NTH Bootcamp · Interactive companions

Modules

Five live, in-browser playgrounds that mirror the bootcamp pipeline — from camera to cortex. Each page sits next to a Jupyter notebook and is meant to build intuition before (or alongside) the code.

Pipeline: camera → gaze → stim → phosphenes → decoding NTH: neurotechhub.org Code: github.com/NeuroTechHub/AIMD_bootcamp

Contributors

Antonio Lefteris Jorge Patricija Cesc Stijn Samantha Radovan
M1
Camera + CV
M2
Gaze
M3
Stimulation
M4
Phosphenes
M5
Decoding

01The loop in one picture

The five modules below run open-loop end-to-end: image → stim → phosphenes. The loop closes when a decoder reads the phosphenes back out and that readout drives the next stim. M5 wires this up live in your browser.

CAMERA scene in VISION MODEL edges / mask STIM current per ch. DYNAPHOS phosphenes DECODER readout READOUT brightness / label PID · ∇ error → PID · gradient → end-to-end training GAZE crop centre

Hover any node for a one-line tour · click to jump to that module.

The forward chain runs across M1–M4. The dashed pink arrow on the bottom is what M5 wires up: the decoder’s readout flows back into the next stim command (PID) or into the vision model’s weights (end-to-end training).

02Modules

Open any card to jump straight into the interactive companion for that step of the pipeline.

M1 · Playground

Computer vision

How a computer turns a photo into information — before any of it reaches the brain. Try pixel-level operators, edge detection, and a YOLO demo on your own webcam.

Topics Sobel · Canny · Threshold · YOLO · Webcam
M2 · Companion

Gaze & DeepGaze

Why a visual prosthesis cares where the user is looking. Heatmaps vs scanpaths, history-aware saliency, and how DeepGaze III predicts the next fixation.

Topics Saliency · Scanpaths · DeepGaze III · Trajectories
M3 · Companion

Neuromodulation & stimulation

How a cortical prosthesis turns numbers into firing. One biphasic pulse, one Utah-array config table, one real-time stimulator with safety chips.

Topics Biphasic pulses · Utah array · Safety limits · Charge balance
M4 · Playground

Phosphene simulator

A live mirror of the dynaphos equations. Move sliders, watch the basis change, paint a stimulus directly onto the visual field.

Topics Single phosphene · Population · Forward map · Temporal dynamics · Paint
M5 · Companion EXPERT · OPTIONAL

Decoding & closed loop

Pretrained decoder demo first, then train your own. End-to-end co-optimization through the differentiable simulator, and a minimal closed-loop demo. Optional / expert track — goes deeper than M1–M4.

Topics Pretrained · Train your own · End-to-end · Closed loop