Benchmarks
Tracks
Each track covers a different part of organoid electrophysiology or closed-loop behavior.
Track 01
Signal Quality
Electrophysiological recording fidelity from the preparation: SNR, channel yield, spike sortability.
Metrics
- Spike SNR
- Active channel ratio
- Sorted units per array
- ISI violation rate
Tasks
- Baseline recording
- Stimulated recording
A closed-loop system cannot score above its recording floor. Signal quality is the baseline precondition for every downstream claim.
Track 02
Responsiveness
Does input change output? Evoked response magnitude, latency, and selectivity under matched controls.
Metrics
- Evoked response effect size
- Response latency
- Pattern selectivity
Tasks
- Evoked vs sham
- Pattern discrimination
Responsiveness separates preparations that merely produce spontaneous activity from those whose activity is contingent on input.
Track 03
Plasticity
Does repeated input durably change the input-to-output mapping? Open-loop plasticity with matched controls.
Metrics
- Paired vs unpaired delta
- Induction half-life
Tasks
- Paired induction
Plasticity is the mechanistic substrate any learning claim depends on. Without paired/unpaired controls, drift and adaptation look identical.
Track 04
Closed-Loop Learning
Task performance under stimulus-contingent feedback, versus matched no-feedback control.
Metrics
- Terminal performance delta
- Learning curve AUC
Tasks
- Closed-loop Pong-like task
- Closed-loop 2AFC
Closed-loop performance improvement (vs control) is the field's operational definition of stimulus-contingent adaptation at the task level. Not a claim about internal cognition.
Track 05
Retention
Does an induced change persist? Re-test at fixed delays against matched pre-induction baseline.
Metrics
- Retention at 1h
- Retention at 24h
- Retention at 7d
Tasks
- Delayed retest
Retention is how a plasticity or learning claim transitions from 'change' to 'memory'. Requires specified delays and no intervening exposure.
Track 06
Reproducibility
Are results stable across batches and labs? Within-lab and cross-lab coefficient of variation on headline metric.
Metrics
- Within-lab CV
- Cross-lab CV
- Independent replications
Tasks
- Replication panel
Per-track scores without reproducibility data hide cross-batch variance. This track is a first-class citizen, not a footnote.