Data
Attended speaker paradigm (cEEGrid data), OpenNeuro ds004015, released under CC0 by Holtze, Rosenkranz, Jaeger, Debener and Mirkovic (Frontiers in Neuroscience, 2022). 36 people, electrode arcs around both ears, two audiobooks at once from left and right, each person told to follow one side. Three 10 minute blocks per person in which both stories were equally loud.
Pipeline
A causal band pass from 1 to 9 Hz, resampling to 64 Hz, and a linear decoder over half a second of EEG that rebuilds the followed story's loudness over time. A window's verdict is the story whose loudness matches the rebuilt one best.
Testing
Personal decoders were tested on a 10 minute block they never saw; generic ones on a person they never saw, scaled with that person's first two minutes and no labels. The electrode ranking was chosen on the whole group, which can flatter the per ear counts slightly.
Switch time
Minimal expected switch duration (Geirnaert, Francart and Bertrand): the attended voice held in the top 35% of the gain range 80% of the time, with at least five gain steps.
Learned decoder
Two networks of one dimensional convolutions, about 16,000 weights each: one over the eight electrode channels, one over each story's loudness, trained on 5 second crops so that the followed story's embedding moves with the EEG's. Six folds by person, five more people held back to stop training, three networks per fold from different starting points, three different splits of the 36 people. The EEG is scaled from the person's first two minutes and each story by its own running spread; nothing reaches more than 0.44 s ahead. The control rotates both stories 97 s out of step with the EEG.
Trust and belief
Each decoder's ten second decisions on people it never saw fit the weight a decision's margin earns, by maximum likelihood. The belief is a hidden Markov model over the two stories, filtered forward one decision at a time. Its steadiness counts from the second minute of each block; its switch times come from switches simulated halfway through each block, the later decisions counting for the other story.
Limits
Electrode arcs around the ear are not earbuds. Attention here was instructed and held for whole blocks, never switched. A quiet room and people sitting still. These are published research recordings, not Signalive product measurements.
Reproduce it
python3 research/aad/preprocess.pypython3 research/aad/analyze.pypython3 research/aad/export.pypython3 research/aad/calibrate.pyfor s in 7 11 23; do AAD_SEED=$s AAD_ENSEMBLE=3 python3 research/aad/deep.py; donepython3 research/aad/belief.pypython3 research/aad/deep_export.py