DANDI:000232

Reproducing Chang et al. (2023) from dandiset 000232 28

Notebook reproduce_chang_2023.ipynb

• ✕Not reproducedResults, Pre-stimulus states in motor cortex track behavioral rule switches, paragraph 1; Figure 5Bverifier disagreed at first

  Mice switched before or immediately after the cue on the 9th trial; there were 88 switches into respond-to-touch blocks and 91 into respond-to-light blocks.

  We used the first hit trial as the mark of a successful behavioral switch and found that mice switched before or immediately after the cue (Fig. 5b, total number of block switches: respond-to-touch: 88 switches, respond-to-light: 91 switches)

  Results, Pre-stimulus states in motor cortex track behavioral rule switches, paragraph 1; Figure 5B

  Non-first blocks with a hit, as the criterion and the code's GetFirstHitInfo define them, number 63 (touch) and 75 (light), against 88 and 91. Both counts fail, so two of the three conditions fail and the outcome is not reproduced (round 1 recorded partially reproduced, which the criterion does not allow). The third condition holds; first hits at or before the trial after the cue are 57.1% (touch) and 65.2% (light) of blocks with a cue row, counted in rows of the file, and 55.4% and 62.1% in trial numbers estimated from the gaps between rows. All blocks, including the first of each session, number exactly 88 and 91, and blocks with a hit including first blocks 87 and 91. The code's GetFirstHitInfo returns one entry per block, NaN for first blocks and blocks without a hit, so a count of its entries gives the number of blocks.

  How the test differed from the paper’s method

  • The code numbers trials by the behavioural system, including trials the files lack; first hits are placed relative to the cue row in the files, and as a variant in trial numbers estimated from the gaps between rows (xm.estimated_trial_numbers).
• ✕Not reproducedResults, Disruption of pre-stimulus motor cortical state impairs rule-dependent tactile detection, paragraph 6; Figure 6H, 6I and 6J

  Lick probability on laser-only trials does not change during S1/S2, MM or ALM inhibition in either task, so the behavioural effects are not due to an inability to lick (cross-modal S1/S2 [-0.18, 0.24], MM [-0.31, 0.03], ALM [-0.24, 0.16]; detection S1/S2 [-0.13, 0.31], MM [-0.06, 0.45], ALM [-0.18, 0.34]).

  Lick probability was unaffected during S1, S2, MM and ALM experiments for both tasks, indicating that the behavioral effects were not due to an inability to lick

  Results, Disruption of pre-stimulus motor cortical state impairs rule-dependent tactile detection, paragraph 6; Figure 6H, 6I and 6J

  What the paper reports

  • cross-modal task, S1/S2: hierarchical bootstrap, 95% CI -0.18 to 0.24 (n = 4 mice, 10 sessions)
  • cross-modal task, MM: hierarchical bootstrap, 95% CI -0.31 to 0.03 (n = 4 mice, 11 sessions)
  • cross-modal task, ALM: hierarchical bootstrap, 95% CI -0.24 to 0.16 (n = 4 mice, 10 sessions)
  • detection task, S1/S2: hierarchical bootstrap, 95% CI -0.13 to 0.31 (n = 3 mice, 3 sessions)
  • detection task, MM: hierarchical bootstrap, 95% CI -0.06 to 0.45 (n = 3 mice, 5 sessions)
  • detection task, ALM: hierarchical bootstrap, 95% CI -0.18 to 0.34 (n = 3 mice, 4 sessions)

  11 of 12 CIs include 0. On short laser-only trials of the detection task, MM inhibition raises the right-lick probability from 0.333 in the inter-trial window to 0.553 in the response window (change 0.258, CI 0.045 to 0.483; 141 trials, 5 sessions, 3 mice); over ten other seeds the lower bound is 0.040 to 0.053, and the other eleven CIs include 0 in every seed. All cross-modal CIs and all long- laser CIs include 0; the paper gives one CI per area and task (MM detection -0.06 to 0.45), without saying which laser duration. The windows are the code's (GetBehavInfo, GetBehavInfo_tDetection). In the cross-modal task, licks on short laser-only trials are scored 0 to 2 s after the laser offset, in the detection task -0.8 to 1.2 s from it, which covers the laser. The paper's cross-modal CIs match the long-laser rows (MM -0.312 to 0.030 against -0.31 to 0.03), so the criterion's twelve CIs test more than the paper reports. Its detection CIs match neither the short, the long nor the pooled rows (the code's "all laser trials"; pooled MM 0.020 to 0.274 also excludes 0). A rise in licking does not bear on the paper's point that inhibition does not prevent licking.

  How the test differed from the paper’s method

  • The paper reports one CI per area and task; short and long laser-only trials were tested apart, as the code computes them.
• ◐Partially reproducedResults, Task rules modulate touch-evoked activity of individual neurons in the tactile processing stream, paragraph 4; Figure 1H

  18 to 33% of neurons discriminate tactile hits from tactile correct rejections in the first 150 ms after the stimulus (S1 28.8%, S2 17.9%, MM 32.9%, ALM 23.4%), and most of these respond more in tactile hits (AUC above 0.5).

  We found that 18-33% of neurons in these cortical areas had area under the receiver-operating curve (AUC) values significantly different from 0.5 ... the majority had enhanced responses (AUC > 0.5) to tactile stimuli that were behaviorally relevant

  Results, Task rules modulate touch-evoked activity of individual neurons in the tactile processing stream, paragraph 4; Figure 1H

  S1 30.5, S2 16.7 and ALM 23.0% are within tolerance; MM is 36.4% against 32.9 plus or minus 3.29, and above the stated range widened by 10%. Over four other seeds MM gives 35.0 to 36.4%, S1 28.2 to 30.5, S2 17.9 to 19.1 and ALM 21.9 to 25.0%. MM is within tolerance in 3 of the 5 seeds, and the five-seed means (S1 29.7, S2 18.1, MM 35.6, ALM 23.1%) are all within tolerance, so the partial outcome depends on the bootstrap draw; it is judged on the main seed. 165 of 191 selective neurons (86.4%) have mean AUC above 0.5, as the claim states.

  How the test differed from the paper’s method

  • The bootstrap resamples are shared by all units and bins of a session; the code draws them separately. Each unit's interval depends only on its own resamples.
• ◐Partially reproducedResults, Pre-stimulus activity of single neurons signals task rules, paragraph 1; Figure 2C

  Before the stimulus (-100 to 0 ms), fewer than 5% of neurons in S1 and S2 discriminate the rule, while about 10 to 20% do in MM and ALM (S1 4.5%, S2 2.5%, MM 21.4%, ALM 10.2%).

  Less than 5% of neurons in S1 and S2 showed significant rule discriminability, while MM and ALM had around 10-20% significant neurons (Fig. 2c; S1: 4.5%, 177 neurons; S2: 2.5%, 162 neurons; MM: 21.4%, 140 neurons; ALM: 10.2%, 256 neurons

  Results, Pre-stimulus activity of single neurons signals task rules, paragraph 1; Figure 2C

  S2 2.5, MM 20.0 and ALM 9.8% are within tolerance; S1 is 5.6% (10 neurons) against 4.5% (8 neurons). Over the main seed and four others S1 gives 3.4 to 5.6% and is within tolerance in none (9 neurons, 5.1%, is just above it); ALM is within tolerance in 2 of 5. The five-seed means (S1 5.0, S2 2.8, MM 20.7, ALM 9.9%) are all within tolerance. The outcome is judged on the main seed. MM and ALM each exceed S1 and S2, as the claim states.

• ◐Partially reproducedResults, Separation of pre-stimulus states predicts subsequent divergent processing, paragraph 1; Figure 4B and 4C

  Sessions with a larger pre-stimulus distance between tactile hit and correct rejection trajectories (top 50% of 40 sessions) show a larger distance after the stimulus than the bottom 50% (permutation test, p < 0.001).

  The top 50% group showed a larger mean distance between tHit and tCR trajectories after stimulus onset compared with the bottom 50% group

  Results, Separation of pre-stimulus states predicts subsequent divergent processing, paragraph 1; Figure 4B and 4C

  What the paper reports

  • permutation test, p < 0.001 (n = 40 sessions)

  Top 20 sessions 1.171 against bottom 20 0.966 mean post-stimulus distance, permutation p = 0.004. With the code's normalization (range without the offset 5) p = 0.001. Pre- and post-stimulus mean distances correlate over sessions (Spearman 0.54, p = 0.0004).

  How the test differed from the paper’s method

  • The code's windows are offset by one 10 ms bin from the stated ones; the stated windows are used.
• ◐Partially reproducedResults, Neural subspaces for tactile processing are rule-dependent, paragraph 1; Figure 4E

  In all four areas the subspace overlap of tactile correct rejections with tactile hits (0 to 150 ms) is lower than that of held-out tactile hits (tCR minus control tHit; S1 -0.23, 8 sessions, p = 0.0016; S2 -0.23, 7 sessions, p = 0.0086; MM -0.36, 5 sessions, p < 0.001; ALM -0.35, 11 sessions, p < 0.001; paired t-test).

  For S1, S2, MM and ALM, subspace overlaps for tCR trials were significantly lower than the corresponding subspace overlaps for the control tHit trials

  Results, Neural subspaces for tactile processing are rule-dependent, paragraph 1; Figure 4E

  What the paper reports

  • S1: paired t-test, p = 0.0016 (n = 8 sessions)
  • S2: paired t-test, p = 0.0086 (n = 7 sessions)
  • MM: paired t-test, p < 0.001 (n = 5 sessions)
  • ALM: paired t-test, p < 0.001 (n = 11 sessions)

  Negative in all four areas with p = 0.0007, 0.025, 0.003 and below 0.0001 (8, 7, 5 and 12 sessions), but only S2 is within 10% of the paper. MM and ALM are larger in magnitude than the reported -0.36 and -0.35; the code's single-split procedure repeated 200 times gives 95% ranges of -0.497 to -0.376 (MM) and -0.473 to -0.359 (ALM), which exclude the reported values.

  How the test differed from the paper’s method

  • Sessions with at least 10 units (Methods), 12 ALM sessions; the code keeps more than 10, 11 ALM sessions, as the paper reports. Both are shown and give the same result.
  • Overlaps average 100 random equal splits with offset 5 throughout; the code uses one split drawn separately for each neuron and offsets 5 and 0.01, shown as a variant.
• ◐Partially reproducedResults, Choice coding dimensions change with task rule, paragraph 1; Figure S4E and S4F

  Stimulus coding dimensions are aligned between the two rules in S1, S2 and MM but not in ALM, while choice coding dimensions (lick against no lick) are not aligned in any area (dot product magnitudes, true against shuffled, with 95% CIs).

  In ALM, the dot product magnitudes calculated between stimulus CDs for the two block types were not significantly different from those calculated after shuffling ... S1, S2 and MM had stimulus CDs that were significantly aligned ... the choice CDs for the two block types were not aligned well in S1, S2, MM, or ALM

  Results, Choice coding dimensions change with task rule, paragraph 1; Figure S4E and S4F

  What the paper reports

  • S1 stimulus CD, true: bootstrap, 95% CI 0.34 to 0.66 (n = 10 sessions)
  • S1 stimulus CD, shuffled: bootstrap, 95% CI 0.12 to 0.34 (n = 10 sessions)
  • S2 stimulus CD, true: bootstrap, 95% CI 0.43 to 0.78 (n = 8 sessions)
  • S2 stimulus CD, shuffled: bootstrap, 95% CI 0.13 to 0.31 (n = 8 sessions)
  • MM stimulus CD, true: bootstrap, 95% CI 0.38 to 0.59 (n = 9 sessions)
  • MM stimulus CD, shuffled: bootstrap, 95% CI 0.16 to 0.33 (n = 9 sessions)
  • ALM stimulus CD, true: bootstrap, 95% CI 0.2 to 0.47 (n = 13 sessions)
  • ALM stimulus CD, shuffled: bootstrap, 95% CI 0.13 to 0.31 (n = 13 sessions)
  • S1 choice CD, true: bootstrap, 95% CI 0.15 to 0.43 (n = 10 sessions)
  • S1 choice CD, shuffled: bootstrap, 95% CI 0.12 to 0.33 (n = 10 sessions)
  • S2 choice CD, true: bootstrap, 95% CI 0.11 to 0.33 (n = 8 sessions)
  • S2 choice CD, shuffled: bootstrap, 95% CI 0.13 to 0.32 (n = 8 sessions)
  • MM choice CD, true: bootstrap, 95% CI 0.13 to 0.33 (n = 9 sessions)
  • MM choice CD, shuffled: bootstrap, 95% CI 0.14 to 0.3 (n = 9 sessions)
  • ALM choice CD, true: bootstrap, 95% CI 0.16 to 0.39 (n = 13 sessions)
  • ALM choice CD, shuffled: bootstrap, 95% CI 0.13 to 0.31 (n = 13 sessions)

  Seven of eight judgements match. The MM stimulus CD is not aligned (0.366, CI 0.218 to 0.521, shuffled 0.150 to 0.441), where the paper reports 0.48 against 0.24 with non-overlapping CIs; with the code's sessions of more than 10 units it is 0.295 and also not aligned. S1, S2 and ALM values are close to the paper's (0.557, 0.620, 0.348 against 0.5, 0.62, 0.33).

  How the test differed from the paper’s method

  • All sessions are used, as the paper's session counts state; the code keeps sessions with more than 10 units, shown as a variant.
• ◐Partially reproducedResults, Choice coding dimensions change with task rule, paragraph 2; Figure S4H

  Choice coding dimensions computed from right against left lick trials are still not well aligned between the two rules (true against shuffled; S1 0.39 against 0.2, S2 0.32 against 0.2, MM 0.35 against 0.18, ALM 0.28 against 0.21).

  We found that the orientation of the choice coding dimension in a respond-to-touch block was still not aligned well with that in a respond-to-light block

  Results, Choice coding dimensions change with task rule, paragraph 2; Figure S4H

  What the paper reports

  • S1 true: bootstrap, 95% CI 0.23 to 0.55 (n = 10 sessions)
  • S1 shuffled: bootstrap, 95% CI 0.1 to 0.31 (n = 10 sessions)
  • S2 true: bootstrap, 95% CI 0.18 to 0.46 (n = 8 sessions)
  • S2 shuffled: bootstrap, 95% CI 0.11 to 0.3 (n = 8 sessions)
  • MM true: bootstrap, 95% CI 0.21 to 0.48 (n = 9 sessions)
  • MM shuffled: bootstrap, 95% CI 0.11 to 0.26 (n = 9 sessions)
  • ALM true: bootstrap, 95% CI 0.17 to 0.39 (n = 13 sessions)
  • ALM shuffled: bootstrap, 95% CI 0.12 to 0.31 (n = 13 sessions)

  All four below 0.5; S1, MM and ALM within 0.1 of the paper, S2 0.422 against 0.32. All four CIs overlap the shuffled ones. Over the main seed and four others the S2 mean is 0.420 to 0.425, within 0.1 of the paper in 1 of 5 (0.420); the outcome is judged on the main seed.

  How the test differed from the paper’s method

  • The criterion's "needed condition" first read as each of the four rare categories left 1 of 10 S1 sessions, none in S2 and MM and 1 of 13 in ALM, so it could not decide; following the code's nanmean over stimuli, right- and left-lick trials are pooled over stimuli (at least 2 each, all 40 sessions). The first reading is shown as a variant.
• ◐Partially reproducedResults, Disruption of pre-stimulus motor cortical state impairs rule-dependent tactile detection, paragraph 2; Figure 6C

  Inhibiting MM or ALM before the stimulus reduces tactile detection sensitivity in respond-to-touch blocks, while inhibiting S1/S2, AMM or the sham does not (95% CI of the change; S1/S2 [-0.47, 0.08], MM [-0.65, -0.12], ALM [-0.68, -0.02], sham [-0.12, 0.13], AMM [-0.19, 0.06]).

  Tactile detection sensitivity was significantly decreased when MM and ALM but not S1 and S2 were inhibited during the prestimulus period ... Neither the negative control (sham) condition, nor inhibition of AMM before stimulus onset, showed an effect

  Results, Disruption of pre-stimulus motor cortical state impairs rule-dependent tactile detection, paragraph 2; Figure 6C

  What the paper reports

  • S1/S2: hierarchical bootstrap, 95% CI -0.47 to 0.08 (n = 4 mice, 10 sessions)
  • MM: hierarchical bootstrap, 95% CI -0.65 to -0.12 (n = 4 mice, 11 sessions)
  • ALM: hierarchical bootstrap, 95% CI -0.68 to -0.02 (n = 4 mice, 10 sessions)
  • sham: hierarchical bootstrap, 95% CI -0.12 to 0.13 (n = 7 mice, 28 sessions)
  • AMM: hierarchical bootstrap, 95% CI -0.19 to 0.06 (n = 7 mice, 21 sessions)

  MM -0.390 (CI -0.658 to -0.123) is below 0; ALM -0.373 has a CI of -0.707 to 0.005 when false-alarm trials are also resampled (Methods). S1/S2, sham and AMM include 0. With the code's resampling, which keeps the observed false-alarm rate, ALM is -0.682 to -0.018 and every CI is within 0.03 of the paper's, which would make the claim reproduced. The outcome is judged on the main seed; the ALM upper bound is at the edge of 0. Over ten other seeds it averages -0.001 (SD 0.003, range -0.006 to 0.001) and is below 0 in 7 of 10; with the code's resampling it is below 0 in all ten (mean -0.018). No other Methods-resampling bound of the optogenetic CIs checked over seeds changes side; the figs6b ALM interval with the code's resampling does (upper bound 0.002 on the main draw, below 0 in 9 of 10 other seeds), and the fig6ij laser-only calls keep their side in all ten seeds.

  How the test differed from the paper’s method

  • Hit and false-alarm trials are both resampled; the code resamples hits only, shown as a variant.
• ✓ReproducedResults, Task rules modulate touch-evoked activity of individual neurons in the tactile processing stream, paragraph 3; Figure 1E and 1G; Figure S1K

  Single units were recorded with 64-channel probes in S1 (6 mice, 10 sessions, 177 neurons), S2 (5 mice, 8 sessions, 162 neurons), MM (7 mice, 9 sessions, 140 neurons) and ALM (8 mice, 13 sessions, 256 neurons), one area per session, and in AMM (110 neurons).

  we performed single-unit recordings from sensory and motor cortical areas including S1, S2, MM and ALM ... S1: 6 mice, 10 sessions, 177 neurons, S2: 5 mice, 8 sessions, 162 neurons, MM: 7 mice, 9 sessions, 140 neurons, ALM: 8 mice, 13 sessions, 256 neurons). We recorded from one of these cortical areas per session

  Results, Task rules modulate touch-evoked activity of individual neurons in the tactile processing stream, paragraph 3; Figure 1E and 1G; Figure S1K

  Sessions, mice and units per area match exactly; S1 10, 6, 177; S2 8, 5, 162; MM 9, 7, 140; ALM 13, 8, 256; AMM 110 units in 9 sessions from 7 mice. The units are those left after the paper's quality filter.

• ✓ReproducedFigure 6 legend

  The optogenetic experiments in the cross-modal task comprise S1/S2 (4 mice, 10 sessions), MM (4, 11), ALM (4, 10), sham (7, 28), AMM (7, 21) and PPC (7, 21); in the tactile detection task sham (5, 9), S1/S2 (3, 3), MM (3, 5), ALM (3, 4), AMM (3, 4) and PPC (3, 4).

  S1/S2: 4 mice, 10 sessions; MM: 4 mice, 11 sessions; ALM: 4 mice, 10 sessions. Sham: 7 mice, 28 sessions ... Sham: 5 mice, 9 sessions; S1/S2: 3 mice, 3 sessions; MM: 3 mice, 5 sessions

  Figure 6 legend

  All 24 counts of sessions and mice per optogenetic condition match the Figure 6 legend. The code's performance check, ported here, passes 27 of the 28 cross-modal sham sessions and all other cross-modal sessions.

• ✓ReproducedResults, Task rules modulate touch-evoked activity of individual neurons in the tactile processing stream, paragraph 2; Figure 1D

  Performance was about 75% correct under both rules (respond-to-touch 74 plus or minus 1%, respond-to-light 75 plus or minus 1%, mean and SEM over 12 mice), with no difference between them (paired t-test, p = 0.56).

  We used stimulus strengths ... that yielded performance of approximately 75% correct for both respond-to-touch and respond-to-light blocks (Fig. 1d; touch: 74 ± 1%, light: 75 ± 1% (mean ± sem), p = 0.56, paired sample t-test, n = 12 mice)

  Results, Task rules modulate touch-evoked activity of individual neurons in the tactile processing stream, paragraph 2; Figure 1D

  What the paper reports

  • paired sample t-test, p = 0.56 (n = 12 mice)

  Reading (a), trials as deposited, gives 73.6 plus or minus 0.8% (touch) and 74.8 plus or minus 1.5% (light) over 12 mice, paired t-test p = 0.561, matching the reported 74, 75 and p = 0.56. Reading (b), without the last 20 trials, gives 72.8 and 74.2% (p = 0.558), with the touch value outside tolerance.

  How the test differed from the paper’s method

  • The Methods remove the last 20 trials of each session and the code does not; the files may already lack them. Both readings are shown and reading (a) matches.
• ✓ReproducedFigure 1D legend

  The fractions of trial outcomes were similar under the two rules (touch against light; hit 36 against 35%, correct rejection 38 against 40%, miss 13 against 14%, false alarm 13 against 12%).

  The fractions of trial outcomes were similar between the respond-to-touch and respond-to-light rules (touch vs light: hit (36±1% vs 35±2%); correct rejection (38±1% vs 40±1%); miss (13±1% vs 14±1%); false alarm (13±1% vs 12±1%))

  Figure 1D legend

  Under reading (a) all eight fractions are within the paper's SEM (touch against light; hit 35.6 and 35.2, correct rejection 38.1 and 39.6, miss 13.0 and 13.6, false alarm 13.3 and 11.6%). Reading (b) puts 6 of 8 within. Gaps between rows, which mark removed trials, separate 4.5% of consecutive rows within the last 20 rows of a session against 12.7% earlier; this is consistent with the last rows being the end of the session but does not show it.

• ✓ReproducedResults, Pre-stimulus activity of single neurons signals task rules, paragraph 2; Figure 2D

  As a negative control, almost no neuron discriminates tactile from visual trials before the stimulus (S1 0%, S2 0%, MM 0%, ALM 0.8%).

  As expected, single-unit activity before stimulus onset did not discriminate between tactile and visual trials (Fig. 2d; S1: 0%, 177 neurons; S2: 0%, 162 neurons; MM: 0%, 140 neurons; ALM: 0.8%, 256 neurons)

  Results, Pre-stimulus activity of single neurons signals task rules, paragraph 2; Figure 2D

  0% in S1, S2 and MM and 0.8% (2 neurons) in ALM, as in the paper.

• ✓ReproducedResults, Pre-stimulus activity of single neurons signals task rules, paragraph 2; Figure 2E

  After the stimulus (0 to 100 ms), more than 35% of neurons in S1 and S2 and about 15% in MM and ALM discriminate tactile from visual trials (S1 37.3%, S2 35.2%, MM 15%, ALM 14.1%).

  After stimulus onset, more than 35% of neurons in the sensory cortical areas and approximately 15% of neurons in the motor cortical areas showed significant stimulus discriminability (Fig. 2e; S1: 37.3%, 177 neurons; S2: 35.2%, 162 neurons; MM: 15%, 140 neurons; ALM: 14.1%, 256 neurons)

  Results, Pre-stimulus activity of single neurons signals task rules, paragraph 2; Figure 2E

  All four within tolerance of 37.3, 35.2, 15 and 14.1%.

• ✓ReproducedResults, Pre-stimulus activity of single neurons signals task rules, paragraph 3; Figure 2F

  Among neurons with significant rule discrimination before the stimulus, the pre-stimulus rule preference predicts the rule modulation of the early touch response (0 to 50 ms); Pearson r = 0.93 in MM (30 neurons) and 0.83 in ALM (26 neurons), both p < 0.001 (S1 r = 0.69, 8 neurons, p = 0.056; S2 r = 0.91, 4 neurons, p = 0.093).

  We found that neurons with stronger preference for the respond-to-touch rule before stimulus onset showed larger touch-evoked activity in the respond-to-touch blocks, whereas neurons with a preference for the respond-to-light rule showed larger touch-evoked activity in the respond-to-light blocks

  Results, Pre-stimulus activity of single neurons signals task rules, paragraph 3; Figure 2F

  What the paper reports

  • MM: Pearson correlation, r = 0.93, p < 0.001 (n = 30 neurons)
  • ALM: Pearson correlation, r = 0.83, p < 0.001 (n = 26 neurons)
  • S1: Pearson correlation, r = 0.69, p = 0.056 (n = 8 neurons)
  • S2: Pearson correlation, r = 0.91, p = 0.093 (n = 4 neurons)

  MM r = 0.958 over 28 neurons and ALM r = 0.841 over 25 neurons, both p < 0.001 (paper 30 and 26 neurons). S1 r = 0.681 (10 neurons, p = 0.030) and S2 r = 0.902 (4 neurons, p = 0.0985), against the paper's 0.69 (8 neurons, p = 0.056) and 0.91 (4, p = 0.093).

• ✓ReproducedResults, Pre-stimulus states of neuronal populations reflect task rules, paragraph 2; Figure 3B

  The rule can be decoded from pre-stimulus population activity (-100 to 0 ms) in each area; median LDA accuracy over sessions, true against shuffled, S1 0.61 against 0.5, S2 0.62 against 0.53, MM 0.7 against 0.52, ALM 0.68 against 0.55.

  Pre-stimulus states in S1, S2, MM and ALM could each be used to decode the block type

  Results, Pre-stimulus states of neuronal populations reflect task rules, paragraph 2; Figure 3B

  Shuffled medians are 0.564, 0.532, 0.526 and 0.535; 37 of 40 sessions exceed their shuffled value. The S1 sessions differ from shuffled at Wilcoxon p = 0.055, the others at p below 0.01. The shuffled medians (0.526 to 0.564) are about equal to the larger block's share of correct trials (medians 0.529 to 0.556 by area).

  How the test differed from the paper’s method

  • The Methods name LDA; the code's diagonal LDA is used. The Methods' soft normalization and the code's z-score give the same diagonal LDA predictions.
• ✓ReproducedResults, Pre-stimulus states of neuronal populations reflect task rules, paragraph 3; Figure 3C

  Rule decoding is robust in the motor areas, whose bootstrap 95% CIs of mean accuracy do not overlap those of shuffled data (MM 0.60 to 0.73 against 0.48 to 0.53; ALM 0.56 to 0.66 against 0.49 to 0.54), and limited in the sensory areas, whose true CIs are above 0.5 but overlap the shuffled ones (S1 0.52 to 0.61 against 0.49 to 0.55; S2 0.53 to 0.63 against 0.49 to 0.54).

  activity in the motor cortical areas allowed robust block-type classification (no overlap between bootstrap 95% CIs for the true and shuffled data ... In contrast, the sensory cortical areas showed limited block-type discriminability

  Results, Pre-stimulus states of neuronal populations reflect task rules, paragraph 3; Figure 3C

  What the paper reports

  • MM true accuracy: hierarchical bootstrap, 95% CI 0.6 to 0.73
  • MM shuffled accuracy: hierarchical bootstrap, 95% CI 0.48 to 0.53
  • ALM true accuracy: hierarchical bootstrap, 95% CI 0.56 to 0.66
  • ALM shuffled accuracy: hierarchical bootstrap, 95% CI 0.49 to 0.54
  • S1 true accuracy: hierarchical bootstrap, 95% CI 0.52 to 0.61
  • S1 shuffled accuracy: hierarchical bootstrap, 95% CI 0.49 to 0.55
  • S2 true accuracy: hierarchical bootstrap, 95% CI 0.53 to 0.63
  • S2 shuffled accuracy: hierarchical bootstrap, 95% CI 0.49 to 0.54

  Bootstrap 95% CIs, true against shuffled; MM 0.601 to 0.731 against 0.472 to 0.523; ALM 0.560 to 0.655 against 0.495 to 0.544 (no overlap); S1 0.530 to 0.614 against 0.493 to 0.545; S2 0.528 to 0.619 against 0.488 to 0.539 (overlap). These are within 0.012 of the paper's bounds.

  How the test differed from the paper’s method

  • 200 resamples per area; the code's header sets 100 and its saved file names say 1000.
• ✓ReproducedResults, Pre-stimulus states of neuronal populations reflect task rules, paragraph 3; Figure 3D and 3E; Figure S3C and S3D

  Population activity discriminates tactile from visual trials after the stimulus (0 to 100 ms) but not before it (-100 to 0 ms).

  we found that neural population activity could be used to discriminate between stimulus types (tactile vs visual) after stimulus onset (Fig. 3e and Fig. S3d; 0 to 100 ms relative to stimulus onset) but not before stimulus onset

  Results, Pre-stimulus states of neuronal populations reflect task rules, paragraph 3; Figure 3D and 3E; Figure S3C and S3D

  Before the stimulus true means 0.495 to 0.509 with CIs overlapping shuffled in all areas; after it 0.642 (MM) to 0.805 (S2), no overlap in any area.

• ✓ReproducedResults, Pre-stimulus states of neuronal populations reflect task rules, paragraph 2; Figure S3A and S3B

  Support vector machines and random forests decode the rule from pre-stimulus activity about as well as LDA (median accuracy true against shuffled; SVM S1 0.6 against 0.53, S2 0.61 against 0.51, MM 0.71 against 0.51, ALM 0.65 against 0.52; random forests S1 0.59 against 0.52, S2 0.6 against 0.52, MM 0.65 against 0.49, ALM 0.7 against 0.5).

  Support vector machine (SVM) and Random Forest classifiers showed similar decoding abilities

  Results, Pre-stimulus states of neuronal populations reflect task rules, paragraph 2; Figure S3A and S3B

  All eight within 10% and above their shuffled medians. With the code's z-score the SVM medians are 0.575, 0.603, 0.701 and 0.642.

  How the test differed from the paper’s method

  • scikit-learn's SVC and random forest stand in for MATLAB fitcsvm and TreeBagger with their defaults.
• ✓ReproducedResults, Neural subspaces for tactile processing are rule-dependent, paragraph 2; Figure 4F

  Across sessions, the tCR subspace overlap before the stimulus (-100 to 0 ms) correlates with that after it (Pearson r = 0.68, p < 0.001, 31 sessions).

  We found that, across the cortical areas, the subspace overlaps for tCR trials calculated from periods before and after the tactile stimulus onset were correlated

  Results, Neural subspaces for tactile processing are rule-dependent, paragraph 2; Figure 4F

  What the paper reports

  • Pearson correlation, r = 0.68, p < 0.001 (n = 31 sessions)

  r = 0.688 over 32 sessions (p = 1.3e-05); 0.686 over the code's 31 sessions; the code's single-split procedure gives 0.573 to 0.734 over 200 runs.

• ✓ReproducedResults, Pre-stimulus states in motor cortex track behavioral rule switches, paragraph 2; Figure 5D and 5E

  Over a rule transition, the fraction of trials classified as respond-to-touch from pre-stimulus activity changes progressively in MM and ALM (Kendall's tau, mean and 95% CI; touch to light MM -0.39 [-0.67, -0.11], ALM -0.29 [-0.54, -0.04]; light to touch MM 0.37 [0.07, 0.63], ALM 0.27 [0.03, 0.49]).

  For respond-to-touch to respond-to-light block transitions, the fractions of trials classified as respond-to-touch for MM and ALM decreased progressively over the course of the transition ... the fractions of trials classified as respond-to-touch increased progressively

  Results, Pre-stimulus states in motor cortex track behavioral rule switches, paragraph 2; Figure 5D and 5E

  What the paper reports

  • MM, touch to light: Kendall's tau, bootstrap CI, tau = -0.39, 95% CI -0.67 to -0.11 (n = 9 sessions)
  • ALM, touch to light: Kendall's tau, bootstrap CI, tau = -0.29, 95% CI -0.54 to -0.04 (n = 13 sessions)
  • MM, light to touch: Kendall's tau, bootstrap CI, tau = 0.37, 95% CI 0.07 to 0.63 (n = 9 sessions)
  • ALM, light to touch: Kendall's tau, bootstrap CI, tau = 0.27, 95% CI 0.03 to 0.49 (n = 13 sessions)

  Touch to light MM -0.401 [-0.667, -0.111], ALM -0.302 [-0.538, -0.051]; light to touch MM 0.382 [0.074, 0.630], ALM 0.268 [0.026, 0.513]; all within 0.04 of the paper's values and bounds.

  How the test differed from the paper’s method

  • LDA with Ledoit-Wolf shrinkage stands in for the code's optimized LDA; 500 resamples (code 1000).
• ✓ReproducedResults, Pre-stimulus states in motor cortex track behavioral rule switches, paragraph 2; Figure S5

  Classification of trials in S1 and S2 shows no clear trend across block transitions (Kendall's tau touch to light S1 -0.16 [-0.43, 0.1], S2 -0.15 [-0.54, 0.21]; light to touch S1 0.21 [-0.07, 0.5], S2 0.25 [-0.17, 0.63]).

  Accuracies for classification of trials by block type based on S1 and S2 activity were uniformly poor and showed no clear trends across block transitions

  Results, Pre-stimulus states in motor cortex track behavioral rule switches, paragraph 2; Figure S5

  What the paper reports

  • S1, touch to light: Kendall's tau, bootstrap CI, tau = -0.16, 95% CI -0.43 to 0.1 (n = 10 sessions)
  • S2, touch to light: Kendall's tau, bootstrap CI, tau = -0.15, 95% CI -0.54 to 0.21 (n = 8 sessions)
  • S1, light to touch: Kendall's tau, bootstrap CI, tau = 0.21, 95% CI -0.07 to 0.5 (n = 10 sessions)
  • S2, light to touch: Kendall's tau, bootstrap CI, tau = 0.25, 95% CI -0.17 to 0.63 (n = 8 sessions)

  S1 -0.163 [-0.433, 0.117] and 0.219 [-0.067, 0.500]; S2 -0.140 [-0.500, 0.250] and 0.259 [-0.105, 0.620]; all include 0. The 10-fold estimates without resampling are as large in S1 and S2 as in MM and ALM (S2 to touch 0.583, MM 0.519), so the absence rests on wide CIs from 10 and 8 sessions.

• ✓ReproducedResults, Disruption of pre-stimulus motor cortical state impairs rule-dependent tactile detection, paragraph 2; Figure S6B

  The loss of tactile sensitivity with pre-stimulus inhibition is mainly a fall in the tactile hit rate (95% CI of the change; S1/S2 [-0.31, 0.01], MM [-0.49, -0.15], ALM [-0.46, -0.07]).

  This was primarily due to a reduction in the tactile hit rate

  Results, Disruption of pre-stimulus motor cortical state impairs rule-dependent tactile detection, paragraph 2; Figure S6B

  What the paper reports

  • S1/S2: hierarchical bootstrap, 95% CI -0.31 to 0.01 (n = 4 mice, 10 sessions)
  • MM: hierarchical bootstrap, 95% CI -0.49 to -0.15 (n = 4 mice, 11 sessions)
  • ALM: hierarchical bootstrap, 95% CI -0.46 to -0.07 (n = 4 mice, 10 sessions)

  MM -0.318 (-0.492 to -0.152), ALM -0.227 (-0.463 to -0.007), S1/S2 -0.147 (-0.303 to 0.010). The ALM upper bound is close to 0. Over ten other seeds it is below 0 in all ten (mean -0.004, SD 0.002). The code's resampling is the same procedure here, as there is no false-alarm group; its draw gives 0.002 and is below 0 in 9 of 10 other seeds.

• ✓ReproducedResults, Disruption of pre-stimulus motor cortical state impairs rule-dependent tactile detection, paragraph 2; Figure 6D

  Inhibiting S1/S2, MM or ALM from the stimulus onset reduces tactile sensitivity (95% CI S1/S2 [-0.67, -0.08], MM [-0.6, -0.34], ALM [-0.55, -0.27]).

  inhibition of these cortical areas after stimulus onset reduced detection sensitivity for tactile stimuli

  Results, Disruption of pre-stimulus motor cortical state impairs rule-dependent tactile detection, paragraph 2; Figure 6D

  What the paper reports

  • S1/S2: hierarchical bootstrap, 95% CI -0.67 to -0.08 (n = 4 mice, 10 sessions)
  • MM: hierarchical bootstrap, 95% CI -0.6 to -0.34 (n = 4 mice, 11 sessions)
  • ALM: hierarchical bootstrap, 95% CI -0.55 to -0.27 (n = 4 mice, 10 sessions)

  S1/S2 -0.389 (-0.699 to -0.080), MM -0.487 (-0.612 to -0.327), ALM -0.402 (-0.568 to -0.253).

• ✓ReproducedResults, Disruption of pre-stimulus motor cortical state impairs rule-dependent tactile detection, paragraph 3; Figure S7G and S7H

  Visual detection sensitivity in respond-to-light blocks falls with pre-stimulus inhibition of MM [-0.6, -0.18] and AMM [-0.35, -0.08] but not of ALM [-0.5, 0.04] or S1/S2 [-0.27, 0.05]; with inhibition from the stimulus onset it falls for MM, ALM and AMM but not for S1/S2 [-0.44, 0.04].

  Visual detection sensitivity was not affected when S1 and S2 were inhibited before ... visual detection sensitivity was decreased when MM and AMM but not ALM were suppressed ... Inhibition of any of the three motor cortical areas after stimulus onset caused a reduction in visual sensitivity

  Results, Disruption of pre-stimulus motor cortical state impairs rule-dependent tactile detection, paragraph 3; Figure S7G and S7H

  What the paper reports

  • S1/S2, before the stimulus: hierarchical bootstrap, 95% CI -0.27 to 0.05
  • S1/S2, after the stimulus onset: hierarchical bootstrap, 95% CI -0.44 to 0.04 (n = 4 mice, 10 sessions)
  • MM, before the stimulus: hierarchical bootstrap, 95% CI -0.6 to -0.18 (n = 4 mice, 11 sessions)
  • ALM, before the stimulus: hierarchical bootstrap, 95% CI -0.5 to 0.04 (n = 4 mice, 10 sessions)
  • AMM, before the stimulus: hierarchical bootstrap, 95% CI -0.35 to -0.08 (n = 7 mice, 21 sessions)
  • MM, after the stimulus onset: hierarchical bootstrap, 95% CI -0.83 to -0.52
  • ALM, after the stimulus onset: hierarchical bootstrap, 95% CI -0.84 to -0.39
  • AMM, after the stimulus onset: hierarchical bootstrap, 95% CI -0.72 to -0.36

  All eight judgements match; pre MM -0.603 to -0.173, AMM -0.356 to -0.082, ALM -0.494 to 0.050, S1/S2 -0.282 to 0.070; post MM -0.839 to -0.518, ALM -0.870 to -0.385, AMM -0.725 to -0.353, S1/S2 -0.460 to 0.045.

• ✓ReproducedResults, Disruption of pre-stimulus motor cortical state impairs rule-dependent tactile detection, paragraph 4; Figure 6C and 6D; Figure S7G and S7H

  Inhibiting PPC before or after the stimulus onset reduces both tactile and visual detection sensitivity (tactile pre [-0.4, -0.06], post [-0.43, -0.04]; visual pre [-0.31, -0.05], post [-0.54, -0.07]).

  Detection sensitivities for both tactile and visual stimuli were decreased when PPC was inhibited before ... or after the stimulus onset

  Results, Disruption of pre-stimulus motor cortical state impairs rule-dependent tactile detection, paragraph 4; Figure 6C and 6D; Figure S7G and S7H

  What the paper reports

  • tactile, before the stimulus: hierarchical bootstrap, 95% CI -0.4 to -0.06
  • visual, before the stimulus: hierarchical bootstrap, 95% CI -0.31 to -0.05
  • tactile, after the stimulus onset: hierarchical bootstrap, 95% CI -0.43 to -0.04
  • visual, after the stimulus onset: hierarchical bootstrap, 95% CI -0.54 to -0.07

  Tactile pre -0.408 to -0.052, post -0.466 to -0.009; visual pre -0.333 to -0.031, post -0.555 to -0.070. The tactile post upper bound is below 0 in all ten other seeds (mean -0.011, SD 0.003).

• ✓ReproducedResults, Disruption of pre-stimulus motor cortical state impairs rule-dependent tactile detection, paragraph 5; Figure 6F and 6G

  In a simple tactile detection task without rule switching, inhibiting S1/S2, MM or ALM after the stimulus onset reduces sensitivity, but inhibiting them before it does not (pre S1/S2 [-0.34, 0.18], MM [-0.23, 0.06], ALM [-0.28, 0.07]; post S1/S2 [-0.59, -0.31], MM [-0.59, -0.25], ALM [-0.45, -0.1]); AMM and PPC have no effect in either window.

  We found that tactile sensitivity was decreased when the sensory and motor cortical areas were inhibited after but not before stimulus onset ... Inhibition of AMM and PPC did not influence tactile sensitivity in either inhibition condition

  Results, Disruption of pre-stimulus motor cortical state impairs rule-dependent tactile detection, paragraph 5; Figure 6F and 6G

  What the paper reports

  • S1/S2, before: hierarchical bootstrap, 95% CI -0.34 to 0.18 (n = 3 mice, 3 sessions)
  • MM, before: hierarchical bootstrap, 95% CI -0.23 to 0.06 (n = 3 mice, 5 sessions)
  • ALM, before: hierarchical bootstrap, 95% CI -0.28 to 0.07 (n = 3 mice, 4 sessions)
  • S1/S2, after: hierarchical bootstrap, 95% CI -0.59 to -0.31
  • MM, after: hierarchical bootstrap, 95% CI -0.59 to -0.25
  • ALM, after: hierarchical bootstrap, 95% CI -0.45 to -0.1
  • AMM, before: hierarchical bootstrap, 95% CI -0.25 to 0.16 (n = 3 mice, 4 sessions)
  • PPC, before: hierarchical bootstrap, 95% CI -0.12 to 0.1 (n = 3 mice, 4 sessions)
  • AMM, after: hierarchical bootstrap, 95% CI -0.17 to 0.18
  • PPC, after: hierarchical bootstrap, 95% CI -0.14 to 0.3

  Pre-stimulus CIs include 0 for S1/S2, MM and ALM; post-stimulus S1/S2 -0.643 to -0.251, MM -0.628 to -0.233, ALM -0.471 to -0.065. AMM and PPC include 0 in both windows.