DEV Community

Cover image for Training the Return: What 111 Randomized Trials Reveal About Attention
Khali Sollis
Khali Sollis

Posted on

Training the Return: What 111 Randomized Trials Reveal About Attention

You're twenty minutes into a function that finally makes sense. Not "I can explain it" sense — the deeper kind, where the whole call stack is loaded into working memory at once and you can feel the shape of the bug before you've located it. A message notification slides in. You answer it, because it takes ten seconds and you're a reasonable person. You come back to the editor.

The cursor is exactly where you left it. The code hasn't changed. But the thing that made it intelligible thirty seconds ago is gone, and you can feel yourself re-reading the same six lines without them landing. The interruption itself took ten seconds. Reconstructing the mental state it displaced takes considerably longer.

This is usually filed under "distraction" and treated as a discipline problem: turn off notifications, use a timer, try harder. But there's a separate, more interesting question buried in that experience, and it happens to be one that meditation researchers have spent the last decade quantifying: what happens when a cognitive system repeatedly practices noticing that attention has wandered, and returning it to a chosen target?

We Might Be Asking the Wrong Question About Focus

The common mental model of "good focus" is something like an uninterrupted beam: a mind that, once aimed, doesn't drift. Under that model, distraction is pure failure, and the goal of any attention-training practice would be to reduce how often the mind wanders in the first place.

Meditation research suggests a different, more testable idea worth taking seriously: mind-wandering may be something to expect rather than a defect to eliminate. What might actually be trainable isn't the absence of wandering. It's the loop around it: how reliably the system detects that it has drifted, disengages from the drift, and gets back to the intended target.

That reframe matters because it changes what a "good" trial looks like. If the goal is zero wandering, most people fail constantly. If the goal is a fast, low-friction return, then every wandering episode becomes a rep — and reps are something a nervous system can plausibly get better at, the way a muscle gets stronger through repeated, effortful contraction rather than through never being asked to contract.

To be clear about what kind of claim this is: no dataset in the meditation literature directly measures "return efficiency" as a stopwatch-timed variable and tracks it across training. This is an interpretive frame suggested by the shape of what these studies do measure — not a demonstrated mechanism. Keep that distinction in mind, because the rest of the article leans on it.

The Loop, as a Framework

Stripped down, the practice that most attention-focused meditation research examines looks like a simple repeating structure:

Choose a target → attention wanders → notice the wandering → disengage from it → return to the target → repeat.

Borrowing lightly from systems language: this isn't a bug being patched. It's closer to a control loop — a process that continuously checks whether the current state has diverged from an intended state, and if so, executes a correction. The "bug" framing implies something is broken. The loop framing implies something is running as designed, and the skill lives in how efficiently the correction step executes.

This is a useful lens, not a proven architecture. Neuroscience hasn't established that the brain literally implements this as a discrete, three-step algorithm. What it has established — carefully, and with real caveats — is what happens behaviorally and functionally when people practice something structurally similar to this loop, over and over, for weeks at a time. That's where the evidence gets specific.

What 111 Randomized Trials Actually Found

The most comprehensive test of this is a 2024 meta-analysis by Nur Hani Zainal and Michelle Newman, published in Health Psychology Review, which pooled 111 randomized controlled trials — 9,538 participants across 22 countries — comparing mindfulness-based interventions (MBIs) against no-treatment, waitlist, or active control conditions [1]. Unlike earlier reviews that mixed randomized and non-randomized designs, this one restricted itself to RCTs specifically to control for the confound of who chooses to meditate in the first place.

The analysis tested effects across fifteen distinct cognitive subdomains rather than treating "cognition" as one variable, which is what makes it useful here. The results split cleanly into two piles.

Domains that showed a positive effect: global cognition, executive attention, working memory accuracy, inhibition accuracy, cognitive-flexibility (shifting) accuracy, sustained attention accuracy, a measure of moment-to-moment consistency in sustained attention (intra-individual variability), and subjective cognitive functioning — i.e., how capable people felt their attention was [1]. Effect sizes ranged from small to large, with the strongest effects on global cognition — a composite score aggregating performance across the individual task domains measured, not a proxy for general intelligence or IQ.

Those improved domains — executive attention, working memory accuracy, inhibition, shifting, sustained attention — are what the trials actually measured: task-based accuracy scores on standardized cognitive tests. That's consistent with the return-loop interpretation developed above — goal-maintenance and course-correction are plausible ingredients in tasks that reward accurate inhibition and shifting — but it's worth being precise about the direction of the inference. The meta-analysis did not measure "noticing that attention has wandered" or "returning to a target" directly. It measured performance on lab cognitive tasks. The loop is a frame for interpreting why those particular tasks might improve, not a variable anyone tracked.

Domains that did not show a reliable effect: orienting, processing speed, verbal fluency, episodic memory, cognitive error rates, and the latency — as opposed to accuracy — components of working memory, inhibition, and shifting [1]. In plain terms: people didn't reliably get faster on these tasks. Accuracy moved on a specific cluster of goal-maintenance-flavored measures; raw processing speed and unrelated memory systems like recalling past events did not.

A few moderators are worth flagging, because they cut against a simple "just meditate more" reading. Effect sizes did not depend on how many sessions people did, how long the program ran, or completion rate [1]. They did depend on delivery format: instructor-led, face-to-face training outperformed self-guided formats, and studies of lower methodological quality tended to report larger effects than higher-quality ones [1] — a pattern meta-scientists treat as a caution flag, not a footnote. Effects were also somewhat weaker in older adults and in women, an asymmetry the authors note but don't fully explain.

None of this says mindfulness training makes people smarter, faster, or more broadly capable. It says something narrower and, honestly, more interesting: across a large, randomized evidence base, a specific cluster of goal-maintenance and course-correction functions improved, while several unrelated cognitive systems didn't move at all.

Training Isn't Transfer

If you've spent time optimizing anything — a build pipeline, a training loop, a query — the next idea will feel familiar: improving performance on the exact thing you practiced doesn't guarantee improvement on adjacent things, even things that feel related.

That's essentially what the null results above describe. Practicing "notice the mind has wandered, return to the breath" moved accuracy on tasks involving goal maintenance and course correction. It did not move verbal fluency or episodic memory, which draw on different systems and weren't obviously exercised by the practice. It's worth thinking of this the way you'd think about training specificity anywhere else: getting better at one exercise doesn't automatically transfer to a different one that merely looks related. That's an analogy, not a citation to a separate body of transfer-of-training research — but the pattern in this particular dataset fits it: the gains cluster tightly around the kind of goal-tracking process the practice actually exercises, and stop right at the edge of that cluster.

For anyone who's watched a model overfit to its training distribution, or watched a team get extremely good at one CI pipeline and then struggle the moment the stack changes, this shouldn't be surprising. But it's worth stating explicitly, because the popular version of meditation coverage almost never states it. And that gap — between what a specific, bounded finding supports and what a headline claims — is worth looking at directly.

Where the Abstraction Leaks

Here's a useful historical marker. In 2014, a landmark JAMA Internal Medicine review by Madhav Goyal and colleagues pooled 47 RCTs (3,515 participants) and found moderate evidence that mindfulness programs produced small-to-moderate reductions in anxiety and depression — but found the evidence for effects on attention specifically insufficient or low-quality at the time, alongside similarly weak evidence for sleep, substance use, and eating behavior [2]. Ten years and a much larger, attention-specific evidence base later, Zainal and Newman's 111-trial analysis found consistent, moderate effects on several attention-adjacent cognitive functions [1].

That's not necessarily a contradiction, and it isn't safe to read it as "the earlier review simply missed an effect that was there all along." The two analyses asked somewhat different questions, used different inclusion criteria and outcome measures, and drew on evidence bases separated by a decade. What the contrast reliably shows is how much the empirical landscape changed: by 2024, researchers could aggregate a far larger body of randomized evidence focused specifically on cognitive outcomes than existed in 2013. Whether that's the whole explanation for the different conclusions, or whether differences in methodology also played a role, isn't something these two papers alone can settle. It's also worth noting, per a 2022 review of 44 separate meta-analyses covering 336 RCTs, that effect sizes across the mindfulness literature broadly depend heavily on what the intervention is compared against — effects tend to look larger against passive controls such as waitlists than against credible active comparators (like structured exercise) [3]. That's a caveat for the whole field, not just cognition research, and it's a reason to hold effect sizes loosely rather than as fixed constants.

Here's where the leak happens, concretely. A careful sentence looks like: "Across 111 randomized trials, mindfulness-based interventions produced small-to-moderate improvements in executive attention, working memory accuracy, and sustained attention, without corresponding improvements in processing speed or episodic memory." That sentence is boring, bounded, and defensible.

The version that circulates instead is usually something closer to: "Science proves meditation makes you sharper." Every qualifier — which domains, what kind of intervention, delivered how, compared to what — evaporates in the retelling. The retracted-and-corrected literature on this topic offers a sharper cautionary example: a 2023 anatomical meta-analysis claiming mindfulness produces structural brain changes was retracted in 2025 after it emerged that four null-finding studies, representing 40% of the pooled participants, had been excluded from the analysis. The retraction notice states that this exclusion meant the analysis "was not designed to test the stated hypothesis" it claimed to address, and therefore could not support the paper's conclusions [4]. Forty percent of the participant pool disappearing from the analysis is, on its own, the whole story here. That paper is not cited elsewhere in this piece as evidence of anything, except as an illustration of how easily a headline-friendly brain claim can outrun what the underlying data supports.

What the Evidence Actually Permits Us to Say

Put together, a fair reading of this literature supports something like this: across randomized comparisons, mindfulness-based interventions were associated with improvements in accuracy on a specific cluster of goal-maintenance and course-correction-flavored cognitive tasks — executive attention, working memory, inhibition, shifting, sustained attention — without a matching association for processing speed, verbal or episodic memory, or anything resembling general intelligence. Reported effects appear to depend more on delivery quality than on dose, and — since lower-quality studies in this literature tended to report larger effects — the honest posture toward the size of any individual number here is a cautious one.

That's a smaller claim than "meditation makes you focused." It's also a more useful one, because it suggests a different way to think about the target of training: perhaps not the absence of distraction, but the fidelity of the return.

Whether that generalizes to a debugging session, a code review, or a deep-work block is an open, unanswered question — the trials measured laboratory cognitive tasks, not IDE behavior, and nothing here licenses a claim about programming performance specifically. What the data does support is a narrower shift in how to think about attention itself: not as a beam that either holds or breaks, but as a system that drifts by default — one where a cluster of accuracy-based, goal-maintenance-flavored functions responded to training, in a pattern consistent with, though not direct proof of, the idea that how well it comes back matters as much as whether it wanders at all.

It's also worth saying plainly, since the picture shouldn't be painted as uniformly benign: a 2020 systematic review of adverse events across meditation research found that among the subset of studies that specifically investigated harms, a majority reported at least one adverse event, most commonly anxiety, depressive symptoms, or unusual cognitive experiences [5]. That's not a reason for alarm about a training loop metaphor — it's a reminder that "attention training" in this literature refers to a real, sometimes intense psychological practice, not an abstraction, and the evidence should be read with that in mind.

References

[1] Zainal, N. H., & Newman, M. G. (2024). Mindfulness enhances cognitive functioning: A meta-analysis of 111 randomized controlled trials. Health Psychology Review, 18(2), 369–395. https://doi.org/10.1080/17437199.2023.2248222

[2] Goyal, M., Singh, S., Sibinga, E. M. S., Gould, N. F., Rowland-Seymour, A., Sharma, R., Berger, Z., Sleicher, D., Maron, D. D., Shihab, H. M., Ranasinghe, P. D., Linn, S., Saha, S., Bass, E. B., & Haythornthwaite, J. A. (2014). Meditation programs for psychological stress and well-being: A systematic review and meta-analysis. JAMA Internal Medicine, 174(3), 357–368. https://doi.org/10.1001/jamainternmed.2013.13018

[3] Goldberg, S. B., Riordan, K. M., Sun, S., & Davidson, R. J. (2022). The empirical status of mindfulness-based interventions: A systematic review of 44 meta-analyses of randomized controlled trials. Perspectives on Psychological Science, 17(1), 108–130. https://doi.org/10.1177/1745691620968771

[4] Siew, S., & Yu, J. (2025). Retraction note: Mindfulness-based randomized controlled trials led to brain structural changes: An anatomical likelihood meta-analysis. Scientific Reports, 15, 25545. https://doi.org/10.1038/s41598-025-11069-9

[5] Farias, M., Maraldi, E., Wallenkampf, K. C., & Lucchetti, G. (2020). Adverse events in meditation practices and meditation-based therapies: A systematic review. Acta Psychiatrica Scandinavica, 142(5), 374–393. https://doi.org/10.1111/acps.13225

Top comments (9)

Collapse
 
anne_jacobs_ac166227aa92b profile image
anne jacobs

This is easily one of the most brilliant, intellectually rigorous breakdowns of attention dynamics I’ve ever read! Framing attention not as a unbroken beam, but as a control loop—where mind-wandering is expected and the trainable skill is the fidelity and speed of the return—is a complete paradigm shift. The intellectual honesty in grounding the argument in actual RCT data while highlighting methodological caveats makes this top-tier writing. Incredible work, Khali!

Collapse
 
bellatrix profile image
Bellatrix Ouranos

This is exceptional science writing.

The central reframe—that the trainable skill is not the absence of mind-wandering but the fidelity of the return—is both precise and genuinely useful. Treating every drift as a potential rep rather than a failure changes the entire practice model, and the article keeps that claim carefully interpretive rather than overstated.

What elevates the piece is the disciplined handling of the 111-trial meta-analysis: clear separation of the domains that moved (executive attention, working memory accuracy, sustained attention, inhibition) from those that did not (processing speed, episodic memory, verbal fluency), plus the honest caveats around delivery format, study quality, and the limits of transfer. The contrast with the earlier 2014 Goyal review is handled with equal care—no forced narrative of vindication, just a clear accounting of how the evidence base itself changed.

Especially strong is the insistence on keeping the claim bounded: laboratory task accuracy, not general intelligence, not programming performance, not “meditation makes you sharper.” That restraint is rare and valuable.

Clear, rigorous, and intellectually honest. Outstanding work.

Collapse
 
n_c_e4a8149b59e51d8be77 profile image
N. C.

What stood out most here is the shift from thinking of focus as never getting distracted to thinking of attention as the ability to notice, disengage, and return. The “return” as a repeated rep is such a useful framework because it turns wandering from a failure into part of the training process. I also appreciated how carefully the article separates what the 111 randomized trials actually measured from the broader interpretation being drawn from them. The distinction between improvements in executive attention, working memory accuracy, inhibition, shifting, and sustained attention versus the lack of reliable gains in processing speed or episodic memory makes the findings much more meaningful than the usual “meditation makes you smarter” headline. The discussion of transfer was another highlight—getting better at a specific cognitive process doesn’t automatically mean becoming better at everything. Most importantly, the article models scientific humility while still offering a genuinely interesting idea: perhaps the real skill isn't keeping attention from wandering, but becoming better at finding your way back.

Collapse
 
jfox profile image
Jenna Fox

This reframing of attention really stood out to me. We often treat distraction as the failure and uninterrupted focus as the goal, but the idea of training the return gives attention a much more dynamic definition.

The loop of “notice → disengage → return” is especially compelling. Every moment of wandering becomes less of a mistake and more of an opportunity to practice recovering the intended state.

I also appreciated how carefully the article separates what the 111 randomized trials actually measured from the broader interpretation. The improvements were concentrated in specific areas like executive attention, working memory accuracy, inhibition, shifting, and sustained attention—not a blanket improvement in every aspect of cognition.

The distinction between training and transfer is another important highlight. Better performance on attention-related tasks doesn't automatically mean better performance at everything we care about. That kind of specificity gets lost surprisingly quickly when research becomes a headline.

And the phrase “the fidelity of the return” is probably the idea I’ll remember most. Maybe strong attention isn't a mind that never wanders, but a mind that becomes increasingly capable of noticing where it went and finding its way back.

Collapse
 
patjo profile image
Pat Johansen

Brilliant writing Khali, thank you so much!

Collapse
 
karmen_f883f51347e4136a4e profile image
Mirella

This is such a refreshing piece of science writing because it refuses to turn meditation into a magical cure-all. Instead, it asks a much more interesting question: what exactly might attention training be training?

✨ “Mind-wandering may be something to expect rather than a defect to eliminate.” — This completely reframes the practice. If wandering is inevitable, then the moment of noticing isn't failure. It may actually be the repetition.

✨ “Every wandering episode becomes a rep.” — Such a memorable way to think about meditation. The goal isn't necessarily to hold attention perfectly; it may be to practice recognizing drift and returning without getting lost in it.

✨ “Choose a target → attention wanders → notice the wandering → disengage from it → return to the target → repeat.” — I love how clearly this reduces the practice to a trainable loop. It turns something that can feel abstract into a concrete process.

✨ “This is a useful lens, not a proven architecture.” — This level of scientific restraint is one of the strongest features of the article. The author repeatedly separates an intriguing interpretation from what the studies actually measured.

✨ “The meta-analysis did not measure ‘noticing that attention has wandered’ or ‘returning to a target’ directly.” — This is exactly the kind of qualification that often disappears from popular science. The distinction between measured cognitive performance and an inferred mechanism matters enormously.

✨ “None of this says mindfulness training makes people smarter, faster, or more broadly capable.” — Yes. The specificity here is refreshing. The 111 randomized trials point toward improvements in particular accuracy-based cognitive functions, not some blanket upgrade to human intelligence.

✨ “Training isn’t transfer.” — Another excellent point. Improving performance on particular cognitive tasks doesn't automatically mean every adjacent ability improves too. The null findings are just as informative as the positive ones.

And this line is brilliant:

✨ “A careful sentence looks like… That sentence is boring, bounded, and defensible.”

That should honestly be a motto for communicating science.

The article also deserves credit for keeping the uncomfortable caveats in view: differences between active and passive controls, study quality, delivery format, the limits of laboratory measures, and even reported adverse events.

And then the central idea comes back beautifully:

✨ “Perhaps not the absence of distraction, but the fidelity of the return.”

That is such an elegant reframing.

Maybe attention isn't a beam we succeed or fail at holding perfectly.

Maybe it is a system that wanders—and a skill that can be practiced every time we notice, disengage, and come back.

The wandering isn't necessarily the failure.

The return may be the training.

Collapse
 
rosana_e4663528aeaba0b05b profile image
Rosana

Love the way you write Khali, thank you!

Collapse
 
laurie_s_37847e70cef85a0 profile image
Ron Beg

Appreciate the way you approach the subject with such depth and will be sharing this thanks!

Collapse
 
marieeee profile image
Marie

Outstanding writing thank you for sharing on DEV.to!