The picture says it all. Up top, a row of robots: one hammering away at a typewriter, another painting a landscape, a third spitting images out of a printer. Below them, a conveyor belt carrying it all away. And down at the bottom - wired directly into their heads by a hose - sit the people. Tablets, phones, laptops, eyes bugging out, a thread of drool at the corner of the mouth. Consuming. No pauses, no questions, no blinking.
It's an exaggeration. A caricature. And uncomfortably on point.
Because the question isn't whether the picture is true today. It's how far from it we actually are - and which direction we're drifting.
How we got here
Nobody wakes up one morning and decides to stop thinking. It happens in small, perfectly reasonable steps.
Instead of reading the long article, we have it summarized - who's got the time. Instead of searching and comparing sources, we ask and take the first answer - it sounds confident, after all. Instead of understanding the problem, we have a solution generated - it works, so why dig in.
Each step makes sense on its own. The problem is the sum. Active searching slowly turns into passive intake. "I understand it" becomes "I have it." And between those two sentences there's a chasm.
And then the uncomfortable part: the line separating what a human made from what a machine made gets thinner by the day. An article, a post, an image, a snippet of code, the comment underneath it - who wrote that? More and more often, we can't tell. And worse, we stop asking.
Why developers in particular should care
This isn't abstract philosophy. It has two very concrete dimensions.
The first is personal - skill atrophy. A muscle you don't use gets weaker. Spend five years handing off your debugging, your design, your decisions to a tool, and the ability to do it yourself quietly walks out the door. It won't vanish overnight; it'll vanish in a way you only notice the moment you badly need it - and it's gone. The point isn't to stop using tools. The point is not to lose the ability to tell when a tool is talking nonsense.
The second is systemic - and scarier. Models learn from data. But more and more of the data on the internet is generated by models themselves. A loop forms: AI trained on the output of other AI, not on human work. Researchers call this model collapse - copy of a copy of a copy, where each generation loses a slice of diversity and quality, much like photographing a photograph. The phenomenon was documented by Shumailov et al. in Nature in 20241: when generative models are trained recursively on their own output, the tails of the original data distribution - the rare, unusual cases - disappear first, and the degradation compounds. The human original - that irregular, unpolished, but real thing - is fuel that can't be substituted. And we're starting to stop supplying it.
Add to that the fact that we're simultaneously losing the ability to judge quality, and you get an unpleasant combination: machines produce ever-worse content and people are ever-less able to notice. The funnel tightens from both ends.
A fair caveat, in the spirit of this article: the research isn't unanimous. Later work by Gerstgrasser et al. argues that accumulating real and synthetic data - rather than replacing one with the other - can avoid collapse, and that the most catastrophic predictions assume real data gets deleted entirely, which isn't how the real world works. So treat model collapse as a real risk to manage, not a prophecy. Which is rather the point.
This isn't a manifesto against tools
Before this starts to sound like a sermon from some Luddite who rejects everything invented after the typewriter - it isn't.
These tools are wonderful. I had this very article's structure workshopped and half its phrasing polished in collaboration with a model. It'd be hypocritical to pretend otherwise. The question was never "use them or don't." The question is how.
One distinction helps me: tool versus prosthesis. A tool extends what you can do - makes you faster, lets you reach further, frees your hands for what matters. A prosthesis replaces what you've stopped being able to do. A hammer is a tool. A crutch you've talked a healthy leg into believing it can't walk without is something else.
The same model, the same prompt, can be either one - it depends entirely on what's happening inside your head. "Explain why this solution is failing, so I can spot it myself next time" is a tool. "Give me something that passes so I don't have to think about it" is the first installment on a prosthesis. From the outside, indistinguishable. The difference is all on the inside.
How not to end up hanging under the funnel
There's no heroic resistance here. Just a few habits that keep you in the robot's chair up top instead of sitting you down by the hose below.
Verify. A confident tone isn't proof. Before you adopt anything - especially when it sounds smooth and finished - check it against the source. Five seconds of doubt is what separates you from the role of passive recipient.
Ask smart, don't swallow blind. AI is a phenomenal thinking partner and a lousy replacement for thinking. Use it for questions that move you forward - "what did I miss?", "why isn't this working?", "what's the counterargument?" - not just for answers that spare you the thinking entirely.
Create more than you consume. This is maybe the most important one. Anyone who writes, builds, or designs something original feeds that rare human raw material back into the system. Being a maker instead of a mere channel is almost a political act these days. And it's also the only reliable defense against atrophy: the muscle you use doesn't weaken.
Closing
The picture isn't a prophecy. It's a warning - and the only point of a warning is that it can be avoided.
The robots up top and the people on the hose down below aren't two inevitable categories that history will sort us into. It's a choice. And the nice thing about it is that it doesn't renew once a generation - it renews every single day, in every prompt, in every article you either read or have paraphrased for you, in every thing you either make or just swallow.
The funnel exists. The only question is whether you're standing under it, or operating it.
-
Shumailov, I., Shumaylov, Z., Zhao, Y., Papernot, N., Anderson, R., & Gal, Y. (2024). AI models collapse when trained on recursively generated data. Nature, 631(8022), 755–759. doi:10.1038/s41586-024-07566-y. Earlier preprint: The Curse of Recursion: Training on Generated Data Makes Models Forget, arXiv:2305.17493. Counterpoint: Gerstgrasser et al. (2024), Is Model Collapse Inevitable? Breaking the Curse of Recursion by Accumulating Real and Synthetic Data, arXiv:2404.01413. ↩
Top comments (0)