I spent three hours last Tuesday chasing a bug that didn't exist.
The code looked perfect. It was syntactically correct, followed best practices, and even had thoughtful comments explaining what each function did. The problem was that one of those functions was solving a problem I never asked it to solve. Claude had decided, in its infinite pattern-matching wisdom, that my API endpoint needed pagination. I hadn't asked for pagination. I didn't want pagination. But there it was, breaking my response structure in ways that took me longer to diagnose than it would have taken to write the whole thing myself.
This is the 66% problem.
According to Stack Overflow's latest developer survey of over 90,000 developers, 66% said their biggest frustration with AI coding assistants is that the code is "almost right, but not quite." Another 45% said debugging AI-generated code takes more work than it's worth.
I find those numbers oddly comforting. Not because I enjoy suffering, but because it means I'm not losing my mind. The tools that were supposed to make me faster have introduced a new category of bug that didn't exist three years ago: the bug that looks like working code.
Here's the thing about completely wrong code. It fails loudly. It throws errors. It refuses to compile. Your test suite catches it. You fix it and move on with your life. But almost-right code? That's the code that passes your tests, ships to staging, and then does something subtly insane at 2am when your biggest client runs a batch job you forgot they were running.
The old bugs were honest. They announced themselves. These new bugs are polite. They wait.
I've been writing code professionally for decades... I've made every mistake you can make. I've shipped SQL injection vulnerabilities. I've accidentally deleted production data. I once re-imaged over a production database locking myself out.Those were my mistakes, and I understood them immediately when they blew up. The feedback loop was tight: I did something dumb, the system complained, I learned not to do that again.
The AI-generated bugs don't work that way. When something breaks now, my first question isn't "what did I do wrong?" It's "what did the AI do that I didn't notice?" That's a fundamentally different kind of debugging. Instead of understanding my own logic, I'm reverse-engineering someone else's assumptions about what I probably wanted.
Microsoft Research published a study earlier this year that quantified this. They tested nine different AI models on SWE-bench Lite, a benchmark of 300 real-world debugging tasks. The best performer, Claude 3.7 Sonnet, solved 48.4% of them. Less than half. These weren't exotic edge cases. They were the kinds of bugs that wouldn't trip up an experienced developer.
The models are phenomenal at writing code. They struggle to fix it.
This makes a perverse kind of sense when you think about how they work. Code generation is pattern completion. You give the model a prompt, it predicts what code probably comes next based on billions of examples. That's genuinely useful for boilerplate, for syntax you've forgotten, for exploring unfamiliar libraries. But debugging isn't pattern completion. Debugging is hypothesis testing. It requires understanding what the code is supposed to do, what it's actually doing, and why those two things are different.
That "why" is where everything falls apart. The AI doesn't know why your system is architected the way it is. It doesn't know about the business rule your CEO insisted on in 2019 that makes no logical sense but accounts for 40% of your revenue. It doesn't know that your database schema has a quirk because you migrated from Oracle fifteen years ago and nobody wants to touch it. It just sees patterns and matches them.
The METR randomized trial from July 2025 found something that should concern all of us. They had experienced open-source developers complete tasks with and without AI assistance. The AI group was 19% slower on average. But here's the part that keeps me up at night: they believed they were 24% faster. Before starting, participants predicted AI would speed them up. After finishing, even with slower results, they still thought it had helped.
We're not just getting almost-right code. We're getting almost-right code while feeling productive. The dopamine hit of instant completion masks the debugging debt accumulating behind us.
I'm not going to tell you to stop using AI tools. I use them constantly. But I've started treating them differently than I did a year ago. I used to accept suggestions and move on. Now I read every line like it was written by a junior developer who's very confident and moderately competent. Because that's essentially what it is.
The 66% aren't complaining because the tools are bad. They're complaining because the tools are good enough to be dangerous. A hammer that misses the nail is annoying. A hammer that hits almost the right spot is how you end up with a crooked house.
I don't have a solution. I'm not sure anyone does yet. The tools will get better. The context windows will get longer. The models will learn to ask clarifying questions instead of assuming. Maybe.
Until then, I'm keeping my print statements close and my test coverage closer. Some skills don't need to be automated. They need to be sharpened.
Top comments (6)
I always check AI outputs carefully and ask follow-up questions about the code. Sometimes I also go back to the official documentation to verify whether the AI’s output is really correct. Even so, I still miss bugs that I didn’t anticipate.😭
However, AI is improving very quickly and getting better day by day. So I believe that as my skills improve and AI coding improves as well, the number of bugs will decrease in the future.
It really is. I find myself using it more and more for quick analysis when I am strapped for time. It more often than not points me in the right direction but is not quite there in the detailed root causes.
Oh yes, I remember when my UX designer wrote his very first piece of Python code in ChatGPT 😄
It worked at first, but once he asked for “optimization”, something broke. In the end he asked me to take a look. I removed about 80% of the code because it was adding things he didn’t actually need, tweaked the main function a bit - and it worked.
He decided I was a genius after that 😄
HA! That's so funny! 😂
LLMs are great at writing code, but definitely need to be supervised. There's a ton that needs to be built in tooling and workflow to make that process super efficient.
oh, 100%