DEV Community

Sumama-Jameel
Sumama-Jameel

Posted on

Why Coding Agents Still Fail The Same Way Every Time - And What I Did Instead

Coding agents don't fail because they can't type code. They fail because they call the wrong tool, read the wrong error, try again the same wrong way, and get stuck.

I watched that happen over and over in real coding sessions. So I built something to fix it.

What MegaBit is

MegaBit is a data factory. I pick a real open source bug. I revert the fix. I let an agent fix it live inside a sandbox, and I record every command it runs. When the agent's fix breaks its own tests, I keep the failure in the data. When it passes, I keep the patch.

That way the model learns the real path: the wrong turns, the bad tool calls, the recovery, not just the finished diff.

What the AI gets better at

An AI trained on this data gets better at:

  • Coding
  • Planning
  • Tool calls
  • Agentic execution
  • Recovery from failures

The corpus is free and open source. Anyone can check it.

How to check it yourself

To see it in your own terminal:

git clone https://github.com/Sumama-Jameel/megabit-trajectories
cd megabit-trajectories
python3 verify.py
Enter fullscreen mode Exit fullscreen mode

Expected output: 66/66 episodes verified

The honest part

Everything here was built with no team, no investors, no customers, no revenue. Just one engineer doing this from Karachi. No traction claims, no fluff. The work is real, it's public, and you can run it.

Want to help?

If you want to work with us, or you want one of your engineers to help check the data, or you just want to try it yourself, write to me: sumamajamil2005@gmail.com

Follow along: https://github.com/Sumama-Jameel/megabit-trajectories

Top comments (0)