𝗣𝗼𝘀𝘁 𝟮 — 𝗪𝗵𝘆 𝗠𝗲𝗱𝗶𝘂𝗺 𝗜𝘀𝘀𝘂𝗲𝘀 𝗠𝗮𝘁𝘁𝗲𝗿 (finding medium software engineering issues, within a #codebase)

𝗦𝗲𝗿𝗶𝗲𝘀: 𝗧𝗵𝗲 𝟭.𝟵𝟲% 𝗚𝗮𝗽 - Medium Issues

A model cannot learn medium-tier reasoning from one prompt, one shot. Here is where #HumanintheLoop comes in.

This is the part most people miss.

Medium issues force the model to confront things it cannot shortcut: the underlying intent of the code, the expected behavior, the conditions that must remain true, and the consequences of a change. These are not “harder bugs” – they are 𝗿𝗲𝗮𝘀𝗼𝗻𝗶𝗻𝗴 𝗽𝗿𝗼𝗯𝗹𝗲𝗺𝘀.

A model cannot learn medium-tier reasoning from one prompt.

It needs a structured loop:
•Identify relevant files
•Describe current vs. expected behavior
•List invariants
•Propose minimal patch
•Apply patch
•Run tests
•Diagnose failures
•Revise patch

This loop is how you train the model to reason – and it’s why medium issues require Human-in-the-loop oversight.

Next, putting reasoning under real pressure for the SWE‑bench.