<?xml version="1.0" encoding="UTF-8"?>
<rss version="2.0" xmlns:atom="http://www.w3.org/2005/Atom" xmlns:dc="http://purl.org/dc/elements/1.1/">
  <channel>
    <title>DEV Community: Chenhui Lucia Wu</title>
    <description>The latest articles on DEV Community by Chenhui Lucia Wu (@chenhuiluciawu).</description>
    <link>https://dev.to/chenhuiluciawu</link>
    <image>
      <url>https://media2.dev.to/dynamic/image/width=90,height=90,fit=cover,gravity=auto,format=auto/https:%2F%2Fdev-to-uploads.s3.us-east-2.amazonaws.com%2Fuploads%2Fuser%2Fprofile_image%2F4248524%2Fd6e5a973-a34d-40c3-9c66-3087f4bdf086.png</url>
      <title>DEV Community: Chenhui Lucia Wu</title>
      <link>https://dev.to/chenhuiluciawu</link>
    </image>
    <atom:link rel="self" type="application/rss+xml" href="https://dev.to/feed/chenhuiluciawu"/>
    <language>en</language>
    <item>
      <title>Katse: Don't read the AI's change. Reproduce it. (Junction 2026)</title>
      <dc:creator>Chenhui Lucia Wu</dc:creator>
      <pubDate>Mon, 16 Nov 2026 21:31:26 +0000</pubDate>
      <link>https://dev.to/chenhuiluciawu/katse-dont-read-the-ais-change-reproduce-it-junction-2026-31eo</link>
      <guid>https://dev.to/chenhuiluciawu/katse-dont-read-the-ais-change-reproduce-it-junction-2026-31eo</guid>
      <description>&lt;p&gt;&lt;em&gt;This is a submission for the &lt;a href="https://dev.to/mlh-hackathon"&gt;MLH x DEV Writing Challenge&lt;/a&gt;&lt;/em&gt;&lt;/p&gt;

&lt;h2&gt;
  
  
  What I Built
&lt;/h2&gt;

&lt;p&gt;AI writes code faster than anyone can read it, so people end up just pressing Enter. And asking &lt;em&gt;another&lt;/em&gt; AI "is this fine?" doesn't solve anything: "the AI said it was fine" is exactly what Tieto's challenge at Junction 2026, &lt;strong&gt;Earned Trust in AI Code&lt;/strong&gt;, ruled out.&lt;/p&gt;

&lt;p&gt;So with my team (GOATiers) we built &lt;strong&gt;Katse&lt;/strong&gt;: a PR review tool that lets a &lt;strong&gt;named human sign every AI-written change without reading every line&lt;/strong&gt;.&lt;/p&gt;

&lt;p&gt;The idea comes from outside software:&lt;/p&gt;

&lt;ul&gt;
&lt;li&gt;🔬 Science doesn't trust a paper because a reviewer read it twice. It trusts it when &lt;strong&gt;another lab reproduces it&lt;/strong&gt;.&lt;/li&gt;
&lt;li&gt;🏦 Banks don't re-read every entry. They &lt;strong&gt;reconcile two independent ledgers&lt;/strong&gt; and only look at the mismatch.&lt;/li&gt;
&lt;/ul&gt;

&lt;p&gt;An agent's change is cheap to produce, so it's cheap to &lt;em&gt;reproduce&lt;/em&gt;. Katse rebuilds the change blind with several agents from different model families, runs the tests, attacks the result and compares everything against the original requirement. What reproduces, is proved, or passes a test that actually bites is backed by evidence. What doesn't is the &lt;strong&gt;residue&lt;/strong&gt;: the only part the human owner reads, questions and signs.&lt;/p&gt;

&lt;p&gt;Two rules hold everywhere:&lt;/p&gt;

&lt;ol&gt;
&lt;li&gt;&lt;strong&gt;Evidence is executable, or it isn't evidence.&lt;/strong&gt;&lt;/li&gt;
&lt;li&gt;
&lt;strong&gt;Consensus directs attention. It never approves.&lt;/strong&gt; Katse has no approve button and never merges.&lt;/li&gt;
&lt;/ol&gt;

&lt;p&gt;On Tieto's sample change (#2283, a 228-line agent-written crash fix) Katse compiled it on the pinned base, saw 3/3 new tests go red→green, ran 174/174 regression tests, caught 3/4 seeded bugs, and threw out a planted false accusation by running it. It also &lt;strong&gt;refused to decide&lt;/strong&gt; one thing: the fix silently drops some diagnostics, which the requirement never asked for. That's a product decision, so it became a question for the owner. Result: the human reads &lt;strong&gt;29 of 228 lines plus 2 questions&lt;/strong&gt;.&lt;/p&gt;

&lt;p&gt;Across the four Tieto branches, Katse said "don't trust this yet" as readily as "this is fine". One PR was sent back because 4 of its 10 new tests passed even &lt;em&gt;without&lt;/em&gt; the change.&lt;/p&gt;

&lt;p&gt;&lt;strong&gt;What I learned:&lt;/strong&gt; "blind" is a property of the environment, not of the prompt. Every agent call is code execution, even when you only ask for text. And a reviewer that accuses falsely loses trust as fast as one that lets bugs through.&lt;/p&gt;

&lt;h2&gt;
  
  
  Demo
&lt;/h2&gt;

&lt;p&gt;  &lt;iframe src="https://www.youtube.com/embed/2JLW1lM3XFo" width="710" height="399"&gt;
  &lt;/iframe&gt;
&lt;/p&gt;

&lt;ul&gt;
&lt;li&gt;💻 Code: &lt;a href="https://github.com/janvilaregut/Junction2026" rel="noopener noreferrer"&gt;github.com/janvilaregut/Junction2026&lt;/a&gt;
&lt;/li&gt;
&lt;li&gt;📑 &lt;a href="https://github.com/janvilaregut/Junction2026/blob/main/submission/katse-pitch.pdf" rel="noopener noreferrer"&gt;Slides (PDF)&lt;/a&gt; · 🃏 &lt;a href="https://github.com/janvilaregut/Junction2026/blob/main/CONCEPT_CARD.md" rel="noopener noreferrer"&gt;Concept card&lt;/a&gt; · 🔎 &lt;a href="https://github.com/janvilaregut/Junction2026/blob/main/docs/EVIDENCE.md" rel="noopener noreferrer"&gt;Evidence on #2283&lt;/a&gt;
&lt;/li&gt;
&lt;/ul&gt;

&lt;p&gt;In the UI you see every branch as a tree, a dependency graph where size = blast radius (PageRank) and colour = what maths can prove, the blind rebuilds judged against a quote from the requirement, and finally the screen where &lt;em&gt;you&lt;/em&gt; sign.&lt;/p&gt;

&lt;h2&gt;
  
  
  Partner Technologies
&lt;/h2&gt;

&lt;p&gt;&lt;strong&gt;Entire&lt;/strong&gt; (we were also in the running for &lt;em&gt;MLH Best Use of Entire&lt;/em&gt;). Entire saves the AI session behind every commit directly in git. For a review tool that's huge: Katse can walk back from a change to the &lt;strong&gt;original prompt&lt;/strong&gt; and check whether the code does what was actually asked, not just what the agent decided. We install it inside the repo with a pinned SHA256, and &lt;code&gt;npm run entire -- push&lt;/code&gt; only pushes checkpoints if no secret is found. Being honest: Tieto's branches had no saved prompts, so the demo branches use seeded Entire fixtures (marked as such in the code), and the Tieto reports say "original prompt: not available".&lt;/p&gt;

&lt;p&gt;Rest of the stack:&lt;/p&gt;

&lt;ul&gt;
&lt;li&gt;
&lt;strong&gt;Gemma 4 (local, oMLX / Ollama)&lt;/strong&gt; as a privacy gateway: in strict mode every cloud call must pass a local scan first. If local Gemma is down, &lt;em&gt;nothing&lt;/em&gt; is sent. Fail-closed.&lt;/li&gt;
&lt;li&gt;
&lt;strong&gt;Gemini 4 Hydrogen / Carbon&lt;/strong&gt; for the contract, blind rebuilds and the judge (who must quote the requirement).&lt;/li&gt;
&lt;li&gt;
&lt;strong&gt;NVIDIA Nemotron 3.5 Super&lt;/strong&gt; as a second model family, so agreement isn't one model agreeing with itself.&lt;/li&gt;
&lt;li&gt;
&lt;strong&gt;Gemini Live&lt;/strong&gt; for voice ("Hey Katse").&lt;/li&gt;
&lt;li&gt;
&lt;strong&gt;Node.js&lt;/strong&gt; (no framework), &lt;strong&gt;Roslyn&lt;/strong&gt; and &lt;strong&gt;.NET 8&lt;/strong&gt; for C# symbol analysis and running tests.&lt;/li&gt;
&lt;/ul&gt;

&lt;p&gt;The maths layer (PageRank, proofs, entropy, complexity) has no model in it: no model can turn a node green.&lt;/p&gt;

&lt;h2&gt;
  
  
  Hackathon Experience
&lt;/h2&gt;

&lt;p&gt;I was at &lt;strong&gt;Junction 2026&lt;/strong&gt; in Finland with team &lt;strong&gt;GOATiers&lt;/strong&gt;, and we took &lt;strong&gt;2nd place in Tieto's challenge&lt;/strong&gt; 🥈.&lt;/p&gt;

&lt;p&gt;What broke at 3am? Our own reviewer. In the first full run, the "blind" agents escaped their sandbox and worked inside the original repo, where they could see the answer. We had set each agent's working directory but not &lt;code&gt;PWD&lt;/code&gt;, and the CLI trusted &lt;code&gt;PWD&lt;/code&gt;. Later, the model that was only supposed to &lt;em&gt;write text&lt;/em&gt; (the judge) decided it was a coding task and edited the repo. We only caught it because &lt;code&gt;git status&lt;/code&gt; showed a file modified at the exact second the judge ran. Both are now in our &lt;a href="https://github.com/janvilaregut/Junction2026/blob/main/docs/LESSONS.md" rel="noopener noreferrer"&gt;lessons log&lt;/a&gt;, together with 18 other failure modes, and they became the best answer to the judges' question: &lt;em&gt;"What would make you not trust your own output?"&lt;/em&gt;&lt;/p&gt;

&lt;p&gt;But honestly, the prize was only half of it. ~1,800 hackers, ~800 projects and one sleepless weekend in Finland, building with three absolute legends: Meulén Cirillo Veltri, Jan Vilaregut and Fabián Birch Torrejón 🐐. We met so many amazing people from all over the world, and I'm leaving with new friends and a lot of inspiration.&lt;/p&gt;

&lt;p&gt;Huge thanks to Tieto, the Junction organisers and MLH. 💜&lt;/p&gt;

</description>
      <category>mlhacks</category>
      <category>devchallenge</category>
      <category>hackathon</category>
      <category>ai</category>
    </item>
  </channel>
</rss>
