<?xml version="1.0" encoding="UTF-8"?>
<rss version="2.0" xmlns:atom="http://www.w3.org/2005/Atom" xmlns:dc="http://purl.org/dc/elements/1.1/">
  <channel>
    <title>DEV Community: onepersonrd</title>
    <description>The latest articles on DEV Community by onepersonrd (@onepersonrd).</description>
    <link>https://dev.to/onepersonrd</link>
    <image>
      <url>https://media2.dev.to/dynamic/image/width=90,height=90,fit=cover,gravity=auto,format=auto/https:%2F%2Fdev-to-uploads.s3.us-east-2.amazonaws.com%2Fuploads%2Fuser%2Fprofile_image%2F4212252%2Fbf59335d-525e-4f37-8ea2-0e8ac5124746.png</url>
      <title>DEV Community: onepersonrd</title>
      <link>https://dev.to/onepersonrd</link>
    </image>
    <atom:link rel="self" type="application/rss+xml" href="https://dev.to/feed/onepersonrd"/>
    <language>en</language>
    <item>
      <title>4 ways my AI coding agent fooled me (and the check I added for each)</title>
      <dc:creator>onepersonrd</dc:creator>
      <pubDate>Thu, 29 Oct 2026 08:04:28 +0000</pubDate>
      <link>https://dev.to/onepersonrd/4-ways-my-ai-coding-agent-fooled-me-and-the-check-i-added-for-each-4e7b</link>
      <guid>https://dev.to/onepersonrd/4-ways-my-ai-coding-agent-fooled-me-and-the-check-i-added-for-each-4e7b</guid>
      <description>&lt;p&gt;&lt;strong&gt;Summary:&lt;/strong&gt; AI coding agents rarely lie. They do something worse for a one-person shop: they state unverified things in the same confident tone as verified ones. Over a year of running hardware and software development with agents, the failures fell into a few patterns. Each one got a mechanical check that the agent must run and report. The checks are below; the templates that enforce them are in the free &lt;a href="https://github.com/onepersonrd/ai-rd-process-kit" rel="noopener noreferrer"&gt;ai-rd-process-kit&lt;/a&gt;.&lt;/p&gt;

&lt;p&gt;I run a one-person R&amp;amp;D operation that builds small hardware products: boards, firmware, PC tools. Most of the typing is done by Claude Code. There is no second engineer to review its work, so every failure below reached me, and some reached documents other people read. The dates are from my lessons-learned log, which the agent writes itself.&lt;/p&gt;

&lt;h2&gt;
  
  
  1. "Not found" reported as "does not exist"
&lt;/h2&gt;

&lt;p&gt;&lt;strong&gt;What happened.&lt;/strong&gt; I asked the agent whether a standards document contained any provision about a particular activity. It searched for two keywords, found nothing, and reported: &lt;em&gt;no such rule&lt;/em&gt;. A day later, reading the relevant chapter for a different reason, it found the rule, written with different words. The next day it did the same thing in a different domain: it searched a marketplace for competitors with one generic English phrase, reported "no competitor", and the following morning found three competitors under the data source's official name.&lt;/p&gt;

&lt;p&gt;&lt;strong&gt;Why the agent did it.&lt;/strong&gt; A keyword search returning zero results was treated as evidence of absence. The agent did not distinguish "my search found nothing" from "nothing exists", and it did not say which chapters it had &lt;em&gt;not&lt;/em&gt; read.&lt;/p&gt;

&lt;p&gt;&lt;strong&gt;The check I added.&lt;/strong&gt; Any answer of the form "there is no X" must say what was searched (the exact terms), what was read in full, and what was not. Searches for the existence of something run with at least four phrasings: the native-language name, the English name, the official or system name, and the organisation's name. The report says "not found with terms A, B, C, D; chapters 3–5 not read" instead of "none".&lt;/p&gt;

&lt;p&gt;&lt;strong&gt;Outcome.&lt;/strong&gt; The agent now writes "not found with …" by default. It is less satisfying to read and much safer to act on.&lt;/p&gt;

&lt;h2&gt;
  
  
  2. "The sibling project uses the same part" without opening the sibling project
&lt;/h2&gt;

&lt;p&gt;&lt;strong&gt;What happened.&lt;/strong&gt; Two related products share a lot of design. While selecting parts for product A, the agent learned that a driver IC had gone end-of-life, and wrote into the concept document, the part-selection record and a shared knowledge base that product B "uses the same part, so its maintainer must be told". The next day the person who maintains product B sent the current files: B had already moved to a different driver. The only document the agent had was an older change list for B, and it had read "not mentioned in the change list" as "unchanged".&lt;/p&gt;

&lt;p&gt;&lt;strong&gt;Why.&lt;/strong&gt; Absence from an old document was treated as evidence of the current state. The agent wrote into a shared repository without checking with the person who owned the current files.&lt;/p&gt;

&lt;p&gt;&lt;strong&gt;The check.&lt;/strong&gt; Any statement about the &lt;em&gt;current&lt;/em&gt; state of another project cites the file and the date it was read, in the sentence itself. No file, no statement. If the file is not accessible, the answer is "I can't verify; here is what the last document I saw said, dated …".&lt;/p&gt;

&lt;h2&gt;
  
  
  3. Part behaviour written from general knowledge, not the datasheet, and it spread
&lt;/h2&gt;

&lt;p&gt;&lt;strong&gt;What happened.&lt;/strong&gt; The agent selected a motor-driver IC and wrote, into the part-selection record, the hardware spec, the pin assignment, the block diagram and the shared knowledge base, that it had a current-sense output and a sleep pin. When it finally opened the datasheet to build the pin table, neither existed on the exact part number chosen. They are on the "A" variant of the same family. It had taken a research sub-agent's one-line summary ("has current sensing and limiting") as the design basis, and it was the second time in three days the same pattern had occurred. The next day, for a different board, the same sub-agent's summary of which connector carried which bus went into a spec and had to be reversed after the agent read the actual schematic. An optocoupler's output logic had been assumed the wrong way round as well.&lt;/p&gt;

&lt;p&gt;&lt;strong&gt;Why.&lt;/strong&gt; A summary, especially one produced by another agent, looks like a source: to an agent, and, when you are in a hurry, to you. The variant suffix on a part number is exactly the kind of detail a summary drops.&lt;/p&gt;

&lt;p&gt;&lt;strong&gt;The check.&lt;/strong&gt; Technical claims about a specific part, API, or circuit must be made with the primary source open and cited by page or section. Summaries produced by another agent are inputs to be verified, not sources. Shared documents are never updated with unsourced technical text. The agent writes "unverified" and stops.&lt;/p&gt;

&lt;p&gt;&lt;strong&gt;Outcome.&lt;/strong&gt; Fewer paragraphs, more citations, and a rule in the project's instruction file: &lt;em&gt;no unsourced technical claims&lt;/em&gt;. It is the rule I would keep if I could keep only one.&lt;/p&gt;

&lt;h2&gt;
  
  
  4. ERC passed; the netlist had three shorts
&lt;/h2&gt;

&lt;p&gt;&lt;strong&gt;What happened.&lt;/strong&gt; The agent generated a schematic for a small driver board from a written description. The CAD tool's electrical rules check passed. When I had the agent export the netlist and check it with a script, it found a protection diode rotated 90°, shorting two supply rails through its cathode; a pull-up resistor routed onto a data line, shorting a rail to the signal; and a duplicated reference designator. Separately, a standard symbol's pin numbering did not match the package actually ordered (pin 1 was ground on one, base on the other).&lt;/p&gt;

&lt;p&gt;&lt;strong&gt;Why.&lt;/strong&gt; ERC checks pin &lt;em&gt;types&lt;/em&gt; (output into output, unconnected input). It does not check whether nets are connected to the right places. The agent treated "ERC passed" as "the circuit is right". The pin mismatch happened because a library symbol was trusted over the package datasheet.&lt;/p&gt;

&lt;p&gt;&lt;strong&gt;The check.&lt;/strong&gt; After any generated or edited schematic, before layout: export the netlist and script-check that (a) supply and ground domains are separate once isolating parts are removed, (b) every oriented part (diodes, polarised caps, transistors) has its pins on the expected nets, and (c) there are no duplicate designators. Then, for every part that uses a standard symbol, compare pin numbers with the datasheet of the &lt;em&gt;ordered&lt;/em&gt; package, not the family. The script is small. The point is that it runs every time and its result is pasted into the design doc.&lt;/p&gt;

&lt;p&gt;&lt;strong&gt;Outcome.&lt;/strong&gt; Three shorts caught before a board spin. The script lives with the project and the agent runs it without being asked.&lt;/p&gt;

&lt;h2&gt;
  
  
  What the four have in common
&lt;/h2&gt;

&lt;p&gt;None of these is a hallucination in the usual sense. The agent did not invent a library or a function. It &lt;strong&gt;skipped a verification step and reported the result in the same tone as a verified one&lt;/strong&gt;. The fixes are therefore not "better prompts" but &lt;em&gt;forced reporting&lt;/em&gt;: the agent must say what it checked, what it did not, and cite the source, every time, in the sentence, so a tired human can audit it in two seconds.&lt;/p&gt;

&lt;p&gt;Here are the four checks as the agent sees them. The first three are rules 6 and 7 in &lt;code&gt;rules/CLAUDE.md.example&lt;/code&gt; in the kit; the fourth is the prevention line of the netlist entry in &lt;code&gt;templates/lessons-learned.md&lt;/code&gt;.&lt;/p&gt;

&lt;div class="table-wrapper-paragraph"&gt;&lt;table&gt;
&lt;thead&gt;
&lt;tr&gt;
&lt;th&gt;#&lt;/th&gt;
&lt;th&gt;Pattern&lt;/th&gt;
&lt;th&gt;The check the agent must run and report&lt;/th&gt;
&lt;/tr&gt;
&lt;/thead&gt;
&lt;tbody&gt;
&lt;tr&gt;
&lt;td&gt;1&lt;/td&gt;
&lt;td&gt;"Not found" → "does not exist"&lt;/td&gt;
&lt;td&gt;Say the search terms and the chapters not read. Four phrasings minimum.&lt;/td&gt;
&lt;/tr&gt;
&lt;tr&gt;
&lt;td&gt;2&lt;/td&gt;
&lt;td&gt;Current state of another project from memory&lt;/td&gt;
&lt;td&gt;Cite file and date read, or say "can't verify".&lt;/td&gt;
&lt;/tr&gt;
&lt;tr&gt;
&lt;td&gt;3&lt;/td&gt;
&lt;td&gt;Technical detail from general knowledge&lt;/td&gt;
&lt;td&gt;Primary source open and cited, or "unverified". Never into shared docs.&lt;/td&gt;
&lt;/tr&gt;
&lt;tr&gt;
&lt;td&gt;4&lt;/td&gt;
&lt;td&gt;"The tool's check passed" → "it's correct"&lt;/td&gt;
&lt;td&gt;Run the second, independent check (netlist, pin table) and paste the result.&lt;/td&gt;
&lt;/tr&gt;
&lt;/tbody&gt;
&lt;/table&gt;&lt;/div&gt;

&lt;h2&gt;
  
  
  The part that actually changed behaviour
&lt;/h2&gt;

&lt;p&gt;The checks are necessary, but the thing that reduced repeats was making the agent &lt;strong&gt;write its own lessons-learned entry&lt;/strong&gt; immediately after each failure (situation, cause on its own side, prevention) and read that file at the start of every session. Pattern 1 still recurred once, with the marketplace search, after the first entry was written. The second entry says "repeat of the 2026-10-27 pattern", and that is the entry the agent now quotes back to me before answering any "does X exist" question.&lt;/p&gt;

&lt;p&gt;Whether that holds for a year, I will report.&lt;/p&gt;




&lt;p&gt;&lt;em&gt;Drafted with an AI assistant from the author's own work logs and published with the author's approval. Product names and customer details removed. The templates, the rule file and the Claude Code skill are MIT-licensed in &lt;a href="https://github.com/onepersonrd/ai-rd-process-kit" rel="noopener noreferrer"&gt;ai-rd-process-kit&lt;/a&gt;. Previous post: &lt;a href="https://dev.to/onepersonrd/three-documents-that-keep-my-ai-coding-agent-honest-free-templates-claude-code-skill-63f"&gt;Three documents that keep my AI coding agent honest&lt;/a&gt;.&lt;/em&gt;&lt;/p&gt;

</description>
      <category>ai</category>
      <category>productivity</category>
      <category>hardware</category>
      <category>claude</category>
    </item>
    <item>
      <title>Three documents that keep my AI coding agent honest (free templates + Claude Code skill)</title>
      <dc:creator>onepersonrd</dc:creator>
      <pubDate>Wed, 28 Oct 2026 06:06:29 +0000</pubDate>
      <link>https://dev.to/onepersonrd/three-documents-that-keep-my-ai-coding-agent-honest-free-templates-claude-code-skill-63f</link>
      <guid>https://dev.to/onepersonrd/three-documents-that-keep-my-ai-coding-agent-honest-free-templates-claude-code-skill-63f</guid>
      <description>&lt;p&gt;I run a one-person R&amp;amp;D operation that ships small hardware products — boards, firmware, PC tools. Most of the typing is done by AI coding agents (mainly Claude Code). They are fast, and for a year they failed in the same four ways:&lt;/p&gt;

&lt;ul&gt;
&lt;li&gt;They extended the scope without asking.&lt;/li&gt;
&lt;li&gt;They reported "done" without running the test.&lt;/li&gt;
&lt;li&gt;They stated facts they had not checked ("the sibling project uses the same part").&lt;/li&gt;
&lt;li&gt;They repeated the same mistake in the next session.&lt;/li&gt;
&lt;/ul&gt;

&lt;p&gt;None of this was fixed by a better model. It was fixed by a process the agent cannot skip. I've generalized it into a small kit and put it on GitHub under MIT: &lt;strong&gt;&lt;a href="https://github.com/onepersonrd/ai-rd-process-kit" rel="noopener noreferrer"&gt;ai-rd-process-kit&lt;/a&gt;&lt;/strong&gt;.&lt;/p&gt;

&lt;h2&gt;
  
  
  The idea
&lt;/h2&gt;

&lt;p&gt;Before any implementation, the agent writes three documents, and I accept them:&lt;/p&gt;

&lt;ol&gt;
&lt;li&gt;
&lt;strong&gt;Plan&lt;/strong&gt; — scope decided in seven lines (constraints, vision, first release, one-sentence core concept, out of scope, MVP, deferred), completion criteria &lt;em&gt;before&lt;/em&gt; the task list, and a progress scale where &lt;strong&gt;100% means reviewed and tested&lt;/strong&gt;, nothing else.&lt;/li&gt;
&lt;li&gt;
&lt;strong&gt;Design document&lt;/strong&gt; — every chapter created on day one. A chapter that doesn't apply says "N/A (reason)". Rejected options are kept with the reason. Design order is data → functions → UI, because starting from the screen is how you find the missing data at the end.&lt;/li&gt;
&lt;li&gt;
&lt;strong&gt;Requirements ↔ test matrix&lt;/strong&gt; — every requirement has at least one test, every pass criterion is a number, and "not run" is a status that is never reported as "pass".&lt;/li&gt;
&lt;/ol&gt;

&lt;p&gt;Then the agent works in small checked pieces, updates the documents in the same change that alters the design, and when it fails, &lt;strong&gt;it writes the lesson itself&lt;/strong&gt;: situation, cause, prevention. It reads that file at the start of every session.&lt;/p&gt;

&lt;h2&gt;
  
  
  The progress scale (the part people copy first)
&lt;/h2&gt;

&lt;div class="table-wrapper-paragraph"&gt;&lt;table&gt;
&lt;thead&gt;
&lt;tr&gt;
&lt;th&gt;%&lt;/th&gt;
&lt;th&gt;Means&lt;/th&gt;
&lt;/tr&gt;
&lt;/thead&gt;
&lt;tbody&gt;
&lt;tr&gt;
&lt;td&gt;0&lt;/td&gt;
&lt;td&gt;Not started&lt;/td&gt;
&lt;/tr&gt;
&lt;tr&gt;
&lt;td&gt;25&lt;/td&gt;
&lt;td&gt;Started&lt;/td&gt;
&lt;/tr&gt;
&lt;tr&gt;
&lt;td&gt;50&lt;/td&gt;
&lt;td&gt;Draft complete, not self-checked&lt;/td&gt;
&lt;/tr&gt;
&lt;tr&gt;
&lt;td&gt;75&lt;/td&gt;
&lt;td&gt;Waiting for review, or under test&lt;/td&gt;
&lt;/tr&gt;
&lt;tr&gt;
&lt;td&gt;100&lt;/td&gt;
&lt;td&gt;Accepted in review and tests passed&lt;/td&gt;
&lt;/tr&gt;
&lt;/tbody&gt;
&lt;/table&gt;&lt;/div&gt;

&lt;p&gt;Unverified work stays at 75. Where things can be counted, they are counted: &lt;code&gt;tests passed 38/52 → 73%&lt;/code&gt;.&lt;/p&gt;

&lt;h2&gt;
  
  
  Two real lessons from the file
&lt;/h2&gt;

&lt;p&gt;&lt;strong&gt;"Not found" is not "does not exist."&lt;/strong&gt; The agent searched a coding standard for two keywords, found nothing, and reported that no rule applied. The rule existed under different wording. Prevention: questions of the form "is there a rule about X" are answered by reading the relevant chapters, and the report says what was searched and what was not read.&lt;/p&gt;

&lt;p&gt;&lt;strong&gt;ERC passed, the netlist had three shorts.&lt;/strong&gt; An auto-generated schematic passed the electrical rules check. The netlist showed a rotated protection diode shorting two supply rails, a pull-up routed onto a data line, and a duplicated reference designator. Prevention: after generating a schematic, export the netlist and script-check supply/ground separation, polarity of oriented parts and duplicate designators before layout.&lt;/p&gt;

&lt;h2&gt;
  
  
  What's in the kit
&lt;/h2&gt;

&lt;ul&gt;
&lt;li&gt;
&lt;code&gt;templates/&lt;/code&gt; — plan, design doc, requirements↔test matrix, lessons-learned (with four real, anonymized examples)&lt;/li&gt;
&lt;li&gt;
&lt;code&gt;rules/CLAUDE.md.example&lt;/code&gt; — 13 promises for the root of your project&lt;/li&gt;
&lt;li&gt;
&lt;code&gt;skills/rd-process/SKILL.md&lt;/code&gt; — a Claude Code skill: session start, create the docs, work, test, log, session end&lt;/li&gt;
&lt;/ul&gt;

&lt;p&gt;Five-minute setup: copy the templates into &lt;code&gt;docs/&lt;/code&gt;, put the rules in &lt;code&gt;CLAUDE.md&lt;/code&gt;, install the skill, and say "plan this". If the agent starts coding before showing you the scope table, the rules aren't loaded.&lt;/p&gt;

&lt;h2&gt;
  
  
  What it is not
&lt;/h2&gt;

&lt;p&gt;Not a methodology, not a tool, not a prompt pack. Four Markdown files and a habit. It works with any agent that reads an instruction file; the skill is for Claude Code.&lt;/p&gt;

&lt;p&gt;If you try it, I'd like to know which rule your agent broke first. Mine was #4.&lt;/p&gt;

&lt;p&gt;&lt;em&gt;Disclosure: this post and the templates were drafted with an AI assistant from my own work logs and published with my approval.&lt;/em&gt;&lt;/p&gt;

</description>
      <category>ai</category>
      <category>productivity</category>
      <category>programming</category>
      <category>opensource</category>
    </item>
  </channel>
</rss>
