Human-in-the-loop QA: let an AI agent run your test sheet on Android, iPhone, web and desktop — and sign off each case yourself

metataro — Tue, 13 Oct 2026 11:51:34 +0000

Most "AI testing" tools aim for the same promise: the AI runs everything and tells you it passed.
When something ships broken anyway, "the AI said it passed" is not an answer anyone accepts. A person is accountable.

git-qa is an open-source human-in-the-loop QA runner built around that fact.
An AI agent works through your test sheet; you watch the live screen and sign off each case with one key.
The evidence records who verified what.

What it does

Reads a test sheet — a TSV you can write in any spreadsheet: step, expected result
Drives the target — Android devices and emulators (adb), web pages (Chrome, Edge, Firefox, Safari), desktop apps on macOS and Windows, and iPhone / iPad (USB mirroring; tapping through WebDriverAgent)
Shows you the live screen while it works, with a marker where it found the expected text
Lets you place the verdict with one key — D pass, F fail
Keeps the evidence — run.json plus the screen at the moment of the verdict, per case

The vocabulary is the point

Value	Meaning
`VERIFIED`	A person put their name on it
`AUTO_PASS`	The AI passed it. Nobody looked
`FAIL`	It failed
`BLOCKED`	Could not run
`SKIP`	Not run

A plain PASS would merge the first two. That merge is exactly what git-qa exists to prevent.

Letting Claude Code test on a real device

git-qa ships an MCP server. An agent such as Claude Code can take screenshots, read the screen,
list what can be pressed and tap it — on Android, web, desktop or iPhone.
You can run a sheet unattended overnight (--no-ui) and review only the failures in the morning.
The pass is still yours to give.

It also refuses sheets that verify nothing: if the expected text was already on screen before the step,
the case is stopped as BLOCKED with a note on how to fix the sheet.

Try it

Download from the distribution page (macOS signed and notarized; Windows x64 / ARM64, unsigned) and install Node 22+
Enter a handle, pick a device / URL / desktop app, pick a test sheet
Start, watch, press D / F

It is beta and MIT-licensed. Bug reports and requests: Issues.

Let Claude Code draw your architecture diagram — and keep the box you moved

metataro — Tue, 13 Oct 2026 05:14:27 +0000

Asking an AI to draw an architecture diagram works fine — the first time.

The trouble starts with the second one. The architecture changes, you ask the AI to update the diagram, and the layout you spent ten minutes tidying is gone. So you stop asking. A month later the diagram is fiction.

zumen is an open-source diagram editor built around that second drawing.

The one idea: the AI may not write where you wrote

A zumen diagram is one YAML file. The AI writes nodes: and edges:. When you drag a box, the position goes into a separate pins: block — and the AI is not allowed to write pins:.

nodes:
  - id: api
    label: Order API
  - id: db
    label: Order DB
edges:
  - from: api
    to: db
pins:
  db:
    position: { x: 40, y: 170 }   # you put it here; regeneration cannot move it

Regenerate as often as you like: the AI rewrites the nodes and edges, your pins stay. Across 10 real AI round trips, every human edit survived; a pin survives regeneration in all 389 bundled example drawings.

Set it up in Claude Code

claude mcp add zumen -- npx -y @metataro/zumen-mcp

Other MCP clients: run npx -y @metataro/zumen-mcp as a stdio server.

The agent gets:

zumen_spec — the format, read first
zumen_examples — 389 worked examples to learn the notation from
zumen_propose — a proposal, shown to you as a diff. There is no tool that writes the file directly; a person presses apply
zumen_inspect — checks for crossings, overlapping boxes, labels that did not fit, lines of different colours running on top of each other
zumen_export — SVG, PNG, Mermaid, draw.io

Show what changed, to people who will never read YAML

From a clone of the repository:

pnpm compare before.zumen.yaml after.zumen.yaml out.svg

Before and after, side by side: new nodes marked, removed ones dotted, and the nodes a person placed marked on both sides — so a reviewer can see at a glance that the hand edits survived.

Not only boxes and arrows

The same small set of primitives draws things most diagram tools never attempt: stage lighting plots in USITT RP-2 notation, pallet loading patterns in isometric (checked against the Japanese Industrial Standards), floor plans with door swings, periodontal charts, transit maps with parallel lines that don't hide each other. All 389 examples are in the gallery.

What it is not

Not a Figma replacement, not a general drawing program, not a web app or real-time collaboration tool. Editing features exist only as far as a person needs them to approve what the AI changed.

DEV Community: metataro