Human-in-the-loop QA: let an AI agent run your test sheet on Android, iPhone, web and desktop — and sign off each case yourself

Most "AI testing" tools aim for the same promise: the AI runs everything and tells you it passed.
When something ships broken anyway, "the AI said it passed" is not an answer anyone accepts. A person is accountable.

git-qa is an open-source human-in-the-loop QA runner built around that fact.
An AI agent works through your test sheet; you watch the live screen and sign off each case with one key.
The evidence records who verified what.

What it does

• Reads a test sheet — a TSV you can write in any spreadsheet: step, expected result
• Drives the target — Android devices and emulators (adb), web pages (Chrome, Edge, Firefox, Safari), desktop apps on macOS and Windows, and iPhone / iPad (USB mirroring; tapping through WebDriverAgent)
• Shows you the live screen while it works, with a marker where it found the expected text
• Lets you place the verdict with one key — D pass, F fail
• Keeps the evidence — run.json plus the screen at the moment of the verdict, per case

The vocabulary is the point

A plain PASS would merge the first two. That merge is exactly what git-qa exists to prevent.

Letting Claude Code test on a real device

git-qa ships an MCP server. An agent such as Claude Code can take screenshots, read the screen,
list what can be pressed and tap it — on Android, web, desktop or iPhone.
You can run a sheet unattended overnight (--no-ui) and review only the failures in the morning.
The pass is still yours to give.

It also refuses sheets that verify nothing: if the expected text was already on screen before the step,
the case is stopped as BLOCKED with a note on how to fix the sheet.

Try it

1. Download from the distribution page (macOS signed and notarized; Windows x64 / ARM64, unsigned) and install Node 22+
2. Enter a handle, pick a device / URL / desktop app, pick a test sheet
3. Start, watch, press D / F

It is beta and MIT-licensed. Bug reports and requests: Issues.