← Zurück zu den Beiträgen
engineering2 Min. Lesezeit

Friday Five #5: Small enough to check

How I hand work to coding agents: a five-field envelope, an eight-field report, and a small program that checks both.

Rob Vasquez·

Five notes from the week. Short on purpose.

  1. Sent: Every handoff I give a coding agent starts as an envelope. It has 5 fields: goal, task, scope, done-when and constraints. Scope is a list of paths. Not a paragraph. Done-when is something I can observe, like "the formatter tests pass". The agent hands back a report with 8 fields, where status is complete, partial or blocked and confidence is high, medium or low, and I don't accept anything outside those words.
  2. Checked: A small program reads both blocks and prints JSON. A report marked complete that also lists blockers fails. So does a duplicate field, an absolute path or a wildcard in the scope. No partial credit. It doesn't guess, it rejects the whole document, and anything over 64 KiB is out. I didn't want a checker that fills in the blanks. The checks and demos are in a public repo, and they don't need any accounts: https://github.com/robvasquez/agent-harness
  3. Limited: Strict, and still not enough. It can't prove the tests ran. A plausible false report can pass, and I don't trust one just because it's tidy. So I read the diff myself, and a separate review pass checks the work. In September that pass caught a save that waited on cache invalidation while every test was green, and one regression test now holds invalidation open.
  4. Gated: I've got a gate for outbound text in the same repo. It blocks a commit message or pull request body with a local path or an internal marker, and it tells me why. `make demo` blocks a sample body, then accepts the fixed one. Anyone can skip it. The README says so.
  5. Asking: How do you check what an agent tells you it did? Do you read the diff, the report, or both?
FridayFiveAIAgentsCodeReview

Brauchst du einen praktischen Weg zu KI-gestützter Auslieferung?

Beginne mit einem KI-Readiness-Audit zum Festpreis und geh mit einer konkreten Roadmap.

KI-Readiness-Audit ansehen