Before more teams relied on it, Aerunit needed to see what its own team couldn’t.
Aerunit hands software stories to AI coding agents, then reviews and merges their work. Founder Mio Nilsson brought in CrashTest AI for an outside view. I ran a custom‑scoped, seven‑step crash test of the whole journey, with eight known defects planted for its code-review agent to find.
- Client
Mio NilssonFounder, Aerunit- Tested by
WoodyLead evaluator, CTAI- Planted defects
- 8
- Evidence
- 63hashed items
01 The stakes
An agent platform can look flawless in a demo and still trip up a new team in ways nobody inside the company sees. Mio was close to the product, and close is where blind spots live.
He wanted the whole journey tested by someone with no stake in the answer, judged against pass criteria we agreed in writing before I touched anything.

“It’s so easy to get blind spots when being too close to the product — really nice and refreshing to get an outside perspective.”
02 The 4-phase crash test
| 01Initial impact | Pass criteria agreed in writing. Answer key sealed up front | Baseline set |
|---|---|---|
| 02Stress testing | Seven steps as a new team. 8 planted defects, 3 review runs | 8/8 every run |
| 03Observe & document | 63 timestamped evidence items, every file hashed | Logged |
| 04Verdict & report | Interactive report, sealed key and 10 product fixes ranked by impact | Delivered |
The headline The code-review agent caught every planted defect in all three runs, with no false positives. Sent back to the coding agent, all eight were fixed and independently confirmed in about 12 minutes.
In the client’s words
“I’ve read through it and it’s very impressive, I really got my money’s worth.”
Mio Nilsson · Founder“I love the way you’re presenting me the report in interactive format, it’s very tidy and easy to read.”
Mio Nilsson · Founder03 What the client walked away with
Summary card from Aerunit’s private report. The score stays private until the re-test.
- A private, interactive report. Every step opens in one click, with its evidence.
- 10 product fixes, ranked by their impact on a new user.
- The sealed answer key, so every code-review result can be checked.
- A re-test path to prove the fixes, published as a before and after.
04 What happens next
This is the mini case study. Aerunit is working through the fixes. Then the same journey is re-tested on fresh defects, and the full before‑and‑after report is published here.
“I’ll definitely recommend you to my friends and co-workers.”
00 Start a conversation Building an AI product or agent workflow? Tell me what you’re working on. I reply personally within 24 hours.
Start a conversation