Building an AI test case generator that QA engineers actually trust
Most "AI writes your tests" demos fall apart on real apps. Here is the architecture I landed on after the naive version failed.
15 years building and breaking software. I design test strategies, automate them, and build tools that generate the tests for you.
Not a prompt wrapper. The model only writes at stage three — everything before and after it is deterministic.
Playwright walks the app and captures the accessibility tree at every reachable state.
The route graph collapses into flows — entry point to state change.
Risk-rated cases per flow, then a second pass drops anything the crawler never saw.
Turns a URL into a reviewed, risk-rated test suite in under 10 minutes.
An AI agent that crawls a web app and writes the test cases — then turns them into Playwright or API scripts.
Cut the nightly regression run from 6 hours to 11 minutes and flake to under 1%.
Inherited a 2,400-test suite with a 40% flake rate that nobody trusted. Rebuilt it into a gate the team actually respected.
Most "AI writes your tests" demos fall apart on real apps. Here is the architecture I landed on after the naive version failed.
The bugs that hurt are never the ones in the test plan. Some patterns I keep seeing across teams, products, and decades.