PromptTesting and quality
Flaky-test hunt
Finds tests that pass and fail at random and fixes the root cause instead of retrying them.
How each pass goes
- Run the suite many times to find unstable tests.
- Pick one and find why it flips (timing, order, shared state).
- Fix the cause and rerun to prove it is stable.
Stops when
The test passes on every one of many runs.
Starter prompt
Run the test suite 20 times and list tests that both passed and failed. Take the worst one, find the root cause (timing, ordering, shared state, network), fix it without adding retries or sleeps, then rerun it 20 times. Repeat for the next flaky test.