H.7.7 Flakiness
recommendedReading progress2 helpful
Prerequisites0/2 complete
Articles read
Helpful reading is optional.
Article in preparation — showing conspect notes
Flaky evidence describes the tested state unreliably and weakens every decision that consumes it.
- Keep CI quarantine distinct from Bazel retry metadata such as
flaky = Trueand--flaky_test_attempts. - Detect reproducibility failures, track rates and disruption, and make quarantined evidence and owners visible.
- Set repair expectations from criticality and impact; choose fix, replace, or retire when the deadline fails.
- Route unclear ownership through the integration coordinator without making that role the permanent fixer.
- Investigate timing, shared state, network, environment, and hermeticity causes rather than normalizing retries.