Test levels and the traceability matrix
6 months ago
Smoke, sanity, and regression labels on every test case, plus a coverage matrix that shows you where the gaps are.
Every test case now carries a level: SMOKE for critical paths (auth, checkout, data integrity), SANITY for core features, REGRESSION for edge cases. Qlane assigns a sensible default during generation; you can promote, demote, or archive cases via human-reviewed proposals.
Projects can opt into a post-PR smoke phase: after the main test run, the agent re-runs SMOKE-level cases against the same sandbox and reports combined results back to GitHub. After every smoke phase, qlane suggests promote / demote / archive proposals so the suite stays sharp instead of drifting.
The new coverage matrix is a feature-area × case grid that color-codes pass / fail / no-result so you can spot uncovered functionality at a glance. Filter by level to focus on smoke or regression specifically.
- SMOKE / SANITY / REGRESSION labels with sensible defaults.
- Optional post-PR smoke phase reports back to your PR.
- Promote / demote / archive proposals after every run.
- Coverage matrix grouped by area, filterable by level.