Automated PR testing
8 months ago
Every pull request now triggers a sandbox build, an AI test pass, and a posted GitHub review with reproduction steps and screenshots — automatically.
This is the headline feature of qlane: PR testing on autopilot. When a PR opens or updates, we queue a test session. A sandbox spins up, clones the branch, builds the app, and exposes a preview URL. The QA agent then drives a real Chromium browser through the changed surface.
When the agent finishes, it posts results to the PR: a single review (Approve or Request changes), one comment per finding with severity, screenshot, and reproduction steps. Failed tests link back to the qlane session for full investigation.
The whole pipeline is durable: retries on transient failures, sandbox lifecycles managed end-to-end. If a sandbox dies mid-run, the next attempt picks up cleanly.
- Sandbox provisioned per PR — clone, install, build, run.
- QA agent drives a real Chromium browser, just like a human tester.
- Posted as a single GitHub review with one comment per finding.
- Durable pipeline: retries on transient failure, picks up after a crash.