500 human-validated real GitHub issues; an agent must produce a patch that passes the repo's existing unit test suite.
discriminates
[build-verify-reflect][debate][ensemble]
saturation
mid
patternLabFit
Native build-verify-reflect (write patch, run tests, read failures, revise); the test harness is the oracle. Best benchmark for roundsToFirstPass and error-decorrelation (different agents fix different bugs).
