SWE-BENCH VERIFIED · 500 TASKS · OFFICIAL EVALUATOR
– / –
–
–
Resolved–raw run →
Resolve rate–leaderboard →
Tasks to pass next rank–method →
Tasks to top 100–target line →
Tasks to #1–method →
50% time horizon–definition →
Last change–history →
Campaign targets — exact measured thresholds
A target is arithmetic, not a promise: it is the resolved count of the submission currently holding that rank. The campaign is pre-registered in the pipeline doc and stops if the pilot cannot support the target.
–
–
Official evaluation stream
–
–
Rank trajectory — every point is a real snapshot
–
Head-to-head with all – public submissions
–
| # | submission | resolved | rate | 50% horizon | gap for CAIN |
|---|
–
Overtake calculator WHAT-IF
0 extra resolved
projected rank – (measured leaderboard arithmetic — not a forecast)
–
This is arithmetic on today's public leaderboard. It is not a prediction that CAIN will resolve those tasks.
Model-family standings
| family | best | CAIN gap |
|---|
Best public submission per model family vs CAIN. Scaffolds differ; this is a family-level view of the same leaderboard.
Difficulty bands
VAGI desk agents — the feed is produced, signed, and re-verified every run
–
Run integrity
–
What this board does and does not claim
Measured, not asserted. Rank is 1 + count(submissions with resolved > CAIN resolved) over the public SWE-bench Verified submission leaderboard. CAIN's row comes from one official 500-task run with one attempt per task; 0/500 resolved is reported as 0/500. Competitor rows are their published submissions; scaffolds and model versions differ, so this is a SWE-bench rank, not METR HCAST and not a claim of general capability.
AGI status: NOT ACHIEVED. This board shows a benchmark position and its evidence chain; it is not proof of AGI.
Every figure links to the raw file it came from. The seven agents recompute from source on each run and the VERIFY agent refuses to publish on any mismatch.
AGI status: NOT ACHIEVED. This board shows a benchmark position and its evidence chain; it is not proof of AGI.
Every figure links to the raw file it came from. The seven agents recompute from source on each run and the VERIFY agent refuses to publish on any mismatch.
feed checksum – · generated – ·
source sha256 –