CAIN-42 CAIN Studio
SWE-BENCH VERIFIED · ALL 136 PUBLIC SUBMISSIONS · OFFICIAL 500-TASK RUN

CAIN-42: #136 of 136

0/500 resolved · 0.0% · Wilson 95% 0.0–0.8% · leader 396/500 (79.2%) · to pass #135: +3 · to #1: +397

Open the live interactive board · raw feed · evidence · refreshed 2026-11-20T18:55:01Z · checksum f90f34d321e5fd7d

#submissionresolvedrate50% horizongap from CAIN
120251215_livesweagent_claude-opus-4-5396/50079.2%4.3 hCAIN needs +397
220251205_sonar-foundation-agent_claude-opus-4-5396/50079.2%4.2 hCAIN needs +397
320250928_trae_doubao_seed_code394/50078.8%4.1 hCAIN needs +395
420251127_openhands_claude-opus-4-5388/50077.6%3.3 hCAIN needs +389
520251120_livesweagent_gemini-3-pro-preview387/50077.4%2.5 hCAIN needs +388
620250902_atlassian-rovo-dev384/50076.8%2.1 hCAIN needs +385
720250804_epam-ai-run-claude-4-sonnet384/50076.8%1.7 hCAIN needs +385
820250819_ACoder382/50076.4%1.9 hCAIN needs +383
920250901_warp378/50075.6%2.7 hCAIN needs +379
1020250612_trae376/50075.2%1.7 hCAIN needs +377
1120251103_sonar-foundation-agent_claude-sonnet-4-5374/50074.8%2.6 hCAIN needs +375
1220250731_harness_ai374/50074.8%1.4 hCAIN needs +375
1320250915_JoyCode373/50074.6%2.3 hCAIN needs +374
1420250720_Lingxi-v1.5_claude-4-sonnet-20250514373/50074.6%1.7 hCAIN needs +374
1520251015_Prometheus_v1.2.1_gpt5372/50074.4%2.5 hCAIN needs +373
1620250603_Refact_Agent_claude-4-sonnet372/50074.4%1.8 hCAIN needs +373
1720251103_SalesforceAIResearch_SAGE_OpenHands369/50073.8%1.8 hCAIN needs +370
1820250522_tools_claude-4-opus366/50073.2%2.3 hCAIN needs +367
1920251021_SalesforceAIResearch_SAGE_bash_only365/50073.0%2.1 hCAIN needs +366
2020250522_tools_claude-4-sonnet362/50072.4%2.0 hCAIN needs +363
2120260901_mini-v2.4.2_gemini-3-5-flash359/50071.8%3.0 hCAIN needs +360
2220250807_openhands_gpt5359/50071.8%1.5 hCAIN needs +360
2320250929_Prometheus_v1.2_gpt5356/50071.2%1.7 hCAIN needs +357
2420250710_bloop356/50071.2%1.4 hCAIN needs +357
2520251014_Lingxi_kimi_k2356/50071.2%1.2 hCAIN needs +357
2620250715_qodo_command356/50071.2%1.2 hCAIN needs +357
2720250623_warp355/50071.0%1.7 hCAIN needs +356
2820250611_moatless_claude-4-sonnet-20250514354/50070.8%1.3 hCAIN needs +355
2920250519_trae353/50070.6%1.2 hCAIN needs +354
3020250610_augment_agent_v1352/50070.4%1.4 hCAIN needs +353
3120250524_openhands_claude_4_sonnet352/50070.4%1.3 hCAIN needs +353
3220250515_Refact_Agent352/50070.4%1.2 hCAIN needs +353
3320250519_devlo351/50070.2%1.1 hCAIN needs +352
3420250430_zencoder_ai350/50070.0%1.1 hCAIN needs +351
3520250805_openhands-Qwen3-Coder-480B-A35B-Instruct348/50069.6%1.1 hCAIN needs +349
3620250516_cortexa_o3341/50068.2%1.1 hCAIN needs +342
3720250930_zai_glm4-6341/50068.2%1.1 hCAIN needs +342
3820250522_sweagent_claude-4-sonnet-20250514333/50066.6%1.0 hCAIN needs +334
3920250514_aime_coder332/50066.4%1.1 hCAIN needs +333
4020250415_openhands329/50065.8%0.9 hCAIN needs +330
4120250716_openhands_kimi_k2327/50065.4%0.9 hCAIN needs +328
4220250316_augment_agent_v0327/50065.4%0.8 hCAIN needs +328
4320250405_amazon-q-developer-agent-20250405-dev327/50065.4%0.8 hCAIN needs +328
4420250117_wandb_programmer_o1_crosscheck5323/50064.6%0.9 hCAIN needs +324
4520250503_patchpilot-v1.1-o4-mini323/50064.6%0.9 hCAIN needs +324
4620250728_zai_glm4-5321/50064.2%0.9 hCAIN needs +322
4720250206_agentscope317/50063.4%0.7 hCAIN needs +318
4820250224_tools_claude-3-7-sonnet316/50063.2%0.7 hCAIN needs +317
4920250110_blackboxai_agent_v1.1314/50062.8%0.7 hCAIN needs +315
5020250228_epam-ai-run-claude-3-5-sonnet314/50062.8%0.6 hCAIN needs +315
5120250225_sweagent_claude-3-7-sonnet312/50062.4%0.6 hCAIN needs +313
5220241221_codestory_midwit_claude-3-5-sonnet_swe-search311/50062.2%0.6 hCAIN needs +312
5320250203_openhands_4x_scaled304/50060.8%0.6 hCAIN needs +305
5420250901_entroPO_R2E_QwenCoder30BA3B_tts302/50060.4%0.6 hCAIN needs +303
5520250110_learn_by_interact_claude3.5301/50060.2%0.5 hCAIN needs +302
5620250629_deepswerl_r2eagent_tts294/50058.8%0.5 hCAIN needs +295
5720241213_devlo291/50058.2%0.5 hCAIN needs +292
5820250410_cortexa291/50058.2%0.5 hCAIN needs +292
5920241223_emergent286/50057.2%0.4 hCAIN needs +287
6020250924_artemis_agent_v2285/50057.0%0.5 hCAIN needs +286
6120241208_gru285/50057.0%0.4 hCAIN needs +286
6220250405_swe-rizzo_claude37283/50056.6%0.4 hCAIN needs +284
6320241212_epam-ai-run-claude-3-5-sonnet277/50055.4%0.4 hCAIN needs +278
6420241202_amazon-q-developer-agent-20241202-dev275/50055.0%0.4 hCAIN needs +276
6520241108_devlo271/50054.2%0.4 hCAIN needs +272
6620251110_frogboss-32b268/50053.6%0.3 hCAIN needs +269
6720250804_codesweep_sweagent_kimi_k2_instruct267/50053.4%0.3 hCAIN needs +268
6820250120_Bracket266/50053.2%0.4 hCAIN needs +267
6920241029_OpenHands-CodeAct-2.1-sonnet-20241022265/50053.0%0.3 hCAIN needs +266
7020241212_google_jules_gemini_2.0_flash_experimental261/50052.2%0.3 hCAIN needs +262
7120250901_entroPO_R2E_QwenCoder30BA3B261/50052.2%0.3 hCAIN needs +262
7220241125_enginelabs259/50051.8%0.3 hCAIN needs +260
7320250122_autocoderover-v2.1-claude-3-5-sonnet-20241022258/50051.6%0.3 hCAIN needs +259
7420250805_openhands-Qwen3-Coder-30B-A3B-Instruct258/50051.6%0.3 hCAIN needs +259
7520241202_agentless-1.5_claude-3.5-sonnet-20241022254/50050.8%0.3 hCAIN needs +255
7620241028_solver250/50050.0%0.3 hCAIN needs +251
7720241125_marscode-agent-dev250/50050.0%0.3 hCAIN needs +251
7820241105_nfactorial246/50049.2%0.2 hCAIN needs +247
7920241022_tools_claude-3-5-sonnet-updated245/50049.0%0.2 hCAIN needs +246
8020241025_composio_swekit243/50048.6%0.2 hCAIN needs +244
8120241106_navie-2-gpt4o-sonnet236/50047.2%0.2 hCAIN needs +237
8220250616_Skywork-SWE-32B+TTS_Bo8235/50047.0%0.2 hCAIN needs +236
8320250520_openhands_devstral_small234/50046.8%0.2 hCAIN needs +235
8420241023_emergent233/50046.6%0.2 hCAIN needs +234
8520241108_autocoderover-v2.0-claude-3-5-sonnet-20241022231/50046.2%0.2 hCAIN needs +232
8620250528_patchpilot_Co-PatcheR230/50046.0%0.2 hCAIN needs +231
8720240924_solver227/50045.4%0.2 hCAIN needs +228
8820240824_gru226/50045.2%0.2 hCAIN needs +227
8920251110_frogmini-14b225/50045.0%0.2 hCAIN needs +226
9020250118_codeshellagent_gemini_2.0_flash_experimental221/50044.2%0.2 hCAIN needs +222
9120240920_solver218/50043.6%0.2 hCAIN needs +219
9220250214_agentless_lite_o3_mini212/50042.4%0.1 hCAIN needs +213
9320250527_amazon.nova-premier-v1.0212/50042.4%0.1 hCAIN needs +213
9420250629_deepswerl_r2eagent211/50042.2%0.1 hCAIN needs +212
9520250806_SWE-Exp_DeepSeek-V3210/50042.0%0.1 hCAIN needs +211
9620250112_ugaiforge208/50041.6%0.1 hCAIN needs +209
9720241030_nfactorial208/50041.6%0.1 hCAIN needs +209
9820250226_swerl_llama3_70b206/50041.2%0.1 hCAIN needs +207
9920241113_nebius-search-open-weight-models-11-24203/50040.6%0.1 hCAIN needs +204
10020241016_composio_swekit203/50040.6%0.1 hCAIN needs +204
10120240820_honeycomb203/50040.6%0.1 hCAIN needs +204
10220241022_tools_claude-3-5-haiku203/50040.6%0.1 hCAIN needs +204
10320250511_sweagent_lm_32b201/50040.2%0.1 hCAIN needs +202
10420241029_epam-ai-run-claude-3-5-sonnet198/50039.6%0.1 hCAIN needs +199
10520240721_amazon-q-developer-agent-20240719-dev194/50038.8%0.1 hCAIN needs +195
10620241028_agentless-1.5_gpt4o194/50038.8%0.1 hCAIN needs +195
10720240628_autocoderover-v20240620192/50038.4%0.1 hCAIN needs +193
10820250725_sweagent_devstral_small_2507190/50038.0%0.1 hCAIN needs +191
10920250616_Skywork-SWE-32B190/50038.0%0.1 hCAIN needs +191
11020240617_factory_code_droid185/50037.0%0.1 hCAIN needs +186
11120240620_sweagent_claude3.5sonnet168/50033.6%0.1 hCAIN needs +169
11220250306_SWE-Fixer_Qwen2.5-7b-retriever_Qwen2.5-72b-editor164/50032.8%0.1 hCAIN needs +165
11320240612_MASAI_gpt4o163/50032.6%0.1 hCAIN needs +164
11420241120_artemis_agent160/50032.0%0.0 hCAIN needs +161
11520241007_nfactorial158/50031.6%0.1 hCAIN needs +159
11620241128_SWE-Fixer_Qwen2.5-7b-retriever_Qwen2.5-72b-editor_20241128151/50030.2%0.1 hCAIN needs +152
11720241002_lingma-agent_lingma-swe-gpt-72b144/50028.8%0.0 hCAIN needs +145
11820241016_epam-ai-run-gpt-4o135/50027.0%0.1 hCAIN needs +136
11920240615_appmap-navie_gpt4o131/50026.2%0.0 hCAIN needs +132
12020241001_nfactorial129/50025.8%0.0 hCAIN needs +130
12120240509_amazon-q-developer-agent-20240430-dev128/50025.6%0.0 hCAIN needs +129
12220240918_lingma-agent_lingma-swe-gpt-72b125/50025.0%0.0 hCAIN needs +126
12320240820_epam-ai-run-gpt-4o120/50024.0%0.0 hCAIN needs +121
12420250627_agentless_MCTS-Refine-7B116/50023.2%0.0 hCAIN needs +117
12520240728_sweagent_gpt4o116/50023.2%0.0 hCAIN needs +117
12620240402_sweagent_gpt4112/50022.4%0.0 hCAIN needs +113
12720241002_lingma-agent_lingma-swe-gpt-7b91/50018.2%0.0 hCAIN needs +92
12820240402_sweagent_claude3opus79/50015.8%0.0 hCAIN needs +80
12920240918_lingma-agent_lingma-swe-gpt-7b51/50010.2%0.0 hCAIN needs +52
13020240402_rag_claude3opus35/5007.0%0.0 hCAIN needs +36
13120231010_rag_claude222/5004.4%0.0 hCAIN needs +23
13220240402_rag_gpt414/5002.8%0.0 hCAIN needs +15
13320231010_rag_swellama7b7/5001.4%0.0 hCAIN needs +8
13420231010_rag_swellama13b6/5001.2%0.0 hCAIN needs +7
13520231010_rag_gpt352/5000.4%0.0 hCAIN needs +3
136CAIN-42 (70B tool agent, E124) — LAST PLACE0/5000.0%—

Every row is a published SWE-bench Verified submission. Scaffolds and model versions differ, so this is a SWE-bench rank, not METR HCAST. CAIN's 0/500 is reported as measured. Generated by scripts/e124/rank_agents.py (7 agents, hash-chained) — no row is typed by hand. AGI status: NOT ACHIEVED.