E93 interim evidence — day 1–2 (2026-11-18)
CAIN-42 is not VAGI. E93 interim, day 1–2: the first genuine procedure-synthesis result (after E92 was withdrawn), with its limits.
Current designation: Governed agentic intelligence infrastructure (outcome 3 of 3 in the E93 rule). No AGI, VAGI, production or certification claim.
Decisive experiment: procedure synthesis vs selection vs baselines
Pre-registered before any task family existed (see PREREGISTRATION.md, DEVIATIONS.md). 17 families × 30 held-out tasks = 510. Held-out tasks never reach any learner.
| Arm | Seed 9301 | New families, seed 9302 |
| G2 — open synthesis (no templates) | 369 | 367 |
| G — select from designer-supplied library (incl. E92's 4 templates) | 200 | 223 |
| F — best fixed strategy | 149 | 164 |
| D — governed, no procedures | 87 | 114 |
| G2 at the library's development compute | 208 | 212 |
| Adaptive (library first, synthesise if it fails) | 390 | 418 |
What is shown
- Procedure synthesis (in-distribution): an open, family-agnostic search with no per-family templates scored 369/510 held-out tasks versus 200 for selecting from the designer-supplied library, 149 for the best fixed strategy and 87 for no procedures (exact McNemar, Holm-corrected, all significant). On new families (replication seed 9302): 367 vs 223 / 164 / 114. 12 + 12 procedures promoted, none in the supplied library; 9 and 10 behave unlike every library procedure.
- Learning from verified experience: held-out accuracy rises with more verified examples (k = 0, 3, 5, 10, 20, 60): 87 → 224 → 250 → 311 → 311 → 369 and 114 → 183 → 248 → 300 → 360 → 367 of 510. Both curves are monotone.
- Adaptive reasoning: trying the library first and synthesising only when it fails scored 390 and 418/510, beating always-synthesise at slightly lower cost (rule fixed before the results were read).
- Governance and kill switch (tested threat model, same host): 19/19 admission scenarios and 10/10 tool-gate scenarios held; in 20 kill-switch trials with real worker processes, 36,565 effects before the fence, 0 after, 56,333 post-fence attempts refused; fence latency median 4.6 ms, max 55.7 ms.
Limits and what is not done
- At equal compute, synthesis = selection: with development tool calls capped at the library's, synthesis scored 208 vs 200 and 212 vs 223. Uncapped, it used about 21× more development tool calls.
- In-distribution: the generated families' hidden answers come from the same language the search explores. Two out-of-language controls were not solved.
- No positive transfer: 0 positive transfers between families; the gate blocked all 49 harmful ones.
- Local model: 34 Qwen2.5-1.5B proposals on CPU, 4 parseable, 0 valid. No paid model was called; cost $0.
- Not independent: the same team wrote the search and the tasks; the approver is a separate key in the same process. A second session recomputed every count from the raw rows (same team, not external review). External review: BLOCKED.
- Verticals are in progress: fixed baselines on 30 held-out tasks each, software 3/30, science 30/30 (a ceiling: one rule solves it), defensive cyber 1/30 (reused E91 environment). A cross-review found that a patch could pass the software checker without fixing the bug, by reading the hidden test file; this was found and fixed before any arm saw software held-out (the exploit now scores 0/5, the reference fix is still accepted).
- In progress: a 6-hour governed mission started 12:52 UTC (600 fresh vertical tasks, 20 injected faults, 4 workers). No result yet.
- Not run yet: synthesis and learning on the verticals, cross-domain transfer, collaboration.
E92 was withdrawn
E92's published synthesis result rested on four hand-written family templates and identical placeholder baselines. Its staged-repair checker also accepted the constant True. See E92_CORRECTION.md.
Verify it yourself
Download this folder and run python3 -I recompute.py . (standard library only, no CAIN code). It checks SHA256SUMS, recounts every arm from the raw rows, recomputes every exact McNemar p-value, the learning curve and the governance counts. Expected: 57/57. The files are hashed, not signed: integrity is checkable, independent witnessing is not claimed.
Mirrors: clawx.click · cainstudio.online. The team is three people; FIRME AI CORPORATION.