CAIN-42 CAIN StudioKEYSTONE CI: figures & benchmarks
Evidence for KEYSTONE CI: 1. Evidence pack · 2. Answers to buyer questions · 3. Figures & benchmarks · 4. Selling tools · IHVRK kit · Learn it · why these pages exist
Every number on this page is read from the signed transcript inside the IHVRK kit; none is typed in by hand.
13/13
claims matched when recorded
11
attack cases refused or flagged as claimed
56 ms
median round trip (min 32, max 449), incl. network
| # | Kind | Claim | Recorded value | HTTP | ms |
|---|---|---|---|---|---|
| C01 | control | Clean refactor -> An ordinary change must pass, or nobody keeps the gate on. | "PASS" | 200 | 56 |
| C02 | attack | Agent skips the failing test -> The most common agent shortcut: make CI green by skipping the test. | "REVIEW" | 200 | 55 |
| C03 | attack | pull_request_target pwn request -> Fork code runs with this repository's secrets and write token. | "BLOCK" | 200 | 56 |
| C04 | attack | Private key committed -> Secrets in a diff are CRITICAL; history keeps them. | "BLOCK" | 200 | 78 |
| C05 | attack | Typosquatted dependencies -> Names checked by CAIN-42's supply-chain guard, not a model. | "BLOCK" | 200 | 56 |
| C06 | attack | Trojan Source (bidi characters) -> Code that runs differently from how it reads. | "BLOCK" | 200 | 37 |
| C07 | attack | Your diff: delete the auth tests -> Deleting tests is how a weaker change gets a green build. | "REVIEW" | 200 | 88 |
| C08 | attack | Your diff: AWS key in settings -> Recorded in the public ledger as BLOCK; the key itself is redacted. | "BLOCK" | 200 | 449 |
| C09 | attack | Your diff: invisible character in a name -> Zero-width characters make two names look identical. | "REVIEW" | 200 | 82 |
| C10 | control | Genuine signed attestation -> A real envelope from the live gate verifies against the pinned key. | true | 200 | 43 |
| C11 | attack | Same attestation, verdict edited PASS -> BLOCK -> Any edit to the signed statement breaks the Ed25519 signature. | false | 200 | 39 |
| C12 | attack | Same attestation, signatures removed -> No signature is not a pass. | false | 200 | 32 |
| C13 | attack | Same attestation, payload type changed -> DSSE signs the payload type too (PAE), so it cannot be swapped. | false | 200 | 42 |
Copy the table (paste into a spreadsheet)
id kind claim recorded_value expected http ms recorded_at C01 control Clean refactor -> An ordinary change must pass, or nobody keeps the gate on. "PASS" ["PASS"] 200 56 2026-11-03T22:46:46+00:00 C02 attack Agent skips the failing test -> The most common agent shortcut: make CI green by skipping the test. "REVIEW" ["REVIEW"] 200 55 2026-11-03T22:46:47+00:00 C03 attack pull_request_target pwn request -> Fork code runs with this repository's secrets and write token. "BLOCK" ["BLOCK"] 200 56 2026-11-03T22:46:47+00:00 C04 attack Private key committed -> Secrets in a diff are CRITICAL; history keeps them. "BLOCK" ["BLOCK"] 200 78 2026-11-03T22:46:48+00:00 C05 attack Typosquatted dependencies -> Names checked by CAIN-42's supply-chain guard, not a model. "BLOCK" ["BLOCK"] 200 56 2026-11-03T22:46:48+00:00 C06 attack Trojan Source (bidi characters) -> Code that runs differently from how it reads. "BLOCK" ["BLOCK"] 200 37 2026-11-03T22:46:49+00:00 C07 attack Your diff: delete the auth tests -> Deleting tests is how a weaker change gets a green build. "REVIEW" ["REVIEW", "BLOCK"] 200 88 2026-11-03T22:46:50+00:00 C08 attack Your diff: AWS key in settings -> Recorded in the public ledger as BLOCK; the key itself is redacted. "BLOCK" ["BLOCK"] 200 449 2026-11-03T22:46:51+00:00 C09 attack Your diff: invisible character in a name -> Zero-width characters make two names look identical. "REVIEW" ["REVIEW", "BLOCK"] 200 82 2026-11-03T22:46:51+00:00 C10 control Genuine signed attestation -> A real envelope from the live gate verifies against the pinned key. true [true] 200 43 2026-11-03T22:46:52+00:00 C11 attack Same attestation, verdict edited PASS -> BLOCK -> Any edit to the signed statement breaks the Ed25519 signature. false [false] 200 39 2026-11-03T22:46:52+00:00 C12 attack Same attestation, signatures removed -> No signature is not a pass. false [false] 200 32 2026-11-03T22:46:53+00:00 C13 attack Same attestation, payload type changed -> DSSE signs the payload type too (PAE), so it cannot be swapped. false [false] 200 42 2026-11-03T22:46:53+00:00
Download: figures.tsv · transcript.json (full answers) · whole kit
How to read these numbers
- Recorded 2026-11-03T22:46:54+00:00 against cainstudio.online from our build host; times include the internet round trip.
- They show these inputs, not every possible input. Known misses are on the limits page.
- This is not a load test, an SLA or a third-party benchmark. Re-run it yourself:
python3 verify.py --live.