Evidence
26 attacks written before any change on 2026-11-02, each against one promise.
| Run | Engine | Held | Counts? | Note |
|---|---|---|---|---|
| 1 | 1.0.0 | 17/26 | no | harness bug: broker.mint called without its grants argument; 6 mint cases crashed or passed for the wrong reason. Not a measurement. |
| 2 | 1.0.0 | 19/26 | yes | harness fixed, engine unchanged: the reported blind result |
| 3 | 1.1.0 | 26/26 | yes | after the fixes; the set is now a tuning set |
Run 1 is shown because it happened: our own test harness called BROKER wrongly, so it measured nothing. We fixed only the harness and ran again.
Run 2, every row (engine 1.0.0, unchanged)
| Attack | Want | Got | Result | Detail |
|---|---|---|---|---|
self_approval_case_variant | refused | accepted | failed | accepted |
one_person_two_case_ids | refused | accepted | failed | accepted |
approver_id_with_plus_looks_like_two | refused | accepted | failed | accepted |
ambiguous_path_in_request | refused | accepted | failed | accepted |
backtick_path_spoofs_slack_message | refused | accepted | failed | accepted |
method_with_whitespace | refused | accepted | failed | accepted |
required_fraction_string | refused | refused | held | ValueError: invalid literal for int() with base 10: '1.5' |
required_bool_true | refused | accepted | failed | accepted |
ballot_used_as_approval | refused | refused | held | ValueError: DENY |
ballot_reused_after_vote | refused | refused | held | ApprovalError: ballot_spent |
refused_vote_does_not_burn_ballot | ok | ok | held | accepted |
vote_after_quorum | refused | refused | held | ApprovalError: closed |
vote_after_deny | refused | refused | held | ApprovalError: closed |
vote_after_expiry | refused | refused | held | ApprovalError: bad_ballot |
approval_receipt_used_twice | refused | refused | held | ValueError: DENY |
approval_for_other_path | refused | refused | held | ValueError: DENY |
approval_for_other_body | refused | refused | held | ValueError: DENY |
approval_for_other_agent | refused | refused | held | ValueError: DENY |
legit_quorum_mints_once | ok | ok | held | accepted |
concurrent_votes_one_outcome | ok | ok | held | APPROVED votes=2 errs=['closed'] |
forged_ballot_other_rid | refused | refused | held | ApprovalError: bad_ballot |
slack_wrong_secret | refused | refused | held | ApprovalError: bad_slack_signature |
slack_old_timestamp | refused | refused | held | ApprovalError: bad_slack_signature |
slack_other_team | refused | refused | held | ApprovalError: wrong_team |
slack_user_mapped_to_agent_case_variant | refused | refused | held | ApprovalError: not_an_approver |
ledger_tamper_detected | refused | refused | held | {'valid': False} |
Raw data: approval-evolution-2026-11-02.json · approval-blind-2026-11-02.json. Our own runs; no independent test.
FIRME AI CORPORATION · CAIN-42 is a Byzantine trust fabric. Numbers marked "our own check" were run by us, not by an independent party. Nothing on these pages is a certification.