CAIN-42 CAIN StudioEvidence library · niche
Benchmarks, coverage & performance
How fast it runs and how much was tested. 1269 tested invariants.
Last reviewed 2026-10-01
1269 of 1269 held
Test families in this niche
bench_family (669) · bench_category (336) · coverage (116) · property (50) · harness (15) · regression (11) · performance (11) · corpus (11) · end_to_end (10) · completion (10) · latency (9) · false_completion (8) · fabric_component (2) · failure_to_test (1) · swe (1) · telemetry (1) · radar (1) · f2t (1)
Where these come from
- CAIN-42 Evolution 36 -- Machine Agency Exchange Fabric: 307
- CAIN-42 Evolution 35 -- Continuous Governance Intelligence Fabric: 202
- CAIN-42 Evolution 34 -- Proof-Carrying Machine Agency: 195
- CAIN-42 Evolution 40 -- Autonomous Enterprise Intelligence Fabric: 176
- CAIN-42 Evolution 41 -- Machine Agency Exchange Fabric: 135
- CAIN-42 Evolution 42 -- Supreme Governed Agentic Infrastructure Platform: 96
- CAIN-42 Evolution 29 -- Governed Agentic Internet Transaction Fabric: 50
- CAIN-42 Evolution 33 -- Governed Agentic Operating Fabric: 43
- CAIN-42 Evolution 32 -- Governed Autonomy Learning Fabric: 22
- CAIN-42 Evolution 30 -- Governed Machine Autonomy Fabric: 18
- CAIN-42 Evolution 31 -- Universal Proof-of-Governance Fabric: 15
- CAIN-42 Evolution 21 -- Governed Open-Ended Intelligence Fabric: 3
- CAIN-42 Evolution 27 -- Agentic Internet Control Plane: 2
- CAIN-42 Evolution 19 -- Governed Autonomy Operating Fabric: 1
- CAIN-42 Evolution 20 -- Governed Agentic Civilization Fabric: 1
- CAIN-42 Evolution 23 -- Governed Meta-Intelligence Fabric: 1
- CAIN-42 Evolution 37 -- Autonomous Execution Mesh: 1
- CAIN-42 Evolution 38 -- Portable Proof-Carrying Machine Agency: 1
Rules 301–450 of 1269
| ID | Rule | Bundle | Result |
|---|---|---|---|
| E34-BENCHFAM-status-simulation_is_not_production | every status/simulation_is_not_production scenario holds | E34 | held |
| E34-BENCHFAM-status-status | every status/status scenario holds | E34 | held |
| E34-BENCHFAM-status-status_priority | every status/status_priority scenario holds | E34 | held |
| E34-BENCHFAM-status-uncontrolled_channel | every status/uncontrolled_channel scenario holds | E34 | held |
| E34-BENCHFAM-status-unknown_core | every status/unknown_core scenario holds | E34 | held |
| E34-BENCHFAM-supply_chain-component_kind | every supply_chain/component_kind scenario holds | E34 | held |
| E34-BENCHFAM-supply_chain-model_substitution | every supply_chain/model_substitution scenario holds | E34 | held |
| E34-BENCHFAM-supply_chain-unsigned_component | every supply_chain/unsigned_component scenario holds | E34 | held |
| E34-BENCHFAM-tenancy-cross_tenant_denied | every tenancy/cross_tenant_denied scenario holds | E34 | held |
| E34-BENCHFAM-tenancy-isolated_key | every tenancy/isolated_key scenario holds | E34 | held |
| E34-BENCHFAM-tenancy-rbac_denied | every tenancy/rbac_denied scenario holds | E34 | held |
| E34-BENCHFAM-time_machine-known_at_time | every time_machine/known_at_time scenario holds | E34 | held |
| E34-BENCHFAM-transaction-transaction_units | every transaction/transaction_units scenario holds | E34 | held |
| E34-BENCHFAM-truth_guard-negated_ok | every truth_guard/negated_ok scenario holds | E34 | held |
| E34-BENCHFAM-truth_guard-unsupported_claim | every truth_guard/unsupported_claim scenario holds | E34 | held |
| E34-SURFBASIS-mcp | surface mcp carries a stated enforcement basis | E34 | held |
| E34-SURFBASIS-a2a | surface a2a carries a stated enforcement basis | E34 | held |
| E34-SURFBASIS-http | surface http carries a stated enforcement basis | E34 | held |
| E34-SURFBASIS-rest | surface rest carries a stated enforcement basis | E34 | held |
| E34-SURFBASIS-grpc | surface grpc carries a stated enforcement basis | E34 | held |
| E34-SURFBASIS-websocket | surface websocket carries a stated enforcement basis | E34 | held |
| E34-SURFBASIS-event_bus | surface event_bus carries a stated enforcement basis | E34 | held |
| E34-SURFBASIS-cli | surface cli carries a stated enforcement basis | E34 | held |
| E34-SURFBASIS-shell | surface shell carries a stated enforcement basis | E34 | held |
| E34-SURFBASIS-filesystem | surface filesystem carries a stated enforcement basis | E34 | held |
| E34-SURFBASIS-browser | surface browser carries a stated enforcement basis | E34 | held |
| E34-SURFBASIS-computer_use | surface computer_use carries a stated enforcement basis | E34 | held |
| E34-SURFBASIS-databases | surface databases carries a stated enforcement basis | E34 | held |
| E34-SURFBASIS-cloud_apis | surface cloud_apis carries a stated enforcement basis | E34 | held |
| E34-SURFBASIS-credentials | surface credentials carries a stated enforcement basis | E34 | held |
| E34-SURFBASIS-secrets | surface secrets carries a stated enforcement basis | E34 | held |
| E34-SURFBASIS-deployment | surface deployment carries a stated enforcement basis | E34 | held |
| E34-SURFBASIS-ci_cd | surface ci_cd carries a stated enforcement basis | E34 | held |
| E34-SURFBASIS-containers | surface containers carries a stated enforcement basis | E34 | held |
| E34-SURFBASIS-subagents | surface subagents carries a stated enforcement basis | E34 | held |
| E34-SURFBASIS-delegation | surface delegation carries a stated enforcement basis | E34 | held |
| E34-SURFBASIS-scheduled_jobs | surface scheduled_jobs carries a stated enforcement basis | E34 | held |
| E34-SURFBASIS-autonomous_loops | surface autonomous_loops carries a stated enforcement basis | E34 | held |
| E34-SURFBASIS-memory_mutation | surface memory_mutation carries a stated enforcement basis | E34 | held |
| E34-SURFBASIS-policy_mutation | surface policy_mutation carries a stated enforcement basis | E34 | held |
| E34-SURFBASIS-model_replacement | surface model_replacement carries a stated enforcement basis | E34 | held |
| E34-SURFBASIS-skill_installation | surface skill_installation carries a stated enforcement basis | E34 | held |
| E34-SURFBASIS-plugin_installation | surface plugin_installation carries a stated enforcement basis | E34 | held |
| E34-SURFBASIS-capability_acquisition | surface capability_acquisition carries a stated enforcement basis | E34 | held |
| E34-SURFBASIS-financial_transactions | surface financial_transactions carries a stated enforcement basis | E34 | held |
| E34-SURFBASIS-machine_contracts | surface machine_contracts carries a stated enforcement basis | E34 | held |
| E34-SURFBASIS-physical_actuators | surface physical_actuators carries a stated enforcement basis | E34 | held |
| E34-SURFBASIS-vehicle_robot_boundaries | surface vehicle_robot_boundaries carries a stated enforcement basis | E34 | held |
| E34-SURFBASIS-research_experiments | surface research_experiments carries a stated enforcement basis | E34 | held |
| E34-SURFBASIS-self_improvement | surface self_improvement carries a stated enforcement basis | E34 | held |
| E34-SURFBASIS-code_modification | surface code_modification carries a stated enforcement basis | E34 | held |
| E35-FABRIC-coverage_learner | the intelligence fabric exposes coverage_learner | E35 | held |
| E35-FABRIC-benchmark_engine | the intelligence fabric exposes benchmark_engine | E35 | held |
| E35-HARNESS-plan | harness event plan is governed | E35 | held |
| E35-HARNESS-context_assembly | harness event context_assembly is governed | E35 | held |
| E35-HARNESS-memory | harness event memory is governed | E35 | held |
| E35-HARNESS-tool_selection | harness event tool_selection is governed | E35 | held |
| E35-HARNESS-tool_execution | harness event tool_execution is governed | E35 | held |
| E35-HARNESS-retry | harness event retry is governed | E35 | held |
| E35-HARNESS-loop | harness event loop is governed | E35 | held |
| E35-HARNESS-delegation | harness event delegation is governed | E35 | held |
| E35-HARNESS-checkpoint | harness event checkpoint is governed | E35 | held |
| E35-HARNESS-recovery | harness event recovery is governed | E35 | held |
| E35-HARNESS-state_persistence | harness event state_persistence is governed | E35 | held |
| E35-HARNESS-model_switching | harness event model_switching is governed | E35 | held |
| E35-HARNESS-browser_action | harness event browser_action is governed | E35 | held |
| E35-HARNESS-computer_use | harness event computer_use is governed | E35 | held |
| E35-HARNESS-code_execution | harness event code_execution is governed | E35 | held |
| E35-RADAR-agent_harnesses | radar topic agent_harnesses exists | E35 | held |
| E35-LATENCY-decision | latency stage decision exists | E35 | held |
| E35-LATENCY-authorization | latency stage authorization exists | E35 | held |
| E35-LATENCY-proof | latency stage proof exists | E35 | held |
| E35-LATENCY-verification | latency stage verification exists | E35 | held |
| E35-LATENCY-enforcement | latency stage enforcement exists | E35 | held |
| E35-LATENCY-revocation | latency stage revocation exists | E35 | held |
| E35-LATENCY-incident_detection | latency stage incident_detection exists | E35 | held |
| E35-LATENCY-containment | latency stage containment exists | E35 | held |
| E35-LATENCY-recovery | latency stage recovery exists | E35 | held |
| E35-CAT-law | every law scenario holds | E35 | held |
| E35-CAT-epistemic | every epistemic scenario holds | E35 | held |
| E35-CAT-observation | every observation scenario holds | E35 | held |
| E35-CAT-risk | every risk scenario holds | E35 | held |
| E35-CAT-prediction | every prediction scenario holds | E35 | held |
| E35-CAT-calibration | every calibration scenario holds | E35 | held |
| E35-CAT-recommendation | every recommendation scenario holds | E35 | held |
| E35-CAT-policy_optimizer | every policy_optimizer scenario holds | E35 | held |
| E35-CAT-control_optimizer | every control_optimizer scenario holds | E35 | held |
| E35-CAT-learner | every learner scenario holds | E35 | held |
| E35-CAT-world_model | every world_model scenario holds | E35 | held |
| E35-CAT-counterfactual | every counterfactual scenario holds | E35 | held |
| E35-CAT-simulation | every simulation scenario holds | E35 | held |
| E35-CAT-evaluation | every evaluation scenario holds | E35 | held |
| E35-CAT-benchmark | every benchmark scenario holds | E35 | held |
| E35-CAT-memory | every memory scenario holds | E35 | held |
| E35-CAT-knowledge | every knowledge scenario holds | E35 | held |
| E35-CAT-research | every research scenario holds | E35 | held |
| E35-CAT-environment_query | every environment_query scenario holds | E35 | held |
| E35-CAT-state_predictor | every state_predictor scenario holds | E35 | held |
| E35-CAT-consequence_graph | every consequence_graph scenario holds | E35 | held |
| E35-CAT-autonomy_gradient | every autonomy_gradient scenario holds | E35 | held |
| E35-CAT-budget_learner | every budget_learner scenario holds | E35 | held |
| E35-CAT-harness | every harness scenario holds | E35 | held |
| E35-CAT-plan_check_act | every plan_check_act scenario holds | E35 | held |
| E35-CAT-goal_integrity | every goal_integrity scenario holds | E35 | held |
| E35-CAT-intent_compiler | every intent_compiler scenario holds | E35 | held |
| E35-CAT-action_graph | every action_graph scenario holds | E35 | held |
| E35-CAT-trajectory | every trajectory scenario holds | E35 | held |
| E35-CAT-communication | every communication scenario holds | E35 | held |
| E35-CAT-collusion | every collusion scenario holds | E35 | held |
| E35-CAT-economy | every economy scenario holds | E35 | held |
| E35-CAT-labor | every labor scenario holds | E35 | held |
| E35-CAT-marketplace | every marketplace scenario holds | E35 | held |
| E35-CAT-compiler | every compiler scenario holds | E35 | held |
| E35-CAT-obligation | every obligation scenario holds | E35 | held |
| E35-CAT-policy_conflict | every policy_conflict scenario holds | E35 | held |
| E35-CAT-failure_predictor | every failure_predictor scenario holds | E35 | held |
| E35-CAT-failure_to_product | every failure_to_product scenario holds | E35 | held |
| E35-CAT-adversarial_generation | every adversarial_generation scenario holds | E35 | held |
| E35-CAT-red_team | every red_team scenario holds | E35 | held |
| E35-CAT-blue_team | every blue_team scenario holds | E35 | held |
| E35-CAT-tournament | every tournament scenario holds | E35 | held |
| E35-CAT-regret | every regret scenario holds | E35 | held |
| E35-CAT-calibration_engine | every calibration_engine scenario holds | E35 | held |
| E35-CAT-deployment | every deployment scenario holds | E35 | held |
| E35-CAT-profile | every profile scenario holds | E35 | held |
| E35-CAT-computer_use | every computer_use scenario holds | E35 | held |
| E35-CAT-revision | every revision scenario holds | E35 | held |
| E35-CAT-r2e | every r2e scenario holds | E35 | held |
| E35-CAT-radar | every radar scenario holds | E35 | held |
| E35-CAT-ip | every ip scenario holds | E35 | held |
| E35-CAT-moat | every moat scenario holds | E35 | held |
| E35-CAT-swarm | every swarm scenario holds | E35 | held |
| E35-CAT-lab | every lab scenario holds | E35 | held |
| E35-CAT-benchmark_v2 | every benchmark_v2 scenario holds | E35 | held |
| E35-CAT-integrity | every integrity scenario holds | E35 | held |
| E35-CAT-root_of_trust | every root_of_trust scenario holds | E35 | held |
| E35-CAT-degradation | every degradation scenario holds | E35 | held |
| E35-CAT-latency | every latency scenario holds | E35 | held |
| E35-CAT-economics | every economics scenario holds | E35 | held |
| E35-CAT-self_healing | every self_healing scenario holds | E35 | held |
| E35-CAT-self_governance | every self_governance scenario holds | E35 | held |
| E35-CAT-evolution | every evolution scenario holds | E35 | held |
| E35-CAT-canary | every canary scenario holds | E35 | held |
| E35-CAT-rollback | every rollback scenario holds | E35 | held |
| E35-CAT-loop | every loop scenario holds | E35 | held |
| E35-CAT-fabric | every fabric scenario holds | E35 | held |
| E35-BENCHFAM-action_graph-anomaly | every action_graph/anomaly scenario holds | E35 | held |
| E35-BENCHFAM-adversarial_generation-adversarial_source | every adversarial_generation/adversarial_source scenario holds | E35 | held |
| E35-BENCHFAM-autonomy_gradient-autonomy_dimension | every autonomy_gradient/autonomy_dimension scenario holds | E35 | held |
| E35-BENCHFAM-benchmark-benchmark_no_authority | every benchmark/benchmark_no_authority scenario holds | E35 | held |
Other niches
Consensus & distributed systems · Attacks, threats & containment · Identity, authority & delegation · Evidence, receipts & proofs · Memory, data & privacy · Prediction, world models & simulation · Transactions, markets & economics · Tools, MCP, protocols & adapters · Autonomy, control loops & recovery · Policy, law & governance · Trust & reputation · Supply chain, registry & lifecycle · Core guarantees
Try CAIN-42 on your own agents
Create a free account and every new account starts with a 7-day trial of the full platform. Or try the sandbox first, with no account at all.
Create a free account → · Try the sandbox · See the whole ecosystem