CAIN-42 CAIN StudioEvidence library · niche
Benchmarks, coverage & performance
How fast it runs and how much was tested. 1269 tested invariants.
Last reviewed 2026-10-01
1269 of 1269 held
Test families in this niche
bench_family (669) · bench_category (336) · coverage (116) · property (50) · harness (15) · regression (11) · performance (11) · corpus (11) · end_to_end (10) · completion (10) · latency (9) · false_completion (8) · fabric_component (2) · failure_to_test (1) · swe (1) · telemetry (1) · radar (1) · f2t (1)
Where these come from
- CAIN-42 Evolution 36 -- Machine Agency Exchange Fabric: 307
- CAIN-42 Evolution 35 -- Continuous Governance Intelligence Fabric: 202
- CAIN-42 Evolution 34 -- Proof-Carrying Machine Agency: 195
- CAIN-42 Evolution 40 -- Autonomous Enterprise Intelligence Fabric: 176
- CAIN-42 Evolution 41 -- Machine Agency Exchange Fabric: 135
- CAIN-42 Evolution 42 -- Supreme Governed Agentic Infrastructure Platform: 96
- CAIN-42 Evolution 29 -- Governed Agentic Internet Transaction Fabric: 50
- CAIN-42 Evolution 33 -- Governed Agentic Operating Fabric: 43
- CAIN-42 Evolution 32 -- Governed Autonomy Learning Fabric: 22
- CAIN-42 Evolution 30 -- Governed Machine Autonomy Fabric: 18
- CAIN-42 Evolution 31 -- Universal Proof-of-Governance Fabric: 15
- CAIN-42 Evolution 21 -- Governed Open-Ended Intelligence Fabric: 3
- CAIN-42 Evolution 27 -- Agentic Internet Control Plane: 2
- CAIN-42 Evolution 19 -- Governed Autonomy Operating Fabric: 1
- CAIN-42 Evolution 20 -- Governed Agentic Civilization Fabric: 1
- CAIN-42 Evolution 23 -- Governed Meta-Intelligence Fabric: 1
- CAIN-42 Evolution 37 -- Autonomous Execution Mesh: 1
- CAIN-42 Evolution 38 -- Portable Proof-Carrying Machine Agency: 1
Rules 451–600 of 1269
| ID | Rule | Bundle | Result |
|---|---|---|---|
| E35-BENCHFAM-benchmark_v2-benchmark_v2_no_authority | every benchmark_v2/benchmark_v2_no_authority scenario holds | E35 | held |
| E35-BENCHFAM-blue_team-blue_team_proposal | every blue_team/blue_team_proposal scenario holds | E35 | held |
| E35-BENCHFAM-budget_learner-budget_recommendation | every budget_learner/budget_recommendation scenario holds | E35 | held |
| E35-BENCHFAM-calibration-calibration_by_dimension | every calibration/calibration_by_dimension scenario holds | E35 | held |
| E35-BENCHFAM-calibration-no_hidden_poor_calibration | every calibration/no_hidden_poor_calibration scenario holds | E35 | held |
| E35-BENCHFAM-calibration_engine-calibration_gap | every calibration_engine/calibration_gap scenario holds | E35 | held |
| E35-BENCHFAM-canary-canary_observes | every canary/canary_observes scenario holds | E35 | held |
| E35-BENCHFAM-canary-canary_share | every canary/canary_share scenario holds | E35 | held |
| E35-BENCHFAM-collusion-collusion_strength | every collusion/collusion_strength scenario holds | E35 | held |
| E35-BENCHFAM-communication-message_class | every communication/message_class scenario holds | E35 | held |
| E35-BENCHFAM-communication-message_class_rejected | every communication/message_class_rejected scenario holds | E35 | held |
| E35-BENCHFAM-compiler-governance_compiler | every compiler/governance_compiler scenario holds | E35 | held |
| E35-BENCHFAM-computer_use-bulk_cu | every computer_use/bulk_cu scenario holds | E35 | held |
| E35-BENCHFAM-computer_use-computer_use_incomplete | every computer_use/computer_use_incomplete scenario holds | E35 | held |
| E35-BENCHFAM-computer_use-computer_use_surface | every computer_use/computer_use_surface scenario holds | E35 | held |
| E35-BENCHFAM-consequence_graph-consequence_chain | every consequence_graph/consequence_chain scenario holds | E35 | held |
| E35-BENCHFAM-control_optimizer-proposal_only | every control_optimizer/proposal_only scenario holds | E35 | held |
| E35-BENCHFAM-counterfactual-bulk_cf | every counterfactual/bulk_cf scenario holds | E35 | held |
| E35-BENCHFAM-counterfactual-counterfactual_field | every counterfactual/counterfactual_field scenario holds | E35 | held |
| E35-BENCHFAM-counterfactual-intervention | every counterfactual/intervention scenario holds | E35 | held |
| E35-BENCHFAM-counterfactual-unknown_intervention | every counterfactual/unknown_intervention scenario holds | E35 | held |
| E35-BENCHFAM-degradation-degradation_state | every degradation/degradation_state scenario holds | E35 | held |
| E35-BENCHFAM-deployment-deployment_dimension | every deployment/deployment_dimension scenario holds | E35 | held |
| E35-BENCHFAM-deployment-governance_failure_dominates | every deployment/governance_failure_dominates scenario holds | E35 | held |
| E35-BENCHFAM-economics-economics_metric | every economics/economics_metric scenario holds | E35 | held |
| E35-BENCHFAM-economy-economy_attack | every economy/economy_attack scenario holds | E35 | held |
| E35-BENCHFAM-environment_query-governance_question | every environment_query/governance_question scenario holds | E35 | held |
| E35-BENCHFAM-environment_query-unknown_answer | every environment_query/unknown_answer scenario holds | E35 | held |
| E35-BENCHFAM-environment_query-unknown_query | every environment_query/unknown_query scenario holds | E35 | held |
| E35-BENCHFAM-epistemic-bulk_epistemic | every epistemic/bulk_epistemic scenario holds | E35 | held |
| E35-BENCHFAM-epistemic-epistemic_rejected | every epistemic/epistemic_rejected scenario holds | E35 | held |
| E35-BENCHFAM-epistemic-epistemic_state | every epistemic/epistemic_state scenario holds | E35 | held |
| E35-BENCHFAM-evaluation-evaluation_dimension | every evaluation/evaluation_dimension scenario holds | E35 | held |
| E35-BENCHFAM-evolution-evolution_gate | every evolution/evolution_gate scenario holds | E35 | held |
| E35-BENCHFAM-fabric-fabric_analyze | every fabric/fabric_analyze scenario holds | E35 | held |
| E35-BENCHFAM-fabric-fabric_review_by_kernel | every fabric/fabric_review_by_kernel scenario holds | E35 | held |
| E35-BENCHFAM-failure_predictor-failure_hypothesis | every failure_predictor/failure_hypothesis scenario holds | E35 | held |
| E35-BENCHFAM-failure_to_product-f2p_stage | every failure_to_product/f2p_stage scenario holds | E35 | held |
| E35-BENCHFAM-goal_integrity-drift_detected | every goal_integrity/drift_detected scenario holds | E35 | held |
| E35-BENCHFAM-goal_integrity-no_drift | every goal_integrity/no_drift scenario holds | E35 | held |
| E35-BENCHFAM-harness-harness_event | every harness/harness_event scenario holds | E35 | held |
| E35-BENCHFAM-harness-harness_event_rejected | every harness/harness_event_rejected scenario holds | E35 | held |
| E35-BENCHFAM-integrity-integrity_watch | every integrity/integrity_watch scenario holds | E35 | held |
| E35-BENCHFAM-intent_compiler-ambiguity_not_permission | every intent_compiler/ambiguity_not_permission scenario holds | E35 | held |
| E35-BENCHFAM-intent_compiler-intent_field | every intent_compiler/intent_field scenario holds | E35 | held |
| E35-BENCHFAM-ip-ip_disclosure | every ip/ip_disclosure scenario holds | E35 | held |
| E35-BENCHFAM-knowledge-kg_dangling_edge | every knowledge/kg_dangling_edge scenario holds | E35 | held |
| E35-BENCHFAM-knowledge-kg_edge | every knowledge/kg_edge scenario holds | E35 | held |
| E35-BENCHFAM-knowledge-kg_node | every knowledge/kg_node scenario holds | E35 | held |
| E35-BENCHFAM-knowledge-knowledge_revocation | every knowledge/knowledge_revocation scenario holds | E35 | held |
| E35-BENCHFAM-lab-research_lab | every lab/research_lab scenario holds | E35 | held |
| E35-BENCHFAM-labor-reputation_not_authority | every labor/reputation_not_authority scenario holds | E35 | held |
| E35-BENCHFAM-latency-latency_stage | every latency/latency_stage scenario holds | E35 | held |
| E35-BENCHFAM-law-bulk_law | every law/bulk_law scenario holds | E35 | held |
| E35-BENCHFAM-law-no_authority | every law/no_authority scenario holds | E35 | held |
| E35-BENCHFAM-learner-learner_finding | every learner/learner_finding scenario holds | E35 | held |
| E35-BENCHFAM-loop-loop_step | every loop/loop_step scenario holds | E35 | held |
| E35-BENCHFAM-loop-no_self_deploy | every loop/no_self_deploy scenario holds | E35 | held |
| E35-BENCHFAM-marketplace-marketplace_object | every marketplace/marketplace_object scenario holds | E35 | held |
| E35-BENCHFAM-memory-memory_kind | every memory/memory_kind scenario holds | E35 | held |
| E35-BENCHFAM-memory-memory_kind_rejected | every memory/memory_kind_rejected scenario holds | E35 | held |
| E35-BENCHFAM-moat-no_market_moat | every moat/no_market_moat scenario holds | E35 | held |
| E35-BENCHFAM-obligation-bulk_ob | every obligation/bulk_ob scenario holds | E35 | held |
| E35-BENCHFAM-obligation-obligation_lifecycle | every obligation/obligation_lifecycle scenario holds | E35 | held |
| E35-BENCHFAM-obligation-obligation_modal | every obligation/obligation_modal scenario holds | E35 | held |
| E35-BENCHFAM-observation-epistemic_separated | every observation/epistemic_separated scenario holds | E35 | held |
| E35-BENCHFAM-observation-observation_kind | every observation/observation_kind scenario holds | E35 | held |
| E35-BENCHFAM-observation-observed_needs_source | every observation/observed_needs_source scenario holds | E35 | held |
| E35-BENCHFAM-observation-unknown_kind_refused | every observation/unknown_kind_refused scenario holds | E35 | held |
| E35-BENCHFAM-plan_check_act-decision_kind | every plan_check_act/decision_kind scenario holds | E35 | held |
| E35-BENCHFAM-policy_conflict-conflict_dimension | every policy_conflict/conflict_dimension scenario holds | E35 | held |
| E35-BENCHFAM-policy_conflict-fail_closed | every policy_conflict/fail_closed scenario holds | E35 | held |
| E35-BENCHFAM-policy_optimizer-proposal_only | every policy_optimizer/proposal_only scenario holds | E35 | held |
| E35-BENCHFAM-prediction-prediction_field | every prediction/prediction_field scenario holds | E35 | held |
| E35-BENCHFAM-prediction-prediction_signed | every prediction/prediction_signed scenario holds | E35 | held |
| E35-BENCHFAM-profile-profile_dimension | every profile/profile_dimension scenario holds | E35 | held |
| E35-BENCHFAM-r2e-research_pipeline_stage | every r2e/research_pipeline_stage scenario holds | E35 | held |
| E35-BENCHFAM-radar-radar_no_evidence | every radar/radar_no_evidence scenario holds | E35 | held |
| E35-BENCHFAM-radar-radar_topic | every radar/radar_topic scenario holds | E35 | held |
| E35-BENCHFAM-recommendation-recommendation_not_authority | every recommendation/recommendation_not_authority scenario holds | E35 | held |
| E35-BENCHFAM-recommendation-recommendation_refused_as_authority | every recommendation/recommendation_refused_as_authority scenario holds | E35 | held |
| E35-BENCHFAM-red_team-redteam_may | every red_team/redteam_may scenario holds | E35 | held |
| E35-BENCHFAM-red_team-redteam_may_not | every red_team/redteam_may_not scenario holds | E35 | held |
| E35-BENCHFAM-regret-regret_dimension | every regret/regret_dimension scenario holds | E35 | held |
| E35-BENCHFAM-research-research_maturity | every research/research_maturity scenario holds | E35 | held |
| E35-BENCHFAM-revision-no_revision | every revision/no_revision scenario holds | E35 | held |
| E35-BENCHFAM-revision-state_revision | every revision/state_revision scenario holds | E35 | held |
| E35-BENCHFAM-risk-bulk_risk | every risk/bulk_risk scenario holds | E35 | held |
| E35-BENCHFAM-risk-risk_clamped | every risk/risk_clamped scenario holds | E35 | held |
| E35-BENCHFAM-risk-risk_dimension | every risk/risk_dimension scenario holds | E35 | held |
| E35-BENCHFAM-risk-unknown_dimension | every risk/unknown_dimension scenario holds | E35 | held |
| E35-BENCHFAM-rollback-rollback_no_authority | every rollback/rollback_no_authority scenario holds | E35 | held |
| E35-BENCHFAM-root_of_trust-root_of_trust_separated | every root_of_trust/root_of_trust_separated scenario holds | E35 | held |
| E35-BENCHFAM-self_governance-self_governance_object | every self_governance/self_governance_object scenario holds | E35 | held |
| E35-BENCHFAM-self_healing-self_healing_allowed | every self_healing/self_healing_allowed scenario holds | E35 | held |
| E35-BENCHFAM-self_healing-self_healing_forbidden | every self_healing/self_healing_forbidden scenario holds | E35 | held |
| E35-BENCHFAM-simulation-simulation_is_not_reality | every simulation/simulation_is_not_reality scenario holds | E35 | held |
| E35-BENCHFAM-state_predictor-prediction_target | every state_predictor/prediction_target scenario holds | E35 | held |
| E35-BENCHFAM-swarm-swarm_role | every swarm/swarm_role scenario holds | E35 | held |
| E35-BENCHFAM-tournament-tournament_no_authority | every tournament/tournament_no_authority scenario holds | E35 | held |
| E35-BENCHFAM-trajectory-trajectory_state | every trajectory/trajectory_state scenario holds | E35 | held |
| E35-BENCHFAM-world_model-epistemic_state | every world_model/epistemic_state scenario holds | E35 | held |
| E35-BENCHFAM-world_model-transition_simulated | every world_model/transition_simulated scenario holds | E35 | held |
| E36-PERF-task_success | performance dimension task_success is evidence | E36 | held |
| E36-PERF-latency | performance dimension latency is evidence | E36 | held |
| E36-PERF-cost | performance dimension cost is evidence | E36 | held |
| E36-PERF-reliability | performance dimension reliability is evidence | E36 | held |
| E36-PERF-governance_compliance | performance dimension governance_compliance is evidence | E36 | held |
| E36-PERF-proof_completeness | performance dimension proof_completeness is evidence | E36 | held |
| E36-PERF-recovery_quality | performance dimension recovery_quality is evidence | E36 | held |
| E36-PERF-incident_rate | performance dimension incident_rate is evidence | E36 | held |
| E36-PERF-false_actions | performance dimension false_actions is evidence | E36 | held |
| E36-PERF-false_refusals | performance dimension false_refusals is evidence | E36 | held |
| E36-PERF-resource_efficiency | performance dimension resource_efficiency is evidence | E36 | held |
| E36-CORPUS-transaction_patterns | corpus category transaction_patterns exists | E36 | held |
| E36-CORPUS-governance_failures | corpus category governance_failures exists | E36 | held |
| E36-CORPUS-successful_governance | corpus category successful_governance exists | E36 | held |
| E36-CORPUS-service_reliability | corpus category service_reliability exists | E36 | held |
| E36-CORPUS-agent_behavior | corpus category agent_behavior exists | E36 | held |
| E36-CORPUS-delegation_behavior | corpus category delegation_behavior exists | E36 | held |
| E36-CORPUS-contract_failures | corpus category contract_failures exists | E36 | held |
| E36-CORPUS-recovery | corpus category recovery exists | E36 | held |
| E36-CORPUS-economic_attacks | corpus category economic_attacks exists | E36 | held |
| E36-CORPUS-proof_patterns | corpus category proof_patterns exists | E36 | held |
| E36-CORPUS-conformance_results | corpus category conformance_results exists | E36 | held |
| E36-TELEMETRY-latency | telemetry metric latency exists | E36 | held |
| E36-CAT-law | every law scenario holds | E36 | held |
| E36-CAT-identity | every identity scenario holds | E36 | held |
| E36-CAT-passport | every passport scenario holds | E36 | held |
| E36-CAT-discovery | every discovery scenario holds | E36 | held |
| E36-CAT-match | every match scenario holds | E36 | held |
| E36-CAT-marketplace | every marketplace scenario holds | E36 | held |
| E36-CAT-procurement | every procurement scenario holds | E36 | held |
| E36-CAT-negotiation | every negotiation scenario holds | E36 | held |
| E36-CAT-contract | every contract scenario holds | E36 | held |
| E36-CAT-contract_compile | every contract_compile scenario holds | E36 | held |
| E36-CAT-sla | every sla scenario holds | E36 | held |
| E36-CAT-performance | every performance scenario holds | E36 | held |
| E36-CAT-reputation | every reputation scenario holds | E36 | held |
| E36-CAT-escrow | every escrow scenario holds | E36 | held |
| E36-CAT-payment | every payment scenario holds | E36 | held |
| E36-CAT-receipt | every receipt scenario holds | E36 | held |
| E36-CAT-dispute | every dispute scenario holds | E36 | held |
| E36-CAT-arbitration | every arbitration scenario holds | E36 | held |
| E36-CAT-risk_pool | every risk_pool scenario holds | E36 | held |
| E36-CAT-warranty | every warranty scenario holds | E36 | held |
| E36-CAT-proof_market | every proof_market scenario holds | E36 | held |
| E36-CAT-bid | every bid scenario holds | E36 | held |
| E36-CAT-auction | every auction scenario holds | E36 | held |
| E36-CAT-composition | every composition scenario holds | E36 | held |
Other niches
Consensus & distributed systems · Attacks, threats & containment · Identity, authority & delegation · Evidence, receipts & proofs · Memory, data & privacy · Prediction, world models & simulation · Transactions, markets & economics · Tools, MCP, protocols & adapters · Autonomy, control loops & recovery · Policy, law & governance · Trust & reputation · Supply chain, registry & lifecycle · Core guarantees
Try CAIN-42 on your own agents
Create a free account and every new account starts with a 7-day trial of the full platform. Or try the sandbox first, with no account at all.
Create a free account → · Try the sandbox · See the whole ecosystem