CAIN-42 CAIN Studio

Evidence library · niche

Benchmarks, coverage & performance

How fast it runs and how much was tested. 1269 tested invariants.

Last reviewed 2026-10-01

1269 of 1269 held

Where this niche's rules come from

Test families in this niche

bench_family (669) · bench_category (336) · coverage (116) · property (50) · harness (15) · regression (11) · performance (11) · corpus (11) · end_to_end (10) · completion (10) · latency (9) · false_completion (8) · fabric_component (2) · failure_to_test (1) · swe (1) · telemetry (1) · radar (1) · f2t (1)

Where these come from

Rules 901–1050 of 1269

IDRuleBundleResult
E40-CAT-scaleevery scale scenario holdsE40held
E40-FAM-authority-boundedfamily authority/bounded holdsE40held
E40-FAM-authority-unboundedfamily authority/unbounded holdsE40held
E40-FAM-autonomy_budget-budget_dimfamily autonomy_budget/budget_dim holdsE40held
E40-FAM-autonomy_budget-budget_exhaustionfamily autonomy_budget/budget_exhaustion holdsE40held
E40-FAM-autonomy_budget-child_boundedfamily autonomy_budget/child_bounded holdsE40held
E40-FAM-autonomy_gradient-no_request_increasefamily autonomy_gradient/no_request_increase holdsE40held
E40-FAM-calibration-overconfidencefamily calibration/overconfidence holdsE40held
E40-FAM-causal-bad_relationfamily causal/bad_relation holdsE40held
E40-FAM-causal-causal_relationfamily causal/causal_relation holdsE40held
E40-FAM-certificate-completion_certificatefamily certificate/completion_certificate holdsE40held
E40-FAM-checkpoint-human_on_high_riskfamily checkpoint/human_on_high_risk holdsE40held
E40-FAM-clock-stale_statefamily clock/stale_state holdsE40held
E40-FAM-completion-bulk_completionfamily completion/bulk_completion holdsE40held
E40-FAM-completion-completion_kindfamily completion/completion_kind holdsE40held
E40-FAM-completion-partial_not_completefamily completion/partial_not_complete holdsE40held
E40-FAM-counterfactual-counterfactual_not_factfamily counterfactual/counterfactual_not_fact holdsE40held
E40-FAM-degradation-no_authority_increasefamily degradation/no_authority_increase holdsE40held
E40-FAM-drift-bad_kindfamily drift/bad_kind holdsE40held
E40-FAM-drift-drift_kindfamily drift/drift_kind holdsE40held
E40-FAM-epistemic-claimedfamily epistemic/claimed holdsE40held
E40-FAM-epistemic-conflictedfamily epistemic/conflicted holdsE40held
E40-FAM-epistemic-corroboratedfamily epistemic/corroborated holdsE40held
E40-FAM-epistemic-observedfamily epistemic/observed holdsE40held
E40-FAM-epistemic-predictedfamily epistemic/predicted holdsE40held
E40-FAM-epistemic-revokedfamily epistemic/revoked holdsE40held
E40-FAM-epistemic-simulatedfamily epistemic/simulated holdsE40held
E40-FAM-epistemic-stalefamily epistemic/stale holdsE40held
E40-FAM-false_completion-false_completionfamily false_completion/false_completion holdsE40held
E40-FAM-forecast-prediction_not_observationfamily forecast/prediction_not_observation holdsE40held
E40-FAM-human-human_authorityfamily human/human_authority holdsE40held
E40-FAM-law-bulk_lawfamily law/bulk_law holdsE40held
E40-FAM-law-no_authorityfamily law/no_authority holdsE40held
E40-FAM-loop-loop_stepfamily loop/loop_step holdsE40held
E40-FAM-loop-mandatory_stepfamily loop/mandatory_step holdsE40held
E40-FAM-objective-no_silent_overridefamily objective/no_silent_override holdsE40held
E40-FAM-objective-objective_levelfamily objective/objective_level holdsE40held
E40-FAM-proof-proof_completefamily proof/proof_complete holdsE40held
E40-FAM-proof-proof_incompletefamily proof/proof_incomplete holdsE40held
E40-FAM-reconcile-conflictedfamily reconcile/conflicted holdsE40held
E40-FAM-reconcile-resolvedfamily reconcile/resolved holdsE40held
E40-FAM-reconcile-stalefamily reconcile/stale holdsE40held
E40-FAM-reconcile-unknownfamily reconcile/unknown holdsE40held
E40-FAM-reject-no_authorityfamily reject/no_authority holdsE40held
E40-FAM-replan-replan_triggerfamily replan/replan_trigger holdsE40held
E40-FAM-resource-resource_objectfamily resource/resource_object holdsE40held
E40-FAM-risk-risk_dimensionfamily risk/risk_dimension holdsE40held
E40-FAM-scale-object_scalefamily scale/object_scale holdsE40held
E40-FAM-simulation-simulation_not_realityfamily simulation/simulation_not_reality holdsE40held
E40-FAM-time_machine-known_at_tfamily time_machine/known_at_t holdsE40held
E40-FAM-world_model-bad_epistemicfamily world_model/bad_epistemic holdsE40held
E40-FAM-world_model-bad_kindfamily world_model/bad_kind holdsE40held
E40-FAM-world_model-bulk_objectfamily world_model/bulk_object holdsE40held
E40-FAM-world_model-object_fieldfamily world_model/object_field holdsE40held
E40-FAM-world_model-object_kindfamily world_model/object_kind holdsE40held
E40-FAM2-authority-boundedfamily authority/bounded is a held, non-empty checkE40held
E40-FAM2-authority-unboundedfamily authority/unbounded is a held, non-empty checkE40held
E40-FAM2-autonomy_budget-budget_dimfamily autonomy_budget/budget_dim is a held, non-empty checkE40held
E40-FAM2-autonomy_budget-budget_exhaustionfamily autonomy_budget/budget_exhaustion is a held, non-empty checkE40held
E40-FAM2-autonomy_budget-child_boundedfamily autonomy_budget/child_bounded is a held, non-empty checkE40held
E40-FAM2-autonomy_gradient-no_request_increasefamily autonomy_gradient/no_request_increase is a held, non-empty checkE40held
E40-FAM2-calibration-overconfidencefamily calibration/overconfidence is a held, non-empty checkE40held
E40-FAM2-causal-bad_relationfamily causal/bad_relation is a held, non-empty checkE40held
E40-FAM2-causal-causal_relationfamily causal/causal_relation is a held, non-empty checkE40held
E40-FAM2-certificate-completion_certificatefamily certificate/completion_certificate is a held, non-empty checkE40held
E40-FAM2-checkpoint-human_on_high_riskfamily checkpoint/human_on_high_risk is a held, non-empty checkE40held
E40-FAM2-clock-stale_statefamily clock/stale_state is a held, non-empty checkE40held
E40-FAM2-completion-bulk_completionfamily completion/bulk_completion is a held, non-empty checkE40held
E40-FAM2-completion-completion_kindfamily completion/completion_kind is a held, non-empty checkE40held
E40-FAM2-completion-partial_not_completefamily completion/partial_not_complete is a held, non-empty checkE40held
E40-FAM2-counterfactual-counterfactual_not_factfamily counterfactual/counterfactual_not_fact is a held, non-empty checkE40held
E40-FAM2-degradation-no_authority_increasefamily degradation/no_authority_increase is a held, non-empty checkE40held
E40-FAM2-drift-bad_kindfamily drift/bad_kind is a held, non-empty checkE40held
E40-FAM2-drift-drift_kindfamily drift/drift_kind is a held, non-empty checkE40held
E40-FAM2-epistemic-claimedfamily epistemic/claimed is a held, non-empty checkE40held
E40-FAM2-epistemic-conflictedfamily epistemic/conflicted is a held, non-empty checkE40held
E40-FAM2-epistemic-corroboratedfamily epistemic/corroborated is a held, non-empty checkE40held
E40-FAM2-epistemic-observedfamily epistemic/observed is a held, non-empty checkE40held
E40-FAM2-epistemic-predictedfamily epistemic/predicted is a held, non-empty checkE40held
E40-FAM2-epistemic-revokedfamily epistemic/revoked is a held, non-empty checkE40held
E40-FAM2-epistemic-simulatedfamily epistemic/simulated is a held, non-empty checkE40held
E40-FAM2-epistemic-stalefamily epistemic/stale is a held, non-empty checkE40held
E40-FAM2-false_completion-false_completionfamily false_completion/false_completion is a held, non-empty checkE40held
E40-FAM2-forecast-prediction_not_observationfamily forecast/prediction_not_observation is a held, non-empty checkE40held
E40-FAM2-human-human_authorityfamily human/human_authority is a held, non-empty checkE40held
E40-FAM2-law-bulk_lawfamily law/bulk_law is a held, non-empty checkE40held
E40-FAM2-law-no_authorityfamily law/no_authority is a held, non-empty checkE40held
E40-FAM2-loop-loop_stepfamily loop/loop_step is a held, non-empty checkE40held
E40-FAM2-loop-mandatory_stepfamily loop/mandatory_step is a held, non-empty checkE40held
E40-FAM2-objective-no_silent_overridefamily objective/no_silent_override is a held, non-empty checkE40held
E40-FAM2-objective-objective_levelfamily objective/objective_level is a held, non-empty checkE40held
E40-FAM2-proof-proof_completefamily proof/proof_complete is a held, non-empty checkE40held
E40-FAM2-proof-proof_incompletefamily proof/proof_incomplete is a held, non-empty checkE40held
E40-FAM2-reconcile-conflictedfamily reconcile/conflicted is a held, non-empty checkE40held
E40-FAM2-reconcile-resolvedfamily reconcile/resolved is a held, non-empty checkE40held
E40-FAM2-reconcile-stalefamily reconcile/stale is a held, non-empty checkE40held
E40-FAM2-reconcile-unknownfamily reconcile/unknown is a held, non-empty checkE40held
E40-FAM2-reject-no_authorityfamily reject/no_authority is a held, non-empty checkE40held
E40-FAM2-replan-replan_triggerfamily replan/replan_trigger is a held, non-empty checkE40held
E40-FAM2-resource-resource_objectfamily resource/resource_object is a held, non-empty checkE40held
E40-FAM2-risk-risk_dimensionfamily risk/risk_dimension is a held, non-empty checkE40held
E40-FAM2-scale-object_scalefamily scale/object_scale is a held, non-empty checkE40held
E40-FAM2-simulation-simulation_not_realityfamily simulation/simulation_not_reality is a held, non-empty checkE40held
E40-FAM2-time_machine-known_at_tfamily time_machine/known_at_t is a held, non-empty checkE40held
E40-FAM2-world_model-bad_epistemicfamily world_model/bad_epistemic is a held, non-empty checkE40held
E40-FAM2-world_model-bad_kindfamily world_model/bad_kind is a held, non-empty checkE40held
E40-FAM2-world_model-bulk_objectfamily world_model/bulk_object is a held, non-empty checkE40held
E40-FAM2-world_model-object_fieldfamily world_model/object_field is a held, non-empty checkE40held
E40-FAM2-world_model-object_kindfamily world_model/object_kind is a held, non-empty checkE40held
E40-CAT2-lawcategory law has many held scenariosE40held
E40-CAT2-epistemiccategory epistemic has many held scenariosE40held
E40-CAT2-world_modelcategory world_model has many held scenariosE40held
E40-CAT2-reconcilecategory reconcile has many held scenariosE40held
E40-CAT2-driftcategory drift has many held scenariosE40held
E40-CAT2-causalcategory causal has many held scenariosE40held
E40-CAT2-objectivecategory objective has many held scenariosE40held
E40-CAT2-riskcategory risk has many held scenariosE40held
E40-CAT2-resourcecategory resource has many held scenariosE40held
E40-CAT2-authoritycategory authority has many held scenariosE40held
E40-CAT2-forecastcategory forecast has many held scenariosE40held
E40-CAT2-calibrationcategory calibration has many held scenariosE40held
E40-CAT2-counterfactualcategory counterfactual has many held scenariosE40held
E40-CAT2-simulationcategory simulation has many held scenariosE40held
E40-CAT2-autonomy_budgetcategory autonomy_budget has many held scenariosE40held
E40-CAT2-autonomy_gradientcategory autonomy_gradient has many held scenariosE40held
E40-CAT2-humancategory human has many held scenariosE40held
E40-CAT2-checkpointcategory checkpoint has many held scenariosE40held
E40-CAT2-completioncategory completion has many held scenariosE40held
E40-CAT2-false_completioncategory false_completion has many held scenariosE40held
E40-CAT2-clockcategory clock has many held scenariosE40held
E40-CAT2-degradationcategory degradation has many held scenariosE40held
E40-CAT2-replancategory replan has many held scenariosE40held
E40-CAT2-time_machinecategory time_machine has many held scenariosE40held
E40-CAT2-proofcategory proof has many held scenariosE40held
E40-CAT2-certificatecategory certificate has many held scenariosE40held
E40-CAT2-loopcategory loop has many held scenariosE40held
E40-CAT2-rejectcategory reject has many held scenariosE40held
E40-CAT2-scalecategory scale has many held scenariosE40held
E41-F2T-REGRESSIONfailure-to-test stage REGRESSION existsE41held
E41-CAT-lawevery law scenario holdsE41held
E41-CAT-relationshipevery relationship scenario holdsE41held
E41-CAT-discoveryevery discovery scenario holdsE41held
E41-CAT-attestevery attest scenario holdsE41held
E41-CAT-negotiationevery negotiation scenario holdsE41held
E41-CAT-handshakeevery handshake scenario holdsE41held
E41-CAT-contractevery contract scenario holdsE41held
E41-CAT-workevery work scenario holdsE41held
E41-CAT-receiptevery receipt scenario holdsE41held
E41-CAT-settlementevery settlement scenario holdsE41held
E41-CAT-disputeevery dispute scenario holdsE41held

1 2 3 4 5 6 7 8 9

Other niches

Consensus & distributed systems · Attacks, threats & containment · Identity, authority & delegation · Evidence, receipts & proofs · Memory, data & privacy · Prediction, world models & simulation · Transactions, markets & economics · Tools, MCP, protocols & adapters · Autonomy, control loops & recovery · Policy, law & governance · Trust & reputation · Supply chain, registry & lifecycle · Core guarantees

Try CAIN-42 on your own agents

Create a free account and every new account starts with a 7-day trial of the full platform. Or try the sandbox first, with no account at all.

Create a free account →  ·  Try the sandbox  ·  See the whole ecosystem