Evidence library · family
Coverage
116 tested rules in the 'coverage' family, 116 held.
Last reviewed 2026-10-01
116 of 116 held niche Benchmarks, coverage & performance
What this family tests
Every rule the CAIN-42 test suites recorded under the family coverage, across 7 evidence bundles. Each rule links to its own page with the recorded result and an in-browser check of the file it came from.
| ID | Rule | Bundle | Result |
|---|---|---|---|
| E30-COV-ENFORCED | coverage class 'ENFORCED' is a closed, reported category | E30 | held |
| E30-COV-MONITORED | coverage class 'MONITORED' is a closed, reported category | E30 | held |
| E30-COV-OBSERVED | coverage class 'OBSERVED' is a closed, reported category | E30 | held |
| E30-COV-PARTIALLY_ENFORCED | coverage class 'PARTIALLY_ENFORCED' is a closed, reported category | E30 | held |
| E30-COV-BYPASSABLE | coverage class 'BYPASSABLE' is a closed, reported category | E30 | held |
| E30-COV-UNCONTROLLED | coverage class 'UNCONTROLLED' is a closed, reported category | E30 | held |
| E30-COV-UNKNOWN | coverage class 'UNKNOWN' is a closed, reported category | E30 | held |
| E30-COV-MONITORED | monitored paths are never counted as enforced | E30 | held |
| E31-CV-identity | identity: unprobed coverage is UNKNOWN and blocks any universal claim | E31 | held |
| E31-CV-action | action: unprobed coverage is UNKNOWN and blocks any universal claim | E31 | held |
| E31-CV-protocol | protocol: unprobed coverage is UNKNOWN and blocks any universal claim | E31 | held |
| E31-CV-capability | capability: unprobed coverage is UNKNOWN and blocks any universal claim | E31 | held |
| E31-CV-execution | execution: unprobed coverage is UNKNOWN and blocks any universal claim | E31 | held |
| E31-CV-data | data: unprobed coverage is UNKNOWN and blocks any universal claim | E31 | held |
| E31-CV-memory | memory: unprobed coverage is UNKNOWN and blocks any universal claim | E31 | held |
| E31-CV-delegation | delegation: unprobed coverage is UNKNOWN and blocks any universal claim | E31 | held |
| E31-CV-subagent | subagent: unprobed coverage is UNKNOWN and blocks any universal claim | E31 | held |
| E31-CV-physical_action | physical_action: unprobed coverage is UNKNOWN and blocks any universal claim | E31 | held |
| E31-CV-economic_action | economic_action: unprobed coverage is UNKNOWN and blocks any universal claim | E31 | held |
| E31-CV-cloud_resource | cloud_resource: unprobed coverage is UNKNOWN and blocks any universal claim | E31 | held |
| E31-CV-computer_use | computer_use: unprobed coverage is UNKNOWN and blocks any universal claim | E31 | held |
| E31-CV-recovery | recovery: unprobed coverage is UNKNOWN and blocks any universal claim | E31 | held |
| E31-CV-evidence | evidence: unprobed coverage is UNKNOWN and blocks any universal claim | E31 | held |
| E33-COVERAGE-ENFORCED | coverage class ENFORCED is reachable only from its evidence | E33 | held |
| E33-COVERAGE-VERIFIED | coverage class VERIFIED is reachable only from its evidence | E33 | held |
| E33-COVERAGE-MONITORED | coverage class MONITORED is reachable only from its evidence | E33 | held |
| E33-COVERAGE-OBSERVED | coverage class OBSERVED is reachable only from its evidence | E33 | held |
| E33-COVERAGE-BYPASSABLE | coverage class BYPASSABLE is reachable only from its evidence | E33 | held |
| E33-COVERAGE-UNKNOWN | coverage class UNKNOWN is reachable only from its evidence | E33 | held |
| E34-COVCLASS-ENFORCED | coverage class ENFORCED exists and is never auto-universal | E34 | held |
| E34-COVCLASS-MONITORED | coverage class MONITORED exists and is never auto-universal | E34 | held |
| E34-COVCLASS-OBSERVED | coverage class OBSERVED exists and is never auto-universal | E34 | held |
| E34-COVCLASS-PARTIALLY_ENFORCED | coverage class PARTIALLY_ENFORCED exists and is never auto-universal | E34 | held |
| E34-COVCLASS-BYPASSABLE | coverage class BYPASSABLE exists and is never auto-universal | E34 | held |
| E34-COVCLASS-UNCONTROLLED | coverage class UNCONTROLLED exists and is never auto-universal | E34 | held |
| E34-COVCLASS-UNKNOWN | coverage class UNKNOWN exists and is never auto-universal | E34 | held |
| E34-SURFACE-mcp | surface mcp states its real class and basis | E34 | held |
| E34-SURFACE-a2a | surface a2a states its real class and basis | E34 | held |
| E34-SURFACE-http | surface http states its real class and basis | E34 | held |
| E34-SURFACE-rest | surface rest states its real class and basis | E34 | held |
| E34-SURFACE-grpc | surface grpc states its real class and basis | E34 | held |
| E34-SURFACE-websocket | surface websocket states its real class and basis | E34 | held |
| E34-SURFACE-event_bus | surface event_bus states its real class and basis | E34 | held |
| E34-SURFACE-cli | surface cli states its real class and basis | E34 | held |
| E34-SURFACE-shell | surface shell states its real class and basis | E34 | held |
| E34-SURFACE-filesystem | surface filesystem states its real class and basis | E34 | held |
| E34-SURFACE-browser | surface browser states its real class and basis | E34 | held |
| E34-SURFACE-computer_use | surface computer_use states its real class and basis | E34 | held |
| E34-SURFACE-databases | surface databases states its real class and basis | E34 | held |
| E34-SURFACE-cloud_apis | surface cloud_apis states its real class and basis | E34 | held |
| E34-SURFACE-credentials | surface credentials states its real class and basis | E34 | held |
| E34-SURFACE-secrets | surface secrets states its real class and basis | E34 | held |
| E34-SURFACE-deployment | surface deployment states its real class and basis | E34 | held |
| E34-SURFACE-ci_cd | surface ci_cd states its real class and basis | E34 | held |
| E34-SURFACE-containers | surface containers states its real class and basis | E34 | held |
| E34-SURFACE-subagents | surface subagents states its real class and basis | E34 | held |
| E34-SURFACE-delegation | surface delegation states its real class and basis | E34 | held |
| E34-SURFACE-scheduled_jobs | surface scheduled_jobs states its real class and basis | E34 | held |
| E34-SURFACE-autonomous_loops | surface autonomous_loops states its real class and basis | E34 | held |
| E34-SURFACE-memory_mutation | surface memory_mutation states its real class and basis | E34 | held |
| E34-SURFACE-policy_mutation | surface policy_mutation states its real class and basis | E34 | held |
| E34-SURFACE-model_replacement | surface model_replacement states its real class and basis | E34 | held |
| E34-SURFACE-skill_installation | surface skill_installation states its real class and basis | E34 | held |
| E34-SURFACE-plugin_installation | surface plugin_installation states its real class and basis | E34 | held |
| E34-SURFACE-capability_acquisition | surface capability_acquisition states its real class and basis | E34 | held |
| E34-SURFACE-financial_transactions | surface financial_transactions states its real class and basis | E34 | held |
| E34-SURFACE-machine_contracts | surface machine_contracts states its real class and basis | E34 | held |
| E34-SURFACE-physical_actuators | surface physical_actuators states its real class and basis | E34 | held |
| E34-SURFACE-vehicle_robot_boundaries | surface vehicle_robot_boundaries states its real class and basis | E34 | held |
| E34-SURFACE-research_experiments | surface research_experiments states its real class and basis | E34 | held |
| E34-SURFACE-self_improvement | surface self_improvement states its real class and basis | E34 | held |
| E34-SURFACE-code_modification | surface code_modification states its real class and basis | E34 | held |
| E34-SURFBASIS-mcp | surface mcp carries a stated enforcement basis | E34 | held |
| E34-SURFBASIS-a2a | surface a2a carries a stated enforcement basis | E34 | held |
| E34-SURFBASIS-http | surface http carries a stated enforcement basis | E34 | held |
| E34-SURFBASIS-rest | surface rest carries a stated enforcement basis | E34 | held |
| E34-SURFBASIS-grpc | surface grpc carries a stated enforcement basis | E34 | held |
| E34-SURFBASIS-websocket | surface websocket carries a stated enforcement basis | E34 | held |
| E34-SURFBASIS-event_bus | surface event_bus carries a stated enforcement basis | E34 | held |
| E34-SURFBASIS-cli | surface cli carries a stated enforcement basis | E34 | held |
| E34-SURFBASIS-shell | surface shell carries a stated enforcement basis | E34 | held |
| E34-SURFBASIS-filesystem | surface filesystem carries a stated enforcement basis | E34 | held |
| E34-SURFBASIS-browser | surface browser carries a stated enforcement basis | E34 | held |
| E34-SURFBASIS-computer_use | surface computer_use carries a stated enforcement basis | E34 | held |
| E34-SURFBASIS-databases | surface databases carries a stated enforcement basis | E34 | held |
| E34-SURFBASIS-cloud_apis | surface cloud_apis carries a stated enforcement basis | E34 | held |
| E34-SURFBASIS-credentials | surface credentials carries a stated enforcement basis | E34 | held |
| E34-SURFBASIS-secrets | surface secrets carries a stated enforcement basis | E34 | held |
| E34-SURFBASIS-deployment | surface deployment carries a stated enforcement basis | E34 | held |
| E34-SURFBASIS-ci_cd | surface ci_cd carries a stated enforcement basis | E34 | held |
| E34-SURFBASIS-containers | surface containers carries a stated enforcement basis | E34 | held |
| E34-SURFBASIS-subagents | surface subagents carries a stated enforcement basis | E34 | held |
| E34-SURFBASIS-delegation | surface delegation carries a stated enforcement basis | E34 | held |
| E34-SURFBASIS-scheduled_jobs | surface scheduled_jobs carries a stated enforcement basis | E34 | held |
| E34-SURFBASIS-autonomous_loops | surface autonomous_loops carries a stated enforcement basis | E34 | held |
| E34-SURFBASIS-memory_mutation | surface memory_mutation carries a stated enforcement basis | E34 | held |
| E34-SURFBASIS-policy_mutation | surface policy_mutation carries a stated enforcement basis | E34 | held |
| E34-SURFBASIS-model_replacement | surface model_replacement carries a stated enforcement basis | E34 | held |
| E34-SURFBASIS-skill_installation | surface skill_installation carries a stated enforcement basis | E34 | held |
| E34-SURFBASIS-plugin_installation | surface plugin_installation carries a stated enforcement basis | E34 | held |
| E34-SURFBASIS-capability_acquisition | surface capability_acquisition carries a stated enforcement basis | E34 | held |
| E34-SURFBASIS-financial_transactions | surface financial_transactions carries a stated enforcement basis | E34 | held |
| E34-SURFBASIS-machine_contracts | surface machine_contracts carries a stated enforcement basis | E34 | held |
| E34-SURFBASIS-physical_actuators | surface physical_actuators carries a stated enforcement basis | E34 | held |
| E34-SURFBASIS-vehicle_robot_boundaries | surface vehicle_robot_boundaries carries a stated enforcement basis | E34 | held |
| E34-SURFBASIS-research_experiments | surface research_experiments carries a stated enforcement basis | E34 | held |
| E34-SURFBASIS-self_improvement | surface self_improvement carries a stated enforcement basis | E34 | held |
| E34-SURFBASIS-code_modification | surface code_modification carries a stated enforcement basis | E34 | held |
| coverage | every 'coverage' invariant in this bundle (46 of 46 held) | E37 | held |
| coverage | every 'coverage' invariant in this bundle (12 of 12 held) | E38 | held |
| E42-COVCLASS-ENFORCED | coverage class ENFORCED exists and is never upgraded | E42 | held |
| E42-COVCLASS-MONITORED | coverage class MONITORED exists and is never upgraded | E42 | held |
| E42-COVCLASS-OBSERVED | coverage class OBSERVED exists and is never upgraded | E42 | held |
| E42-COVCLASS-BYPASSABLE | coverage class BYPASSABLE exists and is never upgraded | E42 | held |
| E42-COVCLASS-UNKNOWN | coverage class UNKNOWN exists and is never upgraded | E42 | held |
| E42-COVCLASS-UNCONTROLLED | coverage class UNCONTROLLED exists and is never upgraded | E42 | held |
Other families in this niche
bench_family · bench_category · property · telemetry · fabric_component · radar · swe · harness · regression · performance · corpus · end_to_end · completion · latency · f2t · false_completion · failure_to_test
Try CAIN-42 on your own agents
Create a free account and every new account starts with a 7-day trial of the full platform. Or try the sandbox first, with no account at all.
Create a free account → · Try the sandbox · See the whole ecosystem