Is high coverage the same as a pass?

No. Coverage measures how much is proven, in either direction. A tool can have 100% coverage and still send data — the point is the data flow is evidenced, not assumed.

Why not trust the model's own confidence?

Confidence is generated from text patterns, not observation. Coverage is computed from captured evidence. Confidence is not evidence.

Definition

Evidence Coverage

Evidence Coverage is the share of an audit's claims that are backed by independently captured evidence rather than assertion. An audit that states five things but proves one has 20% evidence coverage.

How it's measured

Canary extracts each claim, then for each one looks for real evidence — intercepted traffic, a matching line in the tool's docs, a passed capture self-test. Coverage = supported claims ÷ total claims.

Examples

An audit claiming 'sends no data' is only covered if a live capture self-test confirms no egress. An audit claiming 'sends data to X' is only covered if a request to X was actually intercepted.

FAQ

Is high coverage the same as a pass?: No. Coverage measures how much is proven, in either direction. A tool can have 100% coverage and still send data — the point is the data flow is evidenced, not assumed.
Why not trust the model's own confidence?: Confidence is generated from text patterns, not observation. Coverage is computed from captured evidence. Confidence is not evidence.