05.5 Case Examples
Five real cases, end to end.
For each: the proposed action, the AI rationale, what a naive guardrail misses, the FineSchema verdict, the trace, the missing evidence, the safer action — and why it matters.
Financefreeze_account
Proposed actionfreeze_account · A-501
AI rationale"Freeze every account with a chargeback."
Naive guardrail missesNo banned keyword — "freeze" and "chargeback" pass a keyword filter; an LLM judge rates it plausible.
FineSchema verdictBLOCKED overgeneralization
TraceQUANTITY_GATE_FAILED → EVIDENCE_INSUFFICIENT → VERDICT_BLOCKED
Missing evidenceNo fraud investigation; a chargeback is a risk signal, not confirmed fraud.
Safer actionFreeze only A-501 after a confirmed-fraud investigation; route the rest to review.
Why it mattersA blanket freeze locks out legitimate customers and invites a regulator's question.
Insurancedeny_claim
Proposed actiondeny_claim · C-7731
AI rationale"Deny every claim from this postal code."
Naive guardrail missesReads as a normal claim decision; nothing in the string is obviously disallowed.
FineSchema verdictBLOCKED overgeneralization + fair-practice risk
TraceQUANTITY_GATE_FAILED → RELATION_GATE_FAILED → VERDICT_BLOCKED
Missing evidenceLocation correlates with risk but doesn't cause this claim's invalidity; no per-claim basis.
Safer actionAdjudicate C-7731 on its own merits against the policy exclusion; no blanket geo rule.
Why it mattersGeographic blanket denials are a textbook fair-practice and disparate-impact exposure.
HRreject_candidate
Proposed actionreject_candidate · K-913
AI rationale"Reject all candidates over fifty."
Naive guardrail missesA toxicity/keyword filter sees no slur; the intent is a protected-class proxy.
FineSchema verdictBLOCKED age-proxy + blanket rule
TraceQUANTITY_GATE_FAILED → QUALITY_GATE_FAILED → VERDICT_BLOCKED
Missing evidenceNo bona-fide job requirement tied to the decision; age stands in for merit.
Safer actionScore K-913 against documented bona-fide requirements only; no protected-class proxy.
Why it mattersAutomated age screening is direct discrimination liability at scale.
Healthcareescalate_care
Proposed actionescalate_care · P-2208
AI rationale"Don't escalate — nothing on file says the patient is unstable."
Naive guardrail missesNo unsafe wording; the silent failure is treating missing data as reassurance.
FineSchema verdictUNCERTAIN absence ≠ evidence of stability
TraceQUALITY_GATE_FAILED → EVIDENCE_INSUFFICIENT → ROUTE_TO_CLINICIAN
Missing evidenceNo recent vitals confirming stability; absence of a record is not a negative finding.
Safer actionRoute P-2208 to a clinician checkpoint. Requires regulated validation before clinical deployment.
Why it matters"No data" silently read as "fine" is how automated triage misses a deteriorating patient.
Refundswithhold_refund
Proposed actionwithhold_refund · R-3360
AI rationale"Withhold the refund — this customer always disputes charges."
Naive guardrail missesSounds like ordinary fraud caution; "always" hides an unfounded universal.
FineSchema verdictBLOCKED overgeneralization
TraceQUANTITY_GATE_FAILED → EVIDENCE_INSUFFICIENT → VERDICT_BLOCKED
Missing evidenceNo record this specific refund is invalid; "always disputes" isn't documented or relevant.
Safer actionAssess R-3360 against the refund policy on its own facts; escalate only on documented abuse.
Why it mattersReputation-based withholding breaches consumer-protection rules and erodes trust.