core
The grounded answer that denied the wrong claim
Wrong policy version selected - faithful citation, wrong contract
InsuranceRAG & retrievalMetadata filtering
20–40 min· 30 cases
Learn AI by fixing what breaks.
Real incidents from AI systems that pass their evals and still get it wrong. Yours to diagnose and repair.
Public betaFreeNo sign-upNo API key
Early release. Three incidents work end to end; more are being written, and the grading may change as they do. If something breaks or confuses you, the Report a problem button is how the next fix gets chosen.
C1-001C1-002C1-003C1-004C1-005+5
decline · governing version V2 · waiting 4y → 2026-06-15
“Under V2 a waiting period of four years applies from 2022-06-15… the claim date 2025-01-10 falls inside that waiting period.”
05 retrieval.rank · weights recency 2.0 · applicability 0.0
06 resolve.version · applicability not enforced — taking top-ranked wording (V2)
07 decide.waiting_period · claim 2025-01-10 → deny
The citation is real. The quotation is accurate. The contract is the wrong one.
Incidents
All incidentscore
The answer that belonged to someone else
Customer access and cache isolation failure
InsuranceCachingAuthZ & privacy
20–35 min· 16 cases
advanced
The document that became an instruction
Evidence injection and unsafe tool authorization
InsuranceAgents & toolsPrompt injection
25–40 min· 14 cases