All Lessons

When an enterprise RAG system outputs an incorrect or incomplete response, engineers often immediately modify the system prompt or switch to a larger model. Why is this reflex (known as the Triage Fallacy) an anti-pattern?

1 / 1
advanced 45 min

Day 21: Diagnose Retrieval, Generation, and Corpus Failures

Diagnose Retrieval, Generation, and Corpus Failures

Loading lesson content...

In PolicyDesk, a German engineering employee asks for executive bonus multipliers and receives: 'I cannot find any policy covering executive bonus multipliers.' An engineer investigates the trace above. How should this incident be classified?

1 / 1

In FieldDesk, a technician servicing an X-840 Revision D pump asks for the cylinder head stud torque. FieldDesk states that the manual does not specify torque. Investigation reveals that the torque table was in Appendix B on a rotated page that the PDF parser dropped during ingestion. An engineer proposes loosening the prompt abstention rules so Claude estimates torque from bolt diameter when tables are absent. What is the fatal flaw in this proposal?

1 / 1