All Lessons

What is the Fundamental Law of Reranking regarding the Candidate Recall Ceiling in two-stage retrieval architectures?

1 / 1
intermediate 45 min

Day 14: Rerank Candidates for Relevance

Rerank Candidates for Relevance

Loading lesson content...

Why is a cross-encoder model able to detect subtle conditions like 'do NOT use composite gaskets on Rev-D heads' far more reliably than a bi-encoder vector search model?

1 / 1

In PolicyDesk, the service level agreement dictates an end-to-end retrieval latency ceiling of 80 milliseconds. Stage-1 hybrid search takes 15 milliseconds. The CPU cross-encoder reranker takes 1.2 milliseconds per candidate pair. What is the optimal candidate pool depth N to maximize candidate recall without breaching the latency SLA?

1 / 1