Financial Services
Compliance knowledge assistant over regulated documents
Hybrid-retrieval RAG assistant for compliance and legal teams to search policy, contracts, and regulatory filings — with citations every analyst can trust.
4.2×
retrieval hit rate vs naive baseline
<3%
hallucination rate on eval set
Minutes
not hours, to find the right clause
Challenge
Analysts were copy-pasting between PDFs and chat tools. Naive RAG hallucinated on regulatory language and missed the right clause more often than not.
Approach
- Layout-aware parsing for long-form regulatory documents
- Hybrid BM25 + vector retrieval with cross-encoder reranking
- Permission-aware retrieval by document class and user role
- Faithfulness eval set built from analyst-labeled gold questions
- CI-gated eval blocks regressions on prompt or model changes
Outcomes
Citations
on every answer, down to the clause
CI-gated
eval keeps it from regressing
Stack
OpenAI
pgvector
Cohere Rerank
LangGraph
Langfuse
Build something like this
Book a discovery call. We'll scope the right engagement for your version of this problem.
Book a callReady to accelerate your tech growth?
Schedule your free consultation today and let's discuss how we can help your business scale efficiently.
