A private GPT for your law firm: AI that knows your precedents
Legal AI tools that answer questions about legislation and case law already exist — that layer is covered. What no one covers is the layer where a law firm's real value lives: its own documents. The contracts it negotiated, the filings that won, the opinions partners signed. That know-how sits in folders and in people's heads, and it leaves with them. The pain concentrates in three concrete problems. We show how to build a private firm GPT that attacks all three: retrieval over the firm's own archive, answers with verified citations instead of confident fabrications, and confidentiality by design — hosted in the EU, with a lawyer approving anything that leaves the building.
Three real problems this solves — and who has them
1. "How did we handle this last time?" takes hours to answer
Who has it: a corporate firm with ~25 lawyers and twenty years of transactions. The best change-of-control clause the firm ever drafted exists — somewhere, in some deal folder, under some file name. Associates search by asking colleagues; when the partner who remembers leaves, the memory leaves too.
The stakes are measured: professionals expect AI to free up about 5 hours per week — roughly $19,000 of annual value per professional (Thomson Reuters, Future of Professionals 2025), and 92 % of lawyers already use at least one AI tool, with 62 % saving 6–20 % of their week (Wolters Kluwer, Future Ready Lawyer 2026). The gap isn't willingness — it's that generic tools don't know your documents.
How we solve it: the firm's archive — contracts, filings, opinions, templates — is indexed into a private retrieval layer. A lawyer asks in plain language ("our strongest liability cap in an IT outsourcing deal, seller side") and gets the actual passages, with links to the source documents. Onboarding a junior stops meaning "shadow someone for a year."
2. Generic AI doesn't know your documents — and makes things up
Who has it: any firm whose lawyers quietly paste things into a public chatbot. The answers sound authoritative, cite nothing verifiable — and sometimes cite things that don't exist.
This isn't hypothetical: Stanford researchers found that even purpose-built legal AI tools hallucinated on 17–33 % of queries (Stanford HAI), and courts worldwide keep sanctioning filings with fabricated citations. For a profession where a made-up reference is a career event, "mostly right" is not a product.
How we solve it: the assistant answers only from retrieved documents, every claim carries a citation to the passage it came from, and a deterministic verification step checks each citation against the source before the answer is shown. What can't be supported is flagged as unsupported — not improvised. A lawyer stays in the loop for anything that goes to a client or a court.
3. Client files can't go into someone else's cloud
Who has it: every firm bound by attorney-client privilege. The fastest way to kill an AI initiative internally is one question from a partner: "so our client's merger documents go where, exactly?"
Under GDPR the firm is the controller and any AI vendor a processor — which requires an Article 28 processor agreement: no training on client data, deletion on request, auditability. After Schrems II, transfers to US providers remain legally fragile. This is not a blocker; it's a design requirement — and a selling point for the firm towards its own clients.
How we solve it: the models and the index run in the EU — or directly on the firm's own infrastructure. Client data is never used to train anything, access follows the firm's matter-level permissions (who can't open the folder can't get the answer either), and every query is logged for audit.
Benchmark figures above are from Thomson Reuters, Wolters Kluwer and Stanford HAI. What your own numbers look like — hours spent searching, onboarding time, exposure — shows up fast once one practice area is on the loop. That's what the free diagnostic maps.
The idea: a loop around the firm's own knowledge
All three problems share one cause: the firm's knowledge isn't a system, it's a pile. The fix is to wrap a controlled loop around it.
The goal is not to replace lawyers or generate legal advice. The goal is that the firm's accumulated work product becomes searchable, citable and safe to use — and gets better the more the firm works.
How it works
- Ingest — the document archive is read where it lives (DMS, file server, M365), including OCR of older scans; nothing is copied out of the firm's control.
- Private retrieval — questions are answered from an index of the firm's own documents, respecting matter-level access rights. Public-law research tools stay what they are — a separate, complementary layer.
- Citations, verified — every answer links to the passages it came from, and citations are checked against the source before display. No support → the answer says so.
- Human in the loop — the assistant drafts and finds; lawyers decide. Nothing leaves the firm without a person behind it.
- Compounding — every closed matter enriches the index. The firm's twentieth year of documents finally works as hard as its twentieth lawyer.
What lawyers actually ask it:
| Question | What comes back |
|---|---|
| "Our best warranty cap for a seller in a share deal" | the three strongest clauses the firm ever negotiated, with deal context |
| "Summarise this 400-page file for the client call" | a sourced summary with page references |
| "Have we argued this before any court?" | the firm's own past filings on the point, linked |
| "Draft the first version from our template" | a draft built from the firm's approved language, marked for review |
Who it makes sense for
This makes sense for firms where the archive is old enough to be valuable and big enough to be unsearchable. Especially if:
- "ask Peter, he did something similar in 2019" is a real retrieval strategy,
- juniors take months to learn where anything is,
- lawyers already paste text into public chatbots — unofficially,
- clients ask what the firm's AI policy is, and there isn't one,
- confidentiality rules out anything that ships data to a US consumer cloud.
The same applies beyond law — auditors, tax advisors and consultancies have the same pile of past work and the same problem. And it composes with the rest of the loop family: AI agents that do the work and a register-watching corporate assistant.
The point isn't a chatbot with a law degree. It's that the firm's own twenty years of work become an asset you can query — with citations you can trust and confidentiality you can defend.
The payback is concrete: hours of searching handed back every week, juniors productive in weeks instead of months, and the firm's know-how staying home when people don't. One practice area's archive is enough to prove it.
Want to see it on your own documents? Get a free diagnostic — we map one practice area and show you exactly what we'd build, the impact and the cost. No obligation.