EngineeringTechnical questionsEngineering consultancy
An assistant that answers with the governing clause, or does not answer
agreement with senior engineers
- Status
- In production
- Service
- Assistants and agents
- Built with
- RetrievalEvaluation harnessPython
01The problem
Junior engineers asking senior engineers the same questions about council requirements and design standards, across seven councils and five engineering disciplines, because the answers lived in people’s heads and in PDFs nobody could search.
02What we built
A document-grounded retrieval system that answers a question with the governing clause and its source, and declines when the documents do not cover it. Grounding was the whole brief: a confident wrong answer about a standard is worse than no answer.
03The result
92% agreement with senior engineers’ answers across a fifty-question evaluation set. The evaluation is the part people underrate. It is how you know the thing works before anyone relies on it.
More work
Something like this in your business?
Tell us how the business runs and where the time goes. We’ll tell you honestly what’s worth building, and what isn’t.