Digital White Papers

I L T A W H I T E P A P E R | K N O W L E D G E M A N A G E M E N T & M A R K E T I N G T E C H N O L O G I E S 22 R O B U S T R A G - B A S E D L E G A L Q U E S T I O N A N S W E R I N G S Y S T E M S F O R K N O W L E D G E M A N A G E M E N T Manish Agnihotri is the Co-Founder and COO of Coheso. He previously worked with the Machine Learning teams at Zycus and Thomson Reuters Westlaw. Manish earned a Master's degree in Data Science from Carnegie Mellon University, specializing in Generative AI applications in law. He has authored multiple academic papers and holds a patent on the application of Generative AI across diverse domains. Conclusion The application of Retrieval-Augmented Generation (RAG) systems in the legal domain shows excellent promise but faces challenges due to the complexity of legal language and document structures. Legal queries often require more than retrieving a few passages—they demand exhaustive information, aggregation, multi-hop reasoning, and handling overlapping content. Standard RAG systems lack the tailored mechanisms to meet these needs, resulting in reduced accuracy in answering legal questions. We propose enhancements such as exhaustive retrieval, structured data processing for aggregation, breaking down multi-hop queries, and document subsetting. These improvements aim to make RAG systems more effective for legal queries, delivering precise, context-aware answers. By addressing current limitations and tailoring RAG systems for legal needs, this work contributes to more efficient and accurate legal question answering, enabling professionals to make better decisions. Legal Knowledge Management system developers should expand on these challenges, addressing legal document comparison, summarization, and document versioning and amendments. Additionally, a unified system incorporating all the proposed approaches should be evaluated across benchmarks to validate its impact further. ILTA Chirag Mehta is the Co-Founder and Chief Product Officer of Coheso. Prior to Coheso, he led the Advanced Analytics team at HP, Inc. Chirag holds a Master's degree in Artificial Intelligence from Carnegie Mellon University, where he focused on Generative AI applications in law. He has experience in building and deploying large language model (LLM) applications at scale. Aditya Rathod is the Co-Founder and CTO of Coheso. He previously served as an AI consultant at ValueLabs, where he specialized in developing legal technology applications. Aditya holds a Master's degree in Artificial Intelligence, with a focus on training and fine-tuning domain-specific LLMs. He has deep expertise in integrating LLMs into enterprise-ready production applications.

• Cover