Development of an Enterprise-Grade Contract Understanding System (2021.naacl-industry)
Copied to clipboard
Arvind Agarwal, Laura Chiticariu, Poornima Chozhiyath Raman, Marina Danilevsky, Diman Ghazi, Ankush Gupta, Shanmukha Guttula, Yannis Katsis, Rajasekar Krishnamurthy, Yunyao Li, Shubham Mudgal, Vitobha Munigala, Nicholas Phan, Dhaval Sonawane, Sneha Srinivasan, Sudarshan R. Thitte, Mitesh Vasa, Ramiya Venkatachalam, Vinitha Yaski, Huaiyu Zhu
| Challenge: | Currently, legal contract review remains an expensive and arduous process. |
| Approach: | They describe a commercial system designed and deployed for contract understanding that enables legal professionals to review contracts. |
| Outcome: | The proposed system is used by a wide range of enterprise users and solves three major challenges. |
Similar Papers
SystemT: Declarative Text Understanding for Enterprise (N18-3)
Copied to clipboard
| Challenge: | a growing number of enterprise applications are relying on text understanding systems to understand information in unstructured and semi-structured forms. |
| Approach: | They propose a declarative text understanding system that addresses these challenges . they summarize the impact of SystemT on business and education . |
| Outcome: | The system addresses the challenges of enterprise text understanding systems . it has been deployed in a wide range of enterprise applications . |
ContractNLI: A Dataset for Document-level Natural Language Inference for Contracts (2021.findings-emnlp)
Copied to clipboard
| Challenge: | Contract review is a time-consuming procedure that costs companies millions of dollars each year . linguistic characteristics of contracts, such as negations by exceptions, contribute to the difficulty of this task . |
| Approach: | They propose a document-level natural language inference (NLI) task for contracts . they annotate and release the largest corpus to date consisting of 607 annotated contracts a linguistically rich system is proposed . |
| Outcome: | The proposed system is based on a contract review task that includes 607 annotated contracts. |
PAKTON: A Multi-Agent Framework for Question Answering in Long Legal Agreements (2025.emnlp-main)
Copied to clipboard
| Challenge: | Contract review is a complex and time-intensive task that typically requires legal expertise. |
| Approach: | a new open-source contract review framework is designed to handle complexities of contract analysis . PAKTON is a retrieval-augmented generation framework with plug-and-play capabilities . |
| Outcome: | The open-source framework outperforms models in predictive accuracy, retrieval performance, explainability, completeness, and grounded justifications. |
COMPACT: Building Compliance Paralegals via Clause Graph Reasoning over Contracts (2026.eacl-long)
Copied to clipboard
| Challenge: | Existing legal NLP benchmarks focus on single-clause tasks, such as ContractNLI and CUAD. |
| Approach: | They propose a framework that models cross-clause dependencies through structured clause graphs by extracting deontic-temporal entities from clauses and constructs typed relationship graphs capturing definitional dependencies, exception hierarchies, and temporal sequences. |
| Outcome: | The proposed framework extracts deontic-temporal entities from clauses and constructs typed relationship graphs capturing definitional dependencies, exception hierarchies, and temporal sequences. |
A Contract Corpus for Recognizing Rights and Obligations (2020.lrec-1)
Copied to clipboard
| Challenge: | Understanding the content of a contract is often difficult and costly, especially if the contract is long and complex. |
| Approach: | They describe how they built an annotated corpus of contract documents that can be used to recognize rights and obligations. |
| Outcome: | The proposed system can recognize parties' rights and obligations based on 46 English contracts and 25 Japanese contracts drafted by lawyers. |
Generating Clarification Questions for Disambiguating Contracts (2024.lrec-main)
Copied to clipboard
| Challenge: | Contractual clauses are obligatory and can detail downstream implementation activities . however, contract ambiguities can be difficult to comprehend and can lead to errors . |
| Approach: | They propose a legal NLP task that generates clarification questions for contracts . they propose generating questions that identify contract ambiguities on a document level . |
| Outcome: | The proposed task generates clarification questions for contracts that detect ambiguities on a document level and can generate an F2 score of 0.87. |
Automatic Construction of Enterprise Knowledge Base (2021.emnlp-demo)
Copied to clipboard
| Challenge: | Existing knowledge bases are often based on bootstrapping entities from human-curated sources such as Wikipedia. |
| Approach: | They propose to build a knowledge base from enterprise documents with minimal human intervention by using deep learning models and classical machine learning techniques. |
| Outcome: | The proposed system is currently serving as part of a Microsoft 365 service. |
Annotation and Classification of Relevant Clauses in Terms-and-Conditions Contracts (2024.lrec-main)
Copied to clipboard
| Challenge: | Using Large Language Models (LLMs) as foundational models, we propose a new annotation scheme to classify different types of clauses in Terms-and-Conditions contracts. |
| Approach: | They propose to use a new annotation scheme to classify clauses in Terms-and-Conditions contracts to support legal experts in identifying and assessing problematic issues. |
| Outcome: | The proposed annotation scheme achieves accuracies ranging from .79 to .95 on validation tasks. |
ProvBench: A Benchmark of Legal Provision Recommendation for Contract Auto-Reviewing (2025.acl-long)
Copied to clipboard
Xiuxuan Shen, Zhongyuan Jiang, Junsan Zhang, Junxiao Han, Yao Wan, Chengjie Guo, Bingcheng Liu, Jie Wu, Renxiang Li, Philip S. Yu
| Challenge: | Contract review is labor-intensive, time-consuming, and costly . a benchmark is proposed to detect potential legal conflicts . |
| Approach: | They propose a benchmark for legal provision recommendation and conflict detection for contract auto-reviewing which aims to recommend the legal provisions related to contract clauses and detect possible legal conflicts. |
| Outcome: | The proposed task recommends legal provisions related to contract clauses and detects legal conflicts. |
ACORD: An Expert-Annotated Retrieval Dataset for Legal Contract Drafting (2025.acl-long)
Copied to clipboard
Steven H Wang, Maksim Zubkov, Kexin Fan, Sarah Harrell, Yuyang Sun, Wei Chen, Andreas Plesner, Roger Wattenhofer
| Challenge: | Contract clause retrieval is critical to contract drafting because of its high quality and complexity. |
| Approach: | They propose the first expert-annotated benchmark specifically designed for contract clause retrieval . ACORD focuses on complex contract clauses such as Limitation of Liability, Indemnification, Change of Control . |
| Outcome: | The atticus clause retrieval dataset shows promising results but needs improvement . the benchmark can be used as an IR benchmark for the NLP community . |