Contract Discovery: Dataset and a Few-Shot Semantic Retrieval Challenge with Competitive Baselines (2020.findings-emnlp)
Copied to clipboard
Łukasz Borchmann, Dawid Wisniewski, Andrzej Gretkowski, Izabela Kosmala, Dawid Jurkiewicz, Łukasz Szałkiewicz, Gabriela Pałka, Karol Kaczmarek, Agnieszka Kaliska, Filip Graliński
| Challenge: | Existing methods for detecting text fragments are not suitable for contract discovery, since it requires manual definition of a few examples, followed by conventional information. |
| Approach: | They propose a task where legal clauses are extracted from documents, given a few examples of similar clauses from other legal acts. |
| Outcome: | The proposed task differs substantially from conventional NLI and shared tasks on legal information extraction. |
Similar Papers
ContractNLI: A Dataset for Document-level Natural Language Inference for Contracts (2021.findings-emnlp)
Copied to clipboard
| Challenge: | Contract review is a time-consuming procedure that costs companies millions of dollars each year . linguistic characteristics of contracts, such as negations by exceptions, contribute to the difficulty of this task . |
| Approach: | They propose a document-level natural language inference (NLI) task for contracts . they annotate and release the largest corpus to date consisting of 607 annotated contracts a linguistically rich system is proposed . |
| Outcome: | The proposed system is based on a contract review task that includes 607 annotated contracts. |
Annotation and Classification of Relevant Clauses in Terms-and-Conditions Contracts (2024.lrec-main)
Copied to clipboard
| Challenge: | Using Large Language Models (LLMs) as foundational models, we propose a new annotation scheme to classify different types of clauses in Terms-and-Conditions contracts. |
| Approach: | They propose to use a new annotation scheme to classify clauses in Terms-and-Conditions contracts to support legal experts in identifying and assessing problematic issues. |
| Outcome: | The proposed annotation scheme achieves accuracies ranging from .79 to .95 on validation tasks. |
What to Read in a Contract? Party-Specific Summarization of Legal Obligations, Entitlements, and Prohibitions (2023.emnlp-main)
Copied to clipboard
| Challenge: | Existing systems that generate section-wise summaries of contracts can be tedious due to length and complexity of legalese. |
| Approach: | They propose a task of party-specific extractive summarization for legal contracts . they train a pairwise importance ranker and propose incorporating domain-specific notions of importance . |
| Outcome: | The proposed system generates a party-specific contract summary using a dataset of lease agreements and lease agreements. |
BriefMe: A Legal NLP Benchmark for Assisting with Legal Briefs (2025.findings-acl)
Copied to clipboard
| Challenge: | a core part of legal work that has been underexplored in Legal NLP is the writing and editing of legal briefs. |
| Approach: | They propose to use large language models to help legal professionals with writing briefs by capturing and evaluating their abilities in language models. |
| Outcome: | The proposed tasks show that the models perform well on arguments summarization, argument completion, and case retrieval tasks. |
ACORD: An Expert-Annotated Retrieval Dataset for Legal Contract Drafting (2025.acl-long)
Copied to clipboard
Steven H Wang, Maksim Zubkov, Kexin Fan, Sarah Harrell, Yuyang Sun, Wei Chen, Andreas Plesner, Roger Wattenhofer
| Challenge: | Contract clause retrieval is critical to contract drafting because of its high quality and complexity. |
| Approach: | They propose the first expert-annotated benchmark specifically designed for contract clause retrieval . ACORD focuses on complex contract clauses such as Limitation of Liability, Indemnification, Change of Control . |
| Outcome: | The atticus clause retrieval dataset shows promising results but needs improvement . the benchmark can be used as an IR benchmark for the NLP community . |
ClauseRec: A Clause Recommendation Framework for AI-aided Contract Authoring (2021.emnlp-main)
Copied to clipboard
| Challenge: | Contracts are a common type of legal document that frequent in business workflows, but there has been limited NLP research in understanding and generating them. |
| Approach: | They propose a task of clause recommendation to help automate contract authoring . they first predict if a specific clause type is relevant to be added in a contract . then they propose two-staged pipeline to recommend top clauses based on the contract context . |
| Outcome: | The proposed pipeline predicts if a clause type is relevant to be added in a contract and recommends the top clauses for the given type based on the contract context. |
LexCLiPR: Cross-Lingual Paragraph Retrieval from Legal Judgments (2025.acl-long)
Copied to clipboard
| Challenge: | Existing work on IR focus on retrieving entire cases rather than precise, paragraph-level information. |
| Approach: | They propose a cross-lingual dataset for paragraph-level retrieval from ECtHR judgments . they evaluate retrieval models in a zero-shot setting and use multilingual case law guides . |
| Outcome: | The proposed model excels in cross-lingual retrieval, while siamese architectures are better suited for monolingual tasks. |
IL-PCSR: Legal Corpus for Prior Case and Statute Retrieval (2025.emnlp-main)
Copied to clipboard
| Challenge: | Existing models for identifying/retrieving relevant statutes and prior cases/precedents are inherently related, e.g., similar cases tend to cite similar statutes due to similar factual situation. |
| Approach: | They propose a corpus that provides a common testbed for developing models that exploit the dependence between the two tasks. |
| Outcome: | The proposed corpus exploits the dependence between the two retrieval tasks and provides a baseline model for the two tasks. |
Legal Case Retrieval: A Survey of the State of the Art (2024.acl-long)
Copied to clipboard
| Challenge: | Recent years have seen increasing attention on Legal Case Retrieval (LCR) this task involves retrieving cases from a legal database of historical cases that are similar to a given query case. |
| Approach: | They present a survey of the major milestones made in legal case retrieval research . they seek to understand the datasets and recent neural models and their performances . |
| Outcome: | The proposed task is based on a dataset of historical cases similar to a given query case. |
Information Extraction from Legal Wills: How Well Does GPT-4 Do? (2023.findings-emnlp)
Copied to clipboard
| Challenge: | Using information extraction from legal wills is an important application of artificial intelligence (AI) |
| Approach: | They propose a manually annotated dataset for Information Extraction (IE) from legal wills . they also use it to evaluate the performance of large language models (LLMs) |
| Outcome: | The proposed dataset can be used to evaluate large language models on IE from legal wills . it shows that the model performs reasonably well, but inconsistent outputs and overgeneralization are observed . |