| Challenge: | Recent advances in NLP and information retrieval have already enabled practical applications. |
| Approach: | They propose a 'discourse' taxonomy for span-and-relation parsing of legal texts . they use a dataset of 602 state-level law paragraphs with 3,715 discourse spans and 1,671 relations to investigate the increase in liquor licenses and decrease in applicable laws. |
| Outcome: | The proposed model performs poorly at span identification and relation classification, but lags far below human level. |
Similar Papers
LexGLUE: A Benchmark Dataset for Legal Language Understanding in English (2022.acl-long)
Copied to clipboard
Ilias Chalkidis, Abhik Jana, Dirk Hartung, Michael Bommarito, Ion Androutsopoulos, Daniel Katz, Nikolaos Aletras
| Challenge: | Laws and their interpretations, legal arguments and agreements are typically expressed in writing. |
| Approach: | They propose a benchmark to evaluate model performance across legal NLU tasks . they also evaluate several generic and legal-oriented models . |
| Outcome: | The proposed model performs better across multiple tasks than previous models. |
A Legal Perspective on Training Models for Natural Language Processing (L18-1)
Copied to clipboard
| Challenge: | a significant concern in processing natural language data is the unclear legal status of the input and output data/resources. |
| Approach: | They examine which legal rules apply at relevant steps and how they affect the legal status of the results. |
| Outcome: | The proposed model training process is based on three scenarios . the analysis focuses on which legal rules apply and how they affect the legal status of the results . |
Legal Case Retrieval: A Survey of the State of the Art (2024.acl-long)
Copied to clipboard
| Challenge: | Recent years have seen increasing attention on Legal Case Retrieval (LCR) this task involves retrieving cases from a legal database of historical cases that are similar to a given query case. |
| Approach: | They present a survey of the major milestones made in legal case retrieval research . they seek to understand the datasets and recent neural models and their performances . |
| Outcome: | The proposed task is based on a dataset of historical cases similar to a given query case. |
Information Extraction from Legal Wills: How Well Does GPT-4 Do? (2023.findings-emnlp)
Copied to clipboard
| Challenge: | Using information extraction from legal wills is an important application of artificial intelligence (AI) |
| Approach: | They propose a manually annotated dataset for Information Extraction (IE) from legal wills . they also use it to evaluate the performance of large language models (LLMs) |
| Outcome: | The proposed dataset can be used to evaluate large language models on IE from legal wills . it shows that the model performs reasonably well, but inconsistent outputs and overgeneralization are observed . |
Automating Legal Interpretation with LLMs: Retrieval, Generation, and Evaluation (2025.acl-long)
Copied to clipboard
| Challenge: | a novel framework for automated legal interpretation is proposed to alleviate the burden on legal experts. |
| Approach: | They propose a framework for automated legal interpretation that uses large language models to extract concept-related information and interpret legal concepts. |
| Outcome: | The proposed framework eliminates the need for legal experts to interpret legal concepts . it uses large language models to extract concept-related information and interpret legal concept interpretations . |
LEGAL-BERT: The Muppets straight out of Law School (2020.findings-emnlp)
Copied to clipboard
| Challenge: | Existing guidelines for pre-training and fine-tuning do not always generalize well in the legal domain. |
| Approach: | They propose to use BERT out of the box, adapt it by additional pre-training on domain-specific corpora, and pre-train it from scratch on domains. |
| Outcome: | The proposed strategies are: use the original BERT out of the box, adapt it by additional pre-training on domain-specific corpora, and pre-train it from scratch on domain specific corpors. |
Discovering Explanatory Sentences in Legal Case Decisions Using Pre-trained Language Models (2021.findings-emnlp)
Copied to clipboard
| Challenge: | Understanding written laws is difficult because the abstract rules must account for a variety of situations, even those not yet encountered. |
| Approach: | They constructed a dataset of 26,959 sentences and labeled them in terms of their usefulness for explaining selected legal concepts. |
| Outcome: | The proposed models outperform the prior approaches and can learn surprisingly sophisticated features. |
Answering legal questions from laymen in German civil law system (2024.eacl-long)
Copied to clipboard
| Challenge: | Existing studies have focused on questions asked by experts, such as lawyers or legal scholars. |
| Approach: | They use a dataset to analyze laymen's legal questions paired with answers from lawyers and grounded to concrete law book paragraphs to find out what limitations exist. |
| Outcome: | The proposed system could help laymen in real situations without understanding law . the proposed system is based on 21k laymen’s legal questions paired with answers from lawyers and grounded to concrete law book paragraphs. |
LawInstruct: A Resource for Studying Language Model Adaptation to the Legal Domain (2025.findings-naacl)
Copied to clipboard
Joel Niklaus, Lucia Zheng, Arya D. McCarthy, Christopher Hahn, Brian M Rosen, Peter Henderson, Daniel E. Ho, Garrett Honke, Percy Liang, Christopher D Manning
| Challenge: | In general, instruction tuning is important for direct user interaction, but the legal domain is underrepresented in typical instruction datasets. |
| Approach: | They aggregate 58 annotated legal datasets and write instructions for each to create LawInstruct. |
| Outcome: | The proposed model improves on LegalBench across all model sizes, but no drop in MMLU. |
CLERC: A Dataset for U. S. Legal Case Retrieval and Retrieval-Augmented Analysis Generation (2025.findings-naacl)
Copied to clipboard
Abe Bohan Hou, Orion Weller, Guanghui Qin, Eugene Yang, Dawn Lawrie, Nils Holzenberger, Andrew Blair-Stanek, Benjamin Van Durme
| Challenge: | a dataset of case law is used to train and evaluate models for writing legal analyses . current approaches struggle to find relevant cases and generate legal analyses, authors say . |
| Approach: | They build a dataset of case law to support information retrieval and retrieval-augmented generation. |
| Outcome: | The proposed dataset supports two important backbone tasks: retrieval (IR) and retrieval-augmented generation (RAG). |