Litigation Analytics: Extracting and querying motions and orders from US federal courts (N19-4)
Copied to clipboard
| Challenge: | a detailed manual analysis of a docket could provide valuable information for the suit and the respective judge. |
| Approach: | They applied machine learning and machine learning to extract and aggregate docket statistics . they used a search engine to query the data in real time and a question-answering interface . |
| Outcome: | The proposed method extracts information from 8 million federal dockets and keeps up with newly closed docketes. |
Similar Papers
CLERC: A Dataset for U. S. Legal Case Retrieval and Retrieval-Augmented Analysis Generation (2025.findings-naacl)
Copied to clipboard
Abe Bohan Hou, Orion Weller, Guanghui Qin, Eugene Yang, Dawn Lawrie, Nils Holzenberger, Andrew Blair-Stanek, Benjamin Van Durme
| Challenge: | a dataset of case law is used to train and evaluate models for writing legal analyses . current approaches struggle to find relevant cases and generate legal analyses, authors say . |
| Approach: | They build a dataset of case law to support information retrieval and retrieval-augmented generation. |
| Outcome: | The proposed dataset supports two important backbone tasks: retrieval (IR) and retrieval-augmented generation (RAG). |
Learning from Litigation: Graphs for Retrieval and Reasoning in eDiscovery (2025.acl-industry)
Copied to clipboard
| Challenge: | Electronic Discovery (eDiscovery) requires identifying relevant documents from vast collections for legal production requests. |
| Approach: | They propose a system that integrates knowledge graphs for enhanced document ranking and classification, augmented by LLM-driven reasoning. |
| Outcome: | The proposed system outperforms baselines in F1-score, precision, and recall across balanced and imbalanced datasets. |
Legal Case Retrieval: A Survey of the State of the Art (2024.acl-long)
Copied to clipboard
| Challenge: | Recent years have seen increasing attention on Legal Case Retrieval (LCR) this task involves retrieving cases from a legal database of historical cases that are similar to a given query case. |
| Approach: | They present a survey of the major milestones made in legal case retrieval research . they seek to understand the datasets and recent neural models and their performances . |
| Outcome: | The proposed task is based on a dataset of historical cases similar to a given query case. |
An Element is Worth a Thousand Words: Enhancing Legal Case Retrieval by Incorporating Legal Elements (2024.findings-acl)
Copied to clipboard
| Challenge: | Existing methods for legal case retrieval lack the definition of relevance for legal cases . however, the definition goes beyond the common semantic relevance of ad-hoc retrieval. |
| Approach: | They propose a legal element dataset that incorporates legal elements into a semi-automatic method . they propose two models to enhance legal search using legal elements . |
| Outcome: | The proposed models outperform existing methods in enhancing legal search using legal elements. |
LexAbSumm: Aspect-based Summarization of Legal Decisions (2024.lrec-main)
Copied to clipboard
| Challenge: | LexAbSumm is a dataset designed for aspect-based summarization of legal documents . it is based on a set of ECtHR fact sheets, and is available for download. |
| Approach: | They propose a dataset designed for aspect-based summarization of legal case decisions . they evaluate abstractive summarizing models tailored for longer documents . |
| Outcome: | The proposed dataset is designed for aspect-based summarization of legal cases . it reveals a challenge in conditioning models to produce aspect-specific summaries . |
An Evaluation Framework for Legal Document Summarization (2022.lrec-1)
Copied to clipboard
| Challenge: | Existing metrics for summarizing legal documents fail to evaluate intent in the original text. |
| Approach: | They propose an automated intent-based summarization metric which shows a better agreement with human evaluation as compared to other automated metrics like BLEU, ROUGE-L etc. |
| Outcome: | The proposed method shows that human evaluation is more accurate than other metrics. |
Claim Extraction and Law Matching for COVID-19-related Legislation (2022.lrec-1)
Copied to clipboard
| Challenge: | Existing approaches to extract legal claims from news articles and match them with applicable laws are difficult for laypersons to learn since news articles do not refer to underlying laws. |
| Approach: | They propose an automated approach to extract legal claims from news articles and match the claims with applicable laws. |
| Outcome: | The proposed model achieves 46.7 F1 for claim extraction and 91.4 F1 law matching, despite conceptual limitations. |
GLIER: Generative Legal Inference and Evidence Ranking for Legal Case Retrieval (2026.acl-long)
Copied to clipboard
| Challenge: | Existing dense retrieval methods neglect the explicit legal logic that underpins legal relevance. |
| Approach: | They propose a framework that reformulates retrieval as an inference process over latent legal variables. |
| Outcome: | GLIER outperforms strong baselines like SAILER and KELLER in a legal case-based retrieval task . the framework exhibits exceptional data efficiency even when trained with only 10% of the data . |
Information Extraction from Legal Wills: How Well Does GPT-4 Do? (2023.findings-emnlp)
Copied to clipboard
| Challenge: | Using information extraction from legal wills is an important application of artificial intelligence (AI) |
| Approach: | They propose a manually annotated dataset for Information Extraction (IE) from legal wills . they also use it to evaluate the performance of large language models (LLMs) |
| Outcome: | The proposed dataset can be used to evaluate large language models on IE from legal wills . it shows that the model performs reasonably well, but inconsistent outputs and overgeneralization are observed . |
LegalDiscourse: Interpreting When Laws Apply and To Whom (2024.naacl-long)
Copied to clipboard
| Challenge: | Recent advances in NLP and information retrieval have already enabled practical applications. |
| Approach: | They propose a 'discourse' taxonomy for span-and-relation parsing of legal texts . they use a dataset of 602 state-level law paragraphs with 3,715 discourse spans and 1,671 relations to investigate the increase in liquor licenses and decrease in applicable laws. |
| Outcome: | The proposed model performs poorly at span identification and relation classification, but lags far below human level. |