CLEAR: A Framework Enabling Large Language Models to Discern Confusing Legal Paragraphs (2025.findings-emnlp)
Copied to clipboard
| Challenge: | Existing work focuses on enabling LLMs to leverage legal rules to tackle complex legal reasoning tasks, but ignores their ability to understand legal rules. |
| Approach: | They propose a legal paragraph prediction task that aims to predict the legal paragraph given criminal facts and a framework CLEAR to enhance their legal reasoning ability. |
| Outcome: | The proposed model improves the ability of LLMs to analyze legal cases with the guidance of legal rule insights. |
Similar Papers
Can Large Language Models Grasp Legal Theories? Enhance Legal Reasoning with Insights from Multi-Agent Collaboration (2024.findings-emnlp)
Copied to clipboard
Weikang Yuan, Junjie Cao, Zhuoren Jiang, Yangyang Kang, Jun Lin, Kaisong Song, Tianqianjin Lin, Pengwei Yan, Changlong Sun, Xiaozhong Liu
| Challenge: | Existing studies have found that when LLMs are given criminal facts and legal rules, then asked whether cases constitute a certain charge, they struggle to understand legal theories and perform basic legal reasoning tasks. |
| Approach: | They propose a task to assess LLMs' understanding of legal theories and reasoning capabilities by using a novel framework: Multi-Agent framework for improving complex legal reasoning capability. |
| Outcome: | The proposed framework improves LLMs' understanding of legal theories and reasoning abilities in real-world scenarios. |
A Comprehensive Evaluation of Large Language Models on Legal Judgment Prediction (2023.findings-emnlp)
Copied to clipboard
| Challenge: | Large language models (LLMs) have demonstrated great potential for domain-specific applications, such as the law domain. |
| Approach: | They propose a framework to investigate LLMs' competence in the law domain by using similar cases and multi-choice options. |
| Outcome: | The proposed solutions can be extended to other domains to facilitate evaluations in other domain. |
Elevating Legal LLM Responses: Harnessing Trainable Logical Structures and Semantic Knowledge with Legal Reasoning (2025.naacl-long)
Copied to clipboard
| Challenge: | Existing approaches to large language models focus on semantic similarity, neglecting the intricate logical structures and reasoning essential for addressing complex legal issues. |
| Approach: | They propose a Logical-Semantic Integration Model (LSIM) that bridges semantic and logical coherence and a supervised framework that integrates semantic features with in-context learning. |
| Outcome: | The proposed framework significantly improves accuracy and reliability on a real-world legal QA dataset. |
Modeling Legal Reasoning: LM Annotation at the Edge of Human Agreement (2023.emnlp-main)
Copied to clipboard
| Challenge: | Existing research examines simple classification tasks, but ability of LMs to classify on complex tasks is less well understood. |
| Approach: | They analyze a Supreme Court opinion annotated by a team of domain experts . they find generative models perform poorly when given instructions equal to human annotators . |
| Outcome: | The proposed model performs poorly when given instructions equal to instructions given to human annotations . strongest results derive from fine-tuning models on the annotated dataset . |
Enabling Discriminative Reasoning in LLMs for Legal Judgment Prediction (2024.findings-emnlp)
Copied to clipboard
| Challenge: | Existing large language models (LLMs) underperform in legal judgment prediction due to challenges in understanding case facts and distinguishing between similar charges. |
| Approach: | They propose a framework that allows LLMs to discriminate among charges and a judicial reasoning framework to improve their models for effective legal judgment prediction. |
| Outcome: | The proposed framework improves accuracy and efficiency when dealing with complex and confusing charges. |
Courtroom-LLM: A Legal-Inspired Multi-LLM Framework for Resolving Ambiguous Text Classifications (2025.coling-main)
Copied to clipboard
| Challenge: | Using a multi-LLM structure inspired by legal courtroom processes, we demonstrate that it can improve decision-making accuracy in ambiguous text classification scenarios. |
| Approach: | They propose a legal-inspired multi-LLM structure that simulates a courtroom setting within LLMs and assigns roles similar to those of prosecutors, defense attorneys, and judges. |
| Outcome: | The proposed model outperforms both single-LLM classifiers and simpler multi-LLMS setups in ambiguous text classification tasks. |
BriefMe: A Legal NLP Benchmark for Assisting with Legal Briefs (2025.findings-acl)
Copied to clipboard
| Challenge: | a core part of legal work that has been underexplored in Legal NLP is the writing and editing of legal briefs. |
| Approach: | They propose to use large language models to help legal professionals with writing briefs by capturing and evaluating their abilities in language models. |
| Outcome: | The proposed tasks show that the models perform well on arguments summarization, argument completion, and case retrieval tasks. |
LegalLens: Leveraging LLMs for Legal Violation Identification in Unstructured Text (2024.eacl-long)
Copied to clipboard
Dor Bernsohn, Gil Semo, Yaron Vazana, Gila Hayat, Ben Hagag, Joel Niklaus, Rohit Saha, Kyryl Truskovskyi
| Challenge: | a recent study focused on detecting legal violations within unstructured textual data . a similar study focused only on associating violations with potentially affected individuals . |
| Approach: | They constructed two datasets using Large Language Models (LLMs) they publicize the results to advance legal natural language processing research . |
| Outcome: | The proposed datasets and the code used for the experiments have been released to advance legal natural language processing (NLP) |
LePREC: Reasoning as Classification over Structured Factors for Assessing Relevance of Legal Issues (2026.acl-long)
Copied to clipboard
Fanyu Wang, Xiaoxi Kang, Paul Burgess, Aashish Srivastava, Chetan Arora, Adnan Trakic, Lay-Ki Soon, Md Khalid Hossain, Lizhen Qu
| Challenge: | Large language models (LLMs) have impressive reasoning capabilities, but their precision remains inadequate. |
| Approach: | They propose a framework that integrates neural generation with statistical reasoning to improve the accuracy of large language models. |
| Outcome: | The proposed framework achieves interpretability through transparent feature weighting while maintaining data efficiency through correlation-based statistical classification. |
Legal Mathematical Reasoning with LLMs: Procedural Alignment through Two-Stage Reinforcement Learning (2025.findings-emnlp)
Copied to clipboard
| Challenge: | Existing legal mathematical reasoning models lack structured numerical reasoning . existing models perform poorly on LexNum, while LexPam improves both mathematical accuracy and legal coherence. |
| Approach: | They propose a legal mathematical reasoning benchmark LexNum and LexPam to address this problem . LexPam is a two-stage reinforcement learning framework for efficient legal reasoning training. |
| Outcome: | The proposed framework improves mathematical accuracy and legal coherence . it also improves legal cohesion and generalizes effectively across tasks and domains. |