Challenge: Existing research examines simple classification tasks, but ability of LMs to classify on complex tasks is less well understood.
Approach: They analyze a Supreme Court opinion annotated by a team of domain experts . they find generative models perform poorly when given instructions equal to human annotators .
Outcome: The proposed model performs poorly when given instructions equal to instructions given to human annotations . strongest results derive from fine-tuning models on the annotated dataset .

Similar Papers

A Legal Perspective on Training Models for Natural Language Processing (L18-1)

Copied to clipboard

Challenge: a significant concern in processing natural language data is the unclear legal status of the input and output data/resources.
Approach: They examine which legal rules apply at relevant steps and how they affect the legal status of the results.
Outcome: The proposed model training process is based on three scenarios . the analysis focuses on which legal rules apply and how they affect the legal status of the results .
A Comprehensive Evaluation of Large Language Models on Legal Judgment Prediction (2023.findings-emnlp)

Copied to clipboard

Challenge: Large language models (LLMs) have demonstrated great potential for domain-specific applications, such as the law domain.
Approach: They propose a framework to investigate LLMs' competence in the law domain by using similar cases and multi-choice options.
Outcome: The proposed solutions can be extended to other domains to facilitate evaluations in other domain.
Elevating Legal LLM Responses: Harnessing Trainable Logical Structures and Semantic Knowledge with Legal Reasoning (2025.naacl-long)

Copied to clipboard

Challenge: Existing approaches to large language models focus on semantic similarity, neglecting the intricate logical structures and reasoning essential for addressing complex legal issues.
Approach: They propose a Logical-Semantic Integration Model (LSIM) that bridges semantic and logical coherence and a supervised framework that integrates semantic features with in-context learning.
Outcome: The proposed framework significantly improves accuracy and reliability on a real-world legal QA dataset.
LawInstruct: A Resource for Studying Language Model Adaptation to the Legal Domain (2025.findings-naacl)

Copied to clipboard

Challenge: In general, instruction tuning is important for direct user interaction, but the legal domain is underrepresented in typical instruction datasets.
Approach: They aggregate 58 annotated legal datasets and write instructions for each to create LawInstruct.
Outcome: The proposed model improves on LegalBench across all model sizes, but no drop in MMLU.
LEGAL-BERT: The Muppets straight out of Law School (2020.findings-emnlp)

Copied to clipboard

Challenge: Existing guidelines for pre-training and fine-tuning do not always generalize well in the legal domain.
Approach: They propose to use BERT out of the box, adapt it by additional pre-training on domain-specific corpora, and pre-train it from scratch on domains.
Outcome: The proposed strategies are: use the original BERT out of the box, adapt it by additional pre-training on domain-specific corpora, and pre-train it from scratch on domain specific corpors.
Knowledge-Infused Legal Wisdom: Navigating LLM Consultation through the Lens of Diagnostics and Positive-Unlabeled Reinforcement Learning (2024.findings-acl)

Copied to clipboard

Challenge: Recent years have witnessed a substantial increase in the demand for legal services, especially for individuals with modest means.
Approach: They propose a diagnostic legal large language model which uses adaptive lawyer-like diagnostic questions to collect additional case information and then provides high-quality feedback.
Outcome: The proposed model surpasses classical LLMs by providing outstanding performance and a remarkable user experience in the legal domain.
GLIER: Generative Legal Inference and Evidence Ranking for Legal Case Retrieval (2026.acl-long)

Copied to clipboard

Challenge: Existing dense retrieval methods neglect the explicit legal logic that underpins legal relevance.
Approach: They propose a framework that reformulates retrieval as an inference process over latent legal variables.
Outcome: GLIER outperforms strong baselines like SAILER and KELLER in a legal case-based retrieval task . the framework exhibits exceptional data efficiency even when trained with only 10% of the data .
LegalDrill: Diagnosis-Driven Synthesis for Legal Reasoning in Small Language Models (2026.acl-industry)

Copied to clipboard

Challenge: Small language models (SLMs) are promising for real-world deployment but struggle with high-stakes legal reasoning tasks.
Approach: They propose a diagnostic-driven synthesis framework that extracts and refines reasoning trajectories from a capable teacher via fine-grained prompting and a self-reflective verification is employed to adaptively select the most effective data for the SLM student.
Outcome: The proposed framework extracts and refines reasoning trajectories from a capable teacher via fine-grained prompting, then a self-reflective verification is employed to adaptively select the most effective data for the student.
Automating Legal Interpretation with LLMs: Retrieval, Generation, and Evaluation (2025.acl-long)

Copied to clipboard

Challenge: a novel framework for automated legal interpretation is proposed to alleviate the burden on legal experts.
Approach: They propose a framework for automated legal interpretation that uses large language models to extract concept-related information and interpret legal concepts.
Outcome: The proposed framework eliminates the need for legal experts to interpret legal concepts . it uses large language models to extract concept-related information and interpret legal concept interpretations .
Evaluating Test-Time Scaling LLMs for Legal Reasoning: OpenAI o1, DeepSeek-R1, and Beyond (2025.findings-emnlp)

Copied to clipboard

Challenge: Experimental results show that Legal-R1 delivers competitive performance across diverse tasks.
Approach: They propose to evaluate 12 large language models across 17 legal tasks across statutory and case-law traditions to determine their general reasoning performance.
Outcome: The proposed model performs well across 17 legal tasks across statutory and case-law traditions.

What is GenGO?

GenGO is an NLP powered publication search system. It currenctly indexes 30k+ papers from ACL Anthology, and implements multi-aspect summarization, semantic search, and more!

Information

About
Limitations