Challenge: Existing legal-oriented PLMs rely on replacing general domain training data with legal data or extending the input length to fit the long-length characteristic of legal data.
Approach: They propose a legal document encoder that leverages fine-grained legal knowledge in both the data sampling and pre-training phases.
Outcome: The proposed model outperforms existing general domain pre-training models and legal-specific pre-trainers on multiple benchmarks.

Similar Papers

ECtHR-PCR: A Dataset for Precedent Understanding and Prior Case Retrieval in the European Court of Human Rights (2024.lrec-main)

Copied to clipboard

Challenge: Prior case retrieval datasets do not simulate a realistic setting because they use complete case documents while only masking references to prior cases.
Approach: They propose a prior case retrieval dataset based on judgements from the European Court of Human Rights which explicitly separate facts from arguments and exhibit precedential practices.
Outcome: The proposed datasets do not simulate a realistic setting and expose queries to spurious patterns left behind by citation masks, potentially short-circuiting a comprehensive understanding of case facts and legal principles.
Enhancing Legal Case Retrieval via Scaling High-quality Synthetic Query-Candidate Pairs (2024.emnlp-main)

Copied to clipboard

Challenge: Existing studies focus on case-to-case retrieval using lengthy queries, which does not match real-world scenarios.
Approach: They propose a method to construct query-candidate pairs and build the largest LCR dataset to date, LEAD.
Outcome: Experimental results show that the method can provide ample training signals for LCR models.
IL-PCSR: Legal Corpus for Prior Case and Statute Retrieval (2025.emnlp-main)

Copied to clipboard

Challenge: Existing models for identifying/retrieving relevant statutes and prior cases/precedents are inherently related, e.g., similar cases tend to cite similar statutes due to similar factual situation.
Approach: They propose a corpus that provides a common testbed for developing models that exploit the dependence between the two tasks.
Outcome: The proposed corpus exploits the dependence between the two retrieval tasks and provides a baseline model for the two tasks.
Automated Refugee Case Analysis: A NLP Pipeline for Supporting Legal Practitioners (2023.findings-acl)

Copied to clipboard

Challenge: In Canada, retrieving similar cases and their analysis is a key part of legal work . long processing times are due to a significant backlog and to the amount of work required from counsels .
Approach: They propose to extend existing neural named-entity recognition models to retrieve 19 categories of items from refugee cases.
Outcome: The proposed pipeline achieves a superior F1- score on five of the targeted categories and superior to 80% on an additional 4 categories.
An Element is Worth a Thousand Words: Enhancing Legal Case Retrieval by Incorporating Legal Elements (2024.findings-acl)

Copied to clipboard

Challenge: Existing methods for legal case retrieval lack the definition of relevance for legal cases . however, the definition goes beyond the common semantic relevance of ad-hoc retrieval.
Approach: They propose a legal element dataset that incorporates legal elements into a semi-automatic method . they propose two models to enhance legal search using legal elements .
Outcome: The proposed models outperform existing methods in enhancing legal search using legal elements.
CLERC: A Dataset for U. S. Legal Case Retrieval and Retrieval-Augmented Analysis Generation (2025.findings-naacl)

Copied to clipboard

Challenge: a dataset of case law is used to train and evaluate models for writing legal analyses . current approaches struggle to find relevant cases and generate legal analyses, authors say .
Approach: They build a dataset of case law to support information retrieval and retrieval-augmented generation.
Outcome: The proposed dataset supports two important backbone tasks: retrieval (IR) and retrieval-augmented generation (RAG).
Less is More: Pretrain a Strong Siamese Encoder for Dense Text Retrieval Using a Weak Decoder (2021.emnlp-main)

Copied to clipboard

Challenge: Dense retrieval requires high-quality text sequence embeddings to support effective search in the representation space.
Approach: They propose a self-learning method that pre-trains the autoencoder using a weak decoder to push the encoder to provide better sequence representations.
Outcome: The proposed model significantly boosts the effectiveness and few-shot ability of dense retrieval models on web search, news recommendation, and open domain question answering.
GLIER: Generative Legal Inference and Evidence Ranking for Legal Case Retrieval (2026.acl-long)

Copied to clipboard

Challenge: Existing dense retrieval methods neglect the explicit legal logic that underpins legal relevance.
Approach: They propose a framework that reformulates retrieval as an inference process over latent legal variables.
Outcome: GLIER outperforms strong baselines like SAILER and KELLER in a legal case-based retrieval task . the framework exhibits exceptional data efficiency even when trained with only 10% of the data .
Learning Interpretable Legal Case Retrieval via Knowledge-Guided Case Reformulation (2024.emnlp-main)

Copied to clipboard

Challenge: Existing methods for legal case retrieval often overlook the incorporation of legal expert knowledge, leading to unsatisfactory retrieval performance.
Approach: They propose a legal knowledge-guided case reformulation approach based on large language models for effective and interpretable legal case retrieval.
Outcome: The proposed model performs better on complex legal case queries than existing methods.
Deconfounding Legal Judgment Prediction for European Court of Human Rights Cases Towards Better Alignment with Experts (2022.emnlp-main)

Copied to clipboard

Challenge: Legal Judgement Prediction systems without expert-informed adjustments can be vulnerable to shallow, distracting surface signals.
Approach: They propose to use domain expertise to identify statistically predictive but legally irrelevant information and adopt adversarial training to prevent it from relying on it.
Outcome: The proposed model aligns better with expert rationales than baseline models . the results are compared with an existing benchmark dataset of human rights cases .

What is GenGO?

GenGO is an NLP powered publication search system. It currenctly indexes 30k+ papers from ACL Anthology, and implements multi-aspect summarization, semantic search, and more!

Information

About
Limitations