Towards Explainability in Legal Outcome Prediction Models (2024.naacl-long)

Copied to clipboard

Challenge: Current legal outcome prediction models do not explain their reasoning in the real world, but human legal actors need to understand the model’s decisions.
Approach: They propose a method for identifying the precedent employed by legal outcome prediction models and a taxonomy of legal precedent to compare human judges and neural models.
Outcome: The proposed model learns to predict outcomes reasonably well, but its use of precedent is unlike that of human judges.

Similar Papers

Precedent-Enhanced Legal Judgment Prediction with LLM and Domain-Model Collaboration (2023.emnlp-main)

Copied to clipboard

Challenge: Recent advances in deep learning have enabled a variety of techniques to be used to solve the LJP task.
Approach: They propose a framework that leverages the strength of both LLMs and domain-specific models in the context of precedents.
Outcome: The proposed framework leverages the strength of both LLM and domain models in the context of precedents.
PILOT: Legal Case Outcome Prediction with Case Law (2024.naacl-long)

Copied to clipboard

Challenge: predicting legal case outcomes requires identifying relevant precedent cases . predicting case outcomes in case law systems presents unique challenges .
Approach: They propose a framework for making legal case outcome predictions with case law . they propose to use two modules for relevant case retrieval and temporal pattern handling .
Outcome: The proposed framework shows significant improvement over previous models based on civil law cases . it is crucial to identify relevant precedent cases that serve as evidence for judges .
Prototype-Based Interpretability for Legal Citation Prediction (2023.findings-acl)

Copied to clipboard

Challenge: citation prediction is a key problem in high-stakes decision making areas such as law . experts often require interpretability for automatic systems to be utilized in practical settings .
Approach: They propose to use legal citation prediction to solve a problem with legal experts' feedback . they propose to add a prototype architecture to add interpretability while adhering to legal parameters .
Outcome: The proposed model performs well while adhering to decision parameters used by lawyers.
Towards Interactivity and Interpretability: A Rationale-based Legal Judgment Prediction Framework (2022.emnlp-main)

Copied to clipboard

Challenge: Existing models lack interpretability due to the neglect of rationale in the prediction process.
Approach: They propose a rationale-based legal judgment prediction framework that follows the judge's real trial logic and provides good interactivity and interpretability.
Outcome: The proposed framework provides good interactivity and interpretability which enables practical use.
Deconfounding Legal Judgment Prediction for European Court of Human Rights Cases Towards Better Alignment with Experts (2022.emnlp-main)

Copied to clipboard

Challenge: Legal Judgement Prediction systems without expert-informed adjustments can be vulnerable to shallow, distracting surface signals.
Approach: They propose to use domain expertise to identify statistically predictive but legally irrelevant information and adopt adversarial training to prevent it from relying on it.
Outcome: The proposed model aligns better with expert rationales than baseline models . the results are compared with an existing benchmark dataset of human rights cases .
Neural Legal Judgment Prediction in English (P19-1)

Copied to clipboard

Challenge: Recent work on legal judgment prediction has focused on Chinese, but only feature-based models have been considered in English.
Approach: They propose a hierarchical version of BERT which bypasses BERT’s length limitation.
Outcome: The proposed model outperforms existing models in binary violation classification, multi-label classification and case importance prediction.
Towards Explainability and Fairness in Swiss Judgement Prediction: Benchmarking on a Multilingual Dataset (2024.lrec-main)

Copied to clipboard

Challenge: Using Swiss Judgement Prediction, we evaluate the explainability of state-of-the-art monolingual and multilingual LJP models.
Approach: They propose an occlusion-based approach to evaluate the explainability performance of legal judgement prediction models using Swiss Judgement Prediction, the only available multilingual LJP dataset.
Outcome: The proposed framework allows us to quantify the influence of lower court information on model predictions, exposing current models’ biases.
On the Role of Negative Precedent in Legal Outcome Prediction (2023.tacl-1)

Copied to clipboard

Challenge: Legal outcome prediction is an increasingly popular task in AI.
Approach: They propose to use the dynamics of a court process to develop two new models inspired by the dynamics.
Outcome: The proposed model improves positive outcome prediction score to 77.15 F1 and doubles negative outcome prediction performance to 24.01 F1.
Legal Judgment Prediction: A Reflection on the State of the Art (2026.acl-long)

Copied to clipboard

Challenge: Legal Judgment Prediction (LJP) involves predicting judgment outcomes based on fact descriptions of cases.
Approach: They propose to use argument trees to build automated legal judgment prediction systems that are trustworthy and can be used to predict cases.
Outcome: The proposed model outperforms competitors on standard evaluation datasets and enables pluralistic values to be naturally expressed.
Legal Judgment Reimagined: PredEx and the Rise of Intelligent AI Interpretation in Indian Courts (2024.findings-acl)

Copied to clipboard

Challenge: Prediction with Explanation is the largest expert-annotated dataset for legal judgment prediction and explanation in the Indian context .
Approach: They propose to use an annotated legal judgment prediction corpus to improve models' accuracy . they employ transformer-based models tailored for both general and Indian legal contexts .
Outcome: The proposed system improves the accuracy and explanatory depth of models for legal judgments.

What is GenGO?

GenGO is an NLP powered publication search system. It currenctly indexes 30k+ papers from ACL Anthology, and implements multi-aspect summarization, semantic search, and more!

Information

About
Limitations