Legal Case Document Summarization: Extractive and Abstractive Methods and their Evaluation (2022.aacl-main)
Copied to clipboard
Abhay Shukla, Paheli Bhattacharya, Soham Poddar, Rajdeep Mukherjee, Kripabandhu Ghosh, Pawan Goyal, Saptarshi Ghosh
| Challenge: | Summarization of legal case judgement documents is a challenging problem in Legal NLP. |
| Approach: | They propose to use extractive and abstractive summarization methods to evaluate legal document summarizing systems. |
| Outcome: | The proposed methods have been evaluated on three legal summarization datasets. |
Similar Papers
LexAbSumm: Aspect-based Summarization of Legal Decisions (2024.lrec-main)
Copied to clipboard
| Challenge: | LexAbSumm is a dataset designed for aspect-based summarization of legal documents . it is based on a set of ECtHR fact sheets, and is available for download. |
| Approach: | They propose a dataset designed for aspect-based summarization of legal case decisions . they evaluate abstractive summarizing models tailored for longer documents . |
| Outcome: | The proposed dataset is designed for aspect-based summarization of legal cases . it reveals a challenge in conditioning models to produce aspect-specific summaries . |
Analyzing Sentence Fusion in Abstractive Summarization (D19-54)
Copied to clipboard
Logan Lebanoff, John Muchovej, Franck Dernoncourt, Doo Soon Kim, Seokhwan Kim, Walter Chang, Fei Liu
| Challenge: | Abstractive summarization systems struggle to combine information from multiple sources, resulting in poor grammar and incorrect facts. |
| Approach: | They analyze the outputs of five abstractive summarization systems and examine their grammatical accuracy and faithfulness. |
| Outcome: | The proposed summarization systems are able to combine information from multiple sources, but they often fail to remain faithful to the original document. |
An Evaluation Framework for Legal Document Summarization (2022.lrec-1)
Copied to clipboard
| Challenge: | Existing metrics for summarizing legal documents fail to evaluate intent in the original text. |
| Approach: | They propose an automated intent-based summarization metric which shows a better agreement with human evaluation as compared to other automated metrics like BLEU, ROUGE-L etc. |
| Outcome: | The proposed method shows that human evaluation is more accurate than other metrics. |
ArgLegalSumm: Improving Abstractive Summarization of Legal Documents with Argument Mining (2022.coling-1)
Copied to clipboard
| Challenge: | Existing abstractive summarization models do not take into account argumentative structure of legal documents, which poses a challenge towards effective abstractive summary. |
| Approach: | They propose a technique that integrates argument role labeling into the summarization process by integrating argument role labels into the document. |
| Outcome: | The proposed method improves over strong baselines with pretrained language models. |
On the Abstractiveness of Neural Document Summarization (D18-1)
Copied to clipboard
| Challenge: | Recent studies show that document summarization systems are abstractive . authors suggest that automated summarizing systems could be improved . |
| Approach: | They propose to use a pure copy system to verify abstractiveness of document summarization systems. |
| Outcome: | The proposed system produces abstractive summaries while being far more efficient. |
On Extractive and Abstractive Neural Document Summarization with Transformer Language Models (2020.emnlp-main)
Copied to clipboard
| Challenge: | We present a method to produce abstractive summaries of documents that exceed several thousand words . we compare transformer based methods to extractive methods, but extractive models score higher . |
| Approach: | They propose a method to generate abstractive summaries of documents that exceed several thousand words via neural abstractive summary. |
| Outcome: | The proposed method produces abstractive summaries of documents that exceed several thousand words . it is compared with baseline methods, state-of-the-art models and variants of the proposed method . |
Towards Argument-Aware Abstractive Summarization of Long Legal Opinions with Summary Reranking (2023.findings-acl)
Copied to clipboard
| Challenge: | Existing summarization models struggle to accurately capture the main arguments of long legal opinions, leading to suboptimal summaries. |
| Approach: | They propose a framework for abstractive summarization of long legal opinions that takes into account the argument structure of the document and reranks them based on alignment with the document's argument structure. |
| Outcome: | The proposed approach outperforms several strong baselines on a dataset of long legal opinions and outperformed existing models. |
Extractive Summarization of Legal Decisions using Multi-task Learning and Maximal Marginal Relevance (2022.findings-emnlp)
Copied to clipboard
| Challenge: | Summarizing legal decisions requires the expertise of law practitioners, which is time- and cost-intensive. |
| Approach: | They propose methods for extracting summarized legal decisions using limited expert annotated data. |
| Outcome: | The proposed models achieve ROUGE scores vis-à-vis expert extracted summaries that match inter-annotator comparisons. |
Beyond Borders: Investigating Cross-Jurisdiction Transfer in Legal Case Summarization (2024.naacl-long)
Copied to clipboard
| Challenge: | a study explores the cross-jurisdictional generalizability of legal case summarization models . fine-tuning on non-target datasets outperforms unsupervised methods, but success depends on similarity between source and target jurisdictions. |
| Approach: | They explore how to effectively summarize legal cases of a target jurisdiction where reference summaries are not available. |
| Outcome: | The proposed model can be generalized across jurisdictions and improve transfer performance. |
Post-Editing Extractive Summaries by Definiteness Prediction (2021.findings-emnlp)
Copied to clipboard
| Challenge: | Abstract: Extractive summarization has been the mainstay of automatic summarizing for decades, but it still suffers from coreference issues arising from extracting sentences away from their original context. |
| Approach: | They propose a post-editing step that generates linguistic decisions that lead to improved extractive summaries by predicting definiteness of noun phrases. |
| Outcome: | The proposed system generates linguistic decisions that improve the quality of the extractive summaries. |