Aspect-Oriented Summarization for Psychiatric Short-Term Readmission Prediction (2025.emnlp-main)
Copied to clipboard
WonJin Yoon, Boyu Ren, Spencer Thomas, Chanhwi Kim, Guergana K Savova, Mei-Hua Hall, Timothy A. Miller
| Challenge: | Recent advances in large language models have enabled the automated processing of lengthy documents even without supervised training on a task-specific dataset. |
| Approach: | They propose a method for processing the summaries of long documents using different aspect-oriented prompts and integrate the information signals from these different prompts for supervised training of transformer models. |
| Outcome: | The proposed method improves on a high-impact task predicting readmissions from a psychiatric discharge using real-world data from four hospitals. |
Similar Papers
Summarizing Text on Any Aspects: A Knowledge-Informed Weakly-Supervised Approach (2020.emnlp-main)
Copied to clipboard
| Challenge: | Existing studies on aspect-based abstractive summarization assume a small set of aspects and do not consider other diverse aspects. |
| Approach: | They propose a weak supervision construction method and an aspect modeling scheme to solve this problem. |
| Outcome: | The proposed method significantly expands the application of the task in practice. |
Abstractive Document Summarization with Summary-length Prediction (2023.findings-eacl)
Copied to clipboard
| Challenge: | Existing abstractive summarization models do not consider summarizing-specific information such as the target summary length. |
| Approach: | They propose a method for enabling a model to understand summarization-specific information by predicting the summary length in the encoder and generating a summary of the predicted length in fine-tuning. |
| Outcome: | The proposed method improves ROUGE scores on the WikiHow, NYT, and CNN/DM datasets. |
Long-Span Summarization via Local Attention and Content Selection (2021.acl-long)
Copied to clipboard
| Challenge: | Transformer-based models are state-of-the-art for a wide range of natural language processing tasks, including document summarization. |
| Approach: | They exploit large pre-trained transformer-based models and address long-span dependencies in abstractive summarization using two methods: local self-attention; and explicit content selection. |
| Outcome: | The proposed models achieve state-of-the-art on Spotify Podcast, arXiv, and PubMed datasets. |
Inducing Document Structure for Aspect-based Summarization (P19-1)
Copied to clipboard
| Challenge: | Abstractive summarization systems treat documents as unstructured and generate a single generic summary per document. |
| Approach: | They propose to incorporate document structure into automatic summarization systems . they induce latent document structure and abstractive summarizing objective . |
| Outcome: | The proposed model improves on topic-agnostic baselines and can produce abstractive and extractive aspect-based summaries. |
A Guide To Effectively Leveraging LLMs for Low-Resource Text Summarization: Data Augmentation and Semi-supervised Approaches (2025.findings-naacl)
Copied to clipboard
| Challenge: | Existing approaches for low-resource text summarization use large language models (LLMs) but such models suffer from inconsistent outputs and are difficult to adapt to domain-specific data. |
| Approach: | They propose two methods to effectively utilize large language models for low-resource text summarization. |
| Outcome: | The proposed methods synthesize high-quality documents using LLaMA-3-70b-Instruct model . they achieve competitive ROUGE scores as a fully supervised method with 5% of the labeled data. |
LexAbSumm: Aspect-based Summarization of Legal Decisions (2024.lrec-main)
Copied to clipboard
| Challenge: | LexAbSumm is a dataset designed for aspect-based summarization of legal documents . it is based on a set of ECtHR fact sheets, and is available for download. |
| Approach: | They propose a dataset designed for aspect-based summarization of legal case decisions . they evaluate abstractive summarizing models tailored for longer documents . |
| Outcome: | The proposed dataset is designed for aspect-based summarization of legal cases . it reveals a challenge in conditioning models to produce aspect-specific summaries . |
Large Language Models with Temporal Reasoning for Longitudinal Clinical Summarization and Prediction (2025.findings-emnlp)
Copied to clipboard
Maya Kruse, Shiyue Hu, Nicholas Derby, Yifu Wu, Samantha Stonbraker, Bingsheng Yao, Dakuo Wang, Elizabeth M. Goldberg, Yanjun Gao
| Challenge: | Recent advances in large language models have shown potential in clinical text summarization, but their ability to handle long patient trajectories with multi-modal data spread across time remains underexplored. |
| Approach: | They evaluate open-source large language models, their Retrieval Augmented Generation variants and chain-of-thought prompting on long-context clinical summarization and prediction. |
| Outcome: | The proposed models can synthesize structured and unstructured EHR data while reasoning over temporal coherence. |
TriSum: Learning Summarization Ability from Large Language Models with Structured Rationale (2024.naacl-long)
Copied to clipboard
| Challenge: | Large language models (LLMs) have advanced tasks like text summarization, but their size and computational demands limit their use in resource-constrained and privacy-centric settings. |
| Approach: | They propose a framework for distilling LLMs’ text summarization abilities into a compact, local model using a curriculum learning strategy that evolves from simple to complex tasks. |
| Outcome: | The proposed framework outperforms baseline models on CNN/DailyMail, XSum, and ClinicalTrial, and improves interpretability by providing insights into the summarization rationale. |
A Discourse-Aware Attention Model for Abstractive Summarization of Long Documents (N18-2)
Copied to clipboard
Arman Cohan, Franck Dernoncourt, Doo Soon Kim, Trung Bui, Seokhwan Kim, Walter Chang, Nazli Goharian
| Challenge: | Existing abstractive summarization models focus on summarizing sentences and short documents. |
| Approach: | They propose a hierarchical encoder that models the discourse structure of a document, and an attentive discourse-aware decoder to generate the summary. |
| Outcome: | The proposed model significantly outperforms state-of-the-art models on two large-scale datasets of scientific papers. |
MODABS: Multi-Objective Learning for Dynamic Aspect-Based Summarization (2024.findings-acl)
Copied to clipboard
| Challenge: | Existing methods for generating content specific summarization assume a fixed set of known aspects. |
| Approach: | They propose a dynamic aspect-based summarization framework that optimizes aspect number prediction and minimizes disparity between generated and reference summaries. |
| Outcome: | The proposed method outperforms baselines on three diverse datasets on different aspects of the input text. |