Understanding LLMs’ summarization capabilities: an analysis of biomedical abstract and lay summary generation (2026.findings-acl)
Copied to clipboard
| Challenge: | Abstracts use technical language for academic audiences, while lay summaries aim to make findings accessible to non-specialists. |
| Approach: | They evaluate the performance of lightweight LLMs in generating biomedical abstracts and lay summaries in a zero-shot setting. |
| Outcome: | The proposed models perform well in generating biomedical abstracts and lay summaries in a zero-shot setting. |
Similar Papers
Readability Controllable Biomedical Document Summarization (2022.findings-emnlp)
Copied to clipboard
| Challenge: | Existing controllable summarization systems for biomedical documents have little attention to readability control, leaving users with incompatible summaries . |
| Approach: | They propose a task of readability controllable summarization for biomedical documents to generate summaries that are incompatible with users' levels of expertise. |
| Outcome: | The proposed model is based on pre-trained language models with prevalent controlling and generation techniques and evaluates the readability discrepancy between lay and technical summaries. |
Can Large Language Model Summarizers Adapt to Diverse Scientific Communication Goals? (2024.findings-acl)
Copied to clipboard
| Challenge: | Recent work on the evaluation of large language models (LLMs) has shown unprecedented performance on diverse language generation tasks. |
| Approach: | They investigate the controllability of large language models on scientific summarization tasks by controlling stylistic and content coverage factors. |
| Outcome: | The proposed model outperforms humans on the MuP review generation task in terms of similarity to reference summaries and human preferences. |
Evaluating the Factuality of Zero-shot Summarizers Across Varied Domains (2024.eacl-short)
Copied to clipboard
| Challenge: | Recent work has shown that large language models can generate zero-shot summaries without explicit supervision that are often comparable or even preferred to manually composed reference summary. |
| Approach: | They evaluate large language models (LLMs) that generate zero-shot summaries without explicit supervision that are often comparable to manual reference summary . they acquire annotations from domain experts to identify inconsistencies in summaires and categorize errors. |
| Outcome: | The proposed model outperforms fine-tuned models in biomedical articles and legal bills across specialized domains. |
Benchmarking Generation and Evaluation Capabilities of Large Language Models for Instruction Controllable Summarization (2024.findings-naacl)
Copied to clipboard
Yixin Liu, Alexander Fabbri, Jiawen Chen, Yilun Zhao, Simeng Han, Shafiq Joty, Pengfei Liu, Dragomir Radev, Chien-Sheng Wu, Arman Cohan
| Challenge: | Recent studies have found that large language models (LLMs) can achieve state-of-the-art performance on generic summarization benchmarks, but their performance on more complex summarizing task settings is less studied. |
| Approach: | They benchmark large language models on instruction controllable text summarization . they use 4 evaluation protocols and 11 LLMs to evaluate their performance . |
| Outcome: | The proposed model performs well on instruction controllable text summarization tasks with 4 evaluation protocols and 11 LLMs. |
Assessing LLMs for Zero-shot Abstractive Summarization Through the Lens of Relevance Paraphrasing (2025.findings-naacl)
Copied to clipboard
| Challenge: | Large Language Models (LLMs) have achieved state-of-the-art performance at zero-shot summarization of abstractive summaries for given articles, but little is known about their robustness at this task. |
| Approach: | They propose a strategy that uses the most relevant sentences to generate an ideal summary and then paraphrases them to obtain a minimally perturbed dataset. |
| Outcome: | The proposed approach can be used to measure the robustness of LLMs as summarizers on a minimally perturbed dataset. |
Evaluation of LLMs in Medical Text Summarization: The Role of Vocabulary Adaptation in High OOV Settings (2025.findings-acl)
Copied to clipboard
| Challenge: | Large Language Models (LLMs) have been successful in medical text summarization . however, they do not perform fine-grained evaluations under difficult settings . |
| Approach: | They show that large language models show a significant performance drop for data points with high concentration of out-of-vocabulary words or with high novelty. |
| Outcome: | The proposed model shows a significant performance drop for data points with high concentration of out-of-vocabulary words or with high novelty. |
Understanding Faithfulness and Reasoning of Large Language Models on Plain Biomedical Summaries (2024.findings-emnlp)
Copied to clipboard
| Challenge: | Generating plain biomedical summaries with Large Language Models (LLMs) can enhance access to biomedically knowledge. |
| Approach: | They propose a benchmark dataset with expert-annotated Faithfulness and Reasoning on plain biomedical summaries. |
| Outcome: | The proposed dataset shows that LLMs perform poorly in generating faithful biomedical summaries and that abstractiveness and faithfulness are negatively correlated. |
A Guide To Effectively Leveraging LLMs for Low-Resource Text Summarization: Data Augmentation and Semi-supervised Approaches (2025.findings-naacl)
Copied to clipboard
| Challenge: | Existing approaches for low-resource text summarization use large language models (LLMs) but such models suffer from inconsistent outputs and are difficult to adapt to domain-specific data. |
| Approach: | They propose two methods to effectively utilize large language models for low-resource text summarization. |
| Outcome: | The proposed methods synthesize high-quality documents using LLaMA-3-70b-Instruct model . they achieve competitive ROUGE scores as a fully supervised method with 5% of the labeled data. |
An Empirical Study of Many-to-Many Summarization with Large Language Models (2025.acl-long)
Copied to clipboard
Jiaan Wang, Fandong Meng, Zengkui Sun, Yunlong Liang, Yuxuan Cao, Jiarong Xu, Haoxiang Shi, Jie Zhou
| Challenge: | Recent studies have shown that large language models (LLMs) have strong multilingual abilities, giving them the potential to perform M2MS in real applications. |
| Approach: | They propose to use many-to-many summarization (M2MS) to generate a brief summary in any language given a document also in any other language. |
| Outcome: | The proposed model outperforms zero-shot LLMs in terms of automatic evaluations. |
SumPubMed: Summarization Dataset of PubMed Scientific Articles (2021.acl-srw)
Copied to clipboard
| Challenge: | Existing summarization models that can extract the top few lines of news articles fail to summarize long documents. |
| Approach: | They constructed a scientific summarization dataset from MEDLINE articles from the PubMed archive to address this problem. |
| Outcome: | The proposed model outperforms existing models on news article summarization datasets and shows that it is more efficient to extract the top few lines. |