Challenge: Existing controllable summarization systems for biomedical documents have little attention to readability control, leaving users with incompatible summaries .
Approach: They propose a task of readability controllable summarization for biomedical documents to generate summaries that are incompatible with users' levels of expertise.
Outcome: The proposed model is based on pre-trained language models with prevalent controlling and generation techniques and evaluates the readability discrepancy between lay and technical summaries.

Similar Papers

Understanding LLMs’ summarization capabilities: an analysis of biomedical abstract and lay summary generation (2026.findings-acl)

Copied to clipboard

Challenge: Abstracts use technical language for academic audiences, while lay summaries aim to make findings accessible to non-specialists.
Approach: They evaluate the performance of lightweight LLMs in generating biomedical abstracts and lay summaries in a zero-shot setting.
Outcome: The proposed models perform well in generating biomedical abstracts and lay summaries in a zero-shot setting.
SuMe: A Dataset Towards Summarizing Biomedical Mechanisms (2022.lrec-1)

Copied to clipboard

Challenge: Biomedical studies often examine how one entity affects another in a biological context.
Approach: They propose a biomedical mechanism summarization task that pairs biomedically relevant texts with their summaries.
Outcome: The proposed task improves performance but produces acceptable outputs in 32% of instances.
Generating Summaries with Controllable Readability Levels (2023.emnlp-main)

Copied to clipboard

Challenge: Current text generation approaches focus on a specific readability level, resulting in texts that are not customized to readers’ proficiency levels.
Approach: They propose to generate summaries with fine-grained control over their readability by using instruction-based readability control, reinforcement learning and lookahead to estimate readability of upcoming decoding steps.
Outcome: The generated summaries with different readability levels were compared with previous methods that focus on a specific readability level (e.g., lay summarization) and a lookahead approach significantly improved readability control on news summarizing.
Summarizing, Simplifying, and Synthesizing Medical Evidence using GPT-3 (with Varying Success) (2023.acl-short)

Copied to clipboard

Challenge: Large language models are capable of producing high quality summaries of general domain news articles in few- and zero-shot settings, but it is unclear whether they are similarly capable in more specialized domains such as biomedicine.
Approach: They use GPT-3 to generate single- and multi-document summaries of biomedical articles, given no supervision, using a set of annotations.
Outcome: The proposed model outperforms fully supervised models in generic news summarization, but struggles to synthesize evidence across multiple documents.
The patient is more dead than alive: exploring the current state of the multi-document summarisation of the biomedical literature (2022.acl-long)

Copied to clipboard

Challenge: Existing evaluation approaches to multi-document summarization of biomedical literature lack consistency and transparency.
Approach: They propose a systematic approach to human evaluation of biomedical summaries and apply it to analyze the summary generated by two current evaluation models.
Outcome: The proposed evaluation framework is based on two state-of-the-art models and examines the summaries generated by the two models to understand the deficiencies of existing evaluation approaches.
Paragraph-level Simplification of Medical Texts (2021.naacl-main)

Copied to clipboard

Challenge: Existing methods for simplification of medical texts are limited due to jargon and technical content.
Approach: They propose to automate the simplification of medical texts by penalizing decoders for producing "jargon" terms.
Outcome: The proposed method improves on existing heuristics by penalizing the decoder for producing "jargon" terms.
Making Science Simple: Corpora for the Lay Summarisation of Scientific Literature (2022.emnlp-main)

Copied to clipboard

Challenge: Existing datasets for lay summarisation are limited in size and scope, hindering the development of data-driven approaches.
Approach: They propose to use two new datasets for the lay summarisation of biomedical research articles to characterise their lay summaries.
Outcome: The proposed datasets are compared with existing datasets and show they can be leveraged to support different audiences and applications.
Can Large Language Model Summarizers Adapt to Diverse Scientific Communication Goals? (2024.findings-acl)

Copied to clipboard

Challenge: Recent work on the evaluation of large language models (LLMs) has shown unprecedented performance on diverse language generation tasks.
Approach: They investigate the controllability of large language models on scientific summarization tasks by controlling stylistic and content coverage factors.
Outcome: The proposed model outperforms humans on the MuP review generation task in terms of similarity to reference summaries and human preferences.
Improving Biomedical Abstractive Summarisation with Knowledge Aggregation from Citation Papers (2023.emnlp-main)

Copied to clipboard

Challenge: Existing language models struggle to generate technical summaries that are on par with those produced by biomedical experts due to the lack of domain-specific background knowledge.
Approach: They propose a attention-based citation aggregation model that integrates domain-specific knowledge from citation papers and a large-scale biomedical summarisation dataset to build on.
Outcome: The proposed model outperforms state-of-the-art approaches and achieves substantial improvements in biomedical abstractive summarisation.
SumPubMed: Summarization Dataset of PubMed Scientific Articles (2021.acl-srw)

Copied to clipboard

Challenge: Existing summarization models that can extract the top few lines of news articles fail to summarize long documents.
Approach: They constructed a scientific summarization dataset from MEDLINE articles from the PubMed archive to address this problem.
Outcome: The proposed model outperforms existing models on news article summarization datasets and shows that it is more efficient to extract the top few lines.

What is GenGO?

GenGO is an NLP powered publication search system. It currenctly indexes 30k+ papers from ACL Anthology, and implements multi-aspect summarization, semantic search, and more!

Information

About
Limitations