Improving Biomedical Abstractive Summarisation with Knowledge Aggregation from Citation Papers (2023.emnlp-main)
Copied to clipboard
| Challenge: | Existing language models struggle to generate technical summaries that are on par with those produced by biomedical experts due to the lack of domain-specific background knowledge. |
| Approach: | They propose a attention-based citation aggregation model that integrates domain-specific knowledge from citation papers and a large-scale biomedical summarisation dataset to build on. |
| Outcome: | The proposed model outperforms state-of-the-art approaches and achieves substantial improvements in biomedical abstractive summarisation. |
Similar Papers
Fine-grained Information Extraction from Biomedical Literature based on Knowledge-enriched Abstract Meaning Representation (2021.acl-long)
Copied to clipboard
| Challenge: | Compared with general natural language texts, sentences from scientific papers usually possess wider contexts between knowledge elements. |
| Approach: | They propose a novel biomedical Information Extraction model to extract scientific entities and events from English research papers using Abstract Meaning Representation (AMR) they construct a sentence-level knowledge graph from an external knowledge base and encode it to improve the model's understanding of complex scientific concepts. |
| Outcome: | The proposed model can extract scientific entities and events from scientific literature and improve its understanding of complex scientific concepts. |
Enhancing Biomedical Lay Summarisation with External Knowledge Graphs (2023.emnlp-main)
Copied to clipboard
| Challenge: | Existing approaches to lay summarisation are reliant on the source article, which is unlikely to include all the information necessary for a lay audience. |
| Approach: | They augment existing biomedical lay summarisation dataset with article-specific knowledge graphs that contain detailed information on relevant biomedically related concepts. |
| Outcome: | The proposed methods improve readability and explanation of technical concepts by integrating graph-based domain knowledge within lay summarisation models. |
Readability Controllable Biomedical Document Summarization (2022.findings-emnlp)
Copied to clipboard
| Challenge: | Existing controllable summarization systems for biomedical documents have little attention to readability control, leaving users with incompatible summaries . |
| Approach: | They propose a task of readability controllable summarization for biomedical documents to generate summaries that are incompatible with users' levels of expertise. |
| Outcome: | The proposed model is based on pre-trained language models with prevalent controlling and generation techniques and evaluates the readability discrepancy between lay and technical summaries. |
SuMe: A Dataset Towards Summarizing Biomedical Mechanisms (2022.lrec-1)
Copied to clipboard
| Challenge: | Biomedical studies often examine how one entity affects another in a biological context. |
| Approach: | They propose a biomedical mechanism summarization task that pairs biomedically relevant texts with their summaries. |
| Outcome: | The proposed task improves performance but produces acceptable outputs in 32% of instances. |
Enhancing Scientific Document Summarization with Research Community Perspective and Background Knowledge (2024.lrec-main)
Copied to clipboard
| Challenge: | Scientific paper summarization is the focus of recent research . prevailing summarizing methods involve selective extraction of content from abstract, introduction, and conclusion segments within the target articles. |
| Approach: | They propose a model that incorporates references and citations to capture the impact of the document on the research community. |
| Outcome: | The proposed model generates extractive and abstractive summaries in parallel and improves their performance when considering the standard metrics. |
Understanding LLMs’ summarization capabilities: an analysis of biomedical abstract and lay summary generation (2026.findings-acl)
Copied to clipboard
| Challenge: | Abstracts use technical language for academic audiences, while lay summaries aim to make findings accessible to non-specialists. |
| Approach: | They evaluate the performance of lightweight LLMs in generating biomedical abstracts and lay summaries in a zero-shot setting. |
| Outcome: | The proposed models perform well in generating biomedical abstracts and lay summaries in a zero-shot setting. |
Summarizing, Simplifying, and Synthesizing Medical Evidence using GPT-3 (with Varying Success) (2023.acl-short)
Copied to clipboard
| Challenge: | Large language models are capable of producing high quality summaries of general domain news articles in few- and zero-shot settings, but it is unclear whether they are similarly capable in more specialized domains such as biomedicine. |
| Approach: | They use GPT-3 to generate single- and multi-document summaries of biomedical articles, given no supervision, using a set of annotations. |
| Outcome: | The proposed model outperforms fully supervised models in generic news summarization, but struggles to synthesize evidence across multiple documents. |
A Discourse-Aware Attention Model for Abstractive Summarization of Long Documents (N18-2)
Copied to clipboard
Arman Cohan, Franck Dernoncourt, Doo Soon Kim, Trung Bui, Seokhwan Kim, Walter Chang, Nazli Goharian
| Challenge: | Existing abstractive summarization models focus on summarizing sentences and short documents. |
| Approach: | They propose a hierarchical encoder that models the discourse structure of a document, and an attentive discourse-aware decoder to generate the summary. |
| Outcome: | The proposed model significantly outperforms state-of-the-art models on two large-scale datasets of scientific papers. |
Scientific Paper Extractive Summarization Enhanced by Citation Graphs (2022.emnlp-main)
Copied to clipboard
| Challenge: | citation graphs can be used to extract scientific papers under different conditions. |
| Approach: | They propose a multi-granularity unsupervised summarization model that fine tunes a pre-trained encoder model on the citation graph by link prediction tasks. |
| Outcome: | The proposed model outperforms baseline models on a public benchmark dataset. |
Parameter-Efficient Domain Knowledge Integration from Multiple Sources for Biomedical Pre-trained Language Models (2021.findings-emnlp)
Copied to clipboard
| Challenge: | Existing domain-specific pre-trained language models (PLMs) rely on self-supervised learning over large amounts of domain text, without explicitly integrating domain- specific knowledge. |
| Approach: | They propose to integrate domain knowledge from diverse sources into PLMs by using adapters that are pre-trained for individual domain knowledge sources and integrated via an attention-based knowledge controller. |
| Outcome: | The proposed architecture integrates domain knowledge from diverse sources into PLMs in a parameter-efficient way. |