Leveraging Pretrained Models for Automatic Summarization of Doctor-Patient Conversations (2021.findings-emnlp)
Copied to clipboard
Longxiang Zhang, Renato Negrinho, Arindam Ghosh, Vasudevan Jagannathan, Hamid Reza Hassanzadeh, Thomas Schaaf, Matthew R. Gormley
| Challenge: | Using pretrained transformer models for automatically summarizing doctor-patient conversations presents challenges . limited training data, domain shift, long and noisy transcripts, and high target summary variability are challenges compared to human annotators. |
| Approach: | They propose a method for fine-tuning pretrained transformer models for automatically summarizing doctor-patient conversations directly from transcripts. |
| Outcome: | The proposed method surpasses the performance of an average human annotator and the quality of previous published work for the task. |
Similar Papers
Few-shot fine-tuning SOTA summarization models for medical dialogues (2022.naacl-srw)
Copied to clipboard
| Challenge: | Abstractive summarization of medical dialogues is a challenge for standard training approaches due to the paucity of suitable datasets. |
| Approach: | They propose to use medical dialogues to generate abstractive summaries using transformer-based models with zero-shot and few-shot learning strategies. |
| Outcome: | The proposed models were compared with a medical dialogue dataset with 143 snippets and a general domain and dialogue-specific text to assess their performance. |
Efficient Few-Shot Fine-Tuning for Opinion Summarization (2022.findings-naacl)
Copied to clipboard
| Challenge: | Abstractive summarization models are typically pre-trained on large amounts of generic texts . large annotated datasets of reviews paired with reference summaries are not available . |
| Approach: | They propose a few-shot method which uses adapters to store in-domain knowledge . they pre-train adapters on unannotated customer reviews and fine-tune them on annotated datasets . |
| Outcome: | The proposed method can store in-domain knowledge and improves on large annotated reviews . it improves coherence and redundancies on the Amazon and Yelp datasets . |
Training Dynamics for Text Summarization Models (2022.findings-acl)
Copied to clipboard
| Challenge: | Pre-trained language models have shown impressive results when fine-tuned on large summarization datasets. |
| Approach: | They analyze the training dynamics for generation models, focusing on summarization . they find that a propensity to copy the input is learned early in the training process . |
| Outcome: | The proposed model learns at different stages of fine-tuning, the authors show . they show that factual errors are learnt in later stages, but not at high-loss tokens . |
Post-Training Dialogue Summarization using Pseudo-Paraphrasing (2022.findings-naacl)
Copied to clipboard
| Challenge: | Existing approaches to dialogue summarization use dialogue-specific features that require additional knowledge to recognize or make the models harder to tune. |
| Approach: | They propose to post-train pretrained language models to rephrase from dialogue to narratives and fine-tune them as usual. |
| Outcome: | The proposed approach outperforms existing models by summary quality and implementation costs. |
Summary Grounded Conversation Generation (2021.findings-acl)
Copied to clipboard
| Challenge: | Existing datasets for conversation summarization are small due to the lack of large-scale datasets. |
| Approach: | They propose three approaches to generate summary grounded conversations, and evaluate the generated conversations using automatic measures and human judgements. |
| Outcome: | The proposed models can generate entire conversations with only a summary of a conversation as the input. |
An Exploratory Study on Long Dialogue Summarization: What Works and What’s Next (2021.findings-emnlp)
Copied to clipboard
Yusen Zhang, Ansong Ni, Tao Yu, Rui Zhang, Chenguang Zhu, Budhaditya Deb, Asli Celikyilmaz, Ahmed Hassan Awadallah, Dragomir Radev
| Challenge: | Existing models for dialogue summarization focus on extracting the main events of short conversations, but real-world dialogues are difficult to train. |
| Approach: | They propose three strategies to deal with the lengthy input problem and locate relevant information using long dialogue datasets. |
| Outcome: | The retrieve-then-summarize pipeline models yield the best performance on three long dialogue datasets. |
Evaluation of Dataset Selection for Pre-Training and Fine-Tuning Transformer Language Models for Clinical Question Answering (2020.lrec-1)
Copied to clipboard
| Challenge: | Existing work on EHR QA models that learn to answer questions from structured data has focused on analyzing questions or mapping questions to existing NLP based information extraction models. |
| Approach: | They conduct 48 experiments on two clinical question answering datasets . they use open-domain and domain-specific corpora to fine-tune Transformer language models . |
| Outcome: | The proposed models can learn to answer questions from unstructured notes with accuracies up to 90% on open-domain and domain-specific corpora. |
Generating SOAP Notes from Doctor-Patient Conversations Using Modular Summarization Techniques (2021.acl-long)
Copied to clipboard
| Challenge: | Creating digital SOAP notes is burdensome and contributes to physician burnout . authors propose a pipeline to generate these notes based on transcripts of clinical conversations . |
| Approach: | They propose a pipeline to leverage deep summarization models based on conversations between physicians and patients . they propose an algorithm that extracts important utterances relevant to each section and generates one summary sentence per cluster . |
| Outcome: | The proposed algorithm outperforms its abstract counterpart by 8 ROUGE-1 points and produces more factual sentences as assessed by human evaluators. |
MedicalSum: A Guided Clinical Abstractive Summarization Model for Generating Medical Reports from Patient-Doctor Conversations (2022.findings-emnlp)
Copied to clipboard
| Challenge: | Existing models for summarizing medical conversations do not take clinical knowledge into account and are difficult to control. |
| Approach: | They propose a transformer-based sequence-to-sequence architecture for summarizing medical conversations by integrating medical domain knowledge from the Unified Medical Language System (UMLS). |
| Outcome: | The proposed model achieves state-of-the-art ROUGE score improvements of 0.8-2.1 points (including 6.2% error reduction in the PE section) it incorporates medical domain knowledge from the Unified Medical Language System (UMLS). |
Low-Resource Dialogue Summarization with Domain-Agnostic Multi-Source Pretraining (2021.emnlp-main)
Copied to clipboard
| Challenge: | Existing methods for low-resource dialogue summarization neglect the difference between dialogues and conventional articles. |
| Approach: | They propose a multi-source pretraining paradigm to leverage external summary data . they exploit large-scale in-domain non-summary data to separate dialogue encoder and summary decoder . |
| Outcome: | The proposed model can be used to better leverage external summary data. |