Exploring Transformer Text Generation for Medical Dataset Augmentation (2020.lrec-1)
Copied to clipboard
| Challenge: | Natural Language Processing (NLP) is a powerful tool to unlock the vast troves of unstructured data in clinical text. |
| Approach: | They propose a method for augmenting unstructured patient information to allow NLP model development on downstream clinically relevant tasks. |
| Outcome: | The proposed method beats baselines on a downstream classification task and can be used for NLP model development. |
Similar Papers
Enhanced Transformer Model for Data-to-Text Generation (D19-56)
Copied to clipboard
| Challenge: | Neural models have shown significant progress on data-to-text generation tasks . data- to-text models generate descriptive texts from non-linguistic structured data . |
| Approach: | They propose a new data-to-text generation model which learns content selection and summary generation in an end-to end fashion. |
| Outcome: | The proposed model outperforms current state-of-the-art models on content selection precision and content ordering metrics. |
Towards Conditioning Clinical Text Generation for User Control (2025.findings-acl)
Copied to clipboard
| Challenge: | Large language models exhibit hallucinations and factual inconsistencies necessitating human oversight. |
| Approach: | They propose to use Large Language Models as human proxies to condition LLMs for clinician control without increasing cognitive workload. |
| Outcome: | The proposed approach yields 9% relative improvement without augmented training and up to 34% with dataset augmentation. |
Rethinking Data Augmentation in Text-to-text Paradigm (2022.coling-1)
Copied to clipboard
| Challenge: | Existing approaches to augment training data are limited or marginal, or even diminishing or adverse especially given original training corpus is relatively sufficient or the backbone classifiers are PLM based. |
| Approach: | They propose to integrate text-to-text language models and construct a new two-phase framework for augmentation using two novel schemes. |
| Outcome: | The proposed framework synthesizes new samples benefiting from the knowledge learned from pre-trained language models on two public classification datasets and shows remarkable gains. |
Neural Data-to-Text Generation with LM-based Text Augmentation (2021.eacl-main)
Copied to clipboard
| Challenge: | Neural data-to-text generation is a difficult task for many new applications because of a lack of training data. |
| Approach: | They propose a few-shot approach that augments the data available for training by generating new text samples based on replacing specific values by alternative ones from the same category and pairing the new text with data samples. |
| Outcome: | The proposed approach outperforms fully supervised sequence-to-sequence models with less than 10% of the training set on both datasets. |
Knowledge-Enriched Natural Language Generation (2021.emnlp-tutorials)
Copied to clipboard
| Challenge: | Knowledge-enriched text generation poses unique challenges in modeling and learning . a roadmap will outline the state-of-the-art methods to tackle these challenges . |
| Approach: | They propose a roadmap to tackle the challenges of knowledge-enriched text generation . they will dive deep into various technical components to illustrate how to represent knowledge . |
| Outcome: | This tutorial outlines the state-of-the-art methods to tackle the problem . it aims to show how to represent knowledge, feed knowledge into a generation model, evaluate results . |
ClinicalT5: A Generative Language Model for Clinical Text (2022.findings-emnlp)
Copied to clipboard
| Challenge: | Recent generative language models like BART and T5 are gaining popularity with their competitive performance on text generation and tasks cast as generative problems. |
| Approach: | They propose to build domain-specific PLMs through fine-tuning or pre-training from scratch over domain corpora. |
| Outcome: | The proposed model outperforms existing models on domain-specific tasks and compares favorably with its close baselines. |
Knowledge-Infused Prompting: Assessing and Advancing Clinical Text Data Generation with Large Language Models (2024.findings-acl)
Copied to clipboard
Ran Xu, Hejie Cui, Yue Yu, Xuan Kan, Wenqi Shi, Yuchen Zhuang, May Dongmei Wang, Wei Jin, Joyce Ho, Carl Yang
| Challenge: | Clinical natural language processing (NLP) is a subfield that requires the extraction, analysis, and interpretation of unstructured clinical text. |
| Approach: | They propose a model which infuses knowledge into clinical text generation with LLMs for clinical NLP tasks. |
| Outcome: | The proposed model improves performance across 8 clinical NLP tasks and 18 datasets by 7.7%-8.7% on average. |
Applications of Natural Language Processing in Clinical Research and Practice (N19-5)
Copied to clipboard
| Challenge: | a tutorial on clinical NLP will introduce students and experts to the field . a focus will be on the use of clinical Nlp in clinical research and practice . |
| Approach: | This tutorial introduces the clinical use of natural language processing (NLP) techniques . it will review techniques and tools developed for the clinical domain . |
| Outcome: | This tutorial will introduce the clinical NLP methodologies and tools at two top universities . the goal of the tutorial is to encourage NLP researchers in the general domain to contribute . |
BioReddit: Word Embeddings for User-Generated Biomedical NLP (D19-62)
Copied to clipboard
| Challenge: | a corpus of medical-themed posts was scrapped from Reddit to train word embeddings on downstream tasks. |
| Approach: | They propose to train word embeddings from a corpus of medical forums from reddit scrapping posts from medical-themed subreddits. |
| Outcome: | The proposed system outperforms embeddings trained on general purpose data or on scientific papers when applied on user-generated content. |
Enrich, Aggregate, and Generate: Three-stage Biomedical Data-to-Text Generation Using Large Language Models in Low-resource Scenarios (2026.findings-acl)
Copied to clipboard
| Challenge: | Biomedical data-to-text generation is a branch of Natural Language Generation, aiming at generating textual natural language descriptions that can fluently and precisely describe the structured data. |
| Approach: | They propose an LLM framework that can be used to generate textual natural language descriptions using in-context learning. |
| Outcome: | The proposed framework provides good interpretability and superior performance on the BioLeaflets dataset. |