Papers by David Sontag
Learning to Decode Collaboratively with Multiple Language Models (2024.acl-long)
Copied to clipboard
| Challenge: | Using a latent variable model, multiple large language models can be trained to collaborate at the token level. |
| Approach: | They propose a method to teach multiple large language models to collaborate by interleaving their generations at the token level. |
| Outcome: | The proposed method improves on instruction-following, domain-specific QA, and reasoning tasks and shows that the model trained with the method exhibits several interesting collaboration patterns. |
Large language models are few-shot clinical information extractors (2022.emnlp-main)
Copied to clipboard
| Challenge: | a long-running goal of clinical NLP is the extraction of important variables trapped in clinical notes. |
| Approach: | They propose to use large language models to tackle diverse clinical extraction tasks . they propose to reannote existing CASI datasets to compare their models with clinical text. |
| Outcome: | The proposed models outperform existing models on few-shot clinical information extraction tasks. |
CLIP: A Dataset for Extracting Action Items for Physicians from Hospital Discharge Notes (2021.acl-long)
Copied to clipboard
James Mullenbach, Yada Pruksachatkun, Sean Adler, Jennifer Seale, Jordan Swartz, Greg McKelvey, Hui Dai, Yi Yang, David Sontag
| Challenge: | Continuity of care is crucial to ensuring positive health outcomes for patients discharged from an inpatient hospital setting. |
| Approach: | They propose to annotate clinical action items from a dataset of medical notes annotated by physicians and extract them as multi-aspect extractive summarization. |
| Outcome: | The proposed dataset is annotated by physicians and covers 718 documents representing 100K sentences. |
Scaling Collaborative Effort with Agents (2026.findings-acl)
Copied to clipboard
Shannon Zejiang Shen, Valerie Chen, Ken Gu, Alexis Ross, Zixian Ma, Jillian Ross, Alex Gu, Chenglei Si, Wayne Chi, Andi Peng, Jocelyn J Shen, Ameet Talwalkar, Tongshuang Wu, David Sontag
| Challenge: | Current evaluations of agents focus on producing high-quality, final outputs in one shot, failing to account for the inherently iterative nature of many real-world problems. |
| Approach: | They propose a framework that captures how an agent’s utility grows with increasing user involvement. |
| Outcome: | The proposed framework captures how an agent’s utility grows with increasing user involvement, revealing a missing ingredient in agent design: the ability to sustain engagement and scaffold user understanding. |