FAMULUS: Interactive Annotation and Feedback Generation for Teaching Diagnostic Reasoning (D19-3)
Copied to clipboard
Jonas Pfeiffer, Christian M. Meyer, Claudia Schulz, Jan Kiesewetter, Jan Zottmann, Michael Sailer, Elisabeth Bauer, Frank Fischer, Martin R. Fischer, Iryna Gurevych
| Challenge: | Existing systems for technologyenhanced learning address skills on recalling, explaining, and applying knowledge, e.g., in automatically generated language learning exercises and math word problems. |
| Approach: | They propose to leverage a NLP model to support experts in their further data annotation with automatic suggestions and provide automatic feedback for students. |
| Outcome: | The proposed system improves on two user studies on diagnostic reasoning in medicine and teacher education and can be extended to further use cases. |
Similar Papers
TYPIC: A Corpus of Template-Based Diagnostic Comments on Argumentation (2022.lrec-1)
Copied to clipboard
Shoichi Naito, Shintaro Sawada, Chihiro Nakagawa, Naoya Inoue, Kenshi Yamaguchi, Iori Shimizu, Farjana Sultana Mim, Keshav Singh, Kentaro Inui
| Challenge: | Argumentation and debate are effective tools for developing critical thinking skills, but it requires a lot of time and effort. |
| Approach: | They propose to automate the process of giving diagnostic comments to students . they define criteria for a template set that can be used to evaluate the model . |
| Outcome: | The proposed model can be used to evaluate arguments and evaluate them in real time. |
Dataset and Baseline for Automatic Student Feedback Analysis (2022.lrec-1)
Copied to clipboard
| Challenge: | Currently, student feedback is collected manually, but it does not indicate the student's opinion on different aspects of the teaching/learning process. |
| Approach: | They propose to annotate student feedback corpus which contains 3000 instances . they propose a hierarchical taxonomy for aspect categorization, which covers all areas . |
| Outcome: | The proposed model can be used for aspects analysis, document level sentiment analysis and document level analysis. |
SYMPTOMIFY: Transforming Symptom Annotations with Language Model Knowledge Harvesting (2023.findings-emnlp)
Copied to clipboard
| Challenge: | a new dataset of annotated vaccine adverse reaction reports is aimed at improving human annotators . a continual evolution in language models and strides in few-shot learning offer promise for improvement. |
| Approach: | They propose a resource to help human annotators improve their efficiency . they evaluate performance across various methods and learning paradigms . |
| Outcome: | The proposed resource outperforms existing systems and learning paradigms in evaluating their performance. |
Reasoning Like a Doctor: Improving Medical Dialogue Systems via Diagnostic Reasoning Process Alignment (2024.findings-acl)
Copied to clipboard
| Challenge: | Medical dialogue systems have attracted significant attention for their potential to act as medical assistants. |
| Approach: | They propose a framework that emulates clinicians' diagnostic reasoning processes and aligns with clinician preferences through thought process modeling. |
| Outcome: | The proposed framework generates appropriate responses that relies on abductive and deductive diagnostic reasoning analyses and aligns with clinician preferences through thought process modeling. |
Experience is the Teacher: Reusing Atomic Thoughts from LLMs to Improve Medical Dialogue (2026.findings-acl)
Copied to clipboard
Guangya Yu, Hui Luo, Qi Ye, Ruihui Hou, Weiyan Zhang, Mingxi Shang, Xuanwu Li, ChunMing Wang, Tong Ruan
| Challenge: | Recent large reasoning models (LLMs) lack dynamic and diverse thinking capabilities . reusing atomic thoughts provides a practical pathway toward dynamic reasoning . |
| Approach: | They propose a framework that extracts atomic thoughts from teacher models and reuses them to guide reasoning and generate responses. |
| Outcome: | The proposed framework extracts atomic thoughts from teacher models and reuses them to guide reasoning and generate responses. |
Polyjuice: Generating Counterfactuals for Explaining, Evaluating, and Improving Models (2021.acl-long)
Copied to clipboard
| Challenge: | Existing counterfactual generation methods rely on manual labor to create very few counterf actuals or only instantiate limited types of perturbations such as paraphrases or word substitutions. |
| Approach: | They propose a general-purpose counterfactual generator that allows for control over perturbation types and locations. |
| Outcome: | The proposed generator produces diverse sets of realistic counterfactuals that are useful in various applications. |
MedTutor: A Retrieval-Augmented LLM System for Case-Based Medical Education (2025.emnlp-demos)
Copied to clipboard
Dongsuk Jang, Ziyao Shangguan, Kyle Tegtmeyer, Anurag Gupta, Jan T Czerminski, Sophie Chheang, Arman Cohan
| Challenge: | Existing educational tools for medical residents are time-consuming and inconsistent. |
| Approach: | They propose a system that generates educational content and multiple-choice questions from clinical case reports and a pipeline that takes clinical case report input and produces targeted educational materials. |
| Outcome: | The system generates educational content and multiple-choice questions from clinical case reports and synergizes with local knowledge base to ensure it is foundationally sound and current. |
Analysis of Automatic Annotation Suggestions for Hard Discourse-Level Tasks in Expert Domains (P19-1)
Copied to clipboard
Claudia Schulz, Christian M. Meyer, Jan Kiesewetter, Michael Sailer, Elisabeth Bauer, Martin R. Fischer, Frank Fischer, Iryna Gurevych
| Challenge: | Existing deep learning methods require large amounts of training data to achieve reasonable performance. |
| Approach: | They propose to generate automatic annotation suggestions for a discourse-level sequence labelling task that requires extensive domain expertise. |
| Outcome: | The proposed model improves with newly annotated texts while introducing no biases. |
DDxTutor: Clinical Reasoning Tutoring System with Differential Diagnosis-Based Structured Reasoning (2025.acl-long)
Copied to clipboard
| Challenge: | Recent advances in Large Language Models (LLMs) have enabled various medical educational applications, but they often provide direct answers that could reduce students’ cognitive engagement and lead to fragmented learning. |
| Approach: | They propose a framework that follows differential diagnosis principles to decompose clinical reasoning into teachable components. |
| Outcome: | The proposed framework decomposes clinical reasoning into teachable components and generates structured teaching references and conducts diagnostic tutoring dialogues. |
DiagnosisArena: Benchmarking Diagnostic Reasoning for Large Language Models (2026.findings-acl)
Copied to clipboard
Yakun Zhu, Zhongzhen Huang, Linjie Mu, Yutong Huang, Wei Nie, Jiaji Liu, Shaoting Zhang, Pengfei Liu, Xiaofan Zhang
| Challenge: | Existing medical benchmarks for diagnostic reasoning are limited in their ability to perform complex tasks. |
| Approach: | They propose to benchmark diagnostic capabilities of large language models to assess their accuracy and generalization bottlenecks. |
| Outcome: | The proposed model achieves 45.82%, 31.09%, and 17.79% accuracy, compared to current models, o3-mini, e1 and DeepSeek-R1 . |