Papers by Benjamin Winter
DDxGym: Online Transformer Policies in a Knowledge Graph Based Natural Language Environment (2024.lrec-main)
Copied to clipboard
Benjamin Winter, Alexei Gustavo Figueroa Rosero, Alexander Loeser, Felix Alexander Gers, Nancy Katerina Figueroa Rosero, Ralf Krestel
| Challenge: | specialized OpenAI Gym environment for clinical differential diagnosis is limited by data access due to privacy concerns. |
| Approach: | They propose a specialized OpenAI Gym environment for clinical differential diagnosis . they frame the task as a natural-language-based reinforcement learning problem . |
| Outcome: | The proposed model improves over baselines and improves on existing models. |
KIMERA: Injecting Domain Knowledge into Vacant Transformer Heads (2022.lrec-1)
Copied to clipboard
| Challenge: | Recent studies show that transformer models lack specific domain knowledge and are under-performing in broad domains like the medical domain. |
| Approach: | They propose a method for retraining and instilling attention heads with structured domain knowledge by masking redundant attention heads. |
| Outcome: | The proposed method improves on seven datasets in the medical domain in information retrieval and clinical outcome prediction settings. |