Papers by Christian Kaestner
What Prompts Don’t Say: Understanding and Managing Underspecification in LLM Prompts (2026.findings-acl)
Copied to clipboard
| Challenge: | Under-specified prompts are 2x as likely to regress across model or prompt changes, authors show . eliot safina: a lack of explicit prompts can cause frustrations and failures . |
| Approach: | They propose requirements-aware prompt optimization mechanisms that improve performance by 4.8% over baselines. |
| Outcome: | The proposed mechanisms improve prompt performance by 4.8% over baselines. |
Beyond Testers’ Biases: Guiding Model Testing with Knowledge Bases using LLMs (2023.findings-emnlp)
Copied to clipboard
Chenyang Yang, Rishabh Rustogi, Rachel Brower-Sinning, Grace Lewis, Christian Kaestner, Tongshuang Wu
| Challenge: | Identifying what to test is a step that is largely ignored and poorly supported. |
| Approach: | They propose an interactive tool that supports requirements elicitation for guiding model testing. |
| Outcome: | The proposed tool can help practitioners test models in real-world settings . |