Papers by Luke Yoffe
FETA: A Benchmark for Few-Sample Task Transfer in Open-Domain Dialogue (2022.emnlp-main)
Copied to clipboard
Alon Albalak, Yi-Lin Tuan, Pegah Jandaghi, Connor Pryor, Luke Yoffe, Deepak Ramachandran, Lise Getoor, Jay Pujara, William Yang Wang
| Challenge: | Prior studies of task transfer in dialogue consider only 2-4 tasks, focus on multitasks. |
| Approach: | They propose a benchmark for FEw-sample TAsk transfer in open-domain dialogue. |
| Outcome: | The proposed benchmark analyzes the transferability between 132 source-target task pairs and provides a baseline for future work. |
DebUnc: Improving Large Language Model Agent Communication With Uncertainty Metrics (2025.findings-emnlp)
Copied to clipboard
| Challenge: | Multi-agent debates can improve the accuracy of Large Language Models by having multiple agents discuss solutions over several rounds of debate. |
| Approach: | a debate framework that uses uncertainty metrics to assess agent confidence is proposed . the framework uses textual prompts or a modified attention mechanism that adjusts token weights . |
| Outcome: | The proposed framework assesses agent confidence using uncertainty metrics . the framework is available at https://github.com/lukeyoffe/debunc. |