Papers by Chao-Chung Wu
I Need Help! Evaluating LLM’s Ability to Ask for Users’ Support: A Case Study on Text-to-SQL Generation (2024.emnlp-main)
Copied to clipboard
| Challenge: | a new study examines the proactive ability of large language models to seek user support . without external feedback, many LLMs struggle to recognize their need for user support. |
| Approach: | They propose metrics to evaluate the trade-off between performance improvements and user burden . they also investigate whether LLMs can determine when to request user support . |
| Outcome: | The proposed metrics show that without external feedback, many LLMs struggle to recognize their need for user support. |
Controlling Sequence-to-Sequence Models - A Demonstration on Neural-based Acrostic Generator (D19-3)
Copied to clipboard
| Challenge: | acrostic is a form of writing that the first token of each line forms a meaningful sequence. |
| Approach: | They propose a generalized acrostic generation system that can hide certain messages in a flexible pattern specified by the users. |
| Outcome: | The proposed system can hide certain messages in a flexible pattern specified by the users. |