Papers by Behnam Hedayatnia
What is wrong with you?: Leveraging User Sentiment for Automatic Dialog Evaluation (2022.findings-acl)
Copied to clipboard
| Challenge: | Existing metrics for dialog evaluation are trained on human annotations, which is cumbersome to collect. |
| Approach: | They propose to use user sentiment and other information as proxy to measure the quality of previous dialogs. |
| Outcome: | The proposed model is comparable to models trained on human annotated data. |
DialGuide: Aligning Dialogue Model Behavior with Developer Guidelines (2023.findings-emnlp)
Copied to clipboard
Prakhar Gupta, Yang Liu, Di Jin, Behnam Hedayatnia, Spandana Gella, Sijia Liu, Patrick Lange, Julia Hirschberg, Dilek Hakkani-Tur
| Challenge: | Dialogue models are able to generate fluent and interesting responses, but they can be difficult to control and may produce non-engaging, unsafe results. |
| Approach: | They propose a framework for controlling dialogue model behavior using natural language rules, or guidelines, which provide information about the context they are applicable to and what should be included in the response. |
| Outcome: | The proposed framework is effective in three open-domain dialogue response generation tasks and is consistent with the developer's expectations and intent. |
Think Before You Speak: Explicitly Generating Implicit Commonsense Knowledge for Response Generation (2022.acl-long)
Copied to clipboard
Pei Zhou, Karthik Gopalakrishnan, Behnam Hedayatnia, Seokhwan Kim, Jay Pujara, Xiang Ren, Yang Liu, Dilek Hakkani-Tur
| Challenge: | Current neural response generation models generate responses directly, omitting unstated implicit knowledge. |
| Approach: | They propose a generative approach to externalize implicit commonsense knowledge and use it to generate responses. |
| Outcome: | Empirical results show that TBS models outperform end-to-end RG models on most automatic metrics and generate more informative, specific, and commonsense-following responses. |