Papers with LHF
Improving Contextual Query Rewrite for Conversational AI Agents through User-preference Feedback Learning (2023.emnlp-industry)
Copied to clipboard
| Challenge: | Contextual query rewriting (CQR) is a crucial component in Conversational AI agents, leveraging contextual information from previous user-agent conversations to improve comprehension of current user intent. |
| Approach: | They propose a framework to enhance the CQR model's capability in generating user preference-aligned rewrites. |
| Outcome: | The proposed framework improves the CQR model's ability to generate user preference-aligned rewrites. |
Beyond the Safety Bundle: Auditing the Helpful and Harmless Dataset (2025.naacl-long)
Copied to clipboard
| Challenge: | Learning from human feedback (LHF) has been used to mitigate the harms of large language models (LLMs) but the quality of this feedback and its effectiveness as a safety mitigation technique remain unclear. |
| Approach: | They audit the Helpful and Harmless (HH) dataset by Anthropic and examine how conceptualization failures and quality issues identified in the dataset can create additional harms . |
| Outcome: | The findings highlight the need for more nuanced, context-sensitive approaches to safety mitigation in large language models. |