Papers by Rim Helaoui
Are Experts Needed? On Human Evaluation of Counselling Reflection Generation (2023.acl-long)
Copied to clipboard
| Challenge: | Language models have been used to generate reflections automatically, but human evaluation is challenging due to the cost of hiring experts. |
| Approach: | They ask laypeople and experts to annotate synthetic reflections and human reflections from actual therapists. |
| Outcome: | The proposed method shows that laypeople and experts are reliable annotators and have moderate-to-strong inter-group correlation. |