Papers by Maryam Sajedinia
Do LLMs suffer from Multi-Party Hangover? A Diagnostic Approach to Addressee Recognition and Response Selection in Conversations (2024.emnlp-main)
Copied to clipboard
| Challenge: | Conventional evaluation methods often overlook variances in model behavior across different levels of structural complexity on interaction graphs. |
| Approach: | They propose a methodological pipeline to investigate model performance across structural attributes of conversations. |
| Outcome: | The proposed method analyzes the performance of an LLM to classify multi-party conversations . it shows that response selection relies more on the textual content of conversations compared to addressee recognition . |