Papers with OP-PROMPTS
One Prompt To Rule Them All: LLMs for Opinion Summary Evaluation (2024.acl-long)
Copied to clipboard
Tejpalsingh Siledar, Swaroop Nath, Sankara Muddu, Rupasai Rangaraju, Swaprava Nath, Pushpak Bhattacharyya, Suman Banerjee, Amey Patil, Sudhanshu Singh, Muthusamy Chelliah, Nikesh Garera
| Challenge: | Existing evaluation methods for opinion summarizations lack adequate opinion summary evaluation datasets. |
| Approach: | They propose a dataset that combines 7 dimensions crucial to opinion summaries . they propose OP-I-PROMPT, a dimension-independent prompt, and OP PROMPTS, . |
| Outcome: | The proposed model achieves a Spearman correlation of 0.70 with human judgments, surpassing prior methods. |