Papers with human-level
What Does This Acronym Mean? Introducing a New Dataset for Acronym Identification and Disambiguation (2020.coling-main)
Copied to clipboard
| Challenge: | Acronyms are short forms of phrases that facilitate conveying lengthy sentences in documents. |
| Approach: | They propose to annotate a large dataset for scientific domain and a new deep learning model which expands an ambiguous acronym in a sentence. |
| Outcome: | The proposed model outperforms the state-of-the-art models on the new dataset. |
Towards Objectively Benchmarking Social Intelligence of Language Agents at the Action Level (2024.findings-acl)
Copied to clipboard
| Challenge: | evaluative findings highlight that the STSS benchmark is challenging for state-of-the-art language agents. |
| Approach: | They propose a social task in sandbox simulation benchmark that assesses language agents objectively at the action level by scrutinizing goal achievements within the multi-agent simulation. |
| Outcome: | The proposed social task-in-sandbox simulation is a language-level benchmark . the proposed benchmark effectively discriminates between distinct language agents . |