Correct-Detect: Balancing Performance and Ambiguity Through the Lens of Coreference Resolution in LLMs (2025.emnlp-main)
Copied to clipboard
| Challenge: | Large Language Models (LLMs) are intended to reflect human linguistic competencies . but when context is absent or insufficient, ambiguity resolution becomes more tenuous . |
| Approach: | They propose a CORRECT-DETECT trade-off between large language models and ambiguity detection . they show that large language model models can achieve good performance with minimal prompting . |
| Outcome: | The proposed models can achieve good performance with minimal prompting in coreference disambiguation and detection of ambiguity in corefertility tasks, but they cannot do both at the same time. |
Similar Papers
Assessing the Capabilities of Large Language Models in Coreference: An Evaluation (2024.lrec-main)
Copied to clipboard
| Challenge: | Large Language Models (LLMs) are a new approach to coreference resolution, but their performance is not yet fully understood. |
| Approach: | They propose that future efforts should improve scope, data, and evaluation methods of traditional coreference research to adapt to the development of LLMs. |
| Outcome: | The proposed methods improve scope, data, and evaluation methods of traditional coreference research to adapt to the development of LLMs. |
CorefInst: Leveraging LLMs for Multilingual Coreference Resolution (2026.tacl-1)
Copied to clipboard
| Challenge: | Existing methods for CR are encoder-only, decoder-based and asynchronous models. |
| Approach: | They propose a multilingual CR methodology which leverages decoder-only LLMs to handle overt and zero mentions. |
| Outcome: | The proposed model outperforms the leading multilingual CR model by 2 percentage points across all languages in the CorefUD v1.2 dataset. |
AmbiCoref: Evaluating Human and Model Sensitivity to Ambiguous Coreference (2023.findings-eacl)
Copied to clipboard
| Challenge: | Existing models do not have welldefined target behavior for coreferential ambiguity. |
| Approach: | They propose to use AmbiCoref to test whether coreference resolution models are sensitive to ambiguity. |
| Outcome: | The proposed model is more sensitive to ambiguity than existing models. |
Un-considering Contextual Information: Assessing LLMs’ Understanding of Indexical Elements (2025.findings-acl)
Copied to clipboard
| Challenge: | Large Language Models (LLMs) excel in coreference resolution tasks, but previous studies only assessed performance with nouns and third person pronouns. |
| Approach: | They evaluate LLMs' performance on coreference resolution with indexicals like I, you, here and tomorrow which come with unique challenges due to their linguistic properties. |
| Outcome: | The proposed models perform well with some indexicals while struggling with others. |
What Did I Do Wrong? Quantifying LLMs’ Sensitivity and Consistency to Prompt Engineering (2025.naacl-long)
Copied to clipboard
| Challenge: | Large Language Models (LLMs) have significantly improved productivity in a number of routine tasks. |
| Approach: | They propose two metrics for classification tasks, namely *sensitivity* and *consistency*, which are complementary to task performance. |
| Outcome: | The proposed metrics are complementary to task performance and can be used to guide prompt engineering and obtain LLMs that balance robustness and performance. |
To Know or Not To Know? Analyzing Self-Consistency of Large Language Models under Ambiguity (2024.findings-emnlp)
Copied to clipboard
| Challenge: | Large language models (LLMs) have remarkable performance in a variety of tasks due to factual knowledge accumulated during pre-training. |
| Approach: | They propose an evaluation protocol that disentangles knowing from applying knowledge and test state-of-the-art LLMs on 49 ambiguous entities. |
| Outcome: | The proposed evaluation protocol disentangles knowing from applying knowledge and tests state-of-the-art LLMs on 49 ambiguous entities. |
LlmLink: Dual LLMs for Dynamic Entity Linking on Long Narratives with Collaborative Memorisation and Prompt Optimisation (2025.coling-main)
Copied to clipboard
| Challenge: | Existing methods focus on supervised fine-tuning or limited to one-off prediction, which poses a challenge where the context is long. |
| Approach: | They propose a dynamic approach to CoREFerence resolution in chunked long narratives by deploying dual Large Language Models. |
| Outcome: | The proposed model achieves performance gains over existing models and fine-tuning approaches on long narrative datasets, significantly reducing the resources required for inference and training. |
Beyond Performance: Quantifying and Mitigating Label Bias in LLMs (2024.naacl-long)
Copied to clipboard
| Challenge: | Large language models exhibit undesirable preference toward predicting certain answers over others, despite their adaptability to diverse tasks. |
| Approach: | They propose a label bias calibration method that outperforms recent calibration approaches for improving performance and mitigating label bias. |
| Outcome: | The proposed method outperforms calibration approaches for improving performance and mitigating label bias. |
Comparing human and LLM politeness strategies in free production (2025.emnlp-main)
Copied to clipboard
| Challenge: | Polite speech poses a fundamental alignment challenge for large language models (LLMs). |
| Approach: | They compare human and LLM responses to English-language scenarios to determine whether they employ a similarly context-sensitive repertoire. |
| Outcome: | The results show that large models replicate key effects from the computational pragmatics literature and human evaluators prefer LLM-generated responses in open-ended contexts. |
Conundrums in Entity Coreference Resolution: Making Sense of the State of the Art (2020.emnlp-main)
Copied to clipboard
| Challenge: | despite significant progress on entity coreference resolution, there is a general lack of understanding of what has been improved. |
| Approach: | They present an empirical analysis of entity coreference resolvers to provide an understanding of what has been improved. |
| Outcome: | The proposed model improves the performance of entity coreference resolvers. |