Coreference information guides human expectations during natural reading (2020.coling-main)
Copied to clipboard
| Challenge: | Existing theories of coreference processing focus on memory, but some theories focus on expectations. |
| Approach: | They hypothesize that coreference tracking also informs human expectations about upcoming words. |
| Outcome: | The proposed coreference-aware parser improves human response times in a naturalistic reading experiment. |
Similar Papers
Coreference-aware Surprisal Predicts Brain Response (2021.findings-emnlp)
Copied to clipboard
| Challenge: | Existing studies have shown that coreference resolution is a key component of language processing and has been used to manipulate variables of interest. |
| Approach: | They propose to enable the parser to process subword information that might better approximate human morphological knowledge and extend evaluation of coreference effects from self-paced reading to human brain imaging data. |
| Outcome: | The proposed model enables the parser to process subword information that might better approximate human morphological knowledge and extends evaluation of coreference effects from self-paced reading to human brain imaging data. |
Tracing Origins: Coreference-aware Machine Reading Comprehension (2022.acl-long)
Copied to clipboard
| Challenge: | a recent study has enriched pre-trained language models with syntactic, semantic and other linguistic information to improve their performance. |
| Approach: | They use a pre-trained language model to leverage coreference information to enhance word embeddings . they use additional encoder layers to focus on coreference mentions or a relational graph convolutional network to model the coreference relations. |
| Outcome: | The proposed model imitates the human reading process and leverages coreference information to enhance word embeddings. |
Coreference Reasoning in Machine Reading Comprehension (2021.acl-long)
Copied to clipboard
| Challenge: | Existing datasets for machine reading comprehension do not reflect the natural distribution and, consequently, the challenges of coreference reasoning. |
| Approach: | They propose to use existing coreference resolution datasets to train machine reading comprehension models to better reflect the natural distribution and, consequently, the challenges of coreference reasoning. |
| Outcome: | The proposed method improves the performance of state-of-the-art models on a set of coreference-related datasets. |
Machine Reading, Fast and Slow: When Do Models “Understand” Language? (2022.coling-1)
Copied to clipboard
| Challenge: | Existing models of reading comprehension score highly on NLU benchmarks, but they are often 'read fast', i.e. rely on shallow patterns. |
| Approach: | They propose a definition for the reasoning steps expected from a system that would be 'reading slowly' they compare that behavior with five models of the BERT family of various sizes, observed through saliency scores and counterfactual explanations. |
| Outcome: | The proposed model is compared with five models of the BERT family of various sizes, and compared using saliency scores and counterfactual explanations. |
Probing for Referential Information in Language Models (2020.acl-main)
Copied to clipboard
| Challenge: | Neural network-based language models (LMs) have been shown to learn relevant properties of language without being explicitly trained for them. |
| Approach: | They extend their previous work to analyze whether language models capture anaphoric relations and pronoun-antecedent relations in English. |
| Outcome: | The Transformer outperforms the LSTM in all analyses. |
Cross-document coreference: An approach to capturing coreference without context (D19-62)
Copied to clipboard
| Challenge: | a cross-document coreference annotation schema was developed to extract timelines in the clinical domain. |
| Approach: | They propose a cross-document coreference annotation schema that is governed by schematic rules to create meaningful and consistent cross- document relations. |
| Outcome: | The proposed approach produces an agreement score of 93.77% for identical relations between the two sets of notes. |
Assessing the Capabilities of Large Language Models in Coreference: An Evaluation (2024.lrec-main)
Copied to clipboard
| Challenge: | Large Language Models (LLMs) are a new approach to coreference resolution, but their performance is not yet fully understood. |
| Approach: | They propose that future efforts should improve scope, data, and evaluation methods of traditional coreference research to adapt to the development of LLMs. |
| Outcome: | The proposed methods improve scope, data, and evaluation methods of traditional coreference research to adapt to the development of LLMs. |
Not Every Metric is Equal: Cognitive Models for Predicting N400 and P600 Components During Reading Comprehension (2025.coling-main)
Copied to clipboard
| Challenge: | Several studies have focused on predicting the surprisal of a word and its reading time, but only recently, attention has been given to other components, such as P600. |
| Approach: | They propose to model reading times and ERP amplitudes using surprisal and entropy . they also propose a metric based on semantic similarity for N400 and P600 . |
| Outcome: | The proposed metric predicts reading times and ERP amplitudes in Mandarin Chinese. |
Analyzing Wrap-Up Effects through an Information-Theoretic Lens (2022.acl-short)
Copied to clipboard
| Challenge: | a lack of studies targeting naturalistic sentence-final reading behavior is likely to explain the lack of data on reading time (RT) data is omitted due to the confounding factors introduced by so-called "wrap-up effects" |
| Approach: | They propose to look for a link between “wrap-up effects” and information theoretic quantities such as word and context information content. |
| Outcome: | The proposed model omits data on words at the end of sentences or clauses to control for the confounding factors introduced by wrap-up effects. |
Predicting Reference: What do Language Models Learn about Discourse Models? (2020.emnlp-main)
Copied to clipboard
| Challenge: | a growing literature that probes neural language models to assess their latent acquisition of grammatical knowledge has not investigated their acquisition of discourse modeling ability. |
| Approach: | They draw on a psycholinguistic literature that has established how different contexts affect referential biases concerning who is likely to be referred to next. |
| Outcome: | The proposed models do not resemble human language users, the authors show . their models capture the linguistic knowledge required to perform discourse modeling . |