| Challenge: | a major unsolved problem in computational psycholinguistics is determining whether human comprehension considers a single analysis path 1 at a time. |
| Approach: | They compare syntactic surprisal from a state-of-the-art dependency parser with fMRI data . they find evidence for multipath parsing in English and Chinese data based on fm data a major unsolved problem in computational psycholinguistics is determining whether human sentence comprehension considers a single analysis path 1 at a time . |
| Outcome: | The proposed model shows that human parsing is multipath, with a higher r2 increase for multipath surprisal than single-path surpresal. |
Similar Papers
A Targeted Assessment of Incremental Processing in Neural Language Models and Humans (2021.acl-long)
Copied to clipboard
| Challenge: | Using by-word reaction time data, we compare incremental processing in humans and neural language models across a range of structural phenomena. |
| Approach: | They propose to scale up incremental processing in humans and language models by collecting by-word reaction time data for 16 different syntactic test suites. |
| Outcome: | The proposed model outputs match human and model accuracy scores, but underpredict the difference in magnitude of incremental processing difficulty between grammatical and ungrammatically-spaced sentences. |
How does the brain process syntactic structure while listening? (2023.findings-acl)
Copied to clipboard
| Challenge: | Syntactic parsing is the task of assigning a syntactical structure to a sentence. |
| Approach: | They investigate the predictive power of the brain encoding models in three settings: individual performance of constituency and dependency parsing based embedding methods, relative effectiveness of each of the syntactic parsers, and relative importance of syntaktic information versus semantic information using BERT embeddngs. |
| Outcome: | The proposed methods explain variance in brain regions, especially in listening tasks, and the relative predictive power of the various syntax parsers is unexplored. |
Which Sense Dominates Multisensory Semantic Understanding? A Brain Decoding Study (2024.lrec-main)
Copied to clipboard
| Challenge: | Decoding semantic meanings from brain activity is open to multisensory stimulation, as word meanings can be delivered by both auditory and visual inputs. |
| Approach: | They aim to develop a computational model to probing what information from the act of language understanding is represented in human brain. |
| Outcome: | The proposed model dissociates multisensory integration of word understanding into written text, spoken text and image perception respectively, exploring the decoding efficiency and reliability of unisensory information in the brain representation. |
Multi-view and Cross-view Brain Decoding (2022.coling-1)
Copied to clipboard
| Challenge: | a recent study has shown that brain decoding models can decode concepts from single view . a multi-view decoder can take brain recordings for any view as input and predict the concept . |
| Approach: | They propose to build a multi-view decoder that can take brain recordings for any view as input and predict the concept. |
| Outcome: | The proposed systems can decode concepts from brain recordings from any view . the proposed systems have 0.68 pairwise accuracy across view pairs and 0.8 average pairwise precision across tasks. |
Incremental Neural Lexical Coherence Modeling (2020.coling-main)
Copied to clipboard
| Challenge: | Recent work on pretrained language models has led to significant improvements in a range of NLP tasks. |
| Approach: | They propose a coherence model which interprets sentences incrementally to capture lexical relations between them. |
| Outcome: | The proposed model interprets sentences incrementally to capture lexical relations between them. |
Using surprisal and fMRI to map the neural bases of broad and local contextual prediction during natural language comprehension (2021.findings-acl)
Copied to clipboard
| Challenge: | a prior work using surprisal only considered within-sentence context, using n-grams, neural language models, or syntactic structure as conditioning context. |
| Approach: | They extend the surprisal approach to use broader topical context . they identify distinct patterns of neural activation for lexical surprised and topical surpresed . |
| Outcome: | The proposed method captures effects of local and topical contexts on processing . it shows that local and broad contextual cues recruit different brain regions . |
Is the Brain Mechanism for Hierarchical Structure Building Universal Across Languages? An fMRI Study of Chinese and English (2022.emnlp-main)
Copied to clipboard
| Challenge: | Existing studies have shown that the brain builds hierarchical syntactic structures, but it is unknown whether they are universal across languages. |
| Approach: | They analyze the working memory requirements when applying parsing strategies to two languages: Chinese and English. |
| Outcome: | The proposed method shows that the brain adopts parsing strategies with less memory load according to different language structures. |
Causal Analysis of Syntactic Agreement Mechanisms in Neural Language Models (2021.acl-long)
Copied to clipboard
| Challenge: | Targeted syntactic evaluations have demonstrated the ability of language models to perform subject-verb agreement given difficult contexts. |
| Approach: | They apply causal mediation analysis to pre-trained neural language models to investigate their models' preferences for grammatical inflections and whether neurons process subject-verb agreement similarly across sentences with different syntactic structures. |
| Outcome: | The proposed model can predict correct token from grammatically minimally different continuations with high accuracy even in difficult contexts. |
Scaling in Cognitive Modelling: a Multilingual Approach to Human Reading Times (2023.acl-short)
Copied to clipboard
| Challenge: | Neural language models provide conditional probability distributions over the lexicon that are predictive of human processing times. |
| Approach: | They propose to use a transformer-based model to generate probabilistic estimates that are less predictive of early eye-tracking measurements reflecting lexical access and early semantic integration. |
| Outcome: | The proposed models show that larger models capture late eye-tracking measurements that reflect the full integration of a word into the current language context. |
Unveiling Multi-level and Multi-modal Semantic Representations in the Human Brain using Large Language Models (2024.emnlp-main)
Copied to clipboard
Yuko Nakagi, Takuya Matsuyama, Naoko Koide-Majima, Hiroto Yamaguchi, Rieko Kubo, Shinji Nishimoto, Yu Takagi
| Challenge: | Recent studies have assessed different levels of semantic content, such as speech, objects, and stories, separately. |
| Approach: | They used functional magnetic resonance imaging to record brain activity while watching 8.3 hours of dramas and movies. |
| Outcome: | The findings show that LLMs predict human brain activity more accurately than traditional language models, particularly for complex background stories. |