Decoding Brain Activity Associated with Literal and Metaphoric Sentence Comprehension Using Distributional Semantic Models (2020.tacl-1)
Copied to clipboard
| Challenge: | Existing research has focused on applying semantic models to decode brain activity associated with the meaning of individual words. |
| Approach: | They evaluate a range of semantic models to capture metaphor processing in the brain . they found that compositional models and word embeddings capture differences in the processing of literal and metaphoric sentences . |
| Outcome: | The proposed models capture differences in the processing of literal and metaphoric sentences, providing support for the idea that the literal meaning is not fully accessible during familiar metaphor comprehension. |
Similar Papers
Modeling Affirmative and Negated Action Processing in the Brain with Lexical and Compositional Semantic Models (P19-1)
Copied to clipboard
| Challenge: | Existing studies have shown that distributional semantic models can be used to decode fMRI patterns associated with specific aspects of semantic composition, such as the negation function. |
| Approach: | They apply lexical and compositional semantic models to decode fMRI patterns associated with negated and affirmative sentences containing hand-action verbs. |
| Outcome: | The proposed models show reduced decoding of sentences where the verb is in the negated context, as compared to the affirmative one, within brain regions implicated in action-semantic processing. |
Linking artificial and human neural representations of language (D19-1)
Copied to clipboard
| Challenge: | a pre-trained BERT architecture is used to fine-tune sentence encoding models on a variety of natural language understanding (NLU) tasks. |
| Approach: | They compare sentence encoding models with fMRI-based fMR predictions of the sentence . they use a pre-trained BERT architecture as a baseline and fine-tune it on a variety of natural language understanding (NLU) tasks. |
| Outcome: | The proposed model does not yield significant improvements in brain decoding performance on the natural language understanding (NLU) tasks. |
Measuring Meaning Composition in the Human Brain with Composition Scores from Large Language Models (2024.acl-long)
Copied to clipboard
| Challenge: | Existing computational metric to quantify extent of meaning composition is lacking . despite extensive neurolinguistic research, understanding how meaning is constructed is difficult . |
| Approach: | They propose a computational metric to quantify the degree of meaning composition . they use key-value memory interpretation of transformer feed-forward network blocks to study meaning composition. |
| Outcome: | Experimental results show that the metric correlates with brain clusters associated with word frequency, structural processing, and general sensitivity to words, suggesting multifaceted nature of meaning composition during human sentence comprehension. |
From Brain Space to Distributional Space: The Perilous Journeys of fMRI Decoding (P19-2)
Copied to clipboard
| Challenge: | Recent work in cognitive neuroscience has introduced models for predicting distributional word meaning representations from brain imaging data. |
| Approach: | They propose to use several alternative measures to evaluate the predicted distributional space against a corpus-derived distributional spatial space. |
| Outcome: | The proposed model performs poorly on the most common metrics, while still delivering promising results. |
Recent advances in neural metaphor processing: A linguistic, cognitive and social perspective (2021.naacl-main)
Copied to clipboard
| Challenge: | Metaphor processing systems have benefited from recent studies on the role of metaphor in communication and deep learning for natural language processing. |
| Approach: | They present a review of automated metaphor processing and discuss their results from downstream NLP tasks. |
| Outcome: | The proposed system is based on the findings of a systematic and comprehensive survey of metaphor processing systems published five years ago. |
The Interplay between Metaphors and NLP (2026.acl-tutorials)
Copied to clipboard
| Challenge: | This tutorial will provide an overview of the metaphor processing field. |
| Approach: | This tutorial will provide an overview of the metaphor processing field . it will focus on recent directions opened by LLMs for metaphor interpretation . |
| Outcome: | The tutorial will discuss the influence of various metaphor theories on the creation of annotated resources and models. |
Which Sense Dominates Multisensory Semantic Understanding? A Brain Decoding Study (2024.lrec-main)
Copied to clipboard
| Challenge: | Decoding semantic meanings from brain activity is open to multisensory stimulation, as word meanings can be delivered by both auditory and visual inputs. |
| Approach: | They aim to develop a computational model to probing what information from the act of language understanding is represented in human brain. |
| Outcome: | The proposed model dissociates multisensory integration of word understanding into written text, spoken text and image perception respectively, exploring the decoding efficiency and reliability of unisensory information in the brain representation. |
Encoding and Decoding Language in the Brain with Language Models (2026.eacl-tutorials)
Copied to clipboard
| Challenge: | This tutorial introduces brain-language model alignment and recent advances in brain-informed fine-tuning and brain-based fine-caching with language models. |
| Approach: | This tutorial introduces brain-language model alignment and recent advances in brain-informed fine-tuning and scaling with language models. |
| Outcome: | This tutorial introduces brain-language model alignment and recent advances in brain-informed fine-tuning and decoding with language models. |
Multi-view and Cross-view Brain Decoding (2022.coling-1)
Copied to clipboard
| Challenge: | a recent study has shown that brain decoding models can decode concepts from single view . a multi-view decoder can take brain recordings for any view as input and predict the concept . |
| Approach: | They propose to build a multi-view decoder that can take brain recordings for any view as input and predict the concept. |
| Outcome: | The proposed systems can decode concepts from brain recordings from any view . the proposed systems have 0.68 pairwise accuracy across view pairs and 0.8 average pairwise precision across tasks. |
Unveiling Multi-level and Multi-modal Semantic Representations in the Human Brain using Large Language Models (2024.emnlp-main)
Copied to clipboard
Yuko Nakagi, Takuya Matsuyama, Naoko Koide-Majima, Hiroto Yamaguchi, Rieko Kubo, Shinji Nishimoto, Yu Takagi
| Challenge: | Recent studies have assessed different levels of semantic content, such as speech, objects, and stories, separately. |
| Approach: | They used functional magnetic resonance imaging to record brain activity while watching 8.3 hours of dramas and movies. |
| Outcome: | The findings show that LLMs predict human brain activity more accurately than traditional language models, particularly for complex background stories. |