Rethinking the Idiomaticity Decomposability Hypothesis: Evidence from Distributional Learning (2026.acl-long)
Copied to clipboard
| Challenge: | Decomposability is thought to predict syntactic flexibility, but is not attributed to distributional experience. |
| Approach: | They propose a model-internal measure of decomposability and relate it to human ratings, syntactic flexibility, and predictability while tracking idiom learning during pretraining. |
| Outcome: | The proposed model-internal measure correlates weakly with human judgments and shows a small but consistent negative relationship with syntactic flexibility. |
Similar Papers
Characterizing Idioms: Conventionality and Contingency (2022.acl-long)
Copied to clipboard
| Challenge: | idioms have non-canonical meanings, but non-conventional meanings are contingent on other words . a recent study shows that idiomatic expressions are not homogeneous among idiomas . |
| Approach: | They propose to use a contingency relationship between words in an idiom and non-canonical meanings of words in the idiome. |
| Outcome: | a new study shows that idioms fall at the expected intersection of the two dimensions, but that the dimensions themselves are not correlated. |
Memorization or Reasoning? Exploring the Idiom Understanding of LLMs (2025.emnlp-main)
Copied to clipboard
| Challenge: | idioms have long posed a challenge due to their unique linguistic properties, which set them apart from other common expressions. |
| Approach: | They propose to use a large-scale dataset of idioms in six languages to evaluate LLMs' idiomatic processing ability. |
| Outcome: | The proposed model integrates contextual cues and reasoning to improve idiom understanding in LLMs, suggesting that their performance is influenced by memorization and reasoning. |
Rolling the DICE on Idiomaticity: How LLMs Fail to Grasp Context (2025.acl-long)
Copied to clipboard
| Challenge: | Existing models fail to resolve idiomaticity when it depends on contextual understanding . idiom frequency influences performance but does not guarantee accurate interpretation. |
| Approach: | They propose a novel contrastive dataset to assess whether large language models can effectively leverage context to disambiguate idiomatic meanings. |
| Outcome: | The proposed model performs better on sentences deemed more likely by the model . collocational frequency and sentence probability influence performance but not accuracy . |
Heuristically Informed Unsupervised Idiom Usage Recognition (D18-1)
Copied to clipboard
| Challenge: | Existing models for idiom usage recognition have failed to recognize usages without annotated examples. |
| Approach: | They propose an unsupervised method for recognizing the intended usages of idioms by using distributional semantics to identify literal usages. |
| Outcome: | The proposed method performs competitively against supervised methods. |
AStitchInLanguageModels: Dataset and Methods for the Exploration of Idiomaticity in Pre-Trained Language Models (2021.findings-emnlp)
Copied to clipboard
| Challenge: | Existing datasets are limited to providing the degree of idiomaticity of expressions along with the literal and, where applicable, (a single) non-literal interpretation of MWEs. |
| Approach: | They propose to use a dataset to test the effectiveness of a language model in generating representations of sentences containing idioms. |
| Outcome: | The proposed model performs reasonably well on the one-shot and few-shot scenarios, but there is scope for improvement in the zero-shot scenario. |
The Distributional Hypothesis Does Not Fully Explain the Benefits of Masked Language Model Pretraining (2023.emnlp-main)
Copied to clipboard
| Challenge: | Despite the rise of the prompting paradigm with the scaling breakthrough of very large language models, understanding the mechanism of model fine-tuning remains an important endeavor. |
| Approach: | They analyze the masked language modeling pretraining objective function from the perspective of the Distributional Hypothesis and examine whether the distributional property leads to better sample efficiency and better generalization capability of pretrained models. |
| Outcome: | The proposed model pretraining objective function improves sample efficiency and generalization capability but does not explain the generalization ability of natural language models. |
Beyond Multiword Expressions: Processing Idioms and Metaphors (P18-5)
Copied to clipboard
| Challenge: | idioms and metaphors processing is a rapidly growing area in NLP, says dr. s. robertson . idiomatic idiomas are characteristic to all areas of human activity and to all types of discourse. |
| Approach: | This tutorial will provide attendees with a clear notion of idioms and metaphors . it will provide them with computational models of linguistic characteristics and methods . |
| Outcome: | This tutorial aims to provide attendees with a clear notion of the linguistic characteristics of idioms and metaphors . it outlines how to model idiomatic idiomes and their processing and what resources are available to support their use . |
No Context Needed: Contextual Quandary In Idiomatic Reasoning With Pre-Trained Language Models (2024.naacl-long)
Copied to clipboard
| Challenge: | idiomatic expressions (IEs) are a non-compositional aspect of a text that makes it difficult for a model to comprehend . general purpose PTLMs are negatively affected by the context, as performance increases with its removal. |
| Approach: | They propose to use idiomatic expressions to infer additional meaning from IEs . they argue that only IE-aware models are suitable for idiom- matic reasoning tasks . |
| Outcome: | The proposed models can reason in the presence of idiomatic expressions, the authors show . they show that general purpose PTLMs are negatively affected by the context . |
Getting BART to Ride the Idiomatic Train: Learning to Represent Idiomatic Expressions (2022.tacl-1)
Copied to clipboard
| Challenge: | Prior work has identified deficiencies in their contextualized representation stemming from the underlying compositional paradigm of representation. |
| Approach: | They propose to use an adapter as a lightweight non-compositional language expert trained on idiomatic sentences to build idiomity into BART. |
| Outcome: | The proposed approach improves idiomaticity over baselines and up to 25% higher sequence accuracy on idiom processing tasks. |
How Furiously Can Colorless Green Ideas Sleep? Sentence Acceptability in Context (2020.tacl-1)
Copied to clipboard
| Challenge: | a recent study shows that context affects our perception of sentence acceptability, but few studies investigate how it affects language models. |
| Approach: | They compare acceptability ratings of sentences judged in isolation with a relevant context and with an irrelevant context. |
| Outcome: | The proposed model achieves state-of-the-art for unsupervised acceptability prediction. |