NeLLCom-Lex: A Neural-agent Framework to Study the Interplay between Lexical Systems and Language Use (2025.findings-emnlp)
Copied to clipboard
| Challenge: | Lexical semantic change has been investigated with observational and experimental methods, but observational methods cannot get at causal mechanisms. |
| Approach: | They introduce a neural-agent framework designed to simulate semantic change by first grounding agents in a real lexical system and then manipulating their communicative needs. |
| Outcome: | The proposed framework simulates the evolution of a lexical system within a single generation by grounding agents in a real lexicon and manipulating their communicative needs. |
Similar Papers
Analysing Lexical Semantic Change with Contextualised Word Representations (2020.acl-main)
Copied to clipboard
| Challenge: | Existing studies on lexical semantic change have focused on detecting and characterising word meaning shifts using distributional semantic models. |
| Approach: | They propose a method that exploits the BERT neural language model to obtain representations of word usages, clusters these representations into usage types, and measures change along time with three proposed metrics. |
| Outcome: | The proposed method captures a variety of synchronic and diachronic linguistic phenomena and is highly reproducible and reproducible. |
Communication Drives the Emergence of Language Universals in Neural Agents: Evidence from the Word-order/Case-marking Trade-off (2023.tacl-1)
Copied to clipboard
| Challenge: | Existing models of language learning with neural agents lack appropriate cognitive biases in artificial learners. |
| Approach: | They propose a framework where speaking and listening agents learn a miniature language via supervised learning and optimize it for communication via reinforcement learning. |
| Outcome: | The proposed framework replicates the word-order/case-marking trade-off without hard-coding biases in the agents. |
LexFit: Lexical Fine-Tuning of Pretrained Language Models (2021.acl-long)
Copied to clipboard
| Challenge: | Transformer-based language models implicitly store a wealth of lexical semantic knowledge, but it is non-trivial to extract that knowledge effectively from their parameters. |
| Approach: | They propose to expose and enrich lexical knowledge from transformer-based language models to serve as effective decontextualized word encoders even when fed input words "in isolation" |
| Outcome: | The proposed model outperforms standard static WEs and vanilla LMs in lexical tasks over four established tasks in 8 languages. |
Lexical Semantics with Large Language Models: A Case Study of English “break” (2023.findings-eacl)
Copied to clipboard
| Challenge: | Large neural language models (LLMs) can be powerful tools for research in lexical semantics. |
| Approach: | They argue that large neural language models can be powerful tools for research in lexical semantics by capturing known sense distinctions and identifying informative new sense combinations. |
| Outcome: | The proposed models capture many of the sense distinctions found in the English verb break and can be used to identify informative new sense combinations for further analysis. |
Improving Temporal Generalization of Pre-trained Language Models with Lexical Semantic Change (2022.emnlp-main)
Copied to clipboard
| Challenge: | Existing methods to improve neural language models perform poorly on emerging data. |
| Approach: | They propose a lexical-level masking strategy to post-train a neural language model using static data from past years. |
| Outcome: | The proposed method outperforms existing methods on two pre-trained language models, two classification tasks, and four benchmark datasets. |
Effects of Pre- and Post-Processing on type-based Embeddings in Lexical Semantic Change Detection (2021.eacl-main)
Copied to clipboard
| Challenge: | Lexical semantic change detection is a new and innovative research field. |
| Approach: | They propose to pre-train on large corpora and refine on diachronic target corpors to improve performance. |
| Outcome: | The proposed models improve on large corpora and diachronic target corpors . the proposed models are compared with existing models in a variety of learning scenarios . |
Probing Pretrained Language Models for Lexical Semantics (2020.emnlp-main)
Copied to clipboard
| Challenge: | Existing studies have focused on morphosyntactic, semantic, and world knowledge, but it remains unclear to what extent LMs derive lexical type-level knowledge from words in context. |
| Approach: | They propose to use multilingual and monolingual LMs to extract lexical type-level knowledge from words in context. |
| Outcome: | The proposed models perform well across six typologically diverse languages and five lexical tasks. |
XL-LEXEME: WiC Pretrained Model for Cross-Lingual LEXical sEMantic changE (2023.acl-short)
Copied to clipboard
| Challenge: | Existing approaches to the Word in Context task use cross-encoders, which prevent the possibility of deriving comparable word embeddings. |
| Approach: | They propose a Lexical Semantic Change Detection model that extends SBERT, highlighting the target word in the sentence. |
| Outcome: | The proposed model outperforms the state-of-the-art on the multilingual benchmarks for SemEval-2020 Task 1 - Lexical Semantic Change (LSC) Detection and the RuShiftEval shared task. |
Definition generation for lexical semantic change detection (2024.findings-acl)
Copied to clipboard
| Challenge: | a number of studies have attempted to bridge the gap between lexical semantic change detection and sense-based LSCD methods. |
| Approach: | They propose a sense distribution based LSCD method which uses contextualized word definitions as 'senses' they argue that the method preserves interpretability and allows to inspect the reasons behind a specific shift in terms of discrete definitions-as-sense. |
| Outcome: | The proposed method outperforms previous sense-based methods on five datasets and three languages and preserves interpretability and allows to inspect the reasons behind a specific shift in terms of discrete definitions-as-senses. |
Always Keep your Target in Mind: Studying Semantics and Improving Performance of Neural Lexical Substitution (2020.coling-main)
Copied to clipboard
| Challenge: | Lexical substitution is a powerful technology used in various NLP applications . it generates plausible words that can replace a given word in a textual context . |
| Approach: | They propose to use a large-scale comparative study to compare lexical substitution methods . they compare existing and new methods using word sense induction datasets . |
| Outcome: | The proposed methods improve competitive results by incorporating information about the target word into the models. |