| Challenge: | Currently, authentic linguistic examples for a given keyword search are organized alphabetically according to context. |
| Approach: | They propose to use NLP-functionalities to organize usage-based examples from corpora . they group retrieved examples on syntactic grounds, then show semantic similarity within phrasal slots . |
| Outcome: | The proposed system would help language learners and other end users to benefit from a distributional linguistic analysis. |
Similar Papers
Which *BERT? A Survey Organizing Contextualized Encoders (2020.emnlp-main)
Copied to clipboard
| Challenge: | a survey on language representation learning aims to highlight common themes . we focus on the areas of progress, compared to other fields, and discuss how each area is evaluated. |
| Approach: | They present a survey on language representation learning to highlight common themes . they compare contributions in contextualized text encoders to ideas from other fields . |
| Outcome: | The proposed survey aims to highlight common themes in the field of language representation learning. |
Incorporating Contextual and Syntactic Structures Improves Semantic Similarity Modeling (D19-1)
Copied to clipboard
| Challenge: | Semantic similarity modeling is central to many NLP problems such as question answering. |
| Approach: | They propose a pairwise word interaction model with syntactic structure priors to explore their effectiveness. |
| Outcome: | Extensive evaluations on eight benchmark datasets show that incorporating structural information improves over strong baselines. |
A Survey on Automatically-Constructed WordNets and their Evaluation: Lexical and Word Embedding-based Approaches (L18-1)
Copied to clipboard
| Challenge: | WordNets are lexical databases in which groups of synonyms are stored according to the semantic relationships between them. |
| Approach: | This paper describes various approaches to constructing WordNets automatically by leveraging traditional lexical resources and newer trends such as word embeddings. |
| Outcome: | The proposed methods leverage traditional lexical resources and newer trends such as word embeddings to build and evaluate WordNets. |
PiC: A Phrase-in-Context Dataset for Phrase Understanding and Semantic Search (2023.eacl-main)
Copied to clipboard
| Challenge: | Existing benchmarks for phrase-similarity compare phrases alone (without context) and phrases with context (with or without context). |
| Approach: | They propose to use a dataset of 28K noun phrases accompanied by their contextual Wikipedia pages to train machine phrase embeddings. |
| Outcome: | The proposed dataset improves ranking-models’ accuracy and pushes span selection models near human accuracy, which is 95% Exact Match (EM) on semantic search given a query phrase and a passage. |
Contextualized Embeddings for Enriching Linguistic Analyses on Politeness (2020.coling-main)
Copied to clipboard
| Challenge: | Current word embeddings in natural language processing do capture context and thus can be leveraged to enrich linguistic analyses. |
| Approach: | They propose a model which leverages pre-trained BERT to cluster contextualized representations of a word based on context in which it appears and labels of items it occurs in. |
| Outcome: | The proposed model can detect interpretable, finer-grained context patterns associated with (im)polite language. |
Se2: Sequential Example Selection for In-Context Learning (2024.findings-acl)
Copied to clipboard
| Challenge: | Prior work has explored the selection of examples for in-context learning, neglecting the internal relationships between examples and exist an inconsistency between training and inference. |
| Approach: | They propose a sequential-aware method that leverages the LLM’s feedback on varying context, aiding in capturing inter-relationships and sequential information among examples. |
| Outcome: | Experiments on 23 NLP tasks show that Se2 surpasses baselines and achieves 42% relative improvement over random selection. |
Contextualized Word Representations for Reading Comprehension (N18-2)
Copied to clipboard
| Challenge: | Reading comprehension (RC) is a high-level task in natural language understanding that requires reading a document and answering questions about its content. |
| Approach: | They propose to provide a standard neural network for reading a document and answering a question about its content. |
| Outcome: | The proposed model improves on the competitive SQuAD dataset by providing rich contextualized word representations and allowing it to choose between context-dependent and context-independent representations. |
Self-Adaptive In-Context Learning: An Information Compression Perspective for In-Context Example Selection and Ordering (2023.acl-long)
Copied to clipboard
| Challenge: | In-context learning is a common practice to randomly sample examples to serve as context. |
| Approach: | They propose a new principle for in-context learning that helps each sample find an in-constitut example organization that can derive the correct prediction. |
| Outcome: | The proposed method achieves 40% relative improvement over the common practice setting. |
Building Static Embeddings from Contextual Ones: Is It Useful for Building Distributional Thesauri? (2022.lrec-1)
Copied to clipboard
| Challenge: | contextual language models are dominant in the field of Natural Language Processing, but they are not suitable for all uses. |
| Approach: | They propose a method for building word or type-level embeddings from contextual models . they evaluate a large set of English nouns from the perspective of extracting semantic similarity relations . |
| Outcome: | The proposed method can be used to build word or type embeddings from contextual models . it can be exploited for a wide set of English nouns, showing it can improve distributional thesauri . |
Verb Sense Clustering using Contextualized Word Representations for Semantic Frame Induction (2021.findings-acl)
Copied to clipboard
| Challenge: | Contextualized word representations are effective in many natural language processing tasks, but it remains unclear to what extent they can cover hand-coded semantic information such as semantic frames. |
| Approach: | They compare contextualized word representations with two English frame-semantic resources . they find that several contextualized representations are informative for semantic frame induction . |
| Outcome: | The proposed representations are useful in natural language processing tasks, but are not fully understood by the literature. |