| Challenge: | Existing methods on preposition representation treat prepositions no different from content words (e.g., word2vec and GloVe). |
| Approach: | They propose to use word-triple counts to capture a preposition’s interaction with its attachment and complement and derive preposition embeddings via tensor decomposition on a large unlabeled corpus. |
| Outcome: | The proposed model is comparable to or better than the state-of-the-art on multiple standardized datasets. |
Similar Papers
Preposition Sense Disambiguation and Representation (D18-1)
Copied to clipboard
| Challenge: | Prepositions are highly polysemous and their variegated senses encode significant semantic information. |
| Approach: | They match each preposition’s context and their interplay to the geometry of the word vectors to the left and right of the preposition. |
| Outcome: | The proposed algorithm is comparable to and better than state-of-the-art on two benchmark datasets. |
Comprehensive Supersense Disambiguation of English Prepositions and Possessives (P18-1)
Copied to clipboard
Nathan Schneider, Jena D. Hwang, Vivek Srikumar, Jakob Prange, Austin Blodgett, Sarah R. Moeller, Aviram Stern, Adi Bitan, Omri Abend
| Challenge: | Frequent prepositions like for are maddeningly polysemous, their interpretation depends especially on the object of the preposition. |
| Approach: | They propose a new annotation scheme, corpus, and task for the disambiguation of prepositions and possessives in English. |
| Outcome: | The proposed annotations are comprehensive with respect to types and tokens of these markers and use broadly applicable supersense classes rather than fine-grained dictionary definitions. |
Building Static Embeddings from Contextual Ones: Is It Useful for Building Distributional Thesauri? (2022.lrec-1)
Copied to clipboard
| Challenge: | contextual language models are dominant in the field of Natural Language Processing, but they are not suitable for all uses. |
| Approach: | They propose a method for building word or type-level embeddings from contextual models . they evaluate a large set of English nouns from the perspective of extracting semantic similarity relations . |
| Outcome: | The proposed method can be used to build word or type embeddings from contextual models . it can be exploited for a wide set of English nouns, showing it can improve distributional thesauri . |
Prepositions Matter in Quantifier Scope Disambiguation (2022.coling-1)
Copied to clipboard
Aleksander Leczkowski, Justyna Grudzińska, Manuel Vargas Guzmán, Aleksander Wawer, Aleksandra Siemieniuk
| Challenge: | Existing work on how to integrate world knowledge into a QSD model has been limited . |
| Approach: | They use a scope-disambiguated corpus annotated with prepositional senses to integrate our knowledge into a machine learning model. |
| Outcome: | The proposed model is based on a scope-disambiguated corpus annotated with prepositional senses . Statistical analysis shows that prepositions have a positive impact on the learnability of automatic QSD systems. |
Exploring Semantic Properties of Sentence Embeddings (P18-2)
Copied to clipboard
| Challenge: | Neural vector representations are ubiquitous throughout all subfields of natural language processing. |
| Approach: | They propose a framework that generates triplets of sentences to explore how changes in the syntactic structure or semantics of a given sentence affect their similarity. |
| Outcome: | The proposed framework generates triplets of sentences to explore how changes in the syntactic structure or semantics of a given sentence affect the similarities obtained between their embeddings. |
Embeddings in Natural Language Processing (2020.coling-tutorials)
Copied to clipboard
| Challenge: | Embeddings have been a key topic of interest in NLP for the past decade . a quick warm-up introduction to NLP and why it is important to have a semantic comprehension of texts . |
| Approach: | This tutorial will provide a high-level synthesis of the main embedding techniques in NLP . it will start with word embedds and then move to other types of embeddable vectors . |
| Outcome: | This tutorial will provide a high-level synthesis of the main embedding techniques in NLP . it will start with word embedds and move to other types of embeddable representations . |
A Computational Approach to Quantifying Grammaticization of English Deverbal Prepositions (2024.lrec-main)
Copied to clipboard
| Challenge: | Linguistic studies have revealed important aspects of grammaticization of deverbal prepositions. |
| Approach: | They propose a computational approach to measure the degree of grammaticization of deverbal prepositions based on corpus data. |
| Outcome: | The proposed method correlates well with human judgements and supports previous findings in linguistics. |
What you can cram into a single $&!#* vector: Probing sentence embeddings for linguistic properties (P18-1)
Copied to clipboard
| Challenge: | a lack of understanding of the properties of sentence embeddings is limiting the use of the techniques. |
| Approach: | They propose 10 probing tasks designed to capture simple linguistic features of sentences . they use three different encoders to train embeddings in eight different ways . |
| Outcome: | The proposed tasks capture key linguistic features of sentences, but they are difficult to infer from them. |
Are the Best Multilingual Document Embeddings simply Based on Sentence Embeddings? (2023.findings-eacl)
Copied to clipboard
| Challenge: | obtaining document embeddings at document level is challenging due to computational requirements and lack of appropriate data. |
| Approach: | They compare methods to produce document-level representations from sentences based on LASER, LaBSE, and Sentence BERT pre-trained multilingual models. |
| Outcome: | The proposed methods produce document-level representations from sentences in 8 languages . the results show that a clever combination of sentence embeddings is usually better than encoding the full document as a single unit. |
Is Language Modeling Enough? Evaluating Effective Embedding Combinations (2020.lrec-1)
Copied to clipboard
Rudolf Schneider, Tom Oberhauser, Paul Grundmann, Felix Alexander Gers, Alexander Loeser, Steffen Staab
| Challenge: | specialized embeddings are not available for tasks like entity linking or paragraph classification. |
| Approach: | They evaluate whether universal embeddings can be complemented by specialized embeddables. |
| Outcome: | The proposed embeddings outperform state-of-the-art embeddables without any fine-tuning. |