| Challenge: | a study on detecting disappearing entities from noisy microblogs has been published on the real world . a major challenge is detecting uncertain contexts of disappearing entity from noisy posts . |
| Approach: | They propose to use Twitter to detect disappearing entities from noisy microblogs . they build large-scale Twitter datasets of disappearing entity and refine word embeddings based on these data . |
| Outcome: | The proposed method outperforms baseline methods on noisy microblog streams and more than 70% of disappearing entities in Wikipedia are discovered earlier than the update on Wikipedia. |
Similar Papers
Entity Cloze By Date: What LMs Know About Unseen Entities (2022.findings-naacl)
Copied to clipboard
| Challenge: | Existing literature provides benchmarks to measure LMs' knowledge about entities . |
| Approach: | They propose a framework to analyze what language models can infer about new entities that did not exist when they were pretrained. |
| Outcome: | The proposed framework shows that models more informed about the entities achieve lower perplexity on this benchmark. |
Named Entity Recognition in Twitter: A Dataset and Analysis on Short-Term Temporal Shifts (2022.aacl-main)
Copied to clipboard
| Challenge: | Named Entity Recognition (NER) is a longstanding NLP task that consists of identifying an entity in a sentence or document. |
| Approach: | They construct a dataset of seven entity types annotated over 11,382 tweets . they provide a set of language model baselines and analyze the performance of the model . |
| Outcome: | The proposed dataset contains seven entity types annotated over 11,382 tweets . the authors focus on short-term degradation of NER models over time and strategies to fine-tune a language model over different periods . |
Diachronic word embeddings and semantic shifts: a survey (C18-1)
Copied to clipboard
| Challenge: | Existing methods for tracing time-related semantic shifts with word embedding models lack the cohesion, common terminology and shared practices of more established areas of natural language processing. |
| Approach: | They propose several axes along which these methods can be compared and propose a framework for comparison. |
| Outcome: | The proposed methods are compared with existing methods and outline their main challenges and potential applications. |
Temporally-Informed Analysis of Named Entity Recognition (2020.acl-main)
Copied to clipboard
| Challenge: | Existing methods to evaluate text data are rarely reported by taking the timestamp of the document into account. |
| Approach: | They propose methods that make better use of temporally-diverse training data with a focus on named entity recognition. |
| Outcome: | The proposed models make better use of temporally-diverse training data, with a focus on named entity recognition. |
Distant Learning for Entity Linking with Automatic Noise Detection (P19-1)
Copied to clipboard
| Challenge: | Accurate entity linkers have been produced for domains and languages where no or very limited amounts of labeled data are available. |
| Approach: | They propose to use annotated text to learn to link entities without labeling . they frame the task as a multi-instance learning problem and rely on surface matching to create initial noisy labels. |
| Outcome: | The proposed method outperforms the baseline surface matching model for a subset of entities. |
Semantic Novelty Detection and Characterization in Factual Text Involving Named Entities (2022.emnlp-main)
Copied to clipboard
| Challenge: | Existing topic-based novelty detection methods do not perform semantic reasoning involving relations between named entities in text and their background knowledge. |
| Approach: | They propose a model to detect whether a text is novel or not . they propose to use a factual text to characterize novelty. |
| Outcome: | The proposed model outperforms 10 baselines by large margins on the novelty detection task. |
Diachronic degradation of language models: Insights from social media (P18-2)
Copied to clipboard
| Challenge: | Existing studies have explored whether and how language models degrade over time, i.e. why they fail to work on contemporary language. |
| Approach: | They investigate the accuracy of pre-trained language models for downstream tasks in machine learning and user profiling. |
| Outcome: | The results show that it is possible to measure diachronic drifts within social media and within the span of a few years. |
Noise-Robust Training with Dynamic Loss and Contrastive Learning for Distantly-Supervised Named Entity Recognition (2023.findings-acl)
Copied to clipboard
| Challenge: | Named entity recognition (NER) is a task in natural language processing that aims at locating entity mentions in a given sentence and assigning them to certain types. |
| Approach: | They propose to use a dynamic loss function to better adapt to the changing noise during the training process and incorporate token level contrastive learning to fully utilize the noisy data. |
| Outcome: | The proposed method outperforms existing NER models on three benchmark datasets and outperformed existing models by significant margins. |
Possessors Change Over Time: A Case Study with Artworks (D18-1)
Copied to clipboard
| Challenge: | Existing methods to extract possession relations from Wikipedia articles can be used to extract possessors over time. |
| Approach: | They propose to extract possession relations from Wikipedia articles and temporal information indicating when these relations are true. |
| Outcome: | The proposed annotation scheme yields many possessors over time for a given artwork, and an LSTM ensemble can automate the task. |
Short-Term Meaning Shift: A Distributional Exploration (N19-1)
Copied to clipboard
| Challenge: | a new study examines the phenomenon of short-term meaning shift in online communities . the authors use distributional representations to explore the phenomenon . |
| Approach: | They propose to use distributional representations to explore short-term meaning shift in online communities. |
| Outcome: | The proposed model has problems distinguishing meaning shift from referential phenomena, and measures contextual variability to remedy this. |