| Challenge: | Developing models that perform well on several domains is important, but domain is vague and can be adapted to a new domain. |
| Approach: | They find that even news articles from the same newspaper in English can be considered different domains. |
| Outcome: | The proposed model performs better on out-of-domain data than on specialized data. |
Similar Papers
Unsupervised Named Entity Disambiguation for Low Resource Domains (2024.emnlp-main)
Copied to clipboard
| Challenge: | Existing approaches to Named Entity Disambiguation (NED) are inefficient for domain specific tasks such as searching, question answering and information extraction. |
| Approach: | They propose a unsupervised approach leveraging the concept of Group Steiner Trees which can identify the most relevant candidate for entity disambiguation using contextual similarities across candidate entities for all the mentions present in a document. |
| Outcome: | The proposed approach outperforms the state-of-the-art methods by more than 40% in terms of Precision@1 and Hit@5 across various domain-specific datasets. |
Named Entity Recognition Under Domain Shift via Metric Learning for Life Sciences (2024.naacl-long)
Copied to clipboard
| Challenge: | Existing models for named entity recognition fail in scientific domains such as biomedicine and chemistry. |
| Approach: | They propose a model to transfer knowledge from the biomedical domain to the target domain . they use pseudo labeling and contrastive learning to enhance discrimination . |
| Outcome: | The proposed model outperforms baseline models by up to 5% . the proposed model is based on a biomedical domain model and a chemical domain model . |
NERetrieve: Dataset for Next Generation Named Entity Recognition and Retrieval (2023.findings-emnlp)
Copied to clipboard
| Challenge: | Named Entity Recognition (NER) is a widely adopted NLP task . authors present three variants of NER task, with dataset to support them . |
| Approach: | They propose three variants of the NER task, together with a dataset to support them . they propose a move towards more fine-grained entities and zero-shot recognition . |
| Outcome: | The proposed model matches or surpasses existing models in NER tasks . the proposed model is based on a large, silver-annotated corpus of 4 million paragraphs . |
The ApposCorpus: a new multilingual, multi-domain dataset for factual appositive generation (2020.coling-main)
Copied to clipboard
| Challenge: | appositives are phrases that appear next to a noun phrase and serve an explicative function. |
| Approach: | They propose a more realistic end-to-end definition of appositive generation with a dataset that spans four languages and two entity types. |
| Outcome: | The proposed model is non-trivial and leaves plenty of room for improvement. |
Neural Adaptation Layers for Cross-domain Named Entity Recognition (D18-1)
Copied to clipboard
| Challenge: | Named entity recognition is a type of information extraction task whereby features can be designed based on domain-specific knowledge. |
| Approach: | They propose to use existing neural architectures to adapt to new domains without retraining . they propose to add adaptation layers to existing neural models to minimize re-training based on source data. |
| Outcome: | The proposed approach significantly outperforms state-of-the-art methods on social media domains. |
Multi-Domain Named Entity Recognition with Genre-Aware and Agnostic Inference (2020.acl-main)
Copied to clipboard
| Challenge: | Named entity recognition (NER) is a key component of many text processing pipelines. |
| Approach: | They propose a new architecture tailored to the task of identifying named entities with data from multiple genres. |
| Outcome: | The proposed architecture outperforms baseline and competitive methods on all three setups with differences ranging between +1.95 to +3.11 average F1 across multiple genres when compared to standard approaches. |
Towards a Unified Multi-Domain Multilingual Named Entity Recognition Model (2023.eacl-main)
Copied to clipboard
Mayank Kulkarni, Daniel Preotiuc-Pietro, Karthik Radhakrishnan, Genta Indra Winata, Shijie Wu, Lingjue Xie, Shaohua Yang
| Challenge: | Named Entity Recognition is a key task whose performance is sensitive to genre and language. |
| Approach: | They propose a setup for Named Entity Recognition which includes multi-domain and multilingual training and evaluation across 13 domains and 4 languages. |
| Outcome: | The proposed model improves on 13 domains and 4 languages across 13 domain and 4 language domains. |
Improving Topic Quality by Promoting Named Entities in Topic Modeling (P18-2)
Copied to clipboard
| Challenge: | Using named entities as domain-specific terms for news-centric content has not been studied extensively. |
| Approach: | They propose to use named entities as domain-specific terms for news-centric content . they propose a weighting model that incorporates more named entities in topic descriptors . |
| Outcome: | The proposed model improves the quality of news-centric topics by including more named entities in the topic descriptors. |
Can Humans Identify Domains? (2024.lrec-main)
Copied to clipboard
Maria Barrett, Max Müller-Eberstein, Elisa Bassignana, Amalie Brogaard Pauli, Mike Zhang, Rob van der Goot
| Challenge: | Textual domain is a crucial property within the Natural Language Processing community due to its effects on downstream model performance. |
| Approach: | They examine the level of human disagreement and the relative difficulty of each annotation task by training classifiers to perform the same task. |
| Outcome: | The authors show that human proficiency in identifying related intrinsic textual properties is low and that disagreements are high. |
Domain-Specific NER via Retrieving Correlated Samples (2022.coling-1)
Copied to clipboard
| Challenge: | Successful Named Entity Recognition models fail on texts from some special domains, for example, Chinese addresses and e-commerce titles. |
| Approach: | They propose to enhance NER models with correlated samples to help the text understanding . they draw correlated texts by the sparse BM25 retriever from large-scale in-domain unlabeled data . |
| Outcome: | Empirical results show that NER models can be enhanced with correlated samples . the proposed model can be used to reason out the correct answer on hard cases . |