| Challenge: | Conventional wisdom is that hand-crafted features are redundant for deep learning models . authors propose a method for using handcrafted features in a hybrid learning approach . |
| Approach: | They propose a method for exploiting handcrafted features as part of a hybrid learning approach. |
| Outcome: | The proposed method outperforms baseline models on a named entity recognition task and reduces training requirements to 60% while maintaining the same predictive accuracy. |
Similar Papers
Bridging Pre-trained Language Models and Hand-crafted Features for Unsupervised POS Tagging (2022.findings-acl)
Copied to clipboard
| Challenge: | Large-scale pre-trained language models (PLMs) have made extraordinary progress in most NLP tasks, but they fail to achieve state-of-the-art (SOTA) performance. |
| Approach: | They propose a Guassian HMM variant for unsupervised POS tagging that incorporates contexualized word representations into the decoder. |
| Outcome: | The proposed model outperforms state-of-the-art models on Penn Treebank and multilingual Universal Dependencies treebank v2.0. |
Robust Lexical Features for Improved Neural Network Named-Entity Recognition (C18-1)
Copied to clipboard
| Challenge: | Named-Entity Recognition (NER) uses word embeddings to extend, rather than replace, hand-crafted features. |
| Approach: | They propose to embed words and entity types into a low-dimensional vector space and compute a feature vector representing each word offline. |
| Outcome: | The proposed representations outperform existing models and achieve state-of-the-art performance. |
Reconstructing NER Corpora: a Case Study on Bulgarian (2020.lrec-1)
Copied to clipboard
| Challenge: | Named Entity Recognition (NER) and Named Enel Linking (NEL) are two related tasks that are under-resourced for the Slavic languages. |
| Approach: | They propose to use deep learning methods to improve a Named Entity Recognition corpus and to predict and annotate new types in a test corpus. |
| Outcome: | The proposed model improves a type-based Named Entity Recognition (NER) training corpus and predicts and annotates new types in a test corpus. |
ProgGen: Generating Named Entity Recognition Datasets Step-by-step with Self-Reflexive Large Language Models (2024.findings-acl)
Copied to clipboard
| Challenge: | Large Language Models (LLMs) exhibit remarkable adaptability across domains, but they are often not suitable for structured knowledge extraction tasks such as named entity recognition (NER). |
| Approach: | They propose a method that instructs LLMs to self-reflect on the specific domain and generates domain-relevant attributes for creating attribute-rich training data. |
| Outcome: | The proposed method produces NER datasets in domains with domain-relevant attributes and generates entity terms and NER context data around these entities. |
Do sequence-to-sequence VAEs learn global features of sentences? (2020.emnlp-main)
Copied to clipboard
| Challenge: | Autoregressive language models are often trained without explicit conditioning labels . authors question claim that latent vectors can capture global features in unsupervised manner . |
| Approach: | They propose to use a sequence-to-sequence architecture to learn latent variables . they find that VAEs are prone to memorizing the first words and sentence length . |
| Outcome: | The proposed model is prone to memorizing the first words and sentence length, the authors show . et al., 2016: a new model learns latent variables that are more global, more predictive of topic or topic labels . authors question this claim, say it is a waste of time and money . |
Better Feature Integration for Named Entity Recognition (2021.naacl-main)
Copied to clipboard
| Challenge: | Existing approaches to named entity recognition (NER) focus on stacking the LSTM and graph neural networks (GCNs) however, the exact interaction mechanism between the two types of features is not clear and the performance gain is not significant. |
| Approach: | They propose a model that incorporates both types of features with a Synergized-LSTM which captures how the two types of feature interact. |
| Outcome: | The proposed model achieves better performance than previous approaches while requiring fewer parameters. |
Towards Improving Neural Named Entity Recognition with Gazetteers (P19-1)
Copied to clipboard
| Challenge: | Currently, neural models for named entity recognition are based on data-driven models, with a strong emphasis on getting rid of the efforts for collecting external resources or designing hand-crafted features. |
| Approach: | They propose to use external gazetteers to efficiently access annotated data to generalize beyond the annotation of entities. |
| Outcome: | The proposed model can access external gazetteers while avoiding the effort to design hand-crafted features. |
From Shortcuts to Balance: Attribution Analysis of Speech-Text Feature Utilization in Distinguishing Original from Machine-Translated Texts (2025.emnlp-main)
Copied to clipboard
| Challenge: | Recent work demonstrated strong performance in distinguishing machine-translated text from human-authored or human-transcribed content using pretrained language models. |
| Approach: | They find that bimodal integration reduces reliance on NEs while moderating overemphasis attribution patterns in speech features. |
| Outcome: | The proposed models show that they are more balanced while relying less on NEs. |
GPT-NER: Named Entity Recognition via Large Language Models (2025.findings-naacl)
Copied to clipboard
Shuhe Wang, Xiaofei Sun, Xiaoya Li, Rongbin Ouyang, Fei Wu, Tianwei Zhang, Jiwei Li, Guoyin Wang, Chen Guo
| Challenge: | Large-scale language models (LLMs) have shown impressive ability for in-context learning with limited training data. |
| Approach: | They propose a novel sequence labeling task that transforms a sequence labeled as a text-generation task into a self-verification task that LLMs can adapt to. |
| Outcome: | The proposed model performs better on NER than supervised models on a variety of tasks . the proposed model can be easily adapted by LLMs to generate a text sequence . |
Deep Learning Based Named Entity Recognition Models for Recipes (2024.lrec-main)
Copied to clipboard
Ayush Agarwal, Janak Kapuriya, Shubham Agrawal, Akhil Vamshi Konam, Mansi Goel, Rishabh Gupta, Shrey Rastogi, Niharika Niharika, Ganesh Bagler
| Challenge: | Named entity recognition is a technique for extracting information from unstructured data with known labels. |
| Approach: | They use named entity recognition to annotate ingredients from recipe data . they use a clustering-based approach to annnotate 88,526 phrases . |
| Outcome: | The proposed method improves on a dataset of 88,526 phrases from RecipeDB . the fine-tuned spaCy-transformer performs better than the previous methods . |