| Challenge: | a recent study focuses on bootstrapping named entity models from English to Japanese . TL is a technique that overcomes linguistic differences between the target and source languages . |
| Approach: | They propose to use a deep neural network model to transfer weights between languages . they also propose a novel approach that romanizes a portion of the Japanese input . |
| Outcome: | The proposed approach overcomes linguistic differences by romanizing a portion of the Japanese input. |
Similar Papers
What Matters for Neural Cross-Lingual Named Entity Recognition: An Empirical Analysis (D19-1)
Copied to clipboard
| Challenge: | Named entity recognition models are challenging for languages with little training data. |
| Approach: | They propose a simple and efficient neural architecture for cross-lingual named entity recognition models. |
| Outcome: | The proposed model achieves competitive performance with the state-of-the-art on two transferable factors: sequential order and multilingual embedding. |
Transfer Learning for Entity Recognition of Novel Classes (C18-1)
Copied to clipboard
| Challenge: | Existing approaches to entity recognition are based on class labels in source and target domains, and many NER corpora only annotate a small number of categories. |
| Approach: | They replicate and extend several past studies on transfer learning for entity recognition. |
| Outcome: | The proposed methods perform better when there is more labeled target data. |
Multi-Source Cross-Lingual Model Transfer: Learning What to Share (P19-1)
Copied to clipboard
| Challenge: | Cross-lingual transfer learning (CLTL) is a viable method for building NLP models for a low-resource target language . however, many languages lack the labeled training data necessary for training deep neural nets for varying NLP tasks. |
| Approach: | They propose a cross-lingual transfer learning method that leverages annotated data from other languages to build NLP models for a target language. |
| Outcome: | The proposed model achieves significant performance gains over prior art over multiple text classification and sequence tagging tasks including a large-scale industry dataset. |
A Little Annotation does a Lot of Good: A Study in Bootstrapping Low-resource Named Entity Recognizers (D19-1)
Copied to clipboard
| Challenge: | Named entity recognition models rely on large amounts of labeled data, making them challenging to extend to new, lower-resource languages. |
| Approach: | They propose a method for bootstrapping named entity recognition models in under-resourced languages . they use cross-lingual transfer learning and targeted annotation of only uncertain entities . |
| Outcome: | The proposed method achieves competitive accuracy with just one-tenth of training data. |
Multi-lingual Entity Discovery and Linking (P18-5)
Copied to clipboard
| Challenge: | This tutorial reviews the framework of cross-lingual EL and motivates it as a broad paradigm for the Information Extraction task. |
| Approach: | This tutorial will review the framework of cross-lingual EL and motivate it as a broad paradigm for the Information Extraction task. |
| Outcome: | The aim of this tutorial is to review the framework of cross-lingual EL and motivate it as a broad paradigm for the Information Extraction task. |
Unsupervised Cross-Lingual Representation Learning (P19-4)
Copied to clipboard
| Challenge: | a comprehensive survey of cutting-edge weakly-supervised and unsupervised cross-lingual word representations is presented . |
| Approach: | This tutorial provides a comprehensive survey of recent work on weakly-supervised and unsupervised cross-lingual word representations. |
| Outcome: | This tutorial provides a comprehensive survey of cutting-edge weakly-supervised and unsupervised word representations. |
Sources of Transfer in Multilingual Named Entity Recognition (2020.acl-main)
Copied to clipboard
| Challenge: | naive training of named-entity recognition models using annotated data from multiple languages consistently underperforms monolingual models. |
| Approach: | They propose a polyglot named-entity recognition model where one model is trained using annotated data drawn from multiple languages. |
| Outcome: | The proposed model outperforms models trained on monolingual data despite more training data . the proposed model shares many parameters across languages and fine-tunes them to outperFORM monolingual models. |
Transfer Learning for Named-Entity Recognition with Neural Networks (L18-1)
Copied to clipboard
| Challenge: | Existing approaches to named-entity recognition (NER) require additional lead time for developing and fine-tuning the rules. |
| Approach: | They propose to transfer an ANN model trained on a large labeled dataset to another dataset with a limited number of labels to improve upon the state-of-the-art results for patient note de-identification. |
| Outcome: | The proposed model can be transferred to a dataset with a limited number of labels, and improves on the state-of-the-art results on patient note de-identification. |
Neural Cross-Lingual Named Entity Recognition with Minimal Resources (D18-1)
Copied to clipboard
| Challenge: | Named-entity recognition (NER) models are highly dependent on large amounts of labeled data. |
| Approach: | They propose a method that finds translations based on bilingual word embeddings . they also propose 'self-attention' which allows for a degree of flexibility with respect to word order . |
| Outcome: | The proposed method achieves state-of-the-art or competitive performance on common languages with lower resource requirements than previous approaches. |
T3L: Translate-and-Test Transfer Learning for Cross-Lingual Text Classification (2023.tacl-1)
Copied to clipboard
| Challenge: | Existing approaches to cross-lingual text classification leverage text classifiers trained in a high-resource language to perform text classification in other languages with no or minimal fine-tuning. |
| Approach: | They propose to combine a neural machine translator and a text classifier trained in a high-resource language to perform text classification in other languages with no or minimal fine-tuning. |
| Outcome: | The proposed approach significantly improves over a baseline approach. |