Papers with OOV
Improving Slot Filling in Spoken Language Understanding with Joint Pointer and Attention (P18-2)
Copied to clipboard
| Challenge: | Experimental results show the effectiveness of our slot filling model at addressing the OOV problem. |
| Approach: | They propose a generative neural network model for slot filling based on a sequence-to-sequence model and a pointer network. |
| Outcome: | The proposed model is able to predict slot values on spoken language data. |
Second Language (Arabic) Acquisition of LLMs via Progressive Vocabulary Expansion (2025.acl-long)
Copied to clipboard
Jianqing Zhu, Huang Huang, Zhihang Lin, Juhao Liang, Zhengyang Tang, Khalid Almubarak, Mosen Alharthi, Bang An, Juncai He, Xiangbo Wu, Fei Yu, Junying Chen, Ma Zhuoheng, Yuhao Du, He Zhang, Saied Alshahrani, Emad A. Alghamdi, Lian Zhang, Ruoyu Sun, Haizhou Li, Benyou Wang, Jinchao Xu
| Challenge: | In the evolving landscape of large language models, the predominant focus has been on English and Chinese. |
| Approach: | They propose to utilize Arabic-specific vocabulary in the tokenizer to accelerate decoding. |
| Outcome: | The proposed model achieves decent performance comparable to the best Arabic LLMs across various Arabic benchmarks. |
Improving Word Embeddings through Iterative Refinement of Word- and Character-level Models (2020.coling-main)
Copied to clipboard
| Challenge: | Embedding of rare and out-of-vocabulary words is an important open NLP problem . standard embedding models are not useful for recommending jobs to users with rare or unseen words . |
| Approach: | They propose to train a character-level neural network to reproduce word embeddings . they then use the model to assign vectors to any input string, including rare words . |
| Outcome: | The proposed method outperforms existing methods on word similarity data sets and can be applied to job title normalization in the e-recruitment domain. |
Will it Unblend? (2020.findings-emnlp)
Copied to clipboard
| Challenge: | Blends, such as “innoventor”, are one particularly challenging class of OOV terms, as they are formed by fusing together two or more bases that relate to the intended meaning in unpredictable manners and degrees. |
| Approach: | They propose to use a dataset of English OOV blends to quantify the difficulty of interpreting the meanings of blends by large-scale contextual language models such as BERT. |
| Outcome: | The proposed model outperforms character-level and context-free embeddings, although their results are still far from satisfactory. |
Sign Language Production With Avatar Layering: A Critical Use Case over Rare Words (2022.lrec-1)
Copied to clipboard
| Challenge: | Existing vision-based sign language production approaches suffer from out-of-vocabulary (OOV) and test-time generalization problems. |
| Approach: | They propose an avatar-based sign language production system that generates sign language videos from spoken language expressions. |
| Outcome: | The proposed system achieves higher BLEU-4 and higher ROUGE-L scores on a new Korean-Korean sign language dataset. |
Imputing Out-of-Vocabulary Embeddings with LOVE Makes LanguageModels Robust with Little Cost (2022.acl-long)
Copied to clipboard
| Challenge: | State-of-the-art NLP systems are brittle when faced with Out-ofVocabulary words . we present a framework that extends word embeddings and makes them robust to OOV . |
| Approach: | They propose a framework that extends existing word embeddings and makes them robust to OOV. |
| Outcome: | The proposed model performs better on original datasets and corrupted variants than previous competitors. |
APIRecX: Cross-Library API Recommendation via Pre-Trained Language Model (2021.emnlp-main)
Copied to clipboard
| Challenge: | API recommendation tools can help programmers use APIs by recommending which APIs to be used next given the APIs that have been written. |
| Approach: | They propose a cross-library API recommendation approach that uses BPE to split API calls in each sequence and pre-train a GPT based language model. |
| Outcome: | The proposed APIRecX can recommend APIs that are previously regarded as OOV . it can migrate knowledge of existing libraries to a new library and recommend API that is previously viewed as OVO . |
Byte-based Multilingual NMT for Endangered Languages (2022.coling-1)
Copied to clipboard
| Challenge: | Existing work has not studied how byte encoding can benefit endangered languages . multilingual neural machine translation (MNMT) models suffer from out-of-vocabulary issues and representation bottleneck . |
| Approach: | They propose a multilingual multilingual neural machine translation system to alleviate the representation bottleneck and improve translation performance in endangered languages. |
| Outcome: | The proposed system outperforms subword-based models on twelve languages up to +18.5 BLEU points, an 840% relative improvement over baseline models. |
Neural Machine Translation for Low-Resourced Indian Languages (2020.lrec-1)
Copied to clipboard
| Challenge: | Neural machine translation (NMT) is an effective way to convert text to a different language without human involvement. |
| Approach: | They propose to use multihead self-attention along with pre-trained Byte-Pair-Encoded (BPE) and MultiBPE embeddings to develop an efficient machine translation system. |
| Outcome: | The proposed system outperforms Google translator and the existing translators on two of the most morphological rich Indian languages. |
LFKQG: A Controlled Generation Framework with Local Fine-tuning for Question Generation over Knowledge Bases (2022.coling-1)
Copied to clipboard
| Challenge: | Existing KBQG models focus on the most relevant part of the answer entity, while neglecting the rest of the subgraph. |
| Approach: | They propose a controlled generation framework for Question Generation over Knowledge Bases that generates questions with out-of-vocabulary (OOV) predicates. |
| Outcome: | The proposed framework outperforms existing methods significantly on three widely-used benchmark datasets SimpleQuestion, PathQuestions, and WebQuestIONS. |
Handling Rare Entities for Neural Sequence Labeling (2020.acl-main)
Copied to clipboard
| Challenge: | Recent approaches to sequence labeling have been based on statistical models but a challenge is from the data sparsity problem. |
| Approach: | They propose to use local context reconstruction to implicitly incorporate contextual information into their representations. |
| Outcome: | The proposed model outperforms all previous methods on multiple benchmark datasets and achieves new start-of-the-art results. |
Improving Multi-Criteria Chinese Word Segmentation through Learning Sentence Representation (2023.findings-emnlp)
Copied to clipboard
| Challenge: | Recent Chinese word segmentation models tend to learn the segmentation knowledge through in-vocabulary words rather than understanding the meaning of the entire context. |
| Approach: | They propose a context-aware approach that incorporates unsupervised sentence representation learning over different dropout masks into the multi-criteria training framework. |
| Outcome: | The proposed approach achieves state-of-the-art (SoTA) performance on six of the nine CWS benchmark datasets and out-of vocabulary (OOV) recalls for eight of nine. |