| Challenge: | Input method editor (IME) converts sequential alphabet key inputs to words in a target language. |
| Approach: | They propose a neural-based language model that incrementally builds a subset vocabulary from the word lattice. |
| Outcome: | The proposed approach achieves 50x speedup on Japanese IME benchmark without losing conversion accuracy. |
Similar Papers
Open Vocabulary Learning for Neural Chinese Pinyin IME (P19-1)
Copied to clipboard
| Challenge: | Pinyin-to-character conversion is the core component of pinyin based Chinese input method engine (IME). |
| Approach: | They propose a neural P2C conversion model augmented by an online updated vocabulary to support open vocabulary learning during IME working. |
| Outcome: | The proposed model outperforms commercial IMEs and state-of-the-art models on standard corpus and true inputting history dataset in terms of multiple metrics and the online updated vocabulary helps it follow user inputting behavior. |
Speeding Up Entmax (2022.findings-naacl)
Copied to clipboard
| Challenge: | Recent studies suggest that sparsity is a problem when the trained model is used for inference. |
| Approach: | They propose an alternative to softmax that produces a dense probability distribution but is slower than softmax. |
| Outcome: | The proposed method keeps its virtuous characteristics but is slower than softmax and achieves on par or better performance in machine translation task. |
Chinese Pinyin Aided IME, Input What You Have Not Keystroked Yet (D18-1)
Copied to clipboard
| Challenge: | Chinese pinyin input method engine (IME) converts pinyine into character based on its core component, pinyan-to-character conversion (P2C). |
| Approach: | They propose a sequence-to-sequence model with gated-attention mechanism for Chinese IMEs. |
| Outcome: | The proposed model improves on existing models in benchmark datasets showing great user experience improvement compared to traditional models. |
Moon IME: Neural-based Chinese Pinyin Aided Input Method with Customizable Association (P18-4)
Copied to clipboard
| Challenge: | a pinyin input method engine (IME) allows users to input Chinese into a computer by typing pinyan through the common keyboard. |
| Approach: | They present a pinyin IME that integrates neural machine translation and IR to offer amusive and customizable association ability. |
| Outcome: | The Moon IME integrates neural machine translation and IR to offer amusive association ability. |
AdaFuse: Adaptive Ensemble Decoding for Large Language Models (2026.acl-long)
Copied to clipboard
Chengming Cui, Tianxin Wei, Ziyi Chen, Ruizhong Qiu, Zhichen Zeng, Zhining Liu, Xuying Ning, Duo Zhou, Jingrui He
| Challenge: | Existing ensemble approaches to large language models lack flexibility for mid-generation adaptation. |
| Approach: | They propose an adaptive ensemble decoding framework that dynamically selects semantically appropriate fusion units during generation. |
| Outcome: | The proposed framework outperforms existing ensemble frameworks on open-domain QA, arithmetic reasoning, and machine translation tasks. |
Entropy-Based Vocabulary Substitution for Incremental Learning in Multilingual Neural Machine Translation (2022.emnlp-main)
Copied to clipboard
| Challenge: | Existing methods to update a multilingual model with new language pairs are expensive and time-consuming. |
| Approach: | They propose an entropy-based vocabulary substitution method that walks through new language pairs for incremental learning while remaining the size of the original vocabulary. |
| Outcome: | The proposed method achieves better performance and saves excess overhead in a multilingual machine translation task. |
Pyramid-BERT: Reducing Complexity via Successive Core-set based Token Selection (2022.acl-long)
Copied to clipboard
| Challenge: | Existing models that use heuristics to shorten sequence lengths are computationally prohibitive. |
| Approach: | They propose a new method to shorten sequence lengths by transforming tokens through encoders and a core-set based token selection method that avoids expensive pre-training and fine tuning. |
| Outcome: | The proposed model outperforms existing models on GLUE benchmarks and Long Range Arena datasets and demonstrates that it is cost-effective and space-efficient. |
Self-Vocabularizing Training for Neural Machine Translation (2025.naacl-srw)
Copied to clipboard
| Challenge: | Past vocabulary learning techniques identify relevant vocabulary before training, relying on corpus statistics or frequency counts without considering contextual information or the model's ability to represent it. |
| Approach: | They propose a method that self-vocabularizes a smaller, more optimal vocabulary by pairing source sentences with the model's predictions to define a new vocabulary. |
| Outcome: | The proposed method produces a 1.49 BLEU improvement in the simulated model and an increase in unique token usage and a 6–8% reduction in vocabulary size. |
Vocabulary Learning via Optimal Transport for Neural Machine Translation (2021.acl-long)
Copied to clipboard
| Challenge: | Empirical results show that VOLT beats widely-used vocabularies in diverse scenarios, including WMT-14 English-German translation, TED bilingual translation, and TED multilingual translation. |
| Approach: | They propose a token dictionary solution that can be used without trial training to find the best dictionary with a proper size. |
| Outcome: | The proposed solution beats widely-used vocabularies in English-German translation, TED bilingual translation, and TED multilingual translation. |
The Devil is in the Details: On the Pitfalls of Vocabulary Selection in Neural Machine Translation (2022.naacl-main)
Copied to clipboard
| Challenge: | Neural Machine Translation models can be optimized to improve latency by constraining the set of output words . lexical shortlisting fails to select the right set of input words for semantically non-compositional phenomena such as idiomatic expressions. |
| Approach: | They propose a model of vocabulary selection that constrains the set of allowed output words . they propose to increase the size of the allowed set to restore translation quality . |
| Outcome: | The proposed model restores translation quality of an unconstrained system, as measured by human evaluations on WMT newstest2020 and idiomatic expressions, at an inference latency competitive with alignment-based selection using aggressive thresholds. |