Papers by Degen Huang
SiLP: Enhancing Non-Dominant Language Capabilities with a Selective Bidirectional Language Projection Framework (2026.acl-long)
Copied to clipboard
| Challenge: | Existing methods to improve performance of large language models rely on additional training objectives or language-specific parameters. |
| Approach: | They propose a bidirectional language projection framework that enables efficient multilingual alignment and language shift using the intrinsic parameters. |
| Outcome: | The proposed framework improves performance of non-dominant languages and improves internal representations. |
BigVideo: A Large-scale Video Subtitle Translation Dataset for Multimodal Machine Translation (2023.findings-acl)
Copied to clipboard
Liyan Kang, Luyang Huang, Ningxin Peng, Peihao Zhu, Zewei Sun, Shanbo Cheng, Mingxuan Wang, Degen Huang, Jinsong Su
| Challenge: | Existing datasets focus on captions describing images or videos, which are not large and diverse enough. |
| Approach: | They propose a large-scale video subtitle translation dataset to facilitate multi-modality machine translation. |
| Outcome: | The proposed dataset is 10 times larger than the widely used *How2* and *VaTeX* datasets. |
Context-Aware Non-Autoregressive Document-Level Translation with Sentence-Aligned Connectionist Temporal Classification (2024.lrec-main)
Copied to clipboard
| Challenge: | Existing studies employ autoregressive translation (AT) methods to encode sentences . however, the AT methods struggle with error accumulation when the length of sentences increases. |
| Approach: | They propose a context-aware non-autoregressive framework with the sentence-aligned connectionist temporal classification loss for document-level neural machine translation. |
| Outcome: | The proposed framework achieves 46X speedup on three benchmarks compared to strong baselines. |
A Joint Multiple Criteria Model in Transfer Learning for Cross-domain Chinese Word Segmentation (2020.emnlp-main)
Copied to clipboard
| Challenge: | Existing methods for word-level segmentation (CWS) for the Chinese language have been successful in large-scale annotated corpora. |
| Approach: | They propose a method that integrates different segmentation criteria into one model . they use a transfer learning method to improve the performance of OOV words . |
| Outcome: | The proposed method achieves state-of-the-art performance on multiple benchmark datasets . it shows a competitive practicability and generalization ability for the CWS task . |
One Pair Suffices: Unlocking Universal Zero-Shot Translation via Cross-Architecture Alignment (2026.acl-long)
Copied to clipboard
| Challenge: | Current paradigms for empowering Large Language Models with multilingual capabilities rely heavily on massive instruction tuning. |
| Approach: | They propose a hybrid cross-alignment approach that fuses a frozen NLLB encoder with a Qwen decoder via a closed-loop dual-adapter architecture. |
| Outcome: | The proposed model outperforms towerPlus-9B and Aya-101 on language-agnostic projection protocols. |
Continual Learning for Multilingual Neural Machine Translation via Dual Importance-based Model Division (2023.emnlp-main)
Copied to clipboard
| Challenge: | Existing methods focus on preventing catastrophic forgetting by making compromises between the original and new language pairs, leading to sub-optimal performance on both translation tasks. |
| Approach: | They propose a dual importance-based model division method to divide the model parameters into two parts and separate the translation of the original and new tasks. |
| Outcome: | The proposed method outperforms strong baselines under different incremental translation scenarios. |
Adaptive Token-level Cross-lingual Feature Mixing for Multilingual Neural Machine Translation (2022.emnlp-main)
Copied to clipboard
| Challenge: | Multilingual neural machine translation models can translate multiple language pairs in a single model but lacks ability to capture language-specific features. |
| Approach: | They propose a token-level feature mixing method that captures different features and dynamically determines feature sharing across languages. |
| Outcome: | The proposed method outperforms baselines and can be extended to zero-shot translation. |
Enhancing Chinese Word Segmentation via Pseudo Labels for Practicability (2021.findings-acl)
Copied to clipboard
| Challenge: | Pre-trained language models alleviate segmentation ambiguity and out-of-vocabulary (OOV) words. |
| Approach: | They propose a semisupervised neural method which distills knowledge from unlabeled data to a student model to improve both in-domain and out-of-domain CWS. |
| Outcome: | The proposed method can keep practicability of the lightweight student model and improve segmentation effectively on downstream Chinese NLP tasks. |
Lexicon-Based Graph Convolutional Network for Chinese Word Segmentation (2021.findings-emnlp)
Copied to clipboard
| Challenge: | Existing methods for Chinese word segmentation have high performance on benchmarks but are limited by the small-scale annotated corpus. |
| Approach: | They propose a framework that incorporates a lexicon-based graph convolutional network into the Transformer encoder to improve Chinese word segmentation (CWS) Chinese word is an essential and pre-processing step for many downstream NLP tasks. |
| Outcome: | The proposed framework captures the information of candidate words and improves performance on benchmarks and datasets. |
Exploring Dynamic Selection of Branch Expansion Orders for Code Generation (2021.acl-long)
Copied to clipboard
| Challenge: | Existing code generation models model abstract syntax tree (AST) but not suitable for all multi-branch nodes. |
| Approach: | They propose to equip a Seq2Tree model with a branch selector to determine optimal expansion orders for multi-branch nodes. |
| Outcome: | The proposed model can determine optimal expansion orders of branches for multi-branch nodes. |
Exploring Better Text Image Translation with Multimodal Codebook (2023.acl-long)
Copied to clipboard
| Challenge: | Current studies on text image translation face bottlenecks due to lack of a publicly available dataset and poor optical character recognition. |
| Approach: | They propose a text image translation model with a multimodal codebook and an OCR dataset for Chinese-English translation. |
| Outcome: | The proposed model can associate the image with relevant texts, providing useful supplementary information for translation. |
Improving Graph-based Sentence Ordering with Iteratively Predicted Pairwise Orderings (2021.emnlp-main)
Copied to clipboard
Shaopeng Lai, Ante Wang, Fandong Meng, Jie Zhou, Yubin Ge, Jiali Zeng, Junfeng Yao, Degen Huang, Jinsong Su
| Challenge: | Existing sentence ordering models can be classified into pairwise ordering models and set-to-sequence models. |
| Approach: | They propose a novel sentence ordering framework which introduces two classifiers to make better use of pairwise orderings for graph-based sentence ordering. |
| Outcome: | The proposed model achieves state-of-the-art performance on five commonly-used datasets. |
Towards Robust k-Nearest-Neighbor Machine Translation (2022.emnlp-main)
Copied to clipboard
| Challenge: | k-Nearest-Neighbor Machine Translation (kNN-MT) is a popular research paradigm in machine translation. |
| Approach: | They propose a confidence-enhanced kNN-MT model with robust training to reduce noise . they introduce NMT confidence to refine the modeling of important components of kN-MT . |
| Outcome: | The proposed model improves on four benchmark datasets and is robust to training. |
Towards User-Driven Neural Machine Translation (2021.acl-long)
Copied to clipboard
| Challenge: | a good translation should implicitly mirror user traits rather than translate the original content semantically. |
| Approach: | They propose a framework that captures user traits from historical inputs . they propose 'user-driven' NMT to model user behavior under a zero-shot learning fashion . |
| Outcome: | The proposed framework can capture user traits from historical inputs under zero-shot learning fashion. |