Papers by Zhongjun He
Addressing Troublesome Words in Neural Machine Translation (D18-1)
Copied to clipboard
| Challenge: | Neural machine translation (NMT) has weaknesses in handling lowfrequency and ambiguous words, which we refer to as troublesome words. |
| Approach: | They propose to use contextual memory to memorize which target words should be produced in which situations to translate troublesome words. |
| Outcome: | The proposed method outperforms baseline models on Chinese-to-English and English-to German translation tasks. |
Learning Adaptive Segmentation Policy for Simultaneous Translation (2020.emnlp-main)
Copied to clipboard
| Challenge: | Experimental results show that adaptive segmentation policies for simultaneous translation are more accurate than current methods . if translation starts before adequate source content is delivered, the quality of translation degrades . waiting for too much source text increases latency, which would hurt accuracy . |
| Approach: | They propose a new adaptive segmentation policy for simultaneous translation based on human interpreters . it learns to segment the source text by considering possible translations produced by the translation model . |
| Outcome: | Experimental results show that the proposed method achieves better accuracy-latency trade-off over state-of-the-art methods. |
FinanceReasoning: Benchmarking Financial Numerical Reasoning More Credible, Comprehensive and Challenging (2025.acl-long)
Copied to clipboard
Zichen Tang, Haihong E, Ziyan Ma, Haoyang He, Jiacheng Liu, Zhongjun Yang, Zihua Rong, Rongjin Li, Kun Ji, Qing Huang, Xinyang Hu, Yang Liu, Qianhe Zheng
| Challenge: | Compared to existing benchmarks, FinanceReasoning provides three key advancements: (1) credibility; (2) comprehensiveness; (3) numerical precision; (4) complexity; (5) complexity; and (6) complexity. |
| Approach: | They propose a benchmark to evaluate the reasoning capabilities of large reasoning models (LRMs) in financial numerical reasoning problems. |
| Outcome: | The proposed benchmark exceeds existing benchmarks in 67.8% of financial concepts and formulas and is credible, comprehensive, and challenging. |
Simultaneous Translation (2020.emnlp-tutorials)
Copied to clipboard
| Challenge: | Simultaneous translation is a problem that has long been considered one of the hardest problems in AI . this tutorial will provide a deep understanding of the history and the recent advances in simultaneous translation. |
| Approach: | This tutorial will examine the design and evaluation of policies for simultaneous translation . it will provide an overview of the history and recent advances in simultaneous translation. |
| Outcome: | This tutorial will examine the design and evaluation of policies for simultaneous translation . |
STACL: Simultaneous Translation with Implicit Anticipation and Controllable Latency using Prefix-to-Prefix Framework (P19-1)
Copied to clipboard
Mingbo Ma, Liang Huang, Hao Xiong, Renjie Zheng, Kaibo Liu, Baigong Zheng, Chuanqiang Zhang, Zhongjun He, Hairong Liu, Xing Li, Hua Wu, Haifeng Wang
| Challenge: | Simultaneous translation is notoriously dif- ficult due to word-order differences. |
| Approach: | They propose a prefix-to-prefix framework that implicitly learns to anticipate in a single translation model. |
| Outcome: | The proposed framework achieves low latency and reasonable qual- ity on 4 directions. |
Learning Adaptive Segmentation Policy for End-to-End Simultaneous Translation (2022.acl-long)
Copied to clipboard
| Challenge: | Existing methods to perform simultaneous speech-to-text translation ignore contextual information and suffer from low translation quality. |
| Approach: | They propose an adaptive segmentation policy for simultaneous speech-to-text translation . it learns to segment the source streaming speech into meaningful units . |
| Outcome: | The proposed method achieves a good accuracy-latency trade-off over state-of-the-art methods on English-German and Chinese-English. |
Robust Neural Machine Translation with Joint Textual and Phonetic Embedding (P19-1)
Copied to clipboard
| Challenge: | Neural machine translation models are sensitive to noises in input sentences . one special kind of noise is the homophone noise, where words are replaced by other words with similar pronunciations. |
| Approach: | They propose to embed phonetic and textual information into neural machine translation datasets to improve robustness to homophone noises. |
| Outcome: | The proposed method improves the robustness of neural machine translation to homophone noises on clean test sets. |
Multi-agent Learning for Neural Machine Translation (D19-1)
Copied to clipboard
| Challenge: | Experimental results show that training with more than one agent improves translation quality and improves accuracy. |
| Approach: | They propose to introduce diverse agents in an in- teractive updating process to train NMT models with an additional agent. |
| Outcome: | The proposed approach improves on NIST Chinese-English, IWSLT 2014 German- English, WMT 2014 English-German translation tasks and shows competitive performance on all tasks. |
Bi-SimCut: A Simple Strategy for Boosting Neural Machine Translation (2022.naacl-main)
Copied to clipboard
| Challenge: | BLEU scores of 31.16 for ende and 38.37 for deen on the IWSLT14 dataset, 30.78 for entde, 35.15 for de en and 27.17 for zhen . |
| Approach: | They propose a bidirectional pretraining and unidirectional finetuning procedure to boost NMT performance. |
| Outcome: | The proposed method achieves strong translation performance across five datasets. |
AlignX: Advancing Multilingual Large Language Models with Multilingual Representation Alignment (2025.emnlp-main)
Copied to clipboard
| Challenge: | Multilingual large language models (LLMs) possess impressive multilingual understanding and generation capabilities, but performance and cross-lingual alignment often lag for non-dominant languages. |
| Approach: | They propose a representation-level framework to enhance multilingual performance of pre-trained LLMs by integrating multilingual semantic alignment and language feature integration. |
| Outcome: | The proposed framework improves multilingual capability of pre-trained LLMs by bringing representations closer and improving cross-lingual alignment. |
Correcting Chinese Spelling Errors with Phonetic Pre-training (2021.findings-acl)
Copied to clipboard
Ruiqing Zhang, Chao Pang, Chuanqiang Zhang, Shuohuan Wang, Zhongjun He, Yu Sun, Hua Wu, Haifeng Wang
| Challenge: | Existing methods for Chinese spelling correction only use pre-trained language model or incorporate phonological information as external knowledge. |
| Approach: | They propose a phonetic Chinese spelling correction model that integrates phonetic features into language model by leveraging pre-training and fine-tuning methods. |
| Outcome: | The proposed model outperforms existing methods on SIGHAN datasets and improves on other datasets. |
Learning Multilingual Sentence Representations with Cross-lingual Consistency Regularization (2023.emnlp-industry)
Copied to clipboard
| Challenge: | Experimental results on multilingual similarity search and bitext mining tasks show the effectiveness of our approach. |
| Approach: | They propose a multilingual sentence representation model that aligns different languages in a shared representation space. |
| Outcome: | The proposed model performs better than LASER3 on similarity searches and bitext mining tasks. |
Mixup Decoding for Diverse Machine Translation (2021.findings-emnlp)
Copied to clipboard
| Challenge: | Existing methods for generating multiple translations for source and target languages neglect the one-to-many mapping between the source and the target languages. |
| Approach: | They propose a method to generate different translations for the input sentence by linearly interpolating it with different sentence pairs sampled from the training corpus during decoding. |
| Outcome: | Experiments on WMT’16 en-ro, WMT'14 en de, and WMT ‘17 zh-en show that the proposed method outperforms all previous diverse machine translation methods. |
Improving Zero-shot Multilingual Neural Machine Translation by Leveraging Cross-lingual Consistency Regularization (2023.findings-acl)
Copied to clipboard
| Challenge: | Existing methods to improve zero-shot translation performance by learning language-agnostic representations and maximizing cross-lingual transfer have been proposed. |
| Approach: | They propose a cross-lingual consistency regularization to bridge the representation gap between different languages and boost zero-shot translation performance. |
| Outcome: | The proposed model improves translation performance on low-resource and high-res benchmarks and closes the sentence representation gap and aligns the representation space. |
An Empirical Study of Consistency Regularization for End-to-End Speech-to-Text Translation (2024.naacl-long)
Copied to clipboard
| Challenge: | Existing methods for speech-to-text translation (ST) have achieved impressive supervised and zero-shot performance. |
| Approach: | They propose to use consistency regularization methods to boost end-to-end (E2E) speech-totext translation (ST) by regularizing the intra-modal consistency instead of the modality gap. |
| Outcome: | The proposed training strategies achieve state-of-the-art (SOTA) performance in most translation directions. |
Non-Autoregressive Chinese ASR Error Correction with Phonological Training (2022.naacl-main)
Copied to clipboard
| Challenge: | Existing methods to correct ASR errors focus on fixed-length corrections, but rarely consider variable-length ones. |
| Approach: | They propose a non-autoregressive method to correct Chinese ASR errors . they use phonological tokens to extend the source sentence for variable-length correction . |
| Outcome: | The proposed method improves word error rate and speeds up inference by 6.2 times compared with the autoregressive model. |