Papers by Chenhui Mao
EGSS: Entropy-guided Stepwise Scaling for Reliable Software Engineering (2026.acl-long)
Copied to clipboard
Chenhui Mao, Yuanting Lei, Zhixiang Wei, Ming Liang, Zhixiang Wang, Jingxuan Xu, Dajun Chen, Wei Jiang, Yong Li
| Challenge: | Entropy-Guided Stepwise Scaling (EGSS) is a novel TTS framework for software engineering tasks. |
| Approach: | They propose an entropy-guided stepwise scaling framework that balances efficiency and effectiveness through entropic-guide encoding and robust test-suite augmentation. |
| Outcome: | EGSS boosts performance by 5–10% across all evaluated models, and reduces inference-time token usage by over 28% . compared to existing methods, EGS reduces token usage and reduce inference time by over 20% . |
Enhancing Language Model with Unit Test Techniques for Efficient Regular Expression Generation (2023.emnlp-industry)
Copied to clipboard
| Challenge: | Recent studies have shown that generative language models lack functional correctness, which is a critical aspect of regular expressions. |
| Approach: | They propose a method that takes functional correctness into account and transforms it into a differentiable gradient feedback using policy gradient techniques. |
| Outcome: | The proposed method has been used in a regulatory scenario to ensure that all online content is free from non-compliant elements, thereby significantly reducing the workload of relevant personnel. |
Lightweight Cross-Lingual Sentence Representation Learning (2021.acl-long)
Copied to clipboard
| Challenge: | Existing models for learning fixed-dimensional cross-lingual sentence representations are impractical due to memory limitations. |
| Approach: | They propose a lightweight dual-transformer architecture with just 2 layers for generating memory-efficient cross-lingual sentence representations. |
| Outcome: | The proposed model improves performance on training tasks and improves memory efficiency. |
When do Contrastive Word Alignments Improve Many-to-many Neural Machine Translation? (2022.findings-naacl)
Copied to clipboard
| Challenge: | Existing methods to improve pre-training for many-to-many neural machine translation use manual cleaning of bilingual dictionaries, which are unavailable for most language pairs. |
| Approach: | They propose a word-level contrastive objective to leverage word alignments for many-to-many neural machine translation (NMT) Empirical results show that this leads to 0.8 BLEU gains for several language pairs. |
| Outcome: | Empirical results show that the proposed objective leads to 0.8 BLEU gains for several language pairs. |
Exploring the Impact of Layer Normalization for Zero-shot Neural Machine Translation (2023.acl-short)
Copied to clipboard
| Challenge: | Recent studies have shown that layer normalization (LayerNorm) overfits training data and therefore has low generalizability for ZST. |
| Approach: | They propose to use the Transformer architecture to set the default layer normalization setting for zero-shot translation (ZST) they also propose to set LayerNorm after residual connections to outperform PreNorm by 12.3 BLEU points. |
| Outcome: | The proposed model outperforms the current model by 12.3 BLEU points on 54 directions on OPUS, IWSLT, and Europarl datasets. |
BERTSeg: BERT Based Unsupervised Subword Segmentation for Neural Machine Translation (2022.aacl-short)
Copied to clipboard
| Challenge: | Existing subword segmenters are frequency-based without semantics information or neural-based but trained on parallel corpora. |
| Approach: | They propose an unsupervised neural subword segmenter for neural machine translation that utilizes contextualized semantic embeddings of words from characterBERT and maximizes the generation probability of subword segments. |
| Outcome: | The proposed method improves translation performance on ALT, IWSLT15 Vi->En, WMT16 Ro->En and WMT15 Fi->En datasets. |