Papers by Xuancheng Huang
Don’t Half-listen: Capturing Key-part Information in Continual Instruction Tuning (2025.acl-long)
Copied to clipboard
Yongquan He, Wenyuan Zhang, Xuancheng Huang, Peng Zhang, Lingxun Meng, Xiang Zhou, Ke Zeng, Xunliang Cai
| Challenge: | Existing methods to improve instruction tuning for large language models may cause catastrophic forgetting (CF) CF is a problem where previously learned abilities are degraded . |
| Approach: | They propose a continual instruction tuning method that uses key-part information gain to replay data and refine training objective. |
| Outcome: | The proposed method achieves superior performance on both seen and held-out tasks. |
Learning to Copy for Automatic Post-Editing (D19-1)
Copied to clipboard
| Challenge: | Automatic post-editing (APE) is an important task in natural language processing. |
| Approach: | They propose a method that explicitly models how to copy words from a machine translation to a correct translation. |
| Outcome: | The proposed method outperforms all published methods on the WMT 2016-2017 datasets. |
An Extensible Plug-and-Play Method for Multi-Aspect Controllable Text Generation (2023.acl-long)
Copied to clipboard
| Challenge: | Multi-aspect controllable text generation has attracted increasing attention . but the mutual interference of multiple prefixes limits its extensibility to training-time unseen combinations. |
| Approach: | They propose to use trainable gates to normalize the intervention of prefixes to restrain the interference. |
| Outcome: | The proposed approach outperforms baselines on constraint accuracy, text quality, and extensibility. |
Transfer Learning for Sequence Generation: from Single-source to Multi-source (2021.acl-long)
Copied to clipboard
| Challenge: | Recent studies have shown that pretrained models are effective for low-resource downstream tasks. |
| Approach: | They propose a two-stage finetuning method to transfer pretrained models to MSG tasks by concatenating multiple sources into a single long sequence. |
| Outcome: | The proposed model outperforms baselines on the WMT17 APE task and multi-source translation task using the WTM14 test set. |
Rethinking Denoised Auto-Encoding in Language Pre-Training (2021.emnlp-main)
Copied to clipboard
| Challenge: | Pre-trained models such as BERT have achieved success in learning sequence representations, but they tend to learn representations that are covariant with the noise of pre-training. |
| Approach: | They propose to train self-trained models to learn noise invariant sequence representations . they encourage consistency between original sequence and corrupted version via unsupervised instance-wise training signals. |
| Outcome: | The proposed model improves on 11 natural language understanding and cross-modal tasks and achieves 0.6% gain on GLUE benchmarks and 0.8% increment on NLVR2 . |
LatentRefusal: Latent-Signal Refusal for Unanswerable Text-to-SQL Queries (2026.findings-acl)
Copied to clipboard
| Challenge: | Existing refusal strategies for unanswerable and underspecified user queries are brittle due to model hallucinations or add complexity and overhead. |
| Approach: | They propose a latent-signal refusal mechanism that predicts query answerability from hidden activations of an LLM. |
| Outcome: | The proposed scheme reduces schema noise and sparse, localized question–schema mismatch cues that indicate unanswerability. |
MHALO: Evaluating MLLMs as Fine-grained Hallucination Detectors (2025.findings-acl)
Copied to clipboard
| Challenge: | Hallucination remains a critical challenge for multimodal large language models, undermining their reliability in real-world applications. |
| Approach: | They propose a benchmark specifically designed for evaluating MLLMs’ capability in performing token-level hallucination detection (FHD) . they use curated training data to train a specialized model that significantly outperforms existing models. |
| Outcome: | The proposed model outperforms existing models in the evaluation of 9 MLLMs and reaches an average F1IoU of 40.59%. |