Papers by Wenxiang Jiao
ParroT: Translating during Chat using Large Language Models tuned with Human Translation and Feedback (2023.findings-emnlp)
Copied to clipboard
Wenxiang Jiao, Jen-tse Huang, Wenxuan Wang, Zhiwei He, Tian Liang, Xing Wang, Shuming Shi, Zhaopeng Tu
| Challenge: | Large language models (LLMs) like ChatGPT are only accessible through restricted APIs, which creates barriers to new research and advancements in the field. |
| Approach: | They propose a framework to enhance and regulate the translation abilities during chat . they reformulate translation data into the instruction-following style and introduce a "Hint" field . |
| Outcome: | The proposed framework enhances and regulates the translation abilities during chat . it reformulates translation data into the instruction-following style and introduces a "Hint" field . |
Refuse Whenever You Feel Unsafe: Improving Safety in LLMs via Decoupled Refusal Training (2025.acl-long)
Copied to clipboard
Youliang Yuan, Wenxiang Jiao, Wenxuan Wang, Jen-tse Huang, Jiahao Xu, Tian Liang, Pinjia He, Zhaopeng Tu
| Challenge: | Large Language Models exhibit a level of intelligence that is both impressive and everevolving, but their ability to refuse generating unsafe content is a double-edged sword. |
| Approach: | They propose a method to tackle a refusal position bias within safety tuning data that compromises the models’ ability to appropriately refuse generating unsafe content. |
| Outcome: | The proposed method significantly improves model safety without compromising performance and surpasses baseline methods in defending against attacks. |
Chain-of-Jailbreak Attack for Image Generation Models via Step by Step Editing (2025.findings-acl)
Copied to clipboard
Wenxuan Wang, Kuiyi Gao, Youliang Yuan, Jen-tse Huang, Qiuzhi Liu, Shuai Wang, Wenxiang Jiao, Zhaopeng Tu
| Challenge: | Text-based image generation models, such as Stable Diffusion and DALL-E 3, hold significant potential in content creation and publishing workflows . however, considerable efforts are being made to prevent the generation of harmful content, such abusive, violent, or pornographic material. |
| Approach: | They propose a chain-of-jailbreak method which decomposes malicious queries into multiple sub-queries and iteratively edits images based on these sub-questions. |
| Outcome: | The proposed method can bypass safeguards of image generation models for over 60% cases, significantly outperforms other jailbreaking methods (14%) |
On the Reliability of Psychological Scales on Large Language Models (2024.emnlp-main)
Copied to clipboard
| Challenge: | Recent research has focused on examining Large Language Models’ characteristics from a psychological standpoint, acknowledging the necessity of understanding their behavioral characteristics. |
| Approach: | They propose to examine the reliability of personality tests to LLMs by using psychological scales. |
| Outcome: | The proposed model can represent diverse personalities with specific prompt instructions. |
Multi-Task Learning with Shared Encoder for Non-Autoregressive Machine Translation (2021.naacl-main)
Copied to clipboard
| Challenge: | Existing non-autoregressive machine translation models have shown significant inference speedup but suffer from inferior translation accuracy. |
| Approach: | They propose to use AT as an auxiliary task to transfer AT knowledge to NAT models by knowledge distillation. |
| Outcome: | The proposed method achieves significant improvements over baseline non-Autoregressive machine translation models on WMT14 En-De and WMT16 En-Ro datasets. |
Improving Machine Translation with Human Feedback: An Exploration of Quality Estimation as a Reward Model (2024.naacl-long)
Copied to clipboard
| Challenge: | Existing methods to improve translation quality using human feedback have not been validated. |
| Approach: | They propose to use quality estimation to predict human preferences for feedback training . they propose to detect incorrect translations and assign a penalty term to the reward scores . |
| Outcome: | The proposed method outperforms systems using larger parallel corpora by a small amount of monolingual data. |
LogicAsker: Evaluating and Improving the Logical Reasoning Ability of Large Language Models (2024.emnlp-main)
Copied to clipboard
Yuxuan Wan, Wenxuan Wang, Yiliu Yang, Youliang Yuan, Jen-tse Huang, Pinjia He, Wenxiang Jiao, Michael Lyu
| Challenge: | LogicAsker examines and improves the reasoning abilities of large language models such as ChatGPT and GPT-4. |
| Approach: | They propose a set of atomic reasoning skills grounded in propositional and predicate logic to examine and improve the reasoning abilities of large language models such as ChatGPT and GPT-4. |
| Outcome: | The proposed approach improves reasoning abilities in large language models such as ChatGPT and GPT-4 by up to 5%. |
Adapters for Enhanced Modeling of Multilingual Knowledge and Text (2022.findings-emnlp)
Copied to clipboard
| Challenge: | Large language models learn facts from text corpora, but knowledge graphs contain facts in an explicit triple format, restricting their research and application. |
| Approach: | They propose to enhance multilingual language models with knowledge from multilingual knowledge graphs . they propose to use cross-lingual entity alignment and facts from MLKGs to improve performance . |
| Outcome: | The proposed model improves MLLMs with cross-lingual entity alignment and facts from multilingual knowledge graphs for many languages while maintaining performance on other general language tasks. |
Identifying the Achilles’ Heel: An Iterative Method for Uncovering Factual Errors in Large Language Models (2026.findings-acl)
Copied to clipboard
Wenxuan Wang, Yuk-Kit Chan, Zixuan Ling, Shi Juluan, Youliang Yuan, Jen-tse Huang, Yifei Zhang, Wenxiang Jiao, Zhaopeng Tu, Michael R. Lyu
| Challenge: | Current methods for evaluating LLMs’ veracity are limited by the need for extensive human labor, test data contamination, or limited scope, hindering efficient and effective exposure of errors. |
| Approach: | They propose a framework that extracts fact triplets to generate diverse question types using rule-based natural language processing techniques. |
| Outcome: | The proposed framework can trigger factual errors in up to 55% of questions in large LLMs while maintaining coverage of questions. |
DRPruning: Efficient Large Language Model Pruning through Distributionally Robust Optimization (2025.acl-long)
Copied to clipboard
| Challenge: | Structured pruning reduces model size but often causes uneven degradation across domains, leading to biased performance. |
| Approach: | They propose a method that dynamically adjusts the data distribution during training to restore balanced performance across heterogeneous and multi-tasking data. |
| Outcome: | Experiments in monolingual and multilingual settings show that the proposed method surpasses similarly sized models in pruning and continued pretraining over perplexity, downstream tasks, and instruction tuning. |
Benchmarking and Improving Long-Text Translation with Large Language Models (2024.findings-acl)
Copied to clipboard
Longyue Wang, Zefeng Du, Wenxiang Jiao, Chenyang Lyu, Jianhui Pang, Leyang Cui, Kaiqiang Song, Derek Wong, Shuming Shi, Zhaopeng Tu
| Challenge: | Recent studies have illuminated the promising capabilities of large language models (LLMs) in handling long texts. |
| Approach: | They construct a benchmark dataset specifically designed for the finetuning and evaluation of large language models (LLMs) they compare LLMs with MT models and find they exhibit shortcomings in long-text domains . |
| Outcome: | The proposed model performs better in long-text translation, and its performance diminishes as document size increases. |
Data Rejuvenation: Exploiting Inactive Training Examples for Neural Machine Translation (2020.emnlp-main)
Copied to clipboard
| Challenge: | Large-scale training datasets make training neural machine translation models difficult. |
| Approach: | They propose to identify inactive training examples which contribute less to the model performance and introduce data rejuvenation to improve NMT models' training. |
| Outcome: | The proposed framework stabilizes and accelerates the training process of NMT models, resulting in models with better generalization capability. |
Learning to Ask: When LLM Agents Meet Unclear Instruction (2025.emnlp-main)
Copied to clipboard
Wenxuan Wang, Shi Juluan, Zixuan Ling, Yuk-Kit Chan, Chaozheng Wang, Cheryl Lee, Youliang Yuan, Jen-tse Huang, Wenxiang Jiao, Michael R. Lyu
| Challenge: | Despite their impressive capabilities, LLMs struggle with complex computations and delivering accurate, timely information. |
| Approach: | They propose a framework that prompts LLM agents to ask questions when they encounter obstacles due to unclear instructions and an automated evaluation tool called ToolEvaluator. |
| Outcome: | The proposed framework outperforms existing frameworks for tool learning in the Noisy ToolBench. |
Curing Miracle Steps in LLM Mathematical Reasoning with Rubric Rewards (2026.acl-long)
Copied to clipboard
Youliang Yuan, Qiuyang Mang, Jingbang Chen, Hong Wan, Xiaoyuan Liu, Junjielong Xu, Jen-tse Huang, Wenxuan Wang, Wenxiang Jiao, Pinjia He
| Challenge: | Existing models are susceptible to reward hacking, leading to a substantial overestimation of a model's reasoning ability. |
| Approach: | They propose a Rubric Reward Model that rewards the entire reasoning trajectory against problem-specific rubrics. |
| Outcome: | The proposed model outperforms outcome-only supervision on four math benchmarks and boosts Verified Pass@1024 from 26.7% to 62.6% and reduces the incidence of Miracle Steps by 71%. |
Scaling Back-Translation with Domain Text Generation for Sign Language Gloss Translation (2023.eacl-main)
Copied to clipboard
| Challenge: | Sign language gloss translation aims to translate the sign glosses into spoken language texts, which is challenging due to the scarcity of labeled gloss-text parallel data. |
| Approach: | They propose a back translation technique that generates pseudo-parallel data by translating in-domain spoken language texts into sign glosses. |
| Outcome: | The proposed method outperforms the BT methods on three benchmarks of sign language gloss translation in different languages. |
Cross-modality Data Augmentation for End-to-End Sign Language Translation (2023.findings-emnlp)
Copied to clipboard
| Challenge: | End-to-end sign language translation (SLT) aims to convert sign language videos into spoken language texts without intermediate representations. |
| Approach: | They propose a cross-modality data-augmented framework to transfer gloss-to-text translation capabilities to end-to end sign language translation. |
| Outcome: | The proposed framework outperforms baseline models on two widely used SLT datasets. |
Not All Countries Celebrate Thanksgiving: On the Cultural Dominance in Large Language Models (2024.acl-long)
Copied to clipboard
| Challenge: | e.g., ChatGPT often provides inappropriate English-culture-related answers when users ask in non-English languages. |
| Approach: | They build a benchmark of concrete and abstract cultural objects to evaluate the cultural dominance issue in large language models. |
| Outcome: | The proposed model can significantly mitigate cultural dominance issue in large language models . the model can provide accurate answers in English, while the model is ethically sound . |
Exploiting Unsupervised Data for Emotion Recognition in Conversations (2020.findings-emnlp)
Copied to clipboard
| Challenge: | Existing models for Emotion Recognition in Conversations lack supervised data, which prevents them from playing their maximum effect. |
| Approach: | They propose a Conversation Completion task which uses unsupervised conversation data to leverage unsupervised data. |
| Outcome: | The proposed model improves on the minority emotion classes on the ERC datasets. |
kNN-TL: k-Nearest-Neighbor Transfer Learning for Low-Resource Neural Machine Translation (2023.acl-long)
Copied to clipboard
| Challenge: | Transfer learning is an effective technique for enhancing low-resource neural machine translation (NMT) however, these methods do not make use of the parent knowledge during the child inference, which may limit the translation performance. |
| Approach: | They propose a k-Nearest-Neighbor Transfer Learning approach which leverages the parent knowledge throughout the entire developing process of the child model. |
| Outcome: | The proposed approach outperforms strong baselines on four low-resource translation tasks. |
Unsupervised Sign Language Translation and Generation (2024.findings-acl)
Copied to clipboard
Zhengsheng Guo, Zhiwei He, Wenxiang Jiao, Xing Wang, Rui Wang, Kehai Chen, Zhaopeng Tu, Yong Xu, Min Zhang
| Challenge: | Experimental results on the BBC-Oxford Sign Language dataset reveal that USLNet achieves competitive results compared to supervised baseline models. |
| Approach: | They propose an unsupervised sign language translation and generation network that learns from abundant single-modality data without parallel sign language data. |
| Outcome: | The proposed model achieves competitive results compared to baseline models on the BBC-Oxford Sign Language dataset and Open-Domain American Sign Language data. |
Self-Training Sampling with Monolingual Data Uncertainty for Neural Machine Translation (2021.acl-long)
Copied to clipboard
| Challenge: | Experimental results show that enhancing the learning on uncertain monolingual sentences improves the translation quality of high-uncertainty sentences and also benefits the prediction of low-frequency words at the target side. |
| Approach: | They propose to use monolingual data to augment model training with synthetic parallel data by selecting the most informative monolingual sentences to complement the parallel data. |
| Outcome: | The proposed approach improves the performance of natural language models by selecting the most informative monolingual sentences. |
Understanding and Improving Sequence-to-Sequence Pretraining for Neural Machine Translation (2022.acl-long)
Copied to clipboard
| Challenge: | Existing studies on self-supervised pretraining for machine translation have focused on the jointly pretrained decoder . |
| Approach: | They propose a method to improve neural machine translation by jointly pretrained decoder . they propose two strategies to remedy the domain and objective discrepancies . |
| Outcome: | The proposed approach improves translation performance and model robustness on three language pairs. |
Encouraging Divergent Thinking in Large Language Models through Multi-Agent Debate (2024.emnlp-main)
Copied to clipboard
Tian Liang, Zhiwei He, Wenxiang Jiao, Xing Wang, Yan Wang, Rui Wang, Yujiu Yang, Shuming Shi, Zhaopeng Tu
| Challenge: | Modern large language models (LLMs) have shown remarkable performance on general language tasks but struggle on complex reasoning tasks. |
| Approach: | They propose a multi-agent debate framework that encourages divergent thinking in LLMs . they propose to break debate and use a judge to obtain a final solution . |
| Outcome: | The proposed framework encourages divergent thinking in large language models . it is able to generate novel thoughts even if initial stance is incorrect . |
All Languages Matter: On the Multilingual Safety of LLMs (2024.findings-acl)
Copied to clipboard
| Challenge: | Existing safety benchmarks only concern the safety in one language, e.g. the majority language in the pretraining data such as English. |
| Approach: | They propose a prompting method to improve multilingual safety of ChatGPT by enhancing cross-lingual generalization of safety alignment. |
| Outcome: | The proposed method can significantly reduce the ratio of unsafe responses by 42% for non-English queries. |
HiGRU: Hierarchical Gated Recurrent Units for Utterance-Level Emotion Recognition (N19-1)
Copied to clipboard
| Challenge: | Using textual features, our proposed HiGRU models achieve at least 8.7%, 7.5%, 6.0% improvement over the state-of-the-art methods on each dataset. |
| Approach: | They propose a hierarchical gated recurrent unit framework to model word-level inputs and an upper-level GRU to capture contexts of utterance-level embeddings. |
| Outcome: | The proposed framework achieves 8.7%, 7.5%, 6.0% improvement over state-of-the-art methods on three datasets. |
LoopTool: Closing the Data–Training Loop for Robust LLM Tool Calls (2026.acl-long)
Copied to clipboard
| Challenge: | Large Language Models (LLMs) are powerful tools for multi-step tasks, but static data pipelines hinder tool learning and cause noisy labels to persist. |
| Approach: | They propose a fully automated, model-aware data evolution framework that tightly integrates data synthesis and model training. |
| Outcome: | Experiments show that LoopTool-8B significantly surpasses its 32B data generator and achieves new state-of-the-art results on the BFCL-v3 and ACEBench benchmarks for its scale. |