Papers by Wenhao Jiang
CLEME2.0: Towards Interpretable Evaluation by Disentangling Edits for Grammatical Error Correction (2025.acl-long)
Copied to clipboard
Jingheng Ye, Zishan Xu, Yinghui Li, Linlin Song, Qingyu Zhou, Hai-Tao Zheng, Ying Shen, Wenhao Jiang, Hong-Gee Kim, Ruitong Liu, Xin Su, Zifei Shan
| Challenge: | Existing studies have focused on the interpretability of Grammatical Error Correction (GEC) evaluation metrics, but the interpretabilty of these metrics has been neglected. |
| Approach: | They propose a reference-based metric that describes four aspects of GEC systems: hit-correction, wrong-corrections, under-correcties, and over-corrects. |
| Outcome: | The proposed metric reveals critical qualities and locates drawbacks of GEC systems. |
Crossing Variational Autoencoders for Answer Retrieval (2020.acl-main)
Copied to clipboard
| Challenge: | Existing methods learned semantic representations with dual encoders or dual variational auto-encoders failed to capture the aligned semantics between question and answer. |
| Approach: | They propose to use two variational auto-encoders to generate questions with aligned answers and generating answers with align questions. |
| Outcome: | The proposed method outperforms the state-of-the-art answer retrieval method on SQuAD. |
Retrieval Augmentation for Commonsense Reasoning: A Unified Approach (2022.emnlp-main)
Copied to clipboard
| Challenge: | Existing methods for retrieving encyclopedic knowledge lack a large corpus and effective commonsense retriever. |
| Approach: | They propose a framework for retrieval-augmented commonsense reasoning with a large commonsensense corpus and a commonseense retriever. |
| Outcome: | The proposed framework outperforms existing methods on commonsense reasoning tasks. |
Pre-training Language Models for Comparative Reasoning (2023.emnlp-main)
Copied to clipboard
| Challenge: | Comparative reasoning is a process of comparing objects, concepts, or entities to draw conclusions. |
| Approach: | They propose a framework to pre-train language models for enhancing comparative reasoning abilities . they collect scalable data for text-based entity comparison . |
| Outcome: | The proposed framework significantly improves comparative reasoning abilities under low-resource conditions on downstream tasks. |
Diversifying Content Generation for Commonsense Reasoning with Mixture of Knowledge Graph Experts (2022.findings-acl)
Copied to clipboard
| Challenge: | Recent years have seen a surge of interest in improving the generation quality of commonsense reasoning tasks. |
| Approach: | They propose a method that diversifies the generative reasoning by a mixture of expert strategy on commonsense knowledge graphs to encourage various generation outputs. |
| Outcome: | The proposed method improves diversity while achieving on par performance on two GCR benchmarks, based on both automatic and human evaluations. |
Knowledge-Enriched Natural Language Generation (2021.emnlp-tutorials)
Copied to clipboard
| Challenge: | Knowledge-enriched text generation poses unique challenges in modeling and learning . a roadmap will outline the state-of-the-art methods to tackle these challenges . |
| Approach: | They propose a roadmap to tackle the challenges of knowledge-enriched text generation . they will dive deep into various technical components to illustrate how to represent knowledge . |
| Outcome: | This tutorial outlines the state-of-the-art methods to tackle the problem . it aims to show how to represent knowledge, feed knowledge into a generation model, evaluate results . |
Locally Differentially Private In-Context Learning (2024.lrec-main)
Copied to clipboard
| Challenge: | Large pretrained language models (LLMs) have shown surprising In-Context Learning ability. |
| Approach: | They propose a locally differentially private framework of in-context learning for LLMs that can be augmented with a private database for some specific task. |
| Outcome: | The proposed framework can predict labels without additional parameter modifications without input-label pairs . |
Teaching According to Talents! Instruction Tuning LLMs with Competence-Aware Curriculum Learning (2025.findings-emnlp)
Copied to clipboard
Yangning Li, Tingwei Lu, Yinghui Li, Yankai Chen, Wei-Chieh Huang, Wenhao Jiang, Hui Wang, Hai-Tao Zheng, Philip S. Yu
| Challenge: | Efficient instruction tuning aims to enhance the ultimate performance of large language models (LLMs) current methods suffer from the curriculum rigidity, resulting in a fixed and potentially sub-optimal learning trajectory. |
| Approach: | a framework for efficient instruction tuning is proposed to address the issue of curriculum rigidity . current methods rely on static heuristic difficulty metrics and fail to adapt to evolving capabilities . |
| Outcome: | Efficient instruction tuning aims to enhance the ultimate performance of large language models . current methods suffer from the curriculum rigidity, resulting in a fixed learning trajectory . |
MKT: A Multi-Stage Knowledge Transfer Framework to Mitigate Catastrophic Forgetting in Multi-Domain Chinese Spelling Correction (2025.emnlp-industry)
Copied to clipboard
Peng Xing, Yinghui Li, Shirong Ma, Xinnian Liang, Haojing Huang, Yangning Li, Shu-Yu Guo, Hai-Tao Zheng, Wenhao Jiang, Ying Shen
| Challenge: | Chinese Spelling Correction (CSC) is a model that detects and corrects spelling errors in given sentences. |
| Approach: | They propose a model-agnostic model with an evolving teacher model and dynamic distillation weights for knowledge transfer in each domain rather than focusing solely on new domain knowledge. |
| Outcome: | The proposed model-agnostic framework is based on an evolving teacher model and dynamic distillation weights for knowledge transfer in each domain, rather than focusing solely on new domain knowledge. |
Faceted Hierarchy: A New Graph Type to Organize Scientific Concepts and a Construction Method (D19-53)
Copied to clipboard
| Challenge: | faceted concept hierarchy is a structure of parent-child relationships . concepts are expected to be organized in a hierarchical structure for student learning . |
| Approach: | They propose a faceted concept hierarchy that aims to build facets from scientific literature. |
| Outcome: | The proposed hierarchy is more complete than "type-of" relations, and resolves conflicts by maintaining the acyclic structure of a hierarchy. |
Rethinking the Roles of Large Language Models in Chinese Grammatical Error Correction (2025.acl-industry)
Copied to clipboard
Yinghui Li, Shang Qin, Jingheng Ye, Haojing Huang, Yangning Li, Shu-Yu Guo, Libo Qin, Xuming Hu, Wenhao Jiang, Hai-Tao Zheng, Philip S. Yu
| Challenge: | Recent studies have shown that Large Language Models’ performance as correctors on Chinese Grammatical Error Correction (CGEC) remains unsatisfactory due to the challenging nature of the task. |
| Approach: | They propose a training framework EXAM that uses LLMs as explainers to enhance CGEC small models and a novel evaluation method SEE that utilizes LLM as evaluators to bring more reasonable evaluations. |
| Outcome: | The proposed methods improve the performance of LLMs on Chinese Grammatical Error Correction (CGEC) task. |
Efficient Transformer Parameter Reuse via Zero-Token Mechanism (2026.findings-acl)
Copied to clipboard
| Challenge: | Existing approaches to scaling up parameter counts are impractical for users with limited computational resources. |
| Approach: | They propose a decoupled parameter cycling strategy that employs a head-tail decoupling strategy to decouple the first (head) and last (tail) layers from the parameter cycling process. |
| Outcome: | The proposed approach achieves superior performance under strict parameter constraints and significantly reduces computational overhead via early exits. |
Technical Question Answering across Tasks and Domains (2021.naacl-industry)
Copied to clipboard
| Challenge: | Existing methods for technical QA have a limited data size and question and answer overlaps . |
| Approach: | They propose a framework of deep transfer learning to address technical QA across tasks and domains using document retrieval and reading comprehension tasks. |
| Outcome: | The proposed framework performs better than state-of-the-art methods on the TechQA task. |
A Survey of Multi-task Learning in Natural Language Processing: Regarding Task Relatedness and Training Methods (2023.eacl-main)
Copied to clipboard
| Challenge: | Multi-task learning is a popular approach in natural language processing because of its commonalities and differences. |
| Approach: | They propose to summarize recent advances in multi-task learning methods based on their task relatedness into two general multi-step training methods. |
| Outcome: | The proposed methods summarize the tasks and discuss future directions. |
ChatMusician: Understanding and Generating Music Intrinsically with LLM (2024.findings-acl)
Copied to clipboard
Ruibin Yuan, Hanfeng Lin, Yi Wang, Zeyue Tian, Shangda Wu, Tianhao Shen, Ge Zhang, Yuhang Wu, Cong Liu, Ziya Zhou, Liumeng Xue, Ziyang Ma, Qin Liu, Tianyu Zheng, Yizhi Li, Yinghao Ma, Yiming Liang, Xiaowei Chi, Ruibo Liu, Zili Wang, Chenghua Lin, Qifeng Liu, Tao Jiang, Wenhao Huang, Wenhu Chen, Jie Fu, Emmanouil Benetos, Gus Xia, Roger Dannenberg, Wei Xue, Shiyin Kang, Yike Guo
| Challenge: | Despite LLMs' impressive capabilities in musical knowledge, music reasoning remains an unsolved task. |
| Approach: | They propose an open-source large language model (LLM) that integrates intrinsic musical abilities into LLaMA2 and GPT-3.5. |
| Outcome: | The proposed model can understand and generate music with a pure text tokenizer without external multi-modal neural structures or tokenizers. |
Prefix-Tuning Based Unsupervised Text Style Transfer (2023.findings-emnlp)
Copied to clipboard
| Challenge: | Unsupervised text style transfer is an important task in computer vision and natural language processing. |
| Approach: | They propose a method that uses pre-trained large language models to train a generative model that can alter the style of the input sentence without using any parallel data. |
| Outcome: | The proposed method outperforms the state-of-the-art methods on well-known datasets. |
SDE-SQL: Enhancing Text-to-SQL Generation in Large Language Models via Self-Driven Exploration with SQL Probes (2026.acl-long)
Copied to clipboard
| Challenge: | Existing approaches depend on static, pre-processed database information, which restricts the model’s capacity to deeply comprehend the underlying database content. |
| Approach: | They propose a framework that empowers LLMs to perform Self-Driven Exploration of databases during inference. |
| Outcome: | Evaluated on the BIRD benchmark with Qwen2.5-72B-Instruct, SDE-SQL achieves an 8.02 % improvement in execution accuracy over the baseline. |
Music Audio-Visual Question Answering Requires Specialized Multimodal Designs (2026.findings-acl)
Copied to clipboard
Wenhao You, Xingjian Diao, Wenjun Huang, Chunhui Zhang, Keyi Kong, Weiyi Wu, Chiyu Ma, Zhongyu Ouyang, Tingxuan Wu, Ming Cheng, Soroush Vosoughi, Jiang Gui
| Challenge: | Music audio-visual question answering presents unique challenges with dense audio-visual content, intricate temporal dynamics, and the need for domain-specific knowledge. |
| Approach: | They analyze Music AVQA datasets and analyze their results to identify key design patterns . they propose concrete future directions for incorporating musical priors . |
| Outcome: | The proposed architectures are critical for success in Music AVQA, the authors argue . they suggest concrete future directions for incorporating musical priors . |
SuPreME: A Supervised Pre-training Framework for Multimodal ECG Representation Learning (2025.findings-emnlp)
Copied to clipboard
| Challenge: | Recent ECG Self-Supervised Learning methods mitigate this by learning features without extensive labels but fail to capture fine-grained clinical semantics and require extensive task-specific fine-tuning. |
| Approach: | They propose a supervised pre-training framework for Multimodal ECG representation learning that combines structured diagnostic labels with large language models to help denoise, standardize cardiac concepts and improve clinical representation learning. |
| Outcome: | The proposed framework improves on six downstream datasets covering 106 cardiac conditions and achieves a zero-shot AUC performance of 77.20% over state-of-the-art eSSLs. |
Knowledge-Augmented Methods for Natural Language Processing (2022.acl-tutorials)
Copied to clipboard
| Challenge: | Knowledge in natural language processing (NLP) is a rising trend especially after the advent of large scale pre-trained models. |
| Approach: | This tutorial introduces the key steps in integrating knowledge into natural language processing (NLP) it introduces knowledge grounding from text, knowledge representation and fusing. |
| Outcome: | This tutorial introduces the key steps in integrating knowledge into natural language processing including knowledge grounding from text, knowledge representation and fusing. |
NeuReasoner: Towards Explainable, Controllable, and Unified Reasoning via Mixture-of-Neurons (2026.acl-long)
Copied to clipboard
| Challenge: | Existing Large Reasoning Models (LRMs) lack explainability and controllability . Existing models target isolated levels without unification, while relying on RL . |
| Approach: | They propose an explainable, controllable, and unified reasoning framework driven by MoN. |
| Outcome: | The proposed framework achieves performance gains of 27.0% while reducing token consumption by 19.6% 63.3%. |
Sentence-Permuted Paragraph Generation (2021.emnlp-main)
Copied to clipboard
| Challenge: | Existing models produce similar contents from homogenized contexts due to the fixed left-to-right sentence order. |
| Approach: | They propose a framework permuting sentence orders to improve content diversity of multi-sentence paragraphs by permutating the sentence orders. |
| Outcome: | The proposed framework produces more diverse outputs with higher quality than existing models. |
Auto-Instruct: Automatic Instruction Generation and Ranking for Black-Box Language Models (2023.findings-emnlp)
Copied to clipboard
Zhihan Zhang, Shuohang Wang, Wenhao Yu, Yichong Xu, Dan Iter, Qingkai Zeng, Yang Liu, Chenguang Zhu, Meng Jiang
| Challenge: | Large language models can perform a wide range of tasks by following natural language instructions without task-specific fine-tuning. |
| Approach: | They propose a method to automatically improve the quality of LLM instructions . they leverage the generative ability of LMS to generate diverse candidate instructions based on a scoring model trained on 575 existing NLP tasks. |
| Outcome: | The proposed method surpasses human-written and LLM-generated instructions on 118 out-of-domain tasks. |
Large Language Models are Built-in Autoregressive Search Engines (2023.findings-acl)
Copied to clipboard
| Challenge: | Existing dual-encoder dense retrievers obtain representations for questions and documents independently, allowing only shallow interactions between them. |
| Approach: | They propose to use large language models to generate URLs for document retrieval by following human instructions. |
| Outcome: | The proposed method achieves better retrieval performance than existing retrieval approaches on open-domain question answering benchmarks. |
ReEx-SQL: Reasoning with Execution-Aware Reinforcement Learning for Text-to-SQL (2026.acl-long)
Copied to clipboard
Yaxun Dai, Wenxuan Xie, Xialie Zhuang, Tianyu Yang, Ziyi Liu, Haiqin Yang, Yiying Yang, Yuhang Zhao, Pingfu Chao, Wenhao Jiang
| Challenge: | Current Text-to-SQL reasoning models lack integrated execution feedback during generation. |
| Approach: | They propose a text-to-SQL framework that interacts with the SQL execution engine during decoding and dynamically adjusts reasoning based on execution feedback. |
| Outcome: | The proposed framework achieves 89.1% accuracy on Spider and 65.3% on BIRD at the 7B scale. |
COIG-P: A High-Quality and Large-Scale Chinese Preference Dataset for Alignment with Human Values (2026.findings-eacl)
Copied to clipboard
Siwei Wu, JinCheng Ren, Xeron Du, Shuyue Guo, Xingwei Qu, Yiming Liang, Jie Liu, Yunwen Li, Tyler Loakman, Tianyu Zheng, Boyu Feng, Huaqing Yuan, Zili Wang, Jiaheng Liu, Wenhao Huang, Chenglin Cai, Haoran Que, Jian Yang, Yuelin Bai, Zekun Moore Wang, Zhouliang Yu, Qunshu Lin, Ding Pan, Yuchen Eleanor Jiang, Tiannan Wang, Wangchunshu Zhou, Shenzhi Wang, Xingyuan Bu, Minghao Liu, Guoyin Wang, Ge Zhang, Chenghua Lin
| Challenge: | Existing Chinese preference datasets suffer from limited scale, restricted domain coverage, and insufficiently rigorous data validation. |
| Approach: | They propose an LLM-based data annotation pipeline with no human intervention to annotate Chinese preference datasets. |
| Outcome: | The proposed pipeline outperforms existing Chinese preference datasets on AlignBench and Chinese Reward Benchmark. |
Dict-BERT: Enhancing Language Model Pre-training with Dictionary (2022.findings-acl)
Copied to clipboard
Wenhao Yu, Chenguang Zhu, Yuwei Fang, Donghan Yu, Shuohang Wang, Yichong Xu, Michael Zeng, Meng Jiang
| Challenge: | Pre-trained language models (PLMs) capture word semantics in different contexts, hence the embeddings of rare words on the tail are poorly optimized. |
| Approach: | They propose to leverage definitions of rare words in dictionaries to enhance language model pre-training by leveraging dictionary definitions. |
| Outcome: | The proposed model improves understanding of rare words and boosts performance on various NLP downstream tasks. |
Express What You See: Can Multimodal LLMs Decode Visual Ciphers with Intuitive Semiosis Comprehension? (2025.findings-acl)
Copied to clipboard
| Challenge: | Traditional VQA benchmarks encounter a modality gap and over-reliance on language priors, whereas human cognition excels at intuitive semiosis, associating abstract visual symbols to linguistic semantics. |
| Approach: | They propose a task of generating abstract linguistics from emoji sequence images, where such reasoning underpins critical applications in cryptography. |
| Outcome: | The proposed model can generate abstract linguistics from emoji sequence images, challenging MLLMs’ reasoning of decoding complex semantics of visual ciphers. |
PLUG: Leveraging Pivot Language in Cross-Lingual Instruction Tuning (2024.acl-long)
Copied to clipboard
| Challenge: | Instruction tuning has advanced large language models (LLMs) but its application in lower-resource languages faces challenges due to the imbalanced foundational abilities of LLMs across different languages. |
| Approach: | They propose a pivot language guided generation approach that utilizes a high-resource language as the pivot to enhance instruction tuning in lower-resourced languages. |
| Outcome: | The proposed approach improves instruction-following abilities of LLMs by 29% on average compared to directly responding in the target language alone. |
Exploring Contrast Consistency of Open-Domain Question Answering Systems on Minimally Edited Questions (2023.tacl-1)
Copied to clipboard
| Challenge: | Existing studies on the ability of a model to make consistently correct predictions in the presence of perturbations have not been conducted in open-domain question answering (OpenQA). |
| Approach: | They propose a query-side contrastive loss to improve the dense passage retriever (DPR) to improve DPR training. |
| Outcome: | The proposed approach improves the density of the dense passage retriever (DPR) training set without sacrificing accuracy on standard test sets. |
IfQA: A Dataset for Open-domain Question Answering under Counterfactual Presuppositions (2023.emnlp-main)
Copied to clipboard
| Challenge: | Existing open-domain QA tasks focus on questions whose answer can be deduced directly from global factual knowledge. |
| Approach: | They propose a dataset where each question is based on a counterfactual presupposition via an "if" clause. |
| Outcome: | The IfQA dataset contains 3,800 questions that were annotated by crowdworkers on relevant Wikipedia passages. |
A Unified Encoder-Decoder Framework with Entity Memory (2022.emnlp-main)
Copied to clipboard
| Challenge: | Existing approaches to index, retrieve, and read documents as evidence suffer from large computational overheads. |
| Approach: | They propose an encoder-decoder framework with an entity memory that stores entity knowledge as latent representations and pre-trained on Wikipedia along with encoder parameters. |
| Outcome: | The proposed framework outperforms memory-based and non-memory encoder-decoder models on various entity-intensive question answering and generation tasks. |
Trust Within? Seek Beyond? Knowledge Boundary Aware Policy Optimization for Agentic Search (2026.acl-long)
Copied to clipboard
Tao Feng, Xinke Jiang, Xinyan Hu, Yonggang Zhang, Zhen Tao, Wentao Zhang, Boyang Liu, Wenhao Jiang, Chao Wu
| Challenge: | Existing approaches to augment large language models with external knowledge suffer from a lack of calibration regarding the model’s knowledge boundary. |
| Approach: | They propose a reinforcement learning framework that explicitly aligns retrieval decisions with quantified knowledge states. |
| Outcome: | The proposed framework outperforms strong baselines while exhibiting reduced hallucination rates. |
Injecting Entity Types into Entity-Guided Text Generation (2021.emnlp-main)
Copied to clipboard
| Challenge: | Recent advances in deep generative modeling have led to significant advances in natural language generation (NLG). |
| Approach: | They propose to model the entity type carefully in the decoding phase to generate contextual words accurately. |
| Outcome: | The proposed model produces a target sequence based on a given list of entities. |
Learn Beyond The Answer: Training Language Models with Reflection for Mathematical Reasoning (2024.emnlp-main)
Copied to clipboard
| Challenge: | Existing studies focus on *broadening* the training set with data augmentation techniques to maximize such benefits. |
| Approach: | They propose a method that embeds problem reflection into each training instance. |
| Outcome: | The proposed method enhances performance in standard and complex scenarios that require reflective thinking. |
A Technical Question Answering System with Transfer Learning (2020.emnlp-demos)
Copied to clipboard
| Challenge: | StackOverflow and AskUbuntu are popular open forum communities for technical question-answering, but it is expensive for human experts to provide timely and helpful responses. |
| Approach: | They develop a system that automatically responds to questions from a siamese ALBERT network based on previously answered questions . |
| Outcome: | The proposed system responds automatically to questions based on answers from previous users. |
Verifiable Format Control for Large Language Model Generations (2025.findings-naacl)
Copied to clipboard
| Challenge: | Existing methods focus on benchmarking general instruction following while overlooking how to improve specific format following ability for small LLMs. |
| Approach: | They propose to synthesize massive datasets to improve LLMs' format following abilities by using a verifiable format following feature. |
| Outcome: | The proposed method improves the format following ability of small LLMs with about 7B parameters. |
Tri-Train: Automatic Pre-Fine Tuning between Pre-Training and Fine-Tuning for SciNER (2020.findings-emnlp)
Copied to clipboard
| Challenge: | Pre-training a language model by self-supervised tasks on huge datasets and fine-tuning with small labelled data are often inadequate for scientific NER tasks. |
| Approach: | They propose to introduce a "pre-fine tuning" step between pre-training and fine-tuning to construct a corpus by selecting sentences from unlabeled documents that are the most relevant with labelled training data. |
| Outcome: | The proposed approach improves on seven benchmarks on the performance of the proposed model on labelled datasets. |
RAISE: Reinforced Adaptive Instruction Selection For Large Language Models (2025.findings-emnlp)
Copied to clipboard
Qingsong Lv, Yangning Li, Zihua Lan, Zishan Xu, Jiwei Tang, Tingwei Lu, Yinghui Li, Wenhao Jiang, Hong-Gee Kim, Hai-Tao Zheng, Philip S. Yu
| Challenge: | Existing selection methods rely on static, heuristic quality scores and are executed only once before training. |
| Approach: | They propose a dynamic selection framework that integrates selection into every training step. |
| Outcome: | The proposed framework integrates selection into every training step. |