Papers by Zhiyong Wu
Unsupervised Multi-scale Expressive Speaking Style Modeling with Hierarchical Context Information for Audiobook Speech Synthesis (2022.coling-1)
Copied to clipboard
| Challenge: | a recent study has shown that expressiveness of audiobooks is limited by the averaged global-scale speaking style representation. |
| Approach: | They propose an unsupervised multi-scale context-sensitive text-to-speech model for audiobooks . they use hierarchical context encoder to predict global-scale contextual style embeddings . |
| Outcome: | The proposed model outperforms existing models on a real-world Mandarin audio dataset. |
Can We Edit Factual Knowledge by In-Context Learning? (2023.emnlp-main)
Copied to clipboard
| Challenge: | In-context knowledge editing (IKE) is a new paradigm for NLP research that can be applied to large language models with tens or hundreds of parameters. |
| Approach: | They propose to use in-context knowledge editing (IKE) without gradient updating to edit factual knowledge without a gradient update. |
| Outcome: | The proposed method achieves a competitive success rate compared to gradient-based methods on GPT-J but with fewer side effects. |
SeeClick: Harnessing GUI Grounding for Advanced Visual GUI Agents (2024.acl-long)
Copied to clipboard
| Challenge: | Existing GUI agents interact with the environment through extracted structured data, which can be notably lengthy (e.g., HTML) and occasionally inaccessible (e-book). |
| Approach: | They propose to enhance SeeClick with GUI grounding pre-training and devise a method to automate curation of GUI ground data. |
| Outcome: | The proposed agent improves ScreenSpot, the first realistic GUI grounding benchmark that encompasses mobile, desktop, and web environments. |
Self-Adaptive In-Context Learning: An Information Compression Perspective for In-Context Example Selection and Ordering (2023.acl-long)
Copied to clipboard
| Challenge: | In-context learning is a common practice to randomly sample examples to serve as context. |
| Approach: | They propose a new principle for in-context learning that helps each sample find an in-constitut example organization that can derive the correct prediction. |
| Outcome: | The proposed method achieves 40% relative improvement over the common practice setting. |
Automated Peer Reviewing in Paper SEA: Standardization, Evaluation, and Analysis (2024.findings-emnlp)
Copied to clipboard
Jianxiang Yu, Zichen Ding, Jiaqi Tan, Kangyang Luo, Zhenmin Weng, Chenghua Gong, Long Zeng, RenJing Cui, Chengcheng Han, Qiushi Sun, Zhiyong Wu, Yunshi Lan, Xiang Li
| Challenge: | Existing approaches to review scientific papers are limited by their content or quality . SEA is a framework for automated scientific review, but its contents are generic or partial. |
| Approach: | They propose a framework for automated scientific review using large language models . they propose to use a standardized review dataset to fine-tune an LLM to generate high-quality reviews. |
| Outcome: | The proposed framework can generate high-quality reviews from standardized datasets and improves on the existing feedback mechanisms. |
Learning Disentangled Semantic Representations for Zero-Shot Cross-Lingual Transfer in Multilingual Machine Reading Comprehension (2022.acl-long)
Copied to clipboard
| Challenge: | Existing methods to zero-shot transfer knowledge from rich-resource to low-resourced languages are limited due to linguistic discrepancies in different languages. |
| Approach: | They propose a multilingual MRC framework equipped with a Siamese Semantic Disentanglement Model to disassociate semantics from syntax in models learned by multilingual pre-trained models. |
| Outcome: | The proposed model disassociates semantics from syntax in multilingual models. |
FERNet: Fine-grained Extraction and Reasoning Network for Emotion Recognition in Dialogues (2020.aacl-main)
Copied to clipboard
| Challenge: | Existing methods for emotion recognition in dialogues do not consider the content of the target utterance. |
| Approach: | They propose to model historical utterances without considering the content of the target utterant . they propose to use a fine-grained reasoning network to generate target-specific historical . |
| Outcome: | The proposed method achieves competitive performance compared with previous methods. |
Genius: A Generalizable and Purely Unsupervised Self-Training Framework For Advanced Reasoning (2025.acl-long)
Copied to clipboard
Fangzhi Xu, Hang Yan, Chang Ma, Haiteng Zhao, Qiushi Sun, Kanzhi Cheng, Junxian He, Jun Liu, Zhiyong Wu
| Challenge: | Existing methods for enhancing LLM reasoning rely on supervisory signals . current methods rely heavily on outcome supervision and auxiliary reward models . |
| Approach: | They propose a gen-eralizable and purely unsupervised self-training framework to enhance LLM reasoning without supervision. |
| Outcome: | The proposed framework improves LLM reasoning without supervision without external supervision. |
How Vocabulary Sharing Facilitates Multilingualism in LLaMA? (2024.findings-acl)
Copied to clipboard
| Challenge: | Large Language Models (LLMs) show strong performance on English tasks, but their performance in other languages is limited. |
| Approach: | They conducted an exhaustive analysis of the multilingual capability of LLMs by examining the performance gap before and after embedding fine-tuning across 101 languages. |
| Outcome: | The proposed model improves on the attributes of four quadrants in the model and provides actionable and efficient guidelines for tuning these languages. |
LLM as Prompter: Low-resource Inductive Reasoning on Arbitrary Knowledge Graphs (2024.findings-acl)
Copied to clipboard
| Challenge: | Knowledge Graph (KG) inductive reasoning is widely adopted in various applications. |
| Approach: | They propose a framework for low-resource inductive reasoning using Large Language Models to generate a graph-structural prompt for pre-trained KGs. |
| Outcome: | The proposed framework outperforms previous methods in three-shot, one-shot and zero-shot reasoning tasks. |
OS-Genesis: Automating GUI Agent Trajectory Construction via Reverse Task Synthesis (2025.acl-long)
Copied to clipboard
Qiushi Sun, Kanzhi Cheng, Zichen Ding, Chuanyang Jin, Yian Wang, Fangzhi Xu, Zhenyu Wu, Chengyou Jia, Liheng Chen, Zhoumianze Liu, Ben Kao, Guohao Li, Junxian He, Yu Qiao, Zhiyong Wu
| Challenge: | Graphical User Interface (GUI) agents powered by Vision-Language Models (VLMs) have demonstrated human-like computer control capability. |
| Approach: | They propose a GUI data synthesis pipeline that reverse engineers GUI trajectory construction process by executing pre-defined tasks. |
| Outcome: | The proposed GUI data synthesis pipeline overcomes the bottlenecks of previous methods that rely on pre-defined tasks and limited data diversity. |
Good for Misconceived Reasons: An Empirical Revisiting on the Need for Visual Context in Multimodal Machine Translation (2021.acl-long)
Copied to clipboard
| Challenge: | Recent studies report improvements when equipping models with multimodal information, but it remains unclear whether such improvements actually come from the multimodal part. |
| Approach: | They propose to extend conventional text-only translation models with multimodal information by extending them with visual input. |
| Outcome: | The proposed models replicate similar gains as recently developed multimodal-integrated systems achieved, but learn to ignore multimodal information. |
Symbol-LLM: Towards Foundational Symbol-centric Interface For Large Language Models (2024.acl-long)
Copied to clipboard
| Challenge: | Large Language Models (LLMs) have limitations when it comes to comprehending and expressing world knowledge that extends beyond the boundaries of natural language. |
| Approach: | They propose a model that integrates symbolic data into LLM training without loss of generality ability. |
| Outcome: | The proposed model performs better on symbol- and NL-centric tasks. |
A Survey on In-context Learning (2024.emnlp-main)
Copied to clipboard
Qingxiu Dong, Lei Li, Damai Dai, Ce Zheng, Jingyuan Ma, Rui Li, Heming Xia, Jingjing Xu, Zhiyong Wu, Baobao Chang, Xu Sun, Lei Li, Zhifang Sui
| Challenge: | In-context learning (ICL) is a new paradigm for natural language processing . large language models (LLMs) demonstrate the ability to learn from a few examples . |
| Approach: | They propose to explore ICL to evaluate and extrapolate the ability of large language models. |
| Outcome: | The proposed methods can be used to evaluate and extrapolate the ability of large language models. |
Perturbed Masking: Parameter-free Probing for Analyzing and Interpreting BERT (2020.acl-main)
Copied to clipboard
| Challenge: | Recent pre-trained language models achieve state-of-the-art performance for downstream NLP tasks. |
| Approach: | They propose a parameter-free probing technique for analyzing pre-trained language models . their method does not require direct supervision from probing tasks . |
| Outcome: | The proposed method improves on linguistically-uninformed baselines on pre-trained language models. |
Truth or Sophistry? LoFa: A Benchmark for LLM Robustness Against Logical Fallacies (2026.acl-long)
Copied to clipboard
| Challenge: | Prior work has focused on the ability of Large Language Models to **identify** or **classify** fallacies, but their robustness against these fallacias in persuasive contexts remains largely unexplored. |
| Approach: | They propose a new metric to assess LLM robustness against fallacies by pairing factual questions with fallacious arguments and developing a multi-round debate framework to assess model resilience. |
| Outcome: | The proposed metric disentangles robustness from a model’s knowledge limitations and demonstrates unique vulnerability profiles across models. |
Explanation Regeneration via Information Bottleneck (2023.findings-acl)
Copied to clipboard
| Challenge: | Recent work builds on prompt engineering to generate free-text explanations without specific training, but they lack sufficiency and conciseness due to the prompt complexity and hallucination issues. |
| Approach: | They propose to generate explanations via the information bottleneck theory by polishing the single-pass output of large pretrained language models but retaining the information that supports the contents being explained by balancing two information bottle neck objectives. |
| Outcome: | The proposed explanations are based on the information bottleneck theory . they are able to explain black-box predictions naturally and accurately . |
Interactive Evolution: A Neural-Symbolic Self-Training Framework For Large Language Models (2025.acl-long)
Copied to clipboard
| Challenge: | Existing methods to fine-tune Large Language Models without human annotations are lacking in the field of natural language training. |
| Approach: | They propose an environment-guided neural-symbolic self-training framework to overcome two main challenges: the scarcity of symbolic data and the limited proficiency of LLMs in processing symbolic language. |
| Outcome: | The proposed framework overcomes two main challenges: the scarcity of symbolic data, and the limited proficiency of LLMs in processing symbolic language. |
Causal Intervention for Mitigating Name Bias in Machine Reading Comprehension (2023.findings-acl)
Copied to clipboard
| Challenge: | Existing MRC models may overuse name information to make predictions, causing name bias . |
| Approach: | They propose a Causal Interventional paradigm for MRC to mitigate name bias by analyzing pre-trained knowledge and context representations. |
| Outcome: | The proposed model is robust to names and performs competitively on the original SQuAD. |
Re-embedding Difficult Samples via Mutual Information Constrained Semantically Oversampling for Imbalanced Text Classification (2021.emnlp-main)
Copied to clipboard
| Challenge: | Existing frameworks for imbalanced text classification can generate anchor instances for difficult samples . difficult samples are hard to classify as they are embedded into an overlapping semantic region with the majority class. |
| Approach: | They propose a Mutual Information constrained Semantically Oversampling framework that generates anchor instances for difficult samples to help the backbone network determine the re-embedding position of a non-overlapping representation. |
| Outcome: | The proposed framework can generate anchor instances to help classifiers achieve significant improvements over baselines on a variety of imbalanced text classification tasks. |
OS-Sentinel: Towards Safety-Enhanced Mobile GUI Agents via Hybrid Validation in Realistic Workflows (2026.acl-long)
Copied to clipboard
Qiushi Sun, Mukai Li, Zhoumianze Liu, Zhihui Xie, Fangzhi Xu, Zhangyue Yin, Kanzhi Cheng, Zehao Li, Zichen Ding, Qi Liu, Zhiyong Wu, Zhuosheng Zhang, Ben Kao, Lingpeng Kong
| Challenge: | Existing methods for detecting unsafe mobile GUI agents are underexplored. |
| Approach: | They propose a mobile agent safety detection framework that integrates a formal verifier and a VLM-based contextual judge to detect system-level violations. |
| Outcome: | The proposed framework achieves 10%–30% improvements over existing approaches across multiple metrics. |
ZeroGen: Efficient Zero-shot Learning via Dataset Generation (2022.emnlp-main)
Copied to clipboard
| Challenge: | Existing approaches to generate training data with pre-trained language models have been found effective in various scenarios. |
| Approach: | They propose an unsupervised zero-shot learning method that generates a dataset from scratch and trains a tiny task model under supervision of the synthesized dataset. |
| Outcome: | The proposed method is annotated-free and efficient, but can provide useful insights from the perspective of data-free model-agnostic knowledge distillation and unreferenced text generation evaluation. |
Lexical Knowledge Internalization for Neural Dialog Generation (2022.acl-long)
Copied to clipboard
| Challenge: | Existing knowledge-grounded dialog models ignore the knowledge that resides in people's minds during a conversation. |
| Approach: | They propose to integrate lexical knowledge internally into the model's parameters instead of further conditioning them on external knowledge . they adopt contrastive learning approach and use a dictionary-based token-level lexicon retriever that requires only weak supervision. |
| Outcome: | The proposed model can relate J.K Rowling to Khalsa Aid with the knowledge retrieved from Wikipedia. |
Learning from Multiple Noisy Augmented Data Sets for Better Cross-Lingual Spoken Language Understanding (2021.emnlp-main)
Copied to clipboard
| Challenge: | Existing approaches to scale out spoken language understanding to low-resource languages are noisy. |
| Approach: | They propose a method for mitigating noise in augmented data by training models with augmented datasets. |
| Outcome: | The proposed method outperforms state-of-the-art methods on two benchmark datasets. |
Cascaded Head-colliding Attention (2021.acl-long)
Copied to clipboard
| Challenge: | Existing frameworks for natural language processing ignore interactions among different heads, which wastes the capacity of the model. |
| Approach: | They propose a model which explicitly models interactions between attention heads through a hierarchical variational distribution. |
| Outcome: | The proposed model outperforms the baseline model on Wikitext-103 and WMT14 EN-DE on language modeling and translation tasks. |
CoLo: A Contrastive Learning Based Re-ranking Framework for One-Stage Summarization (2022.coling-1)
Copied to clipboard
| Challenge: | Existing methods for extractive and abstractive summarization use token-level or sentence-level training objectives. |
| Approach: | They propose a Contrastive Learning based re-ranking framework for one-stage summarization called CoLo. |
| Outcome: | The proposed framework boosts extractive and abstractive results on CNN/DailyMail benchmarks while maintaining inference efficiency. |
AgentStore: Scalable Integration of Heterogeneous Agents As Specialized Generalist Computer Assistant (2025.findings-acl)
Copied to clipboard
| Challenge: | Existing agents lack generalization and specialization capabilities for open-ended tasks . specialized generalists are often underdeveloped in real-world environments . |
| Approach: | They propose a platform to dynamically integrate heterogeneous agents for automating computer tasks . they propose specialized generalist agent MetaAgent with the AgentToken strategy . |
| Outcome: | The proposed platform expands capabilities of existing agents in generalization and specialization . it can be used to automate open-ended tasks in real-world environments . |
DiffuSeq-v2: Bridging Discrete and Continuous Text Spaces for Accelerated Seq2Seq Diffusion Models (2023.findings-emnlp)
Copied to clipboard
| Challenge: | Existing approaches to text generation use discrete text within a continuous diffusion space, which incurs substantial computational overhead during training and results in slower sampling speeds. |
| Approach: | They propose a soft absorbing state that facilitates diffusion models in learning to reconstruct discrete mutations based on the underlying Gaussian space. |
| Outcome: | The proposed method accelerates training convergence by 4x and generates samples of similar quality 800x faster, rendering it closer to practical application. |
UniSRM: A Unified Speech Reward Model for Reasoning-Based Fine-grained Assessment (2026.acl-long)
Copied to clipboard
| Challenge: | Existing methods for speech generation rely on subjective, expensive judgments . Existing models only cover a narrow set of scenarios and only provide limited coverage . |
| Approach: | They propose a unified speech reward model that can support multi-dimensional, interpretable reward signals with reliable reasoning. |
| Outcome: | The proposed model can support multi-dimensional, interpretable reward signals with reliable reasoning. |
𝜙-Decoding: Adaptive Foresight Sampling for Balanced Inference-Time Exploration and Exploitation (2025.acl-long)
Copied to clipboard
| Challenge: | Existing inference-time optimization strategies address the shortsightedness of auto-regressive generation, but the vast search space leads to excessive exploration and insufficient exploitation. |
| Approach: | They propose a decoding strategy that approximates two distributions via foresight and clustering to provide an efficient estimation of step value. |
| Outcome: | The proposed decoding strategy outperforms strong baselines in performance and efficiency. |
An Event-based Abductive Learning for Hard Time-sensitive Question Answering (2024.lrec-main)
Copied to clipboard
| Challenge: | Existing time-sensitive question answering models are limited for hard time-sensitive questions whose time qualifiers are implicit in the document. |
| Approach: | They propose a time-sensitive question answering framework that matches temporal events in documents with time qualifiers. |
| Outcome: | The proposed model outperforms baseline models for hard time-sensitive questions with 12.7% improvement in EM scores. |
OpenICL: An Open-Source Framework for In-context Learning (2023.acl-demo)
Copied to clipboard
| Challenge: | In-context Learning (ICL) is a new paradigm for large language model evaluation. |
| Approach: | They propose an open-source toolkit for ICL and LLM evaluation. |
| Outcome: | The proposed framework is highly flexible and flexible and can be easily combined with other tools to suit users' needs. |
ProGen: Progressive Zero-shot Dataset Generation via In-context Feedback (2022.findings-emnlp)
Copied to clipboard
| Challenge: | Recent work on dataset-generation-based zero-shot learning has shown promising results by training a task-specific model with a dataset synthesized from large pre-trained language models (PLMs). |
| Approach: | They propose a progressive zero-shot dataset generation framework which leverages feedback from the task-specific model to guide the generation of new training data via in-context examples. |
| Outcome: | The proposed framework achieves on-par or superior performance with only 1% synthetic dataset size, when compared to baseline methods without in-context feedback. |