Papers by Wenjie Wei
TURING: an Accurate and Interpretable Multi-Hypothesis Cross-Domain Natural Language Database Interface (2021.acl-demo)
Copied to clipboard
Peng Xu, Wenjie Zi, Hamidreza Shahidi, Ákos Kádár, Keyi Tang, Wei Yang, Jawad Ateeq, Harsh Barot, Meidan Alon, Yanshuai Cao
| Challenge: | Existing text-to-SQL semantic parsers cannot achieve high accuracy in cross-database setting . TURING is a NLDB system that can be used to democratize data-driven insights for non-technical users . |
| Approach: | They propose a TURING system that provides high-precision natural language explanations of SQL queries in a beam. |
| Outcome: | The proposed system achieves 75.1% execution accuracy and 78.3% top-5 beam execution accuracy on the Spider validation set. |
Optimizing Deeper Transformers on Small Datasets (2021.acl-long)
Copied to clipboard
Peng Xu, Dhruv Kumar, Wei Yang, Wenjie Zi, Keyi Tang, Chenyang Huang, Jackie Chi Kit Cheung, Simon J.D. Prince, Yanshuai Cao
| Challenge: | a common belief that training deep transformers from scratch requires large datasets is wrong . however, with proper initialization and optimization, the benefits of very deep transformer can carry over to challenging tasks with small datasets. |
| Approach: | They train 48 layers of transformers from pre-trained RoBERTa and 24 relation-aware layers from scratch. |
| Outcome: | The proposed scheme achieves state-of-the-art performance on a text-to-sql parsing benchmark . it uses 24 fine-tuned layers from pre-trained RoBERTa and 24 relation-aware layers from scratch . |
Cross-Domain Fake News Detection based on Dual-Granularity Adversarial Training (2025.coling-main)
Copied to clipboard
| Challenge: | Existing approaches to detect fake news in unseen domains are limited by domain-specific training. |
| Approach: | They propose a cross-domain fake news detection method based on adversarial training . they use a document-level and entity-level model to generate domain-independent representations . |
| Outcome: | The proposed method can detect fake news in unseen domains with the help of pre-trained language models. |
Instruct Once, Chat Consistently in Multiple Rounds: An Efficient Tuning Framework for Dialogue (2024.acl-long)
Copied to clipboard
| Challenge: | Tuning language models for dialogue generation has been a prevalent paradigm for building capable dialogue agents. |
| Approach: | They propose a multi-round interactive dialogue tuning framework that models the speaker roles of agent and user separately. |
| Outcome: | The proposed framework performs superior to fine-tuning and improves dialogue consistency. |
Reasoning in the Dark: Interleaved Vision-Text Reasoning in Latent Space (2026.findings-acl)
Copied to clipboard
| Challenge: | Existing multimodal reasoning methods depend on explicit reasoning steps that require labor-intensive vision-text annotations and inherently introduce significant inference latency. |
| Approach: | They propose a method that integrates visual and visual information into the reasoning process to improve the performance of multimodal LLMs. |
| Outcome: | The proposed method achieves an average performance increase of 5.45% while achieving a speed increase of over 5 times compared to existing methods. |
Retrieve, Rerank and Rewrite: Soft Template Based Neural Summarization (P18-1)
Copied to clipboard
| Challenge: | Existing summarization systems rely on the source text to generate summaries, which tends to work unstably. |
| Approach: | They propose to use existing summaries as soft templates to guide the seq2seq model . they use a popular IR platform to Retrieve proper summary as candidate templates . |
| Outcome: | The proposed model outperforms state-of-the-art models in terms of informativeness and readability. |
RiskLab: A Controlled Toolkit for Probing Emergent Risks in LLM-Based Multi-Agent Systems (2026.acl-demo)
Copied to clipboard
Yu Jiang, Wenjie Wang, Yue Huang, Yanbo Wang, Zhenhong Zhou, Xiuying Chen, Yang Liu, Pin-Yu Chen, Wei Wang, Xiangliang Zhang
| Challenge: | Recent advances in large language model (LLM) agents have accelerated deployment of multi-agent systems for complex tasks. |
| Approach: | They propose an open-source toolkit for instantiating, probing, and measuring emergent risks in LLM-based multi-agent systems under controlled conditions. |
| Outcome: | The proposed toolkit is based on a structured topology–environment–protocol–agent–task quintuple enabling reproducible studies of how communication structure, coordination mechanisms, and incentives shape system-level risks. |
Query and Output: Generating Words by Querying Distributed Word Representations for Paraphrase Generation (N18-1)
Copied to clipboard
| Challenge: | Existing models tend to memorize words instead of learning meaning of words . existing models tend not to model semantic information, resulting in incorrect sentences . |
| Approach: | They propose a novel model that generates words by querying distributed word representations . they evaluate model on two paraphrase-oriented tasks, namely text simplification and short abstractive summarization . |
| Outcome: | The proposed model outperforms the baseline model on two paraphrase-oriented tasks . it achieves state-of-the-art performance on these benchmark datasets . |
The Evolution of Thought: Tracking LLM Overthinking via Reasoning Dynamics Analysis (2026.acl-long)
Copied to clipboard
Zihao Wei, Liang Pang, Jiahao Liu, Wenjie Shi, Jingcheng Deng, Shicheng Xu, Zenghao Duan, Jingang Wang, Fei Sun, Huawei Shen, Xueqi Cheng
| Challenge: | Explicit reasoning trajectories increase performance but often trigger overthinking . despite its importance, this study examines how each step of reasoning affects the final outcome . |
| Approach: | They propose a Reasoning Completion Point Detector that detects the RCP by monitoring rank dynamics of termination tokens. |
| Outcome: | The proposed method reduces token usage by up to 44% while preserving accuracy. |
Multiview Identifiers Enhanced Generative Retrieval (2023.acl-long)
Copied to clipboard
| Challenge: | Current approaches use a numeric ID or text piece as the identifier, but these identifieres cannot cover a passage’s content well. |
| Approach: | They propose a new type of identifier that is generated based on the content of a passage and could integrate contextualized information that text pieces lack. |
| Outcome: | The proposed approach performs the best in generative retrieval on three public datasets. |
Agent-based Substructure Counting under Local Differential Privacy (2026.acl-long)
Copied to clipboard
| Challenge: | Recent studies have demonstrated the ability of Large Language Models (LLMs) to process graph problems. |
| Approach: | They propose to decompose substructure counting into node-level tasks distributed among node agents and embed the knowledge of distributed algorithms and DP frameworks in the curator agent and privacy controller. |
| Outcome: | Extensive experiments on 6 real-world datasets validate the effectiveness of the proposed framework for substructure counting tasks under edge local differential privacy (LDP). |