Papers by Jiahai Wang
Disentangling Reasoning Capabilities from Language Models with Compositional Reasoning Transformers (2023.findings-acl)
Copied to clipboard
| Challenge: | ReasonFormer is a unified reasoning framework for complex decision-making . it is based on the dual-process theory of cognitive science, where two cognitive systems interact to form a whole reasoning process. |
| Approach: | They propose a unified reasoning framework that mirrors the modular reasoning process of humans . they decouple the representation module and the reasoning modules to capture different levels of cognition . |
| Outcome: | The proposed framework shows that humans can perform better in complex decision-making tasks. |
UserAdapter: Few-Shot User Learning in Sentiment Analysis (2021.findings-acl)
Copied to clipboard
| Challenge: | Adapting a model to a handful of personalized data is challenging, authors say . standard fine-tuning requires hundreds of millions of parameters for each user . |
| Approach: | They propose a lightweight method that clamps millions of parameters of a Transformer model and optimizes a tiny user-specific vector. |
| Outcome: | The proposed method improves accuracy on Yelp and IMDB datasets and reduces the number of parameters added for each user. |
Chain-of-Relations: Faithful and Efficient LLM Reasoning over Knowledge Graphs via Relation-Centric Exploration (2026.findings-acl)
Copied to clipboard
| Challenge: | Existing methods adopt entity-centric exploration that incrementally constructs reasoning paths by selecting and connecting intermediate entities. |
| Approach: | They propose to use relation-centric exploration to construct reasoning paths by selecting and connecting intermediate entities and to reduce the dependence on entity completeness. |
| Outcome: | The proposed method outperforms baselines on three benchmark datasets in both F1 score and KG-grounded Rate. |
ProQA: Structural Prompt-based Pre-training for Unified Question Answering (2022.naacl-main)
Copied to clipboard
Wanjun Zhong, Yifan Gao, Ning Ding, Yujia Qin, Zhiyuan Liu, Ming Zhou, Jiahai Wang, Jian Yin, Nan Duan
| Challenge: | Existing QA research on question answering is focused on specific question types, knowledge domains, or reasoning skills. |
| Approach: | They propose a unified QA paradigm that solves various tasks through a single model. |
| Outcome: | The proposed model improves QA-centric ability on 11 QA benchmarks. |
Democratizing Reasoning Ability: Tailored Learning from Large Language Model (2023.emnlp-main)
Copied to clipboard
Zhaoyang Wang, Shaohan Huang, Yuxuan Liu, Jiahai Wang, Minghui Song, Zihan Zhang, Haizhen Huang, Furu Wei, Weiwei Deng, Feng Sun, Qi Zhang
| Challenge: | Large language models (LLMs) exhibit impressive emergent abilities in natural language processing, but their democratization is hindered due to huge computation requirements and closed-source nature. |
| Approach: | They propose a tailored learning approach to distill the exclusive reasoning ability to smaller LMs to facilitate democratization. |
| Outcome: | The proposed approach enables the democratization of the exclusive reasoning ability by leveraging the black-box model as a reasoning teacher. |
UECA-Prompt: Universal Prompt for Emotion Cause Analysis (2022.coling-1)
Copied to clipboard
| Challenge: | Existing methods adopt fine-tuning paradigm to solve certain types of ECA tasks. Existing models suffer from dataset bias. |
| Approach: | They propose a universal prompt tuning method to solve different ECA tasks in a unified framework and a sequential learning module to ease the dataset bias. |
| Outcome: | The proposed method achieves competitive performance on the ECA datasets. |
RMLM: A Flexible Defense Framework for Proactively Mitigating Word-level Adversarial Attacks (2023.acl-long)
Copied to clipboard
| Challenge: | Existing defenses focus on improving robustness of the victim model in training, but neglect to mitigate adversarial attacks during inference. |
| Approach: | They propose a framework that confuses attackers and corrects adversarial contexts . their framework helps improve the robustness of the victim model during inference . |
| Outcome: | The proposed framework improves the robustness of the victim model in training . it also corrects abnormal contexts in the representation level and filtering out examples . |
Reasoning Over Semantic-Level Graph for Fact Checking (2020.acl-main)
Copied to clipboard
| Challenge: | Existing methods for fact checking use string concatenation or fusing features of isolated evidence sentences. |
| Approach: | They propose a method suitable for reasoning about the semantic-level structure of evidence . they use graph convolutional network and graph attention network to exploit the structure . |
| Outcome: | The proposed method improves claim verification accuracy and FEVER score on a benchmark dataset. |
GroupRank: A Groupwise Paradigm for Effective and Efficient Passage Reranking with LLMs (2026.findings-acl)
Copied to clipboard
Meixiu Long, Duolin Sun, Dan Yang, Yihan Jiao, Lei Liu, Jiahai Wang, Binbin Hu, Yue Shen, Jie Feng, Zhehao Tan, Junjie Wang, Lianzhen Zhong, Jian Wang, Peng Wei, Jinjie Gu
| Challenge: | Existing rankers excel in lexical-matching scenarios, while they struggle with complex queries requiring deep reasoning. |
| Approach: | They propose a new paradigm that balances flexibility and context awareness to unlock the full potential of groupwise reranking. |
| Outcome: | The proposed approach achieves a state-of-the-art 65.2 NDCG@10 on BRIGHT and surpasses baselines by 2.1 points on R2MED while delivering a 6.4 inference speedup. |
Multi-choice Relational Reasoning for Machine Reading Comprehension (2020.coling-main)
Copied to clipboard
| Challenge: | cloze-style reading comprehension is a task that requires much semantic understanding and reasoning using various clues from texts. |
| Approach: | They propose a multi-choice relational reasoning model that emulates human reading comprehension by combining fusion representations of document, query and candidates. |
| Outcome: | The proposed model outperforms baseline models significantly on four datasets. |
Analytical Reasoning of Text (2022.findings-naacl)
Copied to clipboard
Wanjun Zhong, Siyuan Wang, Duyu Tang, Zenan Xu, Daya Guo, Yining Chen, Jiahai Wang, Jian Yin, Ming Zhou, Nan Duan
| Challenge: | Existing models with implicit reasoning ability struggle to solve analytical reasoning of text. |
| Approach: | They propose an approach to analyze text and use it to perform reasoning over it. |
| Outcome: | The proposed approach outperforms pre-trained models on an analysis of the Law School Admission Test dataset. |
Neural Deepfake Detection with Factual Structure of Text (2020.emnlp-main)
Copied to clipboard
| Challenge: | Existing approaches to deepfake detection typically represent documents with coarse-grained representations, but they struggle to capture factual structures of documents. |
| Approach: | They propose a graph-based model that captures factual structures of documents for deepfake detection. |
| Outcome: | The proposed model improves strong base models built with RoBERTa on two public deepfake datasets. |
LogicalFactChecker: Leveraging Logical Operations for Fact Checking with Graph Module Network (2020.acl-main)
Copied to clipboard
Wanjun Zhong, Duyu Tang, Zhangyin Feng, Nan Duan, Ming Zhou, Ming Gong, Linjun Shou, Daxin Jiang, Jiahai Wang, Jian Yin
| Challenge: | Existing methods for fact checking textual statements are not yet available. |
| Approach: | They propose a neural network approach capable of leveraging logical operations for fact checking . they use a textual statement and semi-structured tables to generate a program from it . |
| Outcome: | The proposed approach achieves state-of-the-art performance on TABFACT dataset . it derives a program (a.k.a. logical form) of the statement in semantic parsing manner . |
Policy-Guided Stepwise Action Planning for Controllable LLM Reasoning (2026.findings-acl)
Copied to clipboard
| Challenge: | Existing approaches to steering large language model reasoning via high-level reasoning actions fail to outperform standard generation because planners tend to degenerate into repetitive loops or fixed patterns. |
| Approach: | They propose a planner-executor framework that learns to select reasoning actions dynamically while keeping the executor LLM fully frozen. |
| Outcome: | The proposed framework outperforms existing paradigms by preserving the executor LLM frozen . PG-HAP improves accuracy over strong baselines while producing less redundant, more adaptive trajectories. |