Papers by Zhiqiang Hu
MaPPER: Multimodal Prior-guided Parameter Efficient Tuning for Referring Expression Comprehension (2024.emnlp-main)
Copied to clipboard
| Challenge: | Existing methods for Referring Expression Comprehension (REC) lack specific domain abilities for precise local visual perception and visual-language alignment. |
| Approach: | They propose a framework for Parameter-Efficient Transfer Learning to localize a visual region via natural language using a prior-guided prior. |
| Outcome: | The proposed framework achieves the best accuracy compared to the current methods with only 1.41% tunable backbone parameters. |
Learning to Plan for Retrieval-Augmented Large Language Models from Knowledge Graphs (2024.findings-emnlp)
Copied to clipboard
Junjie Wang, Mingyang Chen, Binbin Hu, Dan Yang, Ziqi Liu, Yue Shen, Peng Wei, Zhiqiang Zhang, Jinjie Gu, Jun Zhou, Jeff Pan, Wen Zhang, Huajun Chen
| Challenge: | Recent studies have attempted to enhance the performance of large language models (LLMs) in complex question-answering (QA) tasks by combining step-wise planning with external retrieval. |
| Approach: | They propose a framework for enhancing LLMs’ planning capabilities by using planning data derived from knowledge graphs (KGs). |
| Outcome: | The proposed framework improves LLMs’ planning capabilities by using knowledge graphs (KGs) the proposed framework is compared with existing frameworks on multiple datasets and shows that it is effective for large language models. |
CoMoE: Contrastive Representation for Mixture-of-Experts in Parameter-Efficient Fine-tuning (2025.findings-emnlp)
Copied to clipboard
| Challenge: | Currently, mixture-of-experts (MoE) is underutilized on heterogeneous datasets, ignoring the fact that experts may learn similar knowledge. |
| Approach: | They propose a method to promote modularization and specialization in MoE by specializing functionalities into different experts and sparsely activating them appropriately. |
| Outcome: | The proposed method improves the capacity and specialization of mixture-of-experts (MoE) by sampling from activated and inactivated experts in top-k routing. |
LLM-Adapters: An Adapter Family for Parameter-Efficient Fine-Tuning of Large Language Models (2023.emnlp-main)
Copied to clipboard
Zhiqiang Hu, Lei Wang, Yihuai Lan, Wanyu Xu, Ee-Peng Lim, Lidong Bing, Xing Xu, Soujanya Poria, Roy Lee
| Challenge: | Large language models (LLMs) have shown unprecedented performance across various tasks. |
| Approach: | They propose an easy-to-use framework that integrates adapters into LLMs . they evaluate adapters on 14 datasets from two different reasoning tasks . |
| Outcome: | The proposed framework can be used to fine-tune open-access language models with task-specific data and instruction data. |
All That Glitters is Not Gold: Improving Robust Retrieval-Augmented Language Models with Fact-Centric Preference Alignment (2025.findings-acl)
Copied to clipboard
| Challenge: | Existing methods to learn adaptive retrieval for noisy documents lack prior filtering and may lead to the loss of crucial information. |
| Approach: | They propose a method to improve retrieval performance without prior filtering . they use LLMs self-generated synthetic data as training data without manual annotation . |
| Outcome: | The proposed method performs positive document mining based on factual consistency and uses LLMs self-generated synthetic data as training data without manual annotation. |
Math-LLaVA: Bootstrapping Mathematical Reasoning for Multimodal Large Language Models (2024.findings-emnlp)
Copied to clipboard
| Challenge: | Existing image instruction fine-tuning datasets do not fully exploit visual information to enhance multimodal reasoning capabilities of Large language models (LLMs). |
| Approach: | They propose a LLaVA-based model fine-tuned with MathV360K to bridge this gap by collecting 40K high-quality images with question-answer pairs from 24 existing datasets and synthesizing 320K new pairs. |
| Outcome: | The proposed model improves the multimodal reasoning capabilities of LLaVA-1.5 and demonstrates enhanced generalizability on the MMMU benchmark. |
Adapter-TST: A Parameter Efficient Method for Multiple-Attribute Text Style Transfer (2023.findings-emnlp)
Copied to clipboard
| Challenge: | Existing studies explore performing text style transfer on attributes like age, gender, formality, politeness, and formality. |
| Approach: | They propose a framework that freezes the pre-trained model’s original parameters and enables the development of a multiple-attribute text style transfer model. |
| Outcome: | The proposed model outperforms state-of-the-art models on sentiment transfer and multiple-attribute transfer tasks with significantly less computational resources. |
SuperWriter: Reflection-Driven Long-Form Generation with Large Language Models (2026.findings-acl)
Copied to clipboard
| Challenge: | Long-form text generation remains a challenge for large language models . generating extended sequences often leads to degraded coherence and logical consistency . |
| Approach: | They propose a framework that integrates explicit structured thinking into long-form text generation. |
| Outcome: | The proposed framework surpasses even larger-scale models in evaluation and human evaluation. |
LLM-Based Agent Society Investigation: Collaboration and Confrontation in Avalon Gameplay (2024.emnlp-main)
Copied to clipboard
Yihuai Lan, Zhiqiang Hu, Lei Wang, Yang Wang, Deheng Ye, Peilin Zhao, Ee-Peng Lim, Hui Xiong, Hao Wang
| Challenge: | Existing studies on LLM agents' social behaviors are lacking . previous studies focused on positive social behaviors, leaving research on negative social behaviors relatively scarce. |
| Approach: | They propose a framework that features a multi-agent system facilitating efficient communication and interaction with LLM agents. |
| Outcome: | The proposed framework is based on Avalon and evaluates on game success and analyzes agents’ social behaviors. |
Plan-and-Solve Prompting: Improving Zero-Shot Chain-of-Thought Reasoning by Large Language Models (2023.acl-long)
Copied to clipboard
| Challenge: | Large language models (LLMs) have recently been shown to deliver impressive performance in various NLP tasks. |
| Approach: | They propose a plan-and-solve (PS) prompting that includes a few manual steps to generate reasoning steps and improves the quality of generated reasoning steps. |
| Outcome: | The proposed strategy outperforms Zero-shot-CoT on ten reasoning problems and has comparable performance to 8-shot CoT prompting on the math reasoning problem. |
Have We Designed Generalizable Structural Knowledge Promptings? Systematic Evaluation and Rethinking (2025.acl-long)
Copied to clipboard
Yichi Zhang, Zhuo Chen, Lingbing Guo, Yajing Xu, Shaokai Chen, Mengshu Sun, Binbin Hu, Zhiqiang Zhang, Lei Liang, Wen Zhang, Huajun Chen
| Challenge: | Existing methods to integrate external knowledge into LLMs focus on specific problems, lacking a comprehensive exploration of the generalization and capability boundaries of SKP. |
| Approach: | They propose a new paradigm for structural knowledge prompting to integrate external structural knowledge into LLMs by incorporating structural representations. |
| Outcome: | The proposed benchmark SUBARU enables the evaluation of the generalization capabilities of SKP from four perspectives. |
Optimal Expert-Attention Allocation in Mixture-of-Experts: A Scalable Law for Dynamic Model Design (2026.acl-industry)
Copied to clipboard
| Challenge: | a novel extension of neural scaling laws to Mixture-of-Experts models is proposed . a ratio of expert-attention compute is crucial for efficient MoE models . |
| Approach: | They propose an extension of neural scaling laws to Mixture-of-Experts (MoE) models . they define the ratio r as the fraction of total FLOPs per token dedicated to expert and attention layers . |
| Outcome: | The proposed model can be tuned beyond size and data with the proposed model. |
RAPO: An Adaptive Ranking Paradigm for Bilingual Lexicon Induction (2022.emnlp-main)
Copied to clipboard
Zhoujin Tian, Chaozhuo Li, Shuo Ren, Zhiqiang Zuo, Zengxuan Wen, Xinyue Hu, Xiao Han, Haizhen Huang, Denvy Deng, Qi Zhang, Xing Xie
| Challenge: | Existing approaches focus on minimizing distances between words in aligned pairs, while suffering from low discriminative capability to distinguish the relative orders between positive and negative candidates. |
| Approach: | They propose a ranking-oriented induction model to learn personalized mapping function for each word. |
| Outcome: | The proposed model can learn personalized mapping function for each word on public datasets including rich-resource and low-resourced languages. |
SeaLLMs - Large Language Models for Southeast Asia (2024.acl-demos)
Copied to clipboard
Xuan-Phi Nguyen, Wenxuan Zhang, Xin Li, Mahani Aljunied, Zhiqiang Hu, Chenhui Shen, Yew Ken Chia, Xingxuan Li, Jianyu Wang, Qingyu Tan, Liying Cheng, Guanzheng Chen, Yue Deng, Sen Yang, Chaoqun Liu, Hang Zhang, Lidong Bing
| Challenge: | Existing large language models favor high-resource languages, such as English, at the expense of low-resourced and regional languages. |
| Approach: | They propose a series of language models that specifically focuses on Southeast Asian languages. |
| Outcome: | SeaLLM models outperform ChatGPT-3.5 in non-Latin languages by large margins . linguistic disparity impedes access to state-of-the-art AI technologies for non-English-speaking populations . |
Unlocking General Long Chain-of-Thought Reasoning Capabilities of Large Language Models via Representation Engineering (2025.acl-long)
Copied to clipboard
| Challenge: | Existing work finds that long CoT reasoning can be efficiently elicited by tuning on only a few examples and can easily transfer to other tasks. |
| Approach: | They propose a representation engineering method to unleash the general long CoT reasoning capabilities of LLMs. |
| Outcome: | The proposed method is effective in in-domain and cross-domain scenarios. |
From Style to Story: A Curriculum Learning Approach for Imitative Novel Generation (2026.findings-acl)
Copied to clipboard
| Challenge: | Novels create rich, immersive worlds with intricate plots and distinct styles, captivating readers through complex storytelling. |
| Approach: | They propose a novel generation system that imitates novel elements by predicting plot developments and writing concrete details using vivid, expressive language. |
| Outcome: | The novel imitative novel generation system is trained through a curriculum learning paradigm, progressing from low-level stylistic mastery to high-level narrative coherence. |
Who Wrote it and Why? Prompting Large-Language Models for Authorship Verification (2023.findings-emnlp)
Copied to clipboard
| Challenge: | Existing AV techniques, including stylometric and deep learning, face limitations in terms of data requirements and lack of explainability. |
| Approach: | They propose a technique that leverages Large-Language Models (LLMs) to provide step-by-step stylometric explanation prompts to verify authorship. |
| Outcome: | The proposed technique outperforms state-of-the-art baselines, operates effectively with limited training data, and enhances interpretability through intuitive explanations. |
Improving Text Auto-Completion with Next Phrase Prediction (2021.findings-emnlp)
Copied to clipboard
| Challenge: | Language models such as GPT-2 require considerable training effort to adapt to specific writing domains (e.g., medical). |
| Approach: | They propose an intermediate training strategy that encourages language models to complete partial queries with enriched phrases and eventually improve their text auto-completion performance. |
| Outcome: | The proposed approach outperforms baselines in auto-completion tasks for email and academic-writing domains with only around 1.2B tokens. |
Adaptive Learning of Local Semantic and Global Structure Representations for Text Classification (C18-1)
Copied to clipboard
Jianyu Zhao, Zhiqiang Zhan, Qichuan Yang, Yang Zhang, Changjian Hu, Zhensheng Li, Liuxin Zhang, Zhiqiang He
| Challenge: | Existing representation models for text classification learn little structure information or rely on pre-defined structures. |
| Approach: | They propose a sandwich neural network to learn local semantic and global structure representations without relying on parsers. |
| Outcome: | The proposed approach achieves competitive performance on several text classification tasks. |