Papers by Shuqi Liu
Less is More: Pretrain a Strong Siamese Encoder for Dense Text Retrieval Using a Weak Decoder (2021.emnlp-main)
Copied to clipboard
Shuqi Lu, Di He, Chenyan Xiong, Guolin Ke, Waleed Malik, Zhicheng Dou, Paul Bennett, Tie-Yan Liu, Arnold Overwijk
| Challenge: | Dense retrieval requires high-quality text sequence embeddings to support effective search in the representation space. |
| Approach: | They propose a self-learning method that pre-trains the autoencoder using a weak decoder to push the encoder to provide better sequence representations. |
| Outcome: | The proposed model significantly boosts the effectiveness and few-shot ability of dense retrieval models on web search, news recommendation, and open domain question answering. |
RIFT: Repurposing Negative Samples via Reward-Informed Fine-Tuning (2026.findings-acl)
Copied to clipboard
| Challenge: | Reward Informed Fine-Tuning (RIFT) is an effective and robust alternative to expensive expert data for LLM alignment. |
| Approach: | They propose a reward-informed fine-tuning framework that utilizes all self-generated samples to learn from both positive and negative trajectories. |
| Outcome: | The proposed framework outperforms both RFT and Supervised Fine-Tuning (SFT) on mathematical benchmarks. |
AgentFactory: A Self-Evolving Framework Through Executable Subagent Accumulation and Reuse (2026.acl-demo)
Copied to clipboard
| Challenge: | Existing frameworks for building LLM-based agents treat agent behavior as static-knowledge gained during execution is not preserved for future use. |
| Approach: | They propose a new paradigm that preserves successful task solutions as executable subagent code rather than textual experience. |
| Outcome: | The proposed agent-based agent-driven paradigm preserves successful tasks as executable subagent code rather than textual experience. |
Bi-Chainer: Automated Large Language Models Reasoning with Bidirectional Chaining (2024.findings-acl)
Copied to clipboard
| Challenge: | Existing unidirectional chaining methods suffer from low prediction accuracy and efficiency. |
| Approach: | They propose a bidirectional chaining method which dynamically switches to depth-first reasoning in the opposite reasoning direction when it encounters multiple branching options within the current direction. |
| Outcome: | The proposed method achieves sizable accuracy boots over unidirectional chaining frameworks on four challenging logical reasoning datasets. |
SimVBG: Simulating Individual Values by Backstory Generation (2025.emnlp-main)
Copied to clipboard
| Challenge: | Large language models (LLMs) have strong human-like capabilities, but rarely simulating individualized human values. |
| Approach: | They propose a framework that simulates individual values based on individual backstories . they use structured data on an individual to transform their backstoried information to a backstory . |
| Outcome: | The proposed framework improves top-1 accuracy by more than 10% over retrieval-augmented generation methods. |
TwinVoice: A Multi-dimensional Benchmark Towards Digital Twins via LLM Persona Simulation (2026.findings-acl)
Copied to clipboard
Bangde Du, Minghao Guo, Songming He, Ziyi Ye, Xi Zhu, Weihang Su, Shuqi Zhu, Yujia Zhou, Yongfeng Zhang, Qingyao Ai, Yiqun Liu
| Challenge: | Existing studies show that advanced LLMs produce text indistinguishable from human writing. |
| Approach: | They propose a benchmark to assess persona simulation across diverse contexts by decomposing the evaluation into six fundamental capabilities including opinion consistency, memory recall, logical reasoning, persona tone, and syntactic style. |
| Outcome: | The proposed model achieves moderate accuracy but falls short of the basic capabilities needed to simulate personas in real-world contexts. |
Zero-shot Cross-lingual Conversational Semantic Role Labeling (2022.findings-naacl)
Copied to clipboard
| Challenge: | Xu et al., 2021: conversational semantic role labeling is under-explored in non-Chinese languages due to the lack of multilingual CSRL annotations for the parser training. |
| Approach: | They propose a model that implicitly learns conversational structure-aware representations with hierarchical encoders and elaborately designed pre-training objectives. |
| Outcome: | The proposed model outperforms baselines on English CSRL tests by large margins . it will facilitate the research of non-Chinese dialogue tasks which suffer from ellipsis and anaphora . |
Sens-Merging: Sensitivity-Guided Parameter Balancing for Merging Large Language Models (2025.findings-acl)
Copied to clipboard
| Challenge: | Existing task vector-based model merging methods apply uniform coefficients across all parameters, overlooking varying parameter importance both within and across tasks. |
| Approach: | They propose a sensitivity-guided coefficient adjustment method that optimizes existing model merging techniques by operating at both task-specific and cross-task levels. |
| Outcome: | The proposed method outperforms existing model merging techniques on mistral 7B and LLaMA2 7B/13B models and enables them to outperformed specialized models. |