Papers by Wenqiao Zhu
Bridging Local Details and Global Context in Text-Attributed Graphs (2024.emnlp-main)
Copied to clipboard
| Challenge: | Existing studies focus on combining different information levels but overlook interconnections, i.e., contextual textual information among nodes. |
| Approach: | They propose a framework that bridges local and global perspectives by leveraging contextual textual information. |
| Outcome: | The proposed framework achieves state-of-the-art performance while reducing tokens significantly. |
Meta-Reflection: A Feedback-Free Reflection Learning Framework (2025.acl-long)
Copied to clipboard
Yaoke Wang, Yun Zhu, XintongBao XintongBao, Wenqiao Zhang, Suyang Dai, Kehan Chen, Wenqiang Li, Gang Huang, Siliang Tang, Yueting Zhuang
| Challenge: | Existing approaches to improve large language models' ability to understand and reason are limited by external feedback. |
| Approach: | They propose a feedback-free reflection mechanism that requires only a single inference pass without external feedback. |
| Outcome: | The proposed method is based on an industrial e-commerce benchmark and public datasets. |
PILOT: Planning via Internalized Latent Optimization Trajectories for Large Language Models (2026.acl-long)
Copied to clipboard
| Challenge: | Large Language Models lack the capacity to formulate global strategies due to latency and availability constraints. |
| Approach: | They propose a framework to internalize the strategic oversight of large models into intrinsic Latent Guidance by synthesizing a query-conditioned Latent Guide. |
| Outcome: | The proposed framework outperforms strong baselines on mathematical and coding benchmarks with negligible inference latency. |
PSC: Extending Context Window of Large Language Models via Phase Shift Calibration (2024.emnlp-main)
Copied to clipboard
| Challenge: | Large-scale language models (LLMs) have shown impressive results across a variety of tasks. |
| Approach: | They propose a module for calibrating the frequencies predefined by existing methods . they conducted extensive experiments across multiple models and tasks . |
| Outcome: | The proposed method reduces perplexity as the context window size is varied from 16k to 32k and up to 64k. |
SGDPO: Self-Guided Direct Preference Optimization for Language Model Alignment (2025.findings-acl)
Copied to clipboard
| Challenge: | Existing methods for aligning Large Language Models with human values are limited and results of DPO are not resilient. |
| Approach: | They propose a self-guided direct preference optimization algorithm that incorporates a pilot term to steer the gradient flow during the optimization process. |
| Outcome: | The proposed method can generate human-preferred response up to 9.19% higher than previous methods. |
CARFT: Boosting LLM Reasoning via Contrastive Learning with Annotated Chain-of-Thought-based Reinforced Fine-Tuning (2025.emnlp-main)
Copied to clipboard
| Challenge: | Existing methods to improve the reasoning performance of Large Language Models (LLMs) ignore annotated Chain-of-Thought (CoT) and incorporate unstable reasoning path sampling. |
| Approach: | They propose a Contrastive learning with annotated CoT-based Reinforced Fine-Tuning approach to enhance the reasoning performance of Large Language Models. |
| Outcome: | The proposed approach exploits annotated CoT and stabilizes the fine-tuning procedure by incorporating an additional unsupervised learning signal. |