Papers by Zhengyang Zhao
BlendFilter: Advancing Retrieval-Augmented Large Language Models via Query Generation Blending and Knowledge Filtering (2024.emnlp-main)
Copied to clipboard
Haoyu Wang, Ruirui Li, Haoming Jiang, Jinjin Tian, Zhengyang Wang, Chen Luo, Xianfeng Tang, Monica Cheng, Tuo Zhao, Jing Gao
| Challenge: | Retrieval-augmented Large Language Models struggle with complex inputs and noisy knowledge retrieval hindering model effectiveness. |
| Approach: | They propose a query generation method that integrates query generation blending with knowledge filtering to enhance retrieval-augmented LLMs. |
| Outcome: | The proposed approach surpasses state-of-the-art benchmarks on open-domain question answering benchmarks. |
CreativeBench: Benchmarking and Enhancing Machine Creativity via Self-Evolving Challenges (2026.findings-acl)
Copied to clipboard
| Challenge: | Increasing saturation of web data limits further scaling of model intelligence. |
| Approach: | They propose a benchmark to evaluate machine creativity in code generation that combines combinatorial and exploratory creativity through reverse engineering and self-play. |
| Outcome: | The proposed benchmark targets combinatorial and exploratory creativity through reverse engineering and self-play. |
CL-QR: Cross-Lingual Enhanced Query Reformulation for Multi-lingual Conversational AI Agents (2023.emnlp-industry)
Copied to clipboard
| Challenge: | Existing QR systems that reformulate defective user queries are limited in English due to the scarcity of non-English QR labels. |
| Approach: | They propose a query reformulation method which reformulates defective user queries to improve non-English QR performance. |
| Outcome: | The proposed framework improves non-English QR performance by leveraging abundant reformulation resources in English. |
Data Diversity Matters for Robust Instruction Tuning (2024.findings-emnlp)
Copied to clipboard
Alexander Bukharin, Shiyang Li, Zhengyang Wang, Jingfeng Yang, Bing Yin, Xian Li, Chao Zhang, Tuo Zhao, Haoming Jiang
| Challenge: | Recent studies have shown that by curating high quality and diverse instruction tuning datasets, we can significantly improve instruction-following capabilities. |
| Approach: | They propose an algorithm to control diversity and quality of instruction tuning datasets and validate it. |
| Outcome: | The proposed algorithm significantly improves worst and average case performance on large scale instruction tuning datasets. |
CompTab: A Comprehensive Benchmark for Real-World TableQA with Complex Reasoning and Irregular Tables (2026.acl-long)
Copied to clipboard
Zhen Yang, Wei Du, Jie Wang, Wenze Zhou, Xiangfeng Meng, Zhengyang Wang, Suping Sun, Ziwei Du, Haodong Zou, Jie Chen, Yongbin Liu, Shicheng Tan, Jiahao Ying, Shu Zhao
| Challenge: | Existing benchmarks focus on well-structured tables and fail to reflect irregular structures and complex reasoning commonly encountered in real-world scenarios. |
| Approach: | They propose a benchmark to evaluate TableQA under complex reasoning and irregular table conditions. |
| Outcome: | The proposed framework improves generalization and realism of large language models under complex and irregular table conditions. |