Papers by Meng Xiao
KnowledgeBerg: Evaluating Systematic Knowledge Coverage and Compositional Reasoning in Large Language Models (2026.findings-acl)
Copied to clipboard
| Challenge: | Existing LLMs lack systematic coverage of a bounded knowledge universe and compositional set-based reasoning over that universe. |
| Approach: | They propose a benchmark for multiple-choice questions based on 1,183 enumeration seeds . they use knowledge width, cardinality of required universe, reasoning depth to formalize the challenge . |
| Outcome: | The proposed benchmarks achieve only 5.26–36.88 F1 on universe enumeration and 16.00–44.19 accuracy on knowledge-grounded reasoning. |
mPresenter: An Agentic Framework for Generating Multilingual Presentation Videos from Scientific Papers (2026.findings-acl)
Copied to clipboard
| Challenge: | Existing Paper2Video systems are monolingual and often rely on single-pass pipelines. |
| Approach: | They propose a multilingual agentic Paper2Video system that decomposes the task into planning, audience-oriented critique, layout-aware slide generation, and multilingual figure interpretation. |
| Outcome: | The proposed system improves question-answering accuracy relative to previous systems while maintaining affordable cost and latency. |
Do LLMs Catch Their Own Mistakes? A Comprehensive Benchmark for Reflective Tool Use LLMs (2026.findings-acl)
Copied to clipboard
| Challenge: | Existing benchmarks primarily evaluate planning and execution success, overlooking the self-reflective dimension of tool use. |
| Approach: | They propose a benchmark to assess LLMs’ self-reflective reasoning in tool-augmented multi-turn dialogues. |
| Outcome: | The proposed benchmark covers 10 domains with 88 distinct APIs and 968 annotated dialogues, systematically injecting diverse error types arising from both user and assistant behavior. |
Immediate Inference: The Missing Foundation in Large Language Model Logical Reasoning (2026.acl-long)
Copied to clipboard
| Challenge: | Recent work on LLMs has focused on fine-grained skill decomposition and consistency probing at the propositional level. |
| Approach: | They propose a benchmark evaluating immediate inference that evaluates elemental operations over categorical propositions and proposes a model that uses immediate inferential reasoning. |
| Outcome: | The proposed benchmark demonstrates that models lack robust operator grounding, oscillating between structural reasoning and surface pattern matching, inconsistent handling of quantifiers and negation. |
The Efficiency vs. Accuracy Trade-off: Optimizing RAG-Enhanced LLM Recommender Systems Using Multi-Head Early Exit (2025.acl-long)
Copied to clipboard
Huixue Zhou, Hengrui Gu, Zaifu Zhan, Xi Liu, Kaixiong Zhou, Yongkang Xiao, Mingfu Liang, Srinivas Prasad Govindan, Piyush Chawla, Jiyan Yang, Xiangfei Meng, Huayu Li, Buyun Zhang, Liang Luo, Wen-Yen Chen, Yiping Han, Bo Long, Rui Zhang, Tianlong Chen
| Challenge: | Existing frameworks for Large Language Models (LLMs) for Click-Through Rate prediction require a careful balance between computational efficiency and predictive accuracy. |
| Approach: | They propose a framework that integrates Retrieval-Augmented Generation with a novel multi-head early exit architecture to address both challenges. |
| Outcome: | The proposed framework reduces retrieval time while maintaining high model performance. |
Cross-layer Attention Sharing for Pre-trained Large Language Models (2026.tacl-1)
Copied to clipboard
Yongyu Mu, Yuzhang Wu, Yuchun Fan, Chenglong Wang, Hengyu Li, Jiali Zeng, Qiaozhi He, Murun Yang, Fandong Meng, Jie Zhou, Tong Xiao, Jingbo Zhu
| Challenge: | Existing studies focus on compressing the Key-Value cache or grouping attention heads, while overlooking redundancy between layers. |
| Approach: | They propose a lightweight substitute for self-attention in well-trained LLMs that uses feed-forward networks to align attention heads between adjacent layers and low-rank matrices to approximate differences in layer-wise attention weights. |
| Outcome: | The proposed model reduces redundancy by sharing weights across layers while maintaining high response quality while reducing redundant calculations within 53% 84% of the total layers. |
Enhancing Speech Large Language Models with Prompt-Aware Mixture of Audio Encoders (2025.emnlp-main)
Copied to clipboard
Weiqiao Shan, Yuang Li, Yuhao Zhang, Yingfeng Luo, Chen Xu, Xiaofeng Zhao, Long Meng, Yunfei Lu, Min Zhang, Hao Yang, Tong Xiao, JingBo Zhu
| Challenge: | Existing work on integrating audio encoders with large language models (LLMs) has focused on semantic understanding tasks, but different tasks may require distinct features that emphasize either semantic or acoustic aspects. |
| Approach: | They propose to use a prompt-aware mixture to enhance the Speech LLM that uses multiple audio encoders to extract different features based on the prompt. |
| Outcome: | The proposed approach outperforms all single-encoder Speech LLMs on ASR, speaker number verification, and AC tasks. |
A Dashboard for Mitigating the COVID-19 Misinfodemic (2021.eacl-demos)
Copied to clipboard
Zhengyuan Zhu, Kevin Meng, Josue Caraballo, Israa Jaradat, Xiao Shi, Zeyu Zhang, Farahnaz Akrami, Haojin Liao, Fatma Arslan, Damian Jimenez, Mohanmmed Samiul Saeef, Paras Pathak, Chengkai Li
| Challenge: | a new public dashboard aims to understand the impact of the COVID-19 misinfodemic on Twitter . the dashboard uses a curated catalog of COVId-19 related facts and debunks of misinformation . |
| Approach: | They propose a public dashboard that matches tweets with COVID-19 misinformation . they also propose experiments to analyze the spread of misinformation on twitter . |
| Outcome: | The proposed dashboard uses a curated catalog of COVID-19 related facts and debunks misinformation . it shows the most prevalent information from the catalog among Twitter users in user-selected geographic regions . |
Memory-Guided Hard Data Augmentation for Multimodal Named Entity Recognition (2026.findings-acl)
Copied to clipboard
Xinyu Liu, Kai fu, Yinghan Shi, Quanyou Chu, Ming Du, Hongya Wang, Xiaojun Meng, Jiansheng Wei, Yanghua Xiao, Bo Xu
| Challenge: | Existing methods for Named Entity Recognition (NER) ignore the internal state of the target model. |
| Approach: | They propose a framework to repair model-specific errors by using a model-based approach . they employ cross-validation to identify model- specific Hard Data and a memory tree to induce macro-level error patterns from micro-level failures. |
| Outcome: | The proposed framework yields significant performance gains on Twitter and other platforms. |
CDS: Data Synthesis Method Guided by Cognitive Diagnosis Theory (2025.findings-acl)
Copied to clipboard
| Challenge: | Large Language Models (LLMs) have demonstrated remarkable capabilities across diverse tasks, but the complexity of emerging tasks and higher performance demands highlight the need for continuous improvement. |
| Approach: | They propose a method that refines evaluation results and characterizes model profiles at the knowledge component level. |
| Outcome: | The proposed method improves performance across multiple benchmarks and academic exams. |
Why Did Apple Fall: Evaluating Curiosity in Large Language Models (2026.findings-acl)
Copied to clipboard
| Challenge: | Existing methods for evaluating curiosity-like behaviors in large language models lack curiosity-inspired features. |
| Approach: | They propose a psychology-inspired framework to evaluate curiosity in large language models . they adapt the Five-Dimensional Curiosity scale Revised (5DCR) to LLMs . |
| Outcome: | The proposed framework evaluates curiosity in large language models using questionnaires and behavioral studies. |
Clustering and Ranking: Diversity-preserved Instruction Selection through Expert-aligned Quality Estimation (2024.emnlp-main)
Copied to clipboard
Yuan Ge, Yilun Liu, Chi Hu, Weibin Meng, Shimin Tao, Xiaofeng Zhao, Mahong Xia, Zhang Li, Boxing Chen, Hao Yang, Bei Li, Tong Xiao, JingBo Zhu
| Challenge: | Existing methods for instruction data selection have limitations such as relying on fragile external APIs, being affected by biases in GPT models, or reducing the diversity of the selected instruction dataset. |
| Approach: | They propose an industrial-friendly, expert-aligned and diversity-preserved instruction data selection method: Clustering and Ranking (CaR). |
| Outcome: | The proposed method outperforms Alpaca's existing methods by 32.1% in GPT-4 evaluations. |
RankNAS: Efficient Neural Architecture Search by Pairwise Ranking (2021.emnlp-main)
Copied to clipboard
| Challenge: | Existing methods require training millions of architectures to estimate the accuracy of the search results. |
| Approach: | They propose a performance ranking method (RankNAS) that uses pairwise ranking and search space pruning to enlarge the search space. |
| Outcome: | The proposed method significantly accelerates NAS through pairwise ranking and search space pruning. |
APB-V: Accelerating Long-Video Understanding via Sequence-Parallelism-aware Approximate Attention (2026.acl-long)
Copied to clipboard
Yuxiang Huang, Mingye Li, Xu Han, Chaojun Xiao, Weilin Zhao, Ao Sun, Ziqi Yuan, Hao Zhou, Fandong Meng, Zhiyuan Liu
| Challenge: | Existing methods for long-video inference use compression or sparse attention . existing methods restrict LMMs from handling longer, more complex videos . |
| Approach: | They propose a sequence-parallel framework with optimized attention that accelerates long-video inference across multiple GPUs. |
| Outcome: | The proposed framework delivers speedups of 12.72x, 1.70x, and 1.18x over FlashAttn, ZigZagRing, and APB without significant performance loss. |
Metaphor Reasoning is Meta-reasoning (2026.acl-long)
Copied to clipboard
Qianyu He, Junting Lu, Yikai Zhang, Siyu Yuan, Xiaojun Meng, Jiansheng Wei, Jiaqing Liang, Yanghua Xiao
| Challenge: | Existing work on metaphor reasoning's impact on reasoning abilities is limited. |
| Approach: | They propose a system for synthesizing metaphorical riddles that satisfy five quality dimensions: diverse, balanced, reasoning-oriented, challenging, and verifiable. |
| Outcome: | The proposed system improves reasoning abilities across six domains using only thousands of metaphorical riddles. |
GATE: Graph-based Adaptive Tool Evolution Across Diverse Tasks (2026.acl-long)
Copied to clipboard
Jianwen Luo, Yiming Huang, Jinxiang Meng, Fangyu Lei, Shizhu He, Xiao Liu, Shanshan Jiang, Bin Dong, Jun Zhao, Kang Liu
| Challenge: | Existing toolsets that use large language models are limited to single-task settings. |
| Approach: | They propose a framework that dynamically constructs and evolves a hierarchical graph of reusable tools across multiple scenarios. |
| Outcome: | The proposed framework achieves up to 4.3 faster milestone completion in Minecraft compared to the previous state-of-the-art method and provides an average improvement of 9.23% over existing tool-making methods in code generation tasks and 10.03% in agent tasks. |
SciText2Eq: Assessing LLMs for Explainable Equation Generation for Scientific Creativity (2026.findings-acl)
Copied to clipboard
| Challenge: | Prior work has addressed problems in unstructured grounding, multi-equation dependency, and human-aligned evaluation. |
| Approach: | They construct a dataset of scientific texts and evaluate it using an explainable equation generation workflow using automatic metrics and human judgments. |
| Outcome: | The proposed model achieves moderate performance on lexical and syntactic similarity, but struggles with semantic accuracy. |
Personality Understanding of Fictional Characters during Book Reading (2023.acl-long)
Copied to clipboard
| Challenge: | Existing methods to predict characters' personalities have not been studied in the NLP field due to the lack of appropriate datasets mimicking the process of book reading. |
| Approach: | They propose a dataset to predict characters' personalities that uses an exhaustive vocabulary of personality traits as targets. |
| Outcome: | The proposed dataset is efficient and accurate and relies on long-term context to achieve accurate predictions for both machines and humans. |
MATH-IDN: A Multilingual Mathematical Problem Solving Dataset Featuring Local Languages in Indonesia (2026.findings-eacl)
Copied to clipboard
| Challenge: | Large Language Models excel at mathematical reasoning in English, but their performance in low-resource languages remains underexplored. |
| Approach: | They propose a multilingual benchmark for mathematical problem solving in Indonesian, Javanese, Sundanese, and Buginese with English as a reference. |
| Outcome: | The proposed model reveals significant performance gaps in low-resource languages, particularly Buginese, and highlights key limitations in current multilingual reasoning capabilities. |
The GaoYao Benchmark: A Comprehensive Framework for Evaluating Multilingual and Multicultural Abilities of Large Language Models (2026.acl-long)
Copied to clipboard
Yilun Liu, Chunguang Zhao, Mengyao Piao, Lingqi Miao, Shimin Tao, Minggui HE, Chenxin Liu, Zhang Li, null Mahongxia, Jiaxin Guo, Chen Liu, Liqun Deng, Jiansheng Wei, Xiaojun Meng, Fanyi Du, Daimeng Wei, Yanghua Xiao
| Challenge: | Existing multilingual evaluation benchmarks neglect cultural nuances and lack language coverage in subjective tasks. |
| Approach: | They propose a framework that categorizes evaluation tasks into three cultural layers and nine cognitive sub-layers. |
| Outcome: | The proposed framework surpasses prior coverage by up to 111% on 20+ LLMs. |
DP-CRE: Continual Relation Extraction via Decoupled Contrastive Learning and Memory Structure Preservation (2024.lrec-main)
Copied to clipboard
| Challenge: | Existing methods for learning relational knowledge are replay-based and prioritize data uniformly . a pronounced bias towards new tasks can be caused by the introduction of new tasks . |
| Approach: | They propose a framework that decouples the process of prior information preservation and new knowledge acquisition. |
| Outcome: | Extensive experiments show that the framework outperforms baselines across two datasets. |
UniCreative: Unifying Long-form Logic and Short-form Sparkle via Reference-Free Reinforcement Learning (2026.findings-acl)
Copied to clipboard
Xiaolong Wei, Zerun Zhu, Simin Niu, Xingyu Zhang, Peiying Yu, Changxuan Xiao, Yuchen Li, Jicheng Yang, Zhejun Zhao, Chong Meng, Long Xia, Daiting Shi
| Challenge: | Existing alignment paradigms for creative writing use static reward signals and supervised data. |
| Approach: | They propose a constraint-aware reward model that synthesizes query-specific criteria to provide fine-grained preference judgments. |
| Outcome: | The proposed framework aligns models with human preferences across content quality and structural paradigms without supervised fine-tuning and ground-truth references. |