Papers by Ao Li
Better Explain Transformers by Illuminating Important Information (2024.findings-eacl)
Copied to clipboard
| Challenge: | Existing explanations focus on the input and output of the Transformers, resulting in confusing results. |
| Approach: | They propose to highlight important information and eliminate irrelevant information by a refined information flow on top of the layer-wise relevance propagation method. |
| Outcome: | The proposed method outperforms baseline models on classification and question-answering datasets with over 3% to 33% improvement on explanation metrics. |
DRAMA: Dynamic Multi-Granularity Graph Estimate Retrieval over Tabular and Textual Question Answering (2024.lrec-main)
Copied to clipboard
| Challenge: | TableTextQA tasks require tabular and textual data, gaining increasing attention . however, row-based approaches suffer from limitations such as lack of interaction between rows . |
| Approach: | They propose a method that incorporates an interaction mechanism among multiple rows . Empirical results demonstrate that the proposed method is effective . |
| Outcome: | Empirical results show that the proposed model is effective on tabFact and HybridQA datasets. |
Estimating Agreement by Chance for Sequence Annotation (2024.acl-long)
Copied to clipboard
| Challenge: | Existing studies on chance correction for sequence annotation tasks lack a chance corrected agreement metric. |
| Approach: | They propose a model for generating random annotations which serves as the foundation for estimating chance agreement in sequence annotation tasks. |
| Outcome: | The proposed model is validated in simulation and corpus-based evaluation. |
Multimodal Causal Reasoning Benchmark: Challenging Multimodal Large Language Models to Discern Causal Links Across Modalities (2025.findings-acl)
Copied to clipboard
| Challenge: | Existing MLLMs lack robustness in multimodal causal reasoning compared to their performance in textual settings. |
| Approach: | They propose a novel multimodal chain-of-thought (CoT) reasoning benchmark that leverages siamese images and text pairs to challenge MLLMs. |
| Outcome: | The proposed benchmark leverages siamese images and text pairs to challenge MLLMs. |
ConRPG: Paraphrase Generation using Contexts as Regularizer (2021.emnlp-main)
Copied to clipboard
| Challenge: | Existing methods for paraphrase generation lack reliable supervision signals. |
| Approach: | They propose an unsupervised paradigm for paraphrase generation based on contextual language models, candidate filtering and paraphrase model training based upon the selected candidates. |
| Outcome: | The proposed paradigm outperforms existing paraphrase generation methods in supervised and unsupervised setups. |
APB: Accelerating Distributed Long-Context Inference by Passing Compressed Context Blocks across GPUs (2025.acl-long)
Copied to clipboard
Yuxiang Huang, Mingye Li, Xu Han, Chaojun Xiao, Weilin Zhao, Sun Ao, Hao Zhou, Jie Zhou, Zhiyuan Liu, Maosong Sun
| Challenge: | Long-context inference is crucial for advancing large language models, but its prefill speed remains a bottleneck. |
| Approach: | They propose an efficient long-context inference framework that leverages multi-host approximate attention to enhance prefill speed. |
| Outcome: | The proposed framework achieves speedups of 9.2, 4.2, and 1.6 without any degradation in performance. |
ReLook: Vision-Grounded RL with a Multimodal LLM Critic for Agentic Web Coding (2026.acl-long)
Copied to clipboard
| Challenge: | Large Language Models (LLMs) excel at algorithmic code generation, but front-end development is lacking in visual fidelity and interaction. |
| Approach: | They propose an agentic, vision-grounded reinforcement learning framework that closes a loop by invoking a multimodal LLM as a tool. |
| Outcome: | The proposed framework outperforms baselines in front-end code generation. |
Adaptive Immune-based Sound-Shape Code Substitution for Adversarial Chinese Text Attacks (2024.emnlp-main)
Copied to clipboard
| Challenge: | Existing text attack methods are designed for English text, but robust implementation of Chinese text is understudied. |
| Approach: | They propose an adaptive immune-based sound-shape code algorithm for Chinese text attacks . they leverage the Sound-Shape Code to generate natural substitutions . |
| Outcome: | The proposed algorithm produces high-quality Chinese adversarial examples . it can reduce duplication of population and improve search ability . |
Self Question-answering: Aspect-based Sentiment Analysis by Role Flipped Machine Reading Comprehension (2021.findings-emnlp)
Copied to clipboard
| Challenge: | unified Aspect-based Sentiment Analysis (ABSA) aims to couple aspect terms with their corresponding opinion terms, which might make it easier to predict sentiment polarities. |
| Approach: | They propose a new paradigm to pair aspect terms with their corresponding opinion terms . they propose to use a machine learning paradigm to solve the unified ABSA task . |
| Outcome: | The proposed framework can solve the ABSA task without any additional data annotation or transformation. |
Interactive Key-Value Memory-augmented Attention for Image Paragraph Captioning (2020.coling-main)
Copied to clipboard
| Challenge: | Existing approaches to image paragraph captioning ignore the past alignment information, resulting in repetitive captioning and incomplete captioning. |
| Approach: | They propose an Interactive key-value Memory-augmented Attention model for image paragraph captioning to keep track of attention history along with update-chain of decoder state. |
| Outcome: | Extensive experiments on a benchmark dataset demonstrate the effectiveness of the proposed model. |
CuMA: Aligning LLMs with Sparse Cultural Values via Demographic-Aware Mixture of Adapters (2026.acl-long)
Copied to clipboard
| Challenge: | Large Language Models (LLMs) have a global audience, so alignment must extend to cultural resonance. |
| Approach: | They propose a framework that frames alignment as a conditional capacity separation problem. |
| Outcome: | The proposed framework outperforms both dense baselines and semantic-only MoEs on three large language models. |
APB-V: Accelerating Long-Video Understanding via Sequence-Parallelism-aware Approximate Attention (2026.acl-long)
Copied to clipboard
Yuxiang Huang, Mingye Li, Xu Han, Chaojun Xiao, Weilin Zhao, Ao Sun, Ziqi Yuan, Hao Zhou, Fandong Meng, Zhiyuan Liu
| Challenge: | Existing methods for long-video inference use compression or sparse attention . existing methods restrict LMMs from handling longer, more complex videos . |
| Approach: | They propose a sequence-parallel framework with optimized attention that accelerates long-video inference across multiple GPUs. |
| Outcome: | The proposed framework delivers speedups of 12.72x, 1.70x, and 1.18x over FlashAttn, ZigZagRing, and APB without significant performance loss. |
SpeechUT: Bridging Speech and Text with Hidden-Unit for Encoder-Decoder Based Speech-Text Pre-training (2022.emnlp-main)
Copied to clipboard
| Challenge: | Existing models for pre-training text and speech are based on unlabeled audio data. |
| Approach: | They propose a unified-modal speech-unit-text pre-training model that connects speech encoders and text decoders with a shared unit encoder. |
| Outcome: | The proposed model improves on automatic speech recognition and speech translation tasks and achieves state-of-the-art performance on both the LibriSpeech ASR and MuST-C ST tasks. |
HSGraphAgent: Knowledge-Graph-Guided Large Language Models for Harmonized System Code Classification (2026.acl-long)
Copied to clipboard
| Challenge: | Harmonized System (HS) code classification is a hierarchically structured and regulation-constrained task, often complicated by short and noisy product descriptions. |
| Approach: | They propose a knowledge-graph-guided LLM framework that formulates HS classification as a stepwise, regulation-aware reasoning process over an explicit HS knowledge graph. |
| Outcome: | The proposed framework constrains inference to legally valid paths while producing explicit and traceable reasoning trajectories. |
FR-Spec: Accelerating Large-Vocabulary Language Models via Frequency-Ranked Speculative Sampling (2025.acl-long)
Copied to clipboard
Weilin Zhao, Tengyu Pan, Xu Han, Yudi Zhang, Sun Ao, Yuxiang Huang, Kaihuo Zhang, Weilun Zhao, Yuxuan Li, Jie Zhou, Hao Zhou, Jianyong Wang, Maosong Sun, Zhiyuan Liu
| Challenge: | Speculative sampling is an efficient way to accelerate the auto-regressive generation process of large language models. |
| Approach: | They propose a frequency-ranked speculative sampling framework that optimizes draft candidate selection through vocabulary space compression. |
| Outcome: | Experiments show that FR-Spec reduces LM Head computation overhead by 75% while ensuring the equivalence of the final output distribution. |
E-EVAL: A Comprehensive Chinese K-12 Education Evaluation Benchmark for Large Language Models (2024.findings-acl)
Copied to clipboard
Jinchang Hou, Chang Ao, Haihong Wu, Xiangtao Kong, Zhigang Zheng, Daijia Tang, Chengming Li, Xiping Hu, Ruifeng Xu, Shiwen Ni, Min Yang
| Challenge: | despite the rapid development of Large Language Models, there is no dedicated benchmark for evaluating LLMs in Chinese K-12 education. |
| Approach: | They propose to develop a benchmark specifically tailored for Chinese K-12 education. |
| Outcome: | EVAL is the first evaluation benchmark specifically tailored for Chinese K-12 education. |
Martingale Foresight Sampling: A Principled Approach to Inference-Time LLM Decoding (2026.eacl-long)
Copied to clipboard
| Challenge: | Standard autoregressive decoding in large language models is short-sighted, often failing to find globally optimal reasoning paths due to token-by-token generation process. |
| Approach: | They propose a principled framework that reformulates LLM decoding as a problem of identifying an optimal stochastic process. |
| Outcome: | The proposed framework surpasses state-of-the-art methods in accuracy while significantly improving computational efficiency. |
KG-ViP: Bridging Knowledge Grounding and Visual Perception in Multi-modal LLMs for Visual Question Answering (2026.acl-long)
Copied to clipboard
| Challenge: | Existing approaches to Visual Question Answering lack synergistic potential of scene graphs and scene graph. |
| Approach: | They propose a retrieval-and-fusion pipeline that fuses scene graphs and commonsense graphs to enable multi-modal reasoning. |
| Outcome: | Experiments on FVQA 2.0+ and MVQA benchmarks show that KG-ViP outperforms existing methods. |
ChineseBERT: Chinese Pretraining Enhanced by Glyph and Pinyin Information (2021.acl-long)
Copied to clipboard
| Challenge: | ChineseBERT model incorporates glyph and pinyin information of Chinese characters into pretraining . proposed model achieves new performance boost over baseline models with fewer training steps . |
| Approach: | They propose a ChineseBERT model that incorporates glyph and pinyin information into pretraining . the glyph embedding is obtained based on different fonts of a character, and the pinyink embeddment characterizes the pronunciation of Chinese characters. |
| Outcome: | The proposed model achieves new performance boosts over baseline models with fewer training steps. |
Making Flexible Use of Subtasks: A Multiplex Interaction Network for Unified Aspect-based Sentiment Analysis (2021.findings-acl)
Copied to clipboard
| Challenge: | Existing studies aim to integrate multiple sub-tasks into a unified ABSA model but suffer from major disadvantages . |
| Approach: | They propose a multi-task learning approach to make use of sub-tasks for a unified ABSA. |
| Outcome: | The proposed model can work well when some sub-tasks are absent, and the interactive relations among subtasks not adequate. |
DuSQL: A Large-Scale and Pragmatic Chinese Text-to-SQL Dataset (2020.emnlp-main)
Copied to clipboard
| Challenge: | Existing text-to-SQL parsing methods mainly focus on English, but there is no labeled data available for the language . a larges-scale and pragmatic Chinese dataset is used for cross-domain text- to-Sql task . |
| Approach: | They propose a larges-scale Chinese dataset for a cross-domain text-to-SQL task . they analyze questions from several representative applications and use an effective data construction framework . |
| Outcome: | The proposed dataset contains 200 databases, 813 tables, and 23,797 question/SQL pairs. |
Modelling Long-distance Node Relations for KBQA with Global Dynamic Graph (2020.coling-main)
Copied to clipboard
| Challenge: | Existing studies rely on deep graph neural networks (GNNs) to capture rich structural information, but they lack the structural information needed for QA. |
| Approach: | They propose a framework which captures structural information from KBs and models long-distance node relations from two perspectives. |
| Outcome: | The proposed framework models long-distance node relations from two perspectives . it is based on two widely used multi-hop KBQA datasets . |
Data Augmentation with Hierarchical SQL-to-Question Generation for Cross-domain Text-to-SQL Parsing (2021.emnlp-main)
Copied to clipboard
| Challenge: | Existing approaches to parse text-to-SQL data are lacking labeled data for unseen evaluation databases. |
| Approach: | They propose a framework for enhancing SQL queries by automatically producing large numbers of SQL queries based on an abstract syntax tree grammar. |
| Outcome: | The proposed framework can produce high-quality natural language questions over strong baselines. |
Layer-wise Model Pruning based on Mutual Information (2021.emnlp-main)
Copied to clipboard
| Challenge: | In spite of impressive results of neural networks, the huge model size has hindered their applications in cases where computation and memory resources are limited. |
| Approach: | They propose a method for layer-wise pruning using mutual information based feature selection in SVMs and logistic regression. |
| Outcome: | The proposed pruning strategy offers greater speedup and higher performance than weight-based pruning methods. |
SpeechT5: Unified-Modal Encoder-Decoder Pre-Training for Spoken Language Processing (2022.acl-long)
Copied to clipboard
Junyi Ao, Rui Wang, Long Zhou, Chengyi Wang, Shuo Ren, Yu Wu, Shujie Liu, Tom Ko, Qing Li, Yu Zhang, Zhihua Wei, Yao Qian, Jinyu Li, Furu Wei
| Challenge: | Existing work shows that pre-trained models can improve in various natural language processing tasks. |
| Approach: | They propose a unified-modal encoder-decoder framework that pre-trains speech-text representations using large-scale unlabeled speech and text data. |
| Outcome: | The proposed framework is superior to existing models on speech-to-text processing tasks. |
Sentence Similarity Based on Contexts (2022.tacl-1)
Copied to clipboard
| Challenge: | Existing methods to measure sentence similarity face limited dataset size and training-test gap . existing methods lack large-scale labeled datasets with labeles that are labor-intensive and expensive . |
| Approach: | They propose a framework that measures sentence similarity by comparing probabilities of generating two sentences given the same context. |
| Outcome: | The proposed framework achieves significant performance boosts over baselines under supervised and unsupervised settings. |
EFSA: Towards Event-Level Financial Sentiment Analysis (2024.acl-long)
Copied to clipboard
| Challenge: | a large-scale Chinese dataset contains 12,160 news articles and 13,725 quintuples . a four-hop Chain-of-Thought LLM-based approach is devised for this task . |
| Approach: | They propose to extend financial sentiment analysis to event-level since events usually serve as the subject of the sentiment in financial text. |
| Outcome: | The proposed method can reach the current state-of-the-art on a large-scale Chinese dataset. |
Quantification of Large Language Model Distillation (2025.acl-long)
Copied to clipboard
Sunbowen Lee, Junting Zhou, Chang Ao, Kaige Li, Xeron Du, Sirui He, Haihong Wu, Tianci Liu, Jiaheng Liu, Hamid Alinejad-Rokny, Min Yang, Yitao Liang, Zhoufutu Wen, Shiwen Ni
| Challenge: | Existing studies have revealed the robustness degra-dation caused by data distillation. |
| Approach: | They propose a framework to evaluate and quantify model distillation . they aim to identify identity cognition contradictions and analyse multi-granularity response similarities across models to measure the extent of homogenization. |
| Outcome: | The proposed framework addresses two key aspects: (1) Identifying identity cognition contradictions to assess discrepancies in how models perceive and represent identity-related information; (2) Analyzing multi-granularity response similarities across models to measure the extent of homogenization. |
Gradient-Adaptive Policy Optimization: Towards Multi-Objective Alignment of Large Language Models (2025.acl-long)
Copied to clipboard
| Challenge: | Reinforcement learning from human feedback (RLHF) has emerged as a powerful technique for aligning large language models (LLMs) with human preferences. |
| Approach: | They propose a novel algorithm that uses multiple-gradient descent to optimize LLMs with diverse preferences to maximize trade-offs between objectives. |
| Outcome: | The proposed approach incorporates user preferences across different objectives and achieves Pareto solutions that better align with the user’s specific needs. |
Ensuring Readability and Data-fidelity using Head-modifier Templates in Deep Type Description Generation (P19-1)
Copied to clipboard
| Challenge: | Existing generative methods overlook grammatical structure or make factual mistakes in generated texts. |
| Approach: | They propose a template-based method to ensure the readability of generated type descriptions . they also propose measurable metrics to measure the readibility of the generated type description . |
| Outcome: | The proposed method improves substantially compared with baselines and achieves state-of-the-art performance on both datasets. |