Papers by Guo Tang
VGA: Vision GUI Assistant - Minimizing Hallucinations through Image-Centric Fine-Tuning (2024.findings-emnlp)
Copied to clipboard
| Challenge: | Existing Large Vision-Language Models (VLMs) often overly rely on internal text-based knowledge while neglecting visual inputs. |
| Approach: | They propose a model that balances attention image and text to enhance interpretation and reduce hallucinations by using a visual input. |
| Outcome: | The proposed model improves interpretation and reduces hallucinations by balancing attention image and text to enhance interpretation and reduction of hallucinosity. |
LCR-RAG: Enhancing Logical Consistency in Retrieval-Augmented Generation via Neuro-symbolic Reinforcement Learning (2026.acl-long)
Copied to clipboard
| Challenge: | Retrieval-Augmented Generation (RAG) is widely used to ground large language models in external knowledge and improve factual accuracy. |
| Approach: | They propose a framework that integrates neuro-symbolic verification with reinforcement learning to optimize logical consistency. |
| Outcome: | The proposed framework outperforms strong RAG baselines on hotpotQA, ASQA, and TriviaQA. |
Too Long, Do Re-weighting for Efficient LLM Reasoning Compression (2026.acl-long)
Copied to clipboard
Zhong-Zhi Li, Xiao Liang, Zihao Tang, Lei Ji, Peijie Wang, Haotian Xu, Xing W, Haizhen Huang, Weiwei Deng, Yeyun Gong, Zhijiang Guo, Xiao Liu, Fei Yin, Cheng-Lin Liu
| Challenge: | Large Language Models (LLMs) have recently achieved remarkable progress on complex reasoning tasks by leveraging extended Chain-of-Thought (CoT) techniques. |
| Approach: | They propose a method that uses Extended Chain-of-Thought (EFT) to reduce the number of output tokens by nearly 40% while maintaining the accuracy of the reasoning. |
| Outcome: | The proposed method reduces the number of output tokens by nearly 40% while maintaining the accuracy of the reasoning. |
RSMeM: Knowledge-Enhanced Memory Evolution for Remote Sensing Agents with Systematic Evaluation (2026.acl-long)
Copied to clipboard
Bingxian Wu, Yu Zhang, Zonghao Guo, Tang Liu, Chen Qian, Yuxiang Lu, Xingbo Du, Yanghao Li, Yidan Zhang, Chi Chen, Ling Yao, Chenghu Zhou, Maosong Sun
| Challenge: | Existing RS agents built on general-purpose LLMs are domain-agnostic, resulting in brittle and error-prone workflows. |
| Approach: | They propose a knowledge-enhanced memory evolution mechanism that bootstraps RS agents with pre-distilled domain knowledge and iteratively integrates online experience for robust multi-step tool execution. |
| Outcome: | Experiments show that the new model improves tool-use performance and accuracy . iteratively, iteration of the model integrates online experience for robust multi-step tool execution . |
AnRe: Analogical Replay for Temporal Knowledge Graph Forecasting (2025.acl-long)
Copied to clipboard
| Challenge: | Temporal Knowledge Graphs (TKGs) are vital for event prediction, yet current methods face limitations. |
| Approach: | They propose a training-free Analogical Replay reasoning framework that uses LLMs to extract historical contexts and generate analogical reasoning examples as contextual inputs. |
| Outcome: | The proposed model outperforms existing training-free methods on four benchmarks. |
G2RPO-A: Guided Group Relative Policy Optimization with Adaptive Guidance (2026.acl-long)
Copied to clipboard
| Challenge: | Recent advances in reasoning-centric large language models (LLMs) have significantly expanded the performance boundaries of LLMs, showcasing the immense potential of reasoning-enhanced models. |
| Approach: | They propose an adaptive algorithm that injects ground-truth reasoning steps into roll-out trajectories to compensate for SLMs’ inherent weaknesses. |
| Outcome: | Experiments on mathematical reasoning and code-generation benchmarks confirm that G2RPO-A substantially outperforms vanilla GRPO. |
Evidence-Aware Inferential Text Generation with Vector Quantised Variational AutoEncoder (2020.acl-main)
Copied to clipboard
| Challenge: | Existing approaches for inferential text generation ignore context that is not explicitly provided . Existing models ignore background knowledge that provides crucial evidence to generate inferences . |
| Approach: | They propose an approach that automatically finds evidence for an event from a large text corpus and leverages it to guide the generation of inferential texts. |
| Outcome: | The proposed model generates inferential texts from a large text corpus and uses evidence to guide it. |
Debias NLU Datasets via Training-free Perturbations (2023.findings-emnlp)
Copied to clipboard
| Challenge: | Existing approaches to debiase NLU models capture biased features that are independent of the task but spuriously correlated to labels. |
| Approach: | They propose a framework that conducts training-free perturbations on samples containing biased features to Debias NLU Datasets. |
| Outcome: | The proposed framework shows competitive performance with previous state-of-the-art debiasing strategies. |
LoopCoder: Scaling Code Intelligence via Looped Language Models (2026.findings-acl)
Copied to clipboard
Jian Yang, Wei Zhang, Shuyue Guo, Yizhi LI, Linzheng Chai, Zhengmao Ye, Shukai Liu, Yuyang Song, Jiajun Wu, Che Liu, Tianyu Zheng, Siwei Wu, Leo L, Xudong Ma, Chuan Hao, Ran Tao, Yan Xing, Jianzhou Wang, Mingjie Tang, Aishan Liu, Zhoujun Li, Xianglong Liu, Weifeng Lv, Bryan Dai
| Challenge: | Large language models have mastered syntax-level code generation, but complex algorithmic reasoning remains a challenge. |
| Approach: | They propose a recurrent inductive bias that aligns with the recursive nature of programming logic. |
| Outcome: | The proposed model achieves comparable performance to standard dense models with more parameters. |
Data Interpreter: An LLM Agent for Data Science (2025.findings-acl)
Copied to clipboard
Sirui Hong, Yizhang Lin, Bang Liu, Bangbang Liu, Binhao Wu, Ceyao Zhang, Danyang Li, Jiaqi Chen, Jiayi Zhang, Jinlin Wang, Li Zhang, Lingyao Zhang, Min Yang, Mingchen Zhuge, Taicheng Guo, Tuo Zhou, Wei Tao, Robert Tang, Xiangtao Lu, Xiawu Zheng, Xinbing Liang, Yaying Fei, Yuheng Cheng, Yongxin Ni, Zhibin Gou, Zongze Xu, Yuyu Luo, Chenglin Wu
| Challenge: | Large Language Models (LLMs) excel in various domains but face challenges when applied to data science workflows due to their complex, multi-stage nature. |
| Approach: | They propose a hierarchical graph-based agent that represents complexity and a progressive strategy for step-by-step verification, refinement, and consistent context management. |
| Outcome: | The proposed agent surpasses state-of-the-art baselines on the MATH dataset and performs better on InfiAgent-DABench. |
Question Generation from SQL Queries Improves Neural Semantic Parsing (D18-1)
Copied to clipboard
| Challenge: | Using question generation, we learn a semantic parser with 30% of the supervised training data. |
| Approach: | They propose to use question generation to learn a semantic parser with less supervised training data. |
| Outcome: | The proposed method improves the state-of-the-art model with less training data. |
Bridging Relevance and Reasoning: Rationale Distillation in Retrieval-Augmented Generation (2025.findings-acl)
Copied to clipboard
Pengyue Jia, Derong Xu, Xiaopeng Li, Zhaocheng Du, Xiangyang Li, Yichao Wang, Yuhao Wang, Qidong Liu, Maolin Wang, Huifeng Guo, Ruiming Tang, Xiangyu Zhao
| Challenge: | Existing approaches to rerank and align documents based on reasoning capabilities of large language models (LLMs) . prior work shows that LLMs have exceptional reasoning and text generation capabilities . |
| Approach: | They propose a rationale extraction method that leverages reasoning capabilities of large language models to extract the rationales necessary for answering a query. |
| Outcome: | The proposed method is compared with baseline methods on two tasks across three datasets. |
TeamLoRA: Boosting Low-Rank Adaptation with Expert Collaboration and Competition (2025.acl-long)
Copied to clipboard
Tianwei Lin, Jiang Liu, Wenqiao Zhang, Yang Dai, Haoyuan Li, Zhelun Yu, Wanggui He, Juncheng Li, Jiannan Guo, Hao Jiang, Siliang Tang, Yueting Zhuang
| Challenge: | Existing methods for fine-tuning are resource-efficient, but performance often falls short . a new approach, TeamLoRA, integrates collaborative and competitive modules to improve performance. |
| Approach: | They propose to introduce task-specific LoRA as domain experts to improve learning efficiency . teamLoRA integrates collaborative and competition modules to improve model learning . |
| Outcome: | Experiments show that TeamLoRA improves performance in multi-task learning . teamLorea integrates collaborative and competitive modules to improve performance . |
VRoPE: Rotary Position Embedding for Video Large Language Models (2025.emnlp-main)
Copied to clipboard
Zikang Liu, Longteng Guo, Yepeng Tang, Tongtian Yue, Junxian Cai, Kai Ma, Qingbin Liu, Xi Chen, Jing Liu
| Challenge: | Existing versions of Large Language Models (LLMs) lack a positional encoding strategy for video. |
| Approach: | They propose a new positional encoding method tailored for Video-LLMs that mitigates positional biases and ensures a more uniform distribution of spatial focus. |
| Outcome: | The proposed method outperforms existing versions of RoPE in video understanding and reasoning tasks. |
Parameter-Efficient Tuning Makes a Good Classification Head (2022.emnlp-main)
Copied to clipboard
| Challenge: | In recent years, pretrained models revolutionized the paradigm of natural language understanding . but the final-layer output of the backbone, i.e. the input of the classification head, will change greatly during finetuning . |
| Approach: | They propose to append a randomly initialized classification head after the pretrained backbone and finetune the whole model. |
| Outcome: | The proposed classification head can be replaced with the randomly initialized heads for a stable performance gain. |
LLMTreeRec: Unleashing the Power of Large Language Models for Cold-Start Recommendations (2025.coling-main)
Copied to clipboard
Wenlin Zhang, Chuhan Wu, Xiangyang Li, Yuhao Wang, Kuicai Dong, Yichao Wang, Xinyi Dai, Xiangyu Zhao, Huifeng Guo, Ruiming Tang
| Challenge: | Lack of training data leads to the system cold-start problem in recommendation systems, making them struggle to provide effective recommendations. |
| Approach: | They propose a tree-based LLM recommendation framework which structures all items into an item tree to improve the efficiency of LLM’s item retrieval. |
| Outcome: | The proposed framework outperforms the baseline model in the A/B test on Huawei industrial system. |
LayoutMask: Enhance Text-Layout Interaction in Multi-modal Pre-training for Document Understanding (2023.acl-long)
Copied to clipboard
| Challenge: | Pre-trained models on document images with transformer-based backbones have led to significant performance gains in this field. |
| Approach: | They propose a multi-modal pre-training model that combines text, layout and image . they propose to use local 1D position instead of global 1D positions as layout input . |
| Outcome: | The proposed model can achieve state-of-the-art results on a wide variety of VrDU problems. |
Deeply Coupled Cross-Modal Prompt Learning (2023.findings-acl)
Copied to clipboard
| Challenge: | Existing prompt-tuning methods focus on language branch or learn vision-language interaction in a shallow mechanism. |
| Approach: | They propose a Deeply coupled Cross-modal Prompt learning method based on CLIP to facilitate the interplay between vision and language with a Cross-Modal Prompting Attention mechanism. |
| Outcome: | The proposed method enables the interplay between vision and language with a Cross-Modal Prompt Attention mechanism. |
Empowering GraphRAG with Knowledge Filtering and Integration (2025.emnlp-main)
Copied to clipboard
| Challenge: | Large language models suffer from knowledge gaps and hallucinations, resulting in incorrect or poor reasoning. |
| Approach: | They propose Graph retrieval-augmented generation (GraphRAG) which integrates structured knowledge from external graphs to enhance model's reasoning. |
| Outcome: | Experiments on knowledge graph QA tasks show that GraphRAG significantly improves reasoning performance across multiple backbone models. |
Can Federated Learning Safeguard Private Data in LLM Training? Vulnerabilities, Attacks, and Defense Evaluation (2025.findings-emnlp)
Copied to clipboard
| Challenge: | federated learning (FL) fine-tunes large language models with local data, but organizations are reluctant to share local data. |
| Approach: | They propose a framework for fine-tuning large language models with local data . they propose centralized fine- tuning with local datasets is a good idea . |
| Outcome: | The proposed framework allows clients to retain local data while sharing only model parameters for training. |
Response-G1: Explicit Scene Graph Modeling for Proactive Streaming Video Understanding (2026.acl-long)
Copied to clipboard
Ke Ma, Jiaqi Tang, Bin Guo, Xueting Han, Ruonan Xu, Qingfeng He, Ziheng Wang, Xu Wang, Qifeng Chen, Zhiwen Yu, Yunhao Liu
| Challenge: | Existing methods for streaming video understanding are query-agnostic and implicitly model video evidence. |
| Approach: | They propose a framework that establishes explicit, structured alignment between the accumulated video evidence and the query’s expected response conditions via scene graphs. |
| Outcome: | The proposed model achieves more interpretable and accurate response timing decisions on both proactive and reactive tasks. |
From Implicit Graph Encoding to Explicit Evidence: A Training-Free LLM Framework for Temporal Knowledge Graph Reasoning (2026.findings-acl)
Copied to clipboard
Guo Tang, Ke Cheng, Huiming Fan, Heng Chang, Wenxiang Zheng, Xianhao Ou, Junjia Xiang, Ming Liu, Yujun Zhou, Li Lanyu, Bing Qin
| Challenge: | Existing Large Language Models (LLMs) struggle with implicit modality alignment and suboptimal graph linearization. |
| Approach: | They propose a training-free, test-time adaptive framework that reframes TKG prediction as explicit evidence-driven reasoning. |
| Outcome: | ExE-LLM outperforms fully trained graph neural networks on four benchmarks . it achieves SOTA performance in inductive settings, significantly outperforming fully trained neural networks . |
SEEKR: Selective Attention-Guided Knowledge Retention for Continual Learning of Large Language Models (2024.emnlp-main)
Copied to clipboard
| Challenge: | Existing methods fail to fully exploit the knowledge embedded in models from previous tasks . Existing techniques fail to exploit the information embedded in previous tasks, resulting in a large number of replay samples to achieve good results. |
| Approach: | They propose a method that uses attention weights to extract knowledge from previous tasks . they use a data replay strategy to extract the knowledge from the previous tasks. |
| Outcome: | The proposed method achieves comparable or even better performance with only 1/10 of replayed data used by other methods. |
Reading Order Matters: Information Extraction from Visually-rich Documents by Token Path Prediction (2023.emnlp-main)
Copied to clipboard
| Challenge: | Recent advances in multimodal pre-trained models have significantly improved information extraction from visually-rich documents (VrDs). |
| Approach: | They propose a method to predict token sequences within visually-rich documents by a simple prediction head. |
| Outcome: | The proposed method can be used to predict token mentions as token sequences within documents. |
Neural Parameter Search for Slimmer Fine-Tuned Models and Better Transfer (2025.acl-long)
Copied to clipboard
Guodong Du, Zitao Fang, Jing Li, Junlin Li, Runhua Jiang, Shuyang Yu, Yifei Guo, Yangneng Chen, Sim Kuan Goh, Ho-Kin Tang, Daojing He, Honghai Liu, Min Zhang
| Challenge: | Foundational models and their checkpoints have advanced deep learning, boosting performance across applications. |
| Approach: | They propose a method for pruning fine-tuned models by calculating differences between them and original model. |
| Outcome: | The proposed method can improve performance across vision, NLP, and multi-modal benchmarks. |
Multi-Task Learning for Conversational Question Answering over a Large-Scale Knowledge Base (D19-1)
Copied to clipboard
| Challenge: | Recent approaches to handle large knowledge base decompose tasks into subtasks and solve them sequentially. |
| Approach: | They propose a multi-task learning framework that resolves coreference in conversations . they propose enabling shared supervisions and type-aware entity detection model . |
| Outcome: | The proposed framework improves overall F1 score from 67% to 79% on a large-scale conversational question answering dataset. |
LLMRouterBench: A Massive Benchmark and Unified Framework for LLM Routing (2026.findings-acl)
Copied to clipboard
Hao Li, Yiqun Zhang, Zhaoyan Guo, Chenxu Wang, Shengji Tang, Qiaosheng Zhang, Yang Chen, Biqing Qi, Peng Ye, Lei Bai, Zhen Wang, Shuyue Hu
| Challenge: | Large language model (LLM) routing assigns each query to the best suitable model from an ensemble. |
| Approach: | They introduce a large-scale benchmark and unified framework for LLM routing . they find that many routing methods exhibit similar performance under unified evaluation . |
| Outcome: | The proposed benchmark provides comprehensive metrics for both performance-oriented and performance-cost trade-off routing. |
Towards Benchmarking Situational Awareness of Large Language Models:Comprehensive Benchmark, Evaluation and Analysis (2024.findings-emnlp)
Copied to clipboard
| Challenge: | Situational awareness is crucial for decision-making, anticipating potential issues, and adapting to dynamic circumstances. |
| Approach: | They propose a benchmark that covers three tiers of situational awareness capabilities . they conduct extensive experiments on advanced LLMs including GPT-4, LLaMA3, Qwen1.5 . |
| Outcome: | The proposed benchmark covers environment perception, situation comprehension and future projection. |
LICHEE: Improving Language Model Pre-training with Multi-grained Tokenization (2021.findings-acl)
Copied to clipboard
| Challenge: | Pre-trained language models are trained based on single-grained tokenization, making it hard to learn the precise meaning of coarse-grain words and phrases. |
| Approach: | They propose a language model pretraining method that incorporates multi-grained information of input text into pre-trained language models. |
| Outcome: | The proposed method improves performance on CLUE and SuperGLUE in Chinese and English with little extra inference cost. |
Automatic Annotation Augmentation Boosts Translation between Molecules and Natural Language (2025.findings-naacl)
Copied to clipboard
| Challenge: | Recent advances in AI for biological research focus on integrating molecular data with natural language to accelerate drug discovery. |
| Approach: | They propose a Language-based Automatic Annotation Augmentation framework that leverages large language models to augment existing datasets. |
| Outcome: | The proposed framework outperforms state-of-the-art models on text-based tasks and validates its versatility and utility. |
Beyond Literal Mapping: Benchmarking and Improving Non-Literal Translation Evaluation (2026.acl-long)
Copied to clipboard
| Challenge: | Large Language Models (LLMs) have advanced machine translation (MT) a meta-evaluation dataset focused on non-literal translations is lacking . experimental results show the inaccuracies of traditional MT metrics and the limitations of LLM-as-a-Judge. |
| Approach: | They propose a meta-evaluation framework that leverages sub-agents to evaluate machine translation metrics. |
| Outcome: | The proposed framework improves on the knowledge cutoff and score inconsistency problem. |
MultiAgentBench : Evaluating the Collaboration and Competition of LLM agents (2025.acl-long)
Copied to clipboard
Kunlun Zhu, Hongyi Du, Zhaochen Hong, Xiaocheng Yang, Shuyi Guo, Zhe Wang, Zhenhailong Wang, Cheng Qian, Robert Tang, Heng Ji, Jiaxuan You
| Challenge: | Large Language Models (LLMs) have shown remarkable capabilities as autonomous agents, yet existing benchmarks focus on single-agent tasks or are confined to narrow domains, failing to capture the dynamics of multi-agent coordination and competition. |
| Approach: | They propose a benchmark to evaluate LLM-based multi-agent systems across diverse, interactive scenarios. |
| Outcome: | The proposed framework measures task completion and quality of collaboration and competition using novel, milestone-based key performance indicators. |
RepoShapley: Shapley-Enhanced Context Filtering for Repository-Level Code Completion (2026.findings-acl)
Copied to clipboard
| Challenge: | Large language models have strong reasoning, coding, and generation capabilities, but retrieval-augmented generation remains difficult under fixed context budgets. |
| Approach: | They propose a coalition-aware context filtering framework supervised by Shapley-style marginal contributions that captures sign effects via teacher-forced probing and computes exact Shaply values for small retrieval sets. |
| Outcome: | Experiments show that RepoShapley improves completion quality while reducing harmful context and unnecessary retrieval. |
ChatKBQA: A Generate-then-Retrieve Framework for Knowledge Base Question Answering with Fine-tuned Large Language Models (2024.findings-acl)
Copied to clipboard
Haoran Luo, Haihong E, Zichen Tang, Shiyao Peng, Yikai Guo, Wentai Zhang, Chenghao Ma, Guanting Dong, Meina Song, Wei Lin, Yifan Zhu, Anh Tuan Luu
| Challenge: | Existing KBQA methods address inefficient knowledge retrieval and semantic parsing errors. |
| Approach: | They propose a generatethen-retrieve KBQA framework that generates logical form and replaces entities and relations with an unsupervised retrieval method to improve both generation and retrieval more directly. |
| Outcome: | Experimental results show that ChatKBQA achieves new state-of-the-art performance on standard KBQA datasets, WebQSP, and CWQ. |
CodeBERT: A Pre-Trained Model for Programming and Natural Languages (2020.findings-emnlp)
Copied to clipboard
Zhangyin Feng, Daya Guo, Duyu Tang, Nan Duan, Xiaocheng Feng, Ming Gong, Linjun Shou, Bing Qin, Ting Liu, Daxin Jiang, Ming Zhou
| Challenge: | Large pre-trained models have improved performance on a variety of natural language processing tasks. |
| Approach: | They develop a bimodal pre-trained model for programming language (PL) and natural language (NL) it incorporates a hybrid objective function that detects replaced tokens from generators. |
| Outcome: | The proposed model performs better on two NL-PL applications by fine-tuning model parameters. |
MagicBench: Diagnosing Visual Agency Loss and Semantic Dependency in Multimodal LLMs (2026.acl-long)
Copied to clipboard
| Challenge: | MLLMs assume linguistic context invariably enhances visual understanding . a diagnostic benchmark is used to evaluate ML models under hierarchical linguistic interference . |
| Approach: | They propose a diagnostic benchmark to evaluate MLLMs under hierarchical linguistic interference. |
| Outcome: | The proposed benchmark compared 402 videos with a physical constraint set to evaluate MLLMs under hierarchical linguistic interference. |
HAHE: Hierarchical Attention for Hyper-Relational Knowledge Graphs in Global and Local Level (2023.acl-long)
Copied to clipboard
Haoran Luo, Haihong E, Yuhao Yang, Yikai Guo, Mingzhi Sun, Tianyu Yao, Zichen Tang, Kaiyang Wan, Meina Song, Wei Lin
| Challenge: | Existing research on HKGs rarely models the graphical and sequential structure of HKG, limiting their representation. |
| Approach: | They propose a Hierarchical Attention model for HKG Embedding that includes global-level and local-level attention to model the graphical structure of HKGs. |
| Outcome: | The proposed model achieves state-of-the-art performance on HKG standard datasets and addresses the issue of HKG multi-position prediction for the first time. |
Good Meta-tasks Make A Better Cross-lingual Meta-transfer Learning for Low-resource Languages (2023.findings-emnlp)
Copied to clipboard
| Challenge: | Model-agnostic meta-learning has garnered attention as a promising technique for enhancing few-shot cross-lingual transfer learning in low-resource scenarios. |
| Approach: | They propose a Meta-Task Collector-based Cross-lingual Meta-Transfer framework to adapt data selection strategies to construct cross-lingual meta-tasks to reduce language gaps. |
| Outcome: | The proposed framework significantly improves model performance in the target language with minimal annotation costs. |
To See a World in a Spark of Neuron: Disentangling Multi-Task Interference for Training-Free Model Merging (2025.emnlp-main)
Copied to clipboard
Zitao Fang, Guodong Du, Shuyang Yu, Yifei Guo, Yiwei Zhang, Yiyao Cao, Jing Li, Ho-Kin Tang, Sim Kuan Goh
| Challenge: | Existing approaches to model merging ignore the fundamental roles of neurons, connectivity and activation. |
| Approach: | They propose a framework that relies on neuronal mechanisms to mitigate task interference . they decomposed task-specific representations into two complementary subspaces . their results offer new insights into mitigating task interference and improving knowledge fusion . |
| Outcome: | The proposed framework reduces task interference within neurons and improves knowledge fusion. |
Syntax-Enhanced Pre-trained Model (2021.acl-long)
Copied to clipboard
Zenan Xu, Daya Guo, Duyu Tang, Qinliang Su, Linjun Shou, Ming Gong, Wanjun Zhong, Xiaojun Quan, Daxin Jiang, Nan Duan
| Challenge: | Existing methods that use syntax of text in pre-training and fine-tuning suffer from discrepancy between the two stages. |
| Approach: | They propose a model that utilizes the syntactic structure of text in pre-training and fine-tuning stages. |
| Outcome: | The proposed model achieves state-of-the-art on six public benchmark datasets. |
Self-Critique Guided Iterative Reasoning for Multi-hop Question Answering (2025.findings-acl)
Copied to clipboard
Zheng Chu, Huiming Fan, Jingchang Chen, Qianyu Wang, Mingda Yang, Jiafeng Liang, Zhongjie Wang, Hao Li, Guo Tang, Ming Liu, Bing Qin
| Challenge: | Large language models (LLMs) have demonstrated remarkable reasoning capabilities, but they still face challenges in knowledge-intensive multi-hop reasoning. |
| Approach: | They propose a method that uses self-critique feedback to guide iterative reasoning by enabling iteration and self-evaluation of its intermediate reasoning steps. |
| Outcome: | The proposed method surpasses the previous SOTA by 8.6% on three multi-hop reasoning datasets. |
Coupling Retrieval and Meta-Learning for Context-Dependent Semantic Parsing (P19-1)
Copied to clipboard
| Challenge: | a context-aware retrieval model and a meta-learning paradigm are used for context-dependent semantic parsing . |
| Approach: | They propose a retrieval model and a meta-learner to incorporate retrieved datapoints as context-dependent semantic parsing evidence. |
| Outcome: | The proposed approach performs better than retrieve-and-edit baselines on CONCODE and CSQA datasets. |
Bootstrapped Pre-training with Dynamic Identifier Prediction for Generative Retrieval (2024.findings-acl)
Copied to clipboard
| Challenge: | Existing methods for document retrieval rely on static document identifiers . experimental results show that generative retrieval is outperforms dense retrieval in document retrievals. |
| Approach: | They propose a bootstrapped pre-training method that dynamically adjusts document identifiers during pre-train to accommodate the continuing memorization of the corpus. |
| Outcome: | The proposed method significantly outperforms existing pre-training generative retrieval baselines and performs well even in zero-shot settings. |
Analytical Reasoning of Text (2022.findings-naacl)
Copied to clipboard
Wanjun Zhong, Siyuan Wang, Duyu Tang, Zenan Xu, Daya Guo, Yining Chen, Jiahai Wang, Jian Yin, Ming Zhou, Nan Duan
| Challenge: | Existing models with implicit reasoning ability struggle to solve analytical reasoning of text. |
| Approach: | They propose an approach to analyze text and use it to perform reasoning over it. |
| Outcome: | The proposed approach outperforms pre-trained models on an analysis of the Law School Admission Test dataset. |
DenseSSM: State Space Models with Dense Hidden Connection for Efficient Large Language Models (2025.naacl-long)
Copied to clipboard
| Challenge: | Large language models (LLMs) face excessive computational and memory requirements due to the commonly used Transformer architecture. |
| Approach: | They propose a method to enhance the flow of hidden information between layers in large language models by selectively integrating shallow-layer hidden states into deeper layers. |
| Outcome: | The proposed method maintains parallelizability and inference efficiency of SSMs while significantly boosting performance on public benchmarks. |
Document-level Relation Extraction with Dual-tier Heterogeneous Graph (2020.coling-main)
Copied to clipboard
| Challenge: | Existing methods focus on extracting relations from single sentence . document-level relation extraction requires a comprehension of the whole document . |
| Approach: | They propose a graph-based model with Dual-tier Heterogeneous Graph (DHG) for document-level relation extraction. |
| Outcome: | The proposed model achieves state-of-the-art performance on two widely used datasets. |
Adaptive Prompt Structure Factorization: A Framework for Self-Discovering and Optimizing Compositional Prompt Programs (2026.acl-long)
Copied to clipboard
| Challenge: | Large language models (LLMs) exhibit strong capabilities in reasoning, coding, and complex generation, yet their performance is highly sensitive to prompt design. |
| Approach: | They propose an API-only framework that decomposes a single prompt into semantic factors and updates selected factors while freezing the rest. |
| Outcome: | The proposed framework outperforms strong baselines, improves accuracy by up to +4.29 percentage points on average, and reduces optimization cost by 45–87% tokens on MultiArith while reaching peak validation in 1 step. |
Cracking the Code of Hallucination in LVLMs with Vision-aware Head Divergence (2025.acl-long)
Copied to clipboard
Jinghan He, Kuan Zhu, Haiyun Guo, Junfeng Fang, Zhenglin Hua, Yuheng Jia, Ming Tang, Tat-Seng Chua, Jinqiao Wang
| Challenge: | Existing methods focus on alignment training or decoding refinements but address symptoms at the generation stage without probing the underlying causes. |
| Approach: | They propose a training-free approach to mitigate hallucination by enhancing the role of vision-aware attention heads. |
| Outcome: | The proposed method achieves superior performance compared to state-of-the-art approaches in mitigating hallucinations while maintaining high efficiency with negligible additional time overhead. |
Towards Faithful Multi-step Reasoning through Fine-Grained Causal-aware Attribution Reasoning Distillation (2025.coling-main)
Copied to clipboard
| Challenge: | Recent advances have witnessed large language models (LLMs) achieving significant milestones across various domains of natural language processing. |
| Approach: | They introduce fine-grained attribution reasoning distillation (FARD) which incorporates grounded citations to consolidate the relationships between reasoning steps. |
| Outcome: | The proposed method outperforms CoT distillation methods on mathematical and general reasoning benchmarks. |
LLMBox: A Comprehensive Library for Large Language Models (2024.acl-demos)
Copied to clipboard
Tianyi Tang, Hu Yiwen, Bingqian Li, Wenyang Luo, ZiJing Qin, Haoxiang Sun, Jiapeng Wang, Shiyi Xu, Xiaoxue Cheng, Geyang Guo, Han Peng, Bowen Zheng, Yiru Tang, Yingqian Min, Yushuo Chen, Jie Chen, Ranchi Zhao, Luran Ding, Yuhao Wang, Zican Dong, Xia Chunxuan, Junyi Li, Kun Zhou, Xin Zhao, Ji-Rong Wen
| Challenge: | a library to facilitate the development, use, and evaluation of large language models (LLMs) is presented. |
| Approach: | They propose a unified library to facilitate the development, use and evaluation of large language models (LLMs). |
| Outcome: | The proposed library is based on extensive experiments in a variety of evaluation settings. |
Human-Agent Collaborative Paper-to-Page Crafting (2026.findings-acl)
Copied to clipboard
Qianli Ma, Siyu Wang, Chen Yilin, Yinhao Tang, Yixiang Yang, Chang Guo, Bingjie Gao, Zhening Xing, Yanan Sun, Zhipeng Zhang
| Challenge: | Existing approaches to create project pages from academic papers have focused on static slides and posters, but the dynamic nature of webpages remains an unaddressed challenge. |
| Approach: | They propose a novel multi-agent system that deconstructs paper-to-page creation into a coarse-to fine pipeline from narrative planning to multimodal content generation and interactive rendering. |
| Outcome: | The proposed system generates high-quality, visually appealing pages in under 15 minutes for less than $0.1 . |
Knowledge Fusion By Evolving Weights of Language Models (2024.findings-acl)
Copied to clipboard
| Challenge: | Experimental results on mainstream language models show that Evolver outperforms previous state-of-the-art models by large margins due to the high training costs of large language models. |
| Approach: | They propose a method to integrate multiple models from diverse training scenarios into a unified model. |
| Outcome: | The proposed method outperforms state-of-the-art models on mainstream language models by large margins. |
ItiNera: Integrating Spatial Optimization with Large Language Models for Open-domain Urban Itinerary Planning (2024.emnlp-industry)
Copied to clipboard
Yihong Tang, Zhaokai Wang, Ao Qu, Yihao Yan, Zhaofeng Wu, Dingyi Zhuang, Jushi Kai, Kebing Hou, Xiaotong Guo, Jinhua Zhao, Zhan Zhao, Wei Ma
| Challenge: | Existing urban itinerary planning studies focus on traditional tourism, but they lack the precision and accuracy needed to create a personalized itinerary. |
| Approach: | They propose an open-domain urban itinerary planning system that integrates spatial optimization with large language models to provide customized urban itineraries based on user needs. |
| Outcome: | The proposed system can generate personalized urban itineraries based on user needs and scale with existing methods. |
Utility-Focused LLM Annotation for Retrieval and Retrieval-Augmented Generation (2025.emnlp-main)
Copied to clipboard
Hengran Zhang, Minghao Tang, Keping Bi, Jiafeng Guo, Shihao Liu, Daiting Shi, Dawei Yin, Xueqi Cheng
| Challenge: | Existing studies on large language models for document utility annotations have shown that they improve retrieval performance and RAG outcomes compared to models trained on human annotations. |
| Approach: | They propose a model that maximizes their summed marginal likelihood to annotate document utility on multiple positive samples per query. |
| Outcome: | The proposed model maximizes the marginal likelihood of multiple positive samples per query. |
An Effective Post-training Embedding Binarization Approach for Fast Online Top-K Passage Matching (2022.aacl-short)
Copied to clipboard
| Challenge: | Existing models that learn semantic representations of passages are prone to performance degradation . embedding binarization is a promising branch of model compression . |
| Approach: | They propose an embedding binarization approach that can be used to optimize for online inference. |
| Outcome: | The proposed model can perform query-passage matching acceleration. |