Papers by Fei Liu
Progra: Progress-Aware Reinforcement Learning for Multi-Turn Function Calling (2026.findings-acl)
Copied to clipboard
Huacan Chai, Zijie Cao, Maolin Ran, Yingxuan Yang, Jianghao Lin, Xin Peng, Hairui Wang, Renjie Ding, Ziyu Wan, Muning Wen, Weiwen Liu, Weinan Zhang, Fei Huang, Ying Wen
| Challenge: | Existing methods for multi-turn function calling are limited by redundancy and lack explicit integration of progress awareness into training. |
| Approach: | They propose a framework that explicitly integrates progress awareness into LLM training for multi-turn function calling. |
| Outcome: | Empirical results show that Progra outperforms existing methods on two public benchmarks. |
MIBench: Evaluating Multimodal Large Language Models over Multiple Images (2024.emnlp-main)
Copied to clipboard
Haowei Liu, Xi Zhang, Haiyang Xu, Yaya Shi, Chaoya Jiang, Ming Yan, Ji Zhang, Fei Huang, Chunfeng Yuan, Bing Li, Weiming Hu
| Challenge: | Existing benchmarks and MLLMs focus on single-image input scenarios, leaving performance of ML models when handling multiple images underexplored. |
| Approach: | They propose a benchmark to evaluate fine-grained abilities of multimodal large language models in multi-image scenarios. |
| Outcome: | The proposed benchmark categorizes the multi-image abilities into three scenarios: MII, MKS and MIC. |
OmniCharacter: Towards Immersive Role-Playing Agents with Seamless Speech-Language Personality Interaction (2025.acl-long)
Copied to clipboard
Haonan Zhang, Run Luo, Xiong Liu, Yuchuan Wu, Ting-En Lin, Pengpeng Zeng, Qiang Qu, Feiteng Fang, Min Yang, Lianli Gao, Jingkuan Song, Fei Huang, Yongbin Li
| Challenge: | Existing methods focus on replicating dialogues in textual form, neglecting the role’s voice traits as a crucial effect in interaction, which tends to be more immersive experiences in realistic scenarios. |
| Approach: | They propose a first seamless speech-language personality interaction model to achieve immersive RPAs with low latency. |
| Outcome: | The proposed model exhibits role-specific personality traits and vocal traits throughout the interaction, enabling a mixture of speech and language responses. |
Improving Factual Consistency for Knowledge-Grounded Dialogue Systems via Knowledge Enhancement and Alignment (2023.findings-emnlp)
Copied to clipboard
Boyang Xue, Weichao Wang, Hongru Wang, Fei Mi, Rui Wang, Yasheng Wang, Lifeng Shang, Xin Jiang, Qun Liu, Kam-Fai Wong
| Challenge: | Experimental results show that pretrained language models generate inconsistent factual knowledge in many conversational tasks. |
| Approach: | They propose a method which explicitly introduces extended feedforward networks (FFNs) in Transformers to enhance factual knowledge expressions given the specific patterns of knowledge-grounded dialogue inputs. |
| Outcome: | The proposed methods improve the factual expression capability of feedforward networks (FFNs) in knowledge-grounded dialogue systems by knowledge enhancement and alignment respectively. |
Too Long, Do Re-weighting for Efficient LLM Reasoning Compression (2026.acl-long)
Copied to clipboard
Zhong-Zhi Li, Xiao Liang, Zihao Tang, Lei Ji, Peijie Wang, Haotian Xu, Xing W, Haizhen Huang, Weiwei Deng, Yeyun Gong, Zhijiang Guo, Xiao Liu, Fei Yin, Cheng-Lin Liu
| Challenge: | Large Language Models (LLMs) have recently achieved remarkable progress on complex reasoning tasks by leveraging extended Chain-of-Thought (CoT) techniques. |
| Approach: | They propose a method that uses Extended Chain-of-Thought (EFT) to reduce the number of output tokens by nearly 40% while maintaining the accuracy of the reasoning. |
| Outcome: | The proposed method reduces the number of output tokens by nearly 40% while maintaining the accuracy of the reasoning. |
When Reasoning Meets Information Aggregation: A Case Study with Sports Narratives (2024.emnlp-main)
Copied to clipboard
| Challenge: | Using sports data, an LLM can analyze sports narratives to infer points from actions, identify related entities, attribute points accurately to players and teams, and draw conclusions. |
| Approach: | They propose a method to synthesize NBA basketball game narratives using real NBA basketball data and propose 'SportsGen' they find that most models fail to accurately aggregate basketball scores due to frequent scoring patterns and open-source models suffer from significant score hallucinations. |
| Outcome: | The proposed method can evaluate LLMs’ reasoning capabilities under complex scenarios with varying narrative lengths and density of information. |
Model Composition for Multimodal Large Language Models (2024.acl-long)
Copied to clipboard
Chi Chen, Yiyang Du, Zheng Fang, Ziyue Wang, Fuwen Luo, Peng Li, Ming Yan, Ji Zhang, Fei Huang, Maosong Sun, Yang Liu
| Challenge: | Existing methods for creating versatile MLLMs rely on joint training with paired instruction data, which is resource-intensive and challenging to extend to new modalities. |
| Approach: | They propose a new paradigm for multimodal large language models by reusing modality encoders and merging LLM parameters. |
| Outcome: | The proposed model retains the modal understanding capabilities of each original model. |
MSEarth: A Multimodal Benchmark for Earth Science Phenomenon Discovery with MLLMs (2026.acl-long)
Copied to clipboard
Xiangyu Zhao, Wanghan Xu, Bo Liu, Yuhao Zhou, Fenghua Ling, Ben Fei, Xiaoyu Yue, Lei Bai, Wenlong Zhang, Xiao-Ming Wu
| Challenge: | Existing datasets often rely on synthetic data or figure-caption pairs, failing to capture the depth and complexity of geoscientific reasoning. |
| Approach: | They propose a multimodal scientific dataset and benchmark curated from open-access publications. |
| Outcome: | MSEarth features over 289K figures with captions enriched by contextual discussions and reasoning from original papers. |
EmpathyEar: An Open-source Avatar Multimodal Empathetic Chatbot (2024.acl-demos)
Copied to clipboard
| Challenge: | EmpathyEar is an open-source, avatar-based multimodal empathetic chatbot . currently, ERG systems rely on text, sound, and vision . |
| Approach: | They propose an open-source, avatar-based multimodal empathetic chatbot to fill the gap in traditional text-only ERG systems. |
| Outcome: | The proposed system enables users to generate emotional responses to user queries . it can also generate avatars with talking faces and synchronized speeches . |
MolCA: Molecular Graph-Language Modeling with Cross-Modal Projector and Uni-Modal Adapter (2023.emnlp-main)
Copied to clipboard
| Challenge: | Language Models (LMs) have demonstrated impressive molecule understanding ability on 1D text-related tasks, but lack 2D graph perception, a critical ability of human professionals in comprehending molecules’ topological structures. |
| Approach: | They propose to combine a cross-modal projector and a uni-modal adapter to enable an LM to understand both text- and graph-based molecular contents via a Q-Former. |
| Outcome: | The proposed model outperforms the baselines on tasks such as molecule captioning, IUPAC name prediction, and molecule-text retrieval. |
Narrative Modeling with Memory Chains and Semantic Supervision (P18-2)
Copied to clipboard
| Challenge: | Story comprehension requires a deep semantic understanding of the narrative, making it a challenging task. |
| Approach: | They propose a method that tracks various semantic aspects with external neural memory chains . they propose to encourage each to focus on a particular semantic aspect . |
| Outcome: | The proposed method outperforms baselines on the task of story ending prediction. |
Mixture-of-Supernets: Improving Weight-Sharing Supernet Training with Architecture-Routed Mixture-of-Experts (2024.findings-acl)
Copied to clipboard
Ganesh Jawahar, Haichuan Yang, Yunyang Xiong, Zechun Liu, Dilin Wang, Fei Sun, Meng Li, Aasish Pappu, Barlas Oguz, Muhammad Abdul-Mageed, Laks Lakshmanan, Raghuraman Krishnamoorthi, Vikas Chandra
| Challenge: | Neural architecture search (NAS) uses weight-sharing supernets to generate diverse subnetworks without retraining. |
| Approach: | They propose a weight-sharing supernet that leverages mixture-of-experts to enhance supernet model expressiveness with minimal training overhead. |
| Outcome: | The proposed method achieves state-of-the-art (SoTA) performance in NAS for fast machine translation models, surpassing NAS-BERT and AutoDistil across various model sizes. |
LLMs Assist NLP Researchers: Critique Paper (Meta-)Reviewing (2024.emnlp-main)
Copied to clipboard
Jiangshu Du, Yibo Wang, Wenting Zhao, Zhongfen Deng, Shuaiqi Liu, Renze Lou, Henry Zou, Pranav Narayanan Venkit, Nan Zhang, Mukund Srinath, Haoran Zhang, Vipul Gupta, Yinghui Li, Tao Li, Fei Wang, Qin Liu, Tianlin Liu, Pengzhi Gao, Congying Xia, Chen Xing, Cheng Jiayang, Zhaowei Wang, Ying Su, Raj Shah, Ruohao Guo, Jing Gu, Haoran Li, Kangda Wei, Zihao Wang, Lu Cheng, Surangika Ranathunga, Meng Fang, Jie Fu, Fei Liu, Ruihong Huang, Eduardo Blanco, Yixin Cao, Rui Zhang, Philip Yu, Wenpeng Yin
| Challenge: | a comparative analysis of paper (meta-)reviews by large language models (LLMs) aims to identify and distinguish LLMs from human activities . |
| Approach: | They present a comparative analysis to identify and distinguish LLM activities from human activities. |
| Outcome: | The proposed analysis aims to improve recognition of instances when someone implicitly uses LLMs for reviewing activities. |
Learning to Solve Domain-Specific Calculation Problems with Knowledge-Intensive Programs Generator (2025.naacl-long)
Copied to clipboard
| Challenge: | Domain Large Language Models (LLMs) are developed for domain-specific tasks based on general LLMs, but it still requires professional knowledge to facilitate the expertise for some domain- specific tasks. |
| Approach: | They propose a pipeline to solve domain-specific calculation problems with KIPG . they use it to extract key variables and calculate outcomes dependent on domain knowledge . |
| Outcome: | The proposed pipeline solves domain-specific calculation problems more effectively . it generates knowledge-intensive programs according to the domain- specific documents . |
DecipherPref: Analyzing Influential Factors in Human Preference Judgments via GPT-4 (2023.emnlp-main)
Copied to clipboard
| Challenge: | Human preference judgments are important in large language models to produce outputs that align with human values. |
| Approach: | They conduct an in-depth examination of pairwise human judgments released by OpenAI . they find that most favored factors vary across tasks and genres . |
| Outcome: | The proposed model reveals that most favored factors vary across tasks and genres . the findings have implications on the construction of balanced datasets in human preference evaluations - crucial step in shaping behavior of future LLMs. |
LMTurk: Few-Shot Learners as Crowdsourcing Workers in a Language-Model-as-a-Service Framework (2022.findings-naacl)
Copied to clipboard
| Challenge: | Recent work shows that large-scale pretrained language models (PLMs) are effective few-shot learners. |
| Approach: | They propose a method that treats few-shotlearners as crowdsourcing workers . they propose to use these workers to train models that solve a task well . |
| Outcome: | The proposed approach treats few-shotlearners as crowdsourcing workers . the resulting annotations can be utilized to train models that solve the task well . |
Automatic Detection of Vague Words and Sentences in Privacy Policies (D18-1)
Copied to clipboard
| Challenge: | a recent study has raised concerns over privacy policies' opaqueness . lack of clarity in privacy policies can lead to undesired ads and privacy breaches . |
| Approach: | They propose to analyze the semantics of vague words and sentences and use them to identify vague content in privacy policies. |
| Outcome: | The proposed methods are effective and provide suggestions for improving privacy policies. |
Guided Knowledge Generation with Language Models for Commonsense Reasoning (2024.findings-emnlp)
Copied to clipboard
| Challenge: | Large Language Models (LLMs) have achieved notable success in commonsense reasoning tasks, benefiting from extensive world knowledge acquired through extensive pretraining. |
| Approach: | They propose a method to generate knowledge explanations and to automatically assign labels based on the probability of correct answers. |
| Outcome: | The proposed method outperforms baselines on four widely-used commonsense reasoning benchmarks and shows that it can generate high quality knowledge leading to correct answers. |
Budget-Constrained Tool Learning with Planning (2024.findings-acl)
Copied to clipboard
| Challenge: | Existing methods for budget-constrained tool learning have been overlooked . et al., 2023b) compared tool learning with other methods to improve performance . |
| Approach: | They propose a method for budget-constrained tool learning by creating a preferable plan under the budget constraint before utilizing the tools. |
| Outcome: | The proposed method reduces the cost of tool learning and reaches competitive Pass Rate. |
Generating User-Engaging News Headlines (2023.acl-long)
Copied to clipboard
| Challenge: | Personalized news recommendation systems present the same headline to all users, making it difficult for them to understand the connection between their interests and the recommended article. |
| Approach: | They propose a framework that incorporates user profiling to generate personalized headlines and a combination of automated and human evaluation methods to determine user preference for personalized headline generation. |
| Outcome: | The proposed framework can generate personalized headlines that meet the needs of a diverse audience. |
OptiCo: Adaptive Distributed Training Optimization via Collaborative Agent Reasoning (2026.acl-long)
Copied to clipboard
| Challenge: | Existing distributed training frameworks are plagued by over-reliance on prior profiling and poor generalization across models/hardware. |
| Approach: | They propose a model-driven multi-agent framework that leverages Large Language Models to enable automatic and explainable distributed training strategy configuration. |
| Outcome: | The proposed framework outperforms expert-designed training strategies within 20 iterations. |
DevEval: A Manually-Annotated Code Generation Benchmark Aligned with Real-World Code Repositories (2024.findings-acl)
Copied to clipboard
Jia Li, Ge Li, Yunfei Zhao, Yongmin Li, Huanyu Liu, Hao Zhu, Lecheng Wang, Kaibo Liu, Zheng Fang, Lanshen Wang, Jiazheng Ding, Xuanming Zhang, Yuqi Zhu, Yihong Dong, Zhi Jin, Binhua Li, Fei Huang, Yongbin Li, Bin Gu, Mengfei Yang
| Challenge: | Existing benchmarks are poorly aligned with real-world code repositories and are insufficient to evaluate the coding abilities of Large Language Models (LLMs). |
| Approach: | They propose a repository-level benchmark named DevEval to evaluate LLMs' coding abilities in real-world code repositories. |
| Outcome: | The proposed benchmarks show that the LLMs perform better in real-world code repositories than existing benchmarks. |
DeFine: Decision-Making with Analogical Reasoning over Factor Profiles (2025.findings-acl)
Copied to clipboard
| Challenge: | Large language models are ideal for decision-making, but they can be difficult to process when they are verbose and include repetition, hedging, and vagueness. |
| Approach: | They propose a framework that constructs probabilistic factor profiles from complex scenarios and integrates them with analogical reasoning to guide LLMs in making decisions in new situations. |
| Outcome: | The proposed framework separates the tasks of quantifying uncertainty and incorporating it into LLM decision-making. |
ToolRM: Towards Agentic Tool-Use Reward Modeling (2026.findings-acl)
Copied to clipboard
Renhao Li, Jianhong Tu, Yang Su, Yantao Liu, Fei Huang, Hamid Alinejad-Rokny, Derek F. Wong, Junyang Lin, Min Yang
| Challenge: | lack of reliable reward models for tool-use tasks has limited progress toward agentic AI . recent advances in agentic artificial intelligence are driven by tool-using capabilities of large language models. |
| Approach: | They propose a pipeline that constructs pairwise preference data using rule-based scoring and multidimensional sampling to build lightweight reward models. |
| Outcome: | The proposed model outperforms existing models on tool calling tasks with higher accuracy. |
Data Interpreter: An LLM Agent for Data Science (2025.findings-acl)
Copied to clipboard
Sirui Hong, Yizhang Lin, Bang Liu, Bangbang Liu, Binhao Wu, Ceyao Zhang, Danyang Li, Jiaqi Chen, Jiayi Zhang, Jinlin Wang, Li Zhang, Lingyao Zhang, Min Yang, Mingchen Zhuge, Taicheng Guo, Tuo Zhou, Wei Tao, Robert Tang, Xiangtao Lu, Xiawu Zheng, Xinbing Liang, Yaying Fei, Yuheng Cheng, Yongxin Ni, Zhibin Gou, Zongze Xu, Yuyu Luo, Chenglin Wu
| Challenge: | Large Language Models (LLMs) excel in various domains but face challenges when applied to data science workflows due to their complex, multi-stage nature. |
| Approach: | They propose a hierarchical graph-based agent that represents complexity and a progressive strategy for step-by-step verification, refinement, and consistent context management. |
| Outcome: | The proposed agent surpasses state-of-the-art baselines on the MATH dataset and performs better on InfiAgent-DABench. |
Beyond Static Testbeds: An Interaction-Centric Agent Simulation Platform for Dynamic Recommender Systems (2025.emnlp-main)
Copied to clipboard
| Challenge: | Existing platforms lack a mechanism for user actions to dynamically reshape the environment. |
| Approach: | They propose a novel agent-based simulation platform for recommender systems with a robust interaction mechanism. |
| Outcome: | The proposed platform improves the credibility of the simulation and replicates the Matthew Effect and Brand Loyalty. |
NOVA-63: Native Omni-lingual Versatile Assessments of 63 Disciplines (2025.emnlp-main)
Copied to clipboard
| Challenge: | Existing multilingual benchmarks show severe drawbacks, such as overly translated content, the absence of difficulty control, and disciplinary imbalance, making the benchmarking process unreliable and showing low convincingness. |
| Approach: | They propose a multilingual benchmark that integrates LLM-assisted formatting, expert quality verification, and multi-level difficulty screening to provide a comprehensive, difficult multilingual assessment. |
| Outcome: | The proposed benchmark features 93,536 questions sourced from native speakers across 14 languages and 63 academic disciplines. |
CLEAR: A Framework Enabling Large Language Models to Discern Confusing Legal Paragraphs (2025.findings-emnlp)
Copied to clipboard
| Challenge: | Existing work focuses on enabling LLMs to leverage legal rules to tackle complex legal reasoning tasks, but ignores their ability to understand legal rules. |
| Approach: | They propose a legal paragraph prediction task that aims to predict the legal paragraph given criminal facts and a framework CLEAR to enhance their legal reasoning ability. |
| Outcome: | The proposed model improves the ability of LLMs to analyze legal cases with the guidance of legal rule insights. |
MUZO: Leveraging Multiple Queries and Momentum for Zeroth-Order Fine-Tuning of Large Language Models (2025.emnlp-main)
Copied to clipboard
| Challenge: | Existing methods for fine-tuning large language models incur memory overhead due to the need for activation storage for back-propagation (BP). |
| Approach: | They propose a method that estimates gradients through finite differences without activation storage for back-propagation. |
| Outcome: | The proposed method demonstrates superior performance in fine-tuning various LLMs. |
Better Highlighting: Creating Sub-Sentence Summary Highlights (2020.emnlp-main)
Copied to clipboard
| Challenge: | Abstractive summarizations are considered to be less reliable because they distort the original meaning and can be confusing for readers. |
| Approach: | They propose a method to generate summary highlights that are understandable on their own to avoid confusion. |
| Outcome: | The proposed method allows summaries to be understood in context and avoids misdirecting readers to false conclusions. |
ProtT3: Protein-to-Text Generation for Text-based Protein Understanding (2024.acl-long)
Copied to clipboard
| Challenge: | Language Models excel in understanding textual descriptions of proteins, but struggle to process texts. |
| Approach: | They propose a framework for Protein-to-Text Generation for Text-based Protein Understanding that integrates a PLM as its protein understanding module. |
| Outcome: | The proposed framework surpasses existing baselines and is highly efficient in protein-to-text generation. |
Rewrite to Jailbreak: Discover Learnable and Transferable Implicit Harmfulness Instruction (2025.findings-acl)
Copied to clipboard
| Challenge: | Existing jailbreak methods create a forced instruction-following scenario, or search adversarial prompts with prefix or suffix tokens to achieve a specific representation manually or automatically. |
| Approach: | They propose a method that rewrites the original instruction to achieve a jailbreak . they propose rewriting the original instructions to improve the attack strategy . |
| Outcome: | The proposed method is more efficient and easier to identify since no additional features are introduced. |
Abstract Meaning Representation for Multi-Document Summarization (C18-1)
Copied to clipboard
| Challenge: | Abstract Meaning Representation (AMR) is a semantic representation of natural language based on linguistic theory . |
| Approach: | They propose to use Abstract Meaning Representation (AMR) as a content representation. |
| Outcome: | The proposed framework is fully data-driven and flexible. |
HELENE: Hessian Layer-wise Clipping and Gradient Annealing for Accelerating Fine-tuning LLM with Zeroth-order Optimization (2025.emnlp-main)
Copied to clipboard
| Challenge: | Large language models (LLMs) face memory challenges due to the high cost of backpropagation. |
| Approach: | They propose a zeroth-order (ZO) optimization that matches memory usage to inference . they propose scalable and memory-efficient zeroth order (ZE) optimizer that integrates annealed A-GNB gradients with diagonal Hessian estimation and layer-wise clipping as a second-order pre-conditioner. |
| Outcome: | The proposed algorithm outperforms state-of-the-art methods with an average speedup of 20 over MeZO on RoBERTa-large and OPT-1.3B. |
Robustness via Referencing: Defending against Prompt Injection Attacks by Referencing the Executed Instruction (2026.findings-acl)
Copied to clipboard
Yulin Chen, Haoran Li, Yuan Sui, Yue Liu, Yufei He, Xiaoling Bai, Chi Fei, Li Yabo, Haozhe Ma, Yangqiu Song, Bryan Hooi
| Challenge: | Prompt injection attacks manipulate large language models (LLMs) by misleading them to deviate from the original input instructions and execute maliciously injected instructions. |
| Approach: | They propose a prompt injection defense method that suppresses the model's instruction-following tendencies rather than suppressing them. |
| Outcome: | The proposed method outperforms prompt-engineering-based approaches and fine-tuning methods and reduces the ASR to nearly 0% in some scenarios. |
Evolving Knowledge Distillation with Large Language Models and Active Learning (2024.lrec-main)
Copied to clipboard
| Challenge: | Existing studies have focused on the direct use of large language models for text generation and labeling, without fully exploring their potential to comprehend the target task and acquire valuable knowledge. |
| Approach: | They propose to distill the knowledge of large language models into smaller models by generating annotated data. |
| Outcome: | The proposed method improves the performance of small domain models while enhancing the ability of large language models. |
Textual Enhanced Contrastive Learning for Solving Math Word Problems (2022.findings-emnlp)
Copied to clipboard
| Challenge: | Recent studies show that current models rely on shallow heuristics to predict solutions . a textual Enhanced Contrastive Learning framework enforces the models to distinguish semantically similar examples while holding different mathematical logic. |
| Approach: | They propose a textual Enhanced Contrastive Learning framework which enforces models to distinguish semantically similar examples while holding different mathematical logic. |
| Outcome: | The proposed framework improves on benchmark and challenge datasets in English and Chinese. |
Writing-RL: Advancing Long-form Writing via Adaptive Curriculum Reinforcement Learning (2026.acl-long)
Copied to clipboard
Xuanyu Lei, Chenliang Li, Yuning Wu, Kaiming Liu, Weizhou Shen, Peng Li, Ming Yan, Fei Huang, Ya-Qin Zhang, Yang Liu
| Challenge: | Recent advances in Large Language Models (LLMs) have enabled strong performance in long-form writing, but current training paradigms remain limited. |
| Approach: | They propose an Adaptive Curriculum Reinforcement Learning framework to advance long-form writing capabilities beyond SFT. |
| Outcome: | Experiments on 7B-scale writer models show that Writing-RL improves long-form writing performance over strong SFT baselines. |
Identifying Factual Inconsistencies in Summaries: Grounding LLM Inference via Task Taxonomy (2024.findings-emnlp)
Copied to clipboard
| Challenge: | Existing studies have focused on specialized BERT-variants and recent LLMs to reason inconsistencies. |
| Approach: | They propose to incorporate task-specific taxonomy into inferences to facilitate both zero-shot and supervised paradigms. |
| Outcome: | The proposed model outperforms specialized non-LLM and recent LLM models in a number of domains. |
De-Biased Court’s View Generation with Causality (2020.emnlp-main)
Copied to clipboard
Yiquan Wu, Kun Kuang, Yating Zhang, Xiaozhong Liu, Changlong Sun, Jun Xiao, Yueting Zhuang, Luo Si, Fei Wu
| Challenge: | Existing approaches to court’s view generation can be used to address this problem, but neglecting the confounding bias in data can limit the model performance and pollute learning outcomes. |
| Approach: | They propose a novel Attentional and Counterfactual based Natural Language Generation method consisting of an attentional encoder and a pair of innovative counterfactual decoders to generate judgment-discriminative court's views. |
| Outcome: | The proposed method is able to generate judgment-discriminative court's views (both supportive and non-supportive views) under both quantitative and qualitative evaluation metrics. |
Enhancing Court View Generation with Knowledge Injection and Guidance (2024.lrec-main)
Copied to clipboard
| Challenge: | Existing methods of natural language generation (NLG) rely on the extensive parameters of pretrained language models (PLMs) but their effectiveness may be compromised by insufficient domain-specific knowledge. |
| Approach: | They propose a knowledge-injected prompt encoder to incorporate domain knowledge during the training stage, thereby reducing computational overhead. |
| Outcome: | The proposed approach outperforms established baselines on real-world data in responsivity of claims and in the ability to transfer domain knowledge. |
Efficient Sequence Learning with Group Recurrent Networks (N18-1)
Copied to clipboard
| Challenge: | Recurrent neural networks have achieved state-of-the-art results in many artificial intelligence tasks, such as language modeling, neural machine translation and speech recognition. |
| Approach: | They propose an efficient architecture to improve the efficiency of such RNN model training by adopting the group strategy for recurrent layers while exploiting the representation rearrangement strategy between layers as well as time steps. |
| Outcome: | The proposed architecture achieves comparable or better accuracy compared with baselines, with a much smaller number of parameters and at a lower computational cost. |
MMEvol: Empowering Multimodal Large Language Models with Evol-Instruct (2025.findings-acl)
Copied to clipboard
Run Luo, Haonan Zhang, Longze Chen, Ting-En Lin, Xiong Liu, Yuchuan Wu, Min Yang, Yongbin Li, Minzheng Wang, Pengpeng Zeng, Lianli Gao, Heng Tao Shen, Yunshui Li, Hamid Alinejad-Rokny, Xiaobo Xia, Jingkuan Song, Fei Huang
| Challenge: | a new framework for image-text instruction data evolution improves MLLM performance . lack of high-quality instruction data remains a major bottleneck in ML modeling . |
| Approach: | They propose a multimodal instruction data evolution framework that iteratively enhances data quality through fine-grained perception, cognitive reasoning, and interaction evolution. |
| Outcome: | The proposed approach improves MLLM performance in nine vision-language tasks while using significantly less data. |
ComSearch: Equation Searching with Combinatorial Strategy for Solving Math Word Problems with Weak Supervision (2023.eacl-main)
Copied to clipboard
| Challenge: | Existing weakly-supervised methods for solving math word problems are expensive and time-consuming. |
| Approach: | They propose a weakly-supervised approach to solve math word problems . they propose 'comsearch' algorithm which compresses the search space by excluding mathematically equivalent equations. |
| Outcome: | The proposed algorithm can compress the search space by excluding mathematically equivalent equations. |
Browse and Concentrate: Comprehending Multimodal Content via Prior-LLM Context Fusion (2024.acl-long)
Copied to clipboard
Ziyue Wang, Chi Chen, Yiqi Zhu, Fuwen Luo, Peng Li, Ming Yan, Ji Zhang, Fei Huang, Maosong Sun, Yang Liu
| Challenge: | Multimodal Large Language Models (MLLMs) lack understanding of multi-image and interleaved inputs due to the visual features encoded by frozen encoders before being fed into the LLM backbone. |
| Approach: | They propose a two phase paradigm to enable in-depth multimodal context fusion prior to feeding the features into LLMs. |
| Outcome: | The proposed paradigm boosts the performance on 7 multi-image scenarios, contributing to increments on average accuracy by 2.13% and 7.60% against strong MLLMs baselines with 3B and 11B LLMs, respectively. |
Gold Panning in Vocabulary: An Adaptive Method for Vocabulary Expansion of Domain-Specific LLMs (2024.emnlp-main)
Copied to clipboard
| Challenge: | Large Language Models (LLMs) struggle when it comes to specialized domains due to limited domain-specific knowledge. |
| Approach: | They propose an adaptive method that automatically identifies valuable words from a given domain vocabulary. |
| Outcome: | The proposed method has been validated on three Chinese datasets and performed on general tasks. |
Mixture-of-Minds: Multi-Agent Reinforcement Learning for Table Understanding (2026.acl-long)
Copied to clipboard
Yuhang Zhou, Mingrui Zhang, Ke Li, Mingyi Wang, Qiao Liu, Qifei Wang, Jiayi Liu, Fei Liu, Serena Li, Weiwei LI, Mingze Gao, Abhishek Kumar, Xiangjun Fan, Zhuokai Zhao, Lizhu Zhang
| Challenge: | Large language models (LLMs) have shown promise on understanding and reasoning over tables, but current approaches remain limited. |
| Approach: | They propose a multi-agent framework that decomposes table reasoning into three specialized roles: planning, coding, and answering. |
| Outcome: | The proposed framework decomposes table reasoning into three specialized roles: planning, coding, and answering. |
Memorization, Emergence, and Explaining Reversal Failures: A Controlled Study of Relational Semantics in LLMs (2026.acl-long)
Copied to clipboard
Yihua Zhu, Qianying Liu, Jiaxin Wang, Fei Cheng, Chaoran Liu, Akiko Aizawa, Sadao Kurohashi, Hidetoshi Shimodaira
| Challenge: | Autoregressive LLMs perform well on relational tasks that require linking entities via relational words, but it is unclear whether they learn the logical semantics of such relations or whether left-to-right order bias is involved. |
| Approach: | They propose a framework that generates text from symmetric/inverse triples and trains autoregressive models from scratch. |
| Outcome: | The proposed framework generates text from symmetric/inverse triples, trains autoregressive models from scratch, and evaluates memorization, logical inference, and in-context generalization to unseen entities. |
Structure-Infused Copy Mechanisms for Abstractive Summarization (C18-1)
Copied to clipboard
| Challenge: | Experimental results show that system summaries struggle to preserve syntactic meaning of source texts. |
| Approach: | They propose to incorporate syntactic information from source sentences into abstractive summaries by structure-infused copy mechanisms. |
| Outcome: | The proposed approach compares favorably to state-of-the-art methods. |
Towards Annotating and Creating Summary Highlights at Sub-sentence Level (D19-54)
Copied to clipboard
| Challenge: | Creating summary highlights at the sub-sentence level is desirable because sub-entrances are more concise than whole sentences. |
| Approach: | They propose to annotate summary-worthy sub-sentences and teach classifiers to do the same . they frame task as selecting important sentences and identifying a single most informative textual unit from each sentence. |
| Outcome: | The proposed method reduces the complexity involved in sentence compression by reducing the number of words and phrases deleted. |
Deeply Coupled Cross-Modal Prompt Learning (2023.findings-acl)
Copied to clipboard
| Challenge: | Existing prompt-tuning methods focus on language branch or learn vision-language interaction in a shallow mechanism. |
| Approach: | They propose a Deeply coupled Cross-modal Prompt learning method based on CLIP to facilitate the interplay between vision and language with a Cross-Modal Prompting Attention mechanism. |
| Outcome: | The proposed method enables the interplay between vision and language with a Cross-Modal Prompt Attention mechanism. |
A New Approach to Overgenerating and Scoring Abstractive Summaries (2021.naacl-main)
Copied to clipboard
| Challenge: | Abstractive summarization is a learning objective to produce system outputs that resemble reference summaries on a word-to-word basis. |
| Approach: | They propose a two-staged strategy to generate multiple variants of the target summary and score and select admissible ones according to users’ needs. |
| Outcome: | The proposed approach can achieve state-of-the-art on benchmark summarization datasets. |
DISC: Plug-and-Play Decoding Intervention with Similarity of Characters for Chinese Spelling Check (2025.acl-long)
Copied to clipboard
Ziheng Qiao, Houquan Zhou, Yumeng Liu, Zhenghua Li, Min Zhang, Bo Zhang, Chen Li, Ji Zhang, Fei Huang
| Challenge: | Chinese spelling check (CSC) tasks require that incorrect characters are usually similar to the correct ones in either phonetics or glyph. |
| Approach: | They propose a plug-and-play decoding intervention with similarity of characters module for Chinese spelling check (CSC) they propose to incorporate phonetic and glyph similarities only during the inference phase. |
| Outcome: | The proposed method significantly improves Chinese spelling check models on benchmarks and on benchmark datasets. |
Depth Growing for Neural Machine Translation (P19-1)
Copied to clipboard
| Challenge: | Neural machine translation models with tens and even more than a hundred blocks have shown effectiveness in image recognition. |
| Approach: | They propose a two-stage approach with three specially designed components to construct deeper NMT models. |
| Outcome: | The proposed approach improves on WMT14 EnglishGerman and EnglishFrench translation tasks. |
Analyzing Sentence Fusion in Abstractive Summarization (D19-54)
Copied to clipboard
Logan Lebanoff, John Muchovej, Franck Dernoncourt, Doo Soon Kim, Seokhwan Kim, Walter Chang, Fei Liu
| Challenge: | Abstractive summarization systems struggle to combine information from multiple sources, resulting in poor grammar and incorrect facts. |
| Approach: | They analyze the outputs of five abstractive summarization systems and examine their grammatical accuracy and faithfulness. |
| Outcome: | The proposed summarization systems are able to combine information from multiple sources, but they often fail to remain faithful to the original document. |
Enhancing Character-Level Understanding in LLMs through Token Internal Structure Learning (2025.acl-long)
Copied to clipboard
Zhu Xu, Zhiqiang Zhao, Zihan Zhang, Yuchi Liu, Quanwei Shen, Fei Liu, Yu Kuang, Jian He, Conglin Liu
| Challenge: | Large language models (LLMs) use tokenization methods but often obscure internal character structures within tokens. |
| Approach: | They propose a method that improves models’ ability to capture character positions within tokens by training them on reverse character prediction tasks using the tokenizer’s vocabulary. |
| Outcome: | Experiments show that the proposed method improves position prediction accuracy in large language models, enabling more precise identification of target characters in original text. |
A Novel Matching Paradigm: Unified Generative and Discriminative LLM with Prompt Compression for Relevance Learning (2026.acl-industry)
Copied to clipboard
Guoliang Zhao, Zixin Cui, Chao Ye, Dengwu He, Fei Huang, Yubo Liu, Shuanglong Li, Tzungren Kuo, Bin Ding, Shuang Zhang, null KunhongZhu, Zhi Guo, Liu Lin
| Challenge: | Existing approaches to matching use Large Language Models as feature extractors, underutilizing their full modeling capabilities. |
| Approach: | They propose a matching paradigm that integrates two-tower, single-towing, and generative tasks within a unified LLM framework via attention-mask partitioning. |
| Outcome: | The proposed model achieves superior performance and strong practical value in an industrial search engine. |
The Referential Reader: A Recurrent Entity Network for Anaphora Resolution (P19-1)
Copied to clipboard
| Challenge: | Existing methods for storing and accessing entity mentions are expensive and implausible for human readers. |
| Approach: | They propose a method for storing and accessing entity mentions during online text processing. |
| Outcome: | The proposed model performs well on a dataset of pronoun-name anaphora. |
Reasoning-Guided Exploration for Online DPO (2026.findings-acl)
Copied to clipboard
| Challenge: | Recent work has aimed to enhance reasoning capabilities of language models, but these methods are limited to domains with objectively verifiable answers. |
| Approach: | They propose a self-play framework to improve reasoning on general-domain data. |
| Outcome: | Experiments show that the proposed framework improves reasoning performance on general-domain data while maintaining competitive performance on verifiable academic benchmarks. |
A Cascade Approach to Neural Abstractive Summarization with Content Selection and Fusion (2020.aacl-main)
Copied to clipboard
| Challenge: | Existing systems that perform content selection and surface realization are not able to provide sufficient training data for news summarization. |
| Approach: | They propose to use a cascade architecture to perform content selection and surface realization together to generate abstracts. |
| Outcome: | The proposed architecture outperforms or outranks existing systems in terms of content selection and surface realization. |
InfiGUIAgent: A Multimodal Generalist GUI Agent with Native Reasoning and Reflection (2026.eacl-long)
Copied to clipboard
Yuhang Liu, Pengxiang Li, Zishu Wei, Congkai Xie, Xueyu Hu, Xinchen Xu, Shengyu Zhang, Xiaotian Han, Hongxia Yang, Fei Wu
| Challenge: | Existing GUI Agents face challenges in multi-step reasoning and reliance on textual annotations, limiting their effectiveness. |
| Approach: | They propose an MLLM-based GUI Agent with a two-stage supervised fine-tuning pipeline that enhances GUI understanding and grounding. |
| Outcome: | InfiGUIAgent achieves competitive performance on several GUI benchmarks, highlighting the impact of native reasoning skills in enhancing GUI interaction for automation tasks. |
Seeking Diverse Reasoning Logic: Controlled Equation Expression Generation for Solving Math Word Problems (2022.aacl-short)
Copied to clipboard
| Challenge: | Existing methods to solve Math Word Problems rely on human annotation . empirical results suggest that our method universally improves the performance on single-unknown and multiple-un unknown benchmarks. |
| Approach: | They propose a controlled equation generation solver by leveraging a set of control codes to guide the model to consider certain reasoning logic and decode the corresponding equations expressions transformed from the human reference. |
| Outcome: | The proposed method improves performance on single-unknown and multiple-un unknown benchmarks with 13.2% accuracy on the challenging multiple-unequal datasets. |
HiDe-LLaVA: Hierarchical Decoupling for Continual Instruction Tuning of Multimodal Large Language Model (2025.acl-long)
Copied to clipboard
| Challenge: | Existing methods to improve instructionfollowing performance of MLLMs often trade off memory efficiency for performance gains, compromising overall efficiency. |
| Approach: | They propose a task-specific expansion and task-general fusion framework based on variations in Centered Kernel Alignment (CKA) similarity across different model layers when trained on diverse datasets. |
| Outcome: | The proposed framework improves performance compared to existing benchmarks. |
Evaluating the Utility of Hand-crafted Features in Sequence Labelling (D18-1)
Copied to clipboard
| Challenge: | Conventional wisdom is that hand-crafted features are redundant for deep learning models . authors propose a method for using handcrafted features in a hybrid learning approach . |
| Approach: | They propose a method for exploiting handcrafted features as part of a hybrid learning approach. |
| Outcome: | The proposed method outperforms baseline models on a named entity recognition task and reduces training requirements to 60% while maintaining the same predictive accuracy. |
From Multimodal LLM to Human-level AI: Modality, Instruction, Reasoning, Efficiency and beyond (2024.lrec-tutorials)
Copied to clipboard
| Challenge: | This tutorial aims to deliver a comprehensive review of cutting-edge research in MLLMs. |
| Approach: | This tutorial will review cutting-edge research in MLLMs and examine the impact of ML in learning and reasoning. |
| Outcome: | This course will review cutting-edge research in MLLMs and examine the impact of ML models on learning, learning, and multimodal reasoning. |
MetaScale: Test-Time Scaling with Evolving Meta-Thoughts (2026.findings-acl)
Copied to clipboard
| Challenge: | Existing approaches impose fixed cognitive structures that enhance performance in specific tasks but lack adaptability across diverse scenarios. |
| Approach: | They propose a test-time scaling framework based on meta-thoughts to improve performance . meta-thinkts are adaptive thinking strategies tailored to a given task . |
| Outcome: | Experimental results show that MetaScale outperforms standard inference approaches . it can scale more effectively with increasing sampling budgets and produces more structured responses . |
Scene Graph as Pivoting: Inference-time Image-free Unsupervised Multimodal Machine Translation with Visual Scene Hallucination (2023.acl-long)
Copied to clipboard
| Challenge: | Current neural machine translation (NMT) relies on parallel sentences, which obstructs the development of NMT for minor languages. |
| Approach: | They propose an unsupervised multimodal machine translation setup where the model is trained with source-text image pairs and tested with only source- text inputs. |
| Outcome: | The proposed model outperforms the baseline model on the task and setup, helping yield translations with better completeness, relevance and fluency without relying on paired images. |
HierGR: Hierarchical Semantic Representation Enhancement for Generative Retrieval in Food Delivery Search (2025.acl-industry)
Copied to clipboard
Fuwei Zhang, Xiaoyu Liu, Xinyu Jia, Yingfei Zhang, Zenghua Xia, Fei Jiang, Fuzhen Zhuang, Wei Lin, Zhao Zhang
| Challenge: | Generative retrieval (GR) is an emerging search paradigm for food delivery search. |
| Approach: | They propose a method that harnesses the advanced query understanding capabilities of large language models to enhance the retrieval of results for complex and long-tail queries in food delivery search scenarios. |
| Outcome: | The proposed method increases the number of online orders by 0.68% for complex search intents. |
DecompEval: Evaluating Generated Texts as Unsupervised Decomposed Question Answering (2023.acl-long)
Copied to clipboard
| Challenge: | Existing evaluation metrics for natural language generation (NLG) tasks face the challenges on generalization ability and interpretability. |
| Approach: | They propose a metric that evaluates natural language generation tasks as an instruction-style question answering task and utilizes instruction-tuned pre-trained language models without training on evaluation datasets. |
| Outcome: | The proposed metric achieves state-of-the-art performance in untrained metrics for evaluating text summarization and dialogue generation, which exhibits strong dimension-level / task-level generalization ability and interpretability. |
DualRAG: A Dual-Process Approach to Integrate Reasoning and Retrieval for Multi-Hop Question Answering (2025.acl-long)
Copied to clipboard
Rong Cheng, Jinyi Liu, Yan Zheng, Fei Ni, Jiazhen Du, Hangyu Mao, Fuzheng Zhang, Bo Wang, Jianye Hao
| Challenge: | Existing approaches to multi-hop question answering struggle to identify and organize dynamic knowledge . et al., 2023; Liu e.t. al. 2023) suggest a dual-process framework for multi-step reasoning . |
| Approach: | They propose a synergistic dual-process framework that integrates reasoning and retrieval. |
| Outcome: | The proposed framework improves answer accuracy and coherence even in smaller-scale models. |
One Cannot Stand for Everyone! Leveraging Multiple User Simulators to train Task-oriented Dialogue Systems (2023.acl-long)
Copied to clipboard
| Challenge: | Recent studies have found that Task-oriented Dialogue systems can be more suitable for human users. |
| Approach: | They propose a framework to optimize ToD systems by leveraging Multiple User SimulaTors. |
| Outcome: | The proposed framework improves performance on multiWOZ with human evaluations and automatic evaluations. |
PlanGenLLMs: A Modern Survey of LLM Planning Capabilities (2025.acl-long)
Copied to clipboard
| Challenge: | Existing studies have focused on developing LLMs to automate complex planning tasks. |
| Approach: | They propose to provide a comprehensive overview of current LLM planners to fill this gap . they examine performance criteria including completeness, executability, optimality, representation, generalization, and efficiency . |
| Outcome: | The proposed survey examines performance criteria for LLM planners and highlights their strengths and weaknesses. |
Towards Interactivity and Interpretability: A Rationale-based Legal Judgment Prediction Framework (2022.emnlp-main)
Copied to clipboard
| Challenge: | Existing models lack interpretability due to the neglect of rationale in the prediction process. |
| Approach: | They propose a rationale-based legal judgment prediction framework that follows the judge's real trial logic and provides good interactivity and interpretability. |
| Outcome: | The proposed framework provides good interactivity and interpretability which enables practical use. |
Optimizing Retrieval-Augmented Generation for E-Commerce How-To Assistance (2026.acl-industry)
Copied to clipboard
| Challenge: | Recent advances in large language models (LLMs) have significantly improved Retrieval-Augmented Generation (RAG), enabling assistants that can reliably ground responses in external knowledge sources while maintaining high-quality natural language interaction. |
| Approach: | They propose a RAG-based How-To Assistant that groundes responses in a proprietary knowledge base to provide personalized customer support. |
| Outcome: | The proposed assistant can ground responses in a proprietary knowledge base while maintaining high-quality natural language interaction. |
A Study of Reinforcement Learning for Neural Machine Translation (D18-1)
Copied to clipboard
| Challenge: | Recent studies have shown that reinforcement learning (RL) is an effective approach for improving the performance of neural machine translation systems. |
| Approach: | They propose to leverage reinforcement learning to boost the performance of NMT systems trained with monolingual data. |
| Outcome: | The proposed method achieves competitive results on translation tasks in English-German, Chinese-English and English-English systems. |
Adapting the Neural Encoder-Decoder Framework from Single to Multi-Document Summarization (D18-1)
Copied to clipboard
| Challenge: | Existing methods to summarize short texts using a neural encoder-decoder are limited and expensive to obtain. |
| Approach: | They propose to use a maximal marginal relevance method to select representative sentences from multi-document input and leverage an abstractive encoder-decoder model to fuse disparate sentences to an abstract. |
| Outcome: | The proposed method compares favorably to state-of-the-art extractive and abstractive approaches judged by automatic metrics and human assessors. |
What Language Do Non-English-Centric Large Language Models Think in? (2025.findings-acl)
Copied to clipboard
Chengzhi Zhong, Qianying Liu, Fei Cheng, Junfeng Jiang, Zhen Wan, Chenhui Chu, Yugo Murawaki, Sadao Kurohashi
| Challenge: | Despite their robust performance in English, these models often exhibit reduced proficiency in non-English languages, and their outputs may reflect an inherent bias toward English-centric perspectives. |
| Approach: | They categorize non-English-centric large language models into two groups: CPMs and BLMs, which are pre-trained on a balanced mix of multiple languages from scratch. |
| Outcome: | The proposed models exhibit a pronounced internal preference for English tokens when projected into the vocabulary space. |
Rescue: Ranking LLM Responses with Partial Ordering to Improve Response Generation (2024.acl-srw)
Copied to clipboard
| Challenge: | Customizing LLMs for a specific task involves separating high-quality responses from lower-quality ones. Obtaining a large volume of expert-annotated data is costly for most tasks. |
| Approach: | They propose a method that trains the model to prioritize the best responses from a pool of candidates created for a task using ranking metrics. |
| Outcome: | The proposed method is more robust, less sensitive to noise, and can be achieved with limited human annotations or through heuristic methods. |
Outcome Accuracy is Not Enough: Aligning the Reasoning Process of Reward Models (2026.acl-long)
Copied to clipboard
Binghai Wang, Yantao Liu, Yuxuan Liu, Tianyi Tang, Shenzhi Wang, Chang Gao, Chujie Zheng, Yichang Zhang, Le Yu, Shixuan Liu, Tao Gui, Qi Zhang, Xuanjing Huang, Bowen Yu, Fei Huang, Junyang Lin
| Challenge: | Recent studies observe a phenomenon where reward models achieve high accuracy on static datasets but fail to generalize effectively during RLHF. |
| Approach: | They propose a method that combines rationale consistency with outcome accuracy to improve performance on RM-Bench and JudgeBench. |
| Outcome: | The proposed method surpasses baselines on RM-Bench and JudgeBench by an average of 5% and improves creative writing tasks by 7%. |
Find Parent then Label Children: A Two-stage Taxonomy Completion Method with Pre-trained Language Model (2023.eacl-main)
Copied to clipboard
| Challenge: | Existing taxonomies focus on adding concepts to the leaf nodes of the existing tree, which does not fully utilize the taxonomy’s knowledge and is unable to update the original taxomy structure. |
| Approach: | They propose a two-stage method called ATTEMPT for taxonomy completion that inserts new concepts into the correct position by finding a parent node and labeling child nodes. |
| Outcome: | The proposed method performs best on taxonomy completion and extension tasks, surpassing existing methods. |
Relation Extraction with Weighted Contrastive Pre-training on Distant Supervision (2023.findings-eacl)
Copied to clipboard
| Challenge: | Existing methods ignore the intrinsic noise of distant supervision during the pre-training stage. |
| Approach: | They propose a weighted contrastive learning method that explicitly reduces noise . they leverage supervised data to estimate reliability and reduce noise compared to non-weighted baselines . |
| Outcome: | The proposed method reduces the noise of distant supervision and estimates reliability of pre-training instances. |
Entity-to-Text based Data Augmentation for various Named Entity Recognition Tasks (2023.findings-acl)
Copied to clipboard
| Challenge: | Existing augmentation techniques manipulate words in the original text that break the semantic coherence of the text, or exploit generative models that ignore preserving entities in the text. |
| Approach: | They propose a novel Entity-to-Text based data augmentation technique called EnTDA to add, delete, replace or swap entities in the original text. |
| Outcome: | The proposed technique generates semantically coherent and entity preserving texts on thirteen NER tasks and two settings. |
Universally Empowering Zeroth-Order Optimization via Adaptive Layer-wise Sampling (2026.findings-acl)
Copied to clipboard
| Challenge: | Existing methods for fine-tuning Large Language Models are slow and lack of performance. |
| Approach: | They propose a Zeroth-Order optimization framework that uses forward passes to fine-tune Large Language Models. |
| Outcome: | The proposed framework achieves 1.7 to 3.0 wall-clock acceleration on LLaMA and OPT models. |
From Shortcuts to Triggers: Backdoor Defense with Denoised PoE (2024.naacl-long)
Copied to clipboard
| Challenge: | Existing backdoor defense methods focus on specific triggers, leaving a universal defense unexplored. |
| Approach: | They propose an ensemble-based backdoor defense framework that denies backdoor attacks by capturing backdoor shortcuts and preventing learning them. |
| Outcome: | The proposed framework significantly improves defense performance against backdoor attacks . it is also effective under a more challenging but practical setting . |
Recurrent Entity Networks with Delayed Memory Update for Targeted Aspect-Based Sentiment Analysis (N18-2)
Copied to clipboard
| Challenge: | Recent work on target-dependent biLSTMs has shown that they are ineffective in aspect-based sentiment analysis. |
| Approach: | They propose a novel architecture that uses external memory chains with a delayed memory update mechanism to track entities. |
| Outcome: | The proposed model improves on a TABSA task using external memory chains with a delayed memory update mechanism. |
Investigating the Robustness of Natural Language Generation from Logical Forms via Counterfactual Samples (2022.emnlp-main)
Copied to clipboard
| Challenge: | State-of-the-art methods based on pre-trained models have achieved remarkable performance on the standard test dataset. |
| Approach: | They propose to incorporate hierarchical structure of logical forms into the model and exploit automatically generated counterfactual data for training. |
| Outcome: | The proposed method is effective to alleviate spurious correlations between the headers of the tables and operators of the logical form. |
Unifying Latent and Lexicon Representations for Effective Video-Text Retrieval (2024.lrec-main)
Copied to clipboard
Haowei Liu, Yaya Shi, Haiyang Xu, Chunfeng Yuan, Qinghao Ye, Chenliang Li, Ming Yan, Ji Zhang, Fei Huang, Bing Li, Weiming Hu
| Challenge: | Existing methods for video-text retrieval capture fine-grained semantic concepts . however, they lack the ability to capture finer-grain concepts such as objects and actions. |
| Approach: | They propose a dual-encoder architecture for fast video-text retrieval that learns lexicon representations to capture fine-grained semantics. |
| Outcome: | The proposed framework outperforms existing methods with 4.8% and 8.2% improvement on MSR-VTT and DiDeMo respectively. |
Dissecting GraphRAG: A Modular Analysis of Knowledge Structuring for Factoid Question Answering (2026.tacl-1)
Copied to clipboard
Noriki Nishida, Rumana Ferdous Munne, Shanshan Liu, Narumi Tokunaga, Yuki Yamagata, Fei Cheng, Kouji Kozaki, Yuji Matsumoto
| Challenge: | GraphRAG integrates structured knowledge graphs into question answering . high-quality triple extraction is critical, but lacks granularity and topical coherence . large language models suffer from inherent limitations in their internalized knowledge . |
| Approach: | They evaluate module-level design choices in GraphRAG for retrieval-augmented generation . they find that triple extraction is critical for accurate and comprehensive retrieval . |
| Outcome: | The proposed framework outperforms other retrieval-augmented generation frameworks in accuracy and efficiency. |
WildDoc: How Far Are We from Achieving Comprehensive and Robust Document Understanding in the Wild? (2025.emnlp-main)
Copied to clipboard
An-Lan Wang, Jingqun Tang, Lei Liao, Hao Feng, Qi Liu, Xiang Fei, Jinghui Lu, Han Wang, Hao Liu, Yuliang Liu, Xiang Bai, Can Huang
| Challenge: | Existing benchmarks for document understanding in the wild are based on scanned or digital documents . however, these benchmarks fail to capture the challenges posed by documents in the real world . |
| Approach: | They propose a new benchmark that incorporates a diverse set of manually captured document images reflecting real-world conditions. |
| Outcome: | The proposed model is based on a set of manually captured document images reflecting real-world conditions and is compared with digital or scanned documents. |
UniLR: Unleashing the Power of LLMs on Multiple Legal Tasks with a Unified Legal Retriever (2025.acl-long)
Copied to clipboard
Ang Li, Yiquan Wu, Yifei Liu, Ming Cai, Lizhi Qing, Shihang Wang, Yangyang Kang, Chengyuan Liu, Fei Wu, Kun Kuang
| Challenge: | Existing retrieval methods are designed for general domains, struggling with legal knowledge, or tailored for specific legal tasks, unable to handle diverse legal knowledge types. |
| Approach: | They propose a novel retrieval method that integrates specialized knowledge into LLMs. |
| Outcome: | The proposed method can perform multiple legal retrieval tasks for LLMs. |
Reinforcement Learning on Pre-Training Data (2026.acl-long)
Copied to clipboard
Siheng Li, Kejiao Li, Zenan Xu, Guanhua Huang, Kun Li, Haoyuan Wu, null Wujiajia, Zihao Zheng, Chenchen Zhang, Kun Shi, Xue Gong, Qi Yi, Ruibin Xiong, Tingqiang Xu, Yuhao Jiang, Jianfeng Yan, Yuyuan Zeng, Guanghui Xu, Jinbao Xue, Zhijiang xu, Zheng Fang, Shuai LI, Qibin Liu, Xiaoxue Li, Zhuoyu Li, Yangyu Tao, Fei Gao, Cheng Jiang, Bochao Wang, Kai Liu, Jianchen Zhu, Wai Lam, Bo Zhou, Di Wang
| Challenge: | Recent progress in large language models is driven by scaling of training compute through pre-training with nexttoken prediction (NTP) or post-training (RL) Pre-training using NTP enables models to acquire extensive knowledge and skills from general data, but it suffers from data inefficiency and catastrophic forgetting in continual learning settings. |
| Approach: | They propose to scale training compute through pre-training with next-token prediction (NTP) or post-training by scaling reinforcement learning (RL) to improve learning from general data. |
| Outcome: | Experiments on multiple benchmarks and models show that the proposed approach improves continual pre-training and provides a strong foundation for post-training on Qwen3-8B-Base. |
Unleashing the Power of LLMs in Court View Generation by Stimulating Internal Knowledge and Incorporating External Knowledge (2024.findings-naacl)
Copied to clipboard
| Challenge: | Large Language Models (LLMs) have made remarkable strides in language generation, but they encounter difficulties in the knowledge-intensive legal domain. |
| Approach: | They propose to decompose court views into different parts, stimulate internal knowledge, and incorporate external information to unleash the power of LLMs in the task. |
| Outcome: | The proposed method generates more accurate and reliable court views on two real-world datasets LAIC2021 and CJO2022. |
Aristotle: Mastering Logical Reasoning with A Logic-Complete Decompose-Search-Resolve Framework (2025.acl-long)
Copied to clipboard
Jundong Xu, Hao Fei, Meng Luo, Qian Liu, Liangming Pan, William Yang Wang, Preslav Nakov, Mong-Li Lee, Wynne Hsu
| Challenge: | Existing systems fail to fully leverage the structure of logical tasks throughout the reasoning process, causing bottlenecks in efficiency and efficacy. |
| Approach: | They propose a logic-complete reasoning framework, Aristotle, which integrates symbolic expressions and logical rules into the entire reasoning process. |
| Outcome: | The proposed framework outperforms state-of-the-art reasoning frameworks in accuracy and efficiency. |
Glyph: Scaling Context Windows via Visual-Text Compression (2026.acl-long)
Copied to clipboard
Jiale Cheng, Yusen Liu, Xinyu Zhang, Yulin Fei, Wenyi Hong, Ruiliang Lyu, Weihan Wang, Zhe Su, Xiaotao Gu, Xiao Liu, Yushi Bai, Jie Tang, Hongning Wang, Minlie Huang
| Challenge: | Large language models (LLMs) traditionally represent text as sequences of discrete tokens . a long-context scaling problem requires processing more tokens more efficiently . |
| Approach: | They propose a framework that renders long texts into compact visual pages and processes them with a vision-language model. |
| Outcome: | The proposed framework renders long texts into compact visual pages and processes them with a vision-language model. |
RexUIE: A Recursive Method with Explicit Schema Instructor for Universal Information Extraction (2023.findings-emnlp)
Copied to clipboard
Chengyuan Liu, Fubang Zhao, Yangyang Kang, Jingyuan Zhang, Xiang Zhou, Changlong Sun, Kun Kuang, Fei Wu
| Challenge: | Named Entity Recognition (NER) and Relation Extraction (RE) models have limited success when extracting general schemas such as quadruples and quintuples. |
| Approach: | They propose a formal formulation that covers almost all extraction schemas and a Recursive Method with Explicit Schema Instructor for UIE. |
| Outcome: | The proposed method shows strong performance under full-shot and few-shot settings and achieves state-of-the-art results on the tasks of extracting complex schemas. |
Rescue Implicit and Long-tail Cases: Nearest Neighbor Relation Extraction (2022.emnlp-main)
Copied to clipboard
| Challenge: | Existing RE models are incapable of handling implicit expressions and long-tail relation types due to language complexity and data sparsity. |
| Approach: | They propose a method to enhance relation extraction using k nearest neighbors (kNN-RE) kNN is a nearest-neighbor search tool that allows the model to consult training relations at test time . |
| Outcome: | The proposed model outperforms the best model to date on ACE05, SciERC, and Wiki80 datasets and outperformed the best on i2b2 and Wik80 dataset. |
Language Lives in Sparse Dimensions: Toward Interpretable and Efficient Multilingual Control for Large Language Models (2026.eacl-long)
Copied to clipboard
| Challenge: | Prior studies show that large language models map multilingual content into English-aligned representations at intermediate layers before projecting them back into target-language token spaces in the later layers. |
| Approach: | They propose a method to identify and manipulate dimensions that are sparse and sparsity-based . they propose to use as few as 50 sentences of either parallel or monolingual data to manipulate these dimensions . |
| Outcome: | Experiments on a multilingual generation control task show the interpretability of these dimensions. |
7 Points to Tsinghua but 10 Points to ? Assessing Large Language Models in Agentic Multilingual National Bias (2025.findings-acl)
Copied to clipboard
| Challenge: | Large Language Models have garnered significant attention for their capabilities in multilingual natural language processing, but studies on risks associated with cross biases are limited to immediate context preferences. |
| Approach: | They investigate multilingual bias in state-of-the-art Large Language Models by analyzing their responses to decision-making tasks across multiple languages. |
| Outcome: | The proposed model can provide personalized advice across university applications, travel, and relocation scenarios. |
Semantics-enhanced Cross-modal Masked Image Modeling for Vision-Language Pre-training (2024.lrec-main)
Copied to clipboard
Haowei Liu, Yaya Shi, Haiyang Xu, Chunfeng Yuan, Qinghao Ye, Chenliang Li, Ming Yan, Ji Zhang, Fei Huang, Bing Li, Weiming Hu
| Challenge: | Existing methods for vision-language pre-training lack high-level semantics and text is not sufficiently involved in masked modeling. |
| Approach: | They propose a semantics-enhanced cross-modal MIM framework for vision-language representation learning that harvests high-level semantics from global image features via self-supervised agreement learning and transfers them to local patch encodings by sharing the encode space. |
| Outcome: | The proposed model achieves state-of-the-art or competitive performance on multiple vision-language tasks. |
More Than Catastrophic Forgetting: Integrating General Capabilities For Domain-Specific LLMs (2024.emnlp-main)
Copied to clipboard
Chengyuan Liu, Yangyang Kang, Shihang Wang, Lizhi Qing, Fubang Zhao, Chao Wu, Changlong Sun, Kun Kuang, Fei Wu
| Challenge: | a recent study shows that performance on general tasks decreases after Large Language Models are fine-tuned on domain-specific tasks. |
| Approach: | They propose a general capability integration approach to integrate general capabilities and domain knowledge within a single instance. |
| Outcome: | The proposed method improves performance on domain-specific tasks by integrating general capabilities and domain knowledge. |
XFormParser: A Simple and Effective Multimodal Multilingual Semi-structured Form Parser (2025.coling-main)
Copied to clipboard
Xianfu Cheng, Hang Zhang, Jian Yang, Xiang Li, Weixiao Zhou, Fei Liu, Kui Wu, Xiangyuan Guan, Tao Sun, Xianjie Wu, Tongliang Li, Zhoujun Li
| Challenge: | Document AI parsing semi-structured image form is a key information extraction task. |
| Approach: | They propose a multimodal and multilingual semi-structured FORM PARSER which integrates SER and relation extraction into a unified framework. |
| Outcome: | The proposed framework achieves up to 1.79% improvement on RE tasks in multilingual and zero-shot settings. |
Reasoning Implicit Sentiment with Chain-of-Thought Prompting (2023.acl-short)
Copied to clipboard
| Challenge: | In implicit sentiment analysis, the opinion cues come in an implicit and obscure manner. |
| Approach: | They propose a three-step prompting principle for THOR to step-by-step induce the implicit aspect, opinion and finally the sentiment polarity. |
| Outcome: | The proposed framework pushes the state-of-the-art (SoTA) by over 6% F1 on supervised setup and more strikingly, boosts the SoTA by over 50% F1 with THOR+GPT3. |
CodexGraph: Bridging Large Language Models and Code Repositories via Code Graph Databases (2025.naacl-long)
Copied to clipboard
Xiangyan Liu, Bo Lan, Zhiyuan Hu, Yang Liu, Zhicheng Zhang, Fei Wang, Michael Qizhe Shieh, Wenmeng Zhou
| Challenge: | Large Language Models excel in stand-alone code tasks but struggle with handling entire code repositories. |
| Approach: | They propose a system that integrates LLM agents with graph database interfaces extracted from code repositories. |
| Outcome: | The proposed system integrates LLM agents with graph database interfaces extracted from code repositories. |
CMMaTH: A Chinese Multi-modal Math Skill Evaluation Benchmark for Foundation Models (2025.coling-main)
Copied to clipboard
Zhongzhi Li, Ming-Liang Zhang, Pei-Jie Wang, Jian Xu, Rui-Song Zhang, Yin Fei, Zhi-Long Ji, Jin-Feng Bai, Zhen-Ru Pan, Jiaxin Zhang, Cheng-Lin Liu
| Challenge: | Large language models excel in various language tasks, while large multimodal models effectively handle visual-language problems. |
| Approach: | They propose to use a multimodal multimodal model evaluation benchmark to evaluate model performance in Chinese K12 classrooms. |
| Outcome: | The proposed model evaluation tool is integrated with the CMMaTH dataset. |
Cross-Lingual Contrastive Learning for Fine-Grained Entity Typing for Low-Resource Languages (2022.acl-long)
Copied to clipboard
| Challenge: | Experimental results show that by applying our framework, we can easily learn effective FGET models for low-resource languages. |
| Approach: | They propose a cross-lingual contrastive learning framework to learn FGET models for low-resource languages. |
| Outcome: | The proposed framework can learn effective FGET models for low-resource languages even without human-labeled data. |
SportsMetrics: Blending Text and Numerical Data to Understand Information Fusion in LLMs (2024.acl-long)
Copied to clipboard
| Challenge: | Large language models can handle text and data, but blending text and numerical data presents significant challenges. |
| Approach: | They propose four tasks to evaluate the numerical reasoning and information fusion capabilities of large language models in sports data analytics. |
| Outcome: | The proposed tasks evaluate the numerical reasoning and information fusion capabilities of large language models in sports data analytics. |
P-MMEval: A Parallel Multilingual Multitask Benchmark for Consistent Evaluation of LLMs (2025.emnlp-main)
Copied to clipboard
Yidan Zhang, Yu Wan, Boyi Deng, Baosong Yang, Hao-Ran Wei, Fei Huang, Bowen Yu, Dayiheng Liu, Junyang Lin, Fei Huang, Jingren Zhou
| Challenge: | Recent advances in large language models showcase varied multilingual capabilities across tasks . previous assessments focused on fundamental natural language processing (NLP) or isolated capability-specific tasks. |
| Approach: | They propose a multilingual multitask benchmark to assess multilingual capabilities . they use a large-scale benchmark covering fundamental and capability-specialized datasets . |
| Outcome: | The proposed benchmark compares models and tasks across languages and tasks and examines knowledge transfer from English to other languages. |
Multi-Document Summarization with Determinantal Point Processes and Contextualized Representations (D19-54)
Copied to clipboard
| Challenge: | Determinantal point processes (DPP) is one of the best performing techniques for extractive summarization. |
| Approach: | They propose to combine determinantal point processes with surface indicators for effective identification of summary-worthy sentences. |
| Outcome: | The determinantal point processes (DPP) framework is one of the best performing in summarization competitions. |
StreamHover: Livestream Transcript Summarization and Annotation (2021.emnlp-main)
Copied to clipboard
Sangwoo Cho, Franck Dernoncourt, Tim Ganter, Trung Bui, Nedim Lipka, Walter Chang, Hailin Jin, Jonathan Brandt, Hassan Foroosh, Fei Liu
| Challenge: | StreamHover is a framework for annotating and summarizing livestream transcripts . the problem is that there is n't enough annotated datasets to summarize livestreams based on the informal nature of spoken language . |
| Approach: | They propose a framework for annotating and summarizing livestream transcripts using a text preview. |
| Outcome: | The proposed model generalizes better and improves over strong baselines. |
CoEvo: Coevolution of LLM and Retrieval Model for Domain-Specific Information Retrieval (2025.emnlp-main)
Copied to clipboard
Ang Li, Yiquan Wu, Yinghao Hu, Lizhi Qing, Shihang Wang, Chengyuan Liu, Tao Wu, Adam Jatowt, Ming Cai, Fei Wu, Kun Kuang
| Challenge: | Recent methods to enhance queries by generating intermediary elements can degrade retrieval performance . combining LLMs and retrievers can be difficult, resulting in unreliable or irrelevant intermediaries . |
| Approach: | They propose a framework that facilitates the coevolution of large language models and retrieval models. |
| Outcome: | The proposed framework facilitates the coevolution of LLMs and retrieval models. |
Scaling External Knowledge Input Beyond Context Windows of LLMs via Multi-Agent Collaboration (2026.acl-long)
Copied to clipboard
| Challenge: | Existing context window extension methods obstruct scaling external knowledge input. |
| Approach: | They develop a multi-agent framework to overcome two core bottlenecks in existing agent orchestration designs. |
| Outcome: | The proposed framework overcomes two core bottlenecks and improves inference-time knowledge integration without longer-context training. |
Improving the Similarity Measure of Determinantal Point Processes for Extractive Multi-Document Summarization (P19-1)
Copied to clipboard
| Challenge: | Despite the empirical success of multi-document summarization, most datasets remain small and the cost of hiring hu-1 is prohibitive. |
| Approach: | They propose a novel method for extractive multi-document summarization that measures redundancy between a pair of sentences based on surface form and semantic information. |
| Outcome: | The proposed method outperforms baseline methods on benchmark datasets and is particularly useful for documents created by multiple authors containing redundant yet lexically diverse expressions. |
MathBench: Evaluating the Theory and Application Proficiency of LLMs with a Hierarchical Mathematics Benchmark (2024.findings-acl)
Copied to clipboard
Hongwei Liu, Zilong Zheng, Yuxuan Qiao, Haodong Duan, Zhiwei Fei, Fengzhe Zhou, Wenwei Zhang, Songyang Zhang, Dahua Lin, Kai Chen
| Challenge: | Recent advances in large language models have showcased significant improvements in mathematics, but traditional benchmarks like GSM8k offer a unidimensional perspective. |
| Approach: | MathBench is a benchmark that rigorously assesses the mathematical capabilities of large language models. |
| Outcome: | MathBench spans a wide range of mathematical disciplines, offering a detailed evaluation of both theoretical understanding and practical problem-solving skills. |
A Sliding-Window Approach to Automatic Creation of Meeting Minutes (2021.naacl-srw)
Copied to clipboard
| Challenge: | Existing methods to extract utterances and keyphrases from transcripts are lacking in meeting minutes. |
| Approach: | They propose a sliding-window approach to automatic generation of meeting minutes . they use a neural abstractive abstractive to navigate through the raw transcript . |
| Outcome: | The proposed approach is evaluated on natural transcripts and two versions of automatic transcripts. |
MedConQA: Medical Conversational Question Answering System based on Knowledge Graphs (2022.emnlp-demos)
Copied to clipboard
| Challenge: | Existing medical dialogue systems have the problems of weak scalability, insufficient knowledge, and poor controllability. |
| Approach: | They propose a medical conversational question-answering system based on the knowledge graph to improve scalability and controllability. |
| Outcome: | The proposed system can conduct knowledge-grounded dialogues with users, using a Chinese medical knowledge graph and a large-scale dataset. |
Precedent-Enhanced Legal Judgment Prediction with LLM and Domain-Model Collaboration (2023.emnlp-main)
Copied to clipboard
Yiquan Wu, Siying Zhou, Yifei Liu, Weiming Lu, Xiaozhong Liu, Yating Zhang, Changlong Sun, Fei Wu, Kun Kuang
| Challenge: | Recent advances in deep learning have enabled a variety of techniques to be used to solve the LJP task. |
| Approach: | They propose a framework that leverages the strength of both LLMs and domain-specific models in the context of precedents. |
| Outcome: | The proposed framework leverages the strength of both LLM and domain models in the context of precedents. |
Prefix-diffusion: A Lightweight Diffusion Model for Diverse Image Captioning (2024.lrec-main)
Copied to clipboard
| Challenge: | Existing image captioning models require large trainable parameters to bridge visual and textual representations. |
| Approach: | They propose a lightweight image captioning network in combination with continuous diffusion that injects prefix image embeddings into denoising process of diffusion model. |
| Outcome: | The proposed method generates diverse captions with relatively less parameters while maintaining fluency and relevance compared with other models. |
Training-Free Test-Time Contrastive Learning for Large Language Models (2026.findings-acl)
Copied to clipboard
| Challenge: | Existing training-free alternatives to training-based models are static or depend on external guidance. |
| Approach: | They propose a training-free adaptation framework that enables a frozen LLM to improve online by distilling supervision from its own inference experiences. |
| Outcome: | The proposed framework outperforms existing test-time adaptation methods under online evaluation. |
EPO: Explicit Policy Optimization for Strategic Reasoning in LLMs via Reinforcement Learning (2025.acl-long)
Copied to clipboard
Xiaoqian Liu, Ke Wang, Yongbin Li, Yuchuan Wu, Wentao Ma, Aobo Kong, Fei Huang, Jianbin Jiao, Junge Zhang
| Challenge: | Existing methods for strategic reasoning face challenges in adaptability, scalability, and transferring strategies to new contexts. |
| Approach: | They propose an explicit policy optimization model that provides strategies in open-ended action space and can be plugged into arbitrary LLM agents to motivate goal-directed behavior. |
| Outcome: | The proposed model provides strategies in open-ended action space and can be plugged into arbitrary LLM agents to motivate goal-directed behavior. |
One-Shot Learning as Instruction Data Prospector for Large Language Models (2024.acl-long)
Copied to clipboard
Yunshui Li, Binyuan Hui, Xiaobo Xia, Jiaxi Yang, Min Yang, Lei Zhang, Shuzheng Si, Ling-Hao Chen, Junhao Liu, Tongliang Liu, Fei Huang, Yongbin Li
| Challenge: | Contemporary practices in instruction tuning often hinge on enlarging data scaling without a clear strategy for ensuring data quality. |
| Approach: | They propose a method that leverages one-shot learning to discern and select high-quality instruction data from extensive datasets. |
| Outcome: | Nuggets outperforms existing methods on MT-Bench and Alpaca-Eval benchmarks. |
Monotonic Paraphrasing Improves Generalization of Language Model Prompting (2024.findings-emnlp)
Copied to clipboard
| Challenge: | Large language models (LLMs) have demonstrated remarkable proficiency in zero-shot decision making and instruction following. |
| Approach: | They propose an end-to-end decoding strategy that paraphrases given prompts or instructions into their lower perplexity counterparts based on an ensemble of a paraphrase LM for prompt rewriting, and a target LM that constrains the generation for lower perxity. |
| Outcome: | The proposed method can efficiently paraphrase the original prompt without altering its semantic meaning while decreasing the perplexity of each generation as calculated by the target LM. |
Pan More Gold from the Sand: Refining Open-domain Dialogue Training with Noisy Self-Retrieval Generation (2022.coling-1)
Copied to clipboard
| Challenge: | Existing methods for generating open-domain dialogue systems underutilize training data. |
| Approach: | They propose a retrieval-generation training framework that takes advantage of heterogeneous training data by considering them as "evidence" they use BERTScore retrieval framework which gives better qualities of the training data, they show . |
| Outcome: | The proposed method performs well on zero-shot experiments and is more robust to real-world data. |
PhiloGPT: A Philology-Oriented Large Language Model for Ancient Chinese Manuscripts with Dunhuang as Case Study (2024.emnlp-main)
Copied to clipboard
Yuqing Zhang, Baoyi He, Yihan Chen, Hangqi Li, Han Yue, Shengyu Zhang, Huaiyong Dou, Junchi Yan, Zemin Liu, Yongquan Zhang, Fei Wu
| Challenge: | philology requires years of professional training in extensive knowledge memorization and manual textual retrieval. |
| Approach: | They curated the PhiloCorpus-ZH, a rich collec-tion of ancient Chinese texts spanning a millennium with 30 diverse topics, including firsthand folk copies. |
| Outcome: | The PhiloCorpus-ZH corpus facilitated the development of the first LLM tailored for discovering ancient Chinese manuscripts. |
Geoparsing: Diagram Parsing for Plane and Solid Geometry with a Unified Formal Language (2026.findings-acl)
Copied to clipboard
Peijie Wang, Ming-Liang Zhang, Jun Cao, Chao Deng, Dekang Ran, Pi Bu, Hongda Sun, Xuan Zhang, Yingyao Wang, Jun Song, Bo Zheng, Fei Yin, Cheng-Lin Liu
| Challenge: | Recent advances in Multimodal Large Language Models (MLLMs) have demonstrated remarkable capabilities across various vision reasoning tasks. |
| Approach: | They propose a unified formal language that integrates plane and solid geometry, comprehensively covering geometric structures and semantic relations. |
| Outcome: | The proposed language achieves state-of-the-art parsing performance and significantly boosts MLLMs’ capabilities for downstream geometry reasoning tasks. |
DialogueCSE: Dialogue-based Contrastive Learning of Sentence Embeddings (2021.emnlp-main)
Copied to clipboard
| Challenge: | Conventional approaches to learning sentence embeddings from dialogues employ the siamese-network for this task, but such architecture yields a large gap between training and evaluating. |
| Approach: | They propose a dialogue-based contrastive learning approach to learn sentence embeddings from dialogues using a siamese-network. |
| Outcome: | The proposed model outperforms baseline methods on three multi-turn dialogue datasets in terms of MAP and Spearman’s correlation measures. |
Understanding Points of Correspondence between Sentences for Abstractive Summarization (2020.acl-srw)
Copied to clipboard
| Challenge: | Using points of correspondence, fusion systems are difficult for abstractive summarizers because of their complexity. |
| Approach: | They propose to model points of correspondence between disparate sentences by combining documents, source and fusion sentences, and human annotations of points of correspondance between sentences. |
| Outcome: | The proposed model bridges the gap between coreference resolution and summarization by using human annotations of points of correspondence between sentences. |
UI-Copilot: Advancing Long-Horizon GUI Automation via Tool-Integrated Policy Optimization (2026.acl-long)
Copied to clipboard
Zhengxi Lu, Fei Tang, Guangyi Liu, Jin Ma, Kaitao Song, Xu Tan, Wenqi Zhang, Weiming Lu, Jun Xiao, Yueting Zhuang, Yongliang Shen
| Challenge: | Experimental results show that UI-Copilot-7B achieves state-of-the-art performance on challenging MemGUI-Bench, outperforming strong 7B-scale GUI agents such as GUI-Owl-7B and UITARS-1.5-7B. |
| Approach: | They propose a collaborative framework where the GUI agent focuses on task execution while a lightweight copilot provides on-demand assistance for memory retrieval and numerical computation. |
| Outcome: | The proposed framework outperforms GUI-Owl-7B and UI-TARS-1.5-7B on MemGUI-Bench and delivers 17.1% improvement on AndroidWorld over the base Qwen model. |
Scoring Sentence Singletons and Pairs for Abstractive Summarization (P19-1)
Copied to clipboard
Logan Lebanoff, Kaiqiang Song, Franck Dernoncourt, Doo Soon Kim, Seokhwan Kim, Walter Chang, Fei Liu
| Challenge: | Existing methods for summarizing content from single sentences are inadequately understood. |
| Approach: | They propose to combine singletons and pairs to create a summarizing sentence . they use a dataset of human-written abstracts to examine human-writing methods . |
| Outcome: | The proposed framework is based on human-written abstracts from three large datasets. |
ViLL-E: Video LLM Embeddings for Retrieval (2026.acl-long)
Copied to clipboard
| Challenge: | Video Large Language Models excel at video understanding tasks where outputs are textual . however, they underperform specialized embedding-based models in Retrieval tasks . |
| Approach: | They propose a video-LLM-based model with an embedding generation mechanism that allows the model to "think longer" for complex videos and stop early for easy ones. |
| Outcome: | The proposed model outperforms specialized embedding-based models in video understanding tasks while remaining competitive on VideoQA tasks. |
LongWeave: A Long-Form Generation Benchmark Bridging Real-World Relevance and Verifiability (2025.findings-emnlp)
Copied to clipboard
Zikai Xiao, Fei Huang, Jianhong Tu, Jianhui Wei, Wen Ma, Yuxuan Zhou, Jian Wu, Bowen Yu, Zuozhu Liu, Junyang Lin
| Challenge: | Existing benchmarks for long-form generation assess real-world queries with hard-to-verify metrics or use synthetic setups that overlook real-life intricacies. |
| Approach: | They propose a new approach that balances verifiable and real-world assessment with Target-Anchored Evaluation. |
| Outcome: | The proposed model balances real-world and verifiable assessment with Target-Anchored Evaluation (TAE) it generates queries, textual materials, and anchors based on verifier targets within real-life scenarios . |
Too Consistent to Detect: A Study of Self-Consistent Errors in LLMs (2025.emnlp-main)
Copied to clipboard
Hexiang Tan, Fei Sun, Sha Liu, Du Su, Qi Cao, Xin Chen, Jingang Wang, Xunliang Cai, Yuanzhuo Wang, Huawei Shen, Xueqi Cheng
| Challenge: | Existing detection methods fail to account for **self-consistent error** . study identifies self-consistency errors and evaluates them . |
| Approach: | They propose a method that fuses hidden state evidence from an external verifier LLM to detect self-consistent errors. |
| Outcome: | The proposed method significantly enhances performance on self-consistent errors across three LLM families. |
Improving Factual Consistency of News Summarization by Contrastive Preference Optimization (2024.findings-emnlp)
Copied to clipboard
Huawen Feng, Yan Fan, Xiong Liu, Ting-En Lin, Zekun Yao, Yuchuan Wu, Fei Huang, Yongbin Li, Qianli Ma
| Challenge: | Recent advances in news summarization have created problems with “hallucinations” that are factually inconsistent with the source text. |
| Approach: | They propose to disentangle LLMs’ propensities to generate faithful and fake content by adopting a probing-based specific training method to improve their capacity of distinguishing two types of propensity. |
| Outcome: | The proposed method disentangles LLMs’ propensities to generate faithful and fake content and improves their ability to distinguish between two types of propensity. |
STRUX: An LLM for Decision-Making with Structured Explanations (2025.naacl-short)
Copied to clipboard
| Challenge: | a new LLM decision-making framework is designed to help users understand how and why decisions are made. |
| Approach: | They introduce a new LLM decision-making framework called STRUX that provides structured explanations for LLM decisions. |
| Outcome: | The proposed framework improves decision-making by providing structured explanations . it has been evaluated on the task of forecasting stock investment decisions based on earnings call transcripts - superior performance against strong baselines compared with previous frameworks based upon earnings call transcriptions demonstrating superior performance . |
LANS: A Layout-Aware Neural Solver for Plane Geometry Problem (2024.findings-acl)
Copied to clipboard
| Challenge: | Existing neural solvers take GPS as vision-language task but lack layout awareness . Existing models are criticized for complex rules and poor adaptability . |
| Approach: | They propose a layout-aware neural solver called LANS that integrates two modules to solve GPS. |
| Outcome: | The proposed solver outperforms existing neural and symbolic solvers on two datasets. |
Conversational Question Answering with Language Models Generated Reformulations over Knowledge Graph (2024.findings-acl)
Copied to clipboard
| Challenge: | State-of-the-art ConvQA methods struggle with inexplicit question-answer pairs, which can degrade ConvQ performance. |
| Approach: | They propose a reinforcement learning based model, CoRnNet, which utilizes question reformulations generated by large language models to improve ConvQA performance. |
| Outcome: | The proposed model outperforms state-of-the-art ConvQA models by using question reformulations generated by large language models (LLMs). |
SDPO: Segment-Level Direct Preference Optimization for Social Agents (2025.acl-long)
Copied to clipboard
Aobo Kong, Wentao Ma, Shiwan Zhao, Yongbin Li, Yuchuan Wu, Ke Wang, Xiaoqian Liu, Qicheng Li, Yong Qin, Fei Huang
| Challenge: | Direct Preference Optimization (DPO) has proven effective in aligning LLM behavior with human preferences across various tasks, but is limited in multi-turn social interactions. |
| Approach: | They propose a method which dynamically selects key segments within interactions to optimize multi-turn agent behavior. |
| Outcome: | The proposed methods outperform existing methods and proprietary LLMs on the SOTOPIA benchmark and show that they can improve social intelligence. |
Machine Translation With Weakly Paired Documents (D19-1)
Copied to clipboard
| Challenge: | Recent studies explore the possibility of unsupervised machine translation with monolingual data only. |
| Approach: | They propose a method to mine bilingual sentences from weakly paired documents . they use word distribution-level alignments to constrain word distributions of two weakly-paired documents. |
| Outcome: | The proposed method outperforms previous results on six translation tasks using weakly paired bilingual documents and a large number of bilingual sentences. |
InFoBench: Evaluating Instruction Following Ability in Large Language Models (2024.findings-acl)
Copied to clipboard
Yiwei Qin, Kaiqiang Song, Yebowen Hu, Wenlin Yao, Sangwoo Cho, Xiaoyang Wang, Xuansheng Wu, Fei Liu, Pengfei Liu, Dong Yu
| Challenge: | Existing methods for evaluating Large Language Models (LLMs) ability to follow instructions have not been able to provide a detailed analysis of their compliance with instructions. |
| Approach: | They propose a new metric for evaluating Large Language Models' ability to follow instructions and a benchmark for DRFR. |
| Outcome: | The proposed metric and benchmark compared with traditional scoring methods and explores annotation sources including human experts, crowd-sourced workers, and GPT-4. |
David vs. Goliath: Cost-Efficient Financial QA via Cascaded Multi-Agent Reasoning (2025.findings-emnlp)
Copied to clipboard
| Challenge: | Large language models have demonstrated remarkable reasoning capabilities, but performance in FQA remains limited. |
| Approach: | They propose a low-cost yet effective framework that enables small LLMs to perform complex reasoning tasks without expensive models. |
| Outcome: | The proposed framework outperforms the best open-source model on BizBench by 10.46% and achieves competitive performance to GPT-3.5 using significantly fewer parameters. |
Dial2vec: Self-Guided Contrastive Learning of Unsupervised Dialogue Embeddings (2022.emnlp-main)
Copied to clipboard
| Challenge: | Dialogue embeddings are a critical prerequisite for semantically understanding dialogues. |
| Approach: | They propose a self-guided contrastive learning approach called dial2vec that captures interaction patterns between interlocutors and leverages them to guide the learning of the embeddings corresponding to each interlocuter. |
| Outcome: | The proposed approach achieves 8.7, 9.0, and 13.8 points absolute improvements over the strongest baseline on the three evaluation tasks respectively. |
HiTrans: A Transformer-Based Context- and Speaker-Sensitive Model for Emotion Detection in Conversations (2020.coling-main)
Copied to clipboard
| Challenge: | Emotion detection in conversations is to detect the emotion for each utterance in conversations that have multiple speakers. |
| Approach: | They propose a transformer-based context- and speaker-sensitive model for EDC . they utilize a low-level transformer to generate local utterance representations . |
| Outcome: | The proposed model outperforms state-of-the-art models on three benchmark datasets. |
Symbol-LLM: Towards Foundational Symbol-centric Interface For Large Language Models (2024.acl-long)
Copied to clipboard
| Challenge: | Large Language Models (LLMs) have limitations when it comes to comprehending and expressing world knowledge that extends beyond the boundaries of natural language. |
| Approach: | They propose a model that integrates symbolic data into LLM training without loss of generality ability. |
| Outcome: | The proposed model performs better on symbol- and NL-centric tasks. |
Coarse-to-Fine: Hierarchical Multi-task Learning for Natural Language Understanding (2022.coling-1)
Copied to clipboard
Zhaoye Fei, Yu Tian, Yongkang Wu, Xinyu Zhang, Yutao Zhu, Zheng Liu, Jiawen Wu, Dejiang Kong, Ruofei Lai, Zhao Cao, Zhicheng Dou, Xipeng Qiu
| Challenge: | Existing methods to learn downstream tasks by stitches skill block lack rationality and interpretation. |
| Approach: | They propose a hierarchical framework with a coarse-to-fine paradigm for generalized text representations from the large-scale corpus. |
| Outcome: | The proposed model learns basic language properties from all tasks and boosts performance on relevant tasks. |
Task-aware Contrastive Mixture of Experts for Quadruple Extraction in Conversations with Code-like Replies and Non-opinion Detection (2025.emnlp-main)
Copied to clipboard
| Challenge: | Applying Large Language Models (LLMs) for this specific task presents two primary challenges: the accurate extraction of multiple elements and the understanding of complex dialogue reply structure. |
| Approach: | They propose a novel LLM-based multi-task approach to extract sentiment quadruples from conversations by integrating expert-level contrastive loss within task-oriented mixture of experts layer. |
| Outcome: | The proposed method outperforms existing fine-tuning techniques in terms of accuracy and computational efficiency. |
Beyond Error Propagation in Neural Machine Translation: Characteristics of Language Also Matter (D18-1)
Copied to clipboard
| Challenge: | Neural machine translation suffers from exposure bias and error propagation problem. |
| Approach: | They conduct a series of analyses to deeply understand the accuracy drop problem . they find that the left part of the translated sentence is often better than its right part . |
| Outcome: | The results show that the left part of the translated sentence is often better than its right part in left-to-right decoding models. |
The Butterfly Effect of Model Editing: Few Edits Can Trigger Large Language Models Collapse (2024.findings-acl)
Copied to clipboard
| Challenge: | Even a single edit can trigger model collapse, manifesting as significant performance degradation in various benchmark tasks. |
| Approach: | They propose to use perplexity as a surrogate metric to determine whether an edited model's performance is affected by a single edit. |
| Outcome: | The proposed method shows that even a single edit can cause model collapse, manifesting as significant performance degradation in various benchmark tasks. |
Divide and Conquer: Legal Concept-guided Criminal Court View Generation (2024.findings-emnlp)
Copied to clipboard
| Challenge: | Existing methods for creating rationales for criminal cases do not pay enough attention to the important legal concepts. |
| Approach: | They propose a legal concept-guided court view generation framework that generates rationales based on predicted legal concepts . they first divide the court view into sub-views, then employ a solver and verifier to generate and select rationale. |
| Outcome: | The proposed model generates coherent and coherent court views on a real-world criminal case dataset. |
MUSEG: Reinforcing Video Temporal Understanding via Timestamp-Aware Multi-Segment Grounding (2026.acl-long)
Copied to clipboard
Fuwen Luo, Shengfeng Lou, Chi Chen, Ziyue Wang, Chenliang Li, Weizhou Shen, Jiyue Guo, Peng Li, Ming Yan, Ji Zhang, Fei Huang, Yang Liu
| Challenge: | Existing methods for MLLMs struggle with fine-grained temporal reasoning . despite advances in video understanding, current methods struggle with time-sensitive tasks . |
| Approach: | They propose a time-stamp-aware multi-segment grounding method that enhances temporal understanding by introducing timestamps. |
| Outcome: | The proposed method outperforms existing methods on time-sensitive tasks and generalizes well across diverse temporal understanding scenarios. |
Minimize Exposure Bias of Seq2Seq Models in Joint Entity and Relation Extraction (2020.findings-emnlp)
Copied to clipboard
Ranran Haoran Zhang, Qianying Liu, Aysa Xuemo Fan, Heng Ji, Daojian Zeng, Fei Cheng, Daisuke Kawahara, Sadao Kurohashi
| Challenge: | Existing methods to extract relation triplets from plain text introduce exposure bias . prior work has focused on pipeline methods that ignore intrinsic interactions between subtasks and propagate classification errors through the tasks. |
| Approach: | They propose a model that reduces the decoding length to three within a triplet and removes the order among triplets. |
| Outcome: | The proposed model overfits to both datasets while showing better generalization. |
Universal Information Extraction with Meta-Pretrained Self-Retrieval (2023.findings-acl)
Copied to clipboard
Xin Cong, Bowen Yu, Mengcheng Fang, Tingwen Liu, Haiyang Yu, Zhongkai Hu, Fei Huang, Yongbin Li, Bin Wang
| Challenge: | Existing methods for IE are task-specific, resulting in specialized and isolated approaches for different tasks. |
| Approach: | They propose a method to retrieve task-specific knowledge from pretrained language models to enhance universal IE by using a Meta-Pretraining Algorithm. |
| Outcome: | The proposed method achieves the new state-of-the-art on 4 IE tasks, 12 datasets under fully-supervised, low-resource and few-shot scenarios. |
GPT-RE: In-context Learning for Relation Extraction using Large Language Models (2023.emnlp-main)
Copied to clipboard
| Challenge: | Existing approaches to in-context learning (ICL) are lacking in relation extraction (RE) . emergence of large language models (LLMs) such as GPT-3 represents a significant advancement in natural language processing. |
| Approach: | They propose to incorporate task-aware representations into demonstration retrieval and enrich the demonstrations with gold label-induced reasoning logic. |
| Outcome: | The proposed model achieves SOTA and competitive performances on the Semeval and SciERC datasets. |
A Systematic Survey of Claim Verification: Corpora, Systems, and Case Studies (2025.findings-emnlp)
Copied to clipboard
| Challenge: | This survey analyses 198 studies published between January 2022 and March 2025 . |
| Approach: | This survey synthesizes recent advances in CV corpus creation and system design. |
| Outcome: | The results of this study are synthesized from 198 studies published between January 2022 and March 2025. |
Your Semantic-Independent Watermark is Fragile: A Semantic Perturbation Attack against EaaS Watermark (2025.findings-emnlp)
Copied to clipboard
| Challenge: | Embedding-as-a-Service (EaaS) is a successful business pattern but faces significant challenges related to various forms of copyright infringement. |
| Approach: | They propose a semantic-independent watermarking scheme that exploits semantic perturbation tests to bypass verification. |
| Outcome: | The proposed watermarking schemes possess semantic-independent characteristics and exploit semantic perturbation tests to bypass verification. |
MoralDial: A Framework to Train and Evaluate Moral Dialogue Systems via Moral Discussions (2023.acl-long)
Copied to clipboard
| Challenge: | A moral dialogue system aligned with users’ values could enhance conversation engagement and user connections. |
| Approach: | They propose a framework to train and evaluate moral dialogue systems based on communication mechanisms of morality and a method to construct moral discussions between simulated users and the dialogue system. |
| Outcome: | The proposed framework can train and evaluate moral dialogue systems based on simulated users and their values . |
Towards Abstractive Grounded Summarization of Podcast Transcripts (2022.acl-long)
Copied to clipboard
| Challenge: | Podcast summarization is of practical benefit to content providers and consumers . however, podcast summarizing faces significant challenges including factual inconsistencies . speech recognizers induce transcription errors and abstractive summarisation models may hallucinate . |
| Approach: | They propose a method to generate podcast summaries while grounding segments in specific regions of the transcript to allow full inspection of summary details. |
| Outcome: | The proposed method can produce an abstractive summary while grounding segments in specific regions of the transcript to allow full inspection of summary details. |
Hint-Based Training for Non-Autoregressive Machine Translation (D19-1)
Copied to clipboard
| Challenge: | AutoRegressive Translation models have to generate tokens sequentially during decoding and thus suffer from high inference latency. |
| Approach: | They propose to use hidden states and word alignments to help train NART models. |
| Outcome: | The proposed model improves on the WMT14 En-De and De-En datasets but is faster in inference than the current models. |
FollowBench: A Multi-level Fine-grained Constraints Following Benchmark for Large Language Models (2024.acl-long)
Copied to clipboard
Yuxin Jiang, Yufei Wang, Xingshan Zeng, Wanjun Zhong, Liangyou Li, Fei Mi, Lifeng Shang, Xin Jiang, Qun Liu, Wei Wang
| Challenge: | Existing benchmarks focus on evaluating pure response quality, rather than assessing whether the response follows constraints stated in the instruction. |
| Approach: | They propose a Multi-level Fine-grained Constraints Following Benchmark for Large Language Models that adds a single constraint to the initial instruction at each increased level. |
| Outcome: | The proposed model can follow instructions with more constraints, and is deemed to have better instruction-following ability. |
Translationese-index: Using Likelihood Ratios for Graded and Generalizable Measurement of Translationese (2025.emnlp-main)
Copied to clipboard
Yikang Liu, Wanyang Zhang, Yiming Wang, Jialong Tang, Pei Zhang, Baosong Yang, Fei Huang, Rui Wang, Hai Hu
| Challenge: | Translationese is a linguistic property that is often introduced in the translation process that is different from those of original texts. |
| Approach: | They propose to use synthesized translations and translations in the wild to evaluate T-index's generalizability in cross-domain settings and its validity against human judgments. |
| Outcome: | The proposed measure can generalize to unseen genres, authors, and language pairs. |
CCHall: A Novel Benchmark for Joint Cross-Lingual and Cross-Modal Hallucinations Detection in Large Language Models (2025.acl-long)
Copied to clipboard
| Challenge: | Existing studies on hallucinations in large language models are limited to a single scenario, either cross-lingual or cross-modal. |
| Approach: | They propose a joint Cross-lingual and Cross-modal hallucinations benchmark to fill this gap . they incorporate cross-lingual, cross-modal scenarios to assess hallucinic capabilities . |
| Outcome: | The proposed benchmark incorporates both cross-lingual and cross-modal hallucination scenarios to assess the cross-linguistic and crossmodal capabilities of LLMs. |
Uncertainty-Calibrated Elastic Alignment for Multimodal Sentiment Analysis with Missing Modalities (2026.findings-acl)
Copied to clipboard
Kang He, Yuzhe Ding, Rao Fu, Yukang Feng, Kaipeng Zhang, Yiming Liu, Fei Li, Chong Teng, Donghong Ji
| Challenge: | Existing methods for multimodal sentiment analysis are often dynamically incomplete. |
| Approach: | They propose a new uncertainty-calibrated elastic alignment framework to address these issues by employing probabilistic imputation to capture cross-modal ambiguity and leverage the estimated uncertainty to drive elastic alignment. |
| Outcome: | The proposed framework outperforms state-of-the-art models in multiple benchmarks and consistently outperformed existing models. |
Generation of Patient After-Visit Summaries to Support Physicians (2022.coling-1)
Copied to clipboard
Pengshan Cai, Fei Liu, Adarsha Bajracharya, Joe Sills, Alok Kapoor, Weisong Liu, Dan Berlowitz, David Levy, Richeek Pradhan, Hong Yu
| Challenge: | After-visit summary is a summary note given to patients after their clinical visit. |
| Approach: | They propose to automate the generation of after-visit summaries and introduce a feedback mechanism that alerts physicians when an automatic summary fails to capture important details of the clinical notes. |
| Outcome: | The proposed system improves on a large clinical dataset that contains electronic health record (EHR) notes and their associated summaries. |
Supervised Optimism Correction: Be Confident When LLMs Are Sure (2025.findings-acl)
Copied to clipboard
| Challenge: | Recent advances in Large Language Models (LLMs) have demonstrated remarkable success across diverse tasks such as instruction following, code generation, and medical diagnosis. |
| Approach: | They propose a supervised fine-tuning-based auxiliary loss for Q-value estimations during supervised refinement. |
| Outcome: | The proposed method outperforms beam search on GSM8K, MATH, and GAOKAO on reasoning benchmarks. |
Improving Seq2Seq Grammatical Error Correction via Decoding Interventions (2023.findings-emnlp)
Copied to clipboard
| Challenge: | Existing approaches to grammatical error correction (GEC) are sequence-to-sequence and sequence-edit. |
| Approach: | They propose a unified decoding intervention framework that employs an external critic to assess the appropriateness of the token to be generated incrementally. |
| Outcome: | The proposed framework outperforms baselines and state-of-the-art methods on English and Chinese datasets. |
GeoEval: Benchmark for Evaluating LLMs and Multi-Modal Models on Geometry Problem-Solving (2024.findings-acl)
Copied to clipboard
| Challenge: | Recent advances in large language models (LLMs) and multi-modal models (MMs) have demonstrated remarkable capabilities in problem-solving, but their proficiency in tackling geometry math problems has not been thoroughly evaluated. |
| Approach: | They propose a benchmark to evaluate the performance of large language models and multi-modal models in solving geometry math problems. |
| Outcome: | The proposed model achieves 55.67% accuracy on main subset but only 6.00% accuracy on hard subset. |
MPBoCo: Multimodal Prompt-based Boundary-enhanced Continual Framework for Joint Entity and Relation Extraction (2026.acl-long)
Copied to clipboard
| Challenge: | Existing methods struggle to balance real-time adaptability and computational efficiency in continual learning scenarios. |
| Approach: | They propose a Continual Multimodal Entity and Relation Joint Extraction task and a Multimodal Prompt-based Boundary-enhanced Continuum framework that stores task-specific knowledge via learnable multimodal prompts. |
| Outcome: | The proposed framework outperforms baseline methods in real-world scenarios by 5.5% and 7.2%. |
RedOne: Revealing Domain-specific LLM Post-Training in Social Networking Services (2025.emnlp-industry)
Copied to clipboard
Fei Zhao, Chonggang Lu, null Wangyue, Zheyong Xie, Ziyan Liu, Haofu Qian, Jianzhao Huang, Fangcheng Shi, Zijie Meng, Hongcheng Guo, Mingqian He, Xinze Lyu, Zheyu Ye, Weiting Liu, Boyang Wang, Shaosheng Cao
| Challenge: | Social networking services (SNS) have experienced rapid growth, which has proposed significant challenges for platform content management and interaction quality improvement. |
| Approach: | They propose a domain-specific LLM to break the performance bottleneck of single-task baselines and establish a comprehensive foundation for social networking services. |
| Outcome: | The proposed model achieves an average improvement of 14.02% across 8 major tasks and 7.56% in bilingual evaluation benchmark, compared with baseline models. |
How Domain Terminology Affects Meeting Summarization Performance (2020.coling-main)
Copied to clipboard
| Challenge: | Existing methods to summarize meetings using domain terminology are understudied . jargon terms are used to identify salient utterances from transcripts . |
| Approach: | They propose to use jargon terms to identify salient utterances from transcribed meetings to generate meeting minutes. |
| Outcome: | The proposed system generates minutes from transcribed meetings by identifying salient utterances from transcripts. |
DialogueMMT: Dialogue Scenes Understanding Enhanced Multi-modal Multi-task Tuning for Emotion Recognition in Conversations (2025.coling-main)
Copied to clipboard
| Challenge: | Existing ERC methods fail to handle emotional cues from both visual sources and discourse structures due to the complexity of visual scenes and contextual dependencies in conversations. |
| Approach: | They propose a framework for Emotion Recognition in conversations that utilizes multi-task instruction tuning to enhance the model's understanding of multi-modal dialogue scenes. |
| Outcome: | The proposed framework outperforms existing state-of-the-art models on three benchmark ERC datasets and is based on a video-language connector and a chain-of thought strategy. |
The Evolution of Thought: Tracking LLM Overthinking via Reasoning Dynamics Analysis (2026.acl-long)
Copied to clipboard
Zihao Wei, Liang Pang, Jiahao Liu, Wenjie Shi, Jingcheng Deng, Shicheng Xu, Zenghao Duan, Jingang Wang, Fei Sun, Huawei Shen, Xueqi Cheng
| Challenge: | Explicit reasoning trajectories increase performance but often trigger overthinking . despite its importance, this study examines how each step of reasoning affects the final outcome . |
| Approach: | They propose a Reasoning Completion Point Detector that detects the RCP by monitoring rank dynamics of termination tokens. |
| Outcome: | The proposed method reduces token usage by up to 44% while preserving accuracy. |
IPL: Leveraging Multimodal Large Language Models for Intelligent Product Listing (2024.emnlp-industry)
Copied to clipboard
Kang Chen, Qing Zhang, Chengbao Lian, Yixin Ji, Xuwei Liu, Shuguang Han, Guoqiang Wu, Fei Huang, Jufeng Chen
| Challenge: | Unlike professional Business-to-Consumer (B2C) e-commerce platforms, consumer-to consumer (C2C), is mainly targeting individual sellers. |
| Approach: | They develop an intelligent product listing tool that generates product descriptions using various product attributes such as category, brand, color, condition, etc. |
| Outcome: | The proposed tool outperforms the base model in domain-specific tasks while producing less hallucination. |
Rethinking Tabular Data Understanding with Large Language Models (2024.naacl-long)
Copied to clipboard
| Challenge: | Large Language Models (LLMs) are capable of various tasks, yet their capability in interpreting and reasoning over tabular data remains an underexplored area. |
| Approach: | They propose a method for table structure normalization to improve model performance . they propose aggregation of multiple reasoning pathways to improve performance based on textual and symbolic reasoning. |
| Outcome: | The proposed method improves performance on symbolic reasoning tasks with textual reasoning slightly outperforming symbolic reasoning on tables. |
Towards Identifying Social Bias in Dialog Systems: Framework, Dataset, and Benchmark (2022.findings-emnlp)
Copied to clipboard
Jingyan Zhou, Jiawen Deng, Fei Mi, Yitong Li, Yasheng Wang, Minlie Huang, Xin Jiang, Qun Liu, Helen Meng
| Challenge: | a number of safety concerns hinder the deployment of open-domain dialog systems, such as offensive languages and toxic behaviors, such social bias is difficult to detect. |
| Approach: | They propose a Dial-Bias Framework for analyzing social bias in conversations . they introduce a Chinese social bias dialog dataset and conduct in-depth ablation studies . |
| Outcome: | The proposed framework is the first annotated Chinese social bias dialog dataset . the proposed framework also provides a fine-grained dialog bias measurement benchmark . |
AceGPT, Localizing Large Language Models in Arabic (2024.naacl-long)
Copied to clipboard
Huang Huang, Fei Yu, Jianqing Zhu, Xuening Sun, Hao Cheng, Song Dingjie, Zhihong Chen, Mosen Alharthi, Bang An, Juncai He, Ziche Liu, Junying Chen, Jianquan Li, Benyou Wang, Lian Zhang, Ruoyu Sun, Xiang Wan, Haizhou Li, Jinchao Xu
| Challenge: | Significant concerns emerge when addressing cultural sensitivity and local values. |
| Approach: | They propose a localized Large Language Model (LLM) specifically for Arabic, a language imbued with unique cultural characteristics inadequately addressed by current mainstream models. |
| Outcome: | The proposed model sets the state-of-the-art standard for open Arabic LLMs across various benchmarks. |
Aspect-based Sentiment Analysis with Context Denoising (2024.findings-naacl)
Copied to clipboard
| Challenge: | Existing approaches to ABSA use text encoders to locate important context features or remove them from input. |
| Approach: | They propose to improve ABSA with context denoising to remove noise from text . they use diffusion networks to perform denoizing process to gradually eliminate noise . paper shows that aspect-based sentiment analysis is effective for fine-grained analysis . |
| Outcome: | The proposed approach improves ABSA on five widely used ABSA datasets. |
Guiding Extractive Summarization with Question-Answering Rewards (N19-1)
Copied to clipboard
| Challenge: | a primary challenge faced by extractive summarization systems is the lack of annotated data. |
| Approach: | They propose a supervised extractive summarization system that rewards question-answering by identifying salient sequences of words from a document and highlighting them in the text. |
| Outcome: | The proposed system compares with baselines of strong summarization and human assessors on question-answering. |
Bridging the Gap between Synthetic and Natural Questions via Sentence Decomposition for Semantic Parsing (2023.tacl-1)
Copied to clipboard
| Challenge: | Existing methods to train a parser to perform zero-shot learning are limited by the lack of training data. |
| Approach: | They propose a decomposition-based method to unify the sentence structures of questions . their method can generalize to natural questions with novel text expressions . |
| Outcome: | The proposed method improves on synthetic data and on complex web questions with novel expressions. |
Compilable Neural Code Generation with Compiler Feedback (2022.findings-acl)
Copied to clipboard
Xin Wang, Yasheng Wang, Yao Wan, Fei Mi, Yitong Li, Pingyi Zhou, Jin Liu, Hao Wu, Xin Jiang, Qun Liu
| Challenge: | Existing deep-learning approaches model code generation as text generation, but few of them account for compilability of the generated programs. |
| Approach: | They propose a three-stage pipeline utilizing compiler feedback for compilable code generation to improve compilability. |
| Outcome: | The proposed pipeline improves compilability of generated programs by combining compiler feedback, language model fine-tuning, and compilable discrimination. |
Learning to Fuse Sentences with Transformers for Summarization (2020.emnlp-main)
Copied to clipboard
| Challenge: | Abstractive summarization systems that fuse sentences are not rewarded for correctly fusing sentences. |
| Approach: | They propose to leverage the knowledge of points of correspondence between sentences to enhance their ability to fuse sentences. |
| Outcome: | The proposed algorithms improve the ability of the proposed summarization systems to fuse sentences and show that they can fuse sentences in a way that retains the original meaning. |
Reinforced Extractive Summarization with Question-Focused Rewards (P18-3)
Copied to clipboard
| Challenge: | Existing methods for extractive summarization use human abstracts to create annotations for extraction units. |
| Approach: | They propose a method where abstracts are converted to Cloze-style comprehension questions to generate extractive summarization. |
| Outcome: | The proposed method surpasses state-of-the-art systems on the standard summarization dataset. |
"I Don’t Know What to Say": A Fact-Filling Questionnaire Method to Help Non-Experts Talk to LegalAI Assistant (2026.findings-acl)
Copied to clipboard
| Challenge: | Recent advances in large language models (LLMs) have greatly expanded the scope of legal AI. |
| Approach: | They propose a method that generates questionnaires to help users refine queries . they leverage an iterative training process that collects valuable questionnaires . |
| Outcome: | The proposed method improves the completeness of queries and ensures the performance of domain-specific models in downstream legal tasks. |
Toward Unifying Text Segmentation and Long Document Summarization (2022.emnlp-main)
Copied to clipboard
| Challenge: | Abstractive strategies produce more condensed summaries, but they suffer from hallucinations and factual errors, which pose a more difficult generation challenge. |
| Approach: | They propose a method that learns robust sentence representations by performing summarization and segmentation simultaneously, which is further enhanced by an optimization-based regularizer to promote selection of diverse summary sentences. |
| Outcome: | The proposed model achieves state-of-the-art performance on publicly available benchmarks and better cross-genre transferability when equipped with text segmentation. |
Soft Contextual Data Augmentation for Neural Machine Translation (P19-1)
Copied to clipboard
| Challenge: | Existing methods for enhancing training data are limited in natural language tasks due to text characteristics. |
| Approach: | They propose a data augmentation method that softly augments a randomly chosen word in a sentence by its contextual mixture of multiple related words. |
| Outcome: | The proposed method outperforms baseline methods on small and large scale machine translation datasets. |
DAMP: Doubly Aligned Multilingual Parser for Task-Oriented Dialogue (2023.acl-long)
Copied to clipboard
| Challenge: | Existing studies show that multilingual models are less robust for semantic parsing compared to other tasks. |
| Approach: | They propose a constrained optimization technique to optimize multilingual parsing systems for multilingual use. |
| Outcome: | The proposed technique outperforms XLM-R and mT5-Large on three benchmarks and significantly outperformed other models. |
Better Generalizing to Unseen Concepts: An Evaluation Framework and An LLM-Based Auto-Labeled Pipeline for Biomedical Concept Recognition (2026.eacl-long)
Copied to clipboard
Shanshan Liu, Noriki Nishida, Fei Cheng, Narumi Tokunaga, Rumana Ferdous Munne, Yuki Yamagata, Kouji Kozaki, Takehito Utsuro, Yuji Matsumoto
| Challenge: | Existing methods for recognizing ontology concepts are limited by the number of annotations available. |
| Approach: | They propose an evaluation framework built on hierarchical concept indices and novel metrics to measure generalization. |
| Outcome: | The proposed evaluation framework is built on hierarchical concept indices and novel metrics to measure generalization. |
ModalPrompt: Towards Efficient Multimodal Continual Instruction Tuning with Dual-Modality Guided Prompt (2025.emnlp-main)
Copied to clipboard
| Challenge: | Existing MCIT methods do not fully exploit the unique attribute of Large Multimodal Models and often gain performance at the expense of efficiency. |
| Approach: | They propose a multimodal continual instruction learning framework that exploits the ability of LMMs to learn mixed instruction datasets and prompts for each task. |
| Outcome: | The proposed framework achieves +14.26% performance gain on MCIT benchmarks with remarkable x1.42 inference speed free from growing computation. |
Step Potential Advantage Estimation: Harnessing Intermediate Confidence and Correctness for Efficient Mathematical Reasoning (2026.findings-acl)
Copied to clipboard
| Challenge: | Existing approaches to RLVR provide sparse supervision since reward arrives only after the full generation is complete. |
| Approach: | They propose a step-level reward system that extracts confidence and correctness and combines them into a Step Potential signal that explicitly estimates reasoning state at each step. |
| Outcome: | The proposed method outperforms existing methods on multiple benchmarks and improves accuracy while reducing response length. |
EviReport: From Reasoned Outlines to Evidence Tracked Long-Form Reports (2026.findings-acl)
Copied to clipboard
Zihan Liu, Jianhui li, Zexin Wang, Fei Sun, Jingjing LI, Zheyuan Li, Ke Xiang, Hang Cui, Houhua Gong, Changhua Pei, Gaogang Xie
| Challenge: | Evidence-intensive reports often produce fluent but under-supported drafts . eviReport is an evidence-grounded workflow for automated long-form report generation . |
| Approach: | They propose an evidence-tracked workflow that organizes corpus evidence into compact, traceable units and retrieves query-relevant subgraphs into retrieval-ready packages. |
| Outcome: | The proposed workflow outperforms baselines in factual coverage, factual accuracy and visual evidence integration. |
DiaASQ: A Benchmark of Conversational Aspect-based Sentiment Quadruple Analysis (2023.findings-acl)
Copied to clipboard
Bobo Li, Hao Fei, Fei Li, Yuhan Wu, Jinsong Zhang, Shengqiong Wu, Jingye Li, Yijiang Liu, Lizi Liao, Tat-Seng Chua, Donghong Ji
| Challenge: | a new task of conversational aspect-based sentiment analysis (DiaASQ) is designed to detect the quadruple of target-aspect-opinion-sentiment in a dialogue. |
| Approach: | They propose a task of conversational aspect-based sentiment quadruple analysis to detect the quadrangle of target-aspect-opinion-sentiment in a dialogue. |
| Outcome: | The proposed task is based on a high-quality dataset in Chinese and English . it improves the end-to-end quadruple prediction and integrates rich feature representations . |
Factuality of Large Language Models: A Survey (2024.emnlp-main)
Copied to clipboard
Yuxia Wang, Minghan Wang, Muhammad Arslan Manzoor, Fei Liu, Georgi Georgiev, Rocktim Das, Preslav Nakov
| Challenge: | Large language models (LLMs) are factually incorrect, which limits their applicability in real-world scenarios. |
| Approach: | They analyze existing work to identify major challenges and their associated causes . they propose to evaluate LLMs using a variety of measures to mitigate factual errors . |
| Outcome: | The proposed methods are based on a variety of datasets and proposed strategies to mitigate factual errors. |
Mixture of insighTful Experts (MoTE): The Synergy of Reasoning Chains and Expert Mixtures in Self-Alignment (2025.acl-long)
Copied to clipboard
Zhili Liu, Yunhao Gou, Kai Chen, Lanqing Hong, Jiahui Gao, Fei Mi, Yu Zhang, Zhenguo Li, Xin Jiang, Qun Liu, James Kwok
| Challenge: | Recent studies show that reasoning abilities contribute significantly to model safety, while integrating Mixture-of-Experts (MoE) architectures can further enhance alignment. |
| Approach: | They propose a framework that synergistically combines reasoning chains and expert mixtures to improve self-alignment. |
| Outcome: | The proposed framework improves model safety, jailbreak resistance, and over-refusal capabilities, achieving performance comparable to OpenAI’s state-of-the-art o1 model. |
Faithful Logical Reasoning via Symbolic Chain-of-Thought (2024.acl-long)
Copied to clipboard
| Challenge: | SymbCoT is a framework that integrates symbolic expressions and logic rules with CoT prompting. |
| Approach: | They propose a Symbolic Chain-of-Thought framework that integrates symbolic expressions and logic rules with CoT prompting. |
| Outcome: | The proposed framework improves on 5 standard datasets with symbolic expressions and rules . it shows that it is more faithful, flexible, and explainable than the current method . |
SimpleDeepSearcher: Deep Information Seeking via Web-Powered Reasoning Trajectory Synthesis (2025.findings-emnlp)
Copied to clipboard
Shuang Sun, Huatong Song, Yuhao Wang, Ruiyang Ren, Jinhao Jiang, Junjie Zhang, Fei Bai, Jia Deng, Xin Zhao, Zheng Liu, Lei Fang, Zhongyuan Wang, Ji-Rong Wen
| Challenge: | Existing approaches to deep search training lack high-quality training trajectories, prohibitive computational costs and lack of high-fidelity training data. |
| Approach: | They propose a framework that synthesizes high-quality training data by simulating real user interactions in live web search environments. |
| Outcome: | The proposed framework synthesizes high-quality training data by simulating user interactions in live web search environments. |
MoverScore: Text Generation Evaluating with Contextualized Embeddings and Earth Mover Distance (D19-1)
Copied to clipboard
| Challenge: | Existing evaluation metrics are not capable of evaluating text quality. |
| Approach: | They propose a metric that compares system output against reference texts based on semantics rather than surface forms. |
| Outcome: | The proposed metric shows a high correlation with human judgment of text quality on a number of text generation tasks. |
DiningBench: A Hierarchical Multi-view Benchmark for Perception and Reasoning in the Dietary Domain (2026.acl-long)
Copied to clipboard
| Challenge: | Existing vision-language models lack fine-grained classification, single-view imagery, and inaccurate metadata. |
| Approach: | They propose a hierarchical, multi-view benchmark to evaluate VLMs across three levels of cognitive complexity. |
| Outcome: | The proposed benchmark evaluates vision-language models across three levels of complexity . it systematically identifies five primary failure modes . the proposed benchmarks are available on https://github.com/meituan/DiningBench. |
SudoLM: Learning Access Control of Parametric Knowledge with Authorization Alignment (2025.acl-long)
Copied to clipboard
| Challenge: | Existing preference alignment is a one-size-fits-all alignment mechanism, where the part of the large language model parametric knowledge with non-preferred features is uniformly blocked to all the users. |
| Approach: | They propose a framework that lets LLMs learn access control over parametric knowledge for users with different credentials via authorization alignment. |
| Outcome: | Experiments on two application scenarios show that the proposed framework effectively controls the user’s access to parametric knowledge and maintains its general utility. |
RL-PLUS: Countering Capability Boundary Collapse of LLMs in Reinforcement Learning with Hybrid-policy Optimization (2026.acl-long)
Copied to clipboard
Yihong Dong, Xue Jiang, Yongding Tao, Huanyu Liu, Kechi Zhang, Lili Mou, Rongyu Cao, Yingwei MA, Jue Chen, Binhua Li, Zhi Jin, Fei Huang, Yongbin Li, Ge Li
| Challenge: | Reinforcement Learning with Verifiable Reward (RLVR) has significantly advanced the complex reasoning abilities of Large Language Models (LLMs). |
| Approach: | They propose a hybrid-policy optimization approach that synergizes internal exploitation with external data to achieve stronger reasoning capabilities. |
| Outcome: | The proposed approach achieves state-of-the-art performance on six math reasoning benchmarks and superior performance on out-of distribution reasoning tasks. |
Learning as Conversation: Dialogue Systems Reinforced for Information Acquisition (2022.naacl-main)
Copied to clipboard
| Challenge: | a novel AI-empowered chat bot for learning as conversation can be applied to various domains without in-domain dialogue data. |
| Approach: | They propose a novel task where a user does not read a passage but gains information and knowledge through conversation with a teacher bot. |
| Outcome: | The proposed system can be transferred to various domains without in-domain dialogue data and can carry out conversations both informative and attentive to users. |
Large Language Models are Better Reasoners with Self-Verification (2023.findings-emnlp)
Copied to clipboard
| Challenge: | Existing methods to solve complex natural language processing tasks require multiple steps to verify the answers. |
| Approach: | They propose to use chain of thought prompting to solve reasoning tasks with large language models. |
| Outcome: | The proposed method can improve reasoning performance on arithmetic, commonsense, and logical reasoning datasets. |
TextFlint: Unified Multilingual Robustness Evaluation Toolkit for Natural Language Processing (2021.acl-demo)
Copied to clipboard
Xiao Wang, Qin Liu, Tao Gui, Qi Zhang, Yicheng Zou, Xin Zhou, Jiacheng Ye, Yongxin Zhang, Rui Zheng, Zexiong Pang, Qinzhuo Wu, Zhengyan Li, Chong Zhang, Ruotian Ma, Zichu Fei, Ruijian Cai, Jun Zhao, Xingwu Hu, Zhiheng Yan, Yiding Tan, Yuan Hu, Qiyuan Bian, Zhihua Liu, Shan Qin, Bolin Zhu, Xiaoyu Xing, Jinlan Fu, Yue Zhang, Minlong Peng, Xiaoqing Zheng, Yaqian Zhou, Zhongyu Wei, Xipeng Qiu, Xuanjing Huang
| Challenge: | Existing approaches to textual robustness evaluation focus on slightly modifying the input data, which maintains the original meaning and results in a different prediction. |
| Approach: | They propose a multilingual robustness evaluation toolkit for NLP that integrates universal text transformations, task-specific transformations and adversarial attack. |
| Outcome: | The toolkit includes universal text transformation, task-specific transformation, adversarial attack, subpopulation, and their combinations to provide comprehensive robustness analyses. |
Dolphin: Document Image Parsing via Heterogeneous Anchor Prompting (2025.findings-acl)
Copied to clipboard
Hao Feng, Shu Wei, Xiang Fei, Wei Shi, Yingdong Han, Lei Liao, Jinghui Lu, Binghong Wu, Qi Liu, Chunhui Lin, Jingqun Tang, Hao Liu, Can Huang
| Challenge: | Current document image parsing solutions rely on specialized models or generate content autoregressively. |
| Approach: | They propose a multimodal document image parsing model that integrates specialized models with autogeneous content generation. |
| Outcome: | The proposed model achieves state-of-the-art performance across diverse page-level and element-level settings while ensuring superior efficiency. |
MeetingBank: A Benchmark Dataset for Meeting Summarization (2023.acl-long)
Copied to clipboard
| Challenge: | a lack of annotated meeting corpora hinders the development of meeting summarization technology. |
| Approach: | They present a new benchmark dataset of city council meetings over the past decade . they use a divide-and-conquer approach to divide professionally written minutes into shorter passages . |
| Outcome: | The proposed dataset provides a testbed for various meeting summarization systems and allows the public to gain insight into how council decisions are made. |
PANDA: Preference Adaptation for Enhancing Domain-Specific Abilities of LLMs (2024.findings-acl)
Copied to clipboard
| Challenge: | Large language models have demonstrated considerable capabilities across various tasks . however, they often fall short of the performance achieved by domain-specific state-of-the-art models . |
| Approach: | They propose a tuning-free method to augment domain-specific abilities of Large language models . they leverage insights from the response preference of expert models to augment LLMs . |
| Outcome: | The proposed method outperforms the expert model on 4 ScienceWorld tasks. |
VECO: Variable and Flexible Cross-lingual Pre-training for Language Understanding and Generation (2021.acl-long)
Copied to clipboard
| Challenge: | Existing work in multilingual pretraining relies on the shared vocabulary and bilingual contexts to encourage the correlation across languages. |
| Approach: | They propose to plug a cross-attention module into a Transformer encoder to explicitly build the interdependence between languages. |
| Outcome: | The proposed model outperforms existing models on XTREME and English-to-French translation datasets. |