Papers by Liang Zhang
To Forget or Not? Towards Practical Knowledge Unlearning for Large Language Models (2024.findings-emnlp)
Copied to clipboard
Bozhong Tian, Xiaozhuan Liang, Siyuan Cheng, Qingbin Liu, Mengru Wang, Dianbo Sui, Xi Chen, Huajun Chen, Ningyu Zhang
| Challenge: | Existing unlearning paradigms are mired in vague forgetting boundaries, erasing knowledge indiscriminately. |
| Approach: | They propose a benchmark to evaluate if unlearning erases essential knowledge . they propose 'knowUnDo' which uses copyrighted content and privacy domains . |
| Outcome: | The proposed method is superior to existing methods in both precise knowledge unlearning and general knowledge retaining of LLMs. |
RiOT: Efficient Prompt Refinement with Residual Optimization Tree (2025.acl-long)
Copied to clipboard
| Challenge: | Existing methods for automatic prompt optimization face two challenges: lack of diversity and semantic drift. |
| Approach: | They propose a framework for automatic prompt optimization that iteratively refines prompts through text gradients and selects the best prompt using perplexity. |
| Outcome: | The proposed framework outperforms existing prompt optimization methods and manual prompting on commonsense, mathematical, logical, temporal, and semantic reasoning benchmarks. |
AFT-Tab: Adversarial Fine-Tuning for Tabular Data Synthesis with Long Text Columns (2026.acl-long)
Copied to clipboard
| Challenge: | Existing tabular data synthesis methods fail to account for cross-modal heterogeneity of real-world tables, where structured continuous and discrete attributes coexist with unstructured long-text columns. |
| Approach: | They propose a framework that synergistically trains an LLM-based text generator and a deep-learning-based non-textual generator to quantify cross-modal semantic alignment. |
| Outcome: | The proposed framework outperforms state-of-the-art frameworks in fidelity, diversity, and task utility. |
Temporal Knowledge Graph Reasoning with Dynamic Hypergraph Embedding (2024.lrec-main)
Copied to clipboard
| Challenge: | Existing models that model temporal dynamics with knowledge graphs and graph convolution networks lack high-order interactions between objects in TKG, which is an important factor to predict future facts. |
| Approach: | They propose to embed temporal knowledge graph reasoning by constructing hypergraphs based on temporal information graphs at different timestamps and then adapt dynamic meta-embedding to fit TKG. |
| Outcome: | The proposed method outperforms baseline models on public TKG datasets and provides good interpretation for the predicted results. |
AMIA: Automatic Masking and Joint Intention Analysis Makes LVLMs Robust Jailbreak Defenders (2025.findings-emnlp)
Copied to clipboard
| Challenge: | AMIA is a lightweight, inference-only defense for Large Vision–Language Models . it automatically masks text-irrelevant image patches and conducts joint Intention Analysis . |
| Approach: | AMIA is a lightweight, inference-only defense for large vision–language models . it automatically masks a small set of text-irrelevant image patches to disrupt adversarial perturbations . |
| Outcome: | AMIA improves defense success rates across diverse LVLMs and jailbreak benchmarks . it preserves general utility with only 2% accuracy drop, incurs only modest inference overhead . |
Less is More: Mitigating Multimodal Hallucination from an EOS Decision Perspective (2024.acl-long)
Copied to clipboard
| Challenge: | Extensive research has shed light on the origins of multimodal hallucinations, including the inability of vision encoders to represent finegrained visual details and model reliance on inherent parametric knowledge such as language priors and statistical biases. |
| Approach: | They propose to use EOS to terminate generation of large multimodal models by comparing the generated text with the image to mitigate multimodal hallucinations. |
| Outcome: | The proposed method significantly improves the hallucination performance of Large Multimodal Models without additional data or knowledge. |
Multiview Clickbait Detection via Jointly Modeling Subjective and Objective Preference (2023.findings-emnlp)
Copied to clipboard
| Challenge: | Existing clickbait detection models rely on analyzing the objective semantics of posts or correlating posts with article content only, but fail to identify and exploit the manipulation intention of clickbaiting from a user’s subjective perspective. |
| Approach: | They propose a multiview clickbait detection model to model subjective and objective preferences simultaneously to capture clickbaiting from a user's subjective perspective. |
| Outcome: | The proposed model outperforms state-of-the-art models on two real-world datasets and shows that it integrates subjective and objective preferences simultaneously. |
DentalGPT: Incentivizing Multimodal Reasoning in Dentistry (2026.findings-acl)
Copied to clipboard
Zhenyang Cai, Jiaming Zhang, Junjie Zhao, Ziyi Zeng, Yanchao Li, Liang Jingyi, Junying Chen, Yunjin Yang, Jiajun You, Shuzhi Deng, null Xieruiqiii, Yuanting Chen, Xiangyi Feng, Jianquan Li, Liangyi Chen, Junwen Wang, Shan Jiang, Benyou Wang
| Challenge: | Current multimodal large language models (MLLMs) show limited understanding of dental images. |
| Approach: | They propose a dental-specialized multimodal large language model trained via staged multimodal alignment and reinforcement learning. |
| Outcome: | The proposed model outperforms state-of-the-art models on disease classification and dental VQA tasks. |
Two Pathways to Truthfulness: On the Intrinsic Encoding of LLM Hallucinations (2026.acl-long)
Copied to clipboard
Wen Luo, Guangyue Peng, Wei Li, Shaohang Wei, Feifan Song, Liang Wang, Nan Yang, Xingxing Zhang, Jing Jin, Furu Wei, Houfeng Wang
| Challenge: | Previous work shows that large language models generate hallucinations, yet the origins and mechanisms of these signals remain unclear. |
| Approach: | They propose to validate and disentangle two different pathways for truthfulness cues . they also propose to use the same mechanism to derive self-contained evidence from the generated answer . |
| Outcome: | The proposed applications improve hallucination detection performance by integrating two different inputs. |
GroupToM-Bench: Benchmarking Group Theory of Mind and Nonlinear Social Emergence in MLLMs (2026.acl-long)
Copied to clipboard
Weidong Tang, Jierui Li, Yueling Hou, Zihan Mei, Can Zhang, Xinyan Wan, Zhiyuan Liang, Pengfei Zhou, Yang You, Wangbo Zhao
| Challenge: | Existing models for general intelligence fail to model how mental states interact and crystallize into group-level outcomes. |
| Approach: | They propose a multimodal benchmark for group-level Theory of Mind (ToM) to probe nonlinear collective behavior. |
| Outcome: | The proposed model performs significantly below human levels, exposing blind spots in modeling social structures and nonlinear collective behavior. |
IEPile: Unearthing Large Scale Schema-Conditioned Information Extraction Corpus (2024.acl-short)
Copied to clipboard
| Challenge: | Large Language Models exhibit a significant performance gap in Information Extraction (IE) high-quality instruction data is the vital key for enhancing LLMs' specific capabilities . |
| Approach: | They propose a bilingual (English and Chinese) IE instruction corpus that contains 0.32B tokens. |
| Outcome: | The proposed model improves the performance of LLMs for IE with zero-shot generalization. |
Sparse-RL: Breaking the Memory Wall in LLM Reinforcement Learning via Stable Sparse Rollouts (2026.acl-long)
Copied to clipboard
Sijia Luo, Xiaokang Zhang, Yuxuan Hu, Bohan Zhang, Ke Wang, Jinbo Su, Mengshu Sun, Lei Liang, Jing Zhang
| Challenge: | Existing methods for storing key-value caches during long-horizon rollouts cause performance collapses. |
| Approach: | They propose a new training paradigm that empowers stable RL training under sparse rollouts. |
| Outcome: | The proposed model reduces rollout overhead while maintaining the performance. |
Curriculum Knowledge Distillation for Emoji-supervised Cross-lingual Sentiment Analysis (2022.emnlp-main)
Copied to clipboard
| Challenge: | Existing sentiment analysis models do not have sufficient sentiment corpus to detect sentiment in low-resource languages. |
| Approach: | They propose a cross-lingual sentiment analysis approach to transfer sentiment knowledge across languages . they use emojis to bridge the source and target languages to find the sentiment . |
| Outcome: | The proposed approach bridges the source and target languages using emojis . it can learn delicate sentiment knowledge, avoiding cross-lingual gaps . |
OpenVNA: A Framework for Analyzing the Behavior of Multimodal Language Understanding System under Noisy Scenarios (2024.acl-demos)
Copied to clipboard
| Challenge: | OpenVNA is an open-source framework for analyzing the behavior of multimodal language understanding systems under noisy conditions. |
| Approach: | They propose to use OpenVNA to analyze behavior of multimodal language understanding systems under noisy conditions. |
| Outcome: | The proposed framework provides high flexibility and extensibility, enabling customization with user-defined noise types and models. |
RTQA : Recursive Thinking for Complex Temporal Knowledge Graph Question Answering with Large Language Models (2025.emnlp-main)
Copied to clipboard
| Challenge: | Current temporal knowledge graph question answering methods focus on implicit temporal constraints and lack the capability to handle complex temporal queries. |
| Approach: | They propose a temporal knowledge graph question answering framework that recursively decomposes questions into sub-problems and employs multi-path answer aggregation to improve fault tolerance. |
| Outcome: | The proposed framework outperforms existing methods on multiTQ and TimelineKGQA benchmarks. |
ArMATH: a Dataset for Solving Arabic Math Word Problems (2022.lrec-1)
Copied to clipboard
| Challenge: | This paper is the first to use deep learning methods to solve Arabic MWPs . it is also the first study to use transfer learning to solve MWp across different languages . |
| Approach: | They contribute to the first large-scale dataset for Arabic Math Word Problems . they use deep learning methods to solve Arabic MWPs and a transfer learning model to promote performance . |
| Outcome: | The proposed model improves Arabic MWP solvers by 3% over the existing model. |
POLYCHARTQA: Benchmarking Large Vision-Language Models with Multilingual Chart Question Answering (2026.acl-long)
Copied to clipboard
| Challenge: | Existing chart understanding benchmarks are overwhelmingly English-centric, limiting their accessibility and relevance to global audiences. |
| Approach: | They propose a multilingual chart question answering benchmark that enables efficient multilingual generation via data translation and code reuse. |
| Outcome: | The proposed benchmark systematically evaluates multilingual chart understanding on state-of-the-art LVLMs and shows a significant performance gap between English and other languages. |
Logical Closed Loop: Uncovering Object Hallucinations in Large Vision-Language Models (2024.findings-acl)
Copied to clipboard
| Challenge: | Object hallucination has been an Achilles’ heel which hinders the broader applications of large vision-language models (LVLMs). |
| Approach: | They propose a logical closed loop-based framework for Object Hallucination Detection and Mitigation that uses logical consistency probing to raise questions with logical correlations to determine hallucinations. |
| Outcome: | The proposed method can be applied to all existing LVLMs and is effective and general. |
Aegis:An Advanced LLM-Based Multi-Agent for Intelligent Functional Safety Engineering (2024.emnlp-industry)
Copied to clipboard
| Challenge: | Aegis is an advanced LLM-based multi-agent for intelligent functional safety engineering that can perform all phases of a vehicle's lifecycle, including design, development, production, operation, and decommissioning. |
| Approach: | They introduce Aegis: An Advanced LLM-Based Multi-Agent for Intelligent Functional Safety Engineering. |
| Outcome: | The proposed solution can perform Hazard Analysis and Risk Assessment (HARA), document Functional Safety Requirements (FSR), and plan test cases for Automatic Emergency Braking (AEB) systems. |
PaddleSpeech: An Easy-to-Use All-in-One Speech Toolkit (2022.naacl-demo)
Copied to clipboard
Hui Zhang, Tian Yuan, Junkun Chen, Xintong Li, Renjie Zheng, Yuxin Huang, Xiaojie Chen, Enlei Gong, Zeyu Chen, Xiaoguang Hu, Dianhai Yu, Yanjun Ma, Liang Huang
| Challenge: | PaddleSpeech is an open-source speech toolkit that supports speech-to-text and text-to speech tasks. |
| Approach: | They describe the design philosophy and core architecture of PaddleSpeech to support several essential speech-to-text and text-to speech tasks. |
| Outcome: | The proposed framework achieves competitive or state-of-the-art performance on various speech datasets and implements the most popular methods. |
Draft Model Knows When to Stop: Self-Verification Speculative Decoding for Long-Form Generation (2025.emnlp-main)
Copied to clipboard
| Challenge: | Conventional speculative decoding methods use a predefined length policy for proposing drafts, but the reality deviates from this assumption. |
| Approach: | They propose a self-verification length policy that adaptively determines the lengths of draft sequences by referring to the draft entropy. |
| Outcome: | The proposed method achieves 17% speedup on MT-Bench and 22% speedup in long-form reasoning. |
VET: Verifiable Execution Tracing for Reliable Text-to-SQL Generation (2026.findings-acl)
Copied to clipboard
| Challenge: | Existing methods for text-to-SQL generation are prone to hallucinations and grounding . authors present a novel reasoning paradigm that transforms text- to-Sql from unverifiable textual rationales into step-wise executable semantics. |
| Approach: | They propose a reasoning paradigm that transforms text-to-SQL from unverifiable textual rationales into step-wise executable semantics. |
| Outcome: | The proposed reasoning paradigm transforms text-to-SQL from unverifiable textual rationales into step-wise executable semantics. |
FlowRAG: Synergizing Explicit Reasoning via Frequency-Aware Multi-Granularity Graph Flow (2026.findings-acl)
Copied to clipboard
| Challenge: | Existing methods for Graph-based retrieval-augmented generation rely on implicit semantic relevance propagation. |
| Approach: | They propose a semantic-aware retrieval framework that improves both semantic recall and explicit reasoning. |
| Outcome: | Extensive experiments show that FlowRAG improves both semantic recall and explicit reasoning. |
MultiCMET: A Novel Chinese Benchmark for Understanding Multimodal Metaphor (2023.findings-emnlp)
Copied to clipboard
| Challenge: | Existing research on multimodal metaphors does not address categorizing the source and target domains in metaphors beyond the English language. |
| Approach: | They propose a Cascading Domain Knowledge Integration benchmark to detect metaphors by introducing domain-specific lexical features. |
| Outcome: | The proposed dataset includes 13,820 text-image pairs of advertisements with manual annotations of the occurrence of metaphors, domain categories, and sentiments metaphors convey. |
GMH: A General Multi-hop Reasoning Model for KG Completion (2021.emnlp-main)
Copied to clipboard
| Challenge: | Knowledge graphs are incomplete with many facts missing, causing performance bottlenecks in many applications. |
| Approach: | They propose a general multi-hop reasoning task that can be formulated as a search process and can be extended to long-distance reasoning scenarios. |
| Outcome: | The proposed model improves on baselines in short and long distance reasoning scenarios. |
CLOMO: Counterfactual Logical Modification with Large Language Models (2024.acl-long)
Copied to clipboard
Yinya Huang, Ruixin Hong, Hongming Zhang, Wei Shao, Zhicheng Yang, Dong Yu, Changshui Zhang, Xiaodan Liang, Linqi Song
| Challenge: | Existing studies on evaluating model reasoning are limited in both form and content. |
| Approach: | They propose a task to cultivate counterfactual thought processes within large language models and an evaluation metric to evaluate their natural language output instead of modeling the task as a multiple-choice problem. |
| Outcome: | The proposed evaluation metric aligns well with human preference. |
MINER: Improving Out-of-Vocabulary Named Entity Recognition from an Information Theoretic Perspective (2022.acl-long)
Copied to clipboard
Xiao Wang, Shihan Dou, Limao Xiong, Yicheng Zou, Qi Zhang, Tao Gui, Liang Qiao, Zhanzhan Cheng, Xuanjing Huang
| Challenge: | Named Entity Recognition models are feature-engineering and machine learning based. |
| Approach: | They propose a new NER learning framework that uses entity mentions to improve model performance. |
| Outcome: | The proposed model achieves better performance on OOV entities on various settings and datasets. |
Task-Oriented Dialogue as Dataflow Synthesis (2020.tacl-1)
Copied to clipboard
Jacob Andreas, John Bufe, David Burkett, Charles Chen, Josh Clausman, Jean Crawford, Kate Crim, Jordan DeLoach, Leah Dorner, Jason Eisner, Hao Fang, Alan Guo, David Hall, Kristin Hayes, Kellie Hill, Diana Ho, Wendy Iwaszuk, Smriti Jha, Dan Klein, Jayant Krishnamurthy, Theo Lanman, Percy Liang, Christopher H. Lin, Ilya Lintsbakh, Andy McGovern, Aleksandr Nisnevich, Adam Pauls, Dmitrij Petters, Brent Read, Dan Roth, Subhro Roy, Jesse Rusak, Beth Short, Div Slomin, Ben Snyder, Stephon Striplin, Yu Su, Zachary Tellman, Sam Thomson, Andrei Vorobev, Izabela Witoszko, Jason Wolfe, Abby Wray, Yuchen Zhang, Alexander Zotov
| Challenge: | Existing approaches to task-oriented dialogue represent dialogue state as a dataflow graph . microsoft's SMCalFlow dataset features complex dialogues about events, weather, places, and people . |
| Approach: | They propose a dataflow graph-based dialogue agent that maps each user utterance to a program that extends this graph. |
| Outcome: | The proposed framework improves representability and predictability in natural dialogues . it uses dataflow graphs and metacomputation to map user intents to a program . |
Towards Understanding and Improving Knowledge Distillation for Neural Machine Translation (2023.acl-long)
Copied to clipboard
| Challenge: | Existing knowledge distillation techniques for neural machine translation lack special treatment on the top-1 information, which is limiting the potential of KD. |
| Approach: | They propose a method to distill knowledge from top-1 predictions of teachers and a technique to infuse more additional knowledge by distilling on the data without ground-truth targets. |
| Outcome: | The proposed method outperforms the vanilla word-level KD and outperfies the existing methods on three different students with different capacity gaps. |
SHIFT: Selected Helpful Informative Frame for Video-guided Machine Translation (2025.emnlp-main)
Copied to clipboard
| Challenge: | Video-guided machine translation (VMT) aims to improve translation quality by integrating contextual information from paired short video clips. |
| Approach: | They propose a plug-and-play framework for video-guided machine translation with multimodal large language models. |
| Outcome: | The proposed framework improves performance of MLLMs while reducing computational cost. |
Self-Powered LLM Modality Expansion for Large Speech-Text Models (2024.emnlp-main)
Copied to clipboard
| Challenge: | Large language models exhibit remarkable performance across diverse tasks . however, these methods require significant resource demands and tend to overfit specific tasks. |
| Approach: | They propose a self-powered LSM that leverages augmented automatic speech recognition data generated by the model itself for more effective instruction tuning. |
| Outcome: | The proposed model mitigates speech anchor bias and improves the fusion of speech and text modalities in large language models. |
RepoAgent: An LLM-Powered Open-Source Framework for Repository-level Code Documentation Generation (2024.emnlp-demo)
Copied to clipboard
Qinyu Luo, Yining Ye, Shihao Liang, Zhong Zhang, Yujia Qin, Yaxi Lu, Yesai Wu, Xin Cong, Yankai Lin, Yingli Zhang, Xiaoyin Che, Zhiyuan Liu, Maosong Sun
| Challenge: | Xia et al., 2018) demonstrate that a large language model can generate and maintain high-quality code documentation. |
| Approach: | They propose a large language model powered open-source framework for generating, maintaining, and updating code documentation. |
| Outcome: | The proposed framework generates high-quality documentation for the entire project. |
AutoMedEval: Harnessing Language Models for Automatic Medical Capability Evaluation (2025.acl-long)
Copied to clipboard
Xiechi Zhang, Zetian Ouyang, Linlin Wang, Gerard De Melo, Zhu Cao, Xiaoling Wang, Ya Zhang, Yanfeng Wang, Liang He
| Challenge: | Existing evaluation methods based on large language models (LLMs) are expensive and lack expertise due to limitations in human expertise. |
| Approach: | They propose an open-source automatic evaluation model with 13B parameters specifically engineered to measure the question-answering proficiency of medical LLMs. |
| Outcome: | The proposed model surpasses baselines in terms of correlation with human judgments. |
ToxiTrace: Gradient-Aligned Training for Explainable Chinese Toxicity Detection (2026.findings-acl)
Copied to clipboard
| Challenge: | Existing toxic content detection methods focus on sentence-level classification but fail to provide readable and contiguous toxic evidence spans. |
| Approach: | They propose an explainability-oriented method for Chinese toxic content detection methods . they refine saliency cues into fine-grained toxic spans with lightweight LLM guidance . |
| Outcome: | The proposed method improves classification accuracy and toxic span extraction while preserving efficient encoder-based inference and producing more coherent explanations. |
MADial-Bench: Towards Real-world Evaluation of Memory-Augmented Dialogue Generation (2025.naacl-long)
Copied to clipboard
| Challenge: | Existing evaluation metrics for memory-augmented dialogue systems lack practical value . current evaluation methods only consider passive memory retrieval while ignoring diverse memory recall with rich triggering factors. |
| Approach: | They propose to use long-term memory to create human-like dialogues using chatbots. |
| Outcome: | The proposed benchmark covers memory retrieval and memory recognition tasks with both passive and proactive memory recall data. |
The Efficiency vs. Accuracy Trade-off: Optimizing RAG-Enhanced LLM Recommender Systems Using Multi-Head Early Exit (2025.acl-long)
Copied to clipboard
Huixue Zhou, Hengrui Gu, Zaifu Zhan, Xi Liu, Kaixiong Zhou, Yongkang Xiao, Mingfu Liang, Srinivas Prasad Govindan, Piyush Chawla, Jiyan Yang, Xiangfei Meng, Huayu Li, Buyun Zhang, Liang Luo, Wen-Yen Chen, Yiping Han, Bo Long, Rui Zhang, Tianlong Chen
| Challenge: | Existing frameworks for Large Language Models (LLMs) for Click-Through Rate prediction require a careful balance between computational efficiency and predictive accuracy. |
| Approach: | They propose a framework that integrates Retrieval-Augmented Generation with a novel multi-head early exit architecture to address both challenges. |
| Outcome: | The proposed framework reduces retrieval time while maintaining high model performance. |
CR-UTP: Certified Robustness against Universal Text Perturbations on Large Language Models (2024.findings-acl)
Copied to clipboard
| Challenge: | Existing certified robustness methods for certifying input-specific text perturbations have shown promise in certifyling UTPs, but masking only adversarial words can eliminate the attack. |
| Approach: | They propose a method to certify a language model’s robustness against UTPs by using random smoothing. |
| Outcome: | The proposed method achieves high certified accuracy under extensive masking and achieves state-of-the-art results in multiple settings. |
SKA-Bench: A Fine-Grained Benchmark for Evaluating Structured Knowledge Understanding of LLMs (2025.findings-emnlp)
Copied to clipboard
| Challenge: | Existing evaluations for Structured Knowledge (SK) understanding are non-rigorous and focus on a single type of SK. |
| Approach: | They propose a structured knowledge understanding benchmark that includes four widely used structured knowledge forms. |
| Outcome: | The proposed benchmark is based on four widely used structured knowledge forms . it includes a question, an answer, positive knowledge units, and noisy knowledge units . |
Temp-R1: A Unified Autonomous Agent for Complex Temporal KGQA via Reverse Curriculum Reinforcement Learning (2026.acl-long)
Copied to clipboard
Zhaoyan Gong, Zhiqiang Liu, Songze Li, Xiaoke Guo, Yuanxiang Liu, Xinle Deng, Zhizhen Liu, Lei Liang, Huajun Chen, Wen Zhang
| Challenge: | Existing methods rely on fixed workflows and expensive closed-source APIs, limiting flexibility and scalability. |
| Approach: | They propose a temporal reasoning agent that trains on difficult questions first . they expand the action space with specialized internal actions alongside external action . |
| Outcome: | The proposed agent improves 19.8% over baselines on complex questions and multi-tasks. |
A Novel Aspect-Guided Deep Transition Model for Aspect Based Sentiment Analysis (D19-1)
Copied to clipboard
| Challenge: | Existing models use aspect-independent encoders for sentence representation generation. |
| Approach: | They propose an aspect-guided deep transition model which guides the sentence encoding from scratch with a specially-designed deep transition architecture. |
| Outcome: | The proposed model outperforms existing models on multiple datasets on aspect-category sentiment analysis and aspectterm sentiment analysis without additional features. |
HAUSER: Towards Holistic and Automatic Evaluation of Simile Generation (2023.acl-long)
Copied to clipboard
| Challenge: | Similes are a crucial part of creative writing, but there is still a lack of evaluation metrics for simile generation. |
| Approach: | They propose to use similes as a tool to evaluate simile generation metrics . they propose to combine five criteria and automatic metrics for each criterion . |
| Outcome: | The proposed metrics are significantly more correlated with human ratings from each perspective compared with prior automatic metrics. |
EventRAG: Enhancing LLM Generation with Event Knowledge Graphs (2025.acl-long)
Copied to clipboard
Zairun Yang, Yilin Wang, Zhengyan Shi, Yuan Yao, Lei Liang, Keyan Ding, Emine Yilmaz, Huajun Chen, Qiang Zhang
| Challenge: | Existing approaches to text generation often neglect event structures that shape real-world narratives. |
| Approach: | They propose a framework that integrates structured event semantics with iterative retrieval and inference to enhance text generation. |
| Outcome: | Experiments on UltraDomain and MultiHopRAG show that the proposed framework outperforms baseline RAG systems in generation effectiveness, logical consistency, and multi-hop reasoning accuracy. |
Unifying Human and Statistical Evaluation for Natural Language Generation (N19-1)
Copied to clipboard
| Challenge: | Human evaluation captures quality but fails to capture diversity . statistical evaluation fails to catch models that plagiarize from training set . |
| Approach: | They propose a framework which evaluates both diversity and quality based on the optimal error rate of predicting whether a sentence is human-generated. |
| Outcome: | The proposed framework evaluates diversity and quality on summarization and chit-chat dialogue. |
Dynamic and Efficient Inference for Text Generation via BERT Family (2023.acl-long)
Copied to clipboard
| Challenge: | Existing methods to improve performance of pre-trained language models are limited due to large-scale parameters and the universal autoregressive decoding paradigm. |
| Approach: | They propose a novel fine-tuning method which can make a single pre-trained model support Dynamic and Efficient infERence and achieve an adaptive trade-off between model performance and latency. |
| Outcome: | The proposed method achieves higher BLEU scores than the strong autoregressive Transformer model on translation tasks with 3 12 times speedup and faster inference speed compared with the BART model on four GLGE benchmark tasks. |
C-World: A Computer Use Agent Environment Creator (2026.acl-long)
Copied to clipboard
Ziqiao Xi, Shuang Liang, Qi Liu, Jiaqing Zhang, Letian Peng, Fang Nan, Meshal Nayim, Tianhui Zhang, Rishika Mundada, Lianhui Qin, Biwei Huang, Kun Zhou
| Challenge: | C-World enables users to build agent environments on demand. |
| Approach: | They propose a system that enables users to build agent environments on demand. |
| Outcome: | The proposed system outperforms baselines on 119k samples and achieves Spearman = 0.883 ranking correlation with real execution. |
ServImage: An Image Generation and Editing Benchmark from Real-world Commercial Imaging Services (2026.acl-long)
Copied to clipboard
Fengxian Ji, Jingpu Yang, Zirui Song, Lang Gao, Junhong Liang, Zhenhao Chen, Jinghui Zhang, Xiuying Chen
| Challenge: | Recent image generation and editing models demonstrate robust adherence to instructions and high visual quality on academic benchmarks. |
| Approach: | They propose a benchmark that correlates image outputs with economic value in commercial design projects. |
| Outcome: | ServImage benchmarks show image generation models perform well on academic benchmarks but are uncertain on commercial projects. |
GuideTree: Guideline-Induced Review Trees for Long Medical Records (2026.acl-industry)
Copied to clipboard
| Challenge: | Medical record reviewers must produce consistent, traceable, guideline-compliant outcomes . longcontext inference is expensive and often degrades as inputs grow . |
| Approach: | a new method compiles textual guidelines into a fixed review tree . a cost-aware split-and-prune search is used to update the tree offline . the algorithm produces consistent, traceable, guideline-compliant outcomes . |
| Outcome: | The proposed system outperforms the strongest non-expert baselines by 84.5–92.8 Macro-F1 . it reduces average I/O volume to 74K input+output characters and average latency to 22s . |
Respond in my Language: Mitigating Language Inconsistency in Response Generation based on Large Language Models (2024.acl-long)
Copied to clipboard
| Challenge: | Large Language Models (LLMs) show strong instruction understanding ability across multiple languages, but are easily biased towards English in instruction tuning. |
| Approach: | They propose to use a model with Pseudo-Inconsistent Penalization to prevent the model from generating English responses when given non-English language prompts during training and prior Enhanced decoding to improve the language consistency of the model. |
| Outcome: | The proposed methods significantly improve the language consistency of the model without multilingual data. |
Rethinking Text-to-SQL: Dynamic Multi-turn SQL Interaction for Real-world Database Exploration (2026.findings-acl)
Copied to clipboard
Linzhuang Sun, Tianyu Guo, Hao Liang, Ruitong Liu, Yuying Li, Qifeng Cai, Jingxuan Wei, Yuchen Wu, Bihui Yu, Xiangxiang Zhang, Wentao Zhang, Bin Cui
| Challenge: | Structured Query Language (SQL) is the cornerstone for data-driven decision-making. |
| Approach: | They propose a benchmark to rigorously evaluate Large Language Models within a dynamic interaction framework. |
| Outcome: | The proposed benchmark aims to rigorously evaluate LLMs within a dynamic interaction framework. |
SPARD: Self-Paced Curriculum for RL Alignment via Integrating Reward Dynamics and Data Utility (2026.acl-long)
Copied to clipboard
Xuyang Zhi, Peilun Zhou, Chengqiang Lu, Hang Lv, Yiwei Liang, Rongyang Zhang, Yan Gao, null Yiwu, Yao Hu, Hongchao Gu, Defu Lian, Hao Wang, Enhong Chen
| Challenge: | Large Language Models (LLMs) are shifting the focus from single verifiable tasks toward complex, open-ended real-world scenarios. |
| Approach: | They propose a framework that automatically adjusts reward weights and data importance to synchronize learning intent with data utility for optimal performance. |
| Outcome: | The proposed framework improves model capabilities across all domains and scales. |
Data Interpreter: An LLM Agent for Data Science (2025.findings-acl)
Copied to clipboard
Sirui Hong, Yizhang Lin, Bang Liu, Bangbang Liu, Binhao Wu, Ceyao Zhang, Danyang Li, Jiaqi Chen, Jiayi Zhang, Jinlin Wang, Li Zhang, Lingyao Zhang, Min Yang, Mingchen Zhuge, Taicheng Guo, Tuo Zhou, Wei Tao, Robert Tang, Xiangtao Lu, Xiawu Zheng, Xinbing Liang, Yaying Fei, Yuheng Cheng, Yongxin Ni, Zhibin Gou, Zongze Xu, Yuyu Luo, Chenglin Wu
| Challenge: | Large Language Models (LLMs) excel in various domains but face challenges when applied to data science workflows due to their complex, multi-stage nature. |
| Approach: | They propose a hierarchical graph-based agent that represents complexity and a progressive strategy for step-by-step verification, refinement, and consistent context management. |
| Outcome: | The proposed agent surpasses state-of-the-art baselines on the MATH dataset and performs better on InfiAgent-DABench. |
Training LLMs for Divide-and-Conquer Reasoning Elevates Test-Time Scalability (2026.acl-long)
Copied to clipboard
Xiao Liang, Zhong-Zhi Li, Zhenghao Lin, Eric Hanchen Jiang, Hengyuan Zhang, Yelong Shen, Kai-Wei Chang, Ying Nian Wu, Yeyun Gong, Weizhu Chen
| Challenge: | Large language models have demonstrated strong reasoning capabilities through step-by-step chain-of-thought (CoT) reasoning, but their strictly sequential nature constrains test-time scalability. |
| Approach: | They propose an end-to-end reinforcement learning framework to enhance LLMs' DAC-style reasoning capacity by decomposing a problem into subproblems and solving them sequentially. |
| Outcome: | The proposed model surpasses CoT by 8.6% and 6.3% on competition-level benchmarks and is available at the [github.com/MasterVito/DAC-RL]. |
An Auxiliary Task Boosted Multi-task Learning Method for Service Account Retrieval with Limited Human Annotation (2023.emnlp-industry)
Copied to clipboard
| Challenge: | Existing approaches to service account retrieval have limited human annotation, resulting in labor-intensive and time-consuming tasks. |
| Approach: | They propose an Auxiliary task Boosted Multi-Task Learning method which introduces multiple auxiliary tasks and enhances the performance of the main task, service account retrieval. |
| Outcome: | The proposed method improves the performance of the main task, service account retrieval. |
Locate, Steer, and Improve: A Practical Survey of Actionable Mechanistic Interpretability in Large Language Models (2026.findings-acl)
Copied to clipboard
Hengyuan Zhang, Zhihao Zhang, Ercong Nie, Mingyang Wang, Zunhai Su, Yiwei Wang, Qianli Wang, Shuzhou Yuan, Xufeng Duan, Qibo Xue, Zeping Yu, Chenming Shang, Xiao Liang, Jing Xiong, Hui Shen, Chaofan Tao, Zhengwu Liu, Senjie Jin, Zhiheng Xi, Dongdong Zhang, Sophia Ananiadou, Tao Gui, Ruobing Xie, Hayden Kwok-Hay So, Hinrich Schuetze, Xuanjing Huang, Qi Zhang, Ngai Wong
| Challenge: | Existing literature on mechanistic interpretation (MI) treats it as an observational science, leaving practical applications underexplored. |
| Approach: | They propose a survey structured around the pipeline to identify and improve MI models. |
| Outcome: | The proposed framework enables tangible improvements in Alignment, Capability, and Efficiency. |
InfoMetIC: An Informative Metric for Reference-free Image Caption Evaluation (2023.acl-long)
Copied to clipboard
| Challenge: | Existing image captioning metrics provide a single score to measure caption qualities, which are less explainable and informative. |
| Approach: | They propose an Informative Metric for Reference-free Image Caption evaluation to support this feedback . they propose to provide a text precision score, a vision recall score and an overall quality score . |
| Outcome: | The proposed method improves on existing metrics on multiple benchmarks and compares coarse-grained scores with human judgements. |
MMA: Cross-Domain Knowledge Integration via Mixture of Multi-Domain Agents (2025.findings-emnlp)
Copied to clipboard
| Challenge: | achieving synergistic improvements between generalization and domain specialization remains a challenge in pre-training and post-training. |
| Approach: | They propose a test-time cross-domain knowledge integration method that integrates general-purpose and domain-specific models to enhance their performance on complex, domainspecific tasks. |
| Outcome: | The proposed method combines the outputs of general-purpose and domain-specific models to improve their performance on complex, domainspecific tasks. |
UniMath: A Foundational and Multimodal Mathematical Reasoner (2023.emnlp-main)
Copied to clipboard
| Challenge: | Existing methods for interpreting and processing diverse mathematical modalities are limited . existing systems are limited in interpreting complex mathematical tasks and implementing them in a multimodal manner. |
| Approach: | They propose a multimodal mathematical reasoning system that utilizes a fine-tuned T5 model augmented with a variational autoencoder (VAE)-based image tokenizer. |
| Outcome: | The proposed model achieves state-of-the-art performance on SVAMP, GeoQA, and TableMWP datasets and is generalized on two additional datasets. |
An Empirical Study of Sentiment-Enhanced Pre-Training for Aspect-Based Sentiment Analysis (2023.findings-acl)
Copied to clipboard
| Challenge: | Existing approaches to Aspect-Based Sentiment Analysis (ABSA) are lacking in a comprehensive evaluation and fair comparison. |
| Approach: | They propose to use a knowledge-mining method to build a large-scale knowledge-annotated SPT corpus and integrate sentiment knowledge into pre-training. |
| Outcome: | The proposed method is able to build a large-scale knowledge-annotated SPT corpus and compares with other methods. |
Intention Analysis Makes LLMs A Good Jailbreak Defender (2025.coling-main)
Copied to clipboard
| Challenge: | Existing methods to align large language models with human values overlook the intrinsic nature of jailbreaks, which limits their effectiveness in complex scenarios. |
| Approach: | They propose a simple yet highly effective defense strategy, i.e., Intention Analysis (IA). They show that IA suppresses LLM’s tendency to follow jailbreak prompts, thereby enhancing safety. |
| Outcome: | The proposed strategy reduces harmfulness of LLMs and outperforms GPT-3.5 in attack success rate. |
AgentInit: Initializing LLM-based Multi-Agent Systems via Diversity and Expertise Orchestration for Effective and Efficient Collaboration (2025.findings-emnlp)
Copied to clipboard
| Challenge: | Existing MAS initialization methods do not fully account for the collaborative needs of the generated agents in subsequent stages. |
| Approach: | They propose to use a Natural Language to Format mechanism to optimize the structure of agent teams and incorporate a natural language to format mechanism to ensure consistency and standardization. |
| Outcome: | The proposed method outperforms state-of-the-art initialization methods and pre-defined strategies across various frameworks and tasks while reducing token consumption. |
Selected Languages are All You Need for Cross-lingual Truthfulness Transfer (2025.coling-main)
Copied to clipboard
| Challenge: | Existing methods for truthfulness enhancement in English are limited to multilingual scenarios. |
| Approach: | They propose a method for cross-lingual truthfulness transfer that uses language bias and transfer contributions to select an optimal subset of all tested languages and employ translation instruction tuning for cross language truthfulness transfers. |
| Outcome: | The proposed method reduces multilingual representation disparity and boosts cross-lingual truthfulness transfer of LLMs. |
DB-LLM: Accurate Dual-Binarization for Efficient LLMs (2024.findings-acl)
Copied to clipboard
Hong Chen, Chengtao Lv, Liang Ding, Haotong Qin, Xiabin Zhou, Yifu Ding, Xuebo Liu, Min Zhang, Jinyang Guo, Xianglong Liu, Dacheng Tao
| Challenge: | Existing methods for ultra-low bit quantization cause severe accuracy drops . a novel Dual-Binarization method is proposed for efficient Large Language Models . |
| Approach: | They propose a Dual-Binarization method that takes 2-bit-width and binarization into account . they propose DB-LLM, which uses a 2-bit binarized weighted model to represent weights efficiently . |
| Outcome: | The proposed method surpasses the current State-of-the-Art in ultra-low bit quantization and achieves 20% reduction in computational consumption compared to the SOTA method under the same bit-width. |
MathMixup: Boosting LLM Mathematical Reasoning with Difficulty-Controllable Data Synthesis and Curriculum Learning (2026.findings-acl)
Copied to clipboard
| Challenge: | Existing data synthesis methods suffer from limited diversity and lack precise control over problem difficulty, making them insufficient for efficient training paradigms such as curriculum learning. |
| Approach: | They propose a data synthesis paradigm that generates high-quality, difficulty-controllable mathematical reasoning problems through hybrid and decomposed strategies. |
| Outcome: | The proposed paradigm outperforms existing methods and improves mathematical reasoning abilities. |
LLMs Can Achieve High-quality Simultaneous Machine Translation as Efficiently as Offline (2025.findings-acl)
Copied to clipboard
| Challenge: | Large language models perform well in offline machine translation when the complete source sentence is provided . however, in many real scenarios, the source tokens arrive in a streaming manner and simultaneous machine translation is required . |
| Approach: | They propose a new paradigm that includes constructing supervised fine-tuning data for simultaneous machine translation (SiMT) to achieve SiMT, source and target tokens are rearranged into interleaved sequences, separated by special tokens according to varying latency requirements. |
| Outcome: | The proposed approach achieves state-of-the-art performance across various SiMT benchmarks and evaluation metrics while maintaining efficient auto-regressive decoding. |
RealChart2Code: Bridging the Gap in Real-World Chart-to-Code Generation via Multi-Task Evaluation (2026.acl-long)
Copied to clipboard
Jiajun Zhang, Yuying Li, Zhixun Li, Xingyu Guo, Jingzhuo Wu, Leqi Zheng, Yiran Yang, Jianke Zhang, Qingbin Li, Shannan Yan, Changguo Jia, Junfei Wu, Zilei Wang, Qiang Liu, Liang Wang
| Challenge: | Vision-Language Models (VLMs) have demonstrated impressive capabilities in code generation across various domains, but their ability to replicate complex, multi-panel visualizations remains largely unassessed. |
| Approach: | They propose a large-scale benchmark to evaluate chart generation from large- scale raw data and assess iterative code refinement in a multi-turn conversational setting. |
| Outcome: | The new benchmark evaluates 14 leading VLMs on real-world data and shows they struggle with complex plot structures and authentic data. |
Hidden States as Early Signals: Step-level Trace Evaluation and Pruning for Efficient Test-Time Scaling (2026.findings-acl)
Copied to clipboard
| Challenge: | Existing approaches to speed up parallel scaling have relied on similarity-based or confidence-based pruning, but these signals do not reliably indicate trace quality. |
| Approach: | They propose a pruning framework that evaluates reasoning steps using hidden states and dynamically prunes unpromising traces during generation. |
| Outcome: | The proposed framework reduces end-to-end inference latency by 45%–70% on average compared to self-consistency while improving reasoning accuracy. |
Reconstruct Before Summarize: An Efficient Two-Step Framework for Condensing and Summarizing Meeting Transcripts (2023.emnlp-main)
Copied to clipboard
| Challenge: | Existing approaches to meeting summarization are limited due to noise, lengthy transcripts, and scattered salient information. |
| Approach: | They propose a two-step framework for meeting summarization that leverages a self-supervised paradigm to reconstruct transcripts and a relative positional bucketing algorithm to equip models to generate the summary. |
| Outcome: | The proposed method significantly reduces memory consumption and processing time on two meeting summarization datasets. |
PBoS: Probabilistic Bag-of-Subwords for Generalizing Word Embedding (2020.findings-emnlp)
Copied to clipboard
| Challenge: | Existing word embeddings assume fixed finite-size vocabularies, hindering their ability to provide useful word representations for out-of-vocaulary words. |
| Approach: | They propose a model that generalizes word embeddings without extra contextual information . they use the spellings of words to model subword segmentation and compute subword-based compositional word embeds. |
| Outcome: | The proposed model can generate meaningful subword segmentations without any source of explicit morphological knowledge. |
UniSonate: A Unified Model for Speech, Music, and Sound Effect Generation with Text Instructions (2026.acl-long)
Copied to clipboard
Chunyu Qiang, Xiaopeng Wang, Kang Yin, Yuzhe Liang, Yuxin Guo, Teng Ma, Ziyu Zhang, Tianrui Wang, Cheng Gong, Yushen Chen, Ruibo Fu, Longbiao Wang, Jianwu Dang
| Challenge: | Generative audio modeling has been fragmented into specialized tasks such as text-to-speech (TTS), text- to-music (TTM), and text-ta (TTA) specialized models require reference audio for timbre cloning and strict phoneme alignment, whereas TTA models generate unstructured textures from open-ended captions. |
| Approach: | They propose a unified flow-matching framework capable of synthesizing speech, music, sound effects . they propose 'token injection mechanism' that projects unstructured environmental sounds into structured temporal latent space . |
| Outcome: | The proposed framework achieves state-of-the-art performance in instruction-based TTS and TTM while maintaining competitive fidelity in TTA. |
Collaboration of Fusion and Independence: Hypercomplex-driven Robust Multi-Modal Knowledge Graph Completion (2026.acl-long)
Copied to clipboard
| Challenge: | Existing multi-modal knowledge graphs lack modality-specific information and are limited in their ability to capture nuanced semantic interplay between modalities. |
| Approach: | They propose a multi-modal knowledge graph completion method which integrates both paradigms . they use a fine-grained Entity Representation Factorization module and a Robust Relation-aware Modality Fusion module to obtain robust representations for three independent modalities and one fused modality. |
| Outcome: | The proposed method achieves coexistence and collaboration of fused and independent modality representations while maintaining modality-specific information. |
MinerU2.5: A Decoupled Vision-Language Model for Efficient High-Resolution Document Parsing (2026.acl-industry)
Copied to clipboard
Junbo Niu, Zheng Liu, Zhuangcheng Gu, Bin Wang, Linke Ouyang, Zhiyuan Zhao, Tao Chu, Tianyao He, Fan Wu, Qintong Zhang, Zhenjiang Jin, Guang Liang, Rui Zhang, Wenzheng Zhang, Yuan Qu, Zhifei Ren, Yuefeng Sun, Zirui Tang, Boyu Niu, Yuanhong Zheng, Dongsheng Ma, Ziyang Miao, Hejun Dong, Siyi Qian, Junyuan Zhang, Fangdong Wang, Jingzhou Chen, Xiaomeng Zhao, Liqun Wei, Wei Li, Shasha Wang, RuiLiang Xu, Yuanyuan Cao, Lu Chen, Qianqian Wu, Huaiyu Gu, Lindong Lu, Dechen Lin, null Shenguanlin, Xuanhe Zhou, Linfeng Zhang, Yuhang Zang, Xiaoyi Dong, Jiaqi Wang, Bo Zhang, Lei Bai, Pei Chu, Weijia Li, Jiang Wu, Lijun Wu, Zhenxiang Li, Guangyu Wang, Zhongying Tu, Chao Xu, Kai Chen, Bowen Zhou, Dahua Lin, Wentao Zhang, Conghui He
| Challenge: | Document images are characterized by higher resolutions, denser content, and more complex structural layouts. |
| Approach: | They propose a 1.2B-parameter document parsing vision-language model that decouples layout analysis from local content recognition. |
| Outcome: | The proposed model surpasses general-purpose and domain-specific models on multiple benchmarks while maintaining significantly lower computational overhead. |
Hyperspherical Multi-Prototype with Optimal Transport for Event Argument Extraction (2024.acl-long)
Copied to clipboard
| Challenge: | Event Argument Extraction (EAE) aims to extract arguments for specified events from a text . previous work focused on long-distance dependencies of arguments, modeling co-occurrence relationships . |
| Approach: | They propose a model that takes inductive biases as targets to locate prototypes . they set multiple prototypes to represent each role to capture intra-class differences . |
| Outcome: | The proposed model achieves state-of-the-art on the RAMS and WikiEvents datasets. |
SCOP: Evaluating the Comprehension Process of Large Language Models from a Cognitive View (2025.acl-long)
Copied to clipboard
| Challenge: | despite the potential of large language models, it is difficult to fully count on them in real-world scenarios. |
| Approach: | They propose to examine how LLMs perform during the comprehension process from a cognitive perspective. |
| Outcome: | The proposed model analyzes how LLMs perform during the comprehension process from a cognitive perspective. |
A Multi-persona Framework for Argument Quality Assessment (2025.acl-long)
Copied to clipboard
| Challenge: | Existing methods for argument quality assessment do not consider multi-perspective evaluation due to subjective nature of arguments. |
| Approach: | They propose a multi-persona framework for argument quality assessment that simulates diverse evaluator perspectives through large language models. |
| Outcome: | The proposed framework outperforms baselines while providing comprehensive multi-perspective rationales on IBM-Rank-30k and IBM-ArgQ-5.3kArgs datasets. |
ChemReason-Bench: Benchmarking Large Language Models for Procedural Reasoning in Experimental Chemistry (2026.acl-long)
Copied to clipboard
| Challenge: | Experimental protocols in organic synthesis specify not only the intended transformation, but also an executable sequence of operations and conditions. |
| Approach: | They propose a human-validated benchmark for verifiable experimental procedure reasoning . they instantiate 7306 benchmark tasks across six complementary formats . |
| Outcome: | The proposed benchmarks show that the evaluations are less diagnostic of procedure-level decision making. |
MlingConf: A Comprehensive Study of Multilingual Confidence Estimation on Large Language Models (2025.findings-acl)
Copied to clipboard
Boyang Xue, Hongru Wang, Rui Wang, Sheng Wang, Zezhong Wang, Yiming Du, Bin Liang, Wenxuan Zhang, Kam-Fai Wong
| Challenge: | Existing studies on LLM confidence estimations in languages other than English have been limited to English. |
| Approach: | They propose to use question-related language to prompt LLMs to assess their confidence in large language models. |
| Outcome: | The proposed model improves on question-related language prompts for LS tasks, while English exhibits notable linguistic dominance in confidence estimations. |
Towards Better Document-level Relation Extraction via Iterative Inference (2022.emnlp-main)
Copied to clipboard
| Challenge: | Existing methods only consider feature information of entity pairs, but our model exploits both feature information and previous predictions of entity pair. |
| Approach: | They propose a document-level relation extraction model with iterative inference to extract relations between entities from raw texts. |
| Outcome: | The proposed model outperforms existing methods on three commonly-used datasets. |
Robust Tool Use via Fission-GRPO: Learning to Recover from Execution Errors (2026.acl-long)
Copied to clipboard
Zhiwei Zhang, Fei Zhao, Rui Wang, Zezhong Wang, Bin Liang, Jiakang Wang, Yao Hu, Shaosheng Cao, Kam-Fai Wong
| Challenge: | Large language models (LLMs) can call tools effectively, but they remain brittle in multi-turn execution. |
| Approach: | They propose a framework that converts execution errors into on-policy corrective supervision within the RL training loop. |
| Outcome: | The proposed framework improves the error recovery rate of Qwen3-8B by 5.7% absolute and overall accuracy by 4.0% on BFCL v4 Multi-Turn. |
SINCon: Mitigate LLM-Generated Malicious Message Injection Attack for Rumor Detection (2025.acl-long)
Copied to clipboard
| Challenge: | Existing methods define important nodes as important and target them for attacks if the model treats nodes’ predictive influence more uniformly . Existing approaches target high predictive influence nodes but are vulnerable to malicious message injection attacks. |
| Approach: | They propose a defense mechanism that encourages the model to learn graph representations where nodes with varying importance have a more uniform influence on predictions. |
| Outcome: | Extensive experiments on the Twitter and Weibo datasets show that similarizing the predictive Influence of nodes with Contrastive Learning significantly enhances resistance against LLM-driven message injection attacks. |
Dynamic Feature Fusion for Sign Language Translation Using HyperNetworks (2025.findings-naacl)
Copied to clipboard
| Challenge: | Using RGB and keypoint streams, sign language translation is highly dependent on the brain's ability to process color, shape, and motion simultaneously. |
| Approach: | They propose a hypernetwork-based fusion method that extracts salient features from RGB and keypoint streams and introduces self-distillation and SST contrastive learning to maintain feature advantages while aligning the global semantic space. |
| Outcome: | The proposed method achieves state-of-the-art performance on two public sign language datasets, reducing model parameters by about two-thirds. |
A Multi-Format Transfer Learning Model for Event Argument Extraction via Variational Information Bottleneck (2022.coling-1)
Copied to clipboard
| Challenge: | Event argument extraction (EAE) aims to extract arguments with given roles from texts. |
| Approach: | They propose a multi-format transfer learning model with variational information bottleneck to learn from existing datasets. |
| Outcome: | The proposed model improves on three benchmark datasets and obtains state-of-the-art performance on EAE. |
mPLUG-DocOwl 1.5: Unified Structure Learning for OCR-free Document Understanding (2024.findings-emnlp)
Copied to clipboard
Anwen Hu, Haiyang Xu, Jiabo Ye, Ming Yan, Liang Zhang, Bo Zhang, Ji Zhang, Qin Jin, Fei Huang, Jingren Zhou
| Challenge: | Existing Multimodal Large Language Models lack general structure understanding abilities for text-rich document images. |
| Approach: | They propose to use unified structure learning to boost the performance of MLLMs by encoding structure information into text-rich images. |
| Outcome: | The proposed model achieves state-of-the-art on 10 visual document understanding benchmarks. |
Personalized Text Generation with Contrastive Activation Steering (2025.acl-long)
Copied to clipboard
| Challenge: | Existing approaches to personalized text generation rely on retrieval-augmented generation and parameter-efficient fine-tuning. |
| Approach: | They propose a training-free framework that disentangles and represents personalized writing style as a vector in LLM’s activation-space. |
| Outcome: | The proposed framework achieves 8% relative improvement in personalized generation while reducing storage requirements by 1700 over PEFT method. |
mPLUG-DocOwl2: High-resolution Compressing for OCR-free Multi-page Document Understanding (2025.acl-long)
Copied to clipboard
| Challenge: | Multimodal Large Language Models (MLLMs) have improved document understanding performance but generate thousands of visual tokens for a single document image, leading to excessive GPU memory and slower inference times. |
| Approach: | They propose a high-resolution document compression module to generate 324 tokens for a single document image. |
| Outcome: | The proposed module reduces first token latency by more than 50% and improves document comprehension performance. |
Fact-Tree Reasoning for N-ary Question Answering over Knowledge Graphs (2022.findings-acl)
Copied to clipboard
| Challenge: | Current Question Answering over Knowledge Graphs (KGQA) tasks focus on binary facts, but neglect n-ary facts. |
| Approach: | They propose a new fact-tree reasoning framework that transforms the question into a fact tree and performs iterative fact reasoning on the fact tree to infer the correct answer. |
| Outcome: | The proposed framework performs iterative fact reasoning on the fact tree to infer the correct answer. |
Revisiting Token Dropping Strategy in Efficient BERT Pretraining (2023.acl-long)
Copied to clipboard
| Challenge: | Token dropping is a recently-proposed strategy to speed up the pretraining of masked language models, such as BERT. |
| Approach: | They propose a semantic-consistent learning method to improve token dropping by skipping the computation of a subset of input tokens at several middle layers. |
| Outcome: | The proposed method achieves consistent and significant performance gains across all tasks and model sizes. |
PFDial: A Structured Dialogue Instruction Fine-tuning Method Based on UML Flowcharts (2025.findings-acl)
Copied to clipboard
Ming Zhang, Yuhui Wang, Yujiong Shen, Tingyi Yang, Changhao Jiang, Yilong Wu, Shihan Dou, Qinhao Chen, Zhiheng Xi, Zhihao Zhang, Yi Dong, Zhen Wang, Zhihui Fei, Mingyang Wan, Tao Liang, Guojun Ma, Qi Zhang, Tao Gui, Xuanjing Huang
| Challenge: | Large Language Models (LLMs) have shown remarkable progress in dialogue and reasoning, but they struggle to solve strictly constrained dialogue tasks. |
| Approach: | They construct a dataset that contains 12,705 high-quality Chinese dialogue instructions from 440 flowcharts containing 5,055 process nodes. |
| Outcome: | The proposed model outperforms GPT-4o models on backward transitions and outperformed GPT-42 models on the same dataset. |
Flooding-X: Improving BERT’s Resistance to Adversarial Attacks via Loss-Restricted Fine-Tuning (2022.acl-long)
Copied to clipboard
Qin Liu, Rui Zheng, Bao Rong, Jingyi Liu, ZhiHua Liu, Zhanzhan Cheng, Liang Qiao, Tao Gui, Qi Zhang, Xuanjing Huang
| Challenge: | Existing approaches to generating adversarial perturbations scale up the cost of training computational complexity by the number of gradient steps it takes to obtain the adversarials. |
| Approach: | They propose a flood method which aims at better generalization and a criterion to bring hyper-parameter-dependent flooding into effect with a narrowed-down search space by measuring how the gradient steps taken within one epoch affect the loss of each batch. |
| Outcome: | The proposed method improves BERT’s resistance to textual adversarial attacks by a large margin and achieves state-of-the-art robust accuracy on various text classification and GLUE tasks. |
SceMQA: A Scientific College Entrance Level Multimodal Question Answering Benchmark (2024.acl-short)
Copied to clipboard
Zhenwen Liang, Kehan Guo, Gang Liu, Taicheng Guo, Yujun Zhou, Tianyu Yang, Jiajun Jiao, Renjie Pi, Jipeng Zhang, Xiangliang Zhang
| Challenge: | SceMQA focuses on core science subjects including Mathematics, Physics, Chemistry, and Biology. |
| Approach: | They propose to use SceMQA to evaluate multimodal question answering at college entrance level. |
| Outcome: | The proposed model provides specific knowledge points for each problem and detailed explanations for each answer. |
A Multi-Agent Framework with Automated Decision Rule Optimization for Cross-Domain Misinformation Detection (2025.emnlp-main)
Copied to clipboard
| Challenge: | Existing methods for misinformation detection are limited by domain knowledge and expert experience. |
| Approach: | They propose a Multi-Agent Framework for cross-domain misinformation detection with Automated Decision Rule Optimization (MARO) they first employ multiple expert agents to analyze target-domain news, then introduce a question-reflection mechanism that guides expert agents for higher-quality analysis. |
| Outcome: | The proposed framework improves on a common dataset and shows that iteratively improves over existing methods. |
From Domains to Instances: Dual-Granularity Data Synthesis for LLM Unlearning (2026.findings-acl)
Copied to clipboard
Xiaoyu Xu, Minxin Du, Zitong LI, Zi Liang, Zhibiao Guo, Zhang Shiyu, Peizhao Hu, Qingqing Ye, Haibo Hu
| Challenge: | Currently, the evaluation of unlearning is limited due to the lack of granularity in the model. |
| Approach: | They propose a framework for synthesizing high-quality forget sets that exploits the target model per se to elicit data that matches its internal knowledge distribution through seed-guided and adversarial prompting. |
| Outcome: | The proposed framework achieves a superior balance of relevance, diversity, and efficiency across benchmarks. |
Reasoning-Augmented Conversation for Multi-Turn Jailbreak Attacks on Large Language Models (2025.findings-emnlp)
Copied to clipboard
Zonghao Ying, Deyue Zhang, Zonglei Jing, Yisong Xiao, Quanchen Zou, Aishan Liu, Siyuan Liang, Xiangzheng Zhang, Xianglong Liu, Dacheng Tao
| Challenge: | Existing methods for implementing multi-turn jailbreaks struggle to balance semantic coherence with attack effectiveness, resulting in benign semantic drift or ineffective detection evasion. |
| Approach: | They propose a framework that reformulates harmful queries into benign reasoning tasks and leverages LLMs’ strong reasoning capabilities to compromise safety alignment. |
| Outcome: | The proposed framework achieves state-of-the-art attack effectiveness in complex conversational scenarios, with average ASRs increasing by up to 96%. |
Concept2Box: Joint Geometric Embeddings for Learning Two-View Knowledge Graphs (2023.findings-acl)
Copied to clipboard
Zijie Huang, Daheng Wang, Binxuan Huang, Chenwei Zhang, Jingbo Shang, Yan Liang, Zhengyang Wang, Xian Li, Christos Faloutsos, Yizhou Sun, Wei Wang
| Challenge: | Existing methods to embed knowledge graphs have ignored the fact that they contain two fundamentally different views: high-level ontology-view concepts and fine-grained instance-view entities. |
| Approach: | They propose a novel geometric representation that jointly embeds the two views of a KG using dual geometric representations. |
| Outcome: | Experiments on the public DBpedia KG and a newly-created industrial KG show the proposed method works well. |
Self-Supervised Prompt Optimization (2025.findings-emnlp)
Copied to clipboard
Jinyu Xiang, Jiayi Zhang, Zhaoyang Yu, Xinbing Liang, Fengwei Teng, Jinhao Tu, Fashen Ren, Xiangru Tang, Sirui Hong, Chenglin Wu, Yuyu Luo
| Challenge: | Existing prompt optimization methods rely heavily on external references such as ground truth or by humans, limiting their applicability in real-world scenarios where such data is unavailable or costly to obtain. |
| Approach: | They propose a cost-efficient framework that discovers effective prompts for both closed and open-ended tasks without external reference. |
| Outcome: | The proposed framework outperforms state-of-the-art prompt optimization methods with significantly lower costs and fewer samples. |
A Multilingual Dataset and Empirical Validation for the Mutual Reinforcement Effect in Information Extraction (2026.findings-acl)
Copied to clipboard
Chengguang Gan, Sunbowen Lee, Qingyu Yin, Yunhao Liang, Xinyang He, Hanjun Wei, Younghun Lim, Shijian Wang, Hexiang Huang, QingHao Zhang, Shiwen Ni, Tatsunori Mori
| Challenge: | Existing work on the Mutual Reinforcement Effect in information extraction has not been empirically validated . 76 percent of the 21 sub-datasets exhibit the Mutual Reforcement effect across languages . |
| Approach: | They propose a multilingual MRE mix dataset that integrates 21 sub-datasets covering English, Japanese, and Chinese. |
| Outcome: | The proposed framework reduces manual annotation effort while preserving structural requirements of MRE tasks. |
Think Beyond Words: Exploring Context-Relevant Visual Commonsense for Diverse Dialogue Generation (2022.findings-emnlp)
Copied to clipboard
| Challenge: | Existing approaches to generate intelligent open-domain dialogue agents only consider auxiliary commonsense stored in pure text, ignoring grounding information from the external visual world. |
| Approach: | They propose a VIsual Commonsense enhanced dialogue generaTOR that exploits auxiliary commonsense from images related to context to generate coherent and informative responses. |
| Outcome: | The proposed method outperforms the latest competitive methods in terms of coherence and diversity on two public datasets. |
KELE: Residual Knowledge Erasure for Enhanced Multi-hop Reasoning in Knowledge Editing (2025.findings-emnlp)
Copied to clipboard
| Challenge: | Existing knowledge editing techniques show limitations when applied to multi-hop reasoning . residual single-hop knowledge causes edited models to revert to original answers . |
| Approach: | They propose a knowledge editing method that incorporates a Knowledge Erasure mechanism for Large language model Editing (KELE) they propose an erasure function for residual knowledge and an injection function for new knowledge . |
| Outcome: | The proposed method significantly improves multi-hop reasoning capability of edited models. |
Looking Beyond Text: Reducing Language Bias in Large Vision-Language Models via Multimodal Dual-Attention and Soft-Image Guidance (2025.emnlp-main)
Copied to clipboard
| Challenge: | Large vision-language models (LVLMs) have been criticized for their language bias. |
| Approach: | They propose to use a dual-attention mechanism to construct separate attention for visual and text inputs to enhance integration of visual inputs across models. |
| Outcome: | Experiments show that the proposed model debiases LVLMs from their language bias, enhancing visual comprehension and reducing hallucinations without additional resources. |
AgentDropout: Dynamic Agent Elimination for Token-Efficient and High-Performance LLM-Based Multi-Agent Collaboration (2025.acl-long)
Copied to clipboard
| Challenge: | Existing methods for MAS suffer from high token consumption and inefficiency due to frequent generation and communication among multiple agents. |
| Approach: | They propose a multi-agent system based on large language models that identifies redundant agents and communication across different communication rounds by optimizing the adjacency matrices of the communication graphs and eliminates them to enhance both token efficiency and task performance. |
| Outcome: | The proposed method reduces prompt token consumption and completion token consumption by 18.4% and improves task performance by 1.14. |
Retrieval Augmented Instruction Tuning for Open NER with Large Language Models (2025.coling-main)
Copied to clipboard
| Challenge: | Existing studies have focused on integrating large language models (LLMs) with information extraction (IE) however, the best approach to incorporate information with LLMs for IE remains an open question. |
| Approach: | They propose to use a Chinese IT dataset to perform RA-IT for IE . they use semantically similar examples from the training dataset as the context . |
| Outcome: | The proposed approach is evaluated in English and Chinese scenarios. |
MemeReaCon: Probing Contextual Meme Understanding in Large Vision-Language Models (2025.emnlp-main)
Copied to clipboard
Zhengyi Zhao, Shubo Zhang, Yuxi Zhang, Yanxi Zhao, Yifan Zhang, Zezhong Wang, Huimin Wang, Yutian Zhao, Bin Liang, Yefeng Zheng, Binyang Li, Kam-Fai Wong, Xian Wu
| Challenge: | Current approaches focus on isolated meme analysis, either for harmful content detection or standalone interpretation, overlooking a fundamental challenge: the same meme can express different intents depending on its conversational context. |
| Approach: | They propose a benchmark to evaluate how large vision language models understand memes in their original context. |
| Outcome: | The proposed benchmark evaluates how large vision language models understand meme intent in their original context. |
AgentSense: Benchmarking Social Intelligence of Language Agents through Interactive Scenarios (2025.naacl-long)
Copied to clipboard
Xinyi Mou, Jingcong Liang, Jiayu Lin, Xinnong Zhang, Xiawei Liu, Shiyue Yang, Rong Ye, Lei Chen, Haoyu Kuang, Xuanjing Huang, Zhongyu Wei
| Challenge: | Large language models are increasingly employed to empower autonomous agents to simulate human behavior. |
| Approach: | They propose to evaluate LLM-driven agents through multi-turn interactions using a bottom-up approach to create diverse social scenarios constructed from extensive scripts. |
| Outcome: | The proposed model evaluates LLM-driven agents through multi-turn interactions emphasizing goal completion and implicit reasoning. |
MCS: An In-battle Commentary System for MOBA Games (2022.coling-1)
Copied to clipboard
Xiaofeng Qi, Chao Li, Zhongping Liang, Jigang Liu, Cheng Zhang, Yuanxin Wei, Lin Yuan, Guang Yang, Lanxiao Huang, Min Li
| Challenge: | In-battle commentary is an important component of live streaming of e-sports competitions and is applicable to a wide range of scenarios like combat information analysis and live streaming. |
| Approach: | They propose a generative system for in-battle real-time commentary in mobile MOBA games and propose 'transform' method to convert match statistics and utterances into consistent encoding space. |
| Outcome: | The proposed system is based on real-time match statistics and events and can be used for live streaming, e-sports commentary and combat information analysis. |
Domain Transfer based Data Augmentation for Neural Query Translation (2020.coling-main)
Copied to clipboard
| Challenge: | Query translation (QT) is a critical factor in successful cross-lingual information retrieval (CLIR). |
| Approach: | They propose to extend query translation (QT) with a domain transfer procedure to revise synthetic candidates to search-aware examples. |
| Outcome: | The proposed method outperforms baselines and domain transfer methods on translation quality and retrieval accuracy. |
Quantifying and Improving the Robustness of Retrieval-Augmented Language Models Against Spurious Features in Grounding Data (2026.acl-long)
Copied to clipboard
Shiping Yang, Jie Wu, Wenbiao Ding, Ning Wu, Shining Liang, Ming Gong, Hongzhi Li, Hengyuan Zhang, Angel X. Chang, Dongmei Zhang
| Challenge: | Existing studies on robustness to explicit noise (e.g., document semantics) but overlook implicit noise (spurious features). |
| Approach: | They propose a framework to quantify the robustness of RAGs against spurious features by integrating a data synthesis pipeline and a taxonomy. |
| Outcome: | The proposed framework quantifies the robustness of RALMs against spurious features. |
LayoutDIT: Layout-Aware End-to-End Document Image Translation with Multi-Step Conductive Decoder (2023.findings-emnlp)
Copied to clipboard
| Challenge: | Existing methods struggle to capture the visual layout in complex document images. |
| Approach: | They propose to integrate layout knowledge into document image translation by using a layout-aware encoder and a multi-step conductive decoder to achieve the translation step by step. |
| Outcome: | The proposed model outperforms state-of-the-art methods with better parameter efficiency. |
Circuit Complexity Bounds for RoPE-based Transformer Architecture (2025.emnlp-main)
Copied to clipboard
| Challenge: | Recent studies provide the circuit complexity bounds to Transformer-like architectures. position embedding has emerged as a crucial technique in modern large language models. |
| Approach: | They propose to use position embedding to improve Transformer-like architectures by analyzing their circuits and analyzing the results. |
| Outcome: | The proposed model is able to solve canonical tasks without embedding positional information. |
Towards Better Graph-based Cross-document Relation Extraction via Non-bridge Entity Enhancement and Prediction Debiasing (2024.findings-acl)
Copied to clipboard
| Challenge: | Existing studies on relation extraction ignore non-bridge entities, leading to bias during inference. |
| Approach: | They propose a graph-based cross-document Relation Extraction model with non-bridge entity enhancement and prediction debiasing that integrates non-cross entities with target entities and bridge entities. |
| Outcome: | The proposed model outperforms baseline models on open and closed datasets. |
Relation Discovery with Out-of-Relation Knowledge Base as Supervision (N19-1)
Copied to clipboard
| Challenge: | Existing methods to extract relations from text corpus without annotated data are violated by up to 31%. |
| Approach: | They propose to use out-of-relation knowledge bases to supervise the discovery of unseen relations where relations to discover from the text corpus and those in knowledge bases are not overlapped. |
| Outcome: | The proposed method improves the state-of-the-art relation discovery performance by a large margin. |
Know the Known and the Unknown: Reasonable Answer Generation with Knowledge-Informed Citations (2026.acl-long)
Copied to clipboard
Yichi Zhang, Zhuo Chen, Lingbing Guo, Jun Xu, Mengshu Sun, Zhizhen Liu, Lei Liang, Wen Zhang, Huajun Chen
| Challenge: | Existing approaches focus on generating multi-level citations linked to specific references, making it verifiable and trustworthy. |
| Approach: | They propose a new data construction pipeline and a benchmark to improve citation granularity and awareness of unknown information. |
| Outcome: | The proposed model improves on the existing benchmark and data construction pipeline and provides citation granularity and awareness of unknown information. |
DUAL RM: Beyond Rule-based Preference Reward Modeling via Meta-Reward (2026.acl-long)
Copied to clipboard
Xiaobo Liang, Wanfu Wang, Qipeng Huang, Yuyang Ding, Zecheng Tang, Yixin Ji, Qianben Chen, Zhe Zhao, Kehai Chen, Juntao Li, Min Zhang
| Challenge: | Existing preference-based reward modeling methods face a recursive dependency where each verifier requires a meta-verifier, leading to continuous and costly dependence on human annotation. |
| Approach: | They propose a dual RM that couples discriminative and generative reward models under a non-parametric meta-reward. |
| Outcome: | The proposed model achieves strong performance across major preference benchmarks and even when trained exclusively on language modality, it exhibits robust cross-modal transfer on Omni-RewardBench. |
Unleashing LLM Reasoning Capability via Scalable Question Synthesis from Scratch (2025.acl-long)
Copied to clipboard
| Challenge: | Existing methods to improve the mathematical reasoning capabilities of Large Language Models (LLMs) are limited due to the proprietary nature of the data. |
| Approach: | They propose a data synthesis method that generates large-scale mathematical reasoning datasets using lightweight 7B-scale models. |
| Outcome: | The proposed method outperforms existing open-source datasets in both in-domain and out-of-domain evaluations and shows improvements in code reasoning tasks. |
BUMP: A Benchmark of Unfaithful Minimal Pairs for Meta-Evaluation of Faithfulness Metrics (2023.acl-long)
Copied to clipboard
Liang Ma, Shuyang Cao, Robert L Logan IV, Di Lu, Shihao Ran, Ke Zhang, Joel Tetreault, Alejandro Jaimes
| Challenge: | Existing benchmarks measure the correlation with human judgements of faithfulness on model-generated summaries, but they are insufficient for diagnosing whether metrics are consistent, effective on human-written texts, and sensitive to different error types. |
| Approach: | They propose to use unfaithful minimal pairs to measure the consistency of automatic faithfulness metrics by comparing human-written summary pairs with a dataset of 889 human-writing, minimally different summary pairs. |
| Outcome: | The proposed benchmarks show that the most discriminative metrics tend not to be the most consistent, and that the best performing metrics are sensitive to errors. |
Light-R1: Curriculum SFT, DPO and RL for Long COT from Scratch and Beyond (2025.acl-industry)
Copied to clipboard
Liang Wen, Yunke Cai, Fenrui Xiao, Xin He, Qi An, Zhenyu Duan, Yimin Du, Junchen Liu, Tanglifu Tanglifu, Xiaowei Lv, Haosheng Zou, Yongchao Deng, Shousheng Jia, Xiangzheng Zhang
| Challenge: | Experimental results show that opensource curriculum training is more effective when distinct datasets are available for different training stages. |
| Approach: | They propose an opensource suite for training long reasoning models using publicdata and models. |
| Outcome: | The proposed model outperforms DeepSeek-R1-DistillQwen-32B models in math reasoning. |
PPTC-R benchmark: Towards Evaluating the Robustness of Large Language Models for PowerPoint Task Completion (2024.findings-emnlp)
Copied to clipboard
| Challenge: | Large Language Models (LLMs) are increasingly used for task completion in real-world situations. |
| Approach: | They propose a PowerPoint Task Completion-Robustness (PPTC-R) benchmark to measure LLMs’ robustness to the user PPT task instruction and software version (Powerpoint). |
| Outcome: | The proposed benchmark compares 3 closed-source and 4 open-source LLMs to the PowerPoint task instruction and software version (Powerpoint) . |
Musical Score Understanding Benchmark: Evaluating Large Language Models’ Comprehension of Complete Musical Scores (2026.acl-long)
Copied to clipboard
Congren Dai, Yue Yang, Krinos Li, Huichi Zhou, Shijie Liang, Zhang Bo, Enyang Liu, Ge Jin, Hongran An, Haosen Zhang, Peiyuan Jing, KinHei Lee, Zhenxuan Zhang, Xiaobing Li, Maosong Sun
| Challenge: | Existing benchmarks for musical score understanding are narrow in scope, focusing on isolated fragments, short excerpts, or multiple-choice formulations, rather than supporting holistic reasoning over entire scores. |
| Approach: | They propose a benchmark for score-level musical understanding across textual and visual modalities. |
| Outcome: | The musical score understanding benchmark contains 1,800 question-answer pairs from works by Bach, Beethoven, Chopin, Debussy, and others. |
STACL: Simultaneous Translation with Implicit Anticipation and Controllable Latency using Prefix-to-Prefix Framework (P19-1)
Copied to clipboard
Mingbo Ma, Liang Huang, Hao Xiong, Renjie Zheng, Kaibo Liu, Baigong Zheng, Chuanqiang Zhang, Zhongjun He, Hairong Liu, Xing Li, Hua Wu, Haifeng Wang
| Challenge: | Simultaneous translation is notoriously dif- ficult due to word-order differences. |
| Approach: | They propose a prefix-to-prefix framework that implicitly learns to anticipate in a single translation model. |
| Outcome: | The proposed framework achieves low latency and reasonable qual- ity on 4 directions. |
MENTOR: Efficient Autoregressive Image Generation with Balanced Multimodal Control (2026.findings-acl)
Copied to clipboard
| Challenge: | Recent text-to-image models achieve impressive visual quality but still face challenges in precise controllability, balancing multimodal inputs, and high training cost for multimodal image generation. |
| Approach: | They propose an autoregressive framework with a two-stage training paradigm for controllable multimodal image generation. |
| Outcome: | Extensive experiments on DreamBench++ and DreamBech show that the proposed framework achieves a strong balance between textual and visual guidance for controllable image generation. |
Act-Adaptive Margin: Dynamically Calibrating Reward Models for Subjective Ambiguity (2026.acl-long)
Copied to clipboard
Feiteng Fang, Dingwei Chen, Xiang Huang, Ting-En Lin, Yuchuan Wu, Xiong Liu, Jing Ye, Ziqiang Liu, Haonan Zhang, Liang Zhu, Hamid Alinejad-Rokny, Min Yang, Yongbin Li
| Challenge: | Existing approaches to reward modeling in reinforcement learning tasks are limited when dealing with ambiguous preferences. |
| Approach: | They propose to use AAM to dynamically calibrate preference margins using the Bradley-Terry model's internal parameter knowledge to improve reward modeling in subjective tasks. |
| Outcome: | The proposed approach improves reward modeling by dynamically calibrating preference margins using the model’s internal parameter knowledge. |
MWP-BERT: Numeracy-Augmented Pre-training for Math Word Problem Solving (2022.findings-naacl)
Copied to clipboard
| Challenge: | Existing work on math word problem solvers replace real numbers with symbolic placeholders to focus on logic reasoning. |
| Approach: | They propose to inject numerical properties into symbolic placeholders with contextualized representation learning schema to solve number representation dilemma. |
| Outcome: | The proposed model can solve MWP problems on English and Chinese benchmarks. |
Mind Reader: Latent User Demand-Guided Content Optimization for Generative Search Engine (2026.acl-long)
Copied to clipboard
Tong Chen, JiaWei Guo, Yuxi Li, Baiming Chen, Houxing Ren, Zhang Zhiwei, Yunxiang Zhang, Hanyang Xia, Kun Liang, Zhaoran Fan
| Challenge: | Generative Search Engines (GSEs) have reshaped information retrieval and Generating Engine Optimization (GEO) emerges to improve the content visibility in GSEs’ responses. |
| Approach: | They propose a method to optimize content to cover latent semantic information of GSEs by decomposing query into diverse perspectives and capturing underlying semantic information. |
| Outcome: | The proposed method outperforms baselines and effectively improves content visibility (with up to 2.44x objective metrics and 1.23x subjective metrics on average). |
Token-Level Self-Evolution Training for Sequence-to-Sequence Learning (2023.acl-short)
Copied to clipboard
| Challenge: | Adaptive training approaches do not consider the variation of learning difficulty in different training steps, making the learning deterministic and sub-optimal. |
| Approach: | They propose a dynamic token-level self-evolution training method that reweighs the training losses of different target tokens based on priors. |
| Outcome: | Empirically, the proposed method yields significant improvements on three translation tasks. |
Multi-Level Cross-Modal Alignment for Speech Relation Extraction (2024.emnlp-main)
Copied to clipboard
Liang Zhang, Zhen Yang, Biao Fu, Ziyao Lu, Liangying Shao, Shiyu Liu, Fandong Meng, Jie Zhou, Xiaoli Wang, Jinsong Su
| Challenge: | Existing studies use synthetic speech to train and evaluate SpeechRE models, hindering their development . modality gap issue limits performance of existing models, limiting future researches . |
| Approach: | They propose to use speech data to train and evaluate SpeechRE models by using real speech . they propose to train a cross-modal alignment model to bridge the modality gap . |
| Outcome: | The proposed model can train to bridge the modality gap between speech encoder and text decoder . the proposed model is based on two real SpeechRE datasets . |
RSA-Bench: Benchmarking Audio Large Models in Real-World Acoustic Scenarios (2026.findings-acl)
Copied to clipboard
Yibo Zhang, Kaiwen Luo, Liang Lin, Shilinlu Yan, Jin Wang, Yaoqi Guo, Yitian Chen, Yalan Qin, Zhenhong Zhou, Kun Wang, Li Sun
| Challenge: | Existing evaluations rely on synthetic Gaussian noise or simplistic single-source interference, failing to capture the intricate, multi-layered acoustic dynamics that characterize authentic physical environments. |
| Approach: | They propose a robustness benchmark to stress-test Audio Large Models (ALLMs) using high-fidelity auditory scene simulations. |
| Outcome: | The proposed model performs well on a wide range of tasks, including automatic speech recognition, speech translation, and audio-based reasoning. |
CARL: Constraint-Aware Reinforcement Learning for Planning with LLMs (2026.findings-acl)
Copied to clipboard
Qiuyi Qi, Jinjian Zhang, Mutian Bao, Tian Liang, Guocong Li, Dongnan Liu, Wei Zhou, Jie Liu, Ming Kong, Linjian Mo, Feng Zhang, Qiang Zhu
| Challenge: | Existing approaches to constraint-aware planning fail to enhance the model’s intrinsic focus on constraints. |
| Approach: | They propose a constraint-aware reinforcement learning framework that encourages constraint focus and penalizes neglect of LLMs. |
| Outcome: | The proposed framework outperforms existing frameworks and state-of-the-art reasoning models in a number of real-world applications. |
Memp: Exploring Agent Procedural Memory (2026.findings-acl)
Copied to clipboard
Runnan Fang, Yuan Liang, Xiaobin Wang, Jialong Wu, Shuofei Qiao, Pengjun Xie, Fei Huang, Huajun Chen, Ningyu Zhang
| Challenge: | Large Language Models (LLMs) based agents suffer from brittle procedural memory that is manually engineered or entangled in static parameters. |
| Approach: | They propose a procedural-memory repository that distills past agent trajectories into fine-grained, step-by-step instructions and higher-level, script-like abstractions. |
| Outcome: | The proposed repository can be used to improve agents' performance on travelplanner and Alfworld. |
Asynchronous Deep Interaction Network for Natural Language Inference (D19-1)
Copied to clipboard
| Challenge: | Existing methods have framed the reasoning problem as a semantic matching task. |
| Approach: | They propose an asynchronous deep interaction network (ADIN) to deconstruct the reasoning process and implement asynchron and multi-step reasoning. |
| Outcome: | The proposed model outperforms strong baselines on three popular benchmarks: SNLI, MultiNLI, and SciTail. |
Less is More: Improving LLM Reasoning with Minimal Test-Time Intervention (2026.acl-long)
Copied to clipboard
| Challenge: | Recent advances in large language models (LLMs) have focused on test-time scaling to improve reasoning quality but at the cost of efficiency. |
| Approach: | They propose a training-free framework that enhances reasoning accuracy and stability with minimal overhead. |
| Outcome: | The proposed framework yields consistent gains across general, coding, and STEM tasks while remaining highly efficient. |
Uncertainty Aware Learning for Language Model Alignment (2024.acl-long)
Copied to clipboard
| Challenge: | Existing alignment strategies that focus on diverse and high-quality data often overlook the intrinsic uncertainty of tasks, learning all data samples equally. |
| Approach: | They propose to introduce the sample uncertainty into the alignment of different task scenarios by a simple fashion by setting the label smoothing value of training according to the uncertainty of individual samples. |
| Outcome: | The proposed model outperforms standard supervised fine-tuning on high-entropy tasks and complex low-entropic tasks. |
Visually-Guided Policy Optimization for Multimodal Reasoning (2026.acl-long)
Copied to clipboard
| Challenge: | Existing RLVRs lack visual faithfulness due to text-dominated reasoning . a novel framework to reinforce visual focus during policy optimization is proposed . |
| Approach: | They propose a framework to reinforce visual focus during policy optimization using visual attention compensation mechanism. |
| Outcome: | The proposed framework exhibits better visual activation and superior performance in multimodal reasoning and visual-dependent tasks. |
CogEvolve: A Multimodal Benchmark for Evaluating Relational Reasoning in Semantic Extension (2026.acl-long)
Copied to clipboard
| Challenge: | a gap exists between human embodied logic and machine statistical learning . authors: models internalize statistical patterns or mimic static recognition . |
| Approach: | They propose a cognitive linguistic benchmark to test whether large language models internalize statistical logic or not . they find that models function as "Super-Associators" expert at static recognition yet fail at causal reasoning . |
| Outcome: | The proposed model fails at causal reasoning and has a high-fidelity concept representation but lacks transformational operators essential for true relational understanding. |
Argument Pair Extraction with Mutual Guidance and Inter-sentence Relation Graph (2021.emnlp-main)
Copied to clipboard
| Challenge: | Existing studies on argumentation mining focus on monological argumentation and dialogical argumentation. |
| Approach: | They propose a mutual guidance framework that could guide arguments in one passage . they propose an inter-sentence relation graph to effectively model the inter-relations between two sentences . |
| Outcome: | The proposed method outperforms the current state-of-the-art model. |
Data-Efficient Selection via Grammatical Complexity in Continual Pre-training of Domain-Specific LLMs (2025.emnlp-main)
Copied to clipboard
Yizhou Ying, Geng Zhang, Cui Danxin, Chengyu Du, Guanglei Yue, Sihang Jiang, Jiaqing Liang, Yifei Fu, Hailin Hu, Yanghua Xiao
| Challenge: | Existing data selection strategies for continual pre-training of large language models often rely on scarce labeled data or computationally expensive LLMs. |
| Approach: | They propose an annotation-independent data selection framework for CPT that evaluates grammatical complexity using lexical diversity and syntactic complexity. |
| Outcome: | The proposed framework outperforms baselines on a financial dataset and surpasses full-data training by 1.7% using only 20% of the data. |
From Redundancy to Relevance: Information Flow in LVLMs Across Reasoning Tasks (2025.naacl-long)
Copied to clipboard
Xiaofeng Zhang, Yihao Quan, Chen Shen, Xiaosong Yuan, Shaotian Yan, Liang Xie, Wenxiao Wang, Chaochen Gu, Hao Tang, Jieping Ye
| Challenge: | Large visionlanguage models (LVLMs) are a powerful visual-language reasoning tool. |
| Approach: | They propose to integrate attention analysis with LLaVA-CAM to determine interactions between visual representations. |
| Outcome: | The proposed approach can be used to determine interactions between visual representations. |
CLUE: A Chinese Language Understanding Evaluation Benchmark (2020.coling-main)
Copied to clipboard
Liang Xu, Hai Hu, Xuanwei Zhang, Lu Li, Chenjie Cao, Yudong Li, Yechen Xu, Kai Sun, Dian Yu, Cong Yu, Yin Tian, Qianqian Dong, Weitang Liu, Bo Shi, Yiming Cui, Junyi Li, Jun Zeng, Rongzhao Wang, Weijian Xie, Yanting Li, Yina Patterson, Zuoyu Tian, Yiwen Zhang, He Zhou, Shaoweihua Liu, Zhe Zhao, Qipeng Zhao, Cong Yue, Xinrui Zhang, Zhengliang Yang, Kyle Richardson, Zhenzhong Lan
| Challenge: | Existing language evaluation benchmarks for English are limited to English . lack of such benchmarks makes it difficult to replicate success in other languages . |
| Approach: | They introduce a large-scale Chinese language understanding evaluation benchmark . the benchmark uses a set of current state-of-the-art pre-trained Chinese models . |
| Outcome: | The first large-scale Chinese Language Understanding Evaluation (CLUE) benchmark is released . the benchmark evaluates models across a wide range of tasks on original Chinese text . existing language evaluation benchmarks are mostly limited to English . |
PresentAgent: Multimodal Agent for Presentation Video Generation (2025.emnlp-demos)
Copied to clipboard
| Challenge: | Existing methods for generating static slides or text summaries are limited to producing narrated presentations. |
| Approach: | They propose a multimodal agent that transforms long-form documents into narrated presentations. |
| Outcome: | The present agent produces fully synchronized visual and spoken content that closely mimics human-style presentations. |
TRIGO: Benchmarking Formal Mathematical Proof Reduction for Generative Language Models (2023.emnlp-main)
Copied to clipboard
Jing Xiong, Jianhao Shen, Ye Yuan, Haiming Wang, Yichun Yin, Zhengying Liu, Lin Li, Zhijiang Guo, Qingxing Cao, Yinya Huang, Chuanyang Zheng, Xiaodan Liang, Ming Zhang, Qun Liu
| Challenge: | Automated theorem proving (ATP) benchmarks focus on symbolic inference but rarely involve understanding complex number combination reasoning. |
| Approach: | They propose a benchmark that requires a model to reduce a trigonometric expression with step-by-step proof and evaluates a generative LM’s reasoning ability on formulas and ability to manipulate, group, and factor number terms. |
| Outcome: | The proposed benchmark evaluates a generative LM’s reasoning ability on formulas and ability to manipulate, group, and factor number terms. |
RGAR: Recurrence Generation-augmented Retrieval for Factual-aware Medical Question Answering (2025.findings-emnlp)
Copied to clipboard
| Challenge: | Existing retrieval approaches often overlook patient-specific factual knowledge embedded in EHRs . existing retrieval frameworks often overlook this factual information, limiting its effectiveness in clinical decision-making. |
| Approach: | They propose a recurrence generation-augmented retrieval framework that synergizes factual and conceptual knowledge from dual sources. |
| Outcome: | The proposed framework improves on factual-aware medical QA benchmarks. |
Too Correct to Learn: Reinforcement Learning on Saturated Reasoning Data (2026.acl-short)
Copied to clipboard
| Challenge: | Strong base models saturate benchmarks, resulting in weaker performance, a paradox . a new approach to Reinforcement Learning (RL) is needed to improve performance . |
| Approach: | They propose a method that uses constrained uniform top-k sampling to flatten the local optimization landscape by sampling uniformly from constrained high-confidence candidates. |
| Outcome: | Experiments show that the proposed approach prevents policy degeneration and boosts out-of-domain generalization. |
Chain-of-History Reasoning for Temporal Knowledge Graph Forecasting (2024.findings-acl)
Copied to clipboard
| Challenge: | Existing graph-based models excel at capturing structural information within TKGs but lack semantic comprehension abilities. |
| Approach: | They propose a plug-and-play module to enhance the performance of graph-based TKG models by exploring high-order histories step-by-step. |
| Outcome: | Experiments on three datasets and backbones show that CoH is effective in capturing high-order historical information for LLMs. |
Second Language (Arabic) Acquisition of LLMs via Progressive Vocabulary Expansion (2025.acl-long)
Copied to clipboard
Jianqing Zhu, Huang Huang, Zhihang Lin, Juhao Liang, Zhengyang Tang, Khalid Almubarak, Mosen Alharthi, Bang An, Juncai He, Xiangbo Wu, Fei Yu, Junying Chen, Ma Zhuoheng, Yuhao Du, He Zhang, Saied Alshahrani, Emad A. Alghamdi, Lian Zhang, Ruoyu Sun, Haizhou Li, Benyou Wang, Jinchao Xu
| Challenge: | In the evolving landscape of large language models, the predominant focus has been on English and Chinese. |
| Approach: | They propose to utilize Arabic-specific vocabulary in the tokenizer to accelerate decoding. |
| Outcome: | The proposed model achieves decent performance comparable to the best Arabic LLMs across various Arabic benchmarks. |
CRAFTQA: A Code-Driven Adaptive Framework for Complex Structured Data Reasoning (2026.findings-acl)
Copied to clipboard
| Challenge: | Existing unified structured data question answering methods rely on a set of predefined functions, which restricts their ability to perform complex reasoning beyond these predefined operations. |
| Approach: | They propose a novel adaptive code-driven framework that generates code-based reasoning operations based on a question. |
| Outcome: | The proposed framework improves on multiple structured datasets on real-world scenarios. |
CM-Align: Consistency-based Multilingual Alignment for Large Language Models (2025.findings-emnlp)
Copied to clipboard
| Challenge: | Current large language models (LLMs) show a significant performance gap in alignment between English and other languages. |
| Approach: | They propose a consistency-based method to construct high-quality multilingual preference data for improving multilingual alignment. |
| Outcome: | The proposed method is based on three LLMs and three common tasks and shows that it performs better than current methods. |
VersaTune: An Efficient Data Composition Framework for Training Multi-Capability LLMs (2025.emnlp-main)
Copied to clipboard
| Challenge: | Existing work focuses on domain-specific enhancements during fine-tuning, the challenge of which lies in catastrophic forgetting of knowledge across other domains. |
| Approach: | They propose a data composition framework that allows LLMs to enhance their multi-domain capabilities during supervised fine-tuning. |
| Outcome: | The proposed framework improves multi-domain fostering performance by 29.77% compared to uniform weights. |
Strength Lies in Differences! Improving Strategy Planning for Non-collaborative Dialogues via Diversified User Simulation (2024.emnlp-main)
Copied to clipboard
| Challenge: | Non-collaborative dialogue agents are expected to engage in strategic conversations with diverse users, and this poses two main challenges for existing dialogue agents: 1) the inability to integrate user-specific characteristics into the strategic planning; 2) the difficulty of training strategic planners that can be generalized to diverse users. |
| Approach: | They propose to integrate a user-aware strategic planning module and a population-based training paradigm into a non-collaborative dialogue agent for securing a mutual agreement that leans favorably towards the system's objectives. |
| Outcome: | The proposed model can be used to achieve a mutual agreement that leans favorably towards the system's objectives. |
Logical Consistency is Vital: Neural-Symbolic Information Retrieval for Negative-Constraint Queries (2025.findings-acl)
Copied to clipboard
Ganlin Xu, Zhoujia Zhang, Wangyi Mei, Jiaqing Liang, Weijia Lu, Xiaodong Zhang, Zhifei Yang, Xiaofeng Ma, Yanghua Xiao, Deqing Yang
| Challenge: | Current dense retrieval methods compute similarities between dense vectors but overlook the real query intents. |
| Approach: | They propose a neuro-symbolic information retrieval method that leverages first-order logic to optimize the embeddings of naive natural language by considering the logical consistency between queries and documents. |
| Outcome: | The proposed method outperforms existing methods on negative-constraint queries under zero-shot and low-resource retrieval tasks. |
UReader: Universal OCR-free Visually-situated Language Understanding with Multimodal Large Language Model (2023.findings-emnlp)
Copied to clipboard
Jiabo Ye, Anwen Hu, Haiyang Xu, Qinghao Ye, Ming Yan, Guohai Xu, Chenliang Li, Junfeng Tian, Qi Qian, Ji Zhang, Qin Jin, Liang He, Xin Lin, Fei Huang
| Challenge: | Existing studies for visually-situated language understanding have shown shallow zero-shot visual text recognition ability when fed a low-resolution image with salient text information. |
| Approach: | They propose a model for universal OCR-free visually-situated language understanding based on the Multimodal Large Language Model (MLLM) their model is jointly finetuned on a wide range of visually situated language understanding tasks via a unified instruction format. |
| Outcome: | The proposed model achieves state-of-the-art ocr-free performance in 8 out of 10 visually-situated language understanding tasks across 5 domains: documents, tables, charts, natural images, and webpage screenshots. |
CQG: A Simple and Effective Controlled Generation Framework for Multi-hop Question Generation (2022.acl-long)
Copied to clipboard
| Challenge: | Current models can not ensure the complexity of generated questions, so they may generate shallow questions that can be answered without multi-hop reasoning. |
| Approach: | They propose a controlled framework to generate multi-hop questions that contain key entities in multi- hop reasoning chains and a novel Transformer-based decoder to guarantee that key entities appear in the questions. |
| Outcome: | The proposed model outperforms the state-of-the-art model 25% on HotpotQA. |
MixRED: A Mix-lingual Relation Extraction Dataset (2024.lrec-main)
Copied to clipboard
| Challenge: | Existing research focuses on monolingual relation extraction, but there is a significant gap in understanding relation extraction in the mix-lingual scenario. |
| Approach: | They propose a task of considering relation extraction in the mix-lingual scenario . they construct a human-annotated dataset to support the task . |
| Outcome: | The proposed task evaluates state-of-the-art supervised models and large language models on the human-annotated dataset MixRED. |
Empathy in Diversity: Personalized Depression and Anxiety Therapy via Dialogue State Tracking and Patient-Aware Planning (2026.acl-long)
Copied to clipboard
Xinwei Yang, Junyi Fan, Yuqing Liu, Jiaxuan Wang, Jiashuai Zhang, Hongru Liang, Wenqiang Lei, Yao Song
| Challenge: | Recent efforts have turned to large language models (LLMs) as therapeutic agents for psychological therapy tasks, yet robustness across diverse patients remains underexplored. |
| Approach: | They propose a realistic role-play protocol for evaluating therapeutic dialogue agents and a de-identified, expert-annotated corpus of therapist–patient dialogues. |
| Outcome: | The proposed framework outperforms baselines on therapeutic outcomes and dialogue quality while improving conversational efficiency. |
ReasVQA: Advancing VideoQA with Imperfect Reasoning Process (2025.naacl-long)
Copied to clipboard
| Challenge: | Existing approaches to VideoQA often fail when complex reasoning or temporal relationships are involved. |
| Approach: | They propose a method that leverages reasoning processes generated by Multimodal Large Language Models to improve VideoQA models. |
| Outcome: | The proposed method improves VideoQA models on three benchmarks. |
COPR: Continual Human Preference Learning via Optimal Policy Regularization (2025.findings-acl)
Copied to clipboard
Han Zhang, Lin Gui, Yu Lei, Yuanzhao Zhai, Yehong Zhang, Zhuo Zhang, Yulan He, Hui Wang, Yue Yu, Kam-Fai Wong, Bin Liang, Ruifeng Xu
| Challenge: | Reinforcement Learning from Human Feedback (RLHF) is effective for aligning Large Language Models with human preferences, but its complex process limits its ability to continually learn human feedback. |
| Approach: | They propose a non-RL offline method to convert historical optimal policies into optimization constraints when continually learning new preferences. |
| Outcome: | The proposed method outperforms strong CL baselines in terms of reward-based evaluations and human assessment. |
Editing Conceptual Knowledge for Large Language Models (2024.findings-emnlp)
Copied to clipboard
Xiaohan Wang, Shengyu Mao, Shumin Deng, Yunzhi Yao, Yue Shen, Lei Liang, Jinjie Gu, Huajun Chen, Ningyu Zhang
| Challenge: | Existing knowledge editing methods can modify concept-level definitions, but they can distort instantial knowledge in LLMs, leading to poor performance. |
| Approach: | They construct a benchmark dataset ConceptEdit and establish new metrics for evaluation to investigate the editing capability of LLMs. |
| Outcome: | The proposed methods can modify concept definitions but can distort instantial knowledge in LLMs, leading to poor performance. |
KnowVrDU: A Unified Knowledge-aware Prompt-Tuning Framework for Visually-rich Document Understanding (2024.lrec-main)
Copied to clipboard
Yunqi Zhang, Yubo Chen, Jingzhe Zhu, Jinyu Xu, Shuai Yang, Zhaoliang Wu, Liang Huang, Yongfeng Huang, Shuai Chen
| Challenge: | Existing methods for integrating layout and image features into pre-training language models are not suitable for few-shot settings. |
| Approach: | They propose to reformulate VrDU tasks into a single question-answering format with task-specific prompts and train the pre-trained model with the parameter-efficient prompt tuning method. |
| Outcome: | The proposed framework can be used in few-shot settings and reduces data requirements. |
SEE: Signal Embedding Energy for Quantifying Noise Interference in Large Audio Language Models (2026.acl-long)
Copied to clipboard
| Challenge: | Existing studies on noise lack quantitative analysis and rely on intuition and empirical observation, thus failing to understand practical robustness. |
| Approach: | They propose a method for quantifying the impact of noise intensity on LALM inputs by using a structured activation subspace derived from the model's internal representations. |
| Outcome: | The proposed method outperforms existing denoising methods and demonstrates that noise is perceived more accurately than raw audio features. |
Unsupervised Preference-Aware Language Identification (2022.findings-acl)
Copied to clipboard
| Challenge: | Existing studies do not consider inter-personal variations due to the lack of user annotated training data. |
| Approach: | They propose to use user preferences to identify ambiguous texts in multilingual applications without user annotated training data to build a preference-aware LID model. |
| Outcome: | The proposed model significantly outperforms existing LID systems on handling ambiguous texts. |
Hawkes based Representation Learning for Reasoning over Scale-free Community-structured Temporal Knowledge Graphs (2025.coling-main)
Copied to clipboard
| Challenge: | Temporal knowledge graph reasoning is a useful tool for many practical tasks. |
| Approach: | They propose a Hawkes process-based Evolutional Representation Learning Network model which learns structural information and evolutional patterns of a TKG simultaneously. |
| Outcome: | The proposed model learns structural information and evolutional patterns of a TKG simultaneously, considering the characteristics of real-world networks: community structure, scale-free and temporal decaying. |
CIF-Bench: A Chinese Instruction-Following Benchmark for Evaluating the Generalizability of Large Language Models (2024.findings-acl)
Copied to clipboard
Yizhi Li, Ge Zhang, Xingwei Qu, Jiali Li, Zhaoqun Li, Noah Wang, Hao Li, Ruibin Yuan, Yinghao Ma, Kai Zhang, Wangchunshu Zhou, Yiming Liang, Lei Zhang, Lei Ma, Jiajun Zhang, Zuowen Li, Wenhao Huang, Chenghua Lin, Jie Fu
| Challenge: | a recent study shows that large language models have limited generalization in low-resource languages like Chinese. |
| Approach: | They propose to evaluate the zero-shot generalizability of large language models to the Chinese language . they release only half of the dataset publicly, with the remainder kept private . |
| Outcome: | The Chinese Instruction-Following Benchmark evaluates the generalizability of LLMs to the Chinese language. |
Original Content Is All You Need! an Empirical Study on Leveraging Answer Summary for WikiHowQA Answer Selection Task (2022.coling-1)
Copied to clipboard
Liang Wen, Juan Li, Houfeng Wang, Yingwei Luo, Xiaolin Wang, Xiaodong Zhang, Zhicong Cheng, Dawei Yin
| Challenge: | Existing answer selection approaches for community question answering lack additional answer summaries due to redundancy and lengthiness issues of crowdsourced answers. |
| Approach: | They constructed a dataset which contains a corresponding reference summary for each original lengthy answer. |
| Outcome: | The proposed model improves the performance of a question and candidate answer on a WikiHowQA dataset. |
MoDULA: Mixture of Domain-Specific and Universal LoRA for Multi-Task Learning (2024.emnlp-main)
Copied to clipboard
Yufei Ma, Zihan Liang, Huangyu Dai, Ben Chen, Dehong Gao, Zhuoran Ran, Wang Zihan, Linbo Jin, Wen Jiang, Guannan Zhang, Xiaoyan Cai, Libin Yang
| Challenge: | Recent advances in open-source Large Language Models (LLMs) have achieved notable successes in natural language processing. |
| Approach: | They propose a Parameter Efficient Fine-Tuning paradigm for improved fine-tuning and parameter efficiency in multi-task learning. |
| Outcome: | The proposed model outperforms existing methods on multi-task learning while reducing training costs by over 80% without losing general capability. |
Selection Bias Explorations and Debias Methods for Natural Language Sentence Matching Datasets (P19-1)
Copied to clipboard
| Challenge: | Natural Language Sentence Matching (NLSM) is a popular NLP task. |
| Approach: | They propose to use QuoraQP to train and evaluate NLSM models using a selection bias framework. |
| Outcome: | The proposed framework can improve generalization ability of trained models and give more trustworthy evaluation results for real-world adoptions. |
Transferring from Formal Newswire Domain with Hypernet for Twitter POS Tagging (D18-1)
Copied to clipboard
| Challenge: | Existing POS tagging methods for Twitter use labeled newswire text . however, Twitter users tend to mimic formal media expressions and develop linguistically informal styles. |
| Approach: | They propose to use newswire text to learn POS tagging for Twitter while twitter users are developing linguistically informal styles. |
| Outcome: | The proposed method achieves better performance than state-of-the-art methods on three different datasets. |
iAgent: LLM Agent as a Shield between User and Recommender Systems (2025.findings-acl)
Copied to clipboard
Wujiang Xu, Yunxiao Shi, Zujie Liang, Xuying Ning, Kai Mei, Kun Wang, Xi Zhu, Min Xu, Yongfeng Zhang
| Challenge: | Traditional recommender systems focus on the user-platform paradigm, where users are directly exposed under the control of the platform's recommendation algorithms. |
| Approach: | They propose a user-agent-platform paradigm where agent serves as the protective shield between user and recommender system that enables indirect exposure. |
| Outcome: | The proposed model improves 16.6% over baselines on four datasets and mitigates echo chamber effects and reduces model bias in disadvantaged users. |
Causal Intervention for Abstractive Related Work Generation (2023.findings-emnlp)
Copied to clipboard
| Challenge: | Existing models ignore the inherent causality during related work generation, leading to spurious correlations which downgrade the models’ generation quality and generalizability. |
| Approach: | They propose a Causal Intervention Module for Related Work Generation (CaM) that captures causal relationships in related work generation and implements causal interventions to mitigate the negative impact of spurious correlations. |
| Outcome: | The proposed framework improves the quality and coherence of generated related work by capturing causalities in the generation process. |
ELAD: Explanation-Guided Large Language Models Active Distillation (2024.findings-acl)
Copied to clipboard
| Challenge: | Large Language Models (LLMs) are hindered by their memory inefficiency, computational demands, and the high costs of API inferences. |
| Approach: | They propose an Explanation-Guided LLMs Active Distillation framework that employs an active learning strategy to optimize the balance between annotation costs and model performance. |
| Outcome: | The proposed framework significantly improves the efficiency of LLMs knowledge distillation. |
RulE: Knowledge Graph Reasoning with Rule Embedding (2024.findings-acl)
Copied to clipboard
| Challenge: | Knowledge graph reasoning is an important problem for knowledge graphs. |
| Approach: | They propose a framework that leverages logical rules to enhance KG reasoning by learning rule embeddings from existing triplets and first-order rules. |
| Outcome: | The proposed framework outperforms existing embedding-based and rule-based methods on multiple benchmarks. |
ReCoSa: Detecting the Relevant Contexts with Self-Attention for Multi-turn Dialogue Generation (P19-1)
Copied to clipboard
| Challenge: | Existing hierarchical recurrent encoder-decoder models treat all contexts indiscriminately, which may hurt the following response generation process. |
| Approach: | They propose a hierarchical recurrent encoder-decoder model that treats all contexts indiscriminately and uses a word level LSTM encoder to obtain the initial representation of each context. |
| Outcome: | The proposed model outperforms baseline models on Chinese customer services and English Ubuntu dialogue datasets in terms of both metric-based and human evaluations. |
Prompt-fused Framework for Inductive Logical Query Answering (2024.lrec-main)
Copied to clipboard
| Challenge: | Existing methods for addressing logical queries on knowledge graphs neglect missing edges in KGs . Existing approaches focus on addressing missing edges, thereby neglecting the emergence of new entities . |
| Approach: | They propose a query-aware prompt-fused framework that addresses embedding of emerging entities . they propose to use a symbolic query to gather information relevant to the query . |
| Outcome: | The proposed framework addresses embedding of emerging entities through contextual information aggregation. |
“Yes, My LoRD.” Guiding Language Model Extraction with Locality Reinforced Distillation (2025.acl-long)
Copied to clipboard
| Challenge: | Existing methods for model extraction attacks on large language models are inadequate . existing methods neglect the inconsistency between training tasks and LLM alignment . |
| Approach: | They propose a model extraction algorithm that uses a policy-gradient-style training task to guide the crafting of preference for the local model. |
| Outcome: | The proposed algorithm reduces query complexity while mitigating watermark protection . it can extract various state-of-the-art commercial LLMs while minimizing query complexity . |
LLM-OREF: An Open Relation Extraction Framework Based on Large Language Models (2025.emnlp-main)
Copied to clipboard
| Challenge: | Existing studies focus on building models that can only handle predefined relations . however, their reliance on human annotation limits their practicality . |
| Approach: | They propose an open relation extraction framework that can generalize to new relations not encountered during training. |
| Outcome: | The proposed framework can generalize to new relations not encountered during training. |
Boundary-Driven Table-Filling for Aspect Sentiment Triplet Extraction (2022.emnlp-main)
Copied to clipboard
| Challenge: | Existing work focuses on extracting aspect terms and opinion terms without considering the relations between aspect terms . |
| Approach: | They propose a task to extract aspect terms, opinion terms, and expressed sentiments from a two-dimensional (2D) table. |
| Outcome: | The proposed method achieves state-of-the-art on several public benchmarks and is well-suited to the ASTE task. |
Landmark-Guided Cross-Speaker Lip Reading with Mutual Information Regularization (2024.lrec-main)
Copied to clipboard
| Challenge: | Lip reading is a process of interpreting silent speech from visual lip movements . but lip reading in cross-speaker scenarios poses a challenging problem due to inter-speech variability . |
| Approach: | They propose to exploit lip landmark-guided visual clues instead of mouth-cropped images as input features. |
| Outcome: | Experimental results show that the proposed approach reduces speaker-specific appearance characteristics in cross-speaker scenarios. |
CLAMBER: A Benchmark of Identifying and Clarifying Ambiguous Information Needs in Large Language Models (2024.acl-long)
Copied to clipboard
Tong Zhang, Peixin Qin, Yang Deng, Chen Huang, Wenqiang Lei, Junhong Liu, Dingnan Jin, Hongru Liang, Tat-Seng Chua
| Challenge: | Large language models are used to meet user information needs, but their effectiveness in dealing with user queries that contain various types of ambiguity remains unknown. |
| Approach: | They propose a benchmark for evaluating large language models using a well-organized taxonomy. |
| Outcome: | The proposed model is based on a well-organized taxonomy and compares it with other models. |
Subjective Topic meets LLMs: Unleashing Comprehensive, Reflective and Creative Thinking through the Negation of Negation (2024.emnlp-main)
Copied to clipboard
| Challenge: | Large language models (LLMs) exhibit powerful reasoning capacity, but their evaluation still lacks comprehensiveness. |
| Approach: | They propose a framework grounded in the principle of the Negation of Negation (NeoN) to unleash the potential comprehensive, reflective, and creative thinking abilities of LLMs. |
| Outcome: | The proposed framework unleashes the potential comprehensive, reflective, and creative thinking abilities of large language models. |
TransGEC: Improving Grammatical Error Correction with Translationese (2023.findings-acl)
Copied to clipboard
| Challenge: | Experimental results show that data augmentation improves accuracy over strong baselines. |
| Approach: | They propose to use translationese as input for GEC data augmentation to overcome stylistic discrepancies . they propose to obtain human-translated texts with a more similar style to non-native texts . |
| Outcome: | The proposed method improves correction accuracy over strong baselines on four GEC benchmarks. |
PRIME: A Process-Outcome Alignment Benchmark for Verifiable Reasoning in Mathematics and Engineering (2026.acl-long)
Copied to clipboard
Xiangfeng Wang, Hangyu Guo, Yanlin Lai, Mitt Huang, Liang Zhao, Chengyuan Yao, Yinmin Zhang, Qi Han, null Xiaoxiaoren, Chun Yuan, Tong Xu, Zheng Ge, Xiangyu Zhang, Daxin Jiang
| Challenge: | Current outcome-centric verification paradigms neglect potential errors in the derivation process. |
| Approach: | They propose a process-aware RLVR training paradigm utilizing verifiers selected via **PRIME**. |
| Outcome: | The proposed approach outperforms the baseline verification paradigm on AIME24, AIME25, and Beyond-AIME models. |
DialogSum: A Real-Life Scenario Dialogue Summarization Dataset (2021.findings-acl)
Copied to clipboard
| Challenge: | Experimental results show unique challenges in dialogue summarization such as spoken terms, special discourse structures, coreferences and ellipsis, pragmatics and social common sense. |
| Approach: | They propose a large-scale labeled dialogue summarization dataset . they use state-of-the-art neural models to analyze spoken dialogue summaries . |
| Outcome: | The proposed dataset can be used to analyze spoken dialogue summarization challenges. |
Eureka: Neural Insight Learning for Knowledge Graph Reasoning (2022.coling-1)
Copied to clipboard
| Challenge: | Existing knowledge embedding methods have limited performance on knowledge graph reasoning tasks . eureka is empowered to learn seen relations with sufficient training triples . |
| Approach: | They propose a neural insight learning framework called Eureka to bridge the “seen” to “unsea” gap . Eureca is empowered to learn seen relations with sufficient training triples while providing flexibility to learn unseen relations given only one trigger . |
| Outcome: | The proposed framework outperforms state-of-the-art models on seen and unseen relations . it can learn seen and unseen relationships with sufficient training triples . |
MultiMET: A Multimodal Dataset for Metaphor Understanding (2021.acl-long)
Copied to clipboard
| Challenge: | Metaphor is a linguistic phenomenon and a cognitive phenomenon structuring human thought, authors say . previous studies focused on texts, partly due to the unavailability of ground truth labels of multimodal metaphor . |
| Approach: | They propose a multimodal metaphor dataset that integrates multimodal text and image . it contains 10,437 text-image pairs with multimodal annotations of occurrences . |
| Outcome: | The proposed dataset examines multimodal cues and their interplay. |
AMEX: Android Multi-annotation Expo Dataset for Mobile GUI Agents (2025.findings-acl)
Copied to clipboard
Yuxiang Chai, Siyuan Huang, Yazhe Niu, Han Xiao, Liang Liu, Guozhi Wang, Dingyu Zhang, Shuai Ren, Hongsheng Li
| Challenge: | a new dataset is being developed to improve the capabilities of mobile GUI-control agents. |
| Approach: | They propose a dataset designed for generalist mobile GUI-control agents . they use screenshots from popular mobile applications to create a detailed GUI-annotated dataset . |
| Outcome: | The Android Multi-annotation EXpo (AMEX) is a large-scale dataset for generalist mobile GUI-control agents . it includes screenshots from popular mobile applications, which are annotated at multiple levels . |
Diagnosing and Remedying Representation Deficiencies for Deterministic Reasoning in KGQA (2026.acl-long)
Copied to clipboard
| Challenge: | Existing approaches to solve non-deterministic reasoning problems in large language models are limited by their complexity and lack of a clear understanding of the problem. |
| Approach: | They propose a method to diagnose and correct non-deterministic reasoning behaviors in large language models. |
| Outcome: | The proposed method outperforms baselines and WebQSP benchmarks on the widely used WebQ SP and CWQ benchmarks. |
TinyChart: Efficient Chart Understanding with Program-of-Thoughts Learning and Visual Token Merging (2024.emnlp-main)
Copied to clipboard
| Challenge: | Recent studies have shown that multimodal large language models can be useful for chart understanding, but their size limits their use in resource-constrained environments. |
| Approach: | They propose an efficient multimodal large language model with only 3B parameters for chart understanding. |
| Outcome: | The proposed model outperforms several chart-understanding MLLMs with up to 13B parameters on ChartQA, Chart-to-Text, Chart to Table, OpenCQA, and ChartX. |
FedMABench: Benchmarking Mobile GUI Agents on Decentralized Heterogeneous User Data (2025.emnlp-main)
Copied to clipboard
| Challenge: | Mobile GUI agents have attracted tremendous research participation recently. traditional approaches to mobile agent training rely on centralized data collection. |
| Approach: | They propose a benchmark for federated training and evaluation of mobile GUI agents . they find that federation algorithms consistently outperform local training . |
| Outcome: | The first benchmark for federated training and evaluation of mobile GUI agents is released . it features 6 datasets with 30+ subsets, 8 federation algorithms, 10+ base models, and over 800 apps across 5 categories . |
ACROSS: An Alignment-based Framework for Low-Resource Many-to-One Cross-Lingual Summarization (2023.findings-acl)
Copied to clipboard
| Challenge: | Existing studies ignore data imbalance in multilingual settings and do not utilize monolingual data. |
| Approach: | They propose a cross-lingual summarization model that aligns cross-linguistic data with high-resource monolingual data via contrastive and consistency loss. |
| Outcome: | The proposed model outperforms baseline models and consistently dominates on 45 language pairs. |
ZhuJiu-Knowledge: A Fairer Platform for Evaluating Multiple Knowledge Types in Large Language Models (2024.naacl-demo)
Copied to clipboard
| Challenge: | evaluating the knowledge of large language models (LLMs) is crucial, and rapid advancement in large language modeling has heightened the importance of model evaluations. |
| Approach: | They propose a fairer benchmark for evaluating multiple knowledge types of LLMs by focusing on commonsense knowledge, world knowledge, and language knowledge. |
| Outcome: | The proposed framework evaluates 14 current mainstream LLMs and provides a detailed discussion and analysis of their results. |
UIOrchestra: Generating High-Fidelity Code from UI Designs with a Multi-agent System (2025.findings-emnlp)
Copied to clipboard
Chuhuai Yue, Jiajun Chai, Yufei Zhang, Zixiang Ding, Xihao Liang, Peixin Wang, Shihai Chen, Wang Yixuan, null Wangyanping, Guojun Yin, Wei Lin
| Challenge: | Recent advances in large language models have significantly improved automated code generation . however, the translation of complex mobile UI designs into high-fidelity front-end code remains a challenge . |
| Approach: | They propose a collaborative multi-agent system to reconstruct static single-page apps from mockups. |
| Outcome: | The proposed system outperforms existing methods in reconstructing complex app pages . the code and data will be released upon paper acceptance . |
Multilingual Knowledge Editing with Language-Agnostic Factual Neurons (2025.coling-main)
Copied to clipboard
| Challenge: | Existing methods to update factual knowledge overlook connections of same knowledge between different languages, resulting in knowledge conflicts and limited edit performance. |
| Approach: | They propose a method to edit multilingual knowledge simultaneously that avoids knowledge conflicts and improves edit performance. |
| Outcome: | The proposed method avoids knowledge conflicts and improves edit performance on bi-ZsRE and MzsRE benchmarks. |
From Implicit to Explicit: Token-Efficient Logical Supervision for Mathematical Reasoning in LLMs (2026.findings-acl)
Copied to clipboard
| Challenge: | Recent studies reveal large language models lack logical reasoning abilities . logical relationship understanding is a core capability underlying genuine logical thinking . |
| Approach: | They propose a lightweight training framework targeting logical relationship understanding . they propose logical relation understanding framework that provides explicit supervision . |
| Outcome: | The proposed framework outperforms CoT-SFT training frameworks in logical relationship understanding tasks. |
EduBench: A Comprehensive Benchmarking Dataset for Evaluating Large Language Models in Diverse Educational Scenarios (2026.acl-long)
Copied to clipboard
Bin Xu, Yu Bai, Huashan Sun, Yiguan Lin, Siming Liu, Xinyue Liang, Yaolin Li, Zhuangzhi Dong, Jingren Zhang, Yufan Deng, Xinyu Zou, Yang Gao, Heyan Huang
| Challenge: | Existing benchmarks that focus on knowledge-intensive tasks do not reflect diverse educational scenarios. |
| Approach: | They propose a benchmark that incorporates 9 major scenarios and 4,000 educational contexts. |
| Outcome: | The proposed model performs comparable to state-of-the-art large models on the test set. |
Read Extensively, Focus Smartly: A Cross-document Semantic Enhancement Method for Visual Documents NER (2022.coling-1)
Copied to clipboard
| Challenge: | Existing methods to extract entities from visually-rich documents ignore the inherent multimodality of VRDs and thus the suboptimal results are achieved. |
| Approach: | They propose a multimodal semantic enhancement method that filters redundant information in the current document and a cross-document information awareness technique to enrich the entity-related context. |
| Outcome: | The proposed method outperforms existing methods on two documents understanding benchmarks covering eight languages. |
Construction of a Chinese Corpus for the Analysis of the Emotionality of Metaphorical Expressions (P18-2)
Copied to clipboard
| Challenge: | a corpus of 5,605 manually annotated sentences in Chinese is described . emotion is an abstract and vague conception, which is often described by metaphor . |
| Approach: | They propose to construct a corpus of metaphors annotated with emotion in Chinese . they use an annotation scheme to include linguistic metaphors, emotional categories and intensity . |
| Outcome: | The proposed corpus contains 5,605 manually annotated sentences in Chinese . the authors show that the corpus is large enough to analyze emotions . |
Let GPT be a Math Tutor: Teaching Math Word Problem Solvers with Customized Exercise Generation (2023.emnlp-main)
Copied to clipboard
| Challenge: | Existing approaches for distilling large language models into smaller, more efficient student models are based on educational science principles such as knowledge tracing and personalized learning. |
| Approach: | They propose a method for distilling large language models into smaller, more efficient student models that are aligned with educational science principles such as knowledge tracing and personalized learning. |
| Outcome: | The proposed approach outperforms LLMs on three benchmarks while employing significantly fewer parameters. |
A Quality-based Syntactic Template Retriever for Syntactically-Controlled Paraphrase Generation (2023.emnlp-main)
Copied to clipboard
| Challenge: | Existing syntactically-controlled paraphrase generation models perform well with human-annotated or well-chosen syntaktic templates. |
| Approach: | They propose a quality-based Syntactic Template Retriever to retrieve templates based on the quality of the to-be-generated paraphrases. |
| Outcome: | The proposed algorithm can generate high-quality paraphrases without sacrificing quality. |
From Remembering to Metacognition: Do Existing Benchmarks Accurately Evaluate LLMs? (2025.findings-emnlp)
Copied to clipboard
Geng Zhang, Yizhou Ying, Sihang Jiang, Jiaqing Liang, Guanglei Yue, Yifei Fu, Hailin Hu, Yanghua Xiao
| Challenge: | Existing benchmark datasets focus on low-level cognitive tasks while providing limited coverage of higher-level reasoning skills. |
| Approach: | They analyze the cognitive depth of popular LLM benchmarks using Bloom’s Taxonomy to evaluate both the cognitive and knowledge dimensions. |
| Outcome: | The results show that incorporating higher-level cognitive instructions into the current instruction fine-tuning process improves model performance. |
Generative Reward Modeling via Synthetic Criteria Preference Learning (2025.acl-long)
Copied to clipboard
| Challenge: | Generative Reward Models (GenRMs) leverage synthesized Chains of Thought (CoT) but this approach introduces risks of overoptimization due to the inability to guarantee the correctness of the CoTs. |
| Approach: | They propose a criteria-based preference tree for GenRMs that uses chain of thought to generate reasoning . they show that synthesized data can be learned using a long CoT format . |
| Outcome: | The proposed model shows significant improvements over baselines on multiple human preference benchmarks. |
MorphoBench: A Benchmark with Difficulty Adaptive to Model Reasoning (2026.findings-acl)
Copied to clipboard
Xukai Wang, Xuanbo Liu, Mingrui Chen, Haitian Zhong, Xuanlin Yang, Bohan Zeng, Jinbo Hu, Hao Liang, Junbo Niu, Xuchen Li, Ruitao Wu, Ruichuan An, Yang Shi, Liu Liu, Qiang Liu, Zhouchen Lin, Xu-Yao Zhang, Wentao Zhang, Bin Dong
| Challenge: | Existing benchmarks designed to evaluate the reasoning capabilities of large models are limited in scope and lack flexibility to adapt difficulty according to evolving reasoning capacities of models. |
| Approach: | They propose a benchmark that incorporates multidisciplinary questions to evaluate the reasoning capabilities of large models and can adjust and update question difficulty based on the reasoning abilities of advanced models. |
| Outcome: | The proposed benchmark incorporates multidisciplinary questions to evaluate the reasoning capabilities of large models and can adjust and update question difficulty based on the reasoning abilities of advanced models. |
Data-Efficient Language Shaped Few-shot Image Classification (2021.findings-emnlp)
Copied to clipboard
| Challenge: | Existing studies have shown that language is helpful guider for image understanding by neural networks. |
| Approach: | They propose a language-shaped learning method that makes the best use of the few-shot images and the language available only in training. |
| Outcome: | The proposed method outperforms state-of-the-art methods on a few-shot dataset with limited training data. |
Hi-ArG: Exploring the Integration of Hierarchical Argumentation Graphs in Language Pretraining (2023.emnlp-main)
Copied to clipboard
Jingcong Liang, Rong Ye, Meng Han, Qi Zhang, Ruofei Lai, Xinyu Zhang, Zhao Cao, Xuanjing Huang, Zhongyu Wei
| Challenge: | Recent studies have discussed its capability to assist language models for various applications. |
| Approach: | They propose a structure to organize arguments using the **Hi**erarchical **Ar**gumentation **G**raph (Hi-ArG) and propose two approaches to exploit Hi-AarG, including a text-graph multi-modal model GreaseArR and a framework augmented with graph information. |
| Outcome: | The proposed structure supersedes existing language models on two argumentation tasks while incorporating graph information during further training improves vanilla language models. |
Fine-tuning Pre-trained Language Models for Few-shot Intent Detection: Supervised Pre-training and Isotropization (2022.naacl-main)
Copied to clipboard
| Challenge: | Recent studies show that fine-tuning pre-trained language models with a small set of labeled utterances in a supervised manner is helpful, but it yields an anisotropic feature space, which may suppress the expressive power of the semantic representations. |
| Approach: | They propose to regularize supervised pre-training towards isotropy by contrastive learning and correlation matrix regularizers. |
| Outcome: | The proposed methods improve supervised pre-training by regularizing the feature space towards isotropy. |
Beyond Positive Scaling: How Negation Impacts Scaling Trends of Language Models (2023.findings-acl)
Copied to clipboard
Yuhui Zhang, Michihiro Yasunaga, Zhengping Zhou, Jeff Z. HaoChen, James Zou, Percy Liang, Serena Yeung
| Challenge: | Recent studies show that some tasks exhibit inverse scaling, or U-shaped scaling, where the performance degrades as models are scaled up. |
| Approach: | They propose a task that asks questions with negation to show positive scaling . they hypothesize that solving NeQA depends on question answering and negation understanding . |
| Outcome: | The proposed task can exhibit inverse scaling, U-shaped scaling, or positive scaling, and the scaling trends shift as the task is more powerful. |
Have We Designed Generalizable Structural Knowledge Promptings? Systematic Evaluation and Rethinking (2025.acl-long)
Copied to clipboard
Yichi Zhang, Zhuo Chen, Lingbing Guo, Yajing Xu, Shaokai Chen, Mengshu Sun, Binbin Hu, Zhiqiang Zhang, Lei Liang, Wen Zhang, Huajun Chen
| Challenge: | Existing methods to integrate external knowledge into LLMs focus on specific problems, lacking a comprehensive exploration of the generalization and capability boundaries of SKP. |
| Approach: | They propose a new paradigm for structural knowledge prompting to integrate external structural knowledge into LLMs by incorporating structural representations. |
| Outcome: | The proposed benchmark SUBARU enables the evaluation of the generalization capabilities of SKP from four perspectives. |
ChatMusician: Understanding and Generating Music Intrinsically with LLM (2024.findings-acl)
Copied to clipboard
Ruibin Yuan, Hanfeng Lin, Yi Wang, Zeyue Tian, Shangda Wu, Tianhao Shen, Ge Zhang, Yuhang Wu, Cong Liu, Ziya Zhou, Liumeng Xue, Ziyang Ma, Qin Liu, Tianyu Zheng, Yizhi Li, Yinghao Ma, Yiming Liang, Xiaowei Chi, Ruibo Liu, Zili Wang, Chenghua Lin, Qifeng Liu, Tao Jiang, Wenhao Huang, Wenhu Chen, Jie Fu, Emmanouil Benetos, Gus Xia, Roger Dannenberg, Wei Xue, Shiyin Kang, Yike Guo
| Challenge: | Despite LLMs' impressive capabilities in musical knowledge, music reasoning remains an unsolved task. |
| Approach: | They propose an open-source large language model (LLM) that integrates intrinsic musical abilities into LLaMA2 and GPT-3.5. |
| Outcome: | The proposed model can understand and generate music with a pure text tokenizer without external multi-modal neural structures or tokenizers. |
A3: Android Agent Arena for Mobile GUI Agents with Essential-State Procedural Evaluation (2026.findings-acl)
Copied to clipboard
Yuxiang Chai, Shunye Tang, Han Xiao, Weifeng Lin, Hanhao Li, Jiayu Zhang, Liang Liu, Pengxiang Zhao, Guangyi Liu, Guozhi Wang, Shuai Ren, Rongduo Han, Haining Zhang, Siyuan Huang, Hongsheng Li
| Challenge: | Existing evaluation methods for mobile GUI agents rely on static frame assessments or offline static apps. |
| Approach: | They propose an evaluation system that leverages large language models as reward models to verify task completion and process achievement. |
| Outcome: | The proposed system addresses the limitations of traditional function based evaluation methods on online dynamic apps. |
Chain-of-Talkers (CoTalk): Fast Human Annotation of Dense Image Captions (2025.emnlp-main)
Copied to clipboard
| Challenge: | Existing approaches for optimizing human annotation efforts are limited . et al., 2015) suggest that densely annotated image captions improve vision-language alignment . |
| Approach: | They propose an AI-in-the-loop methodology to maximize the number of annotated samples and improve their comprehensiveness under fixed budget constraints. |
| Outcome: | The proposed method improves annotation speed and retrieval performance over the parallel method. |
MIND Your Reasoning: A Meta-Cognitive Intuitive-Reflective Network for Dual-Reasoning in Multimodal Stance Detection (2026.acl-long)
Copied to clipboard
| Challenge: | Existing methods operate by learning to fuse modalities, leading to frequent misjudgments. |
| Approach: | They propose a paradigm shift from *learning to fuse* to *learning the reason's process' inspired by the dual-process theory of human cognition, MIND operationalizes a self-improving loop. |
| Outcome: | The proposed model significantly outperforms baseline models and exhibits strong generalization. |
WebAgent-R1: Training Web Agents via End-to-End Multi-Turn Reinforcement Learning (2025.emnlp-main)
Copied to clipboard
Zhepei Wei, Wenlin Yao, Yao Liu, Weizhi Zhang, Qin Lu, Liang Qiu, Changlong Yu, Puyang Xu, Chao Zhang, Bing Yin, Hyokun Yun, Lihong Li
| Challenge: | Existing work on reinforcement learning has focused on single-turn tasks such as solving math problems. |
| Approach: | They propose a framework that learns directly from online interactions by asynchronously generating diverse trajectories, guided by binary rewards depending on task success. |
| Outcome: | Experiments on the WebArena-Lite benchmark show that the framework outperforms state-of-the-art methods and strong proprietary models. |
VideoLLM Knows When to Speak: Enhancing Time-Sensitive Video Comprehension with Video-Text Duet Interaction Format (2025.findings-emnlp)
Copied to clipboard
| Challenge: | Recent studies on video large language models focus on model architectures and training datasets . interaction format between user and model is unsatisfactory for time-sensitive tasks . |
| Approach: | They propose a video-text duet interaction format that allows for continuous playback of the video . when a text message ends, the video continues to play, similar to the alternative of two performers in a duet. |
| Outcome: | The proposed format improves performance on time-sensitive tasks with minimal training efforts. |
Data-Centric Perspectives on Agentic Retrieval-Augmented Generation: A Survey (2026.findings-acl)
Copied to clipboard
| Challenge: | Large Language Models (LLMs) excel at natural language understanding and generation, yet rely on static pre-training data. |
| Approach: | They propose to augment Large Language Models with external retrieval to ground model outputs . traditional RAG is constrained by a fixed retrieve-then-generate routine . authors aim to guide creation of high-quality datasets for next generation of adaptive LLM agents . |
| Outcome: | The proposed model can decompose tasks, issue exploratory queries, and refine evidence through iterative retrieval. |
Revisiting Demonstration Selection Strategies in In-Context Learning (2024.acl-long)
Copied to clipboard
| Challenge: | Large language models (LLMs) have shown an impressive ability to perform a wide range of tasks using in-context learning (ICL). |
| Approach: | They propose a data- and model-dependent method to select models using in-context learning, TopK + ConE, and propose unified explanations for the effectiveness of previous methods. |
| Outcome: | The proposed method improves language understanding and generation tasks with different model scales. |
Vanessa: Visual Connotation and Aesthetic Attributes Understanding Network for Multimodal Aspect-based Sentiment Analysis (2024.findings-emnlp)
Copied to clipboard
| Challenge: | Existing methods to analyze images focus on superficial features or descriptions, omitting subtle contextual information. |
| Approach: | They propose a Visual Connotation and Aesthetic Attributes Understanding Network (Vanessa) for Multimodal Aspect-based Sentiment Analysis. |
| Outcome: | The proposed network captures both implicit and explicit sentimental cues and can be used to enrich textual sentiment analysis. |
Controllable Contamination Detection for Reliable LLM Evaluation with Statistical Guarantees (2026.acl-long)
Copied to clipboard
Zheng Zhang, Qi Liu, Siyuan Liang, Ning Li, Zirui Hu, Weibo Gao, Rui Li, Zhenya Huang, Leszek Rutkowski, Baosheng Yu, Dacheng Tao
| Challenge: | Existing training data detectors fail to detect clean samples from contaminated test sets . existing methods fail to identify clean samples due to black-box nature of LLMs . |
| Approach: | They propose a framework that detects and filters contaminated evaluation data . they propose 'failure detection' to reduce the proportion of contaminated samples mistakenly retained . |
| Outcome: | The proposed framework reduces false discovery rate (FDR) under valid FDR control while maintaining evaluation consistency. |
Toward Human-Like Evaluation for Natural Language Generation with Error Analysis (2023.acl-long)
Copied to clipboard
| Challenge: | Pre-trained language models (PLMs) have been used to evaluate language generation tasks . pretrained error analysis can be used to refine the generated sentence toward higher confidence . |
| Approach: | They propose to combine pretrained language model based metrics with human-like error analysis to improve sentence confidence. |
| Outcome: | The proposed method outperforms top-scoring metrics in 19/25 settings. |
G-Cap: A Game Character Caption Generator (2026.acl-long)
Copied to clipboard
| Challenge: | Existing studies on Large Vision-Language Models (LVLMs) primarily focus on real-world scenarios, leaving surreal, highly stylized, and semantically hybrid virtual-world situations significantly underexplored. |
| Approach: | They propose to use a manually annotated benchmark to evaluate LVLMs' ability to perceive and describe game character from the virtual-world. |
| Outcome: | The proposed task evaluates LVLMs’ ability to perceive and describe game character from the virtual-world. |
DSQG-Syn: Synthesizing High-quality Data for Text-to-SQL Parsing by Domain Specific Question Generation (2025.findings-naacl)
Copied to clipboard
Shaoming Duan, Youxuan Wu, Chuanyi Liu, Yuhao Zhang, Zirui Wang, Peiyi Han, Shengyuan Yu, Liang Yan, Yingwei Liang
| Challenge: | Existing methods for generating SQL queries using natural language questions produce inconsistent NLQ-SQL pairs. |
| Approach: | They propose a text-to-SQL data synthesis framework that generates domain-relevant questions . they synthesize NLQ-SqL pairs that are domain-specific and intent-consistent . |
| Outcome: | The proposed method outperforms closed-source LLMs on the Text-to-SQL task. |
Multi-View Document Representation Learning for Open-Domain Dense Retrieval (2022.acl-long)
Copied to clipboard
| Challenge: | Existing methods for dense retrieval are hard to match with multiple views. |
| Approach: | They propose a multi-view document representation learning framework to generate multiple embeddings through viewers to represent documents and enforce them to align with different queries. |
| Outcome: | The proposed method outperforms recent works and achieves state-of-the-art results. |
A Query-Response Framework for Whole-Page Complex-Layout Document Image Translation with Relevant Regional Concentration (2025.findings-acl)
Copied to clipboard
| Challenge: | Existing methods for document image translation rely on the vanilla encoder-decoder paradigm . a novel dynamic aggregation mechanism is designed to enhance the text semantics in query features toward translation. |
| Approach: | They propose a Query-Response DIT framework that reformulates the DIT task into a parallel response/translation process of multiple queries. |
| Outcome: | The proposed framework improves translation quality on four translation directions on three benchmarks. |
MAVIS: Multi-Agent Video Retrieval via Structured Video Understanding (2026.findings-acl)
Copied to clipboard
| Challenge: | Existing methods for video retrieval rely on embedding-based full-corpus scanning, but there is a bottleneck in semantic asymmetry and computational redundancy. |
| Approach: | They propose a multi-agent framework that rethinks retrieval as cooperative reasoning . they parse raw videos into a structured semantic library, enabling explicit attribute-level indexing . |
| Outcome: | The proposed framework bridges the granularity mismatch gap by parsing raw videos into a structured semantic library . it employs a Logic-aware Debate mechanism with a strict veto protocol . the proposed framework achieves competitive performance without task-specific fine-tuning . |
DORM: Preference Data Weights Optimization for Reward Modeling in LLM Alignment (2025.findings-emnlp)
Copied to clipboard
Rongzhi Zhang, Chenwei Zhang, Xinyang Zhang, Liang Qiu, Haoming Jiang, Yuchen Zhuang, Qingru Zhang, Hyokun Yun, Xian Li, Bing Yin, Tuo Zhao, Chao Zhang
| Challenge: | Existing approaches to align large language models with human preferences are noisy and varying in importance of preference samples. |
| Approach: | a new method enhances reward modeling by learning to dynamically weigh preference data. |
| Outcome: | a new method improves the performance of large language models with human preferences . it initializes data importance and iteratively refines them to maximize validation performance. |
Listening to Patients: Detecting and Mitigating Patient Misreport in Medical Dialogue System (2025.findings-acl)
Copied to clipboard
| Challenge: | Medical Dialogue Systems (MDSs) aim to provide automated healthcare support through natural language interactions between patients and system agents. |
| Approach: | They propose a framework that detects misreports and mitigates them by generating controlled clarifying questions. |
| Outcome: | The proposed framework can detect misreports and mitigate them through generating controlled clarifying questions. |
KERS: A Knowledge-Enhanced Framework for Recommendation Dialog Systems with Multiple Subgoals (2021.findings-emnlp)
Copied to clipboard
| Challenge: | Existing frameworks for multi-subgoal dialogs require a system to build a social bond with users to gain trust and develop affinity. |
| Approach: | They propose a framework for common knowledge-based multi-subgoal dialogs that divides up conversations with multiple subgoals and propose mechanisms to filter noisy knowledge and to include cleaned knowledge in the dialog response generation process. |
| Outcome: | The proposed framework obtains state-of-the-art results on a DuRecDial dataset in both automatic and human evaluation. |
Unilaw-R1: A Large Language Model for Legal Reasoning with Reinforcement Learning and Iterative Inference (2025.emnlp-main)
Copied to clipboard
| Challenge: | Reasoning-focused large language models (LLMs) are rapidly evolving across various domains, yet their capabilities in handling complex legal problems remain underexplored. |
| Approach: | They propose a large language model tailored for legal reasoning with a 7-billion parameter scale and a two-stage training strategy combining Supervised Fine-Tuning and Reinforcement Learning. |
| Outcome: | The proposed model outperforms all models of similar scale on authoritative benchmarks and outperformed Qwen-2.5-7B-Instruct (46.6%) by an average margin of 6.6%. |
RECAL: Sample-Relation Guided Confidence Calibration over Tabular Data (2023.findings-emnlp)
Copied to clipboard
| Challenge: | Various machine learning methods for tabular data lack accurate confidence estimation, which is needed for high-risk sensitive applications such as credit modeling and financial fraud detection. |
| Approach: | They propose a general post-training confidence calibration framework to calibrate the confidence of current machine learning models by employing graph neural networks to model the relationships between different samples. |
| Outcome: | The proposed framework improves the confidence estimation on tabular datasets by using graph neural networks to model the relationships between different samples. |
EventWeave: A Dynamic Framework for Capturing Core and Supporting Events in Dialogue Systems (2026.acl-long)
Copied to clipboard
Zhengyi Zhao, Shubo Zhang, Yiming Du, Bin Liang, Baojun Wang, Zhongyang Li, Binyang Li, Kam-Fai Wong
| Challenge: | Existing dialogue systems process conversational turns in isolation, overlooking event structures that guide natural interactions. |
| Approach: | They propose a framework that explicitly models relationships between conversational events to generate more contextually appropriate dialogue responses. |
| Outcome: | Experiments on three dialogue datasets show that the proposed approach produces more natural responses while requiring less computational overhead. |
FTibSuite: A Comprehensive Resource Suite for Tibetan Vision–Language Modeling (2026.findings-acl)
Copied to clipboard
| Challenge: | FTibSuite provides an end-to-end training-and-evaluation workflow for vision–language models . Tibetan is underserved due to the lack of infrastructure for reproducible training and evaluation. |
| Approach: | They propose a resource-centric workflow for Tibetan VLMs that provides an end-to-end training-and-evaluation workflow and human-verified multimodal annotations. |
| Outcome: | FTibSuite provides an end-to-end training-and-evaluation workflow and human-verified multimodal annotations. |
GEMv2: Multilingual NLG Benchmarking in a Single Line of Code (2022.emnlp-demos)
Copied to clipboard
Sebastian Gehrmann, Abhik Bhattacharjee, Abinaya Mahendiran, Alex Wang, Alexandros Papangelis, Aman Madaan, Angelina Mcmillan-major, Anna Shvets, Ashish Upadhyay, Bernd Bohnet, Bingsheng Yao, Bryan Wilie, Chandra Bhagavatula, Chaobin You, Craig Thomson, Cristina Garbacea, Dakuo Wang, Daniel Deutsch, Deyi Xiong, Di Jin, Dimitra Gkatzia, Dragomir Radev, Elizabeth Clark, Esin Durmus, Faisal Ladhak, Filip Ginter, Genta Indra Winata, Hendrik Strobelt, Hiroaki Hayashi, Jekaterina Novikova, Jenna Kanerva, Jenny Chim, Jiawei Zhou, Jordan Clive, Joshua Maynez, João Sedoc, Juraj Juraska, Kaustubh Dhole, Khyathi Raghavi Chandu, Laura Perez Beltrachini, Leonardo F . R. Ribeiro, Lewis Tunstall, Li Zhang, Mahim Pushkarna, Mathias Creutz, Michael White, Mihir Sanjay Kale, Moussa Kamal Eddine, Nico Daheim, Nishant Subramani, Ondrej Dusek, Paul Pu Liang, Pawan Sasanka Ammanamanchi, Qi Zhu, Ratish Puduppully, Reno Kriz, Rifat Shahriyar, Ronald Cardenas, Saad Mahamood, Salomey Osei, Samuel Cahyawijaya, Sanja Štajner, Sebastien Montella, Shailza Jolly, Simon Mille, Tahmid Hasan, Tianhao Shen, Tosin Adewumi, Vikas Raunak, Vipul Raheja, Vitaly Nikolaev, Vivian Tsai, Yacine Jernite, Ying Xu, Yisi Sang, Yixin Liu, Yufang Hou
| Challenge: | Evaluations in machine learning rarely use the latest metrics, datasets, or human evaluation in favor of remaining compatible with prior work. |
| Approach: | They propose to use the Generation, Evaluation, and Metrics Benchmark to integrate new evaluation methods into existing evaluations. |
| Outcome: | The proposed evaluation infrastructure bridges the gap between the advantages of leaderboards and in-depth and evolving evaluations by allowing model developers to benefit from each other's work. |
Can MLLMs Understand the Deep Implication Behind Chinese Images? (2025.acl-long)
Copied to clipboard
Chenhao Zhang, Xi Feng, Yuelin Bai, Xeron Du, Jinchang Hou, Kaixin Deng, Guangzeng Han, Qinrui Li, Bingli Wang, Jiaheng Liu, Xingwei Qu, Yifei Zhang, Qixuan Zhao, Yiming Liang, Ziqiang Liu, Feiteng Fang, Min Yang, Wenhao Huang, Chenghua Lin, Ge Zhang, Shiwen Ni
| Challenge: | MLLMs perform poorly on traditional culture images, indicating limitations in understanding high-level semantics and lacking a deep knowledge base of Chinese traditional culture. |
| Approach: | They propose to use Chinese images to assess MLLMs' higher-order perception and understanding of Chinese visual content. |
| Outcome: | The proposed model incorporates images that represent Chinese traditional culture, such as famous Chinese traditional paintings, to ensure the authenticity of the Chinese context. |
Advancing SMoE for Continuous Domain Adaptation of MLLMs: Adaptive Router and Domain-Specific Loss (2025.acl-long)
Copied to clipboard
| Challenge: | Recent studies have explored Continual Instruction Tuning (CIT) in Multimodal Large Language Models (MLLMs), with a primary focus on Task-incremental CIT, where MLLM are required to continuously acquire new tasks. |
| Approach: | They propose a Sparse Mixture of Expert (SMoE) based method for domain-incremental CIT in Multimodal Large Language Models (MLLMs) . they equip the SMoA module with a domain-specific autoregressive loss (DSAL) they establish a new benchmark to evaluate the efficacy of their method . |
| Outcome: | The proposed method outperforms all baselines and is based on a Sparse Mixture of Experts (SMoE) module . |
Semantically-Aligned Universal Tree-Structured Solver for Math Word Problems (2020.emnlp-main)
Copied to clipboard
| Challenge: | Existing models focus on one-unknown linear MWPs. |
| Approach: | They propose a universal expression tree-structured solver that integrates multiple expression trees underlying a MWP into a single expression tree. |
| Outcome: | The proposed method outperforms state-of-the-art models on a MWPs dataset and generates a universal expression tree explicitly by deciding which symbol to generate . |
LongInsightBench: A Comprehensive Benchmark for Evaluating Omni-Modal Models on Human-Centric Long-Video Understanding. (2026.findings-acl)
Copied to clipboard
| Challenge: | LongInsightBench is the first benchmark designed to assess models’ ability to understand long videos, with a focus on human language, viewpoints, actions, and other contextual elements. |
| Approach: | They propose a benchmark to assess models’ ability to understand long videos with a focus on human language, viewpoints, actions, and other contextual elements. |
| Outcome: | The proposed model excels in three key areas: a) long-duration, human-centric videos; b) diversifying and challenging task scenarios; c) quality assurance pipeline; and d) reliability. |
Toolscaler: Scalable Generative Tool Calling via Structure-Aware Semantic Tokenization (2025.findings-emnlp)
Copied to clipboard
Yunyue Su, Zhang Jinshuai, Bowen Fang, Wen Ye, Jinghao Zhang, Bowen Song, Weiqiang Wang, Qiang Liu, Liang Wang
| Challenge: | Extensive experiments demonstrate the effectiveness of SGTC across various tasks. |
| Approach: | They propose a generative tool invocation framework that introduces structure-aware semantic tokenization to encode tools as discrete code sequences. |
| Outcome: | The proposed framework reduces the size of the representation space and underutilizes collaborative signals among tools in downstream tasks. |
Think Natively: Unlocking Multilingual Reasoning with Consistency-Enhanced Reinforcement Learning (2026.acl-long)
Copied to clipboard
Xue Zhang, Yunlong Liang, Fandong Meng, Songming Zhang, Kaiyu Huang, Yufeng Chen, Xu Jinan, Jie Zhou
| Challenge: | Current Large Reasoning Models exhibit two critical limitations when processing non-English languages: (1) They struggle to maintain input-output language consistency; (2) They generally perform poorly with wrong reasoning paths and lower answer accuracy compared to English. |
| Approach: | They propose a language-consistency reward and a cross-lingual thinking alignment reward to improve the model's interpretability and accuracy. |
| Outcome: | The proposed model achieves nearly 100% language consistency and superior performance on two multilingual benchmarks (MMATH and PolyMath). |
Robust Lottery Tickets for Pre-trained Language Models (2022.acl-long)
Copied to clipboard
| Challenge: | Recent studies have shown that pre-trained language models contain smaller matching subnetworks that are not robust to adversarial examples. |
| Approach: | They propose a method to find robust tickets hidden in pre-trained language models by learning binary weight masks and an adversarial loss objective to guide the search. |
| Outcome: | The proposed method improves on previous work on adversarial robustness evaluation. |
Self-Generated Critiques Boost Reward Modeling for Language Models (2025.naacl-long)
Copied to clipboard
Yue Yu, Zhengxing Chen, Aston Zhang, Liang Tan, Chenguang Zhu, Richard Yuanzhe Pang, Yundi Qian, Xuewei Wang, Suchin Gururangan, Chao Zhang, Melanie Kambadur, Dhruv Mahajan, Rui Hou
| Challenge: | Existing reward models produce scalar scores and struggle to incorporate critiques in a natural language format. |
| Approach: | They propose a framework that predicts critiques and rewards using self-generated critiques without extra supervision. |
| Outcome: | The proposed framework improves reward modeling accuracy by 3.7%-7.3% compared to standard reward models and LLM judges. |
Filter-And-Refine: A MLLM Based Cascade System for Industrial-Scale Video Content Moderation (2025.acl-industry)
Copied to clipboard
Zixuan Wang, Jinghao Shi, Hanzhong Liang, Xiang Shen, Vera Wen, Zhiqian Chen, Yifan Wu, Zhixin Zhang, Hongyu Xiong
| Challenge: | Effective content moderation is essential for video platforms to safeguard user experience and uphold community standards. |
| Approach: | They propose a method to transform a generative MLLM into a multimodal classifier using minimal discriminative training data. |
| Outcome: | The proposed method improves F1 score by 66.50% over traditional classifiers while requiring only 2% of the fine-tuning data. |
MMSD2.0: Towards a Reliable Multi-modal Sarcasm Detection System (2023.findings-acl)
Copied to clipboard
| Challenge: | Existing benchmarks for multi-modal sarcasm detection have some shortcomings . a new framework can leverage multi-grained cues from multiple perspectives for multimodal detection . |
| Approach: | They propose a correction dataset that removes spurious cues and re-annotates the unreasonable samples. |
| Outcome: | The proposed framework outperforms the existing benchmarks in multi-modal sarcasm detection. |
Mechanistic Insights into Deferred Semantic Drift in LLMs (2026.findings-acl)
Copied to clipboard
| Challenge: | Large Language Models (LLMs) face a fundamental challenge with delayed disambiguation: how can a model update the meaning of an early, ambiguous token when clarifying context only appears later in the sequence? |
| Approach: | They propose a method to defer semantic re-evaluation to subsequent tokens in a process they call "Deferred Semantic Drift" they demonstrate this mechanism in metaphor comprehension and provide causal validation by steering model outputs towards literal or metaphorical meanings via targeted activation interventions. |
| Outcome: | The proposed model can update the meaning of an ambiguous word when clarifying context arrives only after it has been processed. |
RLSeek: Evidence-Grounded Reasoning for RAG Hallucination Detection (2026.acl-long)
Copied to clipboard
Zhaoheng Huang, Dacheng Wen, Yutao Zhu, Xiaoying Lian, Yushi Liang, Kai Hao, Nan Li, Liangjie Zhang, Qi Zhang, Ji-Rong Wen, Zhicheng Dou, Fangzhao Wu
| Challenge: | Recent work addresses this problem by training span-level hallucination detectors using reinforcement learning and chain-of-thought reasoning. |
| Approach: | They propose a framework that explicitly enforces active evidence seeking during CoT reasoning by requiring quotation of relevant source segments at each verification step. |
| Outcome: | The proposed framework improves hallucination span detection performance with limited reasoning overhead and improved robustness in out-of-domain settings. |
Metaphor Reasoning is Meta-reasoning (2026.acl-long)
Copied to clipboard
Qianyu He, Junting Lu, Yikai Zhang, Siyu Yuan, Xiaojun Meng, Jiansheng Wei, Jiaqing Liang, Yanghua Xiao
| Challenge: | Existing work on metaphor reasoning's impact on reasoning abilities is limited. |
| Approach: | They propose a system for synthesizing metaphorical riddles that satisfy five quality dimensions: diverse, balanced, reasoning-oriented, challenging, and verifiable. |
| Outcome: | The proposed system improves reasoning abilities across six domains using only thousands of metaphorical riddles. |
Single-to-mix Modality Alignment with Multimodal Large Language Model for Document Image Machine Translation (2025.acl-long)
Copied to clipboard
| Challenge: | Document Image Machine Translation (DIMT) faces generalization challenges due to limited training data and the complex interplay between visual and textual information. |
| Approach: | They propose a single-to-mix Modality alignment framework leveraging Multimodal Large Language Models (MLLMs) this framework aligns an imageonly encoder with multimodal representations of an MLLM pre-trained on large-scale document image datasets. |
| Outcome: | The proposed framework improves translation quality in cross-domain generalization and challenging document image scenarios. |
T2: An Adaptive Test-Time Scaling Strategy for Contextual Question Answering (2025.emnlp-main)
Copied to clipboard
Zhengyi Zhao, Shubo Zhang, Zezhong Wang, Huimin Wang, Yutian Zhao, Bin Liang, Yefeng Zheng, Binyang Li, Kam-Fai Wong, Xian Wu
| Challenge: | Existing efficient test-time scaling methods introduce budget constraints or early stop mechanisms to avoid overthinking for straightforward questions but add human bias to the reasoning process. |
| Approach: | They propose a framework that dynamically adapts reasoning depth based on question complexity. |
| Outcome: | Experimental results show that the proposed framework achieves higher accuracy than baseline methods and reduces computational overhead by up to 25.2%. |
Stable-RAG: Mitigating Retrieval-Permutation-Induced Hallucinations in Retrieval-Augmented Generation (2026.acl-long)
Copied to clipboard
| Challenge: | Existing RAG methods focus on enhancing LLM robustness to low-quality retrieval, but neither address permutation sensitivity. |
| Approach: | They propose a method that exploits permutation sensitivity to mitigate hallucinations in Large Language Models. |
| Outcome: | The proposed model improves answer accuracy, reasoning consistency, and generalization across datasets, retrievers, and input lengths compared with strong baselines. |
Does it Make Sense? And Why? A Pilot Study for Sense Making and Explanation (P19-1)
Copied to clipboard
| Challenge: | Existing benchmarks measure common sense knowledge indirectly or without reasoning. |
| Approach: | They propose a benchmark to test whether a system can differentiate natural language statements that make sense from those that do not make sense. |
| Outcome: | The proposed benchmarks show that models trained on large corpora perform better than humans on some benchmarks. |
Distorted or Fabricated? A Survey on Hallucination in Video LLMs (2026.findings-acl)
Copied to clipboard
| Challenge: | Despite significant advances in video-language modeling, hallucinations remain a persistent challenge in video large language models. |
| Approach: | They present a systematic taxonomy that categorizes hallucinations into two core types: dynamic distortion and content fabrication. |
| Outcome: | The proposed taxonomy categorizes hallucinations into two core types: dynamic distortion and content fabrication. |
Well Begun is Half Done: Generator-agnostic Knowledge Pre-Selection for Knowledge-Grounded Dialogue (2023.emnlp-main)
Copied to clipboard
| Challenge: | Existing knowledge selection methods are costly to learn and difficult to interpret when errors arise in the generated responses. |
| Approach: | They propose a generator-agnostic knowledge selection method to select context-related knowledge among different knowledge structures and variable knowledge requirements. |
| Outcome: | The proposed method can select knowledge accurately in advance and reduce learning, adjustment, and interpretation burden of later models. |
Compositional Mathematical Encoding for Math Word Problems (2023.findings-acl)
Copied to clipboard
| Challenge: | Existing MWP encoders work in a unimodal setting and map problem description to latent representation, then for decoding. |
| Approach: | They propose a Compositional Math Word Problem Solver which maps problem description to latent representation and decodes it in an interactive way. |
| Outcome: | Extensive experiments show that the proposed model outperforms state-of-the-art models on public benchmarks. |
MQM-APE: Toward High-Quality Error Annotation Predictors with Automatic Post-Editing in LLM Translation Evaluators (2025.coling-main)
Copied to clipboard
| Challenge: | Large Language Models (LLMs) have shown significant potential as judges for Machine Translation (MT) quality assessment. |
| Approach: | They propose a framework that automatically post-edits the original translation based on each error, thereby filtering out non-impactful errors. |
| Outcome: | The proposed framework improves reliability and quality of error spans against GEMBA-MQM, across eight LLMs in both high- and low-resource languages. |
Document Image Machine Translation with Dynamic Multi-pre-trained Models Assembling (2024.naacl-long)
Copied to clipboard
| Challenge: | Existing TIMT tasks focus on text-line-level images. |
| Approach: | They propose to extend the existing TIMT task and introduce a new framework to translate a source document image to markdown-formatted target translation. |
| Outcome: | The proposed task aims to translate a source document image with long context and complex layout structure to markdown-formatted target translation. |
DEFT: Distribution-guided Efficient Fine-Tuning for Human Alignment (2024.findings-emnlp)
Copied to clipboard
| Challenge: | Experimental results show that the methods enhanced by DEFT outperform the original methods in both alignment capability and generalization ability, with significantly reduced training time. |
| Approach: | They propose a distribution-based alignment framework that integrates data filtering and distributional guidance to improve alignment efficiency and generalization ability. |
| Outcome: | The proposed framework outperforms existing methods in alignment capability and generalization ability with significantly reduced training time. |
Why Do Emotions Change? Appraisal-Guided Reasoning for Emotion–Cause Triplet Extraction in Conversations (2026.acl-long)
Copied to clipboard
| Challenge: | Existing methods for multi-turn, multi-speaker multimodal affect understanding are difficult to maintain conversation-level consistency under within-speaks' emotion shifts. |
| Approach: | They propose a framework that combines appraisal-guided structured generation with graph-structured reinforcement learning to extract triplets from multi-turn multimodal conversations. |
| Outcome: | The proposed framework outperforms baselines on public MECTEC benchmarks and improves structure-aware metrics on emotion shift coherence and core events. |
CASN:Class-Aware Score Network for Textual Adversarial Detection (2023.acl-long)
Copied to clipboard
| Challenge: | Existing approaches to counteract adversarial attacks can be divided into two directions, adversarials defense and adversarially detection. |
| Approach: | They propose a score-based generative method to implicitly model the data distribution using a log-density distribution and supervised contrastive learning to guide the estimation using label information. |
| Outcome: | The proposed method improves on three text classification tasks on four advanced attack algorithms. |
Adaptive Simultaneous Sign Language Translation with Confident Translation Length Estimation (2024.lrec-main)
Copied to clipboard
| Challenge: | Existing non-simultaneous sign language translation methods suffer from inherent inference delays in real-time scenarios. |
| Approach: | They propose an adaptive policy for simultaneous sign language translation that progressively converts incrementally received sign video into its corresponding natural sentence. |
| Outcome: | The proposed policy excels in situations requiring extremely low latency. |
ReflectRM: Boosting Generative Reward Models via Self-Reflection within a Unified Judgment Framework (2026.acl-long)
Copied to clipboard
Kai Qin, Liangxin Liu, Yu Liang, Longzheng Wang, null Wangyan, Zhang Yueyang, Long Xia, Zhiyuan Sun, Houde Liu, Daiting Shi
| Challenge: | Existing methods for generating reward models focus on outcome-level supervision, neglecting analytical process quality, which constrains their potential. |
| Approach: | They propose a novel reward model that leverages self-reflection to assess analytical quality and enhance preference modeling. |
| Outcome: | The proposed model improves performance on four benchmarks and significantly mitigates positional bias. |
Design Challenges and Misconceptions in Neural Sequence Labeling (C18-1)
Copied to clipboard
| Challenge: | Existing neural sequence labeling models have been used for many tasks such as POS tagging, chunking and named entity recognition (NER). |
| Approach: | They propose to replicate twelve neural sequence labeling models and compare them to three benchmarks to find out which models are effective and which are inconsistent. |
| Outcome: | The proposed models are compared on NER, Chunking, and POS tagging benchmarks. |
EfficientLLM: Unified Pruning-Aware Pretraining for Auto-Designed Compact Language Models (2026.acl-long)
Copied to clipboard
Xingrun Xing, Zheng Liu, Shitao Xiao, Boyan Gao, Yiming Liang, Haokun Lin, Xianlin Zeng, Guoqi Li, Jiajun Zhang
| Challenge: | Large language models (LLMs) driven by scaling laws can be developed in large model sizes. |
| Approach: | They propose a pruning-aware pretraining approach that decouples LLM pruning from direct pretraining. |
| Outcome: | The proposed model outperforms pretraining models with 100M 1B parameters in commen sense benchmarks. |
Set Learning for Generative Information Extraction (2023.emnlp-main)
Copied to clipboard
| Challenge: | Recent efforts to employ sequence-to-sequence models to solve IE tasks have been focused on a single problem: structured objects are an unordered set, resulting in a potential order bias. |
| Approach: | They propose a sequence-to-sequence (Seq2Sequen) model that considers multiple permutations of structured objects to optimize set probability approximately. |
| Outcome: | The proposed model improves existing frameworks on vast tasks and datasets. |
SLIM: Let LLM Learn More and Forget Less with Soft LoRA and Identity Mixture (2025.naacl-long)
Copied to clipboard
| Challenge: | balancing the training budget, downstream performance, and general capabilities of large language models remains a challenge in many applications. |
| Approach: | They propose a mixture of expert framework based on Soft LoRA and Identity Mixture . SLIM allows dynamic routing between LoRA adapters and identity layers . |
| Outcome: | The proposed framework reduces training cost while maintaining general capabilities . it can be open-sourced upon publication. |
Sequential-NIAH: A Needle-In-A-Haystack Benchmark for Extracting Sequential Needles from Long Contexts (2025.emnlp-main)
Copied to clipboard
Yifei Yu, Qian-Wen Zhang, Lingfeng Qiao, Di Yin, Fang Li, Jie Wang, Chen Zeng Xi, Suncong Zheng, Xiaolong Liang, Xing Sun
| Challenge: | Recent models have extended Corresponding Author. context lengths to millions of tokens while maintaining reasoning and comprehension capabilities. |
| Approach: | They propose a benchmark to evaluate the ability of large language models to extract sequential information items from long contexts. |
| Outcome: | The proposed model achieves maximum accuracy of 63.50% on six well-known LLMs. |
Analogical Math Word Problems Solving with Enhanced Problem-Solution Association (2022.emnlp-main)
Copied to clipboard
| Challenge: | Analogical reasoning has long been used in mathematical education, as it enables students to apply common relational structures of mathematical situations to solve new problems. |
| Approach: | They propose to leverage analogical MWPs to advance the solver’s generalization ability across different kinds of MWps. |
| Outcome: | The proposed model has a stronger generalization ability in solving difficult MWPs due to the analogical learning from easy MWPS. |
SparseAdapter: An Easy Approach for Improving the Parameter-Efficiency of Adapters (2022.findings-emnlp)
Copied to clipboard
| Challenge: | Pretrain-finetuned models are increasingly complex and require more parameters to match the performance of full fine-tuning. |
| Approach: | They propose an efficient Adapter Tuning technique that freezes pretrained language models and fine-tunes a few extra modules. |
| Outcome: | The proposed setting outperforms the standard Adapter Tuning by 80% . the proposed setting is easy to use and has a high sparse ratio . |
On the Off-Target Problem of Zero-Shot Multilingual Neural Machine Translation (2023.findings-acl)
Copied to clipboard
| Challenge: | Despite its success, multilingual neural machine translation suffers from the off-target issue, where the translation is in the wrong language. |
| Approach: | They propose a language-aware vocabulary sharing algorithm that can be used to increase the lexical distance between languages by isolating the vocab of different languages in the decoder. |
| Outcome: | The proposed algorithm reduces off-target rate for 90 translation tasks from 29% to 8%, while improving overall BLEU score by an average of 1.9 points without extra training cost or sacrificing the supervised directions’ performance. |
MAS-Bench: A Unified Benchmark for Shortcut-Augmented Hybrid Mobile GUI Agents (2026.acl-long)
Copied to clipboard
Pengxiang Zhao, Guangyi Liu, Yaozhen Liang, Weiqing He, Zhengxi Lu, WenHao Wang, Yuehao Huang, Yuxiang Chai, Zhaolu Kang, Yaxuan Guo, Hao Wang, Kexin Zhang, Liang Liu, Yong Liu
| Challenge: | Shortcuts such as APIs and deep-links have emerged as efficient complements to flexible GUI operations, but systematic evaluation of GUI–shortcut hybrid agents remains underexplored. |
| Approach: | They propose a benchmark that evaluates GUI-shortcut hybrid agents with a specific focus on the mobile domain. |
| Outcome: | MAS-Bench evaluates agent's ability to generate shortcuts by discovering and creating reusable, low-cost workflows. |
Open-ended Commonsense Reasoning with Unrestricted Answer Candidates (2023.findings-emnlp)
Copied to clipboard
Chen Ling, Xuchao Zhang, Xujiang Zhao, Yanchi Liu, Wei Cheng, Mika Oishi, Takao Osaki, Katsushi Matsuda, Haifeng Chen, Liang Zhao
| Challenge: | Current approaches to commonsense reasoning are limited due to limited answer scope. |
| Approach: | They propose to solve a commonsense question without a pre-defined answer scope . they leverage pre-trained language models to iteratively retrieve reasoning paths on the external knowledge base . |
| Outcome: | The proposed method achieves better performance on two commonsense benchmark datasets. |
Learning Latent Relations for Temporal Knowledge Graph Reasoning (2023.acl-long)
Copied to clipboard
| Challenge: | Existing methods for Temporal Knowledge Graph reasoning capture intra- and inter-time latent relations between entities that appear at different times. |
| Approach: | They propose a Latent relations Learning method for TKG reasoning that captures latent relations between entities at different times. |
| Outcome: | The proposed method exploits the intra- and inter-time latent relations of entities at different times. |
PromptST: Abstract Prompt Learning for End-to-End Speech Translation (2023.emnlp-main)
Copied to clipboard
| Challenge: | Experimental results show that PromptST can improve speech-to-text translation by capturing richer linguistic knowledge. |
| Approach: | They propose a plug-in prompt-enhanced S2T model that captures richer linguistic knowledge . they use a 10GB linguistic probing benchmark to investigate the fusion of speech and text features . |
| Outcome: | The proposed model can improve on a strong baseline by capturing richer linguistic knowledge. |
Training Verifier to Assessing Complex Real-World Tool-Use Trajectories (2026.findings-acl)
Copied to clipboard
Linzhuang Sun, Mingyang Chen, Hao Liang, Tianpeng Li, Zhou Yijie, Chenzheng Zhu, Tianyu Guo, Huanyao Zhang, Jingxuan Wei, Bihui Yu, Fan Yang, Wentao Zhang
| Challenge: | Existing methods for training effective AI agents often resort to synthetic data generation. |
| Approach: | They propose a plug-and-play framework for data quality control in tool-use scenarios . they construct a tool-verify dataset and release a benchmark to assess its performance . |
| Outcome: | The proposed framework surpasses Qwen2.5-72B-Instruct on Tool-V-Bench and the previous APIGen-MT dataset. |
Movie101: A New Movie Understanding Benchmark (2023.acl-long)
Copied to clipboard
| Challenge: | Existing methods to narrate movies with no actors are difficult to implement in real situations . a new metric is proposed to provide the best correlation with human evaluation . |
| Approach: | They propose a large-scale Chinese movie benchmark to help visually impaired enjoy movies . they propose metric called Movie Narration Score (MNScore) which achieves best correlation with human evaluation. |
| Outcome: | The proposed method outperforms baselines and the existing methods. |
CFBench: A Comprehensive Constraints-Following Benchmark for LLMs (2025.acl-long)
Copied to clipboard
Tao Zhang, ChengLIn Zhu, Yanjun Shen, Wenjing Luo, Yan Zhang, Hao Liang, Tao Zhang, Fan Yang, Mingan Lin, Yujing Qiao, Weipeng Chen, Bin Cui, Wentao Zhang, Zenan Zhou
| Challenge: | Existing evaluations of Large Language Models (LLMs) focus on fragmented constraints or narrow scenarios, but they overlook the comprehensiveness and authenticity of constraints from the user’s perspective. |
| Approach: | They propose a Chinese Comprehensive Constraints Following Benchmark for LLMs that compiles constraints from real-world instructions and constructs a systematic framework for constraint types. |
| Outcome: | The proposed framework integrates multi-dimensional assessment criteria with requirement prioritization, covering various perspectives of constraints, instructions, and requirement fulfillment. |
Random Smooth-based Certified Defense against Text Adversarial Attack (2024.findings-eacl)
Copied to clipboard
| Challenge: | Textual adversarial examples train models on the worst-case text generated by substituting words in original texts with synonyms, but due to the discrete word embedding representations, the large search space hinders the robust training efficiency. |
| Approach: | They propose to treat the word substitution as a continuous perturbation on the word embedding representation and apply random smooth techniques to approximate the word replacement operation. |
| Outcome: | The proposed method outperforms conventional methods and improves the robustness in training. |
ReasonRec: A Reasoning-Augmented Multimodal Agent for Unified Recommendation (2026.findings-acl)
Copied to clipboard
Yihua Zhang, Mingfu Liang, Jiyan Yang, Rong Jin, Wen-Yen Chen, Yiping Han, Huayu Li, Buyun Zhang, Liang Luo, Luke Simon, Sijia Liu, Tianlong Chen, Xi Liu
| Challenge: | Recent advances in multimodal recommenders lack explicit reasoning and self-awareness of uncertainty. |
| Approach: | They propose a reasoning-augmented multimodal agent structured around a three-stage explicit reasoning pipeline. |
| Outcome: | The proposed agent improves ranking metrics and performance on four standard recommendation tasks across five real-world datasets. |
GRAG: Graph Retrieval-Augmented Generation (2025.findings-naacl)
Copied to clipboard
| Challenge: | Naive Retrieval-Augmented Generation (RAG) focuses on individual documents during retrieval and is not suitable for networked documents. |
| Approach: | They propose a novel divide-and-conquer strategy that retrieves optimal subgraph structure in linear time. |
| Outcome: | The proposed approach outperforms current state-of-the-art methods on graph reasoning benchmarks. |
JANUS: Joint Autoregressive and Non-autoregressive Training with Auxiliary Loss for Sequence Generation (2022.emnlp-main)
Copied to clipboard
| Challenge: | Existing approaches to train autoregressive and non-autoregressive models only consider relevance of model parameters, ignoring correlations between the two manners. |
| Approach: | They propose a joint autoregressive and non-autoregressive training method using aUxiliary losS to enhance the model performance in both AR and NAR manners simultaneously. |
| Outcome: | The proposed method improves the model performance in both AR and NAR manners and reduces the inference latency. |
PPTC Benchmark: Evaluating Large Language Models for PowerPoint Task Completion (2024.findings-acl)
Copied to clipboard
| Challenge: | Recent evaluations of Large Language Models (LLMs) focus on their zero-shot/few-shot capabilities for basic natural language tasks and their ability to translate instructions into tool APIs. |
| Approach: | They propose a PowerPoint Task Completion benchmark to assess LLMs’ ability to create and edit PPT files based on user instructions. |
| Outcome: | The proposed system outperforms open-source and closed LLMs with 75.1% accuracy in single-turn dialogue testing but only achieves 6% session accuracy. |
ConsistRM: Improving Generative Reward Models via Consistency-Aware Self-Training (2026.acl-long)
Copied to clipboard
Yu Liang, Liangxin Liu, Longzheng Wang, null Wangyan, Zhang Yueyang, Long Xia, Zhiyuan Sun, Daiting Shi
| Challenge: | ConsistRM is a self-training framework that enables effective and stable GRM training without human annotations. |
| Approach: | They propose a self-training framework that enables effective and stable GRM training without human annotations. |
| Outcome: | The proposed framework outperforms vanilla Reinforcement Fine-Tuning (RFT) by 1.5% on five benchmark datasets. |
FRVA: Fact-Retrieval and Verification Augmented Entailment Tree Generation for Explainable Question Answering (2024.findings-acl)
Copied to clipboard
| Challenge: | Existing methods for generating a entailment tree exhibit the reasoning chains from knowledge facts to predicted answers, but they have large fact search spaces and error accumulation problems resulting in the generation of invalid steps. |
| Approach: | They propose a Fact-Retrieval and Verification Augmented bidirectional entailment tree generation method that contains two systems. |
| Outcome: | The proposed method outperforms existing models and achieves state-of-the-art performance in fact selection and structural correctness. |
COIG-P: A High-Quality and Large-Scale Chinese Preference Dataset for Alignment with Human Values (2026.findings-eacl)
Copied to clipboard
Siwei Wu, JinCheng Ren, Xeron Du, Shuyue Guo, Xingwei Qu, Yiming Liang, Jie Liu, Yunwen Li, Tyler Loakman, Tianyu Zheng, Boyu Feng, Huaqing Yuan, Zili Wang, Jiaheng Liu, Wenhao Huang, Chenglin Cai, Haoran Que, Jian Yang, Yuelin Bai, Zekun Moore Wang, Zhouliang Yu, Qunshu Lin, Ding Pan, Yuchen Eleanor Jiang, Tiannan Wang, Wangchunshu Zhou, Shenzhi Wang, Xingyuan Bu, Minghao Liu, Guoyin Wang, Ge Zhang, Chenghua Lin
| Challenge: | Existing Chinese preference datasets suffer from limited scale, restricted domain coverage, and insufficiently rigorous data validation. |
| Approach: | They propose an LLM-based data annotation pipeline with no human intervention to annotate Chinese preference datasets. |
| Outcome: | The proposed pipeline outperforms existing Chinese preference datasets on AlignBench and Chinese Reward Benchmark. |
XGLUE: A New Benchmark Dataset for Cross-lingual Pre-training, Understanding and Generation (2020.emnlp-main)
Copied to clipboard
Yaobo Liang, Nan Duan, Yeyun Gong, Ning Wu, Fenfei Guo, Weizhen Qi, Ming Gong, Linjun Shou, Daxin Jiang, Guihong Cao, Xiaodong Fan, Ruofei Zhang, Rahul Agrawal, Edward Cui, Sining Wei, Taroon Bharti, Ying Qiao, Jiun-Hung Chen, Winnie Wu, Shuguang Liu, Fan Yang, Daniel Campos, Rangan Majumder, Ming Zhou
| Challenge: | XGLUE provides a benchmark dataset to train large-scale cross-lingual pre-trained models . XCLUE provides 11 diversified tasks that cover both understanding and generation scenarios . |
| Approach: | They introduce a new benchmark dataset to train large-scale cross-lingual pre-trained models using multilingual and bilingual corpora. |
| Outcome: | The proposed dataset is labeled in English and includes only natural language understanding tasks. |
Less, but Better: Efficient Multilingual Expansion for LLMs via Layer-wise Mixture-of-Experts (2025.acl-long)
Copied to clipboard
| Challenge: | Existing large language models (LLMs) have remarkable ability in high-resource languages, but their performance in multilingual scenarios is still limited. |
| Approach: | They propose a layer-wise expert allocation algorithm to determine the appropriate number of new experts for each layer. |
| Outcome: | The proposed method outperforms the previous state-of-the-art baseline with 60% fewer experts in the single-expansion setting and 33.3% fewer in the lifelong-expanding setting. |
Never Lost in the Middle: Mastering Long-Context Question Answering with Position-Agnostic Decompositional Training (2024.acl-long)
Copied to clipboard
Junqing He, Kunhao Pan, Xiaoqun Dong, Zhuoyang Song, LiuYiBo LiuYiBo, Qianguosun Qianguosun, Yuxin Liang, Hao Wang, Enming Zhang, Jiaxing Zhang
| Challenge: | Large language models suffer from severe hallucinations, compromising performance in knowledge-oriented QA, dialogue, and writing. |
| Approach: | They propose to enhance the information searching and reflection ability of large language models by training them in position-agnostic multi-step QA tasks to improve their model's accuracy. |
| Outcome: | The proposed model improves in multi-doc QA and other benchmarks by 13.7% absolute gain in shuffled settings, by 21.5% in passage retrieval task. |
Ground Every Sentence: Improving Retrieval-Augmented LLMs with Interleaved Reference-Claim Generation (2025.findings-naacl)
Copied to clipboard
| Challenge: | Existing methods to enhance credibility and verifiability of large language models (LLMs) mainly focus on passage-level or paragraph-level references or citations, which fall short in verifikatability. |
| Approach: | They propose a method that provides sentence-level citations in LLM-generated responses. |
| Outcome: | The proposed method achieves 90% accuracy in long-form question-answering tasks. |
Native Sparse Attention: Hardware-Aligned and Natively Trainable Sparse Attention (2025.acl-long)
Copied to clipboard
Jingyang Yuan, Huazuo Gao, Damai Dai, Junyu Luo, Liang Zhao, Zhengyan Zhang, Zhenda Xie, Yuxing Wei, Lean Wang, Zhiping Xiao, Yuqing Wang, Chong Ruan, Ming Zhang, Wenfeng Liang, Wangding Zeng
| Challenge: | Long-context modeling is crucial for next-generation language models, but high computational cost of standard attention mechanisms poses significant computational challenges. |
| Approach: | They propose a natively trained Sparse Attention mechanism that integrates algorithms with hardware-aligned optimizations to achieve efficient long-context modeling. |
| Outcome: | The proposed model maintains or exceeds Full Attention models across general benchmarks, long-context tasks, and instruction-based reasoning. |
MinT: Boosting Generalization in Mathematical Reasoning via Multi-view Fine-tuning (2024.lrec-main)
Copied to clipboard
| Challenge: | Existing methods focus on specializing LMs in mathematical reasoning and rely on knowledge distillation. |
| Approach: | They propose a multi-view fine-tuning method that exploits existing mathematical problem datasets with diverse annotation styles. |
| Outcome: | The proposed method outperforms existing methods that rely heavily on LLM teachers . it grants models generalization ability across views and datasets, and the capability to learn from inaccurate or incomplete data. |
Bridging the Gap between Training and Inference: Multi-Candidate Optimization for Diverse Neural Machine Translation (2022.findings-naacl)
Copied to clipboard
| Challenge: | Existing diverse NMT models lack translation diversity due to a discrepancy between training and inference . despite the success of diverse NTM, there is still a lack of translation diversity . |
| Approach: | They propose a multi-candidate optimization framework for diverse NMT to deal with this defect. |
| Outcome: | The proposed framework is transparent to basic diverse NMT models, and universally makes better trade-off between diversity and quality. |
FocalOrder: Focal Preference Optimization for Reading Order Detection (2026.acl-long)
Copied to clipboard
Fuyuan Liu, Dianyu Yu, He Ren, Nayu Liu, Xiaomian Kang, Delai Qiu, Fa Zhang, Genpeng Zhen, Shengping Liu, Liang Jiaen, null Weihuang, Yining Wang, Junnan Zhu
| Challenge: | Existing methods for document comprehension rely on uniform supervision, resulting in a performance degradation in the intermediate sections. |
| Approach: | They propose a framework driven by Focal Preference Optimization to detect reading order in document layouts. |
| Outcome: | The proposed framework outperforms competing baselines and surpasses large-scale general VLMs. |
OneGen: Efficient One-Pass Unified Generation and Retrieval for LLMs (2024.findings-emnlp)
Copied to clipboard
Jintian Zhang, Cheng Peng, Mengshu Sun, Xiang Chen, Lei Liang, Zhiqiang Zhang, Jun Zhou, Huajun Chen, Ningyu Zhang
| Challenge: | Recent advances in Large Language Models (LLMs) have significantly enhanced the generative capabilities for various NLP tasks, but they still suffer from hallucinations due to their exclusive reliance on parametric knowledge. |
| Approach: | They propose a framework that integrates retrieval tokens generated autoregressively into a single LLM to handle both tasks simultaneously in a unified forward pass. |
| Outcome: | The proposed framework bridges the traditionally separate training approaches for generation and retrieval by incorporating retrieval tokens generated autoregressively. |
PCA-Bench: Evaluating Multimodal Large Language Models in Perception-Cognition-Action Chain (2024.findings-acl)
Copied to clipboard
Liang Chen, Yichi Zhang, Shuhuai Ren, Haozhe Zhao, Zefan Cai, Yuchi Wang, Peiyi Wang, Xiangdi Meng, Tianyu Liu, Baobao Chang
| Challenge: | a new multimodal decision-making benchmark evaluates the integrated capabilities of multimodal large language models. |
| Approach: | They propose a multimodal decision-making benchmark for evaluating MLLMs . they propose an automatic evaluation protocol to assess 10 prevalent ML models . |
| Outcome: | The proposed benchmark improves performance of multimodal large language models in three scenarios . the model is required to integrate multiple capabilities to make accurate decisions . |
HyperNetwork-based Decoupling to Improve Model Generalization for Few-Shot Relation Extraction (2023.emnlp-main)
Copied to clipboard
| Challenge: | Existing studies cannot generalize well to unseen relations using Prototypical Networks . current approaches are dependent on large amount of labeled data and cannot deal with unseense relations well. |
| Approach: | They propose a HyperNetwork-based Decoupling approach to improve FSRE generalization . they propose FSre models with an encoder, network generator and refined classifiers . |
| Outcome: | The proposed method improves the generalization of few-shot relation extraction models. |
VLM2-Bench: A Closer Look at How Well VLMs Implicitly Link Explicit Matching Visual Cues (2025.acl-long)
Copied to clipboard
| Challenge: | Existing vision-language models lack the ability to visually link matching visual cues across images or frames. |
| Approach: | They propose a benchmark to assess whether vision-language models can Visually Link Matching cues with 9 subtasks and over 3,000 test cases. |
| Outcome: | The proposed benchmarks on multiple images and videos do not demonstrate that vision-language models can link visual cues across images or frames. |
Revisit Few-shot Intent Classification with PLMs: Direct Fine-tuning vs. Continual Pre-training (2023.findings-acl)
Copied to clipboard
| Challenge: | Recent progress in intent detection relies on deep models and datasets with well-crafted annotations. |
| Approach: | They propose a continual pre-training approach to train deep learning models . they propose augmentation method and sequential self-distillation to boost performance . |
| Outcome: | The proposed method outperforms methods that employ continual pre-training on labeled datasets on few-shot intent detection tasks. |
3AM: An Ambiguity-Aware Multi-Modal Machine Translation Dataset (2024.lrec-main)
Copied to clipboard
Xinyu Ma, Xuebo Liu, Derek F. Wong, Jun Rao, Bei Li, Liang Ding, Lidia S. Chao, Dacheng Tao, Min Zhang
| Challenge: | Existing studies have shown that visual information in existing MMT datasets is insufficient, causing models to disregard it and overestimate their capabilities. |
| Approach: | They propose to use 3AM to create an ambiguity-aware multimodal machine translation dataset. |
| Outcome: | The proposed dataset includes more ambiguity and a greater variety of captions and images than other MMT datasets. |
Uncertainty Quantification for In-Context Learning of Large Language Models (2024.naacl-long)
Copied to clipboard
Chen Ling, Xujiang Zhao, Xuchao Zhang, Wei Cheng, Yanchi Liu, Yiyou Sun, Mika Oishi, Takao Osaki, Katsushi Matsuda, Jie Ji, Guangji Bai, Liang Zhao, Haifeng Chen
| Challenge: | Existing studies on in-context learning have focused on quantifying the uncertainty associated with the model's response, but they neglect the complexity of the LLM and the uniqueness of in-constitut learning. |
| Approach: | They propose a method to quantify the uncertainty associated with in-context learning and propose corresponding estimation method to quantify both types of uncertainties. |
| Outcome: | The proposed method offers an unsupervised way to understand the prediction of in-context learning in a plug-and-play fashion. |
Enhancing Opinion Role Labeling with Semantic-Aware Word Representations from Semantic Role Labeling (N19-1)
Copied to clipboard
| Challenge: | Existing work on opinion role labeling (ORL) is highly correlative with semantic role labeled (SRL) SRL is used to identify opinion holders and holder expressions for a given predicate. |
| Approach: | They propose a method to enhance opinion role labeling by presenting semantic-aware word representations which are learned from SRL. |
| Outcome: | The proposed method outperforms two other methods on a benchmark MPQA corpus and achieves higher F scores. |
Grammar-Based Code Representation: Is It a Worthy Pursuit for LLMs? (2025.findings-acl)
Copied to clipboard
Qingyuan Liang, Zhao Zhang, Zeyu Sun, Zheng Lin, Qi Luo, Xiao Yueyi, Yizhou Chen, Yuqun Zhang, Haotian Zhang, Lu Zhang, Chenbin Chenbin, Yingfei Xiong
| Challenge: | Existing research demonstrates the effectiveness of grammar-based code representations in small-scale models, showing their ability to reduce syntax errors and enhance performance. |
| Approach: | They develop a series of billion-scale grammar-based code representations that incorporate grammar rules into the code generation process. |
| Outcome: | Experiments on HumanEval and MBPP show that grammar-based representations reduce syntax errors and improve performance even in billion-scale models. |
Dissecting Logical Reasoning in LLMs: A Fine-Grained Evaluation and Supervision Study (2025.findings-emnlp)
Copied to clipboard
Yujun Zhou, Jiayi Ye, Zipeng Ling, Yufei Han, Yue Huang, Haomin Zhuang, Zhenwen Liang, Kehan Guo, Taicheng Guo, Xiangqi Wang, Xiangliang Zhang
| Challenge: | Existing benchmarks that rely on final-answer accuracy fail to capture the quality of the reasoning process. |
| Approach: | They propose a fine-grained evaluation framework that assesses logical reasoning across three dimensions: overall accuracy, stepwise soundness, and representation-level probing. |
| Outcome: | The proposed framework assesses logical reasoning across three dimensions: overall accuracy, stepwise soundness, and representation-level probing. |
ACE-M3: Automatic Capability Evaluator for Multimodal Medical Models (2025.coling-main)
Copied to clipboard
| Challenge: | Existing metrics for multimodal large language models only focus on token overlap and may not align with human judgment. |
| Approach: | They propose an open-source model that assesses the question answering abilities of multimodal large language models. |
| Outcome: | Experiments show that the ACE-M3 model performs better than existing models and is more reliable than existing metrics. |
Dynamic Heterogeneous-Graph Reasoning with Language Models and Knowledge Representation Learning for Commonsense Question Answering (2023.acl-long)
Copied to clipboard
| Challenge: | Existing methods for QA use knowledge graphs, but they ignore subgraph optimization and subgraph deepening. |
| Approach: | They propose a dynamic heterogeneous-graph reasoning method with LMs and knowledge representation learning that optimizes the structure and knowledge representing of the HKG using a two-stage pruning strategy and knowledge-representation learning. |
| Outcome: | The proposed method improves on existing methods at CommonsenseQA and OpenBookQA. |
Speech Sense Disambiguation: Tackling Homophone Ambiguity in End-to-End Speech Translation (2024.acl-long)
Copied to clipboard
| Challenge: | End-to-end speech translation (ST) models require simultaneous crossmodal and crosslingual transformations to be effective. |
| Approach: | They propose a homophone-aware contrastive learning approach that integrates a speech-text masking strategy to reduce ambiguity. |
| Outcome: | The proposed approach achieves SOTA results on BLEU scores on different MuST-C and CoVoST ST tasks, underlining its effectiveness in reducing speech sense ambiguity. |
A Survey of Multimodal Mathematical Reasoning: From Perception, Alignment to Reasoning (2026.acl-long)
Copied to clipboard
Tianyu Yang, Sihong Wu, Yilun Zhao, Zhenwen Liang, Lisen Dai, Chen Zhao, Minhao Cheng, Arman Cohan, Xiangliang Zhang
| Challenge: | Multimodal mathematical Reasoning (MMR) has attracted increasing attention for its ability to solve mathematical problems involving both textual and visual modalities. |
| Approach: | They review the theoretical frameworks of multimodal reasoning and examine the challenges they face in visual math tasks. |
| Outcome: | The proposed models can solve problems involving both textual and visual modalities. |
SciMMIR: Benchmarking Scientific Multi-modal Information Retrieval (2024.findings-acl)
Copied to clipboard
Siwei Wu, Yizhi Li, Kang Zhu, Ge Zhang, Yiming Liang, Kaijing Ma, Chenghao Xiao, Haoran Zhang, Bohao Yang, Wenhu Chen, Wenhao Huang, Noura Al Moubayed, Jie Fu, Chenghua Lin
| Challenge: | Multi-modal information retrieval (MMIR) is a rapidly evolving field . current benchmarks for image-text pairings overlook the scientific domain . |
| Approach: | They develop a scientific domain-specific MMIR benchmark to evaluate image-text pairings using open-access research paper corpora. |
| Outcome: | The proposed benchmarks are based on 530K image-text pairs extracted from scientific documents with detailed captions. |
MoEBERT: from BERT to Mixture-of-Experts via Importance-Guided Adaptation (2022.naacl-main)
Copied to clipboard
| Challenge: | Existing methods for training pre-trained language models have limited practicality due to latency requirements. |
| Approach: | They propose a method that uses a Mixture-of-Experts structure to increase model capacity and inference speed. |
| Outcome: | The proposed method outperforms existing distillation methods on natural language understanding and question answering tasks. |
Adaptive Schema-aware Event Extraction with Retrieval-Augmented Generation (2025.findings-emnlp)
Copied to clipboard
| Challenge: | Event extraction is a task in natural language processing that involves identifying and extracting event information from unstructured text. |
| Approach: | They propose a paradigm that combines schema paraphrasing with schema retrieval-augmented generation. |
| Outcome: | The proposed paradigm retrieves paraphrased schemas and accurately generates targeted structures. |
Probing Graph Decomposition for Argument Pair Extraction (2023.findings-acl)
Copied to clipboard
| Challenge: | Argument pair extraction (APE) aims to extract interactive argument pairs from two passages within a discussion. |
| Approach: | They propose a method to extract interactive argument pairs from two passages . they propose to decompose the probing graph into four sub-graphs based on inter- and intra-passage perspectives . |
| Outcome: | The proposed method improves on strong baselines on two benchmark datasets. |
Unleashing the Power of Imbalanced Modality Information for Multi-modal Knowledge Graph Completion (2024.lrec-main)
Copied to clipboard
| Challenge: | Existing MMKGC methods overlook the imbalance problem of modality information among entities, resulting in inadequate modal fusion and inefficient utilization of the raw modality. |
| Approach: | They propose to integrate structural, visual, and textual information of entities into the discriminant models to predict the missing triples. |
| Outcome: | The proposed model outperforms 19 recent methods and achieves state-of-the-art results on three public MMKGC benchmarks. |
Self-Training with Differentiable Teacher (2022.findings-naacl)
Copied to clipboard
| Challenge: | Existing methods for self-training are interpreted as teacher-student frameworks, where the teacher generates pseudo-labels and the student makes predictions. |
| Approach: | They propose a differentiable self-training method that treats teacher-student as a Stackelberg game where a leader is always in a more advantageous position than a follower. |
| Outcome: | The proposed model outperforms existing methods on semi- and weakly-supervised learning tasks on semi and weak supervised tasks. |
SCOPE: Preserving Modality-Specific Cues to Mitigate Modality Laziness in Multimodal Learning (2026.findings-acl)
Copied to clipboard
| Challenge: | Existing approaches to learning multimodal representations emphasize shared semantics and overlook modality-specific cues. |
| Approach: | They propose a framework for learning complete multimodal representations using shared and practical cues. |
| Outcome: | SCOPE outperforms SOTA benchmarks on four datasets and achieves 27.10% accuracy improvement. |
A Data-Centric Framework for Composable NLP Workflows (2020.emnlp-demos)
Copied to clipboard
Zhengzhong Liu, Guanxiong Ding, Avinash Bukkittu, Mansi Gupta, Pengzhi Gao, Atif Ahmed, Shikun Zhang, Xin Gao, Swapnil Singhavi, Linwei Li, Wei Wei, Zecong Hu, Haoran Shi, Xiaodan Liang, Teruko Mitamura, Eric Xing, Zhiting Hu
| Challenge: | Empirical natural language processing (NLP) systems involve interoperation among multiple components . a wealth of NLP toolkits exist ( 4), such as spaCy, DKPro, CoreNLP. |
| Approach: | They propose a unified open-source framework that supports fast development of NLP workflows . framework includes processors for NLP tasks, visualization, and annotation . |
| Outcome: | The framework offers processors for NLP tasks, visualization, and annotation, and is extensible . it is delivered through two modularized yet integratable open-source projects, Forte and Stave . |
PibE-MPP: A Play-it-by-Ear Masking Performance Plug-in for LLMs (2026.findings-acl)
Copied to clipboard
Mengwei Wang, Simin Niu, Xun Liang, Yuefeng Ma, Sensen Zhang, Jiawei Yang, Shichao Song, Hanyu Wang, Huayi Lai
| Challenge: | Random masking is a widely adopted classic baseline in large language models (LLMs). |
| Approach: | They propose a play-it-by-ear masking performance plug-in which enables LLMs to adaptively select masking target combinations for each task. |
| Outcome: | The proposed performance plug-in retains the advantages and mitigates the drawbacks of random masking in large language models. |
One2Set + Large Language Model: Best Partners for Keyphrase Generation (2024.emnlp-main)
Copied to clipboard
| Challenge: | Existing selection methods make redundant selections, causing poor recall and accuracy. |
| Approach: | They propose a framework to generate keyphrases from a one2set-based model and an LLM as selector. |
| Outcome: | The proposed framework surpasses state-of-the-art models in absent keyphrase prediction. |
Speeding Up Neural Machine Translation Decoding by Cube Pruning (D18-1)
Copied to clipboard
| Challenge: | Neural machine translation suffers from slow translation speed due to the large search space . a trade-off has to be made between translation quality and speed, argues a new study . |
| Approach: | They apply cube pruning technique to speed up dynamic programming into neural machine translation to speed it up. |
| Outcome: | The proposed method can translate faster on GPUs and CPUs with better translation quality than naive beam search. |
Interpreting Positional Information in Perspective of Word Order (2023.acl-long)
Copied to clipboard
| Challenge: | Attention mechanism is a powerful and effective method utilized in natural language processing, but it is insensitive to positional information. |
| Approach: | They propose a weight concatenation operation to evaluate its efficacy in machine translation tasks. |
| Outcome: | The proposed operation can encode positional information and confirms our hypothesis. |
Born a BabyNet with Hierarchical Parental Supervision for End-to-End Text Image Machine Translation (2024.lrec-main)
Copied to clipboard
| Challenge: | Existing research on text image machine translation (TIMT) is divided into two types: Cascade methods combine text image recognition and MT models to recognize source language text images. |
| Approach: | They propose a method which is optimized with hierarchical parental supervision to improve translation performance. |
| Outcome: | The proposed method significantly outperforms existing methods on synthetic and real-world tests on both synthetic and realistic images. |
Commonality and Individuality! Integrating Humor Commonality with Speaker Individuality for Humor Recognition (2025.naacl-long)
Copied to clipboard
| Challenge: | Current methods for humor recognition focus on one aspect of humor commonalities, ignoring the multifaceted nature of humor. |
| Approach: | They propose a commonality and individuality incorporated network for humor recognition that integrates multifaceted humor commonalities with speaker individuality. |
| Outcome: | The proposed model integrates multifaceted humor commonalities with speaker individuality to deepen the understanding of humor expressions. |
Stealthy Attack on Large Language Model based Recommendation (2024.acl-long)
Copied to clipboard
| Challenge: | Recent advances in recommender systems have been overlooked due to their emphasis on textual content. |
| Approach: | They propose to introduce large language models into recommendation models to exploit the semantic understanding and strong transferability of LLMs. |
| Outcome: | The proposed approach significantly boosts an item’s exposure by altering its textual content during the testing phase, without requiring direct interference with the model’s training process. |
Improving MLLM’s Document Image Machine Translation via Synchronously Self-reviewing Its OCR Proficiency (2025.findings-acl)
Copied to clipboard
| Challenge: | Multimodal Large Language Models (MLLMs) have shown strong performance in document image tasks, especially Optical Character Recognition (OCR). However, they struggle with Document Image Machine Translation (DIMT), which requires handling both cross-modal and cross-lingual challenges. |
| Approach: | They propose a novel fine-tuning paradigm that allows the model to generate OCR text before producing translation text, which allows it to leverage its strong monolingual OCR ability while learning to translate text across languages. |
| Outcome: | The proposed model can leverage its strong monolingual OCR ability while learning to translate text across languages. |
SynthAgent: Adapting Web Agents with Synthetic Supervision (2026.acl-long)
Copied to clipboard
Zhaoyang Wang, Yiming Liang, Xuchao Zhang, Qianhui Wu, Siwei Han, Anson Bastos, Rujia Wang, Chetan Bansal, Baolin Peng, Jianfeng Gao, Saravan Rajmohan, Huaxiu Yao
| Challenge: | Existing studies have focused on synthetic supervision but have encountered data quality issues. |
| Approach: | They propose a fully synthetic supervision framework that aims at improving data quality via dual refinement of both tasks and trajectories. |
| Outcome: | The proposed framework outperforms existing methods on standardized benchmarks and shows promising results on a standardized test. |
Towards Effective Automatic Debt Collection with Persona Awareness (2023.emnlp-industry)
Copied to clipboard
| Challenge: | Existing debt collection agents fail to tailor strategies to debtor personas, leading to ineffective collection. |
| Approach: | They present a commercial practice on debt collection agents that organizes debtor personas into a taxonomy and constructs a persona-aware conversation dataset. |
| Outcome: | The proposed agent increases recovery rate by 3.31% and collects additional 100K RMB after two months of testing. |
M3HG: Multimodal, Multi-scale, and Multi-type Node Heterogeneous Graph for Emotion Cause Triplet Extraction in Conversations (2025.findings-acl)
Copied to clipboard
| Challenge: | Existing methods for ECAC focus on textual contexts, overlooking other modalities. |
| Approach: | They propose a multimodal, multi-scenario MECTEC dataset that captures emotional and causal contexts and effectively fuses contextual information at different levels. |
| Outcome: | The proposed model captures emotional and causal contexts and effectively fuses contextual information at both inter- and intra-utterance levels. |
Tool learning via Inference-time Scaling and Cycle Verifier (2025.findings-acl)
Copied to clipboard
| Challenge: | In inference-time scaling, Chain-of-Thought (CoT) data is scarce or even unavailable. |
| Approach: | They propose a method which establishes an inference cycle to synthesize user queries and CoT data. |
| Outcome: | The proposed method achieves a 75.4% pass rate and a 79.6% win rate using small models in StableToolBench. |
How Is LLM Reasoning Distracted by Irrelevant Context? An Analysis Using a Controlled Benchmark (2025.emnlp-main)
Copied to clipboard
| Challenge: | Prior work has not explored the mechanisms underlying this sensitivity. |
| Approach: | They propose a synthetic benchmark to evaluate Large Language Models’ reasoning robustness against systematically controlled irrelevant context (IC). |
| Outcome: | The proposed model improves in-distribution and out-of-disttribution scenarios while training with strong distractors. |
QAEncoder: Towards Aligned Representation Learning in Question Answering Systems (2025.acl-long)
Copied to clipboard
Zhengren Wang, Qinhan Yu, Shida Wei, Zhiyu Li, Feiyu Xiong, Xiaoxing Wang, Simin Niu, Hao Liang, Wentao Zhang
| Challenge: | Modern QA systems entail retrieval-augmented generation (RAG) for accurate and trustworthy responses, but the inherent gap between user queries and relevant documents hinders precise matching. |
| Approach: | They propose a retrieval-augmented generation (RAG)-based approach to bridge this gap by attaching document fingerprints to the embedding to estimate the expectation of potential queries. |
| Outcome: | Experiments across diverse datasets, languages, and embedding models confirm the proposed solution is simple-yet-effective with zero additional index storage, retrieval latency, training costs, or catastrophic forgetting and hallucination issues. |
An Iterative Multi-Knowledge Transfer Network for Aspect-Based Sentiment Analysis (2021.findings-emnlp)
Copied to clipboard
| Challenge: | Existing approaches to Aspect-based sentiment analysis do not exploit the interactive relations among subtasks and do not utilize document-level labeled domain/sentiment knowledge, which restricts their performance. |
| Approach: | They propose an iterative multi-knowledge transfer network for end-to-end ABSA that leverages the inter-task interaction between subtasks. |
| Outcome: | The proposed approach improves on three benchmark datasets. |
A Survey of Inductive Reasoning for Large Language Models (2026.acl-long)
Copied to clipboard
Kedi Chen, Dezhao Ruan, Yuhao Dan, Yaoting Wang, Siyu Yan, Xuecheng Wu, Yinqi Zhang, Qin Chen, Jie Zhou, Liang He, Biqing Qi, Linyang Li, Qipeng Guo, Xiaoming Shi, Wei Zhang
| Challenge: | Inductive reasoning is an important task for large language models (LLMs). |
| Approach: | They propose a survey of inductive reasoning for large language models . they categorize methods into three main areas: post-training enhancement, test-time exploration, and data augmentation. |
| Outcome: | The proposed method improves inductive reasoning in large language models. |
Efficient Data Labeling by Hierarchical Crowdsourcing with Large Language Models (2025.coling-main)
Copied to clipboard
| Challenge: | Large language models (LLMs) have been gaining attention for their impressive performance in in-context dialogues. |
| Approach: | They propose a hierarchical framework that leverages multiple LLMs for efficient data labeling under budget constraints. |
| Outcome: | The proposed framework outperforms human labelers and GPT-4 in terms of accuracy and efficiency. |
Unlocking Recursive Thinking of LLMs: Alignment via Refinement (2025.findings-acl)
Copied to clipboard
| Challenge: | Existing methods for recursive reasoning are limited due to lack of expert-curated data. |
| Approach: | They propose a method that unlocks the potential of Large Language Models for recursive reasoning through long-form Chain of Thought. |
| Outcome: | The proposed method outperforms preference optimization methods on the openAI o1-series models by 20% on 3k synthetic samples. |
MMRA: A Benchmark for Evaluating Multi-Granularity and Multi-Image Relational Association Capabilities in Large Visual Language Models (2026.findings-eacl)
Copied to clipboard
Siwei Wu, King Zhu, Yu Bai, Yiming Liang, Yizhi Li, Haoning Wu, Jiaheng Liu, Ruibo Liu, Xingwei Qu, Xuxin Cheng, Ge Zhang, Wenhao Huang, Chenghua Lin
| Challenge: | Current multimodal benchmarks focus on facts within individual images, but neglect associative relations among multiple images. |
| Approach: | They propose a multi-image relational association task and a MMRA benchmark to evaluate LVLMs. |
| Outcome: | The proposed benchmarks show that entity-level multi-image perception tasks pose greater challenges than image-level tasks. |
Debatrix: Multi-dimensional Debate Judge with Iterative Chronological Analysis Based on LLM (2024.findings-acl)
Copied to clipboard
| Challenge: | Recent studies have focused on short dialogues, but mainly on short debates. |
| Approach: | They propose to use Large Language Models to construct an automated debate judge to evaluate multi-turn debates. |
| Outcome: | The proposed system improves on the PanelBench benchmark, which compares its performance to actual debate outcomes. |
Source Critical Reinforcement Learning for Transferring Spoken Language Understanding to a New Language (C18-1)
Copied to clipboard
| Challenge: | a study aims to develop a language transferring system to avoid the trouble of acquiring and labeling a new big SLU corpus . general-purpose translators cannot handle the lot of semantic labels, not to mention cultural differences . a RL-based language transfer method can be used to adapt the adapted translator to a target language . |
| Approach: | They propose to use reinforcement learning to adapt a spoken language understanding model to a target language. |
| Outcome: | The proposed language transferring method improves domain classification accuracy by 22% compared with naive translation . the proposed language transfer method can be used on Chinese to English translators with more proper slot tags . |
CoreEval: Automatically Building Contamination-Resilient Datasets with Real-World Knowledge toward Reliable LLM Evaluation (2025.acl-long)
Copied to clipboard
| Challenge: | Publicly available datasets can be used to evaluate performance of large language models . however, contamination of test data can artificially inflate model performance . |
| Approach: | They propose a Contamination-resilient Evaluation strategy that updates data with real-world knowledge. |
| Outcome: | The proposed evaluation strategy can be used to update datasets with real-world knowledge. |
Croppable Knowledge Graph Embedding (2025.acl-long)
Copied to clipboard
| Challenge: | Knowledge Graph Embedding (KGE) is a common approach for Knowledge Grasse (KGs) in AI tasks. |
| Approach: | They propose a new KGE training framework MED that allows one training to obtain a croppable KGE model for multiple scenarios with different dimensional needs. |
| Outcome: | The proposed framework improves low-dimensional sub-models and makes high-dimensional models retain the low-dimension sub-modells’ capacity. |
InstructEd: Soft-Instruction Tuning for Model Editing with Hops (2024.findings-acl)
Copied to clipboard
| Challenge: | Existing methods for model editing are limited due to excessive memorization and knowledge conflict issues. |
| Approach: | They propose to insert soft instructions into the attention module to facilitate interactions between instructions and questions and to understand and utilize new facts. |
| Outcome: | The proposed method achieves 10% improvement in one-hop (multi-hop) model editing on three datasets with LLaMAs and GPT2 . |
Modeling Intra- and Inter-Modal Relations: Hierarchical Graph Contrastive Learning for Multimodal Sentiment Analysis (2022.coling-1)
Copied to clipboard
| Challenge: | Existing studies in Multimodal Sentiment Analysis lack a mechanism to understand complex relations between different modalities. |
| Approach: | They propose a hierarchical graph contrastive learning framework for multimodal sentiment analysis that explores the relationships between modality representations. |
| Outcome: | The proposed framework outperforms the state-of-the-art in multimodal sentiment analysis on two benchmark datasets. |
Take Its Essence, Discard Its Dross! Debiasing for Toxic Language Detection via Counterfactual Causal Effect (2024.lrec-main)
Copied to clipboard
| Challenge: | Existing methods to mitigate lexical bias in toxic language detection (TLD) do not exploit the “useful” and “misleading” impact of the bias. |
| Approach: | They propose a counterfactual Causal Debiasing Framework to mitigate lexical bias in toxic language detection (TLD) it preserves the “useful impact” of lexical bias and eliminates the "misleading impact" they propose to use the same framework to analyze the causal effect of a sentence and bias tokens . |
| Outcome: | The proposed framework preserves the “useful impact” of lexical bias and eliminates the ‘misleading impact’ Empirical evaluations show that the proposed model outperforms current debiased models for out-of-distribution data. |
Runaway is Ashamed, But Helpful: On the Early-Exit Behavior of Large Language Model-based Agents in Embodied Environments (2025.findings-emnlp)
Copied to clipboard
| Challenge: | Experiments with 4 different LLMs across 5 embodied environments show significant efficiency improvements, with only minor drops in agent performance. |
| Approach: | They propose an intrinsic method that injects exit instructions during generation and an extransic system that verifies task completion to determine when to halt an agent’s trial. |
| Outcome: | The proposed method injects exit instructions during generation and an exit method verifies task completion to determine when to halt an agent’s trial. |
Jiuge: A Human-Machine Collaborative Chinese Classical Poetry Generation System (P19-3)
Copied to clipboard
Guo Zhipeng, Xiaoyuan Yi, Maosong Sun, Wenhao Li, Cheng Yang, Jiannan Liang, Huimin Chen, Yuhui Zhang, Ruoyu Li
| Challenge: | Existing systems for automatic poetry generation are model-oriented, resulting in poor user participation. |
| Approach: | They propose a human-machine collaborative Chinese classical poetry generation system called Jiuge . Jiuge allows users to revise unsatisfied parts of a generated poem draft repeatedly . |
| Outcome: | The proposed system allows users to revise unsatisfied parts of a generated poem draft repeatedly. |
Evaluating Verifiability in Generative Search Engines (2023.findings-emnlp)
Copied to clipboard
| Challenge: | Existing generative search engines are rapidly gaining users, according to a new study . existing systems are poorly cited and lack reliability, a study finds . |
| Approach: | They conduct human evaluations of four popular generative search engines . they find that existing generative engines are fluent and appear informative . |
| Outcome: | The results show that existing generative search engines are not reliable and often contain unsupported statements and inaccurate citations. |
Light Up the Shadows: Enhance Long-Tailed Entity Grounding with Concept-Guided Vision-Language Models (2024.findings-acl)
Copied to clipboard
| Challenge: | Multi-Modal Knowledge Graphs (MMKGs) are knowledge graphs that integrate and align information from diverse modalities (e.g., text and images). |
| Approach: | They propose a framework that integrates image-text pairs of long-tailed entities and a concept guidance module that offers explainability and enables human verification. |
| Outcome: | The proposed framework improves the accuracy of recognizing long-tailed image-text pairs compared to baselines and also offers flexibility and explainability. |
UrbanGeoEval: A City-Scale Benchmark for Evaluating Large Language Models in Geospatial Reasoning (2026.acl-long)
Copied to clipboard
| Challenge: | Extensive experiments on 18 widely used LLMs uncover critical insights: (1) models exhibit severe geographic biases and resolution gaps; (2) failures in complex multi-hop tasks stem from brittle foundational spatial skills rather than high-level logic deficits. |
| Approach: | They propose a dual-module framework that disentangles factual recall and spatial logic from the model's real capabilities in urban environments. |
| Outcome: | Extensive tests on 18 widely used LLMs reveal that models exhibit severe geographic biases and resolution gaps, and failures in complex multi-hop tasks often stem from brittle foundational spatial skills rather than high-level logic deficits. |
Understanding Translationese in Cross-Lingual Summarization (2023.findings-emnlp)
Copied to clipboard
| Challenge: | Existing datasets involve translation, but translationese is distinguished from original text . previous studies have shown that translationeses in CLS are not a problem in training sets . |
| Approach: | They propose to use cross-lingual summarization to generate a concise summary in a target language from a document in . existing datasets typically involve translation in their creation, but the translated text is distinguished from the original written in that language. |
| Outcome: | The proposed method systematically investigates how translationese affects CLS model evaluation and performance when it appears in source documents or target summaries. |
MM-Verify: Enhancing Multimodal Reasoning with Chain-of-Thought Verification (2025.acl-long)
Copied to clipboard
| Challenge: | MM-Verifier and MM Reasoner are a powerful multimodal reasoning model . large language models (LLMs) have demonstrated exceptional performance across tasks spanning myriad domains. |
| Approach: | They propose a method which combines tree search and verification to generate high-quality chain-of-thought data. |
| Outcome: | The proposed method outperforms all larger models on the MathCheck, MathVista, and MathVerse benchmarks. |
HCRE: LLM-based Hierarchical Classification for Cross-Document Relation Extraction with a Prediction-then-Verification Strategy (2026.findings-acl)
Copied to clipboard
| Challenge: | Existing approaches to cross-document relation extraction (RE) focus on identifying relations between head and tail entities from single sentence or document. |
| Approach: | They propose a hierarchical relation tree-based LLM-based hierarchic classification model for cross-document relation extraction (HCRE) based on predefined relations, the model can perform hierarchically classification level by level. |
| Outcome: | The proposed model outperforms existing baselines and validates its effectiveness. |
Conditional Memory via Scalable Lookup: A New Axis of Sparsity for Large Language Models (2026.acl-long)
Copied to clipboard
Xin Cheng, Wangding Zeng, Damai Dai, Qinyu Chen, Bingxuan Wang, Zhenda Xie, Kezhao Huang, Xingkai Yu, Zhewen Hao, Han Zhang, Yu-Kun Li, Huishuai Zhang, Dongyan Zhao, Wenfeng Liang
| Challenge: | Mixture-of-Experts (MoE) scales capacity via conditional computation, but lacks knowledge lookup primitive. |
| Approach: | They propose a conditional memory instantiated via Deep Sparse Embedding (DSE) they propose 'u-shaped scaling law' that identifies optimal balance between MoE experts and DSE memory . |
| Outcome: | The proposed model outperforms an iso-parameter and isoFLOPs MoE baseline across knowledge and reasoning benchmarks and is infrastructure-efficient. |
MLAlgo-Bench: Can Machines Implement Machine Learning Algorithms? (2025.findings-emnlp)
Copied to clipboard
| Challenge: | Currently, the top-performing models achieve a 48.8% task completion rate on realizing machine learning algorithms . |
| Approach: | They propose a benchmark to test machine learning's ability to generate ML code for humans . they propose an automatic evaluation framework with metrics such as task pass rate and time overhead . |
| Outcome: | The proposed benchmark is unique in its focus on interpreting complex human instructions and producing multi-step, high-complexity code. |
From Chaotic OCR Words to Coherent Document: A Fine-to-Coarse Zoom-Out Network for Complex-Layout Document Image Translation (2025.coling-main)
Copied to clipboard
| Challenge: | Document Image Translation (DIT) aims to translate documents in images from one language to another. |
| Approach: | They propose a novel end-to-end network called Zoom-out DIT to improve document translation by combining word positioning, sentence recognition and document organization. |
| Outcome: | The proposed network improves word positioning, sentence recognition and document organization, and improves translation quality. |
A Self-Denoising Model for Robust Few-Shot Relation Extraction (2025.acl-long)
Copied to clipboard
| Challenge: | Existing studies assume that the support set contains only accurately labeled instances, but this assumption is often unrealistic. |
| Approach: | They propose a self-denoising model for FSRE which can automatically correct noisy labels of support instances. |
| Outcome: | The proposed model outperforms all baselines on two public datasets showing that it can correct mislabeled support instances. |
Learn Beyond The Answer: Training Language Models with Reflection for Mathematical Reasoning (2024.emnlp-main)
Copied to clipboard
| Challenge: | Existing studies focus on *broadening* the training set with data augmentation techniques to maximize such benefits. |
| Approach: | They propose a method that embeds problem reflection into each training instance. |
| Outcome: | The proposed method enhances performance in standard and complex scenarios that require reflective thinking. |
SaSR-Net: Source-Aware Semantic Representation Network for Enhancing Audio-Visual Question Answering (2024.findings-emnlp)
Copied to clipboard
| Challenge: | Existing AVQA methods often fail to link sound-producing objects in the video with the audio-visual information. |
| Approach: | They introduce a source-aware semantic representation network for AVQA . they use source-wise learnable tokens to capture and align audio-visual elements with the question . |
| Outcome: | The proposed model outperforms state-of-the-art models on the Music-AVQA and AVQA-Yang datasets. |
OS Agents: A Survey on MLLM-based Agents for Computer, Phone and Browser Use (2025.acl-long)
Copied to clipboard
Xueyu Hu, Tao Xiong, Biao Yi, Zishu Wei, Ruixuan Xiao, Yurun Chen, Jiasheng Ye, Meiling Tao, Xiangxin Zhou, Ziyu Zhao, Yuhuai Li, Shengze Xu, Shenzhi Wang, Xinchen Xu, Shuofei Qiao, Zhaokai Wang, Kun Kuang, Tieyong Zeng, Liang Wang, Jiwei Li, Yuchen Eleanor Jiang, Wangchunshu Zhou, Guoyin Wang, Keting Yin, Zhou Zhao, Hongxia Yang, Fan Wu, Shengyu Zhang, Fei Wu
| Challenge: | a new generation of (M)LLMs is enabling the creation of superintelligent AI assistants . OS Agents can complete tasks autonomously and have the potential to significantly enhance the lives of billions of users worldwide. |
| Approach: | They propose to build OS Agents that operate within operating systems' GUIs and GUIs . they examine evaluation metrics and benchmarks to identify promising directions . |
| Outcome: | The proposed agents are based on operating systems (OS) and operating systems frameworks. |
Chain-of-Reasoning: Towards Unified Mathematical Reasoning in Large Language Models via a Multi-Paradigm Perspective (2025.acl-long)
Copied to clipboard
Yiyao Yu, Yuxiang Zhang, Dongdong Zhang, Xiao Liang, Hengyuan Zhang, Xingxing Zhang, Mahmoud Khademi, Hany Hassan Awadalla, Junjie Wang, Yujiu Yang, Furu Wei
| Challenge: | Existing work shows that LLMs rely on single-paradigm reasoning that limits their effectiveness across diverse tasks. |
| Approach: | They propose a new framework that integrates multiple reasoning paradigms to enable synergistic collaboration. |
| Outcome: | The proposed model outperforms current SOTA models in theorem proving tasks and the MATH benchmark in arithmetic tasks. |
Find Your Optimal Teacher: Personalized Data Synthesis via Router-Guided Multi-Teacher Distillation (2026.acl-long)
Copied to clipboard
Hengyuan Zhang, Shiping Yang, Xiao Liang, Chenming Shang, Yuxuan Jiang, Chaofan Tao, Jing Xiong, Hayden Kwok-Hay So, Ruobing Xie, Angel X. Chang, Ngai Wong
| Challenge: | Existing studies show that stronger models are not always optimal teachers, suggesting a mismatch between the teacher’s output and the student’s learning ability. |
| Approach: | They propose a method that routes each prompt to its optimal teacher via a query-level router that jointly considers the student models’ learnability and teacher models’ response quality. |
| Outcome: | The proposed method outperforms baselines on six benchmarks including instruct tuning and math reasoning settings. |
Physics Reasoner: Knowledge-Augmented Reasoning for Solving Physics Problems with Large Language Models (2025.coling-main)
Copied to clipboard
Xinyu Pang, Ruixin Hong, Zhanke Zhou, Fangrui Lv, Xinwei Yang, Zhilong Liang, Bo Han, Changshui Zhang
| Challenge: | Existing large language models (LLMs) fail due to lack of knowledge or incorrect knowledge application. |
| Approach: | They propose a knowledge-augmented framework that constructs a formula set to provide explicit physics knowledge and utilizes checklists to guide effective knowledge application. |
| Outcome: | The proposed framework achieves state-of-the-art performance on SciBench with an average accuracy improvement of 5.8%. |
AgenticRAGTracer: A Hop-Aware Benchmark for Diagnosing Multi-Step Retrieval Reasoning in Agentic RAG (2026.findings-acl)
Copied to clipboard
| Challenge: | Existing benchmarks provide only final questions and answers, while lacking intermediate hop-level questions that gradually connect atomic questions to the final multi-hop query. |
| Approach: | They propose to build a multi-hop reasoning model that is primarily constructed automatically by large language models and designed to support step-by-step validation. |
| Outcome: | The proposed benchmark spans multiple domains, contains 1,305 data points, and has no overlap with existing mainstream benchmarks. |
MatchPrompt: Prompt-based Open Relation Extraction with Semantic Consistency Guided Clustering (2022.emnlp-main)
Copied to clipboard
| Challenge: | Existing methods for open relation extraction (OpenRE) focus on labeled and pre-defined instances, which are costly to acquire in reality. |
| Approach: | They propose a framework that can extract relations without pre-defined types from open-domain corpus with efficient knowledge transfer from a few pre-determined relational instances. |
| Outcome: | The proposed framework achieves the new SOTA results for OpenRE on different datasets. |
CLLE: A Benchmark for Continual Language Learning Evaluation in Multilingual Machine Translation (2022.findings-emnlp)
Copied to clipboard
| Challenge: | Existing benchmarks for Continual Language Learning (CLL) are limited due to the complexity of the task and the lack of unified benchmarks. |
| Approach: | They propose a Continual Language Learning Evaluation benchmark CLLE in multilingual translation. |
| Outcome: | The proposed method is effective when compared with other strong benchmarks. |
Defending Jailbreak Prompts via In-Context Adversarial Game (2024.emnlp-main)
Copied to clipboard
| Challenge: | Large Language Models (LLMs) demonstrate remarkable capabilities across diverse applications, but concerns regarding their security persist. |
| Approach: | They propose an adversarial game that leverages agent learning to extend knowledge to defend against jailbreaks. |
| Outcome: | The proposed game shows that LLMs safeguarded by ICAG exhibit significantly reduced jailbreak success rates across various attack scenarios. |
Stance Detection on Social Media with Background Knowledge (2023.emnlp-main)
Copied to clipboard
| Challenge: | Existing studies of stance detection focus on learning stance information about specific targets from context, but in real-world scenarios, we usually have a certain understanding of a target when we express our stance on it. |
| Approach: | They propose to take the background knowledge of the target into account for better stance detection by categorizing it into episodic and discourse knowledge categories and a heuristic retrieval algorithm based on the topic to retrieve the Wikipedia documents relevant to the sample. |
| Outcome: | The proposed framework achieves state-of-the-art on four benchmark datasets showing that the proposed framework is able to detect stances in-target and zero-shot scenarios. |
CritiQ: Mining Data Quality Criteria from Human Preferences (2025.acl-long)
Copied to clipboard
Honglin Guo, Kai Lv, Qipeng Guo, Tianyi Liang, Zhiheng Xi, Demin Song, Qiuyinzhe Zhang, Yu Sun, Kai Chen, Xipeng Qiu, Tao Gui
| Challenge: | Existing methods to train language models rely on manual design, perplexity, or careful prompt engineering. |
| Approach: | They propose a method that automatically mines criteria from human preferences for data quality with only 30 human-annotated pairs and performs efficient data selection. |
| Outcome: | The proposed method improves on human-annotated test sets and shows high accuracy on code, math, and logic domains. |
From Completion to Editing: Unlocking Context-Aware Code Infilling via Search-and-Replace Instruction Tuning (2026.acl-long)
Copied to clipboard
Jiajun Zhang, Zeyu Cui, Jiaxi Yang, Lei Zhang, Yuheng Jing, Zeyao Ma, Tianyi Bai, Zilei Wang, Qiang Liu, Liang Wang, Binyuan Hui, Junyang Lin
| Challenge: | Fill-in-the-Middle (FIM) models suffer from performance degradation and prohibitive latency. |
| Approach: | They propose a search-and-replace infilling framework that integrates agentic verification and editing into a single-pass inference process. |
| Outcome: | The proposed framework harmonizes completion tasks with the instruction-following priors of Chat LLMs, extending the paradigm from static infilling to dynamic context-aware editing. |
A Systematic Examination of Preference Learning through the Lens of Instruction-Following (2025.naacl-long)
Copied to clipboard
Joongwon Kim, Anirudh Goyal, Aston Zhang, Bo Xiong, Rui Hou, Melanie Kambadur, Dhruv Mahajan, Hannaneh Hajishirzi, Liang Tan
| Challenge: | a recent study has found that preference learning is a key tool for enhancing LLM training and alignment. |
| Approach: | They use a synthetic data generation pipeline to generate 48,000 unique instruction-following prompts with 23 verifiable constraints to obtain preference pairs. |
| Outcome: | The proposed pipeline generates 48,000 unique instruction-following prompts with 23 verifiable constraints that enable fine-grained and automated quality assessments of model responses. |
DynamicKV: Task-Aware Adaptive KV Cache Compression for Long Context LLMs (2025.findings-emnlp)
Copied to clipboard
| Challenge: | Existing KV cache compression methods enforce a fixed pattern, neglecting task-specific characteristics, which hampers the effective retention of essential information while discarding less important tokens. |
| Approach: | They propose a Task-Aware KV cache mechanism that dynamically adjusts the KV caching size across different layers based on the characteristics of the tasks. |
| Outcome: | The proposed method surpasses state-of-the-art methods by 11% on the LongBench dataset even under extreme compression (0.9%) |
GuiLoMo: Allocating Experts and Ranks for LoRA-MoE via Bilevel Optimization with GuidedSelection Vectors (2025.findings-emnlp)
Copied to clipboard
Xinrong Chen, Hengyuan Zhang, Yingmin Qiu, Xiao Liang, Ziyue Li, Guanyu Wang, Weiping Li, Tong Mo, Hayden Kwok-Hay So, Ngai Wong
| Challenge: | Low-Rank Adaptation (LoRA) methods are efficient for a large language model with reduced computational costs. |
| Approach: | They propose a layer-wise expert numbers and ranks allocation strategy with GuidedSelection Vectors. |
| Outcome: | The proposed method achieves superior or comparable performance to all baselines on three backbone models. |
ABSEval: An Agent-based Framework for Script Evaluation (2024.emnlp-main)
Copied to clipboard
| Challenge: | Existing studies on script evaluation of large language models (LLMs) have not evaluated scripts generated by LLMs due to their logical structure, sequential organization, and open-ended nature. |
| Approach: | They propose to use a script evaluation dataset to evaluate LLM scripts . they propose to develop an agent-based script evaluation framework ABSEval to evaluate scripts. |
| Outcome: | The proposed framework provides superior accuracy and relevance, aligning closely with human evaluation. |
COIG-CQIA: Quality is All You Need for Chinese Instruction Fine-tuning (2025.findings-naacl)
Copied to clipboard
Yuelin Bai, Xeron Du, Yiming Liang, Leo Jin, Junting Zhou, Ziqiang Liu, Feiteng Fang, Mingshan Chang, Tianyu Zheng, Xincheng Zhang, Nuo Ma, Zekun Moore Wang, Ruibin Yuan, Haihong Wu, Hongquan Lin, Wenhao Huang, Jiajun Zhang, Chenghua Lin, Jie Fu, Min Yang, Shiwen Ni, Ge Zhang
| Challenge: | Existing datasets for Chinese instruction tuning are not well-aligned with Chinese users’ interaction patterns. |
| Approach: | They propose to use Chinese instruction tuning datasets to improve instruction fine-tuning for Chinese users. |
| Outcome: | The proposed dataset shows that Chinese models achieve competitive performance in diverse benchmarks. |
StyleDubber: Towards Multi-Scale Style Learning for Movie Dubbing (2024.findings-acl)
Copied to clipboard
Gaoxiang Cong, Yuankai Qi, Liang Li, Amin Beheshti, Zhedong Zhang, Anton Hengel, Ming-Hsuan Yang, Chenggang Yan, Qingming Huang
| Challenge: | Existing methods for movie dubbing break phonemes in scripts, resulting in incomplete phoneme pronunciation and poor identity stability. |
| Approach: | They propose a method that switches dubbing learning from frame level to phoneme level . it uses a multimodal style adaptor to learn pronunciation style from audio . |
| Outcome: | The proposed method improves on two benchmarks, V2C and Grid, and is available on github. |
Error Analysis Prompting Enables Human-Like Translation Evaluation in Large Language Models (2024.findings-acl)
Copied to clipboard
| Challenge: | Recent research shows that large language models (LLMs) perform poorly at segment level. |
| Approach: | They propose a new prompting method that emulates the commonly accepted human evaluation framework . they will release their code and scripts to facilitate the community . |
| Outcome: | The proposed method is based on the human evaluation framework MQM and produces explainable and reliable MT evaluations at both the system and segment level. |
FinEval: A Chinese Financial Domain Knowledge Evaluation Benchmark for Large Language Models (2025.naacl-long)
Copied to clipboard
Xin Guo, Haotian Xia, Zhaowei Liu, Hanyang Cao, Zhi Yang, Zhiqiang Liu, Sizhe Wang, Jinyi Niu, Chuqi Wang, Yanhui Wang, Xiaolong Liang, Xiaoming Huang, Bing Zhu, Zhongyu Wei, Yun Chen, Weining Shen, Liwen Zhang
| Challenge: | Large language models have demonstrated outstanding performance in various natural language processing tasks, but their security capabilities in the financial domain have not been explored. |
| Approach: | They propose to use a benchmark to evaluate large language models' financial domain knowledge and practical abilities. |
| Outcome: | The proposed benchmark evaluates large language models' financial domain knowledge and practical abilities. |
CBLUE: A Chinese Biomedical Language Understanding Evaluation Benchmark (2022.acl-long)
Copied to clipboard
Ningyu Zhang, Mosha Chen, Zhen Bi, Xiaozhuan Liang, Lei Li, Xin Shang, Kangping Yin, Chuanqi Tan, Jian Xu, Fei Huang, Luo Si, Yuan Ni, Guotong Xie, Zhifang Sui, Baobao Chang, Hui Zong, Zheng Yuan, Linfeng Li, Jun Yan, Hongying Zan, Kunli Zhang, Buzhou Tang, Qingcai Chen
| Challenge: | a new benchmark for biomedical language understanding is being developed in Chinese . most benchmarks are limited to English, which makes it difficult to replicate success in other languages. |
| Approach: | They propose to use Chinese biomedical language understanding evaluation benchmarks to evaluate Chinese models. |
| Outcome: | The proposed benchmarks show that the current models perform worse than the human ceiling. |
STAPO: Selective Trajectory-Aware Policy Optimization for LLM Agent Training (2026.acl-long)
Copied to clipboard
Qiuyi Qi, Tian Liang, Mutian Bao, Jinjian Zhang, Dongnan Liu, Wei Zhou, Linjian Mo, Ming Kong, Jie Liu, Feng Zhang, Qiang Zhu
| Challenge: | Prior work has explored step-level supervision using Shannon-entropy-based uncertainty signals, which conflate inherent state complexity with agent confidence. |
| Approach: | They propose a hierarchical group-based RL framework that leverages normalized entropy to locate outlier steps associated with trajectory neglect and optimizes them via a mechanism of trajectory-aware reward and trajectory-independent penalty. |
| Outcome: | Experiments on ALFWorld, WebShop, and Search-Augmented QA show that STAPO achieves state-of-the-art performance while substantially alleviating trajectory neglect. |
Contrastive Demonstration Tuning for Pre-trained Language Models (2022.findings-emnlp)
Copied to clipboard
| Challenge: | Recent studies focus on searching discrete or continuous prompts or optimized verbalizers, yet the demonstration examples are crucial for an excellent final performance of prompt-tuning. |
| Approach: | They propose a pluggable, extensible, and efficient approach to prompt tuning that is free of demonstration sampling. |
| Outcome: | The proposed approach can be pluggable, extensible, and efficient on 16 datasets. |
SynWorld: Virtual Scenario Synthesis for Agentic Action Knowledge Refinement (2025.acl-short)
Copied to clipboard
Runnan Fang, Xiaobin Wang, Yuan Liang, Shuofei Qiao, Jialong Wu, Zekun Xi, Ningyu Zhang, Yong Jiang, Pengjun Xie, Fei Huang, Huajun Chen
| Challenge: | Using Large Language Models (LLMs)-based agents can enhance their understanding of environments and tasks. |
| Approach: | They propose a framework that allows agents to synthesize possible scenarios with multi-step action invocation within the action space and perform Monte Carlo Tree Search exploration to refine their action knowledge in the current environment. |
| Outcome: | The proposed framework synthesizes possible scenarios with multi-step action invocation within the action space and performs Monte Carlo Tree Search exploration to refine action knowledge in the current environment. |
GraphNarrator: Generating Textual Explanations for Graph Neural Networks (2025.acl-long)
Copied to clipboard
| Challenge: | Graph representation learning has garnered significant attention due to its broad applications in various domains, such as recommendation systems and social network analysis. |
| Approach: | They propose to use a generative language model to map input-output pairs to explanations reflecting the model’s decision-making process to generate a model that generates pseudo-labels that capture the model's decisions from saliency-based explanations. |
| Outcome: | Extensive experiments show that GraphNarrator produces human-preferred explanations that are faithful, concise, and human-like. |
TRACE: Evaluating Execution Efficiency of LLM-Based Code Translation (2026.acl-long)
Copied to clipboard
| Challenge: | Large Language Models (LLMs) have improved the functional correctness of code translation, but execution efficiency remains overlooked. |
| Approach: | They propose a benchmark to explicitly assess execution efficiency in LLM-translated code. |
| Outcome: | The proposed benchmark identifies that execution efficiency is an essential dimension of code translation . the results highlight that correctness and efficiency are often misaligned . |
UNIVID: Unified Vision-Language Model for Video Moderation (2026.acl-industry)
Copied to clipboard
Kejuan Yang, Yizhuo Zhang, Mingyuan Du, Yue Zhang, Dixin Zheng, Kaili Zhao, Yang Xiao, Hanzhong Liang, Kenan Xiao
| Challenge: | Existing video moderation systems rely on fragmented black-box classification models that are difficult to maintain and lack transparency. |
| Approach: | They propose a Unified Vision-Language model for Video Moderation that generates policy-aware captions that serve as an interpretable intermediate representation. |
| Outcome: | The proposed model reduces violation leakage and overkill rate by 42.7% while reducing maintenance costs. |
Surge: On the Potential of Large Language Models as General-Purpose Surrogate Code Executors (2025.emnlp-main)
Copied to clipboard
| Challenge: | Neural surrogate models are powerful tools in data mining, but are underexplored . large language models (LLMs) have demonstrated remarkable capabilities in code-related tasks . |
| Approach: | They propose a benchmarking framework to examine the feasibility of large language models . they examine scaling laws, data efficiency, and predictive accuracy of 21 open-source and proprietary LLMs . |
| Outcome: | The proposed benchmark examines 21 open-source and proprietary LLMs . it also examines scaling laws, data efficiency, and predictive accuracy . |
CodeV: Issue Resolving with Visual Data (2025.findings-acl)
Copied to clipboard
Linhao Zhang, Daoguang Zan, Quanshun Yang, Zhirong Huang, Dong Chen, Bo Shen, Tianyu Liu, Yongshun Gong, Huang Pengjie, Xudong Lu, Guangtai Liang, Lizhen Cui, Qianxiang Wang
| Challenge: | Large Language Models (LLMs) have expanded to more complex repository-level tasks. |
| Approach: | They propose a first approach to leveraging visual data to enhance the issue-resolving capabilities of Large Language Models (LLMs) they demonstrate the effectiveness of CodeV and provide valuable insights into leveraging visualization to resolve GitHub issues. |
| Outcome: | The proposed approach improves the issue-resolving capabilities of Large Language Models (LLMs) by using visual data. |
Towards Making the Most of ChatGPT for Machine Translation (2023.findings-emnlp)
Copied to clipboard
| Challenge: | Prior studies have shown that ChatGPT achieves comparable results to commercial systems for high-resource languages, but lags behind in complex tasks, e.g., low-resourced and distant-language-pairs translation. |
| Approach: | They propose task-specific prompts and domain-specific prompts which are based on task information and domain information and a task-specific prompt. |
| Outcome: | The proposed prompts improve the performance of ChatGPT in complex tasks and generate hallucinations for non-English-centric tasks. |
Signer Diversity-driven Data Augmentation for Signer-Independent Sign Language Translation (2024.findings-naacl)
Copied to clipboard
| Challenge: | Existing methods for sign language translation (SLT) rely on signer identity labels, which is often impractical and costly in real-world applications. |
| Approach: | They propose a signer diversity-driven data augmentation method that can generalize to signers not encountered during training. |
| Outcome: | The proposed method achieves state-of-the-art results without relying on signer identity labels. |
Unified Hallucination Detection for Multimodal Large Language Models (2024.acl-long)
Copied to clipboard
Xiang Chen, Chenxi Wang, Yida Xue, Ningyu Zhang, Xiaoyan Yang, Qiang Li, Yue Shen, Lei Liang, Jinjie Gu, Huajun Chen
| Challenge: | despite significant strides in multimodal tasks, MLLMs are plagued by the critical issue of hallucination. |
| Approach: | They propose a meta-evaluation benchmark to facilitate evaluation of advancements in hallucination detection methods. |
| Outcome: | The proposed framework validates hallucinations robustly and provides strategic insights . MHaluBench is a meta-evaluation benchmark designed to facilitate evaluation . |
Any Information Is Just Worth One Single Screenshot: Unifying Search With Visualized Information Retrieval (2025.acl-long)
Copied to clipboard
| Challenge: | Existing multimodal retrieval models are lacking in visual representations of multimodal data. |
| Approach: | They propose a visualized information retrieval paradigm where multimodal information is represented by a unified visual format called Screenshots for various retrieval applications. |
| Outcome: | The proposed model is based on a large dataset of screenshots from diverse sources . it is compared with existing models and lays a solid foundation for the new model . |
Label-Enhanced Hierarchical Contextualized Representation for Sequential Metaphor Identification (2021.emnlp-main)
Copied to clipboard
| Challenge: | Recent approaches to identify metaphors ignore extra information from data, such as contextual information and broader discourse information. |
| Approach: | They propose a model augmented with hierarchical contextualized representation to extract more information from both sentence-level and discourse-level. |
| Outcome: | The proposed model outperforms state-of-the-art methods on two tasks using a VUA dataset. |
Better Pre-Training by Reducing Representation Confusion (2023.findings-eacl)
Copied to clipboard
| Challenge: | Existing methods to improve pre-trained language models address information confusion in position encoding and model representations. |
| Approach: | They propose two techniques to improve pre-trained language models by decoupling directions and auxiliary regularizers. |
| Outcome: | The proposed techniques can improve pre-trained language models on GLUE benchmarks. |
Every Document Owns Its Structure: Inductive Text Classification via Graph Neural Networks (2020.acl-main)
Copied to clipboard
| Challenge: | Existing graph-based methods for text classification cannot capture contextual word relationships within each document nor can they produce inductive learning of new words. |
| Approach: | They propose to use Graph Neural Networks to learn the local word representations and then aggregate the word nodes as the document embeddings. |
| Outcome: | The proposed method outperforms state-of-the-art methods on four benchmark datasets. |
The Bitter Lesson of Diffusion Language Models for Agentic Workflows: A Comprehensive Reality Check (2026.acl-long)
Copied to clipboard
| Challenge: | Embodied and Tool-Calling agents are effective in planning and complex reasoning, but require causal, precise, and logically grounded reasoning mechanisms to be viable for agentic tasks. |
| Approach: | They propose a framework that integrates dLLMs as plug-and-play cognitive cores. |
| Outcome: | The proposed model breaks the sequential latency bottleneck in agentic interactions. |
VenusFactory: An Integrated System for Protein Engineering with Data Retrieval and Language Model Fine-Tuning (2025.acl-demo)
Copied to clipboard
Yang Tan, Chen Liu, Jingyuan Gao, Wu Banghao, Mingchen Li, Ruilin Wang, Lingrong Zhang, Huiqun Yu, Guisheng Fan, Liang Hong, Bingxin Zhou
| Challenge: | Pre-trained protein language models have been used in protein engineering, but their adoption is limited due to data collection, task benchmarking, and application challenges. |
| Approach: | They propose a versatile engine that integrates biological data retrieval, standardized task benchmarking, and modular fine-tuning of PLMs. |
| Outcome: | The proposed engine integrates biological data retrieval, task benchmarking, and modular fine-tuning of PLMs. |
Escaping the Echo Trap: On Credit Assignment Failure in Multi-turn LLM Self-Reflection (2026.acl-long)
Copied to clipboard
Linxuan Du, Guangquan Xue, Xiaobo Liang, Qipeng Huang, Yuyang Ding, Xinyu Shi, Zhang Yijun, Ji Qi, Wenpeng Zhu, Juntao Li, Min Zhang
| Challenge: | Existing methods for multi-turn self-reflection are limited by the Echo Trap problem . the model is limited by its inherent capabilities and repeats earlier reflections to preserve reward signals . |
| Approach: | They propose a tree-structured extension of GRPO for multi-turn self-reflection which enables more accurate advantage estimation. |
| Outcome: | The proposed method mitigates behavior collapse and improves performance across benchmarks. |
From Awareness to Adaptability: Enhancing Tool Utilization for Scientific Reasoning (2025.findings-acl)
Copied to clipboard
| Challenge: | Existing approaches enhance reasoning through Chain-of-Thought, Program-ofThough, and Tool-Integration. |
| Approach: | They propose a tool-awareness training method that leverages both forward and backward data generation strategies to strengthen the model’s conscious and selective tool utilization in multi-step reasoning tasks. |
| Outcome: | The proposed method improves the model's tool utilization capabilities, including proactivity and execution success rates. |
MMEvalPro: Calibrating Multimodal Benchmarks Towards Trustworthy and Efficient Evaluation (2025.naacl-long)
Copied to clipboard
Jinsheng Huang, Liang Chen, Taian Guo, Fu Zeng, Yusheng Zhao, Bohan Wu, Ye Yuan, Haozhe Zhao, Zhihui Guo, Yichi Zhang, Jingyang Yuan, Wei Ju, Luchen Liu, Tianyu Liu, Baobao Chang, Ming Zhang
| Challenge: | Large Multimodal Models (LMMs) exhibit impressive cross-modal understanding and reasoning abilities, but many benchmarks suffer from systematic biases. |
| Approach: | They propose a benchmark to avoid Type-I errors by creating one perception question and one knowledge anchor question through a meticulous annotation process. |
| Outcome: | The proposed benchmark avoids Type-I errors while maintaining reliability of MCQ evaluations. |
Target-to-Source Augmentation for Aspect Sentiment Triplet Extraction (2023.emnlp-main)
Copied to clipboard
| Challenge: | Aspect Sentiment Triplet Extraction (ASTE) is an important task in sentiment analysis, but data scarcity limits performance of existing methods. |
| Approach: | They propose a target-to-source augmentation approach to alleviate the issue of data scarcity in Aspect Sentiment Triplet Extraction (ASTE) they use fluency and alignment discriminators to provide feedback and use this feedback to optimize the generator. |
| Outcome: | The proposed approach significantly improves the performance of existing methods. |
Privacy-Preserving Reasoning with Knowledge-Distilled Parametric Retrieval Augmented Generation (2026.findings-acl)
Copied to clipboard
| Challenge: | Existing RAG systems require uploading local documents to the cloud, resulting in inference latency and poor generalization on out-of-distribution (OOD) inputs. |
| Approach: | They propose a generalizable knowledge-distilled parametric RAG model aligned with standard RAG in document structure and parameter activation. |
| Outcome: | The proposed model outperforms baselines in accuracy and generalizes well on out-of-distribution (OOD) data. |
SELP: A Semantically-Driven Approach for Separated and Accurate Class Prototypes in Few-Shot Text Classification (2024.findings-acl)
Copied to clipboard
| Challenge: | Existing methods for few-shot text classification focus on enhancing separation of prototypes without taking semantic relationships into account. |
| Approach: | They propose to utilize semantically enhanced labels to calibrate class Prototypes . they propose a center loss method to enhance intra-class compactness . |
| Outcome: | The proposed method outperforms baseline methods on eight few-shot text classification datasets. |
KnowAgent: Knowledge-Augmented Planning for LLM-Based Agents (2025.findings-naacl)
Copied to clipboard
Yuqi Zhu, Shuofei Qiao, Yixin Ou, Shumin Deng, Shiwei Lyu, Yue Shen, Lei Liang, Jinjie Gu, Huajun Chen, Ningyu Zhang
| Challenge: | Large Language Models (LLMs) fail to effectively guide the planning trajectories during task solving and result in planning hallucinations. |
| Approach: | They propose a novel approach to enhance the planning capabilities of large language models by incorporating explicit action knowledge. |
| Outcome: | The proposed approach can achieve comparable or superior performance to existing baselines on HotpotQA and ALFWorld. |
Towards User-Driven Neural Machine Translation (2021.acl-long)
Copied to clipboard
| Challenge: | a good translation should implicitly mirror user traits rather than translate the original content semantically. |
| Approach: | They propose a framework that captures user traits from historical inputs . they propose 'user-driven' NMT to model user behavior under a zero-shot learning fashion . |
| Outcome: | The proposed framework can capture user traits from historical inputs under zero-shot learning fashion. |
RAP: Efficient Text-Video Retrieval with Sparse-and-Correlated Adapter (2024.findings-acl)
Copied to clipboard
Meng Cao, Haoran Tang, Jinfa Huang, Peng Jin, Can Zhang, Ruyang Liu, Long Chen, Xiaodan Liang, Li Yuan, Ge Li
| Challenge: | Text-Video Retrieval (TVR) aims to align relevant video content with natural language queries. |
| Approach: | They propose to conduct efficient text-video Retrieval with a salient-and-correlated AdaPter . they propose a low-rank modulation module to refine per-image features from frozen CLIP backbone . |
| Outcome: | Experiments on four TVR datasets show that the proposed method performs better than other methods. |
SafeRAG: Benchmarking Security in Retrieval-Augmented Generation of Large Language Model (2025.acl-long)
Copied to clipboard
Xun Liang, Simin Niu, Zhiyu Li, Sensen Zhang, Hanyu Wang, Feiyu Xiong, Zhaoxin Fan, Bo Tang, Jihao Zhao, Jiawei Yang, Shichao Song, Mengwei Wang
| Challenge: | Existing approaches to integrating external knowledge into large language models (LLMs) however, the incorporation of external knowledge increases the vulnerability of LLMs . |
| Approach: | They propose a benchmark to evaluate the RAG security using a dataset . they classify attack tasks into silver noise, inter-context conflict, soft ad, and white Denial-of-Service . |
| Outcome: | The proposed benchmark evaluates the security of RAG against 14 representative RAG components. |
MAC-SQL: A Multi-Agent Collaborative Framework for Text-to-SQL (2025.coling-main)
Copied to clipboard
Bing Wang, Changyu Ren, Jian Yang, Xinnian Liang, Jiaqi Bai, LinZheng Chai, Zhao Yan, Qian-Wen Zhang, Di Yin, Xing Sun, Zhoujun Li
| Challenge: | Recent LLM-based Text-to-SQL methods suffer from performance degradation on “huge” databases and complex user questions that require multi-step reasoning. |
| Approach: | They propose a framework that integrates a decomposer agent and auxiliary agents to generate SQL queries from natural language text. |
| Outcome: | The proposed framework achieves comparable execution accuracy on SQL-Llama tasks compared to the baseline model. |
Subword Encoding in Lattice LSTM for Chinese Word Segmentation (N19-1)
Copied to clipboard
| Challenge: | Using subwords, Chinese word segmentation models use character combination information to disambiguate characters. |
| Approach: | They propose a subword-based neural word segmentor that integrates character embeddings into a Lattice LSTM network over a character sequence. |
| Outcome: | The proposed model can utilize abundant character combination information, which is effective to disambiguate characters. |
Scaling Law for Multimodal Large Language Model Supervised Fine-Tuning (2026.acl-long)
Copied to clipboard
YiFan Zhang, Tao Yu, Feng Li, Chaoyou Fu, Yibo Hu, Kun Wang, Qingsong Wen, Zhang Zhang, Liang Wang, Rong Jin
| Challenge: | supervised fine-tuning (SFT) is crucial for multimodal large language models, yet a comprehensive scaling law is lacking . et al.: scaling laws focus on model size, pre-training tokens, and MLLM SFT data volumes . |
| Approach: | They propose two scaling laws to guide optimal model-data configuration . they propose one applicable when training data volumes are well defined by researchers . |
| Outcome: | The proposed scaling laws provide valuable recommendations for optimal resource allocation . they show that the proposed laws are more accurate than existing models . |
Facilitating Fine-grained Detection of Chinese Toxic Language: Hierarchical Taxonomy, Resources, and Benchmarks (2023.acl-long)
Copied to clipboard
| Challenge: | Existing datasets suffer from a lack of fine-grained annotations, such as the toxic type and expressions with indirect toxicity. |
| Approach: | They propose a benchmark model to detect toxic language by incorporating lexical features into a Chinese dataset to facilitate fine-grained annotations. |
| Outcome: | The proposed model is based on insulting vocabulary containing implicit profanity and is able to detect toxic language with lexical features. |
MetaLogic: Logical Reasoning Explanations with Fine-Grained Structure (2022.emnlp-main)
Copied to clipboard
| Challenge: | Current explanation datasets often employ synthetic data with simple reasoning structures. |
| Approach: | They propose a comprehensive logical reasoning explanation form that incorporates three main components to better fit the human cognitive process. |
| Outcome: | The proposed model performs better than existing models on real-life scenarios, but is more challenging for the current models. |
Cross-Domain NER using Cross-Domain Language Modeling (P19-1)
Copied to clipboard
| Challenge: | Existing methods for named entity recognition (NER) use labeled data for both source and target domains. |
| Approach: | They propose to use language modeling as a bridge between NER domains to perform cross-domain and cross-task knowledge transfer. |
| Outcome: | The proposed method extracts domain differences from cross-domain LM contrast, allowing unsupervised domain adaptation while giving state-of-the-art results among supervised domain adapters. |
CliMedBench: A Large-Scale Chinese Benchmark for Evaluating Medical Large Language Models in Clinical Scenarios (2024.emnlp-main)
Copied to clipboard
| Challenge: | Chinese medical large language models (LLMs) are underperforming on this benchmark, especially where medical reasoning and factual consistency are vital. |
| Approach: | They propose a benchmark with 14 expert-guided clinical scenarios to assess the medical ability of large language models across 7 pivot dimensions. |
| Outcome: | The proposed benchmark has been validated in several ways. |
Co-training and Co-distillation for Quality Improvement and Compression of Language Models (2023.findings-emnlp)
Copied to clipboard
| Challenge: | Knowledge Distillation (KD) compresses expensive pre-trained language models . however, most smaller models fail to surpass performance of larger model . |
| Approach: | They propose a framework that co-trains two models while mutually distilling knowledge to improve performance and inference speed together. |
| Outcome: | The proposed framework outperforms the original larger model by 1.66 on the GLUE benchmark. |
Memory-augmented Query Reconstruction for LLM-based Knowledge Graph Reasoning (2025.findings-acl)
Copied to clipboard
| Challenge: | Existing methods that confuse tool utilization with knowledge reasoning harm readability and give rise to tool invocation hallucinations. |
| Approach: | They propose to decouple LLM from tool invocation tasks by establishing a memory module with explicit descriptions of query statements and a query memory module to facilitate the KGQA process. |
| Outcome: | The proposed method achieves state-of-the-art on WebQSP and CWQ benchmarks. |
Open-ended Long Text Generation via Masked Language Modeling (2023.acl-long)
Copied to clipboard
| Challenge: | Pre-trained autoregressive language models have dominated OPen-ended Long Text Generation (Open-LTG) however, the low inference efficiency of AR impedes their usability. |
| Approach: | They propose a representative iterative non-autoregressive (NAR) decoding strategy to improve inference efficiency for Open-LTG. |
| Outcome: | The proposed model can generate short text and collapse for long text modeling. |
Generalizable and Stable Finetuning of Pretrained Language Models on Low-Resource Texts (2024.naacl-long)
Copied to clipboard
| Challenge: | Pretrained language models have advanced natural language processing tasks significantly, but finetuning them on low-resource datasets presents significant challenges such as instability and overfitting. |
| Approach: | They propose a regularization method based on attention-guided weight mixup for finetuning PLMs on low-resource datasets. |
| Outcome: | The proposed method improves generalization and combats overfitting on two splits of the training dataset. |
IntelliCockpitBench: A Comprehensive Benchmark to Evaluate VLMs for Intelligent Cockpit (2025.findings-acl)
Copied to clipboard
| Challenge: | Visual Question Answering (VQA) is a key task in vehicular systems. |
| Approach: | They propose a benchmark that encompasses diverse automotive scenarios . they use images from front, side, and rear cameras, various road types, weather conditions, and interior views . |
| Outcome: | The proposed benchmark includes images from front, side, and rear cameras, various road types, weather conditions, and interior views. |
Neuron-Level Sequential Editing for Large Language Models (2025.acl-long)
Copied to clipboard
Houcheng Jiang, Junfeng Fang, Tianyu Zhang, Baolong Bi, An Zhang, Ruipeng Wang, Tao Liang, Xiang Wang
| Challenge: | Existing model editing methods focus on single-round editing and often face significant challenges in sequential model editing. |
| Approach: | They propose a model editing method that optimizes the target layer’s hidden states using the model’s original weights to prevent model failure. |
| Outcome: | The proposed method outperforms existing model editing methods and is available on the open-source platform 4open.science. |
WECA: A WordNet-Encoded Collocation-Attention Network for Homographic Pun Recognition (D18-1)
Copied to clipboard
Yufeng Diao, Hongfei Lin, Di Wu, Liang Yang, Kan Xu, Zhihao Yang, Jian Wang, Shaowu Zhang, Bo Xu, Dongyu Zhang
| Challenge: | Homographic puns have a long history in human writing, widely used in written and spoken literature, which intended as jokes. |
| Approach: | They propose a WordNet-encoded model to settle polysemy of homographic puns and a word weighted model for recognizing them. |
| Outcome: | The proposed model can distinguish between homographic pun and non-homographic pun texts. |