Papers by Xiao Xiao
AdaMix: Adaptive Mixing for Short and Long Reasoning Adapters (2026.acl-long)
Copied to clipboard
| Challenge: | Existing methods for large reasoning models have improved efficiency but still face limitations such as conflicting objectives and limited adaptability. |
| Approach: | They propose an adaptive reasoning framework that applies a uniform, computation-intensive deep reasoning strategy to all problems. |
| Outcome: | The proposed framework reduces the average response length of DeepSeek-R1-Distill-Qwen-7B by 54.9% while improving accuracy by up to 4.8% on five mathematical datasets. |
Say What You Mean! Large Language Models Speak Too Positively about Negative Commonsense Knowledge (2023.acl-long)
Copied to clipboard
| Challenge: | Large language models (LLMs) have been studied for their ability to store and utilize positive knowledge. |
| Approach: | They propose to use a constrained keywords-to-sentence generation task and a Boolean question answering task to probe large language models on negative commonsense knowledge. |
| Outcome: | The proposed tasks show that LLMs fail to generate valid sentences grounded in negative commonsense knowledge, yet they can correctly answer yes-or-no questions. |
FlashBack: Efficient Retrieval-Augmented Language Modeling for Fast Inference (2025.findings-acl)
Copied to clipboard
| Challenge: | Retrieval-Augmented Language Modeling (RALM) is a popular approach for large language models. |
| Approach: | They propose a modular RALM that integrates large language models with documents from an external corpus to improve inference efficiency. |
| Outcome: | The proposed method improves inference efficiency with appending context pattern while maintaining decent performance after fine-tuning by Low-Rank Adaption. |
We-Math: Does Your Large Multimodal Model Achieve Human-like Mathematical Reasoning? (2025.acl-long)
Copied to clipboard
Runqi Qiao, Qiuna Tan, Guanting Dong, MinhuiWu MinhuiWu, Chong Sun, Xiaoshuai Song, Jiapeng Wang, Zhuoma GongQue, Shanglin Lei, YiFan Zhang, Zhe Wei, Miaoxuan Zhang, Runfeng Qiao, Xiao Zong, Yida Xu, Peiqing Yang, Zhimin Bao, Muxi Diao, Chen Li, Honggang Zhang
| Challenge: | Existing benchmarks focus more on end-to-end performance, but neglect the underlying principles of knowledge acquisition and generalization. |
| Approach: | They propose a benchmark specifically designed to explore the problem-solving principles by decomposing 6.5K visual math problems into 10.9K step-level questions for evaluation. |
| Outcome: | The proposed benchmark covers 6.5K visual math problems and 10.9K step-level questions spanning 5 layers of knowledge granularity and 67 hierarchical knowledge concepts. |
HEAL: Hybrid Enhancement with LLM-based Agents for Text-attributed Hypergraph Self-supervised Representation Learning (2025.findings-emnlp)
Copied to clipboard
| Challenge: | Existing approaches to enhance text-attributed hypergraph self-supervised learning are limited by label scarcity. |
| Approach: | They propose a data-centric approach that leverages large language models to enhance hypergraph self-supervised learning by integrating hyperedges into a self-representation framework. |
| Outcome: | The proposed approach generates informative nodes and hyperedges through multi-round interaction with LLM-based agents. |
Through the MUD: A Multi-Defendant Charge Prediction Benchmark with Linked Crime Elements (2024.acl-long)
Copied to clipboard
| Challenge: | Existing charge prediction datasets focus on single-defendant cases, but real-world cases involve multiple defendants. |
| Approach: | They propose a benchmark that encompasses legal cases involving multiple defendants . they develop an interpretable model called EJudge that incorporates crime elements and legal rules to infer charges. |
| Outcome: | The proposed model outperforms state-of-the-art models in predicting crime charges while providing corresponding rationales. |
Can Pre-trained Language Models Interpret Similes as Smart as Human? (2022.acl-long)
Copied to clipboard
| Challenge: | Simile interpretation is a crucial task in natural language processing. |
| Approach: | They propose a task to let PLMs infer the shared properties of similes by probing textual corpora and human-designed questions. |
| Outcome: | The proposed task outperforms pre-trained language models on simile interpretation tasks while still underperforming humans. |
Multiview Clickbait Detection via Jointly Modeling Subjective and Objective Preference (2023.findings-emnlp)
Copied to clipboard
| Challenge: | Existing clickbait detection models rely on analyzing the objective semantics of posts or correlating posts with article content only, but fail to identify and exploit the manipulation intention of clickbaiting from a user’s subjective perspective. |
| Approach: | They propose a multiview clickbait detection model to model subjective and objective preferences simultaneously to capture clickbaiting from a user's subjective perspective. |
| Outcome: | The proposed model outperforms state-of-the-art models on two real-world datasets and shows that it integrates subjective and objective preferences simultaneously. |
Step-level Verifier-guided Hybrid Test-Time Scaling for Large Language Models (2025.emnlp-main)
Copied to clipboard
Kaiyan Chang, Yonghao Shi, Chenglong Wang, Hang Zhou, Chi Hu, Xiaoqian Liu, Yingfeng Luo, Yuan Ge, Tong Xiao, JingBo Zhu
| Challenge: | Recent training-based TTS methods, such as continued reinforcement learning, have surged in popularity, while training-free TTS approaches are gradually fading from prominence. |
| Approach: | They propose a fine-grained sequential scaling method guided by process verification that integrates training-free TTS methods with other classical parallel scaling methods at the step level. |
| Outcome: | Experiments on five instruction-tuned large language models (LLMs) show that training-free TTS methods can extend reasoning performance boundaries. |
Sample Design Engineering: An Empirical Study on Designing Better Fine-Tuning Samples for Information Extraction with LLMs (2024.emnlp-industry)
Copied to clipboard
| Challenge: | Prompt Engineering (PE) is renowned for improving IE performance through prompt modifications, but the realm of sample design for downstream fine-tuning remains unexplored. |
| Approach: | They propose a methodical approach to enhancing LLMs’ post-tuning performance by refining input, output, and reasoning designs. |
| Outcome: | The proposed approach outperforms heuristic design strategies on three complex IE tasks with four additional LLMs. |
KnowledgeBerg: Evaluating Systematic Knowledge Coverage and Compositional Reasoning in Large Language Models (2026.findings-acl)
Copied to clipboard
| Challenge: | Existing LLMs lack systematic coverage of a bounded knowledge universe and compositional set-based reasoning over that universe. |
| Approach: | They propose a benchmark for multiple-choice questions based on 1,183 enumeration seeds . they use knowledge width, cardinality of required universe, reasoning depth to formalize the challenge . |
| Outcome: | The proposed benchmarks achieve only 5.26–36.88 F1 on universe enumeration and 16.00–44.19 accuracy on knowledge-grounded reasoning. |
Evolving Beyond Snapshots: Harmonizing Structure and Sequence via Entity State Tuning for Temporal Knowledge Graph Forecasting (2026.acl-long)
Copied to clipboard
| Challenge: | Temporal knowledge graphs (TKGs) require predicting future facts by modeling structural dependencies within each snapshot and temporal evolution across snapshots. |
| Approach: | They propose an encoder-agnostic framework that provides persistent entity states . EST maintains a global state buffer and aligns structural evidence with sequential signals . |
| Outcome: | Experiments show that EST improves diverse backbones and achieves state-of-the-art performance. |
Length-Induced Embedding Collapse in PLM-based Models (2025.acl-long)
Copied to clipboard
| Challenge: | In text embeddings from PLMs are essential for many NLP applications, but performance degrades on longer texts. |
| Approach: | They propose a method which mitigates the phenomenon of Length Collapse . they propose TempScale to ensure more consistent embeddings across different text lengths . |
| Outcome: | The proposed method improves performance on MTEB and LongEmbed by 0.94% on short and 1.10% on long texts. |
Transductive Learning for Unsupervised Text Style Transfer (2021.emnlp-main)
Copied to clipboard
| Challenge: | Existing methods for style transfer are based on an inductive learning approach, which represents the style as embeddings, decoder parameters, or discriminator parameters and directly applies these general rules to the test cases. |
| Approach: | They propose a retrieval-based context-aware style representation that involves top-K relevant sentences in the target style in the transfer process. |
| Outcome: | The proposed method outperforms several strong baselines and is general and effective to the task of unsupervised style transfer. |
Ensembling Large Language Models with Process Reward-Guided Tree Search for Better Complex Reasoning (2025.naacl-long)
Copied to clipboard
| Challenge: | Existing methods for ensembling language models fail to address complex reasoning tasks. |
| Approach: | They propose a framework for process-level ensembling of large language models using Monte Carlo tree search. |
| Outcome: | The proposed framework outperforms both language model decoding and language model ensemble methods on five reasoning benchmarks. |
CFSum Coarse-to-Fine Contribution Network for Multimodal Summarization (2023.acl-long)
Copied to clipboard
| Challenge: | Existing multimodal summarization models ignore the contribution of visual modalities . we propose a novel contribution network to consider different contributions of images . |
| Approach: | They propose a Coarse-to-Fine contribution network for multimodal summarization to consider different contributions of images for summarizing. |
| Outcome: | The proposed system outperforms baselines on the visual and textual modalities. |
On Isotropy, Contextualization and Learning Dynamics of Contrastive-based Sentence Representation Learning (2023.findings-acl)
Copied to clipboard
| Challenge: | Incorporating contrastive learning objectives in sentence representation learning has yielded significant improvements on many sentence-level NLP tasks. |
| Approach: | They aim to examine why contrastive learning works for learning sentence-level semantics . they interpret successes through the geometry of the representation shifts based on isotropy . |
| Outcome: | The proposed model improves on many sentence-level NLP tasks, but it is not well understood why it works. |
Syntax-guided Contrastive Learning for Pre-trained Language Model (2022.findings-acl)
Copied to clipboard
| Challenge: | Existing studies rely on additional syntax-driven attention components to enhance the transformer, which require more parameters and additional syntactic parsing in downstream tasks. |
| Approach: | They propose a syntax-guided contrastive learning method which does not change the transformer architecture and does not alter the transformer structure. |
| Outcome: | The proposed method achieves consistent improvements in a variety of tasks including grammatical error detection, entity tasks, structural probing and GLUE. |
Learning Event Graph Knowledge for Abductive Reasoning (2021.acl-long)
Copied to clipboard
| Challenge: | Existing models for abductive reasoning based on formal logic lack commonsense knowledge and effective reasoning mechanism. |
| Approach: | They propose a narrative text-based abductive reasoning task NLI with a latent variable to capture commonsense knowledge from event graph for guiding the abductive reasoning task. |
| Outcome: | The proposed model outperforms baseline methods on the abductive reasoning task. |
Demoting the Lead Bias in News Summarization via Alternating Adversarial Learning (2021.acl-short)
Copied to clipboard
| Challenge: | In news articles the lead bias dominates the learning signals for neural extractive summarizations, severely limiting their performance on data with different or even no bias. |
| Approach: | They propose a method to demote the lead bias in news and make the model focus more on the content semantics. |
| Outcome: | The proposed method can demote the model’s learned lead bias and improve its generality on out-of-distribution data with little to no performance loss on in-difference data. |
mPresenter: An Agentic Framework for Generating Multilingual Presentation Videos from Scientific Papers (2026.findings-acl)
Copied to clipboard
| Challenge: | Existing Paper2Video systems are monolingual and often rely on single-pass pipelines. |
| Approach: | They propose a multilingual agentic Paper2Video system that decomposes the task into planning, audience-oriented critique, layout-aware slide generation, and multilingual figure interpretation. |
| Outcome: | The proposed system improves question-answering accuracy relative to previous systems while maintaining affordable cost and latency. |
Too Long, Do Re-weighting for Efficient LLM Reasoning Compression (2026.acl-long)
Copied to clipboard
Zhong-Zhi Li, Xiao Liang, Zihao Tang, Lei Ji, Peijie Wang, Haotian Xu, Xing W, Haizhen Huang, Weiwei Deng, Yeyun Gong, Zhijiang Guo, Xiao Liu, Fei Yin, Cheng-Lin Liu
| Challenge: | Large Language Models (LLMs) have recently achieved remarkable progress on complex reasoning tasks by leveraging extended Chain-of-Thought (CoT) techniques. |
| Approach: | They propose a method that uses Extended Chain-of-Thought (EFT) to reduce the number of output tokens by nearly 40% while maintaining the accuracy of the reasoning. |
| Outcome: | The proposed method reduces the number of output tokens by nearly 40% while maintaining the accuracy of the reasoning. |
CogBERT: Cognition-Guided Pre-trained Language Models (2022.coling-1)
Copied to clipboard
| Challenge: | Existing methods fine-tune pre-trained models on cognitive data, ignoring the semantic gap between texts and cognitive signals. |
| Approach: | They propose a framework that can induce fine-grained cognitive features from cognitive data and incorporate them into pre-trained language models by adaptively adjusting the weight of cognitive features for different NLP tasks. |
| Outcome: | The proposed framework can induce fine-grained cognitive features from cognitive data and incorporate them into BERT by adaptively adjusting weight of cognitive features for different NLP tasks. |
Learning What to Share: Leaky Multi-Task Network for Text Classification (C18-1)
Copied to clipboard
| Challenge: | Existing approaches to multi-task learning suffer from the interference between tasks because they lack selection mechanism for feature sharing. |
| Approach: | They propose a multi-task convolutional neural network with the Leaky Unit which has memory and forgetting mechanism to filter the feature flows between tasks. |
| Outcome: | The proposed model can filter feature flows between tasks and improve performance on five datasets. |
PTCSpell: Pre-trained Corrector Based on Character Shape and Pinyin for Chinese Spelling Correction (2023.findings-acl)
Copied to clipboard
| Challenge: | Chinese spelling correction (CSC) is a task which detects incorrect characters in Chinese text and corrects them. |
| Approach: | They propose to pre-train a Chinese spelling correction corrector under the detector-corrector architecture and propose to capture pronunciation and shape information in Chinese characters. |
| Outcome: | The proposed corrector achieves an average of 5.8% F1 improvements over state-of-the-art methods, verifying its effectiveness. |
Lattice-Based Transformer Encoder for Neural Machine Translation (P19-1)
Copied to clipboard
| Challenge: | Neural machine translation (NMT) takes deterministic sequences for source representations. However, word-level or subword-level segmentation has multiple choices to split a source sequence with different word segmentors or different subword vocabulary sizes. |
| Approach: | They propose lattice-based encoders to explore effective word or subword representations in an automatic way during training. |
| Outcome: | The proposed encoders can explore effective word or subword representation in an automatic way during training. |
ET5: A Novel End-to-end Framework for Conversational Machine Reading Comprehension (2022.coling-1)
Copied to clipboard
| Challenge: | Existing methods require three steps to understand text, but span extraction and question rephrasing steps are not fully exploited. |
| Approach: | They propose a framework for conversational machine reading comprehension based on shared parameter mechanism . experimental results show the proposed framework achieves new state-of-the-art results on the ShARC leaderboard . |
| Outcome: | The proposed framework achieves state-of-the-art on the ShARC leaderboard with the BLEU-4 score of 55.2. |
Infusing Hierarchical Guidance into Prompt Tuning: A Parameter-Efficient Framework for Multi-level Implicit Discourse Relation Recognition (2023.acl-long)
Copied to clipboard
| Challenge: | Multi-level implicit discourse relation recognition (MIDRR) aims at identifying hierarchical discourse relations among arguments. |
| Approach: | They propose a prompt-based multi-level implicit discourse relation recognition framework that leverages parameter-efficient prompt tuning to drive inputted arguments to match the pre-trained space. |
| Outcome: | The proposed framework achieves comparable results on PDTB 2.0 and 3.0 using about 0.1% trainable parameters compared with baselines. |
DGST: a Dual-Generator Network for Text Style Transfer (2020.emnlp-main)
Copied to clipboard
| Challenge: | Existing studies on text style transfer focus on altering sentiment words to preserve attribute-independent information. |
| Approach: | They propose a Dual-Generator network architecture for text Style Transfer using two generators. |
| Outcome: | The proposed model performs better than existing models on Yelp and IMDb datasets. |
Event Representation Learning Enhanced with External Commonsense Knowledge (D19-1)
Copied to clipboard
| Challenge: | Existing methods to learn event representations from text lack commonsense knowledge about the intents and emotions of event participants. |
| Approach: | They propose to leverage external commonsense knowledge about the intent and sentiment of the event to learn distributed representations for structured events from text. |
| Outcome: | The proposed model improves on hard similarity tasks and yields more precise inferences on subsequent events under given contexts. |
ReCo: Reliable Causal Chain Reasoning via Structural Causal Recurrent Neural Networks (2022.emnlp-main)
Copied to clipboard
| Challenge: | Causal chain reasoning models suffer from two main transitive problems: threshold effect and scene drift. |
| Approach: | They propose a framework that uses exogenous variables to represent causal pairs and estimates the threshold and scene contradictions using structural causal recurrent neural networks. |
| Outcome: | The proposed framework outperforms baselines on Chinese and English CCR datasets. |
PivotAttack: Rethinking the Search Trajectory in Hard-Label Text Attacks via Pivot Words (2026.findings-acl)
Copied to clipboard
| Challenge: | Existing hard-label text attacks rely on inefficient "outside-in" strategies that traverse vast search spaces. |
| Approach: | They propose a query-efficient "inside-out" framework that perturbs Pivot Sets to induce label flips. |
| Outcome: | The proposed framework outperforms state-of-the-art methods in both Attack Success Rate and query efficiency. |
FuxiTranyu: A Multilingual Large Language Model Trained with Balanced Data (2024.emnlp-industry)
Copied to clipboard
Haoran Sun, Renren Jin, Shaoyang Xu, Leiyu Pan, null Supryadi, Menglong Cui, Jiangcun Du, Yikun Lei, Lei Yang, Ling Shi, Juesi Xiao, Shaolin Zhu, Deyi Xiong
| Challenge: | Large language models exhibit significant performance discrepancies between high- and low-resource languages. |
| Approach: | They present an open-source multilingual LLM with 8 billion parameters and a multilingual instruction dataset. |
| Outcome: | The proposed model achieves consistent multilingual representations across languages. |
Beyond Single-Event Extraction: Towards Efficient Document-Level Multi-Event Argument Extraction (2024.findings-acl)
Copied to clipboard
Wanlong Liu, Li Zhou, DingYi Zeng, Yichen Xiao, Shaohuan Cheng, Chen Zhang, Grandee Lee, Malu Zhang, Wenyu Chen
| Challenge: | mainstream event argument extraction methods process each event in isolation, resulting in inefficient inference and ignoring correlations among multiple events. |
| Approach: | They propose a multi-event argument argument extraction model which extracts arguments from all events simultaneously. |
| Outcome: | The proposed model performs better on four public datasets while saving time. |
Test-time Backdoor Mitigation for Black-Box Large Language Models with Defensive Demonstrations (2025.findings-naacl)
Copied to clipboard
| Challenge: | Existing studies on backdoor defense have focused on training phase, overlooking critical aspect of testing time defense. |
| Approach: | They propose to use demonstrations as a defense mechanism against backdoor attacks in black-box LLMs. |
| Outcome: | The proposed method outperforms existing defense baselines across most evaluation scenarios. |
Automatic Table Union Search with Tabular Representation Learning (2023.findings-acl)
Copied to clipboard
Xuming Hu, Shen Wang, Xiao Qin, Chuan Lei, Zhengyuan Shen, Christos Faloutsos, Asterios Katsifodimos, George Karypis, Lijie Wen, Philip S. Yu
| Challenge: | Existing methods to identify uniability based on column representations are insufficient to reveal latent relational features to describe column relation between pair of columns. |
| Approach: | They propose a self-supervised table union search framework called AutoTUS to learn column relational representations in a multi-stage manner. |
| Outcome: | The proposed framework improves on the SOTA baseline and on real-world datasets. |
Federated Document-Level Biomedical Relation Extraction with Localized Context Contrast (2024.lrec-main)
Copied to clipboard
| Challenge: | Existing studies on relation extraction focus on document-level training without sharing raw medical texts. |
| Approach: | They propose a federated framework for relation extraction that enables collaborative training without sharing raw medical texts. |
| Outcome: | The proposed framework extends document-level relation extraction to a federated environment. |
Improving End-to-End Speech Processing by Efficient Text Data Utilization with Latent Synthesis (2023.findings-emnlp)
Copied to clipboard
| Challenge: | Latent Synthesis is an efficient textual data utilization framework for end-to-end speech processing models . labeled speech data are scarcer and more expensive for collection compared to textual ones . |
| Approach: | They propose a textual data utilization framework for E2E speech processing models . they train a latent synthesizer to convert textual information into an intermediate latent representation . |
| Outcome: | The proposed framework improves on low-resource speech recognition and spoken language understanding tasks. |
Revisiting Chain-of-Thought Prompting: Zero-shot Can Be Stronger than Few-shot (2025.findings-emnlp)
Copied to clipboard
| Challenge: | In-Context Learning (ICL) is an essential emergent ability of Large Language Models (LLMs). |
| Approach: | They introduce CoT to exemplars of ICL to enhance the reasoning capability . however, it remains unclear whether CoT exemplar is still beneficial for recent, stronger models in such tasks. |
| Outcome: | The enhanced exemplars fail to improve the model’s reasoning performance, despite being constructed using answers from advanced models such as Qwen2.5-Max and DeepSeek-R1. |
AGrail: A Lifelong Agent Guardrail with Effective and Adaptive Safety Detection (2025.acl-long)
Copied to clipboard
| Challenge: | Existing defense agencies fail to adaptively and effectively mitigate these risks. |
| Approach: | They propose a lifelong agent guardrail that enhances LLM agent safety by enabling adaptive safety check generation, effective safety check optimization, and tool compatibility & flexibility. |
| Outcome: | The proposed agent guardrail achieves strong performance against task-specific and systemic risks and is transferable across different LLM agents’ tasks. |
Lunar Twins: We Choose to Go to the Moon with Large Language Models (2025.findings-acl)
Copied to clipboard
| Challenge: | Lunar Twins is the first LLM designed specifically for lunar exploration . Lunar GenData is a multi-agent collaborative workflow for generating lunar instructions . |
| Approach: | They propose a framework that combines both large and small LLMs and Lunar GenData, which integrates real data from Chang'e lunar missions. |
| Outcome: | Experimental validation shows that the proposed framework enhances domain expertise and reveals indications of embodied intelligence potential. |
Rethinking LLM Uncertainty: A Multi-Agent Approach to Estimating Black-Box Model Uncertainty (2025.findings-emnlp)
Copied to clipboard
Yu Feng, Phu Mon Htut, Zheng Qi, Wei Xiao, Manuel Mager, Nikolaos Pappas, Kishaloy Halder, Yang Li, Yassine Benajiba, Dan Roth
| Challenge: | Existing methods to gauge model’s uncertainty through self-consistency in responses to the target query are misleading: an LLM may confidently provide an incorrect answer to a target query, yet give a confident and accurate answer to that same query when answering a knowledge-preserving perturbation of the query. |
| Approach: | They propose a method that uses multi-agent interaction to estimate black-box LLMs' uncertainty. |
| Outcome: | The proposed method outperforms existing self-consistency based methods and improves hallucination detection. |
Leveraging Unit Language Guidance to Advance Speech Modeling in Textless Speech-to-Speech Translation (2025.findings-acl)
Copied to clipboard
Yuhao Zhang, Xiangnan Ma, Kaiqi Kou, Peizhuo Liu, Weiqiao Shan, Benyou Wang, Tong Xiao, Yuxin Huang, Zhengtao Yu, JingBo Zhu
| Challenge: | Existing textless speech-to-speech translation models have two main challenges: 1) learning cross-modal features and 2) learning alignment of difference languages in long sequences. |
| Approach: | They propose a unit language to overcome two main modeling challenges . they propose task prompt modeling to utilize the unit language in guiding the modeling process. |
| Outcome: | The proposed language improves over a strong baseline and achieves comparable performance to models trained with text. |
WikiDiverse: A Multimodal Entity Linking Dataset with Diversified Contextual Topics and Entity Types (2022.acl-long)
Copied to clipboard
| Challenge: | Multimodal Entity Linking (MEL) is an essential task for many multimodal applications. |
| Approach: | They propose to use a human-annotated Wikipedia-based multimodal entity linking dataset to improve the quality of existing MEL models. |
| Outcome: | The proposed model uses the visual information of images more effectively than existing models. |
Shared-Private Bilingual Word Embeddings for Neural Machine Translation (P19-1)
Copied to clipboard
| Challenge: | Word embedding is central to neural machine translation, but indirectly interfaces with other layers, making them comparatively isolated. |
| Approach: | They propose a shared-private bilingual word embedding which gives a closer relationship between the source and target embedders and reduces the number of model parameters. |
| Outcome: | The proposed model improves on 5 language pairs belonging to 6 different language families and written in 5 different alphabets and significantly reduces model parameters. |
Weight Distillation: Transferring the Knowledge in Neural Network Parameters (2021.acl-long)
Copied to clipboard
| Challenge: | Knowledge distillation is an effective method for model acceleration and compression. |
| Approach: | They propose to use parameters to distill knowledge from large neural networks to small ones . they propose to do this by using a parameter generator to transfer the knowledge to a small neural network . |
| Outcome: | The proposed method learns a small network 1.88 2.94x faster than the large network but with competitive BLEU points. |
MotiveBench: How Far Are We From Human-Like Motivational Reasoning in Large Language Models? (2025.findings-acl)
Copied to clipboard
| Challenge: | Existing benchmarks for large language models lack information asymmetry with real-world situations. |
| Approach: | They propose a benchmark to evaluate the human-like motivational and behavioral reasoning ability of LLMs with detailed, realistic situations. |
| Outcome: | The proposed benchmark compared LLMs with real-world scenarios on seven model families and found that the most advanced models struggle with understanding "love & belonging" needs. |
WeCheck: Strong Factual Consistency Checker via Weakly Supervised Learning (2023.acl-long)
Copied to clipboard
| Challenge: | Existing factual consistency metrics are often uncontrollably generating text that is factually inconsistent with inputs. |
| Approach: | They propose a weakly supervised framework that is directly trained on actual generated samples from language models with weakly annotated labels. |
| Outcome: | The proposed framework improves on the TRUE benchmark by 3.3% over existing methods with 435M parameters. |
Unity in Diversity: Collaborative Pre-training Across Multimodal Medical Sources (2024.acl-long)
Copied to clipboard
Xiaochen Wang, Junyu Luo, Jiaqi Wang, Yuan Zhong, Xiaokun Zhang, Yaqing Wang, Parminder Bhatia, Cao Xiao, Fenglong Ma
| Challenge: | Current pre-training techniques rely on a limited scope of medical data, limiting the range of downstream tasks. |
| Approach: | They propose a pre-training strategy that unifies patient data within individual sources and captures explicit and implicit correlations between patients across different sources. |
| Outcome: | The proposed strategy bridges the gap between multimodal medical sources by aggregating patient data within individual sources and capturing explicit and implicit correlations between patients across sources. |
DynamixSFT: Dynamic Mixture Optimization of Instruction Tuning Collections (2026.findings-acl)
Copied to clipboard
| Challenge: | Several studies rely on additional models to optimize mixtures. |
| Approach: | They propose a method that dynamically optimizes instruction-tuning dataset mixtures by prior-scaled Boltzmann Exploration and a multi-armed bandit setup. |
| Outcome: | The proposed method improves the TÜLU-2-mixture and TÜLO-3-mixtures across 10 benchmarks while introducing minimal computational overhead over naive sampling. |
SELFGOAL: Your Language Agents Already Know How to Achieve High-level Goals (2025.naacl-long)
Copied to clipboard
Ruihan Yang, Jiangjie Chen, Yikai Zhang, Siyu Yuan, Aili Chen, Kyle Richardson, Yanghua Xiao, Deqing Yang
| Challenge: | Existing approaches to improve the performance of language agents without training are not available. |
| Approach: | They propose an automatic approach to break down high-level goals into tree structure of more practical subgoals during interaction with environments while identifying the most useful subgoal. |
| Outcome: | The proposed approach significantly improves the performance of language agents across various tasks, including competitive, cooperative, and deferred feedback environments. |
RCL: Relation Contrastive Learning for Zero-Shot Relation Extraction (2022.findings-naacl)
Copied to clipboard
| Challenge: | Existing approaches to extract relations require large-scale labeled data. |
| Approach: | They propose a Relation Contrastive Learning framework to mitigate similar relations and similar entities problems by optimizing a contrastive instance loss with a relation classification loss on seen relations. |
| Outcome: | The proposed framework can learn subtle difference between instances and achieve better separation between different relation categories in the representation space simultaneously. |
The “Knowledge–Behavior Gap” in Cultural Taboo Safety of Large Language Models (2026.acl-long)
Copied to clipboard
Ying He, Sihang Jiang, Xingzhou Chen, Zhouhong Gu, Yiwei Gu, Minggui HE, Shimin Tao, null Mahongxia, Yanghua Xiao
| Challenge: | Existing cultural benchmarks assess cultural knowledge or values biases, but ignore cultural taboos. |
| Approach: | They propose a benchmark to evaluate and improve the cultural taboo safety of large language models. |
| Outcome: | The proposed benchmark spans 77 countries and regions, and includes over 2,020 taboos. |
Stimulate the Critical Thinking of LLMs via Debiasing Discussion (2025.emnlp-main)
Copied to clipboard
| Challenge: | Existing studies show that large language models (LLMs) are often prone to stance homogeneity and human preference biases when faced with conflicting perspectives. |
| Approach: | They propose a novel two-stage training framework to address stance homogeneity bias and human preference bias by generating multi-model discussion datasets and optimizing reinforcement learning from human feedback to align with discussion correctness. |
| Outcome: | The proposed framework reduces stance homogeneity bias and human preference bias and improves generalization capabilities on non-discussion scenarios and out-of-domain datasets. |
Modality Adaption or Regularization? A Case Study on End-to-End Speech Translation (2023.acl-short)
Copied to clipboard
| Challenge: | End-to-end speech translation models have limited training data and are often inefficient due to the inconsistency of length and representation between speech and text. |
| Approach: | They find that the "modality gap" between speech and text data is not a major problem in E2E ST . they decouple the encoder to speech encoder and text encoder, and they find that there is a 'capacity gap' |
| Outcome: | The proposed model achieves 29.0 for en-de and 40.3 for fr on the MuST-C dataset. |
Cross-Lingual Phrase Retrieval (2022.acl-long)
Copied to clipboard
| Challenge: | Existing approaches to cross-lingual phrase retrieval learn word or sentence representations in word or sentences. |
| Approach: | They propose a cross-lingual phrase retrieval model that extracts phrase representations from unlabeled example sentences. |
| Outcome: | The proposed model outperforms state-of-the-art methods on a large-scale cross-lingual phrase retrieval dataset, showing it can perform in an unseen language pair during training. |
Bag of Tricks for Optimizing Transformer Efficiency (2021.findings-emnlp)
Copied to clipboard
| Challenge: | Improving Transformer efficiency has become increasingly attractive in recent years. |
| Approach: | They propose to combine pruning, quantization, new architectures and training strategies to improve Transformer efficiency. |
| Outcome: | The proposed methods improve the inference efficiency of a strong Transformer system by 3.80x on CPU and 2.52x on GPU. |
An Empirical Study of Iterative Refinements for Non-autoregressive Translation (2025.acl-long)
Copied to clipboard
| Challenge: | Iterative non-autoregressive (NAR) models have recently demonstrated impressive performance in varied generation tasks, surpassing the autoregressive Transformer. |
| Approach: | They propose a strategy to conduct efficient refinements without performance declines by using two simple metrics to identify potential problems existing in current refinement processes. |
| Outcome: | The proposed model outperforms the autoregressive Transformer by around one BLEU on average. |
Velocitune: A Velocity-based Dynamic Domain Reweighting Method for Continual Pre-training (2025.acl-long)
Copied to clipboard
| Challenge: | Existing methods to optimise pretraining performance have not addressed the complexities of domain-adaptive continual pretraining. |
| Approach: | They propose a framework that dynamically assesses learning velocity and adjusts data proportions accordingly, favouring slower learning domains while de-emphasising faster learning ones. |
| Outcome: | The proposed framework achieves performance gains in math and code reasoning tasks and command-line generation benchmarks. |
Do LLMs Catch Their Own Mistakes? A Comprehensive Benchmark for Reflective Tool Use LLMs (2026.findings-acl)
Copied to clipboard
| Challenge: | Existing benchmarks primarily evaluate planning and execution success, overlooking the self-reflective dimension of tool use. |
| Approach: | They propose a benchmark to assess LLMs’ self-reflective reasoning in tool-augmented multi-turn dialogues. |
| Outcome: | The proposed benchmark covers 10 domains with 88 distinct APIs and 968 annotated dialogues, systematically injecting diverse error types arising from both user and assistant behavior. |
TrInk: Ink Generation with Transformer Network (2025.emnlp-main)
Copied to clipboard
Zezhong Jin, Shubhang Desai, Xu Chen, Biyi Fang, Zhuoyi Huang, Zhe Li, Chong-Xin Gan, Xiao Tu, Man-Wai Mak, Yan Lu, Shujie Liu
| Challenge: | Existing methods for handwriting generation capture global dependencies and can generate high-quality handwritten samples. |
| Approach: | They propose a Transformer-based model for ink generation, TrInk, which captures global dependencies. |
| Outcome: | The proposed model reduces character error rate and word error rate by 35.56% on the IAM-OnDB dataset compared to previous models. |
Event Pattern-Instance Graph: A Multi-Round Role Representation Learning Strategy for Document-Level Event Argument Extraction (2025.findings-acl)
Copied to clipboard
| Challenge: | Existing role-based span selection strategies ignore interrelations between events . authors propose a multi-round role representation learning strategy for document-level event argument extraction . |
| Approach: | They propose a pattern-instance graph to capture role semantics embedded in various associations . they also propose re-inventing the role representations learned from previous analyzed documents . |
| Outcome: | The proposed model captures role semantics embedded in various associations . iteratively updates representations of role nodes and edges to enrich their semantic information . the model improves prediction performance in subsequent rounds of span selection . |
FLAIR: Steering LLM Mathematical Problem Solving based on A Fuzzy-Logic-AssIsted Reasoner (2026.acl-long)
Copied to clipboard
Hao Wu, Hongru Sun, Wanqing Li, Xinguo Yu, Hao Ming, Xiao Luo, Wenbin Zhang, Jiahong Zhao, Yi Guo, Jie Yang
| Challenge: | Existing approaches to mathematical reasoning rely on static heuristics or pre-determined reasoning strategies. |
| Approach: | They propose an adaptive framework that integrates fuzzy theory into LLM-based mathematical reasoning. |
| Outcome: | The proposed framework outperforms state-of-the-art models while offering effective and interpretable diagnostics of intermediate problem-solving states. |
Dual-Channel Evidence Fusion for Fact Verification over Texts and Tables (2022.naacl-main)
Copied to clipboard
| Challenge: | Existing fact extraction and verification tasks only consider evidence of a single format . Existing models convert evidence into either sentences or tables, thus losing context information . |
| Approach: | They propose a Dual Channel Unified Format fact verification model which unifies various evidence into parallel streams, i.e., natural language sentences and a global evidence table, simultaneously. |
| Outcome: | The proposed model outperforms existing models in two formats by a large margin . it makes the most of existing tables and tables to absorb evidence of two formats . |
Reason from Fallacy: Enhancing Large Language Models’ Logical Reasoning through Logical Fallacy Understanding (2024.findings-naacl)
Copied to clipboard
| Challenge: | Large Language Models (LLMs) have demonstrated good performance in many reasoning tasks, but struggle with some more complex reasoning tasks including logical reasoning. |
| Approach: | They propose five concrete tasks from three cognitive dimensions of WHAT, WHY, and HOW to evaluate LLMs’ capability of logical fallacy understanding. |
| Outcome: | The proposed dataset can be used to evaluate LLMs’ LFU capability and to fine-tune LLM models to obtain significantly enhanced performance on logical reasoning. |
Pruning Adatperfusion with Lottery Ticket Hypothesis (2022.findings-naacl)
Copied to clipboard
| Challenge: | Pre-trained language models are computationally expensive to fine-tune and require large storage. |
| Approach: | They propose a method to identify the influence of each adapter module and a way to prune adapters based on the Lottery Ticket Hypothesis. |
| Outcome: | The proposed model reduces size significantly while keeping performance intact. |
Learning Geometry-Aware Representations for New Intent Discovery (2024.acl-long)
Copied to clipboard
| Challenge: | Existing methods for intent classification fail to distinguish new intents due to intertwined centers . a novel framework that learns geometry-aware representations to maximally separate all intents is proposed . |
| Approach: | They propose a new intent discovery framework that learns geometry-aware representations to maximally separate all intents. |
| Outcome: | The proposed framework achieves a new state-of-the-art performance on three benchmarking datasets. |
IFlyEA: A Chinese Essay Assessment System with Automated Rating, Review Generation, and Recommendation (2021.acl-demo)
Copied to clipboard
| Challenge: | Automated Essay Assessment (AEA) aims to judge students’ writing proficiency in an automatic way. |
| Approach: | They propose to use Chinese AEA system IFlyEssayAssess to evaluate essays written by native Chinese students from primary and junior schools. |
| Outcome: | The proposed system provides application services for essay scoring, review generation, recommendation, and explainable analytical visualization. |
LoRAMoE: Alleviating World Knowledge Forgetting in Large Language Models via MoE-Style Plugin (2024.acl-long)
Copied to clipboard
Shihan Dou, Enyu Zhou, Yan Liu, Songyang Gao, Wei Shen, Limao Xiong, Yuhao Zhou, Xiao Wang, Zhiheng Xi, Xiaoran Fan, Shiliang Pu, Jiang Zhu, Rui Zheng, Tao Gui, Qi Zhang, Xuanjing Huang
| Challenge: | Experimental results show that, as the instruction data increases, LoRAMoE can significantly improve the ability to process downstream tasks, while maintaining the world knowledge stored in the LLM. |
| Approach: | They propose a framework that introduces several low-rank adapters and integrates them by using a router network to freeze the backbone model and force a portion of LoRAs to focus on leveraging world knowledge to solve downstream tasks. |
| Outcome: | The proposed framework freezes the backbone model and forces a portion of LoRAs to focus on leveraging world knowledge to solve downstream tasks, to alleviate world knowledge forgetting. |
Experience-driven Multi-turn Reinforcement Learning for GUI Agents (2026.acl-long)
Copied to clipboard
Zhengxi Lu, Jiabo Ye, Fei Tang, Yongliang Shen, Haiyang Xu, Ziwei Zheng, Weiming Lu, Ming Yan, Fei Huang, Jun Xiao, Yueting Zhuang
| Challenge: | GUI agents have demonstrated remarkable progress in automating complex user interface interactions . training such agents for long-horizon tasks remains challenging due to limited rewards and prohibitive costs. |
| Approach: | They propose a method that leverages expert trajectories as environment experiences for on-policy multi-turn training. |
| Outcome: | The proposed method achieves significant gains over the base model with 1K public trajectories as RL experiences . it achieves competitive performance against strong baselines such as UI-TARS-7B and GPT-4o . |
MentalSeek-Dx: Towards Progressive Hypothetico-Deductive Reasoning for Real-world Psychiatric Diagnosis (2026.acl-long)
Copied to clipboard
Xiao Sun, null Ymyang, Xinyi Jiang, Yu Tian, Junnan Zhu, Jiang Zhong, Qin Lei, Jingwang Huang, Haoyang Zeng, Xinyu Zhou, Xin Xiao, Kaiwen Wei
| Challenge: | Mental health disorders represent a burgeoning global public health challenge . lack of ecological validity and fine-grained diagnostic supervision limits their utility . |
| Approach: | They propose a medical-specialized LLM trained to internalize clinical reasoning process through supervised trajectory construction and curriculum-based reinforcement learning. |
| Outcome: | The proposed model achieves state-of-the-art with only 14B parameters, establishing a clinically grounded framework for reliable psychiatric diagnosis. |
OpenWebAgent: An Open Toolkit to Enable Web Agents on Large Language Models (2024.acl-demos)
Copied to clipboard
Iat Long Iong, Xiao Liu, Yuxuan Chen, Hanyu Lai, Shuntian Yao, Pengbo Shen, Hao Yu, Yuxiao Dong, Jie Tang
| Challenge: | OpenWebAgent integrates large language models and large multimodal models to improve web automation. |
| Approach: | They propose to integrate large language models and large multimodal models into an open toolkit to optimize web automation. |
| Outcome: | The open toolkit integrates both large language models (LLMs) and large multimodal models (LMMs) it enables the development of powerful, task-oriented web agents, significantly enhancing user experience and operational efficiency on the web. |
Are Large Language Models Reliable Reviewers? A Benchmark for Error Detection in Financial Documents (2026.findings-acl)
Copied to clipboard
Ying He, Zhouhong Gu, Zhecheng Hu, Yubo Zhou, Hao Shen, Jiaqing Liang, Zhaoqian Dai, Ma Shuguang, Fei Yu, Yanghua Xiao, Zhixu Li
| Challenge: | Existing LLMs struggle to identify errors in financial documents, a study shows . 18% of financial practitioners make errors daily, one-third make errors several times weekly, and 59% make errors multiple times monthly. |
| Approach: | They introduce FinED-Bench, a publicly available Benchmark for financial error detection . it covers nine real-world financial scenarios and includes over 900 documents in 2025 . supervised fine-tuning can significantly improve the performance of weaker LLMs, they show . |
| Outcome: | The proposed benchmark covers nine real-world financial scenarios and includes over 900 documents reported in 2025 that are unseen by existing language models. |
Gated Multi-Task Network for Text Classification (N18-2)
Copied to clipboard
| Challenge: | Existing approaches to multitask learning share the features without distinguishing the usefulness of the features, generating undesired interference between tasks. |
| Approach: | They propose to introduce a gate mechanism into multi-task CNN and propose a new gated sharing unit which can filter the feature flows between tasks and greatly reduce the interference. |
| Outcome: | The proposed approach can learn selection rules automatically and gain a great improvement over strong baselines. |
Chart-MRAG: Benchmarking Multimodal Retrieval Augmented Generation on Chart-based Documents (2026.acl-long)
Copied to clipboard
null Ymyang, Jiang Zhong, Li Jin, Xiao Sun, Jingwang Huang, null Gaojinpeng, Qing Liu, Yang Bai, Jingyuan Zhang, Rui Jiang, Qin Lei, Kaiwen Wei
| Challenge: | Existing benchmarks focus on simple image-text interactions, overlooking complex visual formats like charts. |
| Approach: | They propose a semi-automatic framework for generating evaluation samples through multi-modal keypoint extraction, knowledge graph construction, and qa pair synthesis. |
| Outcome: | The proposed framework generates 4,738 question-answering pairs across 8 domains from real-world documents. |
When Correct Beliefs Collapse: Epistemic Resilience of LLMs under Clinical Pressure (2026.acl-long)
Copied to clipboard
| Challenge: | Existing models exhibit severe multi-turn sycophancy in clinical dialogue . high initial diagnostic capability does not imply high belief stability . |
| Approach: | They propose a stress test framework that evaluates belief stability under escalating pressure. |
| Outcome: | The proposed stress test framework reduces the risk of multi-turn sycophancy in clinical dialogue . it eliminates belief change and improves robustness in training time . |
JiraiBench: A Bilingual Benchmark for Evaluating Large Language Models’ Detection of Human risky health behavior Content in Jirai Community (2026.eacl-long)
Copied to clipboard
Yunze Xiao, Tingyu He, Lionel Z. Wang, Yiming Ma, Xingyu Song, Xiaohang Xu, Mona T. Diab, Irene Li, Ka Chung Ng
| Challenge: | a cross-lingual dataset captures a transnational cultural phenomenon . risky health behaviors (RHB) are often linked to complex mental health conditions . |
| Approach: | They present the first cross-lingual dataset that captures a transnational cultural phenomenon . their dataset of more than 15,000 annotated social media posts forms the core of JiraiBench . |
| Outcome: | The study shows that cultural context can be more influential than linguistic similarity . the study also shows that the Japanese prompts better handle Chinese content . |
Modeling Multi-mapping Relations for Precise Cross-lingual Entity Alignment (D19-1)
Copied to clipboard
| Challenge: | Entity alignment aims to find entities in different knowledge graphs (KGs) that refer to the same real-world object. |
| Approach: | They propose to use dot product-based functions to define dot products over embeddings to better capture semantics of 1-N, N-1 and N-N relations. |
| Outcome: | The proposed framework outperforms existing methods on multilingual datasets. |
Towards Explainable Temporal Reasoning in Large Language Models: A Structure-Aware Generative Framework (2025.findings-acl)
Copied to clipboard
| Challenge: | Existing studies on temporal reasoning models neglect the explainable reasoning processes underlying the results. |
| Approach: | They propose a structure-aware generative framework that integrates Graph structures with text for Explainable TEmporal Reasoning. |
| Outcome: | The proposed framework achieves state-of-the-art performance while also demonstrating robust generalization capabilities. |
Open Domain Event Extraction Using Neural Latent Variable Models (P19-1)
Copied to clipboard
| Challenge: | Existing work on extracting events from news documents focuses on a set of pre-specified event types. |
| Approach: | They propose a latent variable neural model which is scalable to large corpus. |
| Outcome: | The proposed model performs better than the state-of-the-art method for event schema induction. |
Joint Multi-modal Aspect-Sentiment Analysis with Auxiliary Cross-modal Relation Detection (2021.emnlp-main)
Copied to clipboard
| Challenge: | Existing studies on aspect-level sentiment analysis focus on extracting aspect terms and sentiment polarities separately. |
| Approach: | They propose a multi-modal joint learning approach with auxiliary cross-modal relation detection for multi-dimensional aspect-level sentiment analysis. |
| Outcome: | The proposed approach can obtain all aspect-level sentiment polarities dependent on the jointly extracted specific aspects. |
HermEs: Interactive Spreadsheet Formula Prediction via Hierarchical Formulet Expansion (2023.acl-long)
Copied to clipboard
Wanrong He, Haoyu Dong, Yihuai Gao, Zhichao Fan, Xingzhuo Guo, Zhitao Hou, Xiao Lv, Ran Jia, Shi Han, Dongmei Zhang
| Challenge: | HermEs is a spreadsheet formula prediction language that is difficult for Excel users without programming experience to master. |
| Approach: | They propose a hierarchical approach to formula prediction via HiEraRchical forMulet ExpanSion . they propose generating formulas in a fixed order using hierarchically generated formulas . |
| Outcome: | The proposed approach improves formula prediction accuracy by guaranteeing correct grammar and streamlining token-level decoding with high-level Formulet. |
Text Fluoroscopy: Detecting LLM-Generated Text through Intrinsic Features (2024.emnlp-main)
Copied to clipboard
| Challenge: | Large language models (LLMs) have revolutionized the field of natural language processing because of their excellent performance on various tasks. |
| Approach: | They propose a black-box method with better generalizability for detecting LLM-generated text by mining the intrinsic features of the text to be detected. |
| Outcome: | The proposed method achieves 7.36% and 2.84% improvement in detection performance compared to baselines in detecting texts from different domains generated by GPT-4 and Claude3 respectively. |
Reasoning as Gradient: Scaling MLE Agents Beyond Tree Search (2026.findings-acl)
Copied to clipboard
Yifei Zhang, Xu Yang, Xiao Yang, Bowen Xian, Qizheng Li, Shikai Fang, Jingyuan Li, Jian Wang, Minrui Xu, Yuge Zhang, Weiqing Liu, Jiang Bian
| Challenge: | LLM-based agents for machine learning engineering rely on tree search to rank candidates. |
| Approach: | They propose an LLM-based agent that operationalizes gradient-based optimization. |
| Outcome: | The proposed agent achieves a state-of-the-art 35.1% any-medal rate on MLE-Bench with a limited budget on a single GPU. |
SEGMENT+: Long Text Processing with Short-Context Language Models (2024.emnlp-main)
Copied to clipboard
Wei Shi, Shuang Li, Kerun Yu, Jinglei Chen, Zujie Liang, Xinhui Wu, Yuxi Qian, Feng Wei, Bo Zheng, Jiaqing Liang, Jiangjie Chen, Yanghua Xiao
| Challenge: | Existing frameworks that increase context window do not guarantee robust performance across long input tasks. |
| Approach: | They propose a framework that enables language models to handle extended inputs within limited context windows efficiently. |
| Outcome: | The framework improves performance on long-document question-answering and Needle-in-a-Haystack tasks. |
Order Doesn’t Matter, But Reasoning Does: Training LLMs with Order-Centric Augmentation (2025.emnlp-main)
Copied to clipboard
| Challenge: | Logical reasoning is essential for large language models (LLMs) to ensure accurate and coherent inferences. |
| Approach: | They propose an order-centric data augmentation framework based on commutativity in logical reasoning that randomly shuffles independent premises to introduce condition order augmentation. |
| Outcome: | The proposed framework improves LLMs’ reasoning performance and adaptability to diverse logical structures. |
SKEP: Sentiment Knowledge Enhanced Pre-training for Sentiment Analysis (2020.acl-main)
Copied to clipboard
| Challenge: | sentiment knowledge is ignored in sentiment analysis, despite its use in pretraining. |
| Approach: | They propose to use sentiment knowledge to learn a unified sentiment representation for multiple sentiment analysis tasks. |
| Outcome: | The proposed method outperforms strong pre-training baseline on three kinds of sentiment tasks. |
V-DPO: Mitigating Hallucination in Large Vision Language Models via Vision-Guided Direct Preference Optimization (2024.findings-emnlp)
Copied to clipboard
| Challenge: | Existing large vision-language models suffer from hallucination due to over-reliance on the Large Language Model (LLM) backbone. |
| Approach: | They propose a method to improve visual context learning by using a large-scale preference learning algorithm to improve hallucination. |
| Outcome: | The proposed method improves on human-annotated hallucination datasets. |
Immediate Inference: The Missing Foundation in Large Language Model Logical Reasoning (2026.acl-long)
Copied to clipboard
| Challenge: | Recent work on LLMs has focused on fine-grained skill decomposition and consistency probing at the propositional level. |
| Approach: | They propose a benchmark evaluating immediate inference that evaluates elemental operations over categorical propositions and proposes a model that uses immediate inferential reasoning. |
| Outcome: | The proposed benchmark demonstrates that models lack robust operator grounding, oscillating between structural reasoning and surface pattern matching, inconsistent handling of quantifiers and negation. |
Guided Knowledge Generation with Language Models for Commonsense Reasoning (2024.findings-emnlp)
Copied to clipboard
| Challenge: | Large Language Models (LLMs) have achieved notable success in commonsense reasoning tasks, benefiting from extensive world knowledge acquired through extensive pretraining. |
| Approach: | They propose a method to generate knowledge explanations and to automatically assign labels based on the probability of correct answers. |
| Outcome: | The proposed method outperforms baselines on four widely-used commonsense reasoning benchmarks and shows that it can generate high quality knowledge leading to correct answers. |
FastKASSIM: A Fast Tree Kernel-Based Syntactic Similarity Metric (2023.eacl-main)
Copied to clipboard
| Challenge: | Existing syntactic similarity metrics are computationally expensive and inconsistent when faced with syntaktically dissimilar documents. |
| Approach: | They propose a metric which pairs and averages the most similar constituency parse trees between a pair of documents based on tree kernels. |
| Outcome: | The proposed metric is more robust to syntactic dissimilarities and runs up to 5.32 times faster than its predecessor over documents in the r/ChangeMyView corpus. |
MINER: Improving Out-of-Vocabulary Named Entity Recognition from an Information Theoretic Perspective (2022.acl-long)
Copied to clipboard
Xiao Wang, Shihan Dou, Limao Xiong, Yicheng Zou, Qi Zhang, Tao Gui, Liang Qiao, Zhanzhan Cheng, Xuanjing Huang
| Challenge: | Named Entity Recognition models are feature-engineering and machine learning based. |
| Approach: | They propose a new NER learning framework that uses entity mentions to improve model performance. |
| Outcome: | The proposed model achieves better performance on OOV entities on various settings and datasets. |
Task Oriented In-Domain Data Augmentation (2024.emnlp-main)
Copied to clipboard
| Challenge: | Existing methods for large language models suffer from two major issues: in-domain data are scarce compared with general domain-agnostic data. |
| Approach: | They propose a task-oriented in-domain data augmentation framework that uses in- domain data selection and task-orientated synthetic passage generation to adapt LLMs to two domains: advertisement and math. |
| Outcome: | The proposed framework improves LLM performance by 8% in the advertisement domain and 7.5% in the math domain. |
Exploring Key Point Analysis with Pairwise Generation and Graph Partitioning (2024.naacl-long)
Copied to clipboard
| Challenge: | Existing methods for key point analysis rely on semantic similarity instead of measuring the existence of shared key points . |
| Approach: | They propose a key point analysis approach with pairwise generation and graph partitioning to summarize arguments into a concise set of key points. |
| Outcome: | The proposed model surpasses existing models on ArgKP and QAM datasets. |
The Confidence Dichotomy: Analyzing and Mitigating Miscalibration in Tool-Use Agents (2026.acl-long)
Copied to clipboard
| Challenge: | a fundamental pillar of trustworthiness is calibration, which refers to an agent’s ability to express confidence that reliably reflects its actual performance. |
| Approach: | They propose a reinforcement learning framework that jointly optimizes task accuracy and calibration, supported by a holistic benchmark of reward designs. |
| Outcome: | The proposed framework improves calibration across tool types and shows that trained agents achieve superior calibration and exhibit robust generalization from local training environments to noisy web settings and to distinct domains such as mathematical reasoning. |
Re-ViLM: Retrieval-Augmented Visual Language Model for Zero and Few-Shot Image Captioning (2023.findings-emnlp)
Copied to clipboard
Zhuolin Yang, Wei Ping, Zihan Liu, Vijay Korthikanti, Weili Nie, De-An Huang, Linxi Fan, Zhiding Yu, Shiyi Lan, Bo Li, Mohammad Shoeybi, Ming-Yu Liu, Yuke Zhu, Bryan Catanzaro, Chaowei Xiao, Anima Anandkumar
| Challenge: | Existing methods for image-to-text generation store all knowledge within parameters, thus requiring computational-expensive fine-tuning. |
| Approach: | They propose a Retrieval-augmented Visual Language Model that stores all the knowledge within parameters and can be used to retrieve it from the external database. |
| Outcome: | The proposed model significantly boosts performance for image-to-text generation tasks with 4x less parameters compared with baseline methods. |
Enhancing Parameter-efficient Fine-tuning with Simple Calibration Based on Stable Rank (2024.lrec-main)
Copied to clipboard
| Challenge: | Existing methods for lightweight fine-tuning are ineffective in low-resource settings but fail in high-resourced settings, leading to unreliable outcomes. |
| Approach: | They propose a calibration strategy that takes into account the inherent variance of generalization ability in model components and potential changes during the fine-tuning process. |
| Outcome: | The proposed calibration improves GLUE score by 3.1 points over the previous calibration method. |
HacRED: A Large-Scale Relation Extraction Dataset Toward Hard Cases in Practical Applications (2021.findings-acl)
Copied to clipboard
Qiao Cheng, Juntao Liu, Xiaoye Qu, Jin Zhao, Jiaqing Liang, Zhefeng Wang, Baoxing Huai, Nicholas Jing Yuan, Yanghua Xiao
| Challenge: | Relation extraction (RE) is an essential topic in natural language processing and has attracted extensive attention. |
| Approach: | They propose a case-oriented construction framework to build a hard case relation extraction dataset with 65,225 relational facts annotated from 9,231 documents. |
| Outcome: | The proposed model achieves a high 96% F1 score on data quality and is far lower than humans. |
MCapsNet: Capsule Network for Text with Multi-Task Learning (D18-1)
Copied to clipboard
| Challenge: | Multi-task learning has been frustrated by the interference among tasks. |
| Approach: | They propose a capsule-based multi-task learning architecture which is unified, simple and effective. |
| Outcome: | The proposed model can cluster features for each task in the network, which helps reduce the interference among tasks. |
ExpeTrans: LLMs Are Experiential Transfer Learners (2025.acl-long)
Copied to clipboard
| Challenge: | Recent studies provide large language models with textual task-solving experiences via prompts to improve their performance. |
| Approach: | They propose to use prompts to provide LLMs with textual task-solving experiences during their inference stage. |
| Outcome: | The proposed framework improves the performance of large language models on 13 datasets. |
DrAgent: Empowering Large Language Models as Medical Agents for Multi-hop Medical Reasoning (2025.findings-emnlp)
Copied to clipboard
Fenglin Liu, Zheng Li, Hongjian Zhou, Qingyu Yin, Jingfeng Yang, Xin Liu, Zhengyang Wang, Xianfeng Tang, Shiyang Li, Xiang He, Ruijie Wang, Bing Yin, Xiao Gu, Lei Clifton, David A. Clifton
| Challenge: | commercial LLMs can be difficult to use in real-world clinical decision-making . a lightweight LLM can be used to collaborate with diverse clinical tools . |
| Approach: | They propose a lightweight LLM that can be used to build medical LLMs as agents . they use recursive curriculum learning to optimize the LLM in an easy-to-hard progression . |
| Outcome: | The proposed approach outperforms human experts in medical examinations on diverse datasets. |
Dynamic-prototype Contrastive Fine-tuning for Continual Few-shot Relation Extraction with Unseen Relation Detection (2025.coling-main)
Copied to clipboard
| Challenge: | Existing approaches to learn relations from labeled data overlook task interference in continual learning and memory requirements for different relations. |
| Approach: | They propose a framework to learn new relations from limited labeled data while preserving knowledge about previously learned relations. |
| Outcome: | The proposed framework is more practical and comprehensive for real-world scenarios. |
RetroMAE-2: Duplex Masked Auto-Encoder For Pre-Training Retrieval-Oriented Language Models (2023.acl-long)
Copied to clipboard
| Challenge: | Existing methods for retrieval-oriented language models focus on contextualized embedding of the [CLS] token, but recent study shows that ordinary tokens besides [CLL] may provide extra information, which help to produce a better representation effect. |
| Approach: | They propose a method where all contextualized embeddings of pre-trained model can be jointly pre-trained for retrieval tasks. |
| Outcome: | The proposed method improves the quality of representation where all contextualized embeddings of the pre-trained model can be leveraged. |
TexSmart: A System for Enhanced Natural Language Understanding (2021.acl-demo)
Copied to clipboard
Lemao Liu, Haisong Zhang, Haiyun Jiang, Yangming Li, Enbo Zhao, Kun Xu, Linfeng Song, Suncong Zheng, Botong Zhou, Dick Zhu, Xiao Feng, Tao Chen, Tao Yang, Dong Yu, Feng Zhang, ZhanHui Kang, Shuming Shi
| Challenge: | TexSmart supports fine-grained named entity recognition (NER) Large-scale fine-granular entity types are expected to provide richer semantic information for downstream NLP applications. |
| Approach: | They introduce TexSmart, a text understanding system that supports fine-grained named entity recognition (NER) and enhanced semantic analysis functionalities. |
| Outcome: | The proposed system supports fine-grained named entity recognition (NER) and enhanced semantic analysis functions. |
DisastIR: A Comprehensive Information Retrieval Benchmark for Disaster Management (2025.findings-emnlp)
Copied to clipboard
Kai Yin, Xiangjue Dong, Chengkai Liu, Lipai Huang, Yiming Xiao, Zhewei Liu, Ali Mostafavi, James Caverlee
| Challenge: | Existing information retrieval benchmarks focus on general or specialized domains, such as medicine or finance, neglecting the unique linguistic complexity and diverse information needs encountered in disaster management scenarios. |
| Approach: | DisastIR is the first comprehensive IR evaluation benchmark specifically tailored for disaster management. |
| Outcome: | DisastIR covers 48 retrieval tasks derived from six search intents and eight general disaster categories . evaluations show no single model excelling universally . |
A Simple and Effective Approach to Robust Unsupervised Bilingual Dictionary Induction (2020.coling-main)
Copied to clipboard
| Challenge: | Recent work has questioned the robustness of unsupervised bilingual dictionary induction methods on distant language pairs. |
| Approach: | They propose an iterative dimension reduction method to bridge this gap . they propose a method that initializes and self-learning and inducing a dictionary . |
| Outcome: | The proposed method achieves 13.64 55.53% accuracy between English and four distant languages. |
The Efficiency vs. Accuracy Trade-off: Optimizing RAG-Enhanced LLM Recommender Systems Using Multi-Head Early Exit (2025.acl-long)
Copied to clipboard
Huixue Zhou, Hengrui Gu, Zaifu Zhan, Xi Liu, Kaixiong Zhou, Yongkang Xiao, Mingfu Liang, Srinivas Prasad Govindan, Piyush Chawla, Jiyan Yang, Xiangfei Meng, Huayu Li, Buyun Zhang, Liang Luo, Wen-Yen Chen, Yiping Han, Bo Long, Rui Zhang, Tianlong Chen
| Challenge: | Existing frameworks for Large Language Models (LLMs) for Click-Through Rate prediction require a careful balance between computational efficiency and predictive accuracy. |
| Approach: | They propose a framework that integrates Retrieval-Augmented Generation with a novel multi-head early exit architecture to address both challenges. |
| Outcome: | The proposed framework reduces retrieval time while maintaining high model performance. |
Towards Generalizable and Faithful Logic Reasoning over Natural Language via Resolution Refutation (2024.lrec-main)
Copied to clipboard
| Challenge: | Large language models (LLMs) have achieved significant performance in various natural language reasoning tasks, but struggle with performing first-order logic reasoning over formal logical theories expressed in natural language. |
| Approach: | They propose a framework which introduces the paradigm of resolution refutation to solve first-order logic reasoning problems by extending reasoning rules and employing the principle of proof by contradiction. |
| Outcome: | The proposed framework outperforms existing models while maintaining performance in simple scenarios. |
Distract Large Language Models for Automatic Jailbreak Attack (2024.emnlp-main)
Copied to clipboard
| Challenge: | Commercial large language models (LLMs) have made great progress in various NLP tasks. |
| Approach: | They propose a black-box jailbreak framework for automated red teaming of Large language models using an iterative optimization algorithm to conceal malicious content and memory reframing. |
| Outcome: | The proposed framework outperforms existing jailbreak defense methods and highlights the need to develop more effective and practical defense strategies. |
Effective Distillation of Table-based Reasoning Ability from LLMs (2024.lrec-main)
Copied to clipboard
| Challenge: | Existing work on table-based reasoning distillation has focused on smaller models with limited performance. |
| Approach: | They propose a table-based reasoning distillation approach to distill LLMs into smaller models . their results show that a 220 million parameter model fine-tuned using distilled data improves performance . |
| Outcome: | The proposed model improves on a scientific table-to-text generation dataset and surpasses specific LLMs. |
How Susceptible Are LLMs to Logical Fallacies? (2024.lrec-main)
Copied to clipboard
| Challenge: | Recent studies have focused on LLMs' reasoning abilities, but their rational thinking capacity is not as robust as that of other NLP downstream tasks. |
| Approach: | They propose a diagnostic benchmark to assess the robustness of Large Language Models against logical fallacies by comparing their performance against a scenario where the persuader employs logical fallsacie. |
| Outcome: | The proposed benchmark compares the performance of LLMs in debates on controversial topics against logical fallacies. |
HAUSER: Towards Holistic and Automatic Evaluation of Simile Generation (2023.acl-long)
Copied to clipboard
| Challenge: | Similes are a crucial part of creative writing, but there is still a lack of evaluation metrics for simile generation. |
| Approach: | They propose to use similes as a tool to evaluate simile generation metrics . they propose to combine five criteria and automatic metrics for each criterion . |
| Outcome: | The proposed metrics are significantly more correlated with human ratings from each perspective compared with prior automatic metrics. |
On the Rigour of Scientific Writing: Criteria, Analysis, and Insights (2024.findings-emnlp)
Copied to clipboard
| Challenge: | despite its importance, little work exists on modelling rigour in scientific writing . despite widespread use of term, scientific literature lacks definition of rigor . |
| Approach: | They propose a framework to automatically identify and define rigour criteria and assess their relevance in scientific writing. |
| Outcome: | The proposed framework can be tailored to the evaluation of scientific rigour for different areas. |
GAPO: Learning Preferential Prompt through Generative Adversarial Policy Optimization (2025.acl-long)
Copied to clipboard
Zhouhong Gu, Xingzhou Chen, Xiaoran Shi, Tao Wang, Suhang Zheng, Tianyu Li, Hongwei Feng, Yanghua Xiao
| Challenge: | Existing methods for achieving this require a limited understanding of constraints and can be hallucinating or brittle. |
| Approach: | They propose a framework that combines adversarial training dynamics with an encoder-only reward model to progressively learn and adapt to increasingly complex constraints. |
| Outcome: | Extensive experiments show that GAPO significantly outperforms existing methods like PPO, DPO, and KTO in fine-grained constraints. |
Structure Guided Retrieval-Augmented Generation for Factual Queries (2026.acl-long)
Copied to clipboard
| Challenge: | Existing methods for RAG produce factually incorrect outputs, resulting in incorrect answers. |
| Approach: | They propose a novel problem that explicitly incorporates structural information into RAG for factual questions to satisfy all query conditions. |
| Outcome: | The proposed method significantly outperforms baselines on ERQA while maintaining reasonable computational overhead. |
Incentivizing Strong Reasoning from Weak Supervision (2026.eacl-long)
Copied to clipboard
| Challenge: | Large language models (LLMs) have demonstrated impressive performance on reasoning-intensive tasks, but enhancing their reasoning abilities typically relies on expensive high-quality demonstrations and reinforcement learning. |
| Approach: | They propose to incentivize reasoning abilities of large language models without expensive demonstrations and reinforcement learning. |
| Outcome: | The proposed model can recover 94% of the gains of expensive RL at a fraction of the cost. |
I2E: From Image Pixels to Actionable Interactive Environments for Text-Guided Image Editing (2026.acl-long)
Copied to clipboard
Jinghan Yu, Junhao Xiao, Chenyu Zhu, Jiaming Li, Jia Li, HanMing Deng, Xirui Wang, Guoli Jia, Jianjun Li, Xiang Bai, Bowen Zhou, Zhiyuan Ma
| Challenge: | Existing text-guided image editing methods rely on end-to-end pixel-level inpainting paradigm . existing models lack such intermediate representations and Reasoning-then-action process . |
| Approach: | They propose a "Decompose-then-Action" paradigm that revisits image editing as an actionable interaction process within a structured environment. |
| Outcome: | The proposed paradigm outperforms existing methods in compositional editing tasks. |
Cross-layer Attention Sharing for Pre-trained Large Language Models (2026.tacl-1)
Copied to clipboard
Yongyu Mu, Yuzhang Wu, Yuchun Fan, Chenglong Wang, Hengyu Li, Jiali Zeng, Qiaozhi He, Murun Yang, Fandong Meng, Jie Zhou, Tong Xiao, Jingbo Zhu
| Challenge: | Existing studies focus on compressing the Key-Value cache or grouping attention heads, while overlooking redundancy between layers. |
| Approach: | They propose a lightweight substitute for self-attention in well-trained LLMs that uses feed-forward networks to align attention heads between adjacent layers and low-rank matrices to approximate differences in layer-wise attention weights. |
| Outcome: | The proposed model reduces redundancy by sharing weights across layers while maintaining high response quality while reducing redundant calculations within 53% 84% of the total layers. |
Fine-grained Video Dubbing Duration Alignment with Segment Supervised Preference Optimization (2025.acl-long)
Copied to clipboard
| Challenge: | Video dubbing systems use neural machine translation and text-to-speech technologies to translate original speech into visual media programs. |
| Approach: | They propose a preference optimization method to optimize video dubbing duration alignment . they propose combining segment-wise sampling and fine-grained loss to mitigate duration mismatches . |
| Outcome: | The proposed method achieves superior performance in duration alignment tasks. |
On the Robustness of Reading Comprehension Models to Entity Renaming (2022.naacl-main)
Copied to clipboard
| Challenge: | SpanBERT model is more robust than RoBERTa, despite having similar accuracy on unperturbed test data. |
| Approach: | They propose a pipeline to replace entity names with names from a variety of sources. |
| Outcome: | The proposed model performs worse when entities are renamed, the authors show . SpanBERT, which is pretrained with span-level masking, is more robust than RoBERTa . |
MathCoder-VL: Bridging Vision and Code for Enhanced Multimodal Mathematical Reasoning (2025.findings-acl)
Copied to clipboard
Ke Wang, Junting Pan, Linda Wei, Aojun Zhou, Weikang Shi, Zimu Lu, Han Xiao, Yunqiao Yang, Houxing Ren, Mingjie Zhan, Hongsheng Li
| Challenge: | Large Language Models (LMMs) struggle with simple tasks such as geometry, e.g., arithmetic, and reasoning. |
| Approach: | They propose to leverage code as supervision for cross-modal alignment . they propose to use FigCodifier and ImgCode-8.6M to synthesize novel mathematical figures . |
| Outcome: | The proposed model surpasses GPT-4o and Claude 3.5 Sonnet in the geometry problem-solving subset of MathVista, achieving improvements of 8.9% and 9.2%. |
Large Language Model-Enhanced Multi-Armed Bandits (2026.acl-long)
Copied to clipboard
| Challenge: | Large language models (LLMs) have been used to sequential decision-making tasks like multi-armed bandits where an LLM is tasked with selecting arms in each iteration is often suboptimal. |
| Approach: | They propose to combine MAB and LLMs to leverage the in-context learning capability of LLM for reward prediction. |
| Outcome: | The proposed approach outperforms LLM-based direct arm selection on synthetic tasks where only preference feedback between arm pairs is available. |
ExplainaBoard: An Explainable Leaderboard for NLP (2021.acl-demo)
Copied to clipboard
Pengfei Liu, Jinlan Fu, Yang Xiao, Weizhe Yuan, Shuaichen Chang, Junqi Dai, Yixin Liu, Zihuiwen Ye, Graham Neubig
| Challenge: | Using leaderboards, researchers can track the performance of various systems on various NLP tasks. |
| Approach: | They propose a new conceptualization and implementation of NLP evaluation using a leaderboard. |
| Outcome: | The ExplainaBoard is an evaluation tool for natural language processing (NLP) it covers more than 400 systems, 50 datasets, 40 languages, and 12 tasks. |
A Survey on Efficient Large Language Model Training: From Data-centric Perspectives (2025.acl-long)
Copied to clipboard
Junyu Luo, Bohan Wu, Xiao Luo, Zhiping Xiao, Yiqiao Jin, Rong-Cheng Tu, Nan Yin, Yifan Wang, Jingyang Yuan, Wei Ju, Ming Zhang
| Challenge: | achieving data-efficient post-training of Large Language Models is a key research question. |
| Approach: | They propose a taxonomy of data-efficient LLM post-training methods from a data-centric perspective. |
| Outcome: | The proposed methods cover data selection, data quality enhancement, synthetic data generation, data distillation and compression, and self-evolving data ecosystems. |
Unified Structure Generation for Universal Information Extraction (2022.acl-long)
Copied to clipboard
| Challenge: | Information extraction suffers from its varying targets, heterogeneous structures, and demand-specific schemas. |
| Approach: | They propose a unified text-to-structure generation framework, namely UIE, which can universally model different IE tasks, adaptively generate targeted structures, and collaboratively learn general IE abilities from different knowledge sources. |
| Outcome: | The proposed framework can model different IE tasks, generate targeted structures, and learn general IE abilities from different knowledge sources. |
Training LLMs for Divide-and-Conquer Reasoning Elevates Test-Time Scalability (2026.acl-long)
Copied to clipboard
Xiao Liang, Zhong-Zhi Li, Zhenghao Lin, Eric Hanchen Jiang, Hengyuan Zhang, Yelong Shen, Kai-Wei Chang, Ying Nian Wu, Yeyun Gong, Weizhu Chen
| Challenge: | Large language models have demonstrated strong reasoning capabilities through step-by-step chain-of-thought (CoT) reasoning, but their strictly sequential nature constrains test-time scalability. |
| Approach: | They propose an end-to-end reinforcement learning framework to enhance LLMs' DAC-style reasoning capacity by decomposing a problem into subproblems and solving them sequentially. |
| Outcome: | The proposed model surpasses CoT by 8.6% and 6.3% on competition-level benchmarks and is available at the [github.com/MasterVito/DAC-RL]. |
LLaVA Steering: Visual Instruction Tuning with 500x Fewer Parameters through Modality Linear Representation-Steering (2025.acl-long)
Copied to clipboard
| Challenge: | Multimodal Large Language Models (MLLMs) enhance visual tasks by integrating visual representations into large language models. |
| Approach: | They propose a method to re-balance modalities by steering visual representations . they propose LLaVA Steering, a platform that enables rapid customization of MLLMs a component-based architecture . |
| Outcome: | The proposed model re-balances the modalities of visual representations in large language models . the model requires 500 times fewer trainable parameters than LoRA while maintaining comparable performance . |
Locate, Steer, and Improve: A Practical Survey of Actionable Mechanistic Interpretability in Large Language Models (2026.findings-acl)
Copied to clipboard
Hengyuan Zhang, Zhihao Zhang, Ercong Nie, Mingyang Wang, Zunhai Su, Yiwei Wang, Qianli Wang, Shuzhou Yuan, Xufeng Duan, Qibo Xue, Zeping Yu, Chenming Shang, Xiao Liang, Jing Xiong, Hui Shen, Chaofan Tao, Zhengwu Liu, Senjie Jin, Zhiheng Xi, Dongdong Zhang, Sophia Ananiadou, Tao Gui, Ruobing Xie, Hayden Kwok-Hay So, Hinrich Schuetze, Xuanjing Huang, Qi Zhang, Ngai Wong
| Challenge: | Existing literature on mechanistic interpretation (MI) treats it as an observational science, leaving practical applications underexplored. |
| Approach: | They propose a survey structured around the pipeline to identify and improve MI models. |
| Outcome: | The proposed framework enables tangible improvements in Alignment, Capability, and Efficiency. |
Zero-Shot Information Extraction as a Unified Text-to-Triple Translation (2021.emnlp-main)
Copied to clipboard
| Challenge: | a number of information extraction tasks require task-specific training. |
| Approach: | They propose a text-to-triple translation framework for information extraction tasks . they propose enabling task-agnostic translation by leveraging latent knowledge of a pre-trained language model . |
| Outcome: | The proposed framework outperforms the existing methods on open information extraction tasks. |
SQUiD: Synthesizing Relational Databases from Unstructured Text (2025.emnlp-main)
Copied to clipboard
| Challenge: | Relational databases are central to modern data management, but most data exists in unstructured forms like text documents. |
| Approach: | They propose a framework that decomposes the task into four stages, each with specialized techniques. |
| Outcome: | The proposed framework outperforms baselines across diverse datasets. |
SIMBA UQ: Similarity-Based Aggregation for Uncertainty Quantification in Large Language Models (2025.findings-emnlp)
Copied to clipboard
Debarun Bhattacharjya, Balaji Ganesan, Junkyu Lee, Radu Marinescu, Katya Mirylenka, Michael Glass, Xiao Shou
| Challenge: | Uncertainty quantification (UQ) provides measures of uncertainty, such as an estimate of the confidence in an LLM’s generated output. |
| Approach: | They propose a black-box approach where consistency is used as a proxy for confidence in a model's output. |
| Outcome: | The proposed methods are primarily but not necessarily entirely black- box, with consistency between output and other sampled generations used as a proxy for confidence in its correctness. |
Program Transfer for Answering Complex Questions over Knowledge Bases (2022.acl-long)
Copied to clipboard
| Challenge: | Program induction for complex questions over knowledge bases relies on a large number of parallel question-program pairs for the given KB, but the gold program annotations are usually lacking, making learning difficult. |
| Approach: | They propose an approach to leverage program annotations on rich KBs as external supervision signals to aid program induction for low-resourced KB. |
| Outcome: | The proposed approach outperforms SOTA methods on ComplexWebQuestions and WebQuestionSP. |
Paper2Rebuttal: A Multi-Agent Framework for Transparent Author Response Assistance (2026.acl-long)
Copied to clipboard
| Challenge: | Current approaches to writing effective rebuttals are limited by the direct-to-text generation problem . authors must accurately decipher reviewer intent while ensuring every response is firmly anchored in verifiable manuscript details. |
| Approach: | They propose a framework that reframes rebuttal generation as an evidence-centric planning task. |
| Outcome: | The proposed framework outperforms baselines in coverage, faithfulness, and strategic coherence. |
MMA: Cross-Domain Knowledge Integration via Mixture of Multi-Domain Agents (2025.findings-emnlp)
Copied to clipboard
| Challenge: | achieving synergistic improvements between generalization and domain specialization remains a challenge in pre-training and post-training. |
| Approach: | They propose a test-time cross-domain knowledge integration method that integrates general-purpose and domain-specific models to enhance their performance on complex, domainspecific tasks. |
| Outcome: | The proposed method combines the outputs of general-purpose and domain-specific models to improve their performance on complex, domainspecific tasks. |
KARL: Reinforcement Learning for LLM Agents on Multi-Turn Knowledge-Intensive Agentic Tasks (2026.acl-long)
Copied to clipboard
Xueqiao Sun, Xiao Liu, Bowen Lv, Hanchen Zhang, Bohao Jing, Zehan Qi, Yifan Xu, Yuxiao Dong, Jie Tang
| Challenge: | Large Language Models have shown remarkable potential as autonomous agents, but their effectiveness in knowledge-intensive tasks remains limited by passive knowledge utilization. |
| Approach: | They propose a framework that enables LLM agents to dynamically explore structured knowledge sources through multi-turn interactions. |
| Outcome: | The proposed framework outperforms existing retrieval-augmented approaches on knowledge graph and database tasks while maximizing tool-use behaviors end-to-end. |
Revisiting Parallel Context Windows: A Frustratingly Simple Alternative and Chain-of-Thought Deterioration (2024.findings-acl)
Copied to clipboard
| Challenge: | Existing methods for extending the maximum context lengths of language models are lacking a strong baseline for in-context few-shot classification and on more challenging Chain-of-Thought reasoning, such as HotpotQA, deteriorate question miscomprehension and false inference. |
| Approach: | They propose to harness window-wise attention and positional embedding techniques to extend the maximum context lengths of language models. |
| Outcome: | The proposed method is able to extend the maximum context lengths of language models, e.g., 2048 for LLaMA, by harnessing window-wise attention and positional embedding techniques. |
More Data, More Relations, More Context and More Openness: A Review and Outlook for Relation Extraction (2020.aacl-main)
Copied to clipboard
Xu Han, Tianyu Gao, Yankai Lin, Hao Peng, Yaoliang Yang, Chaojun Xiao, Zhiyuan Liu, Peng Li, Jie Zhou, Maosong Sun
| Challenge: | Existing methods for extracting relational facts from text have been successful . but with explosion of Web text, human knowledge is increasing drastically . |
| Approach: | They propose to improve relation extraction methods to extract relational facts from text . they analyze existing methods and show promising directions towards more powerful RE . |
| Outcome: | The proposed methods can extract relational facts from text, but they are still lacking in the current field. |
MCiteBench: A Multimodal Benchmark for Generating Text with Citations (2025.findings-emnlp)
Copied to clipboard
| Challenge: | Existing work focuses on generating citations for text-only content . experimental results reveal MLLMs struggle to ground outputs reliably when handling multimodal input . |
| Approach: | They propose a benchmark to assess the ability of MLLMs to generate text with citations in multimodal contexts. |
| Outcome: | The proposed benchmark assesses the ability of MLLMs to generate text with citations in multimodal contexts. |
Inflated Excellence or True Performance? Rethinking Medical Diagnostic Benchmarks with Dynamic Evaluation (2026.acl-long)
Copied to clipboard
| Challenge: | Current evaluations of large language models (LLMs) are limited in capturing key challenges of clinical diagnostic scenarios. |
| Approach: | They propose a dynamic benchmark for medical diagnostics that provides a stress test of diagnostic robustness. |
| Outcome: | The proposed model provides a stress test of diagnostic robustness and veracity, helpfulness and consistency. |
DEMO: A Statistical Perspective for Efficient Image-Text Matching (2024.naacl-long)
Copied to clipboard
| Challenge: | Image-text matching is a problem that seeks to connect vision and language through semantic understanding. |
| Approach: | They propose a deep unsupervised hashing-based approach for image-text matching . they characterize each image using multiple augmented views, which are considered as samples . |
| Outcome: | The proposed approach achieves superior performance on image-text matching datasets compared with state-of-the-art methods. |
One Unified Model for Diverse Tasks: Emotion Cause Analysis via Self-Promote Cognitive Structure Modeling (2025.naacl-long)
Copied to clipboard
| Challenge: | Existing models for emotion cause analysis overlook common ground rooted in cognitive emotion theories, in particular, the cognitive structure of emotions. |
| Approach: | They propose a unified model capable of tackling diverse emotion cause analysis tasks . they propose 'self-promote mechanism' that constructs the emotion cognitive structure through LLM . |
| Outcome: | The proposed model outperforms existing models and baselines on multiple emotion cause analysis tasks. |
PodAgent: A Comprehensive Framework for Podcast Generation (2025.findings-acl)
Copied to clipboard
| Challenge: | Existing automatic audio generation methods struggle to generate podcast-like audio programs effectively. |
| Approach: | They propose a framework for creating podcast-like audio programs that generates informative topic-discussion content by designing a multi-agent collaboration system, builds a voice pool and uses LLM-enhanced speech synthesis to generate expressive conversational speech. |
| Outcome: | The proposed framework surpasses direct GPT-4 generation in topic-discussion dialogue content, and produces more expressive conversational speech. |
C2KD: Cross-layer and Cross-head Knowledge Distillation for Small Language Model-based Recommendation (2025.findings-acl)
Copied to clipboard
| Challenge: | Large Language Models (LLMs) show promise but their size and high inference costs limit deployment on resource-constrained devices. |
| Approach: | They propose a framework to transfer task-relevant knowledge from two complementary dimensions to Large Language Models (LLMs) Large Language models (LLMS) have demonstrated great potential in sequential recommendation tasks . |
| Outcome: | Extensive experiments across diverse model families show that the proposed framework achieves competitive performance compared to LLMs. |
Incomplete In-context Learning (2026.acl-long)
Copied to clipboard
Wenqiang Wang, Wen Yujia, Yan Xiao, Zhifeng Chen, Yangshijie Zhang, Peng Chen, Mingbo Yang, Xiaochun Cao
| Challenge: | Existing in-context learning assumes the retrieval dataset contains demonstrations for all output label spaces. |
| Approach: | They propose a framework with train-free and train-based variants to address IICL . they propose to integrate a dataset with labeled demonstrations for each output space . |
| Outcome: | The proposed framework outperforms existing methods under incomplete retrieval datasets and even outperformed ICL with complete labels. |
MAPS: Motivation-Aware Personalized Search via LLM-Driven Consultation Alignment (2025.acl-long)
Copied to clipboard
| Challenge: | Existing personalized product search methods assume that users’ query fully captures their real motivation, but in practice, user's queries do not always articulate the requirements. |
| Approach: | They propose a Motivation-Aware Personalized Search method that embeds queries and consultations into a unified semantic space via LLMs and utilizes a Mixture of Attention Experts (MoAE) to prioritize critical semantics. |
| Outcome: | Extensive experiments on real and synthetic data show that the proposed method outperforms existing methods in retrieval and ranking tasks. |
Distantly-Supervised Joint Extraction with Noise-Robust Learning (2024.findings-acl)
Copied to clipboard
| Challenge: | Existing approaches to identifying entity pairs and relations with a single model are noisy . Existing methods only consider one source of noise or make decisions using external knowledge . |
| Approach: | They propose a framework that aligns entity mentions with corresponding tags for joint extraction . they propose DENRL, which employs a lightweight transformer backbone for joint tagging . |
| Outcome: | The proposed framework outperforms baseline models on two benchmark datasets with better interpretability. |
GLM: General Language Model Pretraining with Autoregressive Blank Infilling (2022.acl-long)
Copied to clipboard
| Challenge: | Existing pretraining frameworks do not perform well for all tasks of three main categories, such as natural language understanding (NLU), unconditional generation, and conditional generation. |
| Approach: | They propose a general language model based on autoregressive blank infilling to address this challenge. |
| Outcome: | The proposed model outperforms BERT, T5, and GPT on a wide range of tasks across NLU, conditional and unconditional generation tasks. |
CLEAR: A Framework Enabling Large Language Models to Discern Confusing Legal Paragraphs (2025.findings-emnlp)
Copied to clipboard
| Challenge: | Existing work focuses on enabling LLMs to leverage legal rules to tackle complex legal reasoning tasks, but ignores their ability to understand legal rules. |
| Approach: | They propose a legal paragraph prediction task that aims to predict the legal paragraph given criminal facts and a framework CLEAR to enhance their legal reasoning ability. |
| Outcome: | The proposed model improves the ability of LLMs to analyze legal cases with the guidance of legal rule insights. |
Is EEG-to-Text Feasible in Real-World Scenarios? An In-Depth Analysis Using a Neuropsychology-Inspired Benchmark (2026.acl-long)
Copied to clipboard
| Challenge: | Existing benchmarks for EEG2Text have neglected EEG instability, a problem that has confounded inference and sparked debate. |
| Approach: | They propose to use a 128-channel high-density EEG cap to evaluate EEG2Text models . they find existing benchmarks have neglected EEG instability, a flaw that has confounded inferences and sparked debate . |
| Outcome: | The proposed benchmarks provide key evidence for teacher-forcing-free decoding of EEG2Text models. |
Uncertainty-Aware Bootstrap Learning for Joint Extraction on Distantly-Supervised Data (2023.acl-short)
Copied to clipboard
| Challenge: | Existing approaches to extract entity pairs and their relations from labeled data are noisy and expensive. |
| Approach: | They propose a bootstrap learning approach that is motivated by intuition that the higher the uncertainty of an instance, the more likely the model confidence is inconsistent with the ground truths. |
| Outcome: | The proposed method outperforms baselines and related methods on two large datasets. |
Defending against Insertion-based Textual Backdoor Attacks via Attribution (2023.findings-acl)
Copied to clipboard
| Challenge: | Textual backdoor attacks are vulnerable to backdoors and can be used to infect models trained on poisoned data. |
| Approach: | They propose an efficient attribution-based pipeline to defend against two insertion-based poisoning attacks, BadNL and InSent. |
| Outcome: | The proposed method can generalize sufficiently well in two common attack scenarios, which consistently improves previous methods. |
Exploring the Capacity of Pretrained Language Models for Reasoning about Actions and Change (2023.acl-long)
Copied to clipboard
| Challenge: | Recent transformer-based language models (LMs) provide reasoning over textual benchmarks . RAC is essential to understand and interact with the ever-changing environment . |
| Approach: | They propose to use a transformer-based language model to learn to reason over textual benchmarks. |
| Outcome: | The proposed model minimizes the influence of other linguistic requirements to focus on RAC. |
Data Mixing Agent: Learning to Re-weight Domains for Continual Pre-training (2026.acl-long)
Copied to clipboard
| Challenge: | Existing methods for reweighting data mixtures rely on manual designation with certain heuristics based on intuition or empirical results. |
| Approach: | They propose a model-based framework that learns to re-weight domains by reinforcement learning on large quantities of data mixing trajectories with corresponding feedback from an evaluation environment. |
| Outcome: | The proposed framework outperforms baselines in achieving balanced performance across source and target fields and domain spaces without retraining. |
Cognitive Overload: Jailbreaking Large Language Models with Overloaded Logical Thinking (2024.findings-naacl)
Copied to clipboard
| Challenge: | Large language models (LLMs) have demonstrated increasing power, but they also have vulnerabilities. |
| Approach: | They propose a black-box attack that targets the cognitive structure and processes of large language models (LLMs) they propose defending cognitive overload attacks from three perspectives. |
| Outcome: | The proposed attack is a black-box attack with no need for knowledge of model architecture or access to model weights. |
Multi-Path Transformer is Better: A Case Study on Neural Machine Translation (2022.findings-emnlp)
Copied to clipboard
| Challenge: | Extensive experiments on 12 WMT tasks show that shallower multi-path models can achieve similar or even better performance than the deeper model. |
| Approach: | They propose to use a parameter-efficient multi-path structure to fuse features extracted from different paths to achieve better performance. |
| Outcome: | The proposed model can achieve better performance with the same number of parameters than the deeper model. |
Chinese Automatic Readability Assessment Using Adaptive Pre-training and Linguistic Feature Fusion (2025.coling-main)
Copied to clipboard
| Challenge: | Existing methods for classification of reading difficulty of texts are insufficiently trained and lack of linguistic features. |
| Approach: | They propose a method that combines adaptive pre-training with feature fusion to capture different text difficulties and an interactive attention mechanism to integrate linguistic and deep features. |
| Outcome: | The proposed method achieves state-of-the-art (SOTA) performance on Chinese textbook dataset and can be applied to other languages. |
Cross-Lingual Document Retrieval with Smooth Learning (2020.coling-main)
Copied to clipboard
| Challenge: | Cross-lingual document search is an information retrieval task in which the queries’ language and the documents’ language are different. |
| Approach: | They propose a robust framework that measures the relevance and a loss function that is a novel objective function. |
| Outcome: | The proposed framework achieves significant gains under commonly used ranking metrics on cross-lingual document retrieval task in a variety of languages. |
Masked Audio Text Encoders are Effective Multi-Modal Rescorers (2023.findings-acl)
Copied to clipboard
| Challenge: | Masked Language Models (MLMs) have proven to be effective for second-pass rescoring in Automatic Speech Recognition systems. |
| Approach: | They propose a multi-modal masked language model rescorer which integrates acoustic representations into the input space of MLM. |
| Outcome: | The proposed model reduces word error rate (WER) by 4%-16% on in-domain and 3%-7% on out-of-domain datasets over the text-only baseline. |
Global Structure Knowledge-Guided Relation Extraction Method for Visually-Rich Document (2023.findings-emnlp)
Copied to clipboard
| Challenge: | Existing methods focus on manipulating entity features to find pairwise relations, yet neglect the more fundamental structural information that links disparate entity pairs together. |
| Approach: | They propose a Visual Relation Extraction framework that generates relation predictions on entity pairs extracted from scanned images and incorporates global structural knowledge into the representations of the entities. |
| Outcome: | The proposed framework outperforms existing methods in fine-tuning setting and yields stronger data-efficient performance in the low-resource setting. |
\mathtt{GeLLM^3O}: Generalizing Large Language Models for Multi-property Molecule Optimization (2025.acl-long)
Copied to clipboard
| Challenge: | Large Language Models (LLMs) have remarkable out-of-domain generalizability to novel optimization tasks. |
| Approach: | They propose a series of instruction-tuned LLMs for molecule optimization that outperform state-of-the-art instruction-based LLM models. |
| Outcome: | mathttMuMOInstruct outperforms state-of-the-art LLMs on 5 in-domain and 5 out-of domain tasks. |
Consolidation or Adaptation? PRISM: Disentangling SFT and RL Data via Gradient Concentration (2026.acl-long)
Copied to clipboard
Yang Zhao, Yangou Ouyang, Xiao Ding, Hepeng Wang, Bibo Cai, Kai Xiong, Jinglong Gao, Zhouhao Sun, Li Du, Bing Qin, Ting Liu
| Challenge: | Existing data arbitration strategies for large language model training rely on surface-level heuristics that fail to diagnose intrinsic learning needs. |
| Approach: | They propose a framework that arbitrates data based on its degree of cognitive conflict with the model's existing knowledge. |
| Outcome: | Extensive experiments on WebShop and ALFWorld show that PRISM outperforms state-of-the-art hybrid methods while reducing computational costs by up to 3.22 . |
SCOP: Evaluating the Comprehension Process of Large Language Models from a Cognitive View (2025.acl-long)
Copied to clipboard
| Challenge: | despite the potential of large language models, it is difficult to fully count on them in real-world scenarios. |
| Approach: | They propose to examine how LLMs perform during the comprehension process from a cognitive perspective. |
| Outcome: | The proposed model analyzes how LLMs perform during the comprehension process from a cognitive perspective. |
Each graph is a new language: Graph Learning with LLMs (2025.findings-acl)
Copied to clipboard
| Challenge: | Natural language is used to describe graphs, but graph descriptions become verbose and only relying on attribute embeddings limits LLM’s ability to capture adequate graph structural information. |
| Approach: | They propose a graph-defined language for large language model that translates the graph into a corpus instead of graph descriptions and pre-trains LLMs on this corpus to adequately understand the graph. |
| Outcome: | Experiments on five datasets show that the proposed framework outperforms description-based and embedding-based baselines by efficiently modeling different orders of neighbors. |
PsyScam: A Benchmark for Psychological Techniques in Real-World Scams (2025.findings-emnlp)
Copied to clipboard
| Challenge: | PTs are employed by scammers to manipulate victims and cause lasting psychological trauma. |
| Approach: | They propose a benchmark to capture the PTs employed in real-worldscam reports and investigate how LLMs can be utilized to generate variants of scams based on the pts and the contexts provided by thesescams. |
| Outcome: | The proposed model can generate variants of scams based on the PTs employed in real-world scam reports and the contexts provided by these scams. |
Rethinking Multi-Modal Alignment in Multi-Choice VideoQA from Feature and Sample Perspectives (2022.emnlp-main)
Copied to clipboard
| Challenge: | Existing approaches to VideoQA focus on utilizing frame- or object-level visual representations, but they neglect visual-language interactions. |
| Approach: | They propose to break down video into trajectories and first leverage trajectory feature in VideoQA to enhance alignment between two modalities. |
| Outcome: | The proposed method outperforms all the state-of-the-art models on the NExT-QA benchmark. |
MccSTN: Multi-Scale Contrast and Fine-Grained Feature Fusion Networks for Subject-driven Style Transfer (2024.lrec-main)
Copied to clipboard
| Challenge: | Stylistic style transfer is an important part of the image processing field . due to the low semantic similarity between the original image and the style image, many fine-grained style features are discarded. |
| Approach: | They propose a new style representation and transfer framework that can be adapted to existing image style transfers. |
| Outcome: | The proposed framework can be adapted to existing image style transfers. |
DEEPER Insight into Your User: Directed Persona Refinement for Dynamic Persona Modeling (2025.acl-long)
Copied to clipboard
Aili Chen, Chengyu Du, Jiangjie Chen, Jinghan Xu, Yikai Zhang, Siyu Yuan, Zulong Chen, Liangyue Li, Yanghua Xiao
| Challenge: | Existing methods for generating personas from static historical data fail to capture dynamic behaviors and evolving preferences in real-world interactive scenarios. |
| Approach: | They propose a novel approach that iteratively updates personas using streaming user behavior data to continually enhance their quality. |
| Outcome: | The proposed approach delivers 32.2% reduction in user behavior prediction error over four update rounds, outperforming the best baseline by 22.92%. |
Reaction Miner: An Integrated System for Chemical Reaction Extraction from Textual Data (2023.emnlp-demo)
Copied to clipboard
Ming Zhong, Siru Ouyang, Yizhu Jiao, Priyanka Kargupta, Leo Luo, Yanzhen Shen, Bobby Zhou, Xianrui Zhong, Xuan Liu, Hongxiang Li, Jinfeng Xiao, Minhao Jiang, Vivian Hu, Xuan Wang, Heng Ji, Martin Burke, Huimin Zhao, Jiawei Han
| Challenge: | Reaction Miner is a system designed to extract chemical reactions from raw scientific PDFs. |
| Approach: | They propose a system that extracts chemical reactions directly from raw scientific PDFs. |
| Outcome: | The proposed system can extract chemical reactions from raw scientific PDFs. |
TMFN: A Target-oriented Multi-grained Fusion Network for End-to-end Aspect-based Multimodal Sentiment Analysis (2024.lrec-main)
Copied to clipboard
| Challenge: | Existing methods for multimodal aspect-based sentiment analysis focus on fusing image regional information and textual words. |
| Approach: | They propose a multimodal aspect-based sentiment analysis method that integrates regional and global image information with global image data. |
| Outcome: | Experiments show that the proposed method outperforms state-of-the-art methods on two benchmark datasets. |
Pause or Fabricate? Training Language Models for Grounded Reasoning (2026.findings-acl)
Copied to clipboard
Yiwen Qiu, Linjuan Wu, Yizhou Liu, Yuchen Yan, Jin Ma, Xu Tan, Yao Hu, Daoxin Zhang, Wenqi Zhang, Weiming Lu, Jun Xiao, Yongliang Shen
| Challenge: | Large language models implicitly fabricate information when inputs are incomplete, causing confidence but unreliable conclusions. |
| Approach: | They propose a framework for grounded reasoning under incomplete information that decomposes reasoning into two stages . they propose stage-specific rewards to penalize hallucinations, enabling models to detect gaps, stop proactively, and resume reasoning after clarification. |
| Outcome: | The proposed framework improves premise detection and task success by 30% . it also reduces average response length by over 20% . |
Enhancing Speech Large Language Models with Prompt-Aware Mixture of Audio Encoders (2025.emnlp-main)
Copied to clipboard
Weiqiao Shan, Yuang Li, Yuhao Zhang, Yingfeng Luo, Chen Xu, Xiaofeng Zhao, Long Meng, Yunfei Lu, Min Zhang, Hao Yang, Tong Xiao, JingBo Zhu
| Challenge: | Existing work on integrating audio encoders with large language models (LLMs) has focused on semantic understanding tasks, but different tasks may require distinct features that emphasize either semantic or acoustic aspects. |
| Approach: | They propose to use a prompt-aware mixture to enhance the Speech LLM that uses multiple audio encoders to extract different features based on the prompt. |
| Outcome: | The proposed approach outperforms all single-encoder Speech LLMs on ASR, speaker number verification, and AC tasks. |
Attention Mechanism with Energy-Friendly Operations (2022.findings-acl)
Copied to clipboard
| Challenge: | Empirical results show that attention mechanism can be improved from the energy consumption aspects. |
| Approach: | They propose to replace multiplications with either selective operations or additions to reduce energy consumption. |
| Outcome: | The proposed model achieves competitable accuracy while saving 99% and 66% energy during alignment calculation and the whole attention procedure. |
iMOVE : Instance-Motion-Aware Video Understanding (2025.findings-acl)
Copied to clipboard
Jiaze Li, Yaya Shi, Zongyang Ma, Haoran Xu, Yandong.bai Yandong.bai, Huihui Xiao, Ruiwen Kang, Fan Yang, Tingting Gao, Di Zhang
| Challenge: | Recent advances in Video Large Language Models have led to rapid development, significantly enhancing the capture of overall video semantics and achieving remarkable performance in general video understanding tasks. |
| Approach: | They propose a large-scale instance-motion-aware video instruction-tuning dataset iMOVE that utilizes Event-awful Spatiotemporal Efficient Modeling to retain informative instance spatiotemporal motion details while maintaining computational efficiency. |
| Outcome: | The proposed model excels in video temporal understanding and general video understanding. |
EIT: Enhanced Interactive Transformer (2024.acl-long)
Copied to clipboard
| Challenge: | Existing multi-view learning models prioritize complementarity while ignoring consensus . EMHA allows for efficient modeling of global dependencies among tokens in parallel . |
| Approach: | They propose an enhanced multi-head self-attention (EMHA) that prioritizes complementarity while ignoring consensus. |
| Outcome: | The proposed method favors consensus among heads by introducing two models . it is superior on a wide range of language tasks with a modest increase in model size . |
Towards Bridging the Reward-Generation Gap in Direct Alignment Algorithms (2026.findings-acl)
Copied to clipboard
| Challenge: | Large language models (LLMs) have demonstrated remarkable capabilities across a wide range of tasks, including instruction following, mathematical problem solving, and coding generation. |
| Approach: | They propose a method that truncates both preferred and dispreferred responses to match the shorter one’s length. |
| Outcome: | The proposed approach improves over standard implementations and achieves 11.8 points in AlpacaEval 2 and overall improvements across downstream tasks. |
EXPLAIN: Enhancing Retrieval-Augmented Generation with Entity Summary (2025.acl-industry)
Copied to clipboard
Yaozhen Liang, Xiao Liu, Jiajun Yu, Zhouhua Fang, Qunsheng Zou, Linghan Zheng, Yong Li, Zhiwei Liu, Haishuai Wang
| Challenge: | Existing document question answering methods reduce inference costs and input tokens. |
| Approach: | They propose a retrieval-augmented generation method that automatically extracts useful entities and generates summaries from documents. |
| Outcome: | The proposed method surpasses baseline retrieval-augmented generation (RAG) and long-context question answering (LC) methods achieve higher accuracy by processing entire documents, but at the cost of increased computational Corresponding authors. |
Do VLMs Have a Moral Backbone? A Study on the Fragile Morality of Vision-Language Models (2026.findings-acl)
Copied to clipboard
Zhining Liu, Tianyi Wang, Xiao Lin, Penghao Ouyang, Gaotang Li, Ze Yang, Hui Liu, Sumit Keswani, Vishwa Pardeshi, Huijun Zhao, Wei Fan, Hanghang Tong
| Challenge: | Vision-Language Models (VLMs) have advanced multimodal learning, driving progress in cross-modal reasoning. |
| Approach: | They propose to examine moral robustness of vision-language models by analyzing their moral stances under multimodal perturbations. |
| Outcome: | The proposed model-agnostic multimodal perturbations expose VLMs to a variety of moral vulnerabilities, including a sycophancy trade-off where stronger instruction-following models are more susceptible to persuasion. |
Learning Dialogue Representations from Consecutive Utterances (2022.naacl-main)
Copied to clipboard
| Challenge: | Dialogue Sentence Embedding (DSE) is a self-supervised contrastive learning method that learns effective dialogue representations suitable for a wide range of dialogue-oriented tasks. |
| Approach: | They propose a self-supervised contrastive learning method that learns dialogue representations suitable for a wide range of dialogue tasks. |
| Outcome: | The proposed method outperforms baselines on five dialogue tasks on a few-shot and zero-shot datasets. |
De-Biased Court’s View Generation with Causality (2020.emnlp-main)
Copied to clipboard
Yiquan Wu, Kun Kuang, Yating Zhang, Xiaozhong Liu, Changlong Sun, Jun Xiao, Yueting Zhuang, Luo Si, Fei Wu
| Challenge: | Existing approaches to court’s view generation can be used to address this problem, but neglecting the confounding bias in data can limit the model performance and pollute learning outcomes. |
| Approach: | They propose a novel Attentional and Counterfactual based Natural Language Generation method consisting of an attentional encoder and a pair of innovative counterfactual decoders to generate judgment-discriminative court's views. |
| Outcome: | The proposed method is able to generate judgment-discriminative court's views (both supportive and non-supportive views) under both quantitative and qualitative evaluation metrics. |
A Multi-Task Embedder For Retrieval Augmented LLMs (2024.acl-long)
Copied to clipboard
| Challenge: | Existing retrieval methods face limitations in terms of knowledge, memory, and action. |
| Approach: | They propose a retrieval enhancement mechanism that brings in useful information from external sources to augment the LLM. |
| Outcome: | The proposed method significantly improves the LLM’s performance in various downstream tasks while introducing superior retrieval augmentation’s effect over both general and task-specifc retrievers. |
Unlocking Memorization in Large Language Models with Dynamic Soft Prompting (2024.emnlp-main)
Copied to clipboard
Zhepeng Wang, Runxue Bao, Yawen Wu, Jackson Taylor, Cao Xiao, Feng Zheng, Weiwen Jiang, Shangqian Gao, Yanfu Zhang
| Challenge: | Pretrained large language models excel in a variety of natural language processing tasks . however, they pose significant security risks due to their tendency to memorize training data . |
| Approach: | They propose a method to estimate LLM memorization using dynamic, prefix-dependent soft prompts. |
| Outcome: | The proposed method can achieve maximum relative improvement of 135.3% and 39.8% over baseline compared to state-of-the-art methods. |
A Confidence-based Partial Label Learning Model for Crowd-Annotated Named Entity Recognition (2023.findings-acl)
Copied to clipboard
Limao Xiong, Jie Zhou, Qunxi Zhu, Xiao Wang, Yuanbin Wu, Qi Zhang, Tao Gui, Xuanjing Huang, Jin Ma, Ying Shan
| Challenge: | Existing models for named entity recognition (NER) are based on large-scale labeled datasets, which always obtain using crowdsourcing. |
| Approach: | They propose a CONfidence-based partial Label Learning method to integrate prior and posterior confidences for crowd-annotated named entity recognition models. |
| Outcome: | The proposed model improves on real-world and synthetic datasets compared with baselines. |
MASS-RAG: Multi-Agent Synthesis Retrieval-Augmented Generation (2026.findings-acl)
Copied to clipboard
| Challenge: | Large language models (LLMs) are widely used in retrieval-augmented generation (RAG) when retrieved contexts are noisy, incomplete, or heterogeneous, a single generation process often struggles to reconcile evidence effectively. |
| Approach: | They propose a multi-agent synthesis approach to retrieval-augmented generation that structures evidence processing into multiple role-specialized agents. |
| Outcome: | Experiments on four benchmarks show that MASS-RAG consistently improves performance over strong RAG baselines. |
PrinciplismQA: A Philosophy-Grounded Approach to Assessing LLM-Human Clinical Medical Ethics Alignment (2026.findings-acl)
Copied to clipboard
| Challenge: | Existing benchmarks lack systematic approaches to integrate philosophical frameworks and expert validation for ethical reasoning assessment. |
| Approach: | They propose a philosophy-grounded approach to assess medical ethics alignment . PrinciplismQA comprises 3,648 expert-validated questions spanning knowledge assessment and clinical reasoning . |
| Outcome: | PrinciplismQA provides a philosophy-grounded approach to assessing medical ethics alignment. |
FinMaster: A Holistic Benchmark for Full-Pipeline Financial Management with Large Language Models (2026.findings-acl)
Copied to clipboard
Junzhe Jiang, Chang Yang, Aixin Cui, Sihan Jin, Yujing Zhang, Yilin Xiao, Ruiyu Wang, Bo Li, Xiao Huang, Danny Dongning Sun, Xinrun Wang
| Challenge: | Existing benchmarks lack domain-specific data, realistic workflow-level task design, and standardized workflow- level evaluation. |
| Approach: | a new benchmark evaluates large language models on financial management workflows . the global financial services market is projected to grow to $37 trillion by 2027 . |
| Outcome: | a new benchmark for large language models on financial management workflows reveals critical capability gaps . accuracy drops from 90% on basic tasks to 40% on complex scenarios requiring multi-step reasoning . the global financial services market reached $25.8 trillion in 2022 and is projected to grow to $37 trillion by 2027 . |
Can LLMs Learn to Map the World from Local Descriptions? (2026.acl-long)
Copied to clipboard
| Challenge: | Recent advances in large language models have demonstrated strong capabilities in tasks such as code generation and mathematical reasoning. |
| Approach: | They investigate whether large language models can construct coherent global spatial cognition by integrating fragmented relational descriptions. |
| Outcome: | The proposed models can generalize to unseen spatial relationships and exhibit latent representations aligned with real-world spatial distributions. |
Beyond Similarity: A Gradient-based Graph Method for Instruction Tuning Data Selection (2025.acl-long)
Copied to clipboard
Yang Zhao, Li Du, Xiao Ding, Yangou Ouyang, Hepeng Wang, Kai Xiong, Jinglong Gao, Zhouhao Sun, Dongliang Xu, Qing Yang, Dongchen Li, Bing Qin, Ting Liu
| Challenge: | Existing methods for selecting training data from general datasets fail to account for the joint distribution of instructions, resulting in inefficient learning and suboptimal knowledge transfer. |
| Approach: | They propose a method that constructs a mixed gradient-based instruction graph to capture the joint distribution and interdependencies among instructions. |
| Outcome: | The proposed method outperforms existing methods on domain adaptation tasks and in complex, data-scarce scenarios. |
Mitigating Posterior Salience Attenuation in Long-Context LLMs with Positional Contrastive Decoding (2025.acl-short)
Copied to clipboard
| Challenge: | Current solutions incur prohibitive training costs, leaving statistical behaviors and cost-effective approaches underexplored. |
| Approach: | They propose a positional contrast decoding technique that contrasts long-aware attention with designed local-awn attention. |
| Outcome: | The proposed model achieves state-of-the-art performance on long-context benchmarks. |
Are Machines Better at Complex Reasoning? Unveiling Human-Machine Inference Gaps in Entailment Verification (2024.findings-acl)
Copied to clipboard
| Challenge: | Existing evidence that humans make numerous inferences to understand discourse and text is not fully understood. |
| Approach: | They propose to use textual inference datasets with multi-sentence premises to solve the entailment verification problem. |
| Outcome: | The proposed model outperforms GPT-3.5 and rivals GPL-4 in EV tasks. |
i-Code V2: An Autoregressive Generation Framework over Vision, Language, and Speech Data (2024.findings-naacl)
Copied to clipboard
Ziyi Yang, Mahmoud Khademi, Yichong Xu, Reid Pryzant, Yuwei Fang, Chenguang Zhu, Dongdong Chen, Yao Qian, Xuemei Gao, Yi-Ling Chen, Robert Gmyr, Naoyuki Kanda, Noel Codella, Bin Xiao, Yu Shi, Lu Yuan, Takuya Yoshioka, Michael Zeng, Xuedong Huang
| Challenge: | i-Code V2 is one of the first models capable of generating natural language from any combination of Vision, Language, and Speech data. |
| Approach: | They propose to create a model that can generate natural language from any combination of Vision, Language, and Speech data. |
| Outcome: | i-Code V2 matches or outperforms state-of-the-art single- and dual-modality baselines on 7 multimodal tasks. |
Watermarking Large Language Models: An Unbiased and Low-risk Method (2025.acl-long)
Copied to clipboard
| Challenge: | Recent advances in large language models (LLMs) have highlighted the risk of misusing them, raising the need for accurate detection of LLM-generated content. |
| Approach: | They propose a method to inject imperceptible identifiers into large language models (LLMs) this method is unbiased and preserves the original token distribution in expectation . |
| Outcome: | The proposed method preserves the original token distribution in expectation and has lower risk of producing unsatisfactory outputs in low-entropy scenarios compared to existing unbiased watermarks. |
RankPrompt: Step-by-Step Comparisons Make Language Models Better Reasoners (2024.lrec-main)
Copied to clipboard
| Challenge: | Existing solutions to reasoning tasks require extensive human annotations or fail in scenarios with inconsistent responses. |
| Approach: | They propose a new method that enables LLMs to self-rank their responses without additional resources. |
| Outcome: | The proposed method improves reasoning performance of ChatGPT and GPT-4 with 13% improvement over existing methods. |
Dynamic Attention-Guided Context Decoding for Mitigating Context Faithfulness Hallucinations in Large Language Models (2025.findings-acl)
Copied to clipboard
| Challenge: | Existing methods, such as a n-terminal coding, do not provide accurate data for large language models. |
| Approach: | They propose a lightweight framework that leverages attention distributions and uncertainty signals in a single-pass decoding. |
| Outcome: | Experiments on open-book QA datasets show that DAGCD improves faithfulness and robustness while preserving computational efficiency. |
EET: Experience-Driven Early Termination for Cost-Efficient Software Engineering Agents (2026.findings-acl)
Copied to clipboard
| Challenge: | Large language models are reshaping modern software development, but they often incur substantial monetary cost. |
| Approach: | They propose an experience-driven early termination approach that extracts structured experience from prior issue-resolution executions and leverages it to guide early termination during patch generation and selection. |
| Outcome: | The proposed approach reduces cost by 19%–55% with negligible loss in resolution rate (at most 0.2%) EET extracts structured experience from prior issue-resolution executions and leverages it to guide early termination during patch generation and selection. |
ReasonMed: A 370K Multi-Agent Generated Dataset for Advancing Medical Reasoning (2025.emnlp-main)
Copied to clipboard
Yu Sun, Xingyu Qian, Weiwen Xu, Hao Zhang, Chenghao Xiao, Long Li, Deli Zhao, Wenbing Huang, Tingyang Xu, Qifeng Bai, Yu Rong
| Challenge: | Existing medical reasoning datasets are limited in scale and typically rely on incomplete data. |
| Approach: | They propose to use ReasonMed to train medical reasoning models using a multi-agent generation, verification, and refinement pipeline. |
| Outcome: | The largest medical reasoning dataset to date surpasses the prior best sub-10B models by 4.17% and even exceeds LLaMA3.1-70B on PubMedQA by 4.60%. |
Stumbling Blocks: Stress Testing the Robustness of Machine-Generated Text Detectors Under Attacks (2024.acl-long)
Copied to clipboard
| Challenge: | Existing studies on this topic focus on the robustness of specific detectors or particular attack methods. |
| Approach: | They stress test the detectors’ robustness to malicious attacks under realistic scenarios using LLMs and metric-based detectors. |
| Outcome: | The proposed methods are based on a set of LLM-based models and their performance is compared under different budget levels. |
How Many Answers Should I Give? An Empirical Study of Multi-Answer Reading Comprehension (2023.findings-acl)
Copied to clipboard
| Challenge: | Despite recent progress in multi-answer MRC, there is no systematic analysis of how this phenomenon arises and how to better address it. |
| Approach: | They develop a taxonomy to categorize commonly-seen multi-answer MRC instances and examine how well different paradigms deal with different types of multi-announced questions. |
| Outcome: | The proposed taxonomy categorizes commonly-seen multi-answer instances and analyzes how well different paradigms deal with different types of multi-announced instances. |
Analyze Like a Venture Capitalist: Information-Gain and Knowledge Enhanced Graph Reasoning for Startup Success Prediction (2026.findings-acl)
Copied to clipboard
| Challenge: | Most venture capital investments fail, while a few deliver outsized returns. |
| Approach: | They propose a framework that synthesizes relational evidence across sources . they propose combining information-gain-driven retriever and knowledge base to ground reasoning . |
| Outcome: | The proposed framework achieves +5.9% F1 and +22.1% Precision@5 over state-of-the-art baselines. |
Orthogonal Subspace Learning for Language Model Continual Learning (2023.findings-emnlp)
Copied to clipboard
| Challenge: | Existing methods for continual learning in language models suffer catastrophic forgetting when learning sequential tasks. |
| Approach: | They propose an orthogonal low-rank adaptation approach for continual learning in language models that uses orthogons to learn sequentially. |
| Outcome: | The proposed approach outperforms state-of-the-art methods on continual learning benchmarks and preserves generalization ability of LLMs on unseen tasks. |
AnaloBench: Benchmarking the Identification of Abstract and Long-context Analogies (2024.emnlp-main)
Copied to clipboard
Xiao Ye, Andrew Wang, Jacob Choi, Yining Lu, Shreya Sharma, Lingfeng Shen, Vijay Murari Tiyyala, Nicholas Andrews, Daniel Khashabi
| Challenge: | Analogical reasoning is an important part of human communication, says a new study . a benchmark to determine analogical reasoning ability in language models is needed . |
| Approach: | They propose to benchmark analogical reasoning ability in language models by collecting 340 analogies from human writings. |
| Outcome: | The proposed benchmark aims to determine analogical reasoning ability in language models. |
Revealing the Attention Floating Mechanism in Masked Diffusion Models (2026.findings-acl)
Copied to clipboard
Xin Dai, Pengcheng Huang, Zhenghao Liu, Shuo Wang, Yukun Yan, Chaojun Xiao, Yu Gu, Ge Yu, Maosong Sun
| Challenge: | Masked diffusion models (MDMs) leverage bidirectional attention and a denoising process. |
| Approach: | They investigate the attention behaviors of Masked diffusion models by revealing the phenomenon of Attention Floating. |
| Outcome: | The proposed model doubles the performance of autoregressive models in knowledge-intensive tasks. |
E-KAR: A Benchmark for Rationalizing Natural Language Analogical Reasoning (2022.findings-acl)
Copied to clipboard
Jiangjie Chen, Rui Xu, Ziquan Fu, Wei Shi, Zhongqiao Li, Xinbo Zhang, Changzhi Sun, Lei Li, Yanghua Xiao, Hao Zhou
| Challenge: | Existing benchmarks to test word analogy do not reveal the underneath process of analogical reasoning of neural models. |
| Approach: | They propose an explanation benchmark for analogical reasoning using a Civil Service exam . they use a free-text explanation scheme to explain whether an analogy should be drawn . |
| Outcome: | The proposed benchmark is very challenging for state-of-the-art models, it is found. |
GALA: Geometric Data Selection with Strategic Prospecting for Large Language Model Self-training (2026.findings-acl)
Copied to clipboard
| Challenge: | Existing approaches to self-training are based on reject sampling and lack quality reasoning paths. |
| Approach: | They propose a framework for self-training using a generate-and-filter paradigm . they propose to identify diverse and informative samples from redundant data and exploit them more strategically. |
| Outcome: | The proposed framework exploits informative samples from redundant data and improves reasoning trajectory prospecting. |
Dynamic Uncertainty Ranking: Enhancing Retrieval-Augmented In-Context Learning for Long-Tail Knowledge in LLMs (2025.naacl-long)
Copied to clipboard
| Challenge: | Prior work has shown that in-context learning (ICL) with retriever augmentation can help LLMs better capture long-tail knowledge, reducing their reliance on pre-trained data. |
| Approach: | They propose a reinforcement learning-based dynamic uncertainty ranking method that accounts for the varying impact of each retrieved sample on LLM predictions. |
| Outcome: | The proposed method outperforms baseline models on question-answering datasets by 2.76% and 5.96% on long-tail questions that elude zero-shot inference. |
Med-SRAF: A Multi-Agent Framework for Medical Reasoning via Semantic Routing and Agentic Fusion (2026.findings-acl)
Copied to clipboard
| Challenge: | Existing RAG methods suffer from a two-part problem: semantic drift and concatenation fallacy . et al.: rapid development of Large Language Models has led to a paradigm shift in artificial intelligence . |
| Approach: | They propose a multi-agent retrieval augmentation framework guided by medical domain knowledge to address these challenges. |
| Outcome: | The proposed framework outperforms existing general RAG baselines on five widely used medical benchmarks. |
Farewell to Aimless Large-scale Pretraining: Influential Subset Selection for Language Model (2023.findings-acl)
Copied to clipboard
Xiao Wang, Weikang Zhou, Qi Zhang, Jie Zhou, SongYang Gao, Junzhe Wang, Menghan Zhang, Xiang Gao, Yun Wen Chen, Tao Gui
| Challenge: | Pretrained language models have achieved remarkable success in various natural language processing tasks. |
| Approach: | They propose to use end-task knowledge to select a tiny subset of pretraining corpus to influence performance. |
| Outcome: | The proposed model outperforms pretrained models on eight datasets covering four domains with 0.45% of the data and a three-orders-of-magnitude lower computational cost. |
CR-LLM: A Dataset and Optimization for Concept Reasoning of Large Language Models (2024.findings-acl)
Copied to clipboard
Nianqi Li, Jingping Liu, Sihang Jiang, Haiyun Jiang, Yanghua Xiao, Jiaqing Liang, Zujie Liang, Feng Wei, Jinglei Chen, Zhenghong Hao, Bing Han
| Challenge: | Existing concept reasoning related datasets suffer from modeledge leakage and context leakage. |
| Approach: | They propose a concept reasoning for large language models with modeledge leakage prevention and context leakage preventive methods to improve the models' conceptual reasoning abilities. |
| Outcome: | The proposed method significantly improves the existing models and reasoning methods, achieving a 7% increase in accuracy compared to CoT and showing better granularity. |
AutoScraper: A Progressive Understanding Web Agent for Web Scraper Generation (2024.emnlp-main)
Copied to clipboard
Wenhao Huang, Zhouhong Gu, Chenghao Peng, Jiaqing Liang, Zhixu Li, Yanghua Xiao, Liqian Wen, Zulong Chen
| Challenge: | Existing methods for web scraping suffer from limited adaptability and scalability when faced with a new website. |
| Approach: | They propose a framework that generates web scrapers with large language models and a new executability metric to measure the performance of web scraper generation tasks. |
| Outcome: | The proposed framework can handle diverse web environments more efficiently. |
LM-Cocktail: Resilient Tuning of Language Models via Model Merging (2024.findings-acl)
Copied to clipboard
| Challenge: | Pre-trained language models are continually fine-tuned to better support downstream applications. however, this operation may result in significant performance degeneration on general perspectives. |
| Approach: | They propose a method which enables pre-trained language models to stay resilient in general perspectives. |
| Outcome: | The proposed model achieves strong empirical performance in the whole scope of general tasks while preserving a superior capacity in its targeted domain. |
CoMoL: Efficient Mixture of LoRA Experts via Dynamic Core Space Merging (2026.findings-acl)
Copied to clipboard
Jie Cao, Zhenxuan Fan, Zhuonan Wang, Tianwei Lin, Ziyuan Zhao, Rolan Yan, Wenqiao Zhang, Feifei Shao, Hongwei Wang, Jun Xiao, Siliang Tang
| Challenge: | Existing PEFT methods suffer from limited parameter efficiency and coarse-grained adaptation due to proliferation of LoRA experts and instance-level routing. |
| Approach: | They propose a new MoE-LoRA framework that incorporates expert diversity, parameter efficiency, and fine-grained adaptation. |
| Outcome: | The proposed framework outperforms existing methods on multiple tasks while maintaining parameter efficiency. |
Reasoning-Augmented Conversation for Multi-Turn Jailbreak Attacks on Large Language Models (2025.findings-emnlp)
Copied to clipboard
Zonghao Ying, Deyue Zhang, Zonglei Jing, Yisong Xiao, Quanchen Zou, Aishan Liu, Siyuan Liang, Xiangzheng Zhang, Xianglong Liu, Dacheng Tao
| Challenge: | Existing methods for implementing multi-turn jailbreaks struggle to balance semantic coherence with attack effectiveness, resulting in benign semantic drift or ineffective detection evasion. |
| Approach: | They propose a framework that reformulates harmful queries into benign reasoning tasks and leverages LLMs’ strong reasoning capabilities to compromise safety alignment. |
| Outcome: | The proposed framework achieves state-of-the-art attack effectiveness in complex conversational scenarios, with average ASRs increasing by up to 96%. |
Calibrated Speculative Decoding: Frequency-Guided Candidate Selection for Efficient Inference (2026.acl-long)
Copied to clipboard
| Challenge: | Speculative decoding (SD) is a powerful and efficient way to accelerate autoregressive generation. |
| Approach: | They propose a training-free framework that recovers valid tokens discarded by standard verification . they use online correction memory and Semantic Consistency Gating to analyze rejections . |
| Outcome: | The proposed framework outperforms existing methods and achieves peak throughput speedup of 2.33x. |
AutoDetect: Towards a Unified Framework for Automated Weakness Detection in Large Language Models (2024.findings-emnlp)
Copied to clipboard
Jiale Cheng, Yida Lu, Xiaotao Gu, Pei Ke, Xiao Liu, Yuxiao Dong, Hongning Wang, Jie Tang, Minlie Huang
| Challenge: | Large Language Models (LLMs) exhibit significant but subtle weaknesses, such as mistakes in instruction-following or coding tasks. |
| Approach: | They propose a framework to automatically expose weaknesses in Large Language Models (LLMs) they use three LLM-powered agents to perform comprehensive weakness identification . |
| Outcome: | The proposed framework shows that it is more effective than untargeted data augmentation methods like Self-Instruct to identify weaknesses in LLMs. |
LiGen: Active Lipid Generation via a Molecular Language Model (2026.acl-long)
Copied to clipboard
| Challenge: | Lipid nanoparticles (LNPs) can deliver cargos to tumor and immune cells . traditional approaches rely on experimental screening and expert judgment . |
| Approach: | They propose a method to generate lipid molecules efficiently and actively using deep learning. |
| Outcome: | The proposed method outperforms baseline methods on multiple cell lines and achieves a 30% improvement over the current methods. |
Safety Alignment in NLP Tasks: Weakly Aligned Summarization as an In-Context Attack (2024.acl-long)
Copied to clipboard
| Challenge: | Recent developments in balancing usefulness and safety of large language models raise a critical question . current attacks, especially adversarial ones that manipulate malicious prompts, often aim to manipulate the input . |
| Approach: | They show that LLMs can effectively summarize malicious long documents but often refuse to translate them. |
| Outcome: | The findings highlight a vulnerability in LLMs that can't translate or summarize documents . the study focuses on LLM models, Gemini and GPT-4, which can' be exploited . |
A Two-Stage Framework with Self-Supervised Distillation for Cross-Domain Text Classification (2024.lrec-main)
Copied to clipboard
| Challenge: | Existing work on cross-domain text classification relies on domain-invariant features or task-agnostic features. |
| Approach: | They propose a two-stage framework for cross-domain text classification that leverages or reuses rich labeled data from the source domain and unlabeled data in the target domain. |
| Outcome: | The proposed framework achieves state-of-the-art on a public cross-domain text classification benchmark. |
Extremely Weakly-supervised Text Classification with Wordsets Mining and Sync-Denoising (2024.naacl-long)
Copied to clipboard
| Challenge: | Existing methods for weakly-supervised text classification use only class names as supervision . Existing approaches to classify texts without labeled data have significant flaws, including zero-shot instability and context-dependent ambiguities. |
| Approach: | They propose to use wordsets to generate pseudo-labels for unlabeled texts . they propose to train the classifier using a hybrid learning strategy called sync-denoising . |
| Outcome: | The proposed method outperforms all existing prompt and seed methods on 11 datasets by an impressive average of 8 points. |
DisastQA: A Comprehensive Benchmark for Evaluating Question Answering in Disaster Management (2026.findings-acl)
Copied to clipboard
Zhitong Chen, Kai Yin, Xiangjue Dong, Chengkai Liu, Xiangpeng Li, Bo Li, Junwei Ma, Yiming Xiao, Ali Mostafavi, James Caverlee
| Challenge: | Existing benchmarks for question answering (QA) are lacking in a high-stakes environment. |
| Approach: | They propose a rigorously verified benchmark of 3,000 expert-annotated questions . they propose 'keypoint-based evaluation protocol' emphasizing factual completeness over verbosity . |
| Outcome: | Experiments with 20 models reveal substantial divergences from general-purpose models such as MMLU-Pro. |
An Augmented Benchmark Dataset for Geometric Question Answering through Dual Parallel Text Encoding (2022.coling-1)
Copied to clipboard
| Challenge: | Existing methods for solving geometric problems are limited due to lack of high-quality datasets and efficient neural solvers. |
| Approach: | They propose to annotate 2,518 geometric problems with richer types and greater difficulty using a benchmark dataset. |
| Outcome: | The proposed method improves the accuracy of automatic geometric problem solving to 66.09%. |
s3: You Don’t Need That Much Data to Train a Search Agent via RL (2025.emnlp-main)
Copied to clipboard
| Challenge: | Existing approaches to optimize retrieval using search-only metrics ignore downstream utility and fine-tune entire LLM to jointly reason and retrieve limit retrieval utility and compatibility with frozen or proprietary models. |
| Approach: | They propose a lightweight, model-agnostic framework that decouples the searcher from the generator and trains the search user using a Gain Beyond RAG reward. |
| Outcome: | The proposed framework outperforms baselines trained on over 70 more data with 2.4k training samples. |
InsLogicBench: An Argumentation Logic Grounded Benchmark for Complex Insurance Claims Adjudication (2026.acl-long)
Copied to clipboard
Jin Liu, Yunpeng Liu, Keyi Wang, Jie Shi, Xiao Xu, Wenkang Huang, Xingzhong Xu, Xin Liang, Yanghua Xiao
| Challenge: | Existing benchmarks for insurance claims adjudication are limited to information retrieval or simple multiple-choice setups. |
| Approach: | They propose a benchmark that provides complete reasoning traces linking factual inputs, relevant policy clauses, and final verdicts. |
| Outcome: | The proposed benchmark shows that models often produce correct decisions but fail to provide precise justifications, highlighting a critical discrepancy between decision accuracy and logical reasoning capabilities. |
LLM Critics Help Catch Bugs in Mathematics: Towards a Better Mathematical Verifier with Natural Language Feedback (2025.findings-acl)
Copied to clipboard
Bofei Gao, Zefan Cai, Runxin Xu, Peiyi Wang, Ce Zheng, Runji Lin, Keming Lu, Dayiheng Liu, Chang Zhou, Wen Xiao, Tianyu Liu, Baobao Chang
| Challenge: | Existing mathematical verifiers are trained with binary classification labels, which are not informative enough for the model to accurately assess the solutions. |
| Approach: | They propose a natural language feedback-enhanced verifier that can validate the correctness of response generated by policy models by constructing automatically generated training data and a two-stage training paradigm. |
| Outcome: | The proposed verifier significantly improves in verification and reinforcement learning and alleviates data-demanding problems of the reward model. |
RIGOURATE: Quantifying Scientific Exaggeration with Evidence-Aligned Claim Evaluation (2026.findings-acl)
Copied to clipboard
| Challenge: | Scientific rigour tends to be sidelined in favour of bold statements, leading authors to overstate claims beyond what their results support. |
| Approach: | They propose a multimodal framework that retrieves supporting evidence from a paper and assigns each claim an overstatement score. |
| Outcome: | The proposed framework retrieves supporting evidence from ICLR and NeurIPS papers and assigns each claim an overstatement score. |
ProductResearch: Training E-Commerce Deep Research Agents via Multi-Agent Synthetic Trajectory Distillation (2026.acl-industry)
Copied to clipboard
| Challenge: | Existing LLM-based agents lack the interaction depth and contextual breadth required for complex product research. |
| Approach: | They propose a multi-agent framework that synthesizes high-fidelity tool-use trajectories for training robust e-commerce shopping agents. |
| Outcome: | The proposed framework synthesizes high-fidelity, long-horizon tool-use trajectories for training robust e-commerce shopping agents. |
Better Simultaneous Translation with Monotonic Knowledge Distillation (2023.acl-long)
Copied to clipboard
| Challenge: | Existing methods to train offline MT models require generating target tokens before source sentence is fully consumed. |
| Approach: | They propose a method that leverages traditional translation models as teachers to generate monotonic yet accurate reference translations for sequence-level knowledge distillation. |
| Outcome: | The proposed approach improves on strong baselines and on a monotonic version of the WMT15 De-En test set. |
UNIMO: Towards Unified-Modal Understanding and Generation via Cross-Modal Contrastive Learning (2021.acl-long)
Copied to clipboard
| Challenge: | Existing pre-training methods focus on single-modal tasks or multi-modal ones . large-scale pre- training has drawn much attention in both the community of Compute Vision (CV) and Natural Language Processing (NLP). |
| Approach: | They propose a UNIfied-MOdal pre-training architecture which can adapt to both single-modal and multi-modal understanding and generation tasks. |
| Outcome: | The proposed model can learn more generalizable representations with rich non-paired single-modal data. |
Examining Inter-Consistency of Large Language Models Collaboration: An In-depth Analysis via Debate (2023.findings-emnlp)
Copied to clipboard
| Challenge: | Existing studies focus on inconsistency issues within a single LLM, while we explore the inter-consistencies among multiple LLMs for collaboration. |
| Approach: | They propose a formal debate framework to examine whether LLMs can collaborate effectively to achieve a consensus for a shared goal. |
| Outcome: | The proposed framework enables LLMs to achieve consensus in three real-world debate scenarios with real-time scenarios aligned to the LLM's goals. |
Instructions as Backdoors: Backdoor Vulnerabilities of Instruction Tuning for Large Language Models (2024.naacl-long)
Copied to clipboard
| Challenge: | et al., 2021) show that instruction models can be trained on crowdsourced datasets with task instructions to achieve superior performance. |
| Approach: | They examine security concerns of emergent instruction tuning paradigm that models are trained on crowdsourced datasets with task instructions to achieve superior performance. |
| Outcome: | The proposed model can achieve 90% success rate across four commonly used datasets. |
Reward Mixology: Crafting Hybrid Signals for Reinforcement Learning Driven In-Context Learning (2025.findings-emnlp)
Copied to clipboard
| Challenge: | Existing methods for in-context learning (ICL) performance rely on quality and ordering of demonstrations. |
| Approach: | They propose a method that models iterative demonstration selection as a Markov Decision Process and craft hybrid reward signals. |
| Outcome: | The proposed method combines outcome-based accuracy signals with process-oriented signals like stepwise influence and label entropy improvement. |
Not The End of Story: An Evaluation of ChatGPT-Driven Vulnerability Description Mappings (2023.findings-acl)
Copied to clipboard
| Challenge: | Existing data proves that ChatGPT performs no less than humans in text generation and knowledge Q&A. |
| Approach: | They propose to use ChatGPT to map vulnerabilities to common weakness enumeration (CWE), common attack pattern ennumeration and classification (ATT&CK) techniques and other classifications. |
| Outcome: | The proposed method performs better than human experts on many tasks, but it can't replace professional security engineers in vulnerability analysis. |
Bridging The Gap: Entailment Fused-T5 for Open-retrieval Conversational Machine Reading Comprehension (2023.acl-long)
Copied to clipboard
| Challenge: | Open-retrieval conversational machine reading comprehension (OCMRC) simulates real-life conversation scenes. |
| Approach: | They propose a one-stage end-to-end framework to bridge the information gap between decision-making and question generation in a global understanding manner. |
| Outcome: | The proposed framework achieves new state-of-the-art performance on the OR-ShARC benchmark. |
OctoBench: Benchmarking Scaffold-Aware Instruction Following in Repository-Grounded Agentic Coding (2026.acl-long)
Copied to clipboard
Deming Ding, Shichun Liu, Enhui Yang, Jiahang Lin, Ziying Chen, Shihan Dou, Honglin Guo, Weiyu Cheng, Pengyu Zhao, Chengjun Xiao, Qunhong Zeng, Qi Zhang, Xuanjing Huang, Qidi Xu, Tao Gui
| Challenge: | coding scaffolds that follow heterogeneous instructions remain under-examined in software engineering . coding models are capable software agents, but their ability to follow constraints remains under-explored . |
| Approach: | They introduce OctoBench, which benchmarks scaffold-aware instruction following in agentic coding. |
| Outcome: | The proposed benchmark aims to accelerate the development of more scaffold-aware agents. |
KRLS: Improving End-to-End Response Generation in Task Oriented Dialog with Reinforced Keywords Learning (2023.emnlp-main)
Copied to clipboard
| Challenge: | Task-oriented dialogs (TOD) require a model to generate a response that optimizes for task-related metrics. |
| Approach: | They propose a faster generation procedure that samples from independent next-word distributions and introduce a fine-grained reward function to help the model focus on learning key information in a dialog. |
| Outcome: | The proposed algorithm achieves state-of-the-art performance on an offline task with 15% training time reduction compared to a standard RL algorithm using auto-regressive generation. |
Reframe Your Life Story: Interactive Narrative Therapist and Innovative Moment Assessment with Large Language Models (2025.emnlp-main)
Copied to clipboard
Yi Feng, Jiaqi Wang, Wenxuan Zhang, Zhuang Chen, Shen Yutong, Xiyao Xiao, Minlie Huang, Liping Jing, Jian Yu
| Challenge: | Existing approaches to mental health support lack realism and capture therapeutic progression over time. |
| Approach: | They propose a framework that simulates expert narrative therapists by planning therapeutic stages, guiding reflection levels, and generating contextually appropriate responses through retrieval-augmentation. |
| Outcome: | The proposed framework outperforms standard methods in quality and depth on 260 simulated clients and 230 human participants. |
Document Segmentation Matters for Retrieval-Augmented Generation (2025.findings-acl)
Copied to clipboard
Zhitong Wang, Cheng Gao, Chaojun Xiao, Yufei Huang, Shuzheng Si, Kangyang Luo, Yuzhuo Bai, Wenhao Li, Tangjian Duan, Chuancheng Lv, Guoshan Lu, Gang Chen, Fanchao Qi, Maosong Sun
| Challenge: | Existing rule-based chunking methods lead to suboptimal splits, where overly large chunks introduce irrelevant information and small chunks lack semantic coherence. |
| Approach: | They propose a method that leverages document summaries as pseudo-instructions to guide chunking by computing semantic similarity between sentences and the summary. |
| Outcome: | Experiments on multiple open-domain question-answering benchmarks show that PIC significantly improves retrieval accuracy (Hits@k) and end-to-end QA performance (Exact Match) without any additional training. |
Let’s Rectify Step by Step: Improving Aspect-based Sentiment Analysis with Diffusion Models (2024.lrec-main)
Copied to clipboard
| Challenge: | Empirical evaluations conducted on eight benchmark datasets underscore the compelling advantages offered by DiffusionABSA when compared against robust baseline models. |
| Approach: | They propose a diffusion model which extracts aspects step by step and learns a denoising process that progressively restores them in a reverse manner. |
| Outcome: | Empirical evaluations on eight benchmark datasets underscore the compelling advantages offered by DiffusionABSA when compared against robust baseline models. |
ManagerTower: Aggregating the Insights of Uni-Modal Experts for Vision-Language Representation Learning (2023.acl-long)
Copied to clipboard
Xiao Xu, Bei Li, Chenfei Wu, Shao-Yen Tseng, Anahita Bhiwandiwalla, Shachar Rosenman, Vasudev Lal, Wanxiang Che, Nan Duan
| Challenge: | Two-Tower Vision-Language models suffer from ineffective layer-by-layer utilization of uni-modal representations and cannot flexibly exploit different levels of unil-modal knowledge. |
| Approach: | They propose a model architecture that gathers and combines the insights of pre-trained uni-modal experts at different levels to facilitate more comprehensive cross-modal alignment and fusion. |
| Outcome: | The proposed model outperforms baselines with and without Vision-Language Pre-training (VLP) with 4M VLP data. |
Revealing the Barriers of Language Agents in Planning (2025.naacl-long)
Copied to clipboard
| Challenge: | Existing studies show language agents lack human-level planning abilities . limitations and mechanisms to address them remain insufficiently understood . |
| Approach: | They apply a feature attribution study to identify key factors hindering agent planning . they identify the limited role of constraints and diminishing influence of questions . |
| Outcome: | The proposed model achieves 15.6% on a real-world planning benchmark. |
Leveraging Web-Crawled Data for High-Quality Fine-Tuning (2024.findings-emnlp)
Copied to clipboard
| Challenge: | Currently, large language models are fine-tuned using expensive human-annotated data or GPT-4 generated data. |
| Approach: | They propose to use web-crawled data to train a language model on a smaller set of data . their results show that the model can convert web data with irregular formats into high-quality ones . |
| Outcome: | The proposed model outperforms open-source models larger than 32B and outperformed open-sourced models such as GPT-3.5. |
A Dashboard for Mitigating the COVID-19 Misinfodemic (2021.eacl-demos)
Copied to clipboard
Zhengyuan Zhu, Kevin Meng, Josue Caraballo, Israa Jaradat, Xiao Shi, Zeyu Zhang, Farahnaz Akrami, Haojin Liao, Fatma Arslan, Damian Jimenez, Mohanmmed Samiul Saeef, Paras Pathak, Chengkai Li
| Challenge: | a new public dashboard aims to understand the impact of the COVID-19 misinfodemic on Twitter . the dashboard uses a curated catalog of COVId-19 related facts and debunks of misinformation . |
| Approach: | They propose a public dashboard that matches tweets with COVID-19 misinformation . they also propose experiments to analyze the spread of misinformation on twitter . |
| Outcome: | The proposed dashboard uses a curated catalog of COVID-19 related facts and debunks misinformation . it shows the most prevalent information from the catalog among Twitter users in user-selected geographic regions . |
AutoMIR: Effective Zero-Shot Medical Information Retrieval without Relevance Labels (2025.findings-emnlp)
Copied to clipboard
| Challenge: | Effective zero-shot dense retrieval in the medical domain remains difficult due to the scarcity of relevance-labeled data. |
| Approach: | They propose a framework that leverages large language models to generate hypothetical documents . they also propose 'CMIRB' to provide a rigorous evaluation suite . |
| Outcome: | The proposed framework outperforms HyDE in retrieval accuracy and generalization . it leverages large language models to generate hypothetical documents conditioned on a query . |
EvolvR: Self-Evolving Pairwise Reasoning for Story Evaluation to Enhance Generation (2026.acl-long)
Copied to clipboard
Xinda Wang, Zhengxu Hou, Yangshijie Zhang, null Yanbingren, Jialin Liu, ChenZhuo Zhao, Zhibo Yang, Bin-Bin Yang, Feng Xiao
| Challenge: | Existing methods for story evaluation lack reasoning capabilities for open-source models . evolvR framework provides high-fidelity evaluators for story generation tasks . |
| Approach: | They propose a framework that self-synthesizes chain-of-thought data via a multi-persona strategy . they propose evolvR to provide a reward model for story generation . |
| Outcome: | The proposed framework achieves state-of-the-art performance on three evaluation benchmarks . it also enhances the quality of generated stories, validating the superiority of the framework . |
Beyond Decoder-only: Large Language Models Can be Good Encoders for Machine Translation (2025.findings-acl)
Copied to clipboard
Yingfeng Luo, Tong Zheng, Yongyu Mu, Bei Li, Qinghong Zhang, Yongqi Gao, Ziqiang Xu, Peinan Feng, Xiaoqian Liu, Tong Xiao, JingBo Zhu
| Challenge: | Recent advances in machine translation have focused on a single pre-trained decoder . encoder-decoder architectures have received relatively little attention in NMT . |
| Approach: | They propose a method that leverages LLMs as MT encoders and pairs them with lightweight decoders to develop universal translation models. |
| Outcome: | The proposed method matches or surpasses baselines in terms of translation quality but achieves 75% reduction in memory footprint of the KV cache. |
Diagnosing Failures in Large Language Models’ Answers: Integrating Error Attribution into Evaluation Framework (2025.findings-acl)
Copied to clipboard
| Challenge: | Existing evaluation models lack error attribution capability due to their proprietary nature. |
| Approach: | They propose a misattribution framework with 6 primary and 15 secondary categories to facilitate in-depth analysis. |
| Outcome: | The proposed framework is based on a dataset specifically designed for error attribution, along with the corresponding scores and feedback. |
Translation or Recitation? Calibrating Evaluation Scores for Machine Translation of Extremely Low-Resource Languages (2026.acl-short)
Copied to clipboard
| Challenge: | Existing studies show that performance across low-resource settings is variable, resulting in a significant barrier for the MT community. |
| Approach: | They propose to use FRED Difficulty Metrics to contextualize reported performance across different language pairs to determine whether breakthroughs reported in other contexts are artifacts of benchmark collection. |
| Outcome: | The proposed metrics explain a significant portion of result variability rather than model capability. |
Revisiting Interpolation Augmentation for Speech-to-Text Generation (2024.findings-acl)
Copied to clipboard
Chen Xu, Jie Wang, Xiaoqian Liu, Qian Dong, Chunliang Zhang, Tong Xiao, JingBo Zhu, Dapeng Man, Wu Yang
| Challenge: | Existing approaches to speech-to-text generation tasks are limited by the lack of extensive labeled datasets. |
| Approach: | They propose to use interpolation augmentation to construct virtual training samples by transforming inputs and labels to enhance generalization in other domains. |
| Outcome: | The proposed approach significantly improves performance across diverse tasks, architectures, and data scales, offering a promising avenue for more robust S2T systems in resource-constrained settings. |
FocalPO: Enhancing Preference Optimizing by Focusing on Correct Preference Rankings (2025.acl-short)
Copied to clipboard
| Challenge: | Efficient preference optimization algorithms such as Direct Preference Optimization (DPO) have become a popular approach in aligning large language models with human preferences. |
| Approach: | They propose a preference optimization variant that instead down-weighs misranked preference pairs and prioritizes enhancing the model’s understanding of pairs that it can already rank correctly. |
| Outcome: | The proposed model outperforms DPO on benchmarks like Alpaca Eval 2.0 and Arena-Hard using mistral-base-7B and Llama-3-Instruct-8B with the introduced hyperparameter fixed. |
Is Summary Useful or Not? An Extrinsic Human Evaluation of Text Summaries on Downstream Tasks (2024.lrec-main)
Copied to clipboard
| Challenge: | a recent study focused on intrinsic evaluation, which assesses the quality of summaries, e.g. coherence, fluency, and informativeness, but it focused on task-based extrinsic evaluation to determine the usefulness of summarizations. |
| Approach: | They incorporate three downstream tasks to measure the usefulness of summaries . they find that fine-tuned models produce more useful summary across all three tasks . |
| Outcome: | The proposed model produces more useful summaries across all three tasks compared to zero-shot models . human evaluation provides more reliable performance assessment compared with automatic methods . |
APB: Accelerating Distributed Long-Context Inference by Passing Compressed Context Blocks across GPUs (2025.acl-long)
Copied to clipboard
Yuxiang Huang, Mingye Li, Xu Han, Chaojun Xiao, Weilin Zhao, Sun Ao, Hao Zhou, Jie Zhou, Zhiyuan Liu, Maosong Sun
| Challenge: | Long-context inference is crucial for advancing large language models, but its prefill speed remains a bottleneck. |
| Approach: | They propose an efficient long-context inference framework that leverages multi-host approximate attention to enhance prefill speed. |
| Outcome: | The proposed framework achieves speedups of 9.2, 4.2, and 1.6 without any degradation in performance. |
Similarity Based Auxiliary Classifier for Named Entity Recognition (D19-1)
Copied to clipboard
| Challenge: | Named entity recognition (NER) tasks are a fundamental challenge for name recognition tasks that aim to reduce the boundary error when entities become longer. |
| Approach: | They propose a similarity based auxiliary classifier which can distinguish entity words from non-entity words by using vectors to indicate tags. |
| Outcome: | Empirical results show that the proposed classifier can perform better than baseline approaches. |
SceneGenAgent: Precise Industrial Scene Generation with Coding Agent (2025.acl-long)
Copied to clipboard
| Challenge: | Recent work on scene generation focuses on generating 3D scenes from textual descriptions . however, the task of generating industrial scenes with LLMs is complex and requires precise measurements and positioning . |
| Approach: | They propose an LLM-based agent for generating industrial scenes through C# code. |
| Outcome: | Experiments show that LLMs powered by SceneGenAgent exceed their original performance . the agent achieves 81.0% success rate in real-world industrial scene generation tasks . |
Bridging the Granularity Gap for Acoustic Modeling (2023.findings-acl)
Copied to clipboard
Chen Xu, Yuhao Zhang, Chengbo Jiao, Xiaoqian Liu, Chi Hu, Xin Zeng, Tong Xiao, Anxiang Ma, Huizhen Wang, Jingbo Zhu
| Challenge: | Despite the success of speech recognition, how to encode the speech features effectively remains an open problem. |
| Approach: | They propose a Progressive Down-Sampling technique which compresses acoustic features into coarser-grained units containing more complete semantic information, like text-level representation. |
| Outcome: | The proposed method yields comparable or better results on the speech recognition task and inference speedups ranging from 1.20x to 1.47x. |
M3CoT: A Novel Benchmark for Multi-Domain Multi-step Multi-modal Chain-of-Thought (2024.acl-long)
Copied to clipboard
| Challenge: | MCoT requires models to leverage knowledge from both textual and visual modalities for step-by-step reasoning. |
| Approach: | They propose a benchmark to address the challenges of MCoT, and evaluate it using vision large language models. |
| Outcome: | The proposed benchmark addresses the above challenges and shows that current models still struggle to reason in M3CoT. |
Past Meets Present: Creating Historical Analogy with Large Language Models (2025.acl-long)
Copied to clipboard
Nianqi Li, Siyu Yuan, Jiangjie Chen, Jiaqing Liang, Feng Wei, Zujie Liang, Deqing Yang, Yanghua Xiao
| Challenge: | Historical analogies are important abilities that help people make decisions and understand the world. |
| Approach: | They propose a historical analogy acquisition task that uses large language models to acquire historical analogies. |
| Outcome: | The proposed method mitigates hallucinations and stereotypes when LLMs generate historical analogies. |
E2E-VLP: End-to-End Vision-Language Pre-training Enhanced by Visual Learning (2021.acl-long)
Copied to clipboard
| Challenge: | Existing vision-language pre-training methods use a two-step training procedure to learn visual features from image-text pairs. |
| Approach: | They propose a vision-language pre-trained model for V+L understanding and generation using a unified Transformer framework. |
| Outcome: | The proposed model can learn visual representation and semantic alignments between image and text on visual-text pairs and on visual processing tasks. |
EmotionQueen: A Benchmark for Evaluating Empathy of Large Language Models (2024.findings-acl)
Copied to clipboard
| Challenge: | Existing evaluations of emotional intelligence in large language models (LLMs) focus on basic sentiment analysis tasks, such as emotion recognition, which is not enough to evaluate LLMs’ overall emotional intelligence. |
| Approach: | They propose a framework for evaluating the emotional intelligence of large language models (LLMs) that includes four distinct tasks: Key Event Recognition, Mixed Event Recognition and Implicit Emotional Recognition. |
| Outcome: | The proposed framework includes four distinct tasks: Key Event Recognition, Mixed Event Recognition and Implicit Emotional Recognition. |
Video-MMMU: Evaluating Knowledge Acquisition from Multidisciplinary Professional Videos (2026.acl-long)
Copied to clipboard
| Challenge: | Existing video benchmarks do not evaluate the knowledge acquisition capabilities of Large Multimodal Models (LMMs) existing video benchmark focuses on static, general visual understanding tasks, without evaluating whether models can acquire knowledge dynamically. |
| Approach: | They propose a multi-modal, multi-discipline, multitrack benchmark that evaluates Large Multimodal Models’ ability to acquire knowledge from college-level, educational videos. |
| Outcome: | The proposed benchmark reveals a substantial gap between human learners and current Large Multimodal Models (LMMs) and focuses on improving their learning efficiency. |
Negation Triplet Extraction with Syntactic Dependency and Semantic Consistency (2024.lrec-main)
Copied to clipboard
| Challenge: | Negation understanding is crucial to many downstream tasks such as sentiment analysis, question answering, Web search and natural language inference. |
| Approach: | They propose a novel negation triplet extraction task which aims to extract negation subject along with negation cue and scope. |
| Outcome: | The proposed model is based on a generative pretrained language model with a multi-task learning framework and achieves the best performance compared to baselines. |
A Survey of RAG-Reasoning Systems in Large Language Models (2025.findings-emnlp)
Copied to clipboard
Yangning Li, Weizhi Zhang, Yuyao Yang, Wei-Chieh Huang, Yaozu Wu, Junyu Luo, Yuanchen Bei, Henry Peng Zou, Xiao Luo, Yusheng Zhao, Chunkit Chan, Yankai Chen, Zhongfen Deng, Yinghui Li, Hai-Tao Zheng, Dongyuan Li, Renhe Jiang, Ming Zhang, Yangqiu Song, Philip S. Yu
| Challenge: | a survey of RAG-based reasoning-based approaches shows that it is not effective for multi-step inferences. |
| Approach: | They map how advanced reasoning optimizes each stage of RAG . they show how retrieved knowledge supply missing premises and expand context for complex inference . |
| Outcome: | The proposed frameworks achieve state-of-the-art across knowledge-intensive benchmarks. |
Is LLM an Overconfident Judge? Unveiling the Capabilities of LLMs in Detecting Offensive Language with Annotation Disagreement (2025.findings-acl)
Copied to clipboard
| Challenge: | Existing studies focus on evaluating large language models' ability to handle disagreement cases. |
| Approach: | They evaluate the performance of large language models in detecting offensive language at varying levels of agreement. |
| Outcome: | The proposed model improves detection accuracy and model alignment with human judgment by using disagreement samples in training. |
NUMINA: A Natural Understanding Benchmark for Multi-dimensional Intelligence and Numerical Reasoning Abilities (2025.findings-emnlp)
Copied to clipboard
Changyu Zeng, Yifan Wang, Zimu Wang, Wei Wang, Zhengni Yang, Muyi Bao, Jimin Xiao, Anh Nguyen, Yutao Yue
| Challenge: | Existing 3D benchmarks lack fine-grained numerical reasoning task annotations, limiting MLLMs’ ability to perform precise spatial measurements and complex numerical reasoning. |
| Approach: | They propose a 3D-based benchmark to enhance indoor perceptual understanding by using multi-scale annotations and question-answer pairs. |
| Outcome: | The proposed benchmark improves indoor perceptual understanding by incorporating multi-scale annotations and question-answer pairs. |
Does Multi-Encoder Help? A Case Study on Context-Aware Neural Machine Translation (2020.acl-main)
Copied to clipboard
| Challenge: | In encoder-decoder neural models, multiple encoders are used to represent contextual information in addition to the individual sentence. |
| Approach: | They propose to use multiple context encoders to encode the individual sentences in document-level neural machine translation (NMT) They propose a noisy dropout setup and a single-encoder approach to encode context sentences. |
| Outcome: | The proposed approach encodes the context and the current sentence without contexts. |
Video-Language Understanding: A Survey from Model Architecture, Model Training, and Data Perspectives (2024.findings-acl)
Copied to clipboard
Thong Nguyen, Yi Bin, Junbin Xiao, Leigang Qu, Yicong Li, Jay Zhangjie Wu, Cong-Duy Nguyen, See-Kiong Ng, Anh Tuan Luu
| Challenge: | Existing video-language understanding systems with human-like senses can mimic both our linguistic medium and visual environment with temporal dynamics. |
| Approach: | They propose to develop video-language understanding systems with human-like senses . they summarize their methods and highlight challenges associated with them . |
| Outcome: | The proposed models perform well in a variety of tasks and domains. |
Lost in Literalism: How Supervised Training Shapes Translationese in LLMs (2025.acl-long)
Copied to clipboard
| Challenge: | Large language models exhibit translationese errors and generate unexpected unnatural translations . Neural machine translation (NMT) has become the dominant method in machine translation research . |
| Approach: | They evaluate the prevalence of translationese in LLM-generated translations and investigate its roots during supervised fine-tuning. |
| Outcome: | The proposed methods reduce translationese while improving translation naturalness . the proposed methods are validated by human evaluations and automatic metrics . |
GRASPrune: Global Gating for Budgeted Structured Pruning of Large Language Models (2026.acl-long)
Copied to clipboard
| Challenge: | Large language models are expensive to serve because dense FFN blocks, multi-head attention, and KV caches dominate memory. |
| Approach: | They propose a global budgeted structured pruning framework that prunes FFN channels and attention KV head groups under a single global parameter budget. |
| Outcome: | The proposed model removes 50% of parameters and achieves 12.18 perplexity on WikiText-2 while maintaining competitive average zero-shot accuracy on five downstream benchmarks. |
Joint Semantic and Strategy Matching for Persuasive Dialogue (2023.findings-emnlp)
Copied to clipboard
Chuhao Jin, Yutao Zhu, Lingzhen Kong, Shijie Li, Xiao Zhang, Ruihua Song, Xu Chen, Huan Chen, Yuchong Sun, Yu Chen, Jun Xu
| Challenge: | Persuasive dialogue models rely on utterance semantic matching and a key aspect has been ignored . compared with utterrance semantics, conversation strategies are high-level concepts, which can be informative and provide complementary information to achieve effective persuation. |
| Approach: | They propose to model conversation semantics and strategies to match them using a BERT-like module and an auto-regressive predictor. |
| Outcome: | The proposed model improves state-of-the-art by 5% on a small and 37% on 'large' datasets. |
SCALER: Synthetic Scalable Adaptive Learning Environment for Reasoning (2026.findings-acl)
Copied to clipboard
| Challenge: | Reinforcement learning (RL) is a principled way to enhance the reasoning capabilities of large language models, yet its effectiveness hinges on training signals that remain informative as models evolve. |
| Approach: | They propose a framework that sustains effective learning signals through adaptive environment design that transforms real-world programming problems into verifiable reasoning environments with controllable difficulty and unbounded instance generation. |
| Outcome: | The proposed framework outperforms baselines across diverse reasoning benchmarks and exhibits more stable, long-horizon training dynamics. |
Extractive Summarization via ChatGPT for Faithful Summary Generation (2023.findings-emnlp)
Copied to clipboard
| Challenge: | Abstractive summarization methods struggle with generating ungrammatical or even nonfactual contents. |
| Approach: | They evaluate ChatGPT's performance on extractive summarization and compare it with traditional fine-tuning methods on benchmark datasets. |
| Outcome: | The proposed pipeline performs better than abstractive methods on summary faithfulness and in-context learning. |
MAGI: Multi-Agent Guided Interview for Psychiatric Assessment (2025.findings-acl)
Copied to clipboard
Guanqun Bi, Zhuang Chen, Zhoufu Liu, Hongkai Wang, Xiyao Xiao, Yuqiang Xie, Wen Zhang, Yongkang Huang, Yuxuan Chen, Libiao Peng, Minlie Huang
| Challenge: | Existing large language models (LLMs) do not align with psychiatric diagnostic protocols. |
| Approach: | They propose a framework that transforms the Mini International Neuropsychiatric Interview into automatic computational workflows through coordinated multi-agent collaboration. |
| Outcome: | The proposed framework transforms the gold-standard Mini International Neuropsychiatric Interview (MINI) into automatic computational workflows through coordinated multi-agent collaboration. |
Tool Zero: Training Tool-Augmented LLMs via Pure RL from Scratch (2025.findings-emnlp)
Copied to clipboard
Yirong Zeng, Xiao Ding, Yutai Hou, Yuxian Wang, Li Du, Juyi Dai, Qiuyang Ding, Duyu Tang, Dandan Tu, Weiwen Liu, Bing Qin, Ting Liu
| Challenge: | Experimental results demonstrate that our models achieve over 7% performance improvement compared to both SFT and RL-with-SFT models under the same experimental settings. |
| Approach: | They propose a dynamic generalization-guided reward design for rule-based RL that shifts rewards from exploratory to exploitative tool-use patterns. |
| Outcome: | The proposed model achieves over 7% performance improvement compared to SFT and RL-with-SFT models under the same experimental settings. |
Protecting Bystander Privacy via Selective Hearing in Audio LLMs (2026.acl-long)
Copied to clipboard
| Challenge: | Audio Large language models capture speech from unintended bystanders, raising privacy risks that existing benchmarks and defences did not consider. |
| Approach: | They propose to evaluate selective hearing by evaluating a model’s ability to attend to an intended main speaker while refusing to process or reveal information about incidental bystander speech. |
| Outcome: | The proposed model can attend to an intended main speaker while refusing to process or reveal information about incidental bystander speech. |
M3-Embedding: Multi-Linguality, Multi-Functionality, Multi-Granularity Text Embeddings Through Self-Knowledge Distillation (2024.findings-acl)
Copied to clipboard
| Challenge: | In this paper, we introduce a new embedding model for semantic retrieval of more than 100 working languages. |
| Approach: | They propose a new embedding model that supports multi-lingual, cross-lingual and long-document retrieval . they propose integrating relevance scores from different retrieval functionalities into the teacher signal . |
| Outcome: | The proposed model exhibits superior performance on multilingual, cross-lingual, and long-document retrieval benchmarks. |
End-to-End Conversational Search for Online Shopping with Utterance Transfer (2021.emnlp-main)
Copied to clipboard
Liqiang Xiao, Jun Ma, Xin Luna Dong, Pascual Martínez-Gómez, Nasser Zalmout, Chenwei Zhang, Tong Zhao, Hao He, Yaohui Jin
| Challenge: | a new study proposes a conversational search system that integrates product attributes and dialog with search . but it faces two real world challenges: imperfect product schema/knowledge and lack of training dialog data . |
| Approach: | They propose an end-to-end conversational search system that integrates search with text . they propose an utterance transfer approach that generates dialogue utterations from other domains . |
| Outcome: | The proposed system outperforms the best tested baseline in a conversational search dataset for online shopping. |
CodeRM-NT: Reward Model for Code RL without Unit Tests (2026.findings-acl)
Copied to clipboard
| Challenge: | Existing methods rely on unit tests to evaluate code correctness and provide rewards, but these methods are difficult to verify at scale. |
| Approach: | They propose a code reward model that leverages Monte Carlo Tree Search guided by LLMs to generate code snippets and judges execution traces to annotate code with reward signals. |
| Outcome: | The proposed model outperforms synthetic unit tests on multiple code generation benchmarks and improves curriculum learning. |
Learning Sentence Representations over Tree Structures for Target-Dependent Classification (N18-1)
Copied to clipboard
| Challenge: | Existing work on tree structures uses syntactic parsers or Treebank annotations to perform target-dependent classifications. |
| Approach: | They propose a reinforcement learning based approach which automatically induces target-specific sentence representations over tree structures. |
| Outcome: | The proposed model gives superior performance on two benchmark tasks compared to previous work on parsed trees . |
From AR to Diffusion: Efficiently Adapting Large Language Models with Strictly Causal and Elastic Horizons (2026.acl-long)
Copied to clipboard
| Challenge: | Autoregressive (AR) models rely on bidirectional attention, creating a structural mismatch with pre-trained Autoregression models. |
| Approach: | They propose a framework that efficiently adapts autoregressive (AR) models to the diffusion paradigm. |
| Outcome: | The proposed framework reduces training costs by orders of magnitude while maintaining state-of-the-art performance. |
Legal Fact Prediction: The Missing Piece in Legal Judgment Prediction (2025.emnlp-main)
Copied to clipboard
Junkai Liu, Yujie Tong, Hui Huang, Bowen Zheng, Yiran Hu, Peicheng Wu, Chuan Xiao, Makoto Onizuka, Muyun Yang, Shuyuan Zheng
| Challenge: | Existing studies use legal facts to predict judgments, but legal facts are difficult to obtain in early stages of litigation. |
| Approach: | They propose a legal fact prediction task that takes evidence from trial as input to make predictions in the absence of ground-truth legal facts. |
| Outcome: | The proposed task can predict court rulings without ground-truth legal facts . the first benchmark dataset, LFPBench, is used to evaluate the task . |
CSLM: A Framework for Question Answering Dataset Generation through Collaborative Small Language Models (2024.findings-emnlp)
Copied to clipboard
| Challenge: | Collecting high-quality question-answer (QA) pairs is vital for training large language models, but computational demands and associated costs often render such approaches prohibitive for the average researcher. |
| Approach: | They propose a small-scaled, open-source solution that generates QA pairs from documents or raw corpora using large-scale models like Llama-70B. |
| Outcome: | Experiments on domain-specific datasets show that the proposed model can generate high-quality QA pairs, making it accessible to a broader range of researchers. |
Large-Scale Multimodal Knowledge Graph about Classical Chinese Poetry: Fine-grained Method and Comprehensive Evaluation (2026.findings-acl)
Copied to clipboard
| Challenge: | Existing studies on classical Chinese poetry are limited by modality constraints, dataset size, or the level of refinement. |
| Approach: | They propose to construct a large-scale and fine-grained multimodal knowledge graph of classical Chinese poetry using an informative ontology graph and a text-image alignment method. |
| Outcome: | The proposed method collects knowledge about classical Chinese poetry from ontology graphs and performs four tasks that demonstrate its comprehensiveness and high quality. |
Memory-Guided Hard Data Augmentation for Multimodal Named Entity Recognition (2026.findings-acl)
Copied to clipboard
Xinyu Liu, Kai fu, Yinghan Shi, Quanyou Chu, Ming Du, Hongya Wang, Xiaojun Meng, Jiansheng Wei, Yanghua Xiao, Bo Xu
| Challenge: | Existing methods for Named Entity Recognition (NER) ignore the internal state of the target model. |
| Approach: | They propose a framework to repair model-specific errors by using a model-based approach . they employ cross-validation to identify model- specific Hard Data and a memory tree to induce macro-level error patterns from micro-level failures. |
| Outcome: | The proposed framework yields significant performance gains on Twitter and other platforms. |
Boosting Text-to-SQL through Multi-grained Error Identification (2025.coling-main)
Copied to clipboard
| Challenge: | Existing methods for error identification often overlook validation of generated results . text-to-SQL is a technology that converts natural language questions into executable SQL queries . |
| Approach: | They propose to integrate a multi-grained error identification method into existing methods to detect SQL errors. |
| Outcome: | The proposed method can be integrated as a plugin into various methods, providing effective error identification and correction capabilities. |
Integrating Text and Image: Determining Multimodal Document Intent in Instagram Posts (D19-1)
Copied to clipboard
| Challenge: | Existing studies on text-image content have focused on image as primary content, and text as secondary content. |
| Approach: | They propose a multimodal dataset of 1299 Instagram posts labeled for three orthogonal taxonomies . they show that employing both text and image improves intent detection by 9.6 . |
| Outcome: | The proposed model shows that using both text and image improves intent detection by 9.6 compared to using only the image modality. |
Light-R1: Curriculum SFT, DPO and RL for Long COT from Scratch and Beyond (2025.acl-industry)
Copied to clipboard
Liang Wen, Yunke Cai, Fenrui Xiao, Xin He, Qi An, Zhenyu Duan, Yimin Du, Junchen Liu, Tanglifu Tanglifu, Xiaowei Lv, Haosheng Zou, Yongchao Deng, Shousheng Jia, Xiangzheng Zhang
| Challenge: | Experimental results show that opensource curriculum training is more effective when distinct datasets are available for different training stages. |
| Approach: | They propose an opensource suite for training long reasoning models using publicdata and models. |
| Outcome: | The proposed model outperforms DeepSeek-R1-DistillQwen-32B models in math reasoning. |
FEDKIM: Adaptive Federated Knowledge Injection into Medical Foundation Models (2024.emnlp-main)
Copied to clipboard
| Challenge: | Existing foundation models are limited in access to diverse modalities and privacy regulations restrict the development of comprehensive foundation models. |
| Approach: | They propose a knowledge injection approach to extract and inject healthcare knowledge into medical foundation models to enhance their ability to handle multiple tasks and modalities. |
| Outcome: | The proposed method preserves privacy and enhances the model’s ability to handle complex medical tasks involving multiple modalities. |
Zero-shot Event Detection Using a Textual Entailment Model as an Enhanced Annotator (2024.lrec-main)
Copied to clipboard
| Challenge: | Recent work proposed to use a pre-trained textual entailment model for event detection . but, those methods treated the TE model as a frozen annotator . |
| Approach: | They propose to use TE models to annotate large-scale unlabeled text and annotated data to fine-tune the TE model. |
| Outcome: | The proposed method outperforms baseline methods by 15% on the ACE05 dataset. |
AlignBench: Benchmarking Chinese Alignment of Large Language Models (2024.acl-long)
Copied to clipboard
Xiao Liu, Xuanyu Lei, Shengyuan Wang, Yue Huang, Andrew Feng, Bosi Wen, Jiale Cheng, Pei Ke, Yifan Xu, Weng Lam Tam, Xiaohan Zhang, Lichao Sun, Xiaotao Gu, Hongning Wang, Jing Zhang, Minlie Huang, Yuxiao Dong, Jie Tang
| Challenge: | Effective evaluation of alignment for emerging Chinese LLMs is still significantly lacking, calling for real-scenario grounded, open-ended, challenging and automatic evaluations tailored for alignment. |
| Approach: | They propose a multi-dimensional benchmark for evaluating LLMs’ alignment in Chinese with 8 main categories, 683 real-scenario rooted queries and corresponding human verified references. |
| Outcome: | The benchmark uses a human-in-the-loop data curation pipeline, 683 real-scenario rooted queries and human verified references. |
Hire Your Anthropologist! Rethinking Culture Benchmarks Through an Anthropological Lens (2026.findings-eacl)
Copied to clipboard
| Challenge: | anthropological accounts of culture often focus on static facts or homogeneous values . large language models are being implemented in translation systems, educational tools and search engines . |
| Approach: | They propose to categorize how benchmarks frame culture such as knowledge, preference, performance, or bias. |
| Outcome: | The proposed framework categorizes how benchmarks frame culture, such as knowledge, preference, performance, or bias. |
Dependency parsing with structure preserving embeddings (2021.eacl-main)
Copied to clipboard
| Challenge: | Modern neural approaches to dependency parsing are trained to predict a tree structure by learning a contextual representation for tokens in a sentence and a head–dependent scoring function. |
| Approach: | They propose to combine a contextual representation for tokens and a head–dependent scoring function to learn interpretable representations by training a parser to explicitly preserve structural properties of a tree. |
| Outcome: | The proposed approach yields strong tree distance preservation and parsing performance on par with a competitive graph-based parser. |
A Survey of Post-Training Scaling in Large Language Models (2025.acl-long)
Copied to clipboard
Hanyu Lai, Xiao Liu, Junjie Gao, Jiale Cheng, Zehan Qi, Yifan Xu, Shuntian Yao, Dan Zhang, Jinhua Du, Zhenyu Hou, Xin Lv, Minlie Huang, Yuxiao Dong, Jie Tang
| Challenge: | Large language models (LLMs) have demonstrated proficiency in understanding and generating human natural languages. |
| Approach: | They propose a framework for scaling large language models using supervised fine-tuning, RLxF and test-time compute methodologies. |
| Outcome: | The proposed model can be used to understand and generate human natural languages. |
GhostBERT: Generate More Features with Cheap Operations for BERT (2021.acl-long)
Copied to clipboard
| Challenge: | Existing studies show that some parameters in pre-trained language models can be pruned away without severe accuracy degradation. |
| Approach: | They propose a method which generates more features with very cheap operations from the remaining features and can be applied to unpruned BERT models to enhance their performance. |
| Outcome: | Empirical results on the GLUE benchmark on three backbone models (i.e., BERT, RoBERTa and ELECTRA) verify the efficacy of the proposed method. |
3R: Enhancing Sentence Representation Learning via Redundant Representation Reduction (2025.emnlp-main)
Copied to clipboard
| Challenge: | Existing approaches to improve sentence representations lack fine-grained guidance on reducing redundant information. |
| Approach: | They propose a method that dynamically identifies redundant information from a dimensional perspective and trains the SRL model to redistribute semantics on different dimensions. |
| Outcome: | The proposed method improves sentence representations on seven semantic text similarity benchmarks. |
Guide the Many-to-One Assignment: Open Information Extraction via IoU-aware Optimal Transport (2023.acl-long)
Copied to clipboard
Kaiwen Wei, Yiran Yang, Li Jin, Xian Sun, Zequn Zhang, Jingyuan Zhang, Xiao Li, Linhao Zhang, Jintao Liu, Guo Zhi
| Challenge: | Open Information Extraction (OIE) aims to extract structured information from text without the limitations of close ontology. |
| Approach: | They propose a method to assign ground truth labels to parallelly generated tuple proposals . they leverage intersection-over-union (IoU) as assignment quality measurement . |
| Outcome: | The proposed method outperforms the state-of-the-art models on three benchmarks. |
Verbing Weirds Language (Models): Evaluation of English Zero-Derivation in Five LLMs (2024.lrec-main)
Copied to clipboard
| Challenge: | Lexical-syntactic flexibility is a hallmark of English morphology . conversion involves placing a word with one part of speech in a non-prototypical context . |
| Approach: | They propose to test lexical-syntactic flexibility in the form of conversion . conversion is a process where a word with one part of speech is placed in a non-prototypical context . |
| Outcome: | The proposed task tests the ability of five language models to generalize over words with a non-prototypical part of speech. |
Open-Domain Question Answering with Pre-Constructed Question Spaces (2021.naacl-srw)
Copied to clipboard
| Challenge: | Open-domain question answering aims at locating answers to user-generated questions in massive collections of documents. |
| Approach: | They propose an algorithm with a novel reader-retriever design that differs from both families of algorithms. |
| Outcome: | The proposed algorithm outperforms retrieval-based methods with two large-scale datasets and is state-of-the-art. |
Token-level Inference-Time Alignment for Vision-Language Models (2026.findings-acl)
Copied to clipboard
Kejia Chen, Junjun Zheng, Jiawen Zhang, Manxi Lin, Xiao Pan, Jiacong Hu, Jian Lou, Zunlei Feng, Mingli Song
| Challenge: | Vision-Language Models (VLMs) often prioritize linguistic fluency over visual fidelity . despite widespread adoption, VLMs often exhibit a critical failure mode: hallucination . |
| Approach: | They propose a framework for Token-level Inference-Time Alignment that steers the decoding process without updating the base model parameters. |
| Outcome: | The proposed framework improves performance on 13 benchmarks across architectures . it boosts LLaVA-1.5-7B by 8.6% on MMVet and achieves a 74.0 MMStar score . |
Improving Continual Relation Extraction through Prototypical Contrastive Learning (2022.coling-1)
Copied to clipboard
| Challenge: | Continual relation extraction (CRE) aims to extract relations towards the continuous and iterative arrival of new data, of which the major challenge is the catastrophic forgetting of old tasks. |
| Approach: | They propose a Continual Relation Extraction framework with Contrastive Learning which is built with a classification network and a prototypical contrastive network to achieve incremental-class learning of CRE. |
| Outcome: | The proposed framework outperforms the state-of-the-art methods on two public datasets and proves its effectiveness on improving performance. |
AgentTuning: Enabling Generalized Agent Abilities for LLMs (2024.findings-acl)
Copied to clipboard
| Challenge: | Open large language models (LLMs) with great performance in various tasks are far inferior to commercial models such as ChatGPT and GPT-4 when acting as agents to tackle complex tasks in the real world. |
| Approach: | They propose a method to enhance the agent capabilities of LLMs while maintaining their general abilities. |
| Outcome: | The AgentLM-70B is comparable to GPT-3.5-turbo on unseen agent tasks, demonstrating generalized agent capabilities. |
QCAW 1.0: Building a Qatari Corpus of Student Argumentative Writing (2024.lrec-main)
Copied to clipboard
| Challenge: | Existing studies have highlighted the importance of and need to create learner corpora. |
| Approach: | They propose to create a Qatari corpus of argumentative writing (QCAW) the corpus contains 200,000 tokens of argumentation written by Qatari university students . |
| Outcome: | The QCAW contains 195 essays written by 195 students, 159 females and 36 males. |
LongCLI-Bench: A Preliminary Benchmark and Study for Long-horizon Agentic Programming in Command-Line Interfaces (2026.findings-acl)
Copied to clipboard
Yukang Feng, Jianwen Sun, Zelai Yang, Jiaxin Ai, Chuanhao Li, Zizhen Li, Fanrui Zhang, Kang He, Rui Ma, Jifan Lin, Jie Sun, Yang Xiao, Sizhuo Zhou, Wenxiao Wu, Yiming Liu, Pengfei Liu, Shenglin Zhang, Kaipeng Zhang
| Challenge: | Existing benchmarks for agentic programming in long-horizon command-line interface tasks are limited by short task horizons, data contamination from GitHub scraping, and a lack of fine-grained evaluation metrics. |
| Approach: | They propose a benchmark to evaluate agentic capabilities across long-horizon command-line interface tasks. |
| Outcome: | The proposed benchmarks cover four engineering categories: from scratch, feature addition, bug fixing, and refactoring. |
KG-TRICK: Unifying Textual and Relational Information Completion of Knowledge for Multilingual Knowledge Graphs (2025.coling-main)
Copied to clipboard
Zelin Zhou, Simone Conia, Daniel Lee, Min Li, Shenglei Huang, Umar Farooq Minhas, Saloni Potdar, Henry Xiao, Yunyao Li
| Challenge: | Existing studies have shown that combining information from KGs in different languages aids knowledge Graph Completion and Knowledge Graph Enhancement. |
| Approach: | They propose a sequence-to-sequence framework that unifies tasks of textual and relational information completion for multilingual knowledge graphs. |
| Outcome: | The proposed framework unifies tasks of KGC and KGE into a single framework. |
MENTOR: Efficient Autoregressive Image Generation with Balanced Multimodal Control (2026.findings-acl)
Copied to clipboard
| Challenge: | Recent text-to-image models achieve impressive visual quality but still face challenges in precise controllability, balancing multimodal inputs, and high training cost for multimodal image generation. |
| Approach: | They propose an autoregressive framework with a two-stage training paradigm for controllable multimodal image generation. |
| Outcome: | Extensive experiments on DreamBench++ and DreamBech show that the proposed framework achieves a strong balance between textual and visual guidance for controllable image generation. |
EXCEEDS: Extracting Complex Events via Nugget-based Grid Modeling in Scientific Domain (2026.acl-long)
Copied to clipboard
| Challenge: | Extensive event extraction research has been conducted in many domains, including news, finance, and biology. |
| Approach: | They propose an end-to-end scientific event extraction framework for encoding nuggets into a grid matrix and simplifying complex event extraction as a nuggot-based grid modeling task. |
| Outcome: | The proposed framework performs well in scientific domain, demonstrating state-of-the-art performance. |
Delta Embedding Learning (P19-1)
Copied to clipboard
| Challenge: | Unsupervised word embeddings have limitations to the semantics of words and inadequate fine-tuning of embedded word can lead to suboptimal performance. |
| Approach: | They propose a method that optimizes word embeddings by regularizing them incrementally to ensure they are tuned in an incremental way. |
| Outcome: | The proposed method improves performance on various NLP tasks and shows that it absorbs semantic information without "forging" |
TriSum: Learning Summarization Ability from Large Language Models with Structured Rationale (2024.naacl-long)
Copied to clipboard
| Challenge: | Large language models (LLMs) have advanced tasks like text summarization, but their size and computational demands limit their use in resource-constrained and privacy-centric settings. |
| Approach: | They propose a framework for distilling LLMs’ text summarization abilities into a compact, local model using a curriculum learning strategy that evolves from simple to complex tasks. |
| Outcome: | The proposed framework outperforms baseline models on CNN/DailyMail, XSum, and ClinicalTrial, and improves interpretability by providing insights into the summarization rationale. |
Text-Attributed Graph Learning with Coupled Augmentations (2025.coling-main)
Copied to clipboard
| Challenge: | Existing models focus on either the text attribute or the graph structure, neglecting the other aspect. |
| Approach: | They propose a model that combines the strengths of both text-learning and graph-learning models in parallel. |
| Outcome: | The proposed model outperforms existing models on diverse datasets. |
Revealing the Parallel Multilingual Learning within Large Language Models (2024.emnlp-main)
Copied to clipboard
Yongyu Mu, Peinan Feng, Zhiquan Cao, Yuzhang Wu, Bei Li, Chenglong Wang, Tong Xiao, Kai Song, Tongran Liu, Chunliang Zhang, JingBo Zhu
| Challenge: | Large language models (LLMs) can handle multilingual and cross-lingual text within a single input; however, previous studies focusing on using English as the pivot language to enhance language understanding and reasoning focus on using multiple languages. |
| Approach: | They propose to use parallel multilingual input to enhance the model's comprehension of the input and to examine how multilingual processing affects prediction. |
| Outcome: | The proposed model can handle multilingual and cross-lingual text within a single input, but previous studies focused on using English as the pivot language to enhance language understanding and reasoning. |
Drivel-ology: Challenging LLMs with Interpreting Nonsense with Depth (2025.emnlp-main)
Copied to clipboard
| Challenge: | Despite excelling at many natural language processing tasks, large language models fail to grasp the layered semantics of Drivelological text. |
| Approach: | They construct a benchmark dataset of over 1,200+ carefully curated and diverse examples across English, Mandarin, Spanish, French, Japanese, and Korean to examine their Drivelological characteristics. |
| Outcome: | The proposed models lack conceptual understanding and lack conceptual and semantic accuracy. |
Video Dialog via Progressive Inference and Cross-Transformer (D19-1)
Copied to clipboard
| Challenge: | Existing visual dialog methods use RNN to encode the dialog history as a vector representation . a new method for video dialog is proposed, which progressively updates query information based on dialog history and video content until the agent think the information is sufficient and unambiguous. |
| Approach: | They propose a method which progressively updates query information based on dialog history and video content until the agent thinks it is sufficient and unambiguous. |
| Outcome: | The proposed method can be used to infer video dialog answers on large-scale datasets. |
MobileNMT: Enabling Translation in 15MB and 30ms (2023.acl-industry)
Copied to clipboard
| Challenge: | Existing work on NMT models is limited in storage, memory, computation and power consumption. |
| Approach: | They propose a mobile machine translation system that can translate in 15MB and 30ms on devices. |
| Outcome: | The proposed system can translate in 15MB and 30ms on mobile devices. |
Using a Penalty-based Loss Re-estimation Method to Improve Implicit Discourse Relation Classification (2020.coling-main)
Copied to clipboard
| Challenge: | inessential words are unintentionally misjudged as attention-worthy words and assigned heavier attention weights than should be. |
| Approach: | They propose a penalty-based method to regulate the attention learning process by integrating penalty coefficients into the computation of loss by means of overstability of attention weight distributions. |
| Outcome: | The proposed method improves on the Penn Discourse TreeBank corpus and is competitive compared to the state-of-the-art methods. |
Alleviating Hallucinations from Knowledge Misalignment in Large Language Models via Selective Abstention Learning (2025.acl-long)
Copied to clipboard
Lei Huang, Xiaocheng Feng, Weitao Ma, Yuchun Fan, Xiachong Feng, Yuxuan Gu, Yangfan Ye, Liang Zhao, Weihong Zhong, Baoxin Wang, Dayong Wu, Guoping Hu, Lingpeng Kong, Tong Xiao, Ting Liu, Bing Qin
| Challenge: | Large language models (LLMs) suffer from severe hallucination issues due to the knowledge misalignment between the pre-training stage and the supervised fine-tuning stage. |
| Approach: | They propose a training objective with an abstention mechanism that selectively rejects tokens that misalign with the desired knowledge distribution via a special [REJ] token. |
| Outcome: | The proposed model selectively rejects tokens that misalign with the desired knowledge distribution via a special [REJ] token. |
BERT-MK: Integrating Graph Contextualized Knowledge into Pre-trained Language Models (2020.findings-emnlp)
Copied to clipboard
| Challenge: | Existing knowledge representation learning methods do not use graph contextualized knowledge. |
| Approach: | They propose to model subgraphs in a medical KG and integrate it with a pre-trained language model to do knowledge generalization. |
| Outcome: | The proposed model achieves state-of-the-art on several medical NLP tasks . it improves on MedERNIE, and the proposed model is effective . |
Efficient Many-Shot In-Context Learning with Dynamic Block-Sparse Attention (2025.acl-long)
Copied to clipboard
| Challenge: | Many-shot in-context learning shifts computational burden from training-time to inference-time, making deployment of many-shot ICL challenging to justify in-practice. |
| Approach: | They propose a method for retrieval-based many-shot in-context learning that uses blocks-sparse attention and retrieval of cached demonstrations to achieve comparable per-example latency to finetuning. |
| Outcome: | The proposed method achieves comparable per-example latency to finetuning while maintaining on average >95% of the best method’s accuracy across strong ICL and finetuned baselines. |
CompassVerifier: A Unified and Robust Verifier for LLMs Evaluation and Outcome Reward (2025.emnlp-main)
Copied to clipboard
Shudong Liu, Hongwei Liu, Junnan Liu, Linchen Xiao, Songyang Gao, Chengqi Lyu, Yuzhe Gu, Wenwei Zhang, Derek F. Wong, Songyang Zhang, Kai Chen
| Challenge: | Existing approaches lack robustness to handle complex edge cases and generalizability across different domains. |
| Approach: | They develop an accurate and lightweight verifier model for evaluation and outcome reward that matches unstructured outputs against standard answers. |
| Outcome: | The proposed model can process multiple answer types including multi-subproblems, formulas, and sequence answers while identifying abnormal/invalid responses. |
HuatuoGPT, Towards Taming Language Model to Be a Doctor (2023.findings-emnlp)
Copied to clipboard
Hongbo Zhang, Junying Chen, Feng Jiang, Fei Yu, Zhihong Chen, Guiming Chen, Jianquan Li, Xiangbo Wu, Zhang Zhiyi, Qingying Xiao, Xiang Wan, Benyou Wang, Haizhou Li
| Challenge: | Experimental results show that the distilled language model outperforms its teacher model (ChatGPT) in most cases. |
| Approach: | They propose a Large Language Model (LLM) that leverages both distilled data from **ChatGPT** and real-world data from**doctors** in the supervised fine-tuning stage. |
| Outcome: | The proposed model outperforms the teacher model in most cases by using additional real-world data and RLMF to align the language model with the merits of both sources. |
Similarizing the Influence of Words with Contrastive Learning to Defend Word-level Adversarial Text Attack (2023.findings-acl)
Copied to clipboard
| Challenge: | Neural language models are vulnerable to word-level adversarial text attacks . previous word-based search methods assume important words influence prediction . |
| Approach: | They propose a method for similarizing the influence of words with contrast learning that encourages model to learn sentence representations in which words of varying importance have a more uniform influence on prediction. |
| Outcome: | The proposed method is compatible with various training methods and improves model robustness against various adversarial attacks. |
TROVE: A Challenge for Fine-Grained Text Provenance via Source Sentence Tracing and Relationship Classification (2025.acl-long)
Copied to clipboard
| Challenge: | Large language models have demonstrated great potential in natural language generation, but their widespread adoption has raised concerns regarding content reliability and accountability. |
| Approach: | They propose a challenge to trace each sentence of a target text back to specific source sentences within potentially lengthy or multi-document inputs. |
| Outcome: | The proposed challenge traces each sentence of a target text back to specific source sentences . the dataset includes 11 scenarios covering QA and summarization in english and Chinese . |
Hybrid Alignment Training for Large Language Models (2024.findings-acl)
Copied to clipboard
| Challenge: | Existing approaches to align large language models with instructions and preferences are conflicting . et al., 2023b) show that hybrid alignment training can outperform baselines . |
| Approach: | They propose a hybrid alignment training approach based on alternating alignment and modified elastic weight consolidation methods to achieve better collaboration between different alignment tasks. |
| Outcome: | The proposed approach outperforms baseline alignment training methods on summarization and dialogue tasks. |
Toward Machine Translation Literacy: How Lay Users Perceive and Rely on Imperfect Translations (2025.emnlp-main)
Copied to clipboard
Yimin Xiao, Yongle Zhang, Dayeon Ki, Calvin Bao, Marianna J. Martindale, Charlotte Vaughn, Ge Gao, Marine Carpuat
| Challenge: | Using machine translation tools for everyday tasks is becoming more commonplace, but a lack of evaluation strategies and alternatives can cause users to over-rely on it. |
| Approach: | They propose to use MT evaluation techniques to promote MT quality and MT literacy among its users. |
| Outcome: | The findings highlight the need for evaluation and NLP explanation techniques to promote MT quality and MT literacy among its users. |
Privacy Risks of Intermediate Representations: Attribute Inference in Distributed LLM Inference (2026.findings-acl)
Copied to clipboard
| Challenge: | Distributed LLMs avoid raw inputs by transmitting intermediate hidden states, a practice widely assumed to preserve privacy. |
| Approach: | They propose a distributed inference framework that transmits intermediate hidden states to avoid sending raw inputs by exposing sensitive user attributes. |
| Outcome: | The proposed approach achieves Top-1 accuracy of 0.997 on CMS, 0.980 on Skytrax, and 0.986 on ECHR. |
TriggerNER: Learning with Entity Triggers as Explanations for Named Entity Recognition (2020.acl-main)
Copied to clipboard
| Challenge: | Named entity recognition (NER) is a fundamental information extraction task that focuses on extracting entities from a given text and classifying them using pre-defined categories. |
| Approach: | They propose to use “entity triggers” to facilitate label-efficient learning of NER models. |
| Outcome: | The proposed model is significantly more cost-effective than the traditional neural NER frameworks. |
DyLex: Incorporating Dynamic Lexicons into BERT for Sequence Labeling (2021.emnlp-main)
Copied to clipboard
Baojun Wang, Zhao Zhang, Kun Xu, Guang-Yuan Hao, Yuyang Zhang, Lifeng Shang, Linlin Li, Xiao Chen, Xin Jiang, Qun Liu
| Challenge: | Existing approaches to integrate lexical knowledge into deep learning models are limited by large-scale dynamic lexicons. |
| Approach: | They propose a plug-in lexicon incorporation approach for BERT based sequence labeling tasks . they adopt word-agnostic tag embeddings to avoid re-training the representation . |
| Outcome: | The proposed framework achieves new SOTA even with large scale lexicons, the authors show . they adopt word-agnostic tag embeddings to avoid re-training the representation . |
SERM: Self-Evolving Relevance Model with Agent-Driven Learning from Massive Query Streams (2026.findings-acl)
Copied to clipboard
Chenglong Wang, Canjia Li, Xingzhao Zhu, Yifu Huo, Huiyu Wang, Weixiong Lin, Yun Yang, Qiaozhi He, Tian Hua Zhou, null Changxiaojia, JingBo Zhu, Tong Xiao
| Challenge: | Existing approaches to generate relevance judgments are limited due to dynamic nature of query distributions. |
| Approach: | They propose a self-evolving relevance model approach to generalize queries to practical search scenarios . they use a multi-agent sample miner and a relevance annotator to generate reliable labels . |
| Outcome: | The proposed approach can achieve significant performance gains on a large-scale industrial platform, validated by offline multilingual evaluations and online testing. |
Human-in-the-loop Robotic Grasping Using BERT Scene Representation (2022.coling-1)
Copied to clipboard
| Challenge: | Existing approaches for robotic grasping in cluttered scenes are expensive and lack structure information. |
| Approach: | They propose a human-in-the-loop framework for robotic grasping in cluttered scenes . they substitute scene-graph representation with a text representation of the scene using BERT . |
| Outcome: | The proposed framework outperforms object-agnostic and scene-graph based methods on robots and physical robots. |
CoVerRL: Breaking the Consensus Trap in Label-Free Reasoning via Generator-Verifier Co-Evolution (2026.acl-long)
Copied to clipboard
Teng Pan, Yuchen Yan, Zixuan Wang, Ruiqing Zhang, Guiyang Hou, Wenqi Zhang, Weiming Lu, Jun Xiao, Yongliang Shen
| Challenge: | Label-free reinforcement learning enables large language models to improve reasoning capabilities . but as training maximizes self-consistency, output diversity collapses, authors say . authors propose a framework where a single model alternates between generator and verifier roles . |
| Approach: | They propose a framework where a model alternates between generator and verifier roles, bootstrapping each other. |
| Outcome: | Experiments show that CoVerRL outperforms label-free baselines on reasoning benchmarks . the framework can be used to improve reasoning abilities without ground-truth supervision . |
Harnessing Consistency for Robust Test-Time LLM Ensemble (2026.findings-eacl)
Copied to clipboard
Zhichen Zeng, Qi Yu, Xiao Lin, Ruizhong Qiu, Xuying Ning, Tianxin Wei, Yuchen Yan, Jingrui He, Hanghang Tong
| Challenge: | Existing efforts to improve LLM ensemble quality have focused on model consistency, but failures are often due to heterogeneous tokenization schemes and varying model expertise. |
| Approach: | They propose a plug-and-play technique that harnesses model consistency for robust LLM ensemble. |
| Outcome: | The proposed technique improves ensemble performance and robustness against erroneous signals. |
Analyzing LLMs’ Knowledge Boundary Cognition Across Languages Through the Lens of Internal Representations (2025.acl-long)
Copied to clipboard
| Challenge: | Understanding the knowledge boundaries of Large Language Models (LLMs) is crucial to prevent hallucination, but research on the knowledge boundary perceptions of LLMs has predominantly focused on English. |
| Approach: | They propose a training-free alignment method that effectively transfers knowledge boundary perception ability across languages, thereby helping reduce hallucination risk in low-resource languages. |
| Outcome: | The proposed method reduces hallucination risk in low-resource languages by fine-tuning on bilingual question pair translation. |
Data-Efficient Selection via Grammatical Complexity in Continual Pre-training of Domain-Specific LLMs (2025.emnlp-main)
Copied to clipboard
Yizhou Ying, Geng Zhang, Cui Danxin, Chengyu Du, Guanglei Yue, Sihang Jiang, Jiaqing Liang, Yifei Fu, Hailin Hu, Yanghua Xiao
| Challenge: | Existing data selection strategies for continual pre-training of large language models often rely on scarce labeled data or computationally expensive LLMs. |
| Approach: | They propose an annotation-independent data selection framework for CPT that evaluates grammatical complexity using lexical diversity and syntactic complexity. |
| Outcome: | The proposed framework outperforms baselines on a financial dataset and surpasses full-data training by 1.7% using only 20% of the data. |
UNIMO-G: Unified Image Generation through Multimodal Conditional Diffusion (2024.acl-long)
Copied to clipboard
| Challenge: | Existing text-to-image diffusion models generate images from text prompts due to inherent brevity of textual descriptions . however, the ability to accurately synthesize images with intricate details, such as specific entities or scenes, is limited due to the inherent bribery of text descriptions. |
| Approach: | They propose a multimodal conditional diffusion framework that operates on multimodal prompts with interleaved textual and visual inputs. |
| Outcome: | The proposed framework excels in both text-to-image generation and zero-shot subject-driven synthesis. |
DCFEE: A Document-level Chinese Financial Event Extraction System based on Automatically Labeled Training Data (P18-4)
Copied to clipboard
| Challenge: | Existing methods to extract events from documents are limited due to the high cost of labeling . Experimental results demonstrate the effectiveness of a document-level Chinese financial event extraction system. |
| Approach: | They propose a document-level Chinese financial event extraction framework which detects event mentions and extracts events from financial news. |
| Outcome: | The proposed system detects event mentions and extracts events from financial news . it can generate large scale labeled data and extract events from entire document . |
Anti-Length Shift: Dynamic Outlier Truncation for Training Efficient Reasoning Models (2026.acl-long)
Copied to clipboard
Wei Wu, Liyi Chen, Congxi Xiao, Tianfu Wang, Qimeng Wang, Chengqiang Lu, Yan Gao, null Yiwu, Yao Hu, Hui Xiong
| Challenge: | Existing efficient reasoning methods rely on explicit length penalties for excessive verbosity on simple queries. |
| Approach: | They propose a training-time intervention that selectively suppresses redundant tokens . they find length shift occurs when models generate unnecessary reasoning on trivial inputs - a phenomenon that is often unexplored . |
| Outcome: | The proposed method reduces inference token usage by 78% while increasing accuracy compared to the initial policy and surpasses state-of-the-art efficient reasoning methods. |
Identifying Cellular Niches in Spatial Transcriptomics: An Investigation into the Capabilities of Large Language Models (2025.acl-long)
Copied to clipboard
Huanhuan Wei, Xiao Luo, Hongyi Yu, Jinping Liang, Luning Yang, Lixing Lin, Alexandra Popa, Xiting Yan
| Challenge: | Spatial transcriptomic technologies allow measuring gene expression profile and spatial information of cells in tissues simultaneously. |
| Approach: | They propose a spatial transcriptomic approach to identify spatial niches using a zero-shot large language models by transforming spatial transcriptomics data into spatial context prompts. |
| Outcome: | The proposed model improves performance by leveraging gene expression of neighboring cells/spots, cell type composition, tissue information, and external knowledge. |
Dangling-Aware Entity Alignment with Mixed High-Order Proximities (2022.findings-naacl)
Copied to clipboard
Juncheng Liu, Zequn Sun, Bryan Hooi, Yiwei Wang, Dayiheng Liu, Baosong Yang, Xiaokui Xiao, Muhao Chen
| Challenge: | Existing methods for dangling-aware entity alignment are underexplored but important problem. |
| Approach: | They propose a framework that uses high-order proximities to detect dangling entities and align matchable entities. |
| Outcome: | The proposed framework detects dangling entities and aligns matchable entities better than existing methods. |
Discourse Structure Extraction from Pre-Trained and Fine-Tuned Language Models in Dialogues (2023.findings-eacl)
Copied to clipboard
| Challenge: | Discourse processing suffers from data sparsity, especially for dialogues . a variety of discourse frameworks have been proposed to extract discourse information from dialogues. |
| Approach: | They propose unsupervised and semi-supervised methods to infer latent discourse structures for dialogues based on attention matrices from Pre-trained Language Models. |
| Outcome: | The proposed methods achieve encouraging results on the STAC corpus, with F1 scores of 57.2 and 59.3 for the unsupervised and semi-supervised methods, respectively. |
Style-Compress: An LLM-Based Prompt Compression Framework Considering Task-Specific Styles (2024.findings-emnlp)
Copied to clipboard
| Challenge: | Prompt compression reduces inference time and costs while maintaining informativeness for different usage scenarios. |
| Approach: | They propose a framework that adapts a smaller language model to compress prompts for a larger model on a new task without additional training. |
| Outcome: | The proposed framework outperforms two baseline models in four tasks . iteratively generates and selects effective compressed prompts as task-specific demonstrations . |
Modeling Content Importance for Summarization with Pre-trained Language Models (2020.emnlp-main)
Copied to clipboard
| Challenge: | Existing studies on content importance do not consider semantics and context when evaluating importance. |
| Approach: | They apply information theory to pre-trained language models to define the concept of importance from the perspective of information amount. |
| Outcome: | Experiments on CNN/Daily Mail and New York Times show that the proposed model can model the importance of content better than previous methods based on F1 and ROUGE scores. |
On LLMs-Driven Synthetic Data Generation, Curation, and Evaluation: A Survey (2024.findings-acl)
Copied to clipboard
| Challenge: | Large Language Models (LLMs) provide a data-centric solution to alleviate limitations of real-world data with synthetic data generation. |
| Approach: | They propose a generic workflow for LLM-driven synthetic data generation. |
| Outcome: | The proposed workflows highlight gaps in existing research and outline avenues for future studies. |
Compensate Quantization Errors: Make Weights Hierarchical to Compensate Each Other (2024.findings-naacl)
Copied to clipboard
| Challenge: | Emergent Large Language Models (LLMs) use extraordinary performance and powerful deduction capacity to discern from traditional language models. |
| Approach: | They propose a method that uses weights to compensate quantization error and learnable singular value incremental (LSI) LSI is a technique that helps weights compensate each other conditioned on activation. |
| Outcome: | The proposed method achieves state-of-the-art performance in diverse quantization settings, no matter in weight-only, weight-activation or extremely low bit scenarios. |
OpenSLU: A Unified, Modularized, and Extensible Toolkit for Spoken Language Understanding (2023.acl-demo)
Copied to clipboard
| Challenge: | Spoken Language Understanding (SLU) is a task-oriented dialogue system . open-source toolkit provides a unified, modularized, and extensible toolkit for SLU . |
| Approach: | They introduce an open-source toolkit to provide a unified toolkit for spoken language understanding. |
| Outcome: | The proposed toolkit unifies 10 models for both single-intent and multi-intention scenarios. |
CASA: Causality-driven Argument Sufficiency Assessment (2024.naacl-long)
Copied to clipboard
| Challenge: | Existing methods to assess the sufficiency of arguments are laborious and inconsistent due to subjective criteria. |
| Approach: | They propose a causality-driven argument sufficiency assessment framework that uses the probability of sufficience to estimate the probability that a premise event would lead to a conclusion when both premise and conclusion events are absent. |
| Outcome: | The proposed framework identifies insufficient arguments and improves them in a writing aid application. |
Topic-Oriented Open Relation Extraction with A Priori Seed Generation (2024.emnlp-main)
Copied to clipboard
| Challenge: | Existing methods for open relation extraction give sub-optimal results on specific topics. |
| Approach: | They propose a method that leverages the built-in knowledge of large language models to maintain a dynamic seed relation dictionary for the topic. |
| Outcome: | The proposed approach empowers better topic-oriented control over the generated relations and improves ORE performance along the five dimensions, especially on specialized and narrow topics. |
MegaPairs: Massive Data Synthesis for Universal Multimodal Retrieval (2025.acl-long)
Copied to clipboard
Junjie Zhou, Yongping Xiong, Zheng Liu, Ze Liu, Shitao Xiao, Yueze Wang, Bo Zhao, Chen Jason Zhang, Defu Lian
| Challenge: | despite the growing demand for multimodal retrieval, there is a lack of training data. |
| Approach: | They propose a data synthesis method that leverages vision language models and open-domain images to generate high-quality data. |
| Outcome: | The proposed method outperforms baseline models on 70 more datasets and can scale up. |
Skeletons Matter: Dynamic Data Augmentation for Text-to-Query (2025.emnlp-main)
Copied to clipboard
| Challenge: | Existing studies focus on a single query language, resulting in limited generalizability . a new task paradigm is proposed to unify semantic parsing tasks across different query languages . |
| Approach: | They propose a task paradigm that unifies parsing tasks across query languages . they identify query skeletons as a shared optimization target of Text-to-Query tasks . |
| Outcome: | The proposed method achieves state-of-the-art performance using only a small amount of synthesized data. |
From Shortcuts to Triggers: Backdoor Defense with Denoised PoE (2024.naacl-long)
Copied to clipboard
| Challenge: | Existing backdoor defense methods focus on specific triggers, leaving a universal defense unexplored. |
| Approach: | They propose an ensemble-based backdoor defense framework that denies backdoor attacks by capturing backdoor shortcuts and preventing learning them. |
| Outcome: | The proposed framework significantly improves defense performance against backdoor attacks . it is also effective under a more challenging but practical setting . |
SciMRC: Multi-perspective Scientific Machine Reading Comprehension (2024.lrec-main)
Copied to clipboard
| Challenge: | Existing datasets focused on single-perspective question-answer pairs overlooking inherent variation in comprehension levels among different readers. |
| Approach: | They propose a multi-perspective scientific machine reading comprehension dataset . their dataset comprises 741 scientific papers and 6,057 question-answer pairs . |
| Outcome: | The proposed dataset includes questions from beginners, students, and experts. |
A Simple yet Efficient Prompt Compression Method for Text Classification Data Annotation Using LLM (2025.coling-industry)
Copied to clipboard
| Challenge: | Existing methods to improve the accuracy of large language models (LLMs) are often impractical due to high costs and time consumption. |
| Approach: | They propose a method that uses keyword extraction to reduce prompt tokens in text annotation tasks. |
| Outcome: | The proposed method reduces prompt tokens while maintaining high accuracy. |
BiTIIMT: A Bilingual Text-infilling Method for Interactive Machine Translation (2022.acl-long)
Copied to clipboard
| Challenge: | Existing IMT systems relying on lexical constrained decoding (LCD) are limited in translation efficiency and quality due to LCD. |
| Approach: | They propose a novel interactive neural machine translation system that uses lexical constraints to decode missing words in a manually revised translation. |
| Outcome: | The proposed system performs significantly better and faster than state-of-the-art IMT on three translation tasks. |
AutoTrial: Prompting Language Models for Clinical Trial Design (2023.emnlp-main)
Copied to clipboard
| Challenge: | Generative large language models (LLMs) are a popular tool for creating coherent and human-like documents for clinical trials. |
| Approach: | They propose to generate clinical eligibility criteria using language models by a hybrid of discrete and neural prompting and scalable knowledge incorporation via in-context learning. |
| Outcome: | The proposed method generates high-quality criteria texts fluent and coherent with high accuracy against the GPT-3.5 baselines. |
Sentipolis: Emotion-Aware Agents for Social Simulations (2026.findings-acl)
Copied to clipboard
| Challenge: | Recent advances in reasoning and long-context memory are making large language models (LLMs) appear increasingly human-like, which has led researchers to adopt LLM agents as a substrate for social simulation. |
| Approach: | They propose a framework for emotionally stateful agents that integrates continuous Pleasure-Arousal-Dominance representation, dual-speed emotion dynamics, and emotion–memory coupling. |
| Outcome: | The proposed framework improves emotional grounded behavior, boosting communication, and emotional continuity across thousands of interactions over multiple base models and evaluators. |
Knowledge Graph Unlearning with Schema (2025.coling-main)
Copied to clipboard
| Challenge: | Unlearning on knowledge graphs has not been extensively studied. |
| Approach: | They propose a new unlearning method based on schema for knowledge graph (KG) they update the representation of the deleted element’s neighborhood with an unlearning object that regulates the affinity between the affected neighborhood and the instances within the same schema. |
| Outcome: | The proposed method is evaluated on various KG embedding models with benchmark datasets. |
Between a Rock and a Hard Place: The Tension Between Ethical Reasoning and Safety Alignment in LLMs (2026.acl-long)
Copied to clipboard
| Challenge: | Large Language Models (LLMs) safety alignment predominantly operates on a binary assumption that requests are either safe or unsafe. |
| Approach: | They propose a methodology that embeds harmful requests within ethical framings to exploit this vulnerability. |
| Outcome: | The proposed framework achieves high success rates by exploiting model's own ethical reasoning to frame harmful actions as morally necessary compromises. |
CAMO: An Agentic Framework for Automated Causal Discovery from Micro Behaviors to Macro Emergence in LLM Agent Simulations (2026.findings-acl)
Copied to clipboard
| Challenge: | LLM-empowered agent simulations generate rich, adaptive, and often nonlinear interaction patterns. |
| Approach: | They propose an automated Causal discovery framework for LLM agent simulations that converts mechanistic hypotheses into computable factors and learns a compact causal representation centered on an emergent target. |
| Outcome: | Experiments across four emergent settings demonstrate the promise of CAMO. |
ChatSOP: An SOP-Guided MCTS Planning Framework for Controllable LLM Dialogue Agents (2025.acl-long)
Copied to clipboard
Zhigen Li, Jianxiang Peng, Yanmeng Wang, Yong Cao, Tianhao Shen, Minghui Zhang, Linxi Su, Shang Wu, Yihang Wu, YuQian Wang, Ye Wang, Wei Hu, Jianfeng Li, Shaojun Wang, Jing Xiao, Deyi Xiong
| Challenge: | Existing models that use Large Language Models (LLMs) show superior performance in various tasks, but lack of controllability leads to unfocused conversations or task failure. |
| Approach: | They propose a standard operating procedure (SOP) framework to regulate dialogue flow by integrating Chain of Thought reasoning and supervised fine-tuning for SOP prediction. |
| Outcome: | The proposed method achieves a 27.95% improvement in action accuracy compared to baseline models based on GPT-3.5 and also shows notable gains for open-source models. |
LegalGraphRAG: Multi-Agent Graph Retrieval-Augmented Generation for Reliable Legal Reasoning (2026.acl-long)
Copied to clipboard
Zerui Chen, Qinggang Zhang, Zhishang Xiang, Zhimin Wei, Linfeng Gao, Xiao Huang, Zhihong Zhang, Jinsong Su
| Challenge: | Graph-based Retrieval-Augmented Generation (GraphRAG) is a new approach to document retrieval, but it is not suitable for legal reasoning. |
| Approach: | They propose a framework for reliable legal reasoning that structures knowledge as relational graphs and uses a multi-agent system to verify validity. |
| Outcome: | The proposed framework outperforms existing GraphRAG models in accurate and trustworthy legal analysis. |
CDS: Data Synthesis Method Guided by Cognitive Diagnosis Theory (2025.findings-acl)
Copied to clipboard
| Challenge: | Large Language Models (LLMs) have demonstrated remarkable capabilities across diverse tasks, but the complexity of emerging tasks and higher performance demands highlight the need for continuous improvement. |
| Approach: | They propose a method that refines evaluation results and characterizes model profiles at the knowledge component level. |
| Outcome: | The proposed method improves performance across multiple benchmarks and academic exams. |
D.Va: Validate Your Demonstration First Before You Use It (2025.acl-long)
Copied to clipboard
| Challenge: | In-context learning (ICL) heavily relies on selecting effective demonstrations to achieve outputs that better align with the expected results. |
| Approach: | They propose a method which integrates a demonstration validation perspective into this field and integrates it into the learning paradigm. |
| Outcome: | The proposed method surpasses all retrieval-based in-context learning techniques across both natural language understanding (NLU) and natural language generation (NLG) tasks. |
VISTA: Visualized Text Embedding For Universal Multi-Modal Retrieval (2024.acl-long)
Copied to clipboard
| Challenge: | Existing methods for multimodal retrieval are mostly text-oriented, which lack the capability to process visual information. |
| Approach: | They propose a multi-modal multi-text embedding model VISTA which extends a powerful text encoder with the image understanding capability by introducing visual token embedds. |
| Outcome: | The proposed model achieves superior performance across a variety of multi-modal retrieval tasks in zero-shot and supervised settings. |
PILOT: Planning via Internalized Latent Optimization Trajectories for Large Language Models (2026.acl-long)
Copied to clipboard
| Challenge: | Large Language Models lack the capacity to formulate global strategies due to latency and availability constraints. |
| Approach: | They propose a framework to internalize the strategic oversight of large models into intrinsic Latent Guidance by synthesizing a query-conditioned Latent Guide. |
| Outcome: | The proposed framework outperforms strong baselines on mathematical and coding benchmarks with negligible inference latency. |
AnaMeta: A Table Understanding Dataset of Field Metadata Knowledge Shared by Multi-dimensional Data Analysis Tasks (2023.findings-acl)
Copied to clipboard
Xinyi He, Mengyu Zhou, Mingjie Zhou, Jialiang Xu, Xiao Lv, Tianle Li, Yijia Shao, Shi Han, Zejian Yuan, Dongmei Zhang
| Challenge: | Tabular data analysis is performed everyday across various domains. |
| Approach: | They propose to use a dataset of 467k tables with supervision labels for four types of field metadata. |
| Outcome: | The proposed framework improves the understanding capability of tabular models by incorporating distribution and knowledge information. |
JARVIS or Ultron? A Survey on the Safety and Security Threats of Computer-Using Agents (2026.acl-long)
Copied to clipboard
Ada Chen, Yongjiang Wu, Junyuan Zhang, Jingyu Xiao, Shu Yang, Jen-tse Huang, Kun Wang, Wenxuan Wang, Shuai Wang
| Challenge: | Recent advances in computer-using agents have created new safety and security risks . despite the impressive capabilities of CUAs, there are still significant security risks. |
| Approach: | They propose a systematization of knowledge on the safety and security threats of Computer-Using Agents. |
| Outcome: | The proposed framework provides a framework for assessing the safety and security risks of computer-using agents. |
FRSUM: Towards Faithful Abstractive Summarization via Enhancing Factual Robustness (2022.findings-emnlp)
Copied to clipboard
| Challenge: | Existing models of abstractive summarization are able to generate fluent and coherent summaries, but they still suffer from the unfaithful generation problem. |
| Approach: | They propose to improve the faithfulness of existing models by enhancing their factual robustness by using a novel training strategy, namely FRSUM, which teaches the model to defend against both explicit adversarial samples and implicit factual adversarials. |
| Outcome: | The proposed training strategy improves faithfulness of various models, such as T5, BART, and T5 . |
Incorporating Probing Signals into Multimodal Machine Translation via Visual Question-Answering Pairs (2023.findings-emnlp)
Copied to clipboard
| Challenge: | Existing studies show that multimodal machine translation systems exhibit decreased sensitivity to visual information when text inputs are complete. |
| Approach: | They propose to generate parallel VQA style pairs from source text to foster more robust cross-modal interaction. |
| Outcome: | The proposed approach generates parallel VQA style pairs from the source text, fostering more robust cross-modal interaction. |
Relation Logical Reasoning and Relation-aware Entity Encoding for Temporal Knowledge Graph Reasoning (2025.coling-main)
Copied to clipboard
| Challenge: | Current knowledge graph models focus on embedding entities and relations, overlooking the broader structure of the entire knowledge graph. |
| Approach: | They propose a Temporal Knowledge Graph Reasoning model that embeds relation embeddings into the TKG. |
| Outcome: | The proposed model outperforms state-of-the-art models on five public datasets . it uses relation-aware attention mechanisms to learn relation embeddings based on query relations . |
STELLA: A Multimodal LLM for Protein Functional Annotation via Unified Sequence-Structure Encoding (2026.findings-acl)
Copied to clipboard
Hongwang Xiao, Wenjun Lin, Xi Chen, Hui Wang, Kai Chen, Jiashan Li, Yuancheng Sun, Sicheng Dai, Boya Wu, Qiwei Ye
| Challenge: | a multimodal protein language model (LLM) integrates sequence, structure, and function into functional annotation. |
| Approach: | They propose a multimodal protein language model that synergistically aligns bimodal representations with the textual modality to advance protein functional annotation. |
| Outcome: | The proposed model synergizes bimodal representations with the textual modality to advance protein functional annotation. |
BIASEDTALES-ML: A Multilingual Dataset for Analyzing Narrative Attribute Distributions in LLM-Generated Stories (2026.findings-acl)
Copied to clipboard
| Challenge: | Existing studies on the use of Large Language Models (LLMs) focus primarily on English, leaving the cross-lingual generalization of aligned behavior underexplored. |
| Approach: | They propose a structured generator-extractor pipeline and a multi-dimensional distributional analysis framework to examine how narrative attributes vary across languages, models, and social conditions. |
| Outcome: | The proposed model reveals substantial cross-lingual variability in narrative generation patterns, indicating that distributions observed in English do not always exhibit similar characteristics in other languages, particularly in lower-resource settings. |
Why Did Apple Fall: Evaluating Curiosity in Large Language Models (2026.findings-acl)
Copied to clipboard
| Challenge: | Existing methods for evaluating curiosity-like behaviors in large language models lack curiosity-inspired features. |
| Approach: | They propose a psychology-inspired framework to evaluate curiosity in large language models . they adapt the Five-Dimensional Curiosity scale Revised (5DCR) to LLMs . |
| Outcome: | The proposed framework evaluates curiosity in large language models using questionnaires and behavioral studies. |
Dynamic Curriculum Learning for Low-Resource Neural Machine Translation (2020.coling-main)
Copied to clipboard
| Challenge: | Recent work on neural machine translation (NMT) has demonstrated impressive performance improvements and became the de-facto standard. |
| Approach: | They propose a dynamic curriculum learning method to reorder training samples in training using a Transformer-based system. |
| Outcome: | The proposed method outperforms baselines on three low-resource machine translation benchmarks and different sized data of WMT’16 En-De. |
HyperText: Endowing FastText with Hyperbolic Geometry (2020.findings-emnlp)
Copied to clipboard
| Challenge: | Empirically, we show that HyperText outperforms FastText on a range of text classification tasks with much reduced parameters. |
| Approach: | They propose a model that uses hyperbolic geometry to model tree-like hierarchies in natural language sentences by embedding words or ngrams in hyperbolical space. |
| Outcome: | Empirically, the proposed model outperforms FastText on a range of text classification tasks with much reduced parameters. |
Ouroboros: Generating Longer Drafts Phrase by Phrase for Faster Speculative Decoding (2024.emnlp-main)
Copied to clipboard
Weilin Zhao, Yuxiang Huang, Xu Han, Wang Xu, Chaojun Xiao, Xinrong Zhang, Yewei Fang, Kaihuo Zhang, Zhiyuan Liu, Maosong Sun
| Challenge: | Speculative decoding is a widely used method that accelerates the generation process of large language models (LLMs) drafting efficiency has become a bottleneck in the final speedup of speculative drafting, therefore generating longer drafts at less cost can lead to better speedup. |
| Approach: | They propose a method that uses existing model to drafting and target LLM to verify draft in a low-cost parallel manner. |
| Outcome: | The proposed method can achieve speedups of up to 2.4 over speculative decoding and 3.9 over vanilla decoding without fine-tuning draft and target models. |
Emergent Modularity in Pre-trained Transformers (2023.findings-acl)
Copied to clipboard
Zhengyan Zhang, Zhiyuan Zeng, Yankai Lin, Chaojun Xiao, Xiaozhi Wang, Xu Han, Zhiyuan Liu, Ruobing Xie, Maosong Sun, Jie Zhou
| Challenge: | Existing studies on pre-trained Transformers show that they learn fine-grained neuron functions. |
| Approach: | They examine the presence of modularity in pre-trained Transformers . they focus on Mixture-of-Experts, a promising candidate for modularity . |
| Outcome: | The proposed structure stabilizes at the early stage, which is faster than neuron stabilization. |
Attribution-Based Analysis and Optimization of Modular Agentic Workflows (2026.findings-acl)
Copied to clipboard
Yingxuan Yang, Bo Huang, Siyuan Qi, Chao Feng, Haoyi Hu, Yuxuan Zhu, Jinbo Hu, Haoran Zhao, Ziyi He, Xiao Liu, ZongYu Wang, Muning Wen, Lin Qiu, Xuezhi Cao, Xunliang Cai, Yong Yu, Weinan Zhang
| Challenge: | Large Language Models (LLMs) have driven the rise of agentic workflows . yet, how can we attribute performance gains to individual upgrades and their interactions? |
| Approach: | They propose a game-theoretic framework that models component upgrades as players and evaluates component coalitions to compute Shapley values. |
| Outcome: | The proposed framework provides interaction-aware attribution and recommendation for model allocation under a fixed workflow structure. |
Mem-Gallery: Benchmarking Multimodal Long-Term Conversational Memory for MLLM Agents (2026.acl-long)
Copied to clipboard
Yuanchen Bei, Tianxin Wei, Xuying Ning, Yanjun Zhao, Zhining Liu, Xiao Lin, Yada Zhu, Hendrik Hamann, Jingrui He, Hanghang Tong
| Challenge: | Existing benchmarks evaluate multi-session memory in text-only conversations or assess multimodal understanding within localized contexts. |
| Approach: | They propose a benchmark for evaluating multimodal long-term conversational memory in MLLM agents. |
| Outcome: | The proposed framework assesses key memory capabilities along three functional dimensions: memory extraction and test-time adaptation, memory reasoning, and memory knowledge management. |
Clustering and Ranking: Diversity-preserved Instruction Selection through Expert-aligned Quality Estimation (2024.emnlp-main)
Copied to clipboard
Yuan Ge, Yilun Liu, Chi Hu, Weibin Meng, Shimin Tao, Xiaofeng Zhao, Mahong Xia, Zhang Li, Boxing Chen, Hao Yang, Bei Li, Tong Xiao, JingBo Zhu
| Challenge: | Existing methods for instruction data selection have limitations such as relying on fragile external APIs, being affected by biases in GPT models, or reducing the diversity of the selected instruction dataset. |
| Approach: | They propose an industrial-friendly, expert-aligned and diversity-preserved instruction data selection method: Clustering and Ranking (CaR). |
| Outcome: | The proposed method outperforms Alpaca's existing methods by 32.1% in GPT-4 evaluations. |
PRIMERA: Pyramid-based Masked Sentence Pre-training for Multi-document Summarization (2022.acl-long)
Copied to clipboard
| Challenge: | Existing pretrained models require domain-specific additional information to be effective. |
| Approach: | They propose a pre-trained model for multi-document representation with a focus on summarization that uses efficient encoder-decoder transformers to simplify the processing of concatenated input documents. |
| Outcome: | PRIMERA outperforms current state-of-the-art models on most datasets with large margins . PRImerA uses efficient encoder-decoder transformers to simplify processing of concatenated input documents. |
Open Domain Question Answering with Conflicting Contexts (2025.findings-naacl)
Copied to clipboard
Siyi Liu, Qiang Ning, Kishaloy Halder, Zheng Qi, Wei Xiao, Phu Mon Htut, Yi Zhang, Neha Anna John, Bonan Min, Yassine Benajiba, Dan Roth
| Challenge: | Open domain question answering systems often rely on information retrieved from large collections of text to answer questions. |
| Approach: | They evaluate and benchmark three powerful Large Language Models with a dataset . they find that 25% of unambiguous open domain questions can lead to conflicting contexts . |
| Outcome: | The proposed model can't be used to answer questions with conflicting contexts . it can be fine tuned to provide richer information into the model's training . |
Beyond Boundaries: Learning a Universal Entity Taxonomy across Datasets and Languages for Open Named Entity Recognition (2025.coling-main)
Copied to clipboard
Yuming Yang, Wantong Zhao, Caishuang Huang, Junjie Ye, Xiao Wang, Huiyuan Zheng, Yang Nan, Yuran Wang, Xueying Xu, Kaixin Huang, Yunke Zhang, Tao Gui, Qi Zhang, Xuanjing Huang
| Challenge: | Current Large Language Models struggle with complex entity taxonomies in open domains and lack NER capabilities. |
| Approach: | They propose a dataset to guide LLMs' generalization in Open NER under a universal entity taxonomy. |
| Outcome: | The proposed model outperforms GPT-4 in 3 out-of-domain benchmarks across 15 datasets and 6 languages. |
Bypassing Neural Evaluations for Fast Audio Editing via Adaptive Trajectory Extrapolation (2026.findings-acl)
Copied to clipboard
Xiaoqian Liu, Zhengkun Ge, Jianjin Wang, Haoran Zhang, Yuan Ge, Kaiyan Chang, Chen Xu, Tong Xiao, Zhengtao Yu, Linfeng Zhang, JingBo Zhu
| Challenge: | Recent advances in audio diffusion models have significantly improved text-to-audio editing via inversion techniques, but these models typically rely on dense, fixed-step sampling trajectories to maintain structural integrity. |
| Approach: | They propose a model-agnostic Adaptive Trajectory Extrapolation framework that accelerates inversion-based editing process by dynamically evaluating only the most critical generative phases. |
| Outcome: | The proposed framework achieves a 3.9 speedup with negligible loss in fidelity. |
RankNAS: Efficient Neural Architecture Search by Pairwise Ranking (2021.emnlp-main)
Copied to clipboard
| Challenge: | Existing methods require training millions of architectures to estimate the accuracy of the search results. |
| Approach: | They propose a performance ranking method (RankNAS) that uses pairwise ranking and search space pruning to enlarge the search space. |
| Outcome: | The proposed method significantly accelerates NAS through pairwise ranking and search space pruning. |
Distill, Fuse, Pre-train: Towards Effective Event Causality Identification with Commonsense-Aware Pre-trained Model (2024.lrec-main)
Copied to clipboard
| Challenge: | Existing methods to detect causal relationships in unstructured texts ignore trivial knowledge which may prejudice performance. |
| Approach: | They propose a pipeline to build a commonsense-aware pre-trained model which integrates reliable task-specific knowledge from commonsens graphs. |
| Outcome: | The proposed pipeline integrates reliable task-specific knowledge from commonsense graphs. |
Neural-based Mixture Probabilistic Query Embedding for Answering FOL queries on Knowledge Graphs (2022.emnlp-main)
Copied to clipboard
| Challenge: | Existing methods to embed entities and first-order logical queries in a vector space are often violated in real applications and limit their performance. |
| Approach: | They propose a Neural-based Mixture Probabilistic Query Embedding Model that embeds entities and first-order logical queries in a vector space. |
| Outcome: | The proposed model outperforms state-of-the-art methods on benchmark datasets. |
FormulaReasoning: A Dataset for Formula-Based Numerical Reasoning (2026.findings-acl)
Copied to clipboard
| Challenge: | Existing datasets for numerical reasoning often lack explicit knowledge of formulas . current datasets do not provide process supervision information, resulting in incomplete reasoning . |
| Approach: | They propose a benchmark for formula-based numerical reasoning with 5,324 questions . they provide annotations in English and Chinese and a formula database as an external knowledge source . |
| Outcome: | The proposed model includes 5,324 questions requiring calculations grounded in external physics principles. |
Lunar-Bench: Towards Evaluating Task-Oriented Reasoning of LLMs in Lunar Exploration Scenarios (2026.findings-acl)
Copied to clipboard
| Challenge: | Existing benchmarks focus on static, context-independent reasoning tasks and fail to capture constraints and dependencies of lunar missions. |
| Approach: | They propose a benchmark to assess the task-oriented reasoning and decision-making performance of large language models through 3,000 tasks derived from mission procedures and documentation. |
| Outcome: | The proposed model achieves 47.8% accuracy compared with 65.1% for human experts on 36 representative missions. |
Logical Consistency is Vital: Neural-Symbolic Information Retrieval for Negative-Constraint Queries (2025.findings-acl)
Copied to clipboard
Ganlin Xu, Zhoujia Zhang, Wangyi Mei, Jiaqing Liang, Weijia Lu, Xiaodong Zhang, Zhifei Yang, Xiaofeng Ma, Yanghua Xiao, Deqing Yang
| Challenge: | Current dense retrieval methods compute similarities between dense vectors but overlook the real query intents. |
| Approach: | They propose a neuro-symbolic information retrieval method that leverages first-order logic to optimize the embeddings of naive natural language by considering the logical consistency between queries and documents. |
| Outcome: | The proposed method outperforms existing methods on negative-constraint queries under zero-shot and low-resource retrieval tasks. |
Exploring Logically Dependent Multi-task Learning with Causal Inference (2020.emnlp-main)
Copied to clipboard
| Challenge: | Hierarchical multi-task learning models can utilize task dependencies by stacking encoders and outperform democratic ones. |
| Approach: | They propose a model that utilizes the labels of all lower-level tasks and a Gumbel sampling model to deal with cascading errors. |
| Outcome: | The proposed model outperforms democratic models on six out of seven subtasks and achieves state-of-the-art on the two English and one Chinese datasets. |
Towards Better Representations for Multi-Label Text Classification with Multi-granularity Information (2023.findings-emnlp)
Copied to clipboard
| Challenge: | Existing studies have shown that pre-trained language models generate word frequency-oriented text representations, causing texts with different labels to be closely distributed in a narrow region, which is difficult to classify. |
| Approach: | They propose a framework to refine the text representation for multi-label text classification using contrastive learning and multi-task learning modules. |
| Outcome: | The proposed framework improves the quality of the representations and yields stable and competitive improvements. |
S^4: Operationalizing Speech Act Theory for Strategic Semi-Structured Psychiatric Interview (2026.acl-long)
Copied to clipboard
| Challenge: | Existing methods for psychiatric interviewing degenerate into rigid interrogation or aimless chitchat due to a lack of strategic planning. |
| Approach: | They propose a framework for psychiatric interviewing grounded in Speech Act Theory that integrates a large-scale dataset with fine-grained psychic speech act annotations. |
| Outcome: | The proposed framework outperforms baselines in psychiatric interviewing. |
SAIS: Supervising and Augmenting Intermediate Steps for Document-Level Relation Extraction (2022.naacl-main)
Copied to clipboard
| Challenge: | Existing methods for relation extraction only implicitly learn to model relevant contexts and entity types while being trained for RE. |
| Approach: | They propose to explicitly teach the model to capture relevant contexts and entity types by supervising and augmenting intermediate steps (SAIS) for RE. |
| Outcome: | The proposed method outperforms the runner-up method on three benchmarks by 5.04% . textual contexts and entity types are the major information sources that lead to the success of previous approaches. |
RealHiTBench: A Comprehensive Realistic Hierarchical Table Benchmark for Evaluating LLM-Based Table Analysis (2025.findings-acl)
Copied to clipboard
Pengzuo Wu, Yuhang Yang, Guangcheng Zhu, Chao Ye, Hong Gu, Xu Lu, Ruixuan Xiao, Bowen Bao, Yijing He, Liangyu Zha, Wentao Ye, Junbo Zhao, Haobo Wang
| Challenge: | Existing benchmarks for large language models focus on simple, flat table structures. |
| Approach: | They propose a benchmark to evaluate the performance of both Large Language Models and Multimodal LLMs across a variety of input formats for complex tabular data, including LaTeX, HTML, and PNG. |
| Outcome: | The proposed benchmark evaluates the performance of LLMs and Multimodal LLM models across a variety of input formats for complex tabular data, including LaTeX, HTML, and PNG. |
MAESTRO: Meta-learning Adaptive Estimation of Scalarization Trade-offs for Reward Optimization (2026.acl-long)
Copied to clipboard
Yang Zhao, Hepeng Wang, Xiao Ding, Yangou Ouyang, Bibo Cai, Kai Xiong, Jinglong Gao, Zhouhao Sun, Li Du, Bing Qin, Ting Liu
| Challenge: | Group-Relative Policy Optimization (GRPO) has emerged as an efficient paradigm for aligning Large Language Models (LLMs), but its efficacy is confined to domains with verifiable ground truths. |
| Approach: | They propose a meta-cognitive orchestration layer that treats reward scalarization as a dynamic latent policy, leveraging the model’s terminal hidden states as 'a semantic bottleneck' . Across seven benchmarks, MAESTRO consistently outperforms single-reward and static multi-objective baselines while preserving the efficiency advantages of GRPO. |
| Outcome: | The proposed model outperforms single-reward and static multi-objective baselines while preserving efficiency advantages. |
An Empirical Revisiting of Linguistic Knowledge Fusion in Language Understanding Tasks (2022.emnlp-main)
Copied to clipboard
| Challenge: | Recent work attempts to explicitly incorporate human-defined linguistic priors into fine-tuning tasks. |
| Approach: | They replace parsed graphs or trees with trivial ones to investigate linguistic priors . they propose to use trivial graphs as baselines to design advanced knowledge fusion methods . |
| Outcome: | The use of trivial graphs improves performance in fully-supervised and few-shot settings. |
Measuring Data Diversity for Instruction Tuning: A Systematic Analysis and A Reliable Metric (2025.acl-long)
Copied to clipboard
Yuming Yang, Yang Nan, Junjie Ye, Shihan Dou, Xiao Wang, Shuo Li, Huijie Lv, Tao Gui, Qi Zhang, Xuanjing Huang
| Challenge: | Existing studies have explored various diversity-aware data selection methods to construct high-quality datasets and enhance model performance. |
| Approach: | They propose to use data diversity to measure instruction tuning of large language models. |
| Outcome: | The proposed diversity metric outperforms existing methods on simulated and real-world data and shows that it captures diversity variations and achieves a 0.97 correlation with instruction tuning. |
Adapting Where It Matters: Depth-Aware Adaptation for Efficient Multilingual Speech Recognition in Low-Resource Languages (2026.findings-acl)
Copied to clipboard
| Challenge: | Recent speech foundation models excel at multilingual automatic speech recognition (ASR) for high-resource languages, but their performance drops substantially on low-resourced languages due to the limited data availability. |
| Approach: | They propose a Depth-Aware Model Adaptation framework that allocates adaptation capacity according to each layer’s role. |
| Outcome: | The proposed framework matches or surpasses state-of-the-art accuracy with 80% fewer trainable parameters and achieves 29% error reduction under extreme data scarcity. |
Don’t Tell the Answer, Truly Guide the Reasoning During RL Rollouts (2026.findings-acl)
Copied to clipboard
Xinyi Wang, Jinyi Han, Zishang Jiang, Tingyun li, Jiaqing Liang, Sihang Jiang, Zhaoqian Dai, Ma Shuguang, Fei Yu, Yanghua Xiao
| Challenge: | Existing methods such as GRPO often break down when task difficulty exceeds the model’s capacity, resulting in sparse rewards and inefficient training. |
| Approach: | They propose to measure the compatibility between external guidance and a model's intrinsic policy by introducing an adaptive framework to enhance reasoning performance while explicitly preserving high Affinity. |
| Outcome: | The proposed framework outperforms baseline models while maintaining high Affinity. |
On the Emotion Understanding of Synthesized Speech (2026.acl-long)
Copied to clipboard
Yuan Ge, Haishu Zhao, AoKai Hao, Junxiang Zhang, Bei Li, Xiaoqian Liu, Chenglong Wang, Jianjin Wang, Bingsen Zhou, Bingyu Liu, JingBo Zhu, Zhengtao Yu, Tong Xiao
| Challenge: | Existing models for emotion understanding do not capture fundamental features of synthesized speech. |
| Approach: | They evaluate emotion recognition models on synthesized speech using SER models and generative models. |
| Outcome: | The proposed model can't generalize to synthesized speech because of speech token prediction . generative models tend to infer emotion from textual semantics while ignoring paralinguistic cues. |
SummIt: Iterative Text Summarization via ChatGPT (2023.findings-emnlp)
Copied to clipboard
| Challenge: | Existing text summarization systems generate summaries in a single step, but are often inadequate due to the issue of hallucination and the lack of accuracy. |
| Approach: | They propose an iterative text summarization framework based on large language models like ChatGPT that refines the generated summary iterativly through self-evaluation and feedback. |
| Outcome: | The proposed framework refines the generated summary iteratively through self-evaluation and feedback, closely resembling the iteration humans undertake when drafting and revising summaries. |
Praetor: A Fine-Grained Generative LLM Evaluator with Instance-Level Customizable Evaluation Criteria (2025.acl-long)
Copied to clipboard
Yongqi Leng, Renren Jin, Yue Chen, Zhuowen Han, Ling Shi, Jianxiang Peng, Lei Yang, Juesi Xiao, Deyi Xiong
| Challenge: | Existing evaluation methods are inadequate to evaluate large language models (LLMs). |
| Approach: | They propose a fine-grained generative LLM evaluator with instance-level customazable evaluation criteria that can be used to evaluate large language models. |
| Outcome: | The proposed model outperforms existing LLM evaluators and instruction-tuned LLMs on multiple benchmarks and sets new SOTA results. |
Glyph: Scaling Context Windows via Visual-Text Compression (2026.acl-long)
Copied to clipboard
Jiale Cheng, Yusen Liu, Xinyu Zhang, Yulin Fei, Wenyi Hong, Ruiliang Lyu, Weihan Wang, Zhe Su, Xiaotao Gu, Xiao Liu, Yushi Bai, Jie Tang, Hongning Wang, Minlie Huang
| Challenge: | Large language models (LLMs) traditionally represent text as sequences of discrete tokens . a long-context scaling problem requires processing more tokens more efficiently . |
| Approach: | They propose a framework that renders long texts into compact visual pages and processes them with a vision-language model. |
| Outcome: | The proposed framework renders long texts into compact visual pages and processes them with a vision-language model. |
EvoBench: Towards Real-world LLM-Generated Text Detection Benchmarking for Evolving Large Language Models (2025.findings-acl)
Copied to clipboard
| Challenge: | Existing methods to detect LLM-generated texts rely on static benchmarks that neglect the evolving nature of LLMs. |
| Approach: | They propose a benchmark to evaluate the generalization of LLM-generated text detection methods. |
| Outcome: | The proposed benchmark measures generalization of 14 detection methods across LLMs. |
Importance Estimation from Multiple Perspectives for Keyphrase Extraction (2021.emnlp-main)
Copied to clipboard
| Challenge: | Existing keyphrase extraction methods focus on the part of phrase that is important . experimental results show that KIEMP outperforms existing keyphrase extracting methods . |
| Approach: | They propose to estimate the importance of keyphrase from multiple perspectives using a chunking module, ranking module and matching module. |
| Outcome: | The proposed method outperforms the state-of-the-art keyphrase extraction methods on six benchmark datasets. |
OVEL: Online Video Entity Linking (2025.coling-main)
Copied to clipboard
| Challenge: | Existing studies on Multi-modal Entity Linking focus on linking textual and visual mentions or offline videos’ mentions to entities in multi-modal knowledge bases. |
| Approach: | They propose a task called Online Video Entity Linking to establish connections between online videos and a knowledge base with high accuracy and timeliness. |
| Outcome: | The proposed method can establish connections between mentions in online videos and a knowledge base with high accuracy and timeliness. |
Merge then Realign: Simple and Effective Modality-Incremental Continual Learning for Multimodal LLMs (2025.emnlp-main)
Copied to clipboard
| Challenge: | Recent advances in Multimodal Large Language Models (MLLMs) have enhanced their versatility as they integrate a growing number of modalities. |
| Approach: | They propose a simple MCL paradigm that addresses forgetting and misalignment . they propose 'MErge then ReAlign' to extend existing models to more modalities . |
| Outcome: | The proposed paradigm is easy to deploy and highly reusable in the MLLM community. |
DeltaNet: Conditional Medical Report Generation for COVID-19 Diagnosis (2022.coling-1)
Copied to clipboard
Xian Wu, Shuxin Yang, Zhaopeng Qiu, Shen Ge, Yangtian Yan, Xingwang Wu, Yefeng Zheng, S. Kevin Zhou, Li Xiao
| Challenge: | X-ray and CT are the gold standard for COVID-19 diagnosis and treatment . however, due to the excessive number of patients, writing reports becomes a heavy burden for radiologists. |
| Approach: | They propose to use X-ray and CT to generate medical reports automatically . they evaluate DeltaNet on a COVID-19 dataset, where it outperforms state-of-the-art approaches . |
| Outcome: | The proposed system outperforms state-of-the-art methods on a COVID-19 dataset. |
Towards Transferable Personality Representation Learning based on Triplet Comparisons and Its Applications (2025.emnlp-main)
Copied to clipboard
Kai Tang, Rui Wang, Renyu Zhu, Minmin Lin, Xiao Ding, Tangjie Lv, Changjie Fan, Runze Wu, Haobo Wang
| Challenge: | Existing methods for personality analysis treat corpus as a single unit for classification, but this approach presents several challenges. |
| Approach: | They propose a task paradigm for text-based personality representation learning that uses a triplet personality trend comparison dataset to learn single-sentence personality embeddings with desirable metric properties. |
| Outcome: | The proposed model significantly boosts performance across various applications, including personality detection, personality retrieval, and emotion translation prediction. |
Emotion Cause Extraction on Social Media without Human Annotation (2023.findings-acl)
Copied to clipboard
| Challenge: | Existing studies have focused on extracting emotion causes from news articles, but lack of fine-grained annotations has limited the ECE task. |
| Approach: | They propose a new ECE framework that extracts emotion causes from social media data without relying on human annotations. |
| Outcome: | The proposed framework achieves high extraction performance and generalizability without relying on human annotations. |
From Curated Data to Scalable Models: Continual Pre-training of Dense and MoE Large Language Models for Tibetan (2026.acl-long)
Copied to clipboard
Lei Yang, Leiyu Pan, Bojian Xiong, Renren Jin, Shaowei Zhang, Yue Chen, Ling Shi, Jiang Zhou, Junru Wu, Zhen Wang, Jianxiang Peng, Juesi Xiao, Tianyu Dong, Zhuowen Han, Zhuo Chen, Yuqi Ren, Deyi Xiong
| Challenge: | Large language models have achieved remarkable success across a wide range of tasks, yet their performance remains heavily biased toward high-resource languages. |
| Approach: | They propose a pipeline for advancing Tibetan language modeling through multilingual continual pre-training with Tibetan, Chinese, and English. |
| Outcome: | The proposed model outperforms open-source and Tibetan-focused models on diverse tasks. |
Guiding the Flowing of Semantics: Interpretable Video Captioning via POS Tag (D19-1)
Copied to clipboard
| Challenge: | Existing models of video captioning use a network and semantics are mixed into one feature. |
| Approach: | They propose an Adaptive Semantic Guidance Network which instantiates whole video semantics to different POS-aware semantics with supervision of part of speech (POS) tag. |
| Outcome: | Extensive experiments show that the proposed model is more efficient than state-of-the-art models. |
Unlearning vs. Obfuscation: Are We Truly Removing Knowledge? (2025.emnlp-main)
Copied to clipboard
| Challenge: | Recent methods often rely on obfuscation by injecting incorrect or irrelevant information to suppress knowledge, leaving models vulnerable to probing. |
| Approach: | They propose a method that flattens the model predictive distribution over automatically generated multiple-choice questions, effectively removing knowledge about target individuals. |
| Outcome: | The proposed method achieves unlearning with over 90% refusal rate and a higher uncertainty than obfuscation on probing questions. |
Neural Multitask Learning for Simile Recognition (D18-1)
Copied to clipboard
| Challenge: | Simile is a special type of metaphor, where comparators such as like and as are used to compare two objects. |
| Approach: | They propose a neural network framework for simile sentence classification, simile component extraction and language modeling. |
| Outcome: | The proposed framework outperforms rule-based and feature-based approaches in simile sentence classification and simile component extraction tasks. |
Uncertainty Quantification with Pre-trained Language Models: A Large-Scale Empirical Analysis (2022.findings-emnlp)
Copied to clipboard
Yuxin Xiao, Paul Pu Liang, Umang Bhatt, Willie Neiswanger, Ruslan Salakhutdinov, Louis-Philippe Morency
| Challenge: | Pre-trained language models (PLMs) have gained increasing popularity due to compelling prediction performance in diverse natural language processing tasks. |
| Approach: | They compare three popular options for encoding and Temp Scaling for PLMs . they recommend using Temp Loss as uncertainty quantifier and Focal Loss for fine-tuning . |
| Outcome: | Using pre-trained language models, we compare three options on NLP classification tasks and domain shift. |
Thinking with Reasoning Skills: Fewer Tokens, More Accuracy (2026.acl-industry)
Copied to clipboard
| Challenge: | Reasoning LLMs often spend tokens on long intermediate reasoning traces when solving new problems. |
| Approach: | They propose to store reusable reasoning skills distilled from extensive deliberation and trial-and-error exploration and retrieve these skills at inference time to guide future reasoning. |
| Outcome: | The proposed approach reduces reasoning tokens while improving overall performance on coding and mathematical reasoning tasks. |
SLAM: Towards Efficient Multilingual Reasoning via Selective Language Alignment (2025.coling-main)
Copied to clipboard
Yuchun Fan, Yongyu Mu, YiLin Wang, Lei Huang, Junhao Ruan, Bei Li, Tong Xiao, Shujian Huang, Xiaocheng Feng, Jingbo Zhu
| Challenge: | Large language models (LLMs) have demonstrated significant improvements in reasoning abilities, but these improvements are primarily focused on English, leading to inferior performance in non-English scenarios. |
| Approach: | They propose a multilingual reasoning alignment approach that fine-tunes the layers responsible for multilingual comprehension in one stage. |
| Outcome: | The proposed method fine-tunes 6 of the 9 layers responsible for multilingual comprehension, while reducing training time by 4.1-11.9 compared to the two-stage method. |
Teaching Machine Comprehension with Compositional Explanations (2020.findings-emnlp)
Copied to clipboard
| Challenge: | Recent advances in machine reading comprehension rely heavily on large-scale annotated corpora, which are timeconsuming and costly to collect. |
| Approach: | They propose to use semi-structured explanations to “teach” machines reading comprehension using a small number of semi-structural explanations that explicitly inform machines why answer spans are correct. |
| Outcome: | The proposed method achieves 70.14% F1 score with supervision from 26 explanations on the SQuAD dataset, comparable to plain supervised learning using 1,100 labeled instances yielding a 12x speed up. |
Automatic Construction of Sememe Knowledge Bases via Dictionaries (2021.findings-acl)
Copied to clipboard
| Challenge: | Sememe knowledge bases (SKBs) are used to analyze natural language processing. |
| Approach: | They propose a method to build sememe knowledge bases from an existing dictionary . they propose to use existing dictionaries to build an English and a French SKB . |
| Outcome: | The proposed method is superior to HowNet, the most widely used SKB that takes decades to build manually. |
Improving Variational Autoencoder for Text Modelling with Timestep-Wise Regularisation (2020.coling-main)
Copied to clipboard
| Challenge: | Variational Autoencoders (VAEs) have been widely used in text modelling but posterior collapse is a problem when RNN-based models are employed. |
| Approach: | They propose a timestep-wise regularisation VAE architecture which can effectively avoid posterior collapse when used in text modelling. |
| Outcome: | The proposed model avoids posterior collapse and can be applied to any RNN-based VAE model. |
Embracing Large Language Models in Traffic Flow Forecasting (2025.findings-acl)
Copied to clipboard
| Challenge: | Existing methods to predict future traffic flows capture spatio-temporal dependencies, but they fail to adapt to test-time environmental changes. |
| Approach: | They propose to use large language models to help traffic flow forecasting by capturing spatio-temporal dependencies and using a large language model to select the most likely result. |
| Outcome: | The proposed method is based on large language models (LLMs) and an LLM-based selector. |
ChatGLM-Math: Improving Math Problem-Solving in Large Language Models with a Self-Critique Pipeline (2024.findings-emnlp)
Copied to clipboard
Yifan Xu, Xiao Liu, Xinghan Liu, Zhenyu Hou, Yueyan Li, Xiaohan Zhang, Zihan Wang, Aohan Zeng, Zhengxiao Du, Zhao Wenyi, Jie Tang, Yuxiao Dong
| Challenge: | Large language models (LLMs) have shown excellent mastering of human language but struggle in real-world applications that require mathematical problem-solving. |
| Approach: | They propose a pipeline to train a general Math-Critique model from the LLM itself to provide feedback signals and employ rejective fine-tuning and direct preference optimization over the Llm's own generations for data collection. |
| Outcome: | The proposed pipeline outperforms existing LLMs that could be two times larger. |
Focus on What Matters: Enhancing Medical Vision-Language Models with Automatic Attention Alignment Tuning (2025.acl-long)
Copied to clipboard
| Challenge: | Existing methods rely on inference-time interventions, which are limited in attention adaptation or require additional supervision. |
| Approach: | They propose a framework for automatic attention alignment tuning that leverages weak labels from SAM and selectively modifies visually-critical attention heads to improve alignment while minimizing interference. |
| Outcome: | The proposed framework outperforms state-of-the-art models on medical VQA and report generation benchmarks. |
e-CARE: a New Dataset for Exploring Explainable Causal Reasoning (2022.acl-long)
Copied to clipboard
| Challenge: | Existing causal reasoning models only learn to induce empirical causal patterns that are predictive to the label, while human beings seek for deep and conceptual understanding of the causality to explain the observed causal facts. |
| Approach: | They present a human-annotated CAusal REasoning dataset with conceptual explanations of the causality. |
| Outcome: | The presented dataset shows that human-annotated explanations can be useful for promoting the accuracy and stability of causal reasoning models. |
Leveraging Bidding Graphs for Advertiser-Aware Relevance Modeling in Sponsored Search (2021.findings-emnlp)
Copied to clipboard
| Challenge: | Existing relevance models rely on query-keyword pairs but keywords are usually short texts with scarce semantic information, which may not accurately reflect the underlying advertising purposes. |
| Approach: | They propose a bidding-graph augmented triple-based relevance model with three towers to deeply fuse the bidding graphs and semantic textual data. |
| Outcome: | The proposed model outperforms existing models on a large industry dataset and consistently outperformed existing models. |
DetectBench: Can Large Language Model Detect and Piece Together Implicit Evidence? (2024.findings-emnlp)
Copied to clipboard
Zhouhong Gu, Lin Zhang, Xiaoxuan Zhu, Jiangjie Chen, Wenhao Huang, Yikai Zhang, Shusen Wang, Zheyu Ye, Yan Gao, Hongwei Feng, Yanghua Xiao
| Challenge: | Existing LLMs' abilities to detect evidence in long contexts are far inferior to humans. |
| Approach: | They propose a benchmark to assess LLMs' abilities in evidence and multi-step commonsense reasoning within a long context. |
| Outcome: | The proposed method improves the performance of LLMs in evidence detection and commonsense reasoning. |
LogicGame: Benchmarking Rule-Based Reasoning Abilities of Large Language Models (2025.findings-acl)
Copied to clipboard
Jiayi Gui, Yiming Liu, Jiale Cheng, Xiaotao Gu, Xiao Liu, Hongning Wang, Yuxiao Dong, Jie Tang, Minlie Huang
| Challenge: | Large Language Models (LLMs) have demonstrated notable capabilities across various tasks, showcasing complex problem-solving abilities. |
| Approach: | They propose a benchmark to evaluate the rule-based logical reasoning capabilities of Large Language Models (LLMs) they create simulated scenarios in which models execute or plan operations to achieve specific outcomes. |
| Outcome: | The proposed benchmark evaluates the performance of large language models on a variety of scenarios with varying difficulty levels. |
Dynamic Fusion Network for Multi-Domain End-to-end Task-Oriented Dialog (2020.acl-main)
Copied to clipboard
| Challenge: | Recent studies show remarkable success in end-to-end task-oriented dialog systems . however, most models rely on large training data, which is difficult to scalable for new domains with limited labeled data. |
| Approach: | They propose a shared-private network which exploits the relevance between the target domain and each domain. |
| Outcome: | The proposed model outperforms existing methods on multi-domain dialogue by 13.9% on average. |
TV-AfD: An Imperative-Annotated Corpus from The Big Bang Theory and Wikipedia’s Articles for Deletion Discussions (2020.lrec-1)
Copied to clipboard
| Challenge: | Detecting imperatives in oral and written communication is difficult when the user doesn't use the expected forms. |
| Approach: | They created an imperative corpus with dialogues from The Big Bang Theory and Wikipedia comments from Wikipedia . they manually annotated imperatives and used a syntax-based classifier to extract 10,624 statements that may be imperative. |
| Outcome: | The proposed model performs better in the written data compared to speech data, but has a low precision and recall for speech data. |
ChemNER: Fine-Grained Chemistry Named Entity Recognition with Ontology-Guided Distant Supervision (2021.emnlp-main)
Copied to clipboard
| Challenge: | Named entity recognition (NER) is a fundamental step in scientific literature analysis to build AI-driven systems for molecular discovery, synthetic strategy designing, and manufacturing. |
| Approach: | They propose an ontology-guided method for fine-grained named entity recognition (NER) it leverages the chemistry type ontologies to generate distant labels with flexible KB-matching . |
| Outcome: | The proposed method significantly outperforms the state-of-the-art methods with a .25 absolute F1 improvement. |
Is There a One-Model-Fits-All Approach to Information Extraction? Revisiting Task Definition Biases (2024.findings-emnlp)
Copied to clipboard
| Challenge: | Definition bias is a negative phenomenon that can mislead models. |
| Approach: | They propose a framework that measures definition bias, bias-aware fine-tuning and task-specific bias mitigation to mitigate definition bias in information extraction. |
| Outcome: | The proposed framework mitigates definition bias in information extraction tasks by measuring definition bias, bias-aware fine-tuning, and task-specific bias mitigation. |
CTC-based Non-autoregressive Speech Translation (2023.acl-long)
Copied to clipboard
Chen Xu, Xiaoqian Liu, Xiaowen Liu, Qingxuan Sun, Yuhao Zhang, Murun Yang, Qianqian Dong, Tom Ko, Mingxuan Wang, Tong Xiao, Anxiang Ma, Jingbo Zhu
| Challenge: | End-to-end speech translation (E2E ST) and non-autoregressive (NAR) generation are promising in language and speech processing for their advantages of less error propagation and low latency. |
| Approach: | They develop a model that uses connectionist temporal classification to predict the source and target texts. |
| Outcome: | The proposed model achieves an average BLEU score of 29.5 with a speed-up of 5.67. |
TranSFormer: Slow-Fast Transformer for Machine Translation (2023.findings-acl)
Copied to clipboard
| Challenge: | Prior work has focused on treating subwords as basic units in developing such systems. |
| Approach: | They propose a slow-fast two-stream learning model that uses a “slow” branch to deal with subword sequences and a "fast" branch to cope with longer character sequences. |
| Outcome: | The proposed model shows consistent BLEU improvements (larger than 1 BLUE point) on several machine translation benchmarks. |
FineRAG: Fine-grained Retrieval-Augmented Text-to-Image Generation (2025.coling-main)
Copied to clipboard
| Challenge: | Recent advances in text-to-image generation still exhibit limitations in terms of knowledge access. |
| Approach: | They propose a fine-grained retrieval-augmented image generation model that breaks down the retrieval task into four critical stages: query decomposition, candidate selection, retrieval augmented diffusion, and self-reflection. |
| Outcome: | The proposed method significantly reduces noise associated with retrieval-augmented image generation and performs better in complex, open-world scenarios. |
Multi-task Adversarial Attacks against Black-box Model with Few-shot Queries (2025.acl-long)
Copied to clipboard
| Challenge: | Existing adversarial text attacks rely on abundant access to shared internal features and numerous queries, limited to a single task type. |
| Approach: | They propose a black-box attack that exploits the transferability of adversarial texts . they use a deep-level substitute model trained in a plug-and-play manner for text classification . |
| Outcome: | The proposed attack can target multiple tasks with minimal perturbations . it can target commercial APIs, large language models, and image-generation models . |
Sensitivity-LoRA : Low-Load Sensitivity-Based Fine-Tuning for Large Language Models (2025.findings-emnlp)
Copied to clipboard
Hao Zhang, Bo Huang, Zhenjia Li, Xi Xiao, Hui Yi Leong, Zumeng Zhang, Xinwei Long, Tianyang Wang, Hao Xu
| Challenge: | Low-Rank Adaptation (LoRA) is a promising approach to adapting LLMs to specialized tasks . existing rank allocation techniques remain computationally inefficient and unstable . |
| Approach: | They propose a low-rank adapted model that approximates model weight updates using low-ranked decomposition. |
| Outcome: | The proposed method is limited by its uniform rank allocation to each incremental matrix . it leverages the second-order derivatives of the loss function to capture weight sensitivity . |
Exploiting Target Language Data for Neural Machine Translation Beyond Back Translation (2024.findings-acl)
Copied to clipboard
| Challenge: | Neural Machine Translation (NMT) encounters challenges when translating in new domains and low-resource languages. |
| Approach: | They propose a variant of k-nearest neighbor machine translation that utilizes target language data by constructing a pseudo datastore. |
| Outcome: | The proposed method exhibits strong domain adaptation capability in both high-resource and low-resourced machine translation. |
B4: A Black-Box Scrubbing Attack on LLM Watermarks (2025.naacl-long)
Copied to clipboard
| Challenge: | Experimental results demonstrate superior performance of black-box scrubbing attack on watermarks compared with other baselines. |
| Approach: | They propose a black-box scrubbing attack on watermarks that embeds a hidden pattern invisible to human into generated content of a specific LLM. |
| Outcome: | The proposed method outperforms baselines in 12 different environments. |
Advancing Fine-Grained Visual Understanding with Multi-Scale Alignment in Multi-Modal Models (2025.emnlp-main)
Copied to clipboard
Wei Wang, Zhaowei Li, Qi Xu, Linfeng Li, YiQing Cai, Botian Jiang, Hang Song, Xingcan Hu, Pengyu Wang, Li Xiao
| Challenge: | Recent advances in multi-modal large language models have demonstrated remarkable capabilities in multimodal understanding, reasoning, and interaction. |
| Approach: | They propose a method that effectively aligns and integrates multi-scale knowledge of objects . they use a pipeline that provides over 300K essential training data to enhance alignment . |
| Outcome: | The proposed method effectively aligns and integrates multi-scale knowledge of objects, including texts, coordinates, and images. |
MovieChats: Chat like Humans in a Closed Domain (2020.emnlp-main)
Copied to clipboard
| Challenge: | Currently, open-domain chatbots are far from satisfactory. |
| Approach: | They propose a unified, readily scalable neural approach which reconciles all subtasks like intent prediction and knowledge retrieval. |
| Outcome: | The proposed approach outperforms commercial systems replying on complex rules on static and interactive tests and shows that the results are remarkably good. |
Revisiting the Negative Data of Distantly Supervised Relation Extraction (2021.acl-long)
Copied to clipboard
| Challenge: | Existing methods for relation extraction with distant supervision generate plenty of training samples but noisy labels and imbalanced training data cause problems. |
| Approach: | They propose a method that automatically labels a sentence with relational triples from a knowledge base. |
| Outcome: | The proposed method outperforms existing methods even with false positive samples. |
From Quantity to Quality: Boosting LLM Performance with Self-Guided Data Selection for Instruction Tuning (2024.naacl-long)
Copied to clipboard
Ming Li, Yong Zhang, Zhitao Li, Jiuhai Chen, Lichang Chen, Ning Cheng, Jianzong Wang, Tianyi Zhou, Jing Xiao
| Challenge: | Large Language Models (LLMs) have revolutionized the landscape of artificial intelligence. |
| Approach: | They propose a self-guided method to identify and select cherry samples from open-source datasets, minimizing manual curation and potential cost for instruction tuning an LLM. |
| Outcome: | The proposed method enables LLMs to identify discrepancies between expected responses and intrinsic generation capability, and a marked uptick in model training efficiency. |
Can You Really Trust Code Copilot? Evaluating Large Language Models from a Code Security Perspective (2025.acl-long)
Copied to clipboard
| Challenge: | Existing code security benchmarks focus on one task and paradigm, such as code completion and generation, without comprehensive assessment across dimensions like secure code generation, vulnerability repair and discrimination. |
| Approach: | They propose a multi-task benchmark for comprehensive evaluation of LLM code security . they also propose VC-Judge, an improved judgment model that aligns closely with human experts . |
| Outcome: | The proposed model can evaluate LLM-generated programs for vulnerabilities in a more efficient and reliable way. |
PHMOSpell: Phonological and Morphological Knowledge Guided Chinese Spelling Check (2021.acl-long)
Copied to clipboard
| Challenge: | False gram and phonological errors make Chinese spelling check difficult . a novel end-to-end trainable model outperforms existing methods . |
| Approach: | They propose a trainable Chinese spelling check model that integrates phonological and visual information into a pre-trained language model. |
| Outcome: | The proposed model outperforms existing state-of-the-art models on three benchmarks. |
AD-LLM: Benchmarking Large Language Models for Anomaly Detection (2025.findings-acl)
Copied to clipboard
Tiankai Yang, Yi Nian, Li Li, Ruiyao Xu, Yuangang Li, Jiaqi Li, Zhuo Xiao, Xiyang Hu, Ryan A. Rossi, Kaize Ding, Xia Hu, Yue Zhao
| Challenge: | Anomaly detection (AD) is an important machine learning task with many real-world uses, including fraud detection, medical diagnosis, and industrial monitoring. |
| Approach: | They propose a benchmark that evaluates how large language models (LLMs) can help with NLP anomaly detection. |
| Outcome: | The proposed model can perform zero-shot detection without tasks-specific training, data augmentation and model selection, and it can suggest unsupervised AD models. |
Multi-doc Hybrid Summarization via Salient Representation Learning (2023.acl-industry)
Copied to clipboard
| Challenge: | Multi-document summarization is gaining more and more attention . extractive multi-doc approaches intend to directly extract key facts from multiple sources . |
| Approach: | They propose a multi-document hybrid summarization approach that generates a human-readable summary and extracts corresponding key evidences based on multi-doc inputs. |
| Outcome: | The proposed method generates a human-readable summary and extracts key evidences based on multi-doc inputs. |
“Yes, My LoRD.” Guiding Language Model Extraction with Locality Reinforced Distillation (2025.acl-long)
Copied to clipboard
| Challenge: | Existing methods for model extraction attacks on large language models are inadequate . existing methods neglect the inconsistency between training tasks and LLM alignment . |
| Approach: | They propose a model extraction algorithm that uses a policy-gradient-style training task to guide the crafting of preference for the local model. |
| Outcome: | The proposed algorithm reduces query complexity while mitigating watermark protection . it can extract various state-of-the-art commercial LLMs while minimizing query complexity . |
ODE Transformer: An Ordinary Differential Equation-Inspired Model for Sequence Generation (2022.acl-long)
Copied to clipboard
Bei Li, Quan Du, Tao Zhou, Yi Jing, Shuhan Zhou, Xin Zeng, Tong Xiao, JingBo Zhu, Xuebo Liu, Min Zhang
| Challenge: | Residual networks are an Euler discretization of solutions to Ordinary Differential Equations (ODE). |
| Approach: | They propose a residual block of layers in Transformer that can be described as a higher-order solution to ODE. |
| Outcome: | The proposed architecture can gain large improvements over strong baselines at a slight cost in inference efficiency. |
Do Large Language Models have an English Accent? Evaluating and Improving the Naturalness of Multilingual LLMs (2025.acl-long)
Copied to clipboard
| Challenge: | Current Large Language Models (LLMs) are predominantly designed with English as the primary language, but many are still English-dominated. |
| Approach: | They propose to use automatic corpus-level metrics to assess lexical and syntactic naturalness of LLMs in a multilingual context. |
| Outcome: | The proposed method improves naturalness of LLMs in target languages without compromising performance on general-purpose benchmarks. |
KG-FPQ: Evaluating Factuality Hallucination in LLMs with Knowledge Graph-based False Premise Questions (2025.coling-main)
Copied to clipboard
| Challenge: | Existing benchmarks that assess this vulnerability rely on manual construction, resulting in limited size and lack of expandability. |
| Approach: | They propose a method to generate false premise questions based on knowledge graphs . they modify true triplets extracted from KGs to create false premises . |
| Outcome: | The proposed method generates semantically rich FPQs using state-of-the-art GPTs. |
Precisely the Point: Adversarial Augmentations for Faithful and Informative Text Generation (2022.emnlp-main)
Copied to clipboard
| Challenge: | Existing models for text generation are weak enough to handle perturbations in inputs, leading to degeneration in faithfulness and informativeness. |
| Approach: | They propose a framework for improving faithfulness and informativeness of Seq2Seq models by perturbing word representations and word swapping. |
| Outcome: | The proposed framework improves faithfulness and informativeness of Seq2Seq models under automatic and human evaluation settings. |
Are Your LLMs Capable of Stable Reasoning? (2025.findings-acl)
Copied to clipboard
Junnan Liu, Hongwei Liu, Linchen Xiao, Ziyi Wang, Kuikun Liu, Songyang Gao, Wenwei Zhang, Songyang Zhang, Kai Chen
| Challenge: | Existing evaluation protocols and metrics do not capture the full spectrum of LLM capabilities, especially in complex reasoning tasks. |
| Approach: | They propose a new evaluation metric that continuously assesses model performance across multiple sampling attempts, quantifying both the model’s potential capabilities and operational consistency. |
| Outcome: | The proposed evaluation metric measures model performance across multiple sampling attempts and provides comprehensive insights into their potential capabilities and operational consistency. |
Leveraging Graph to Improve Abstractive Multi-Document Summarization (2020.acl-main)
Copied to clipboard
| Challenge: | Empirical results show that our model brings substantial improvements over several strong baselines. |
| Approach: | They propose a neural abstractive multi-document summarization model which captures cross-document relations and can guide the summary generation process. |
| Outcome: | The proposed model improves on the WikiSum and MultiNews datasets and can be easily combined with pre-trained language models. |
MOOCCube: A Large-scale Data Repository for NLP Applications in MOOCs (2020.acl-main)
Copied to clipboard
Jifan Yu, Gan Luo, Tong Xiao, Qingyang Zhong, Yuquan Wang, Wenzheng Feng, Junyi Luo, Chenyu Wang, Lei Hou, Juanzi Li, Zhiyuan Liu, Jie Tang
| Challenge: | Massive open online courses (MOOCs) are a popular educational platform for advanced research. |
| Approach: | They propose to use MOOCCube to build a large-scale data repository of over 700 MOOC courses, 100k concepts, 8 million student behaviors with an external resource. |
| Outcome: | The proposed datasets show that they can facilitate research in MOOCs. |
HEAL: A Hypothesis-Based Preference-Aware Analysis Framework (2025.findings-emnlp)
Copied to clipboard
Yifu Huo, Chenglong Wang, Qiren Zhu, Shunjie Xing, Tong Xiao, Chunliang Zhang, Tongran Liu, JingBo Zhu
| Challenge: | Preference optimization methods like DPO are often evaluated on a single response, overlooking other outputs. |
| Approach: | They propose a Hypothesis-based PrEference-aware AnaLysis Framework that formulates preference alignment as a re-ranking process within hypothesis spaces. |
| Outcome: | The proposed evaluation paradigm re-ranks preference alignment as a reranking process within hypothesis spaces. |
Position IDs Matter: An Enhanced Position Layout for Efficient Context Compression in Large Language Models (2025.findings-emnlp)
Copied to clipboard
| Challenge: | Existing methods to compress context information ignore holistic contextual dependencies. |
| Approach: | They propose a method that adjusts position encodings to minimize the distance between context tokens and special tokens. |
| Outcome: | Enhanced Position Layout (EPL) improves compression of context information in large language models. |
Hallucination Mitigation in Natural Language Generation from Large-Scale Open-Domain Knowledge Graphs (2023.emnlp-main)
Copied to clipboard
| Challenge: | Graph-to-text models trained on small-scale datasets or datasets with limited variety of graph shapes are not adequate for more realistic large-scale, open-domain settings. |
| Approach: | They propose a novel approach that, given a graph-sentence pair in GraphNarrative, trims the sentence to eliminate portions that are not present in the corresponding graph. |
| Outcome: | The proposed model can be trained on existing datasets and is available on github. |
APB-V: Accelerating Long-Video Understanding via Sequence-Parallelism-aware Approximate Attention (2026.acl-long)
Copied to clipboard
Yuxiang Huang, Mingye Li, Xu Han, Chaojun Xiao, Weilin Zhao, Ao Sun, Ziqi Yuan, Hao Zhou, Fandong Meng, Zhiyuan Liu
| Challenge: | Existing methods for long-video inference use compression or sparse attention . existing methods restrict LMMs from handling longer, more complex videos . |
| Approach: | They propose a sequence-parallel framework with optimized attention that accelerates long-video inference across multiple GPUs. |
| Outcome: | The proposed framework delivers speedups of 12.72x, 1.70x, and 1.18x over FlashAttn, ZigZagRing, and APB without significant performance loss. |
T3-Vis: visual analytic for Training and fine-Tuning Transformers in NLP (2021.emnlp-demo)
Copied to clipboard
| Challenge: | Existing visual analytics tools have been shown to support the analysis and interpretation of deep learning models due to the inherent black-box nature of the models. |
| Approach: | They propose to use visual analytic framework to help researchers understand the model's intrinsic properties and behaviours through interactive visualization. |
| Outcome: | The proposed framework provides valuable insights about the model’s intrinsic properties and behaviours through interactive visualization and a suite of built-in algorithms. |
Refining Corpora from a Model Calibration Perspective for Chinese Spelling Correction (2024.findings-acl)
Copied to clipboard
| Challenge: | Chinese Spelling Correction (CSC) lacks large-scale high-quality corpora due to labor-intensive labeling of spelling errors in real-life writing or typing scenarios. |
| Approach: | They propose to use OCR/ASR-based generation to refine Chinese Spelling Correction models on random replacement-based corpora and filter them based on prediction confidence. |
| Outcome: | The proposed model outperforms existing models on three widely-used benchmarks while significantly alleviating over-correction. |
Revisiting Scaling Laws for Language Models: The Role of Data Quality and Training Strategies (2025.acl-long)
Copied to clipboard
| Challenge: | Existing scaling laws suggest augmenting model size and training data results in enhanced performance, but recent studies reveal deviations, particularly in large language models, where performance improvements decelerate—a phenomenon known as sub-scaling. |
| Approach: | They propose a sub-optimal scaling law that better predicts performance in sub-scaling regimes by examining data quality and training strategies. |
| Outcome: | The proposed scaling law better predicts performance in sub-scaling regimes, highlighting the importance of data quality and diversity. |
Predicting Discourse Trees from Transformer-based Neural Summarizers (2021.naacl-main)
Copied to clipboard
| Challenge: | Existing extractive summarization tasks use only neural approaches to learn discourse information, but recent work has shown that it is beneficial for summarizing discourse information. |
| Approach: | They propose to generate document-level discourse trees from pre-trained neural summarizers that encode dependency- and constituency-style discourse information. |
| Outcome: | The proposed model learns both, dependency- and constituency-style discourse information, consistent with pre-neural results. |
PILOT: Legal Case Outcome Prediction with Case Law (2024.naacl-long)
Copied to clipboard
| Challenge: | predicting legal case outcomes requires identifying relevant precedent cases . predicting case outcomes in case law systems presents unique challenges . |
| Approach: | They propose a framework for making legal case outcome predictions with case law . they propose to use two modules for relevant case retrieval and temporal pattern handling . |
| Outcome: | The proposed framework shows significant improvement over previous models based on civil law cases . it is crucial to identify relevant precedent cases that serve as evidence for judges . |
ADaPT: Token-Level Decoupling for Efficient Large Reasoning Models (2026.findings-acl)
Copied to clipboard
Tingyun li, Zishang Jiang, Jinyi Han, Xinyi Wang, Sihang Jiang, Han Xia, Zhaoqian Dai, Ma Shuguang, Fei Yu, Jiaqing Liang, Yanghua Xiao
| Challenge: | Existing efficiency-oriented methods attempt to shorten or mix reasoning strategies, yet often degrade reasoning capability. |
| Approach: | They propose a token-level dual-process framework that explicitly decouples efficiency and correctness signals during training. |
| Outcome: | The proposed framework reduces inference cost while maintaining strong reasoning ability across multiple benchmarks. |
Landmark Embedding: A Chunking-Free Embedding Method For Retrieval Augmented Long-Context Large Language Models (2024.acl-long)
Copied to clipboard
| Challenge: | Existing methods for retrieval augmentation work with chunked contexts, which leads to poor quality of semantic representation and incomplete retrieval of useful information. |
| Approach: | They propose a method for retrieval augmentation of long-context language modeling using landmark embedding. |
| Outcome: | The proposed method outperforms existing retrieval methods with a notable advantage. |
Black-Box Prompt Optimization: Aligning Large Language Models without Model Training (2024.acl-long)
Copied to clipboard
| Challenge: | Large language models are often not well aligned with human intents, which requires additional training. |
| Approach: | They propose to use Black-Box Prompt Optimization (BPO) to perform alignments on large language models that are not well aligned with human intents. |
| Outcome: | The proposed model outperforms existing models and is model-agnostic. |
Evaluating Entity Disambiguation and the Role of Popularity in Retrieval-Based NLP (2021.acl-long)
Copied to clipboard
| Challenge: | Existing studies show that retrievers underperform on rarer entities that share a name . open-domain tasks require a knowledge source to perform reasoning and produce an answer . |
| Approach: | They propose an evaluation benchmark for retrieving entities that share a name . they define Ambiguous Entity Retrieval sets as a collection of entities that have a common name - and query about those entities. |
| Outcome: | The proposed sets underperform on rarer entities that share a name . the retrievers exhibit popularity bias, and are twice as likely to retrieve erroneous documents . |
Knowledge-Rich Self-Supervision for Biomedical Entity Linking (2022.findings-emnlp)
Copied to clipboard
Sheng Zhang, Hao Cheng, Shikhar Vashishth, Cliff Wong, Jinfeng Xiao, Xiaodong Liu, Tristan Naumann, Jianfeng Gao, Hoifung Poon
| Challenge: | Entity linking is challenging in high-value domains with myriad entities . standard classification approaches suffer from the annotation bottleneck . |
| Approach: | They propose a self-supervised approach to learn domain knowledge for biomedical entity linking . it generates self-reported mention examples on unlabeled text and trains contextual encoder . |
| Outcome: | The proposed method outperforms existing methods by 20 points in accuracy on biomedical datasets. |
AMEX: Android Multi-annotation Expo Dataset for Mobile GUI Agents (2025.findings-acl)
Copied to clipboard
Yuxiang Chai, Siyuan Huang, Yazhe Niu, Han Xiao, Liang Liu, Guozhi Wang, Dingyu Zhang, Shuai Ren, Hongsheng Li
| Challenge: | a new dataset is being developed to improve the capabilities of mobile GUI-control agents. |
| Approach: | They propose a dataset designed for generalist mobile GUI-control agents . they use screenshots from popular mobile applications to create a detailed GUI-annotated dataset . |
| Outcome: | The Android Multi-annotation EXpo (AMEX) is a large-scale dataset for generalist mobile GUI-control agents . it includes screenshots from popular mobile applications, which are annotated at multiple levels . |
Length is a Curse and a Blessing for Document-level Semantics (2023.emnlp-main)
Copied to clipboard
| Challenge: | In recent years, contrastive learning (CL) has been extensively utilized to recover sentence and document-level encoding capability from pre-trained language models. |
| Approach: | They propose a document-based contrastive learning framework that is length-agnostic self-reference based on document length. |
| Outcome: | The proposed framework achieves state-of-the-art on the standard information retrieval benchmark. |
How to Leverage Demonstration Data in Alignment for Large Language Model? A Self-Imitation Learning Perspective (2024.emnlp-main)
Copied to clipboard
| Challenge: | Existing methods for fine-tuning large language models are not suitable for task-dependent tasks. |
| Approach: | They propose a generalized self-imitation learning framework which aligns large language models with offline demonstration data. |
| Outcome: | The proposed framework outperforms baselines in many challenging benchmarks . it is available on github.com/tengxiao1/GSIL . |
Improving Recall of Large Language Models: A Model Collaboration Approach for Relational Triple Extraction (2024.lrec-main)
Copied to clipboard
| Challenge: | Existing large language models can extract triples from simple sentences with few-shot learning or fine-tuning, but they often miss out when extracting from complex sentences. |
| Approach: | They propose an evaluation-filtering framework that integrates large language models with small models for relational triple extraction tasks. |
| Outcome: | The proposed framework integrates large language models with small models for relational triple extraction tasks. |
Everything Has a Cause: Leveraging Causal Inference in Legal Text Analysis (2021.naacl-main)
Copied to clipboard
| Challenge: | Existing studies focus on analyzing structured data, while mining causal relationship among factors from unstructured data is of great importance. |
| Approach: | They propose a graph-based causal inference framework which builds causal graphs from fact descriptions without much human involvement. |
| Outcome: | The proposed framework can capture nuance from fact descriptions among confusing charges and provide explainable discrimination in few-shot settings. |
Counterfactual Recipe Generation: Exploring Compositional Generalization in a Realistic Scenario (2022.emnlp-main)
Copied to clipboard
| Challenge: | Existing models fail to learn and use culinary knowledge in a compositional way, argues a new study. |
| Approach: | They propose a task that asks models to modify a base recipe according to the change of an ingredient. |
| Outcome: | The proposed model can perform compositional generalization in a realistic setting . existing models have difficulties in modifying ingredients while preserving original style . |
Towards Robust Evidence-Aware Fake News Detection via Improving Semantic Perception (2024.lrec-main)
Copied to clipboard
| Challenge: | Existing methods lack sufficient semantic perception and are easily blinded by textual expressions. |
| Approach: | They propose a model-agnostic training framework to improve the semantic perception of evidence-aware fake news detection by combining two kinds of data augmentations with synthetic data. |
| Outcome: | The proposed framework outperforms state-of-the-art methods on the extended test set while achieving competitive performance on the original one. |
The Magic of IF: Investigating Causal Reasoning Abilities in Large Language Models of Code (2023.findings-acl)
Copied to clipboard
| Challenge: | entailment a) |
| Approach: | entailment : We want to explore whether Code-LLMs with code prompts are better . encoding a code prompt is better than text-only LLMs, they say . |
| Outcome: | entailment : Our results show that Code-LLMs with code prompts are better compared to text-only LLMs. |
HyperAdaLoRA: Accelerating LoRA Rank Allocation During Training via Hypernetworks without Sacrificing Performance (2026.findings-acl)
Copied to clipboard
Hao Zhang, Zhenjia Li, Yifan Gao, Xi Xiao, Heng Zhang, Shuyang Zhang, null Xiaoxincc, Bo Huang, Yuhang Wu, Tianyang Wang, Hao Xu
| Challenge: | Low-Rank Adaptation (LoRA) assumes a uniform rank r for each incremental matrix, not accounting for the varying significance of weight matrices across modules and layers. |
| Approach: | They propose a framework that allows for faster convergence of low-rank adaptive models . they use a hypernetwork to prune the outputs of the hypernetworks to generate parameters . |
| Outcome: | The proposed framework accelerates convergence of AdaLoRA by leveraging a hypernetwork. |
Are All the Datasets in Benchmark Necessary? A Pilot Study of Dataset Evaluation for Text Classification (2022.naacl-main)
Copied to clipboard
| Challenge: | Existing benchmark datasets contribute little to discriminating top-scoring systems, while those less used datasets exhibit impressive discriminative power. |
| Approach: | They examine the distinguishability of benchmark datasets when comparing different systems . they find that existing benchmark dataset contribute little to discriminating top-scoring systems - whereas those less used datasets exhibit impressive discriminative power. |
| Outcome: | The proposed datasets are released on DataLab. |
From Long Videos to Engaging Clips: A Human-Inspired Video Editing Framework with Multimodal Narrative Understanding (2025.emnlp-industry)
Copied to clipboard
Xiangfeng Wang, Xiao Li, Yadong Wei, null Songxueyu, Yang Song, null Xiaxiaoqiang, Fangrui Zeng, Zaiyi Chen, null Liuliu, Gu Xu, Tong Xu
| Challenge: | Existing methods for video editing rely on textual cues from ASR transcripts and segment selection, often neglecting rich visual context. |
| Approach: | They propose a human-inspired automatic video editing framework that leverages multimodal narrative understanding to address these limitations. |
| Outcome: | The proposed framework outperforms existing baselines across general and advertisement-oriented editing tasks. |
HiCL: Hierarchical Contrastive Learning of Unsupervised Sentence Embeddings (2023.findings-emnlp)
Copied to clipboard
| Challenge: | Existing methods that encode a sequence in its entirety for contrast with others often neglect local representation learning. |
| Approach: | They propose a hierarchical contrastive learning framework, HiCL, which considers local segment-level and global sequence-level relationships to improve training efficiency and effectiveness. |
| Outcome: | The proposed framework improves training efficiency and effectiveness by dividing a sequence into several segments and using local and global contrastive learning to model relationships. |
PolyJoin: Semantic Multi-key Joinable Table Search in Data Lakes (2025.findings-naacl)
Copied to clipboard
| Challenge: | Existing joinable table search methods focus on single key (unary) joins, where a single column is the join key, but are ineffective when dealing with join keys composed of multiple columns (n-ary joins) Existing methods are inefficient when dealing . with joins composed of n-aries, which are prevalent on web table corpora. |
| Approach: | They propose a joinable table search method that finds multi-key joinable tables on the web, given a query table. |
| Outcome: | The proposed method outperforms the state-of-the-art methods on two real-world web table benchmarks. |
Breaking the Generator Barrier: Disentangled Representation for Generalizable AI-Text Detection (2026.acl-long)
Copied to clipboard
| Challenge: | a rapid proliferation of large language models (LLMs) generate text that increasingly resembles human writing . this makes it difficult to capture subtle cues that distinguish AI-generated content from human-written content . |
| Approach: | They propose a framework that disentangles AI-detection semantics from generator-aware artifacts by latent encoding and perturbation-based regularization. |
| Outcome: | The proposed framework disentangles AI-detection semantics from generator-aware artifacts on 20 representative LLMs across 7 categories. |
Toward Automated Robustness Evaluation of Mathematical Reasoning (2026.findings-acl)
Copied to clipboard
Yutao Hou, Zeguan Xiao, Fei Yu, Yihan Jiang, Ma Shuguang, Zhaoqian Dai, Hailiang Huang, Yun Chen, Guanhua Chen
| Challenge: | Existing robustness evaluations rely on hand-crafted templates or a limited set of perturbation rules, resulting in model failure. |
| Approach: | They propose a framework inspired by software stress testing that generates adversarial variants via a multi-round rewrite-verify loop, ensuring semantic consistency while successfully inducing model failure. |
| Outcome: | The proposed framework generates adversarial variants dynamically for each LLM, minimizing the risk of data contamination. |
From Script to Stage: Automating Experimental Design for Social Simulations with LLMs (2026.findings-acl)
Copied to clipboard
| Challenge: | Xu et al., 2024): multi-agent simulations based on large language models are a new paradigm for social science research . traditional experimental design relies on interdisciplinary expertise and technical barriers . Xiaoping and Xin eli argue that LLM-driven agents are unreliable for rigorous experimental design due to hallucinations and limited verifiability. |
| Approach: | They propose a framework for multi-agent experiment design based on script generation . Script Composition, Script Finalization, and Actor Generation are the core phases of the framework . |
| Outcome: | The proposed framework lowers the barrier for social science experimental design and provides scientifically grounded decision support for policy-making. |
ARTIST: A Transformer-based Chinese Text-to-Image Synthesizer Digesting Linguistic and World Knowledge (2022.findings-emnlp)
Copied to clipboard
| Challenge: | Text-to-Image Synthesis (TIS) is a popular task to convert natural language texts into realistic images. |
| Approach: | They propose a transformer-based Chinese text-to-image synthesizer for high-resolution image generation that incorporates linguistic and relational knowledge facts into the model to ensure better performance without the usage of ultra-large models. |
| Outcome: | The proposed model outperforms existing models in Chinese with linguistic and relational knowledge facts. |
Enhanced Reasoning for Biomedical Document-Level Relation Extraction via a Novel Cascade Language Model Framework (2026.acl-long)
Copied to clipboard
| Challenge: | Pre-trained language models (PLMs) are the leading paradigm in document-level relation extraction. |
| Approach: | They propose a cascade framework that leverages the complementary strengths of PLMs and LLMs through a detect-then-rethink paradigm. |
| Outcome: | The proposed framework improves on BioRED and CDR datasets and improves existing models. |
Multi-Task Representation Alignment on Language Understanding: A Mutual Information Perspective (2026.acl-long)
Copied to clipboard
| Challenge: | Existing approaches to multitask learning fail to address task interference issues . Existing methods focus on task balancing or probabilistic modeling but fail to learn sufficient representations for all target tasks. |
| Approach: | They propose a multi-task representation alignment framework to achieve task-specific alignment and self-alignment on shared representations from a mutual information perspective. |
| Outcome: | The proposed framework outperforms 13 representative MTL methods under label-noisy and data-constrained conditions. |
Sinkhorn Distance Minimization for Knowledge Distillation (2024.lrec-main)
Copied to clipboard
Xiao Cui, Yulei Qin, Yuting Gao, Enwei Zhang, Zihan Xu, Tong Wu, Ke Li, Xing Sun, Wengang Zhou, Houqiang Li
| Challenge: | Existing knowledge distillation methods investigate divergence measures but fail to deliver effective supervision when few distribution overlap exists between teacher and student. |
| Approach: | They propose a knowledge distillation method that exploits the Sinkhorn distance to ensure a nuanced assessment of the disparity between teacher and student distributions. |
| Outcome: | The proposed method outperforms state-of-the-art methods on all kinds of LLMs with encoder-only, encoder decoder, and decoded architectures. |
A Lexicon-Based Approach for Detecting Hedges in Informal Text (2020.lrec-1)
Copied to clipboard
| Challenge: | Existing studies on hedging detection have focused on structured texts and formal communications. |
| Approach: | They propose to use hedging words and phrases to identify tensions between interviewees during a survivor interview to help researchers understand the dynamics of the interview. |
| Outcome: | The proposed algorithm detects sentence-level hedges in informal conversations such as survivor interviews. |
AutoBreach: Universal and Adaptive Jailbreaking with Efficient Wordplay-Guided Optimization via Multi-LLMs (2025.findings-naacl)
Copied to clipboard
| Challenge: | Existing jailbreak research exhibits limitations in universality, validity, and efficiency . Existing methods for jailbreaking LLMs have limited validity and effectiveness . |
| Approach: | They propose a black-box approach that uses wordplay-guided mapping rule sampling to create universal adversarial prompts. |
| Outcome: | The proposed method efficiently identifies security vulnerabilities across various LLMs, achieving an average success rate of over 80% with fewer than 10 queries. |
Improving Neural Abstractive Document Summarization with Explicit Information Selection Modeling (D18-1)
Copied to clipboard
| Challenge: | Existing neural abstractive methods for document summarization are not effective for document summary. |
| Approach: | They propose to extend basic neural encoding-decoding framework with an information selection layer to explicitly model and optimize the information selection process in abstractive document summarization. |
| Outcome: | The proposed model outperforms state-of-the-art methods on document summarization tasks significantly. |
Matching-oriented Embedding Quantization For Ad-hoc Retrieval (2021.emnlp-main)
Copied to clipboard
| Challenge: | Product quantization (PQ) is a widely used technique for ad-hoc retrieval. |
| Approach: | They propose a match-oriented product quantization with a multinoulli contrastive loss objective. |
| Outcome: | The proposed method maximizes matching probability of query and ground-truth key, compared with previous methods on non-supervised datasets. |
MARK: Multi-agent Collaboration with Ranking Guidance for Text-attributed Graph Clustering (2025.findings-acl)
Copied to clipboard
Yiwei Fu, Yuxing Zhang, Chunchun Chen, JianwenMa JianwenMa, Quan Yuan, Rong-Cheng Tu, Xinli Huang, Wei Ye, Xiao Luo, Minghua Deng
| Challenge: | Existing approaches to cluster graphs with GNNs are limited due to label scarcity. |
| Approach: | They propose to leverage large language models to enhance text-attributed graph clustering by using three LLMs as ranking-based supervision signals. |
| Outcome: | The proposed approach generates reliable guidance using collaboration of three LLM-based agents as ranking-based supervision signals. |
RoCBert: Robust Chinese Bert with Multimodal Contrastive Pretraining (2022.acl-long)
Copied to clipboard
| Challenge: | Large-scale pretrained language models have achieved SOTA results on NLP tasks but are vulnerable to adversarial attacks especially for logographic languages like Chinese. |
| Approach: | They propose a pretrained Chinese Bert that is robust to various forms of adversarial attacks like word perturbation, synonyms, typos, etc. |
| Outcome: | The proposed model outperforms baselines on 5 Chinese NLU tasks without sacrificing performance on clean testsets. |
AttentionRank: Unsupervised Keyphrase Extraction using Self and Cross Attentions (2021.emnlp-main)
Copied to clipboard
| Challenge: | Keyword or keyphrase extraction is to identify words or phrases presenting the main topics of a document. |
| Approach: | They propose a hybrid attention model to identify keyphrases from a document in an unsupervised manner. |
| Outcome: | The proposed model is effective and robust on long and short documents. |
From Remembering to Metacognition: Do Existing Benchmarks Accurately Evaluate LLMs? (2025.findings-emnlp)
Copied to clipboard
Geng Zhang, Yizhou Ying, Sihang Jiang, Jiaqing Liang, Guanglei Yue, Yifei Fu, Hailin Hu, Yanghua Xiao
| Challenge: | Existing benchmark datasets focus on low-level cognitive tasks while providing limited coverage of higher-level reasoning skills. |
| Approach: | They analyze the cognitive depth of popular LLM benchmarks using Bloom’s Taxonomy to evaluate both the cognitive and knowledge dimensions. |
| Outcome: | The results show that incorporating higher-level cognitive instructions into the current instruction fine-tuning process improves model performance. |
ALPS: Attention Localization and Pruning Strategy for Efficient Adaptation of Large Language Models (2025.findings-acl)
Copied to clipboard
Hao Chen, Haoze Li, Zhiqing Xiao, Lirong Gao, Qi Zhang, Xiaomeng Hu, Ningtao Wang, Xing Fu, Junbo Zhao
| Challenge: | Prior research has focused on optimizing general-purpose large language models to downstream tasks . however, these approaches inherently introduce data dependency, which hinders generalization and reusability. |
| Approach: | They propose an algorithm that localizes the most task-sensitive attention heads and prunes by restricting attention training updates to these heads, thereby reducing alignment costs. |
| Outcome: | The proposed algorithm achieves 2% performance improvement over baselines on three tasks while localizing the most task-sensitive attention heads. |
Diversified Multiple Instance Learning for Document-Level Multi-Aspect Sentiment Classification (2020.emnlp-main)
Copied to clipboard
| Challenge: | Experimental results show that D-MILN outperforms recent weakly-supervised baselines . document-level multi-aspect sentiment classification requires a lot of manual aspect-level annotations - which is time-consuming and laborious . |
| Approach: | They propose a novel Diversified Multiple Instance Learning Network to achieve DMSC with only document-level weak supervision. |
| Outcome: | The proposed method outperforms weakly-supervised baselines on TripAdvisor and BeerAdvocate datasets. |
Triviality Corrected Endogenous Reward (2026.acl-long)
Copied to clipboard
Xinda Wang, Zhengxu Hou, Yangshijie Zhang, null Yanbingren, Jialin Liu, ChenZhuo Zhao, Zhibo Yang, Bin-Bin Yang, Feng Xiao
| Challenge: | Recent work on unsupervised reinforcement learning for mathematical reasoning using confidence-based endogenous rewards focuses on open-ended text generation, requiring either annotated data or powerful closed-source models. |
| Approach: | They propose a method that rewards the relative information gain between a specialist and a generalist reference policy, modulated by a probability-dependent correction mechanism. |
| Outcome: | The proposed model improves on multiple writing benchmarks and model architectures without external supervision and validates generality across different generation tasks. |
Pre-training Multilingual Neural Machine Translation by Leveraging Alignment Information (2020.emnlp-main)
Copied to clipboard
| Challenge: | Existing pre-training methods are not effective for machine translation tasks. |
| Approach: | They propose a method to pre-train a universal multilingual neural machine translation model . they use random aligned substitution technique to bring words and phrases with similar meanings closer in the representation space. |
| Outcome: | The proposed approach improves translation quality on low, medium, rich resource languages. |
MobiLoRA: Accelerating LoRA-based LLM Inference on Mobile Devices via Context-aware KV Cache Optimization (2025.acl-long)
Copied to clipboard
| Challenge: | MobiLoRA focuses on optimizing the key-value (KV) caches due to the limited computing and memory resources of mobile devices. |
| Approach: | They propose to optimize the key-value caches due to limited computing resources . they propose similarity-aware delta encoding for semantic-level contexts . |
| Outcome: | The proposed model accelerates LoRA-based LLM inference by 57.6% on mobile devices. |
Dynamic Generation of Multi LLM Agents Communication Topologies with Graph Diffusion Models (2026.acl-long)
Copied to clipboard
Eric Hanchen Jiang, Levina Li, Frank Wan, Xiao Liang, Sophia Yin, Yuchen Wu, Xinfeng Li, Yizhou Sun, Wei Wang, Kai-Wei Chang, Ying Nian Wu
| Challenge: | Existing frameworks rely on static or rule-based topologies that fail to adapt to task requirements. |
| Approach: | They propose a generative framework that generates highly task-adaptive topologies . they validated the framework on multiple benchmarks and validated it on multiple platforms . |
| Outcome: | The proposed framework outperforms existing frameworks in task-adaptive communication topologies. |
ThinkNote: Enhancing Knowledge Integration and Utilization of Large Language Models via Constructivist Cognition Modeling (2026.findings-eacl)
Copied to clipboard
Zhipeng Xu, Zhenghao Liu, Yukun Yan, Shuo Wang, Shi Yu, Zheni Zeng, Chaojun Xiao, Zhiyuan Liu, Ge Yu, Chenyan Xiong
| Challenge: | Large Language Models (LLMs) exhibit suboptimal behaviors and inconsistencies when exposed to unfamiliar external information, underscoring their limitations in effectively leveraging such knowledge. |
| Approach: | They propose a framework that enhances the external knowledge utilization of Large Language Models through a two-stage constructivist cognitive modeling process. |
| Outcome: | The proposed framework achieves a 10% improvement over baseline methods on various question-answering benchmarks. |
Recipe2Plan: Evaluating Planning Abilities of LLMs for Efficient and Feasible Multitasking with Time Constraints Between Actions (2025.findings-emnlp)
Copied to clipboard
| Challenge: | Existing evaluation benchmarks focus on single task performance, ignoring multitask planning and execution efficiency. |
| Approach: | They propose a benchmark framework based on real-world cooking scenarios . recipe2plan challenges agents to optimize cooking time through parallel task execution . |
| Outcome: | The proposed benchmarks highlight the need for improved temporal awareness and global multitasking capabilities in large language models. |
Enhancing Local Feature Extraction with Global Representation for Neural Text Classification (D19-1)
Copied to clipboard
| Challenge: | Existing methods for text classification learn long dependency by deeply stacking or hybrid modeling. |
| Approach: | They propose a global-based local feature extraction architecture with global information incorporated into the local feature extractor. |
| Outcome: | The proposed architecture outperforms the previous best models on eight benchmark datasets. |
Geo-BERT Pre-training Model for Query Rewriting in POI Search (2021.findings-emnlp)
Copied to clipboard
| Challenge: | Existing methods to solve the word mismatch between queries and documents are often inadequate to integrate geographic information into the pre-training model. |
| Approach: | They propose to train a pre-training model to integrate semantics and geographic information in the pre-trained representations of POIs. |
| Outcome: | The proposed model achieves excellent accuracy on a wide range of real-world datasets of map services. |
Stacked Acoustic-and-Textual Encoding: Integrating the Pre-trained Models into Speech Translation Encoders (2021.acl-long)
Copied to clipboard
| Challenge: | End-to-end Speech Translation (E2E ST) encoders lack global context representation, whereas MT encoder lacks it. |
| Approach: | They propose a Stacked Acoustic-and-Textual Encoding method for speech translation . they propose an adaptor module to alleviate representation inconsistency . |
| Outcome: | The proposed method achieves state-of-the-art BLEU scores of 18.3 and 25.2 on two ST tasks. |
P4: Plug-and-Play Discrete Prompting for Large Language Models Personalization (2024.findings-acl)
Copied to clipboard
| Challenge: | Large Language Models (LLMs) exhibit impressive capabilities in following instructions, but manually prompting them to exhibit certain personalities may result in sub-optimal performance. |
| Approach: | They propose a plug-and-play prompting method to manipulate Large Language Models with distinct human-like personality traits by appending discrete personalized suffixes to query or dialog histories and focusing exclusively on influential tokens. |
| Outcome: | The proposed method outperforms other prompting methods and model editing methods on four models ranging from 1.1B to 13B and achieves 79.9% accuracy in customizing LLMs’ personalities. |
MoE-I2: Compressing Mixture of Experts Models through Inter-Expert Pruning and Intra-Expert Low-Rank Decomposition (2024.findings-emnlp)
Copied to clipboard
Cheng Yang, Yang Sui, Jinqi Xiao, Lingyi Huang, Yu Gong, Yuanlin Duan, Wenqi Jia, Miao Yin, Yu Cheng, Bo Yuan
| Challenge: | emergence of Mixture of Experts (MoE) LLMs has significantly advanced the development of language models. |
| Approach: | They propose a two-stage compression method tailored for Mixture of Experts to reduce the model size and decrease the computational cost. |
| Outcome: | The proposed method reduces model size and improves inference efficiency while maintaining performance in various zero-shot tasks. |
HiFi: High-Information Attention Heads Hold for Parameter-Efficient Model Adaptation (2023.acl-long)
Copied to clipboard
| Challenge: | Existing paradigm to fine-tune parameters of pre-trained language models poses problems in data-scarce and resource-limited scenarios. |
| Approach: | They propose a parameter-efficient fine-tuning method HiFi that fine-tails only the highly informative and strongly correlated attention heads for the specific task. |
| Outcome: | The proposed method obtains state-of-the-art over the prior benchmarks on the GLUE benchmark. |
PersonaTrace: Synthesizing Realistic Digital Footprints with LLM Agents (2026.eacl-industry)
Copied to clipboard
Minjia Wang, Yunfeng Wang, Xiao Ma, Dexin Lv, Qifan Guo, Lynn Zheng, Benliang Wang, Lei Wang, Jiannan Li, Yongwei Xing, Junzhe Xu, Zheng Sun
| Challenge: | Publicly available corpora cover only slivers of human activity, such as email threads, chat logs, purchase histories, sensor traces, and provide large-scale supervision for data-hungry machine-learning pipelines. |
| Approach: | They propose a method for synthesizing realistic digital footprints using large language model agents from a structured user profile. |
| Outcome: | The proposed method generates diverse sequences of user events, producing corresponding digital artifacts such as emails, messages, calendar entries, reminders, etc. |
HOTVCOM: Generating Buzzworthy Comments for Videos (2024.findings-acl)
Copied to clipboard
| Challenge: | Existing research focuses on generating descriptive comments in English . hot-comments are important for video marketing and branding, authors say . |
| Approach: | They propose a framework to generate hot-comments on a Chinese video dataset . they use a combination of visual, auditory, and textual data to generate them . |
| Outcome: | The proposed framework shows that it generates hot-comments on both the new and existing datasets. |
Can Large Language Models Understand You Better? An MBTI Personality Detection Dataset Aligned with Population Traits (2025.coling-main)
Copied to clipboard
Bohan Li, Jiannan Guan, Longxu Dou, Yunlong Feng, Dingzirui Wang, Yang Xu, Enbo Wang, Qiguang Chen, Bichen Wang, Xiao Xu, Yimeng Zhang, Libo Qin, Yanyan Zhao, Qingfu Zhu, Wanxiang Che
| Challenge: | Existing data on MBTI personality detection are based on self-reported labels and fail to capture the full range of population personality traits. |
| Approach: | They construct a manually annotated MBTI personality detection dataset with soft labels under the guidance of psychologists and use them to identify the task. |
| Outcome: | The MBTIBench is the first manually annotated MBti personality detection dataset with soft labels under the guidance of psychologists. |
Prompt-Based Monte-Carlo Tree Search for Goal-oriented Dialogue Policy Planning (2023.emnlp-main)
Copied to clipboard
| Challenge: | Optimal policy planning is a difficult task, authors say . many goal-oriented conversations require subjective strategies, they say - a problem in goal-orientated settings . |
| Approach: | They propose an approach to perform goal-oriented dialogue policy planning without model training. |
| Outcome: | The proposed approach performs goal-oriented dialogue policy planning without model training. |
ProcWorld: Benchmarking Large Model Planning in Reachability-Constrained Environments (2025.emnlp-main)
Copied to clipboard
| Challenge: | Existing benchmarks for embodied spatial reasoning and long-term planning are non-trivial due to the combinatorial complexity of long-horizon abstract reasoning. |
| Approach: | They propose a large-scale benchmark for partially observable embodied spatial reasoning and long-term planning with large language models and vision language models. |
| Outcome: | The proposed model performs better in 16 task types, 5,000 rooms, and over 10 million evaluation trajectories with diverse data distribution. |
Diversifying Dialogue Generation with Non-Conversational Text (2020.acl-main)
Copied to clipboard
| Challenge: | Neural network-based sequence-to-sequence models suffer from low diversity in open-domain dialogue generation. |
| Approach: | They propose a way to diversify dialogue generation by leveraging non-conversational text . they collect large-scale corpus from forum comments, idioms and book snippets . |
| Outcome: | The proposed model produces significantly more diverse responses without sacrificing relevance with context. |
AdaReTaKe: Adaptive Redundancy Reduction to Perceive Longer for Video-language Understanding (2025.findings-acl)
Copied to clipboard
| Challenge: | Multimodal Large Language Models (MLLMs) are limited by context length when processing long videos. |
| Approach: | They propose a training-free method that flexibly reduces redundancy by allocating compression ratios among time and model layers with theoretical guarantees. |
| Outcome: | Experiments on videoMME, MLVU, LongVideoBench, and LVBench show that AdaRETAKE outperforms existing methods by 2.3% and 2.8% for 7B and 72B models. |
Empirical Studies of Institutional Federated Learning For Natural Language Processing (2020.findings-emnlp)
Copied to clipboard
| Challenge: | federated learning is a promising ideology to unite isolated datasets for machine learning problems. |
| Approach: | They propose to use federated natural language processing networks to train a popular NLP model with applications in sentence intent classification. |
| Outcome: | The proposed model is sensitive to imbalanced data load and tested against a federated model under imbalanced datasets. |
MTR-Suite: A Framework for Evaluating and Synthesizing Conversational Retrieval Benchmarks (2026.acl-long)
Copied to clipboard
Junhao Ruan, Abudukeyumu Abudula, Bei Li, Yongjing Yin, Xinyu Liu, Kechen Jiao, Xin Chen, Jingang Wang, Xunliang Cai, Tong Xiao, JingBo Zhu
| Challenge: | Existing conversational retrieval benchmarks suffer from costly, sparse human annotation or rigid, unnatural automated heuristics. |
| Approach: | They propose a framework for auditing, synthesizing, and benchmarking conversational retrieval. |
| Outcome: | The proposed framework is based on three LLM-based auditors and a multi-agent system . it mimics production-style challenges (hard topic switching, verbosity) and offers superior discriminative power. |
Dynamic Prefix-Tuning for Generative Template-based Event Extraction (2022.acl-long)
Copied to clipboard
| Challenge: | Experimental results show that our model achieves competitive results with the state-of-the-art classification-based model OneIE on ACE 2005. |
| Approach: | They propose a generative template-based event extraction method with dynamic prefix . they integrate context information with type-specific prefixes to learn a context-specific name for each context . |
| Outcome: | The proposed method achieves competitive results with state-of-the-art model OneIE on ACE 2005 and performs well on ERE. |
IIET: Efficient Numerical Transformer via Implicit Iterative Euler Method (2025.emnlp-main)
Copied to clipboard
Xinyu Liu, Bei Li, Jiahao Liu, Junhao Ruan, Kechen Jiao, Hongyin Tang, Jingang Wang, Tong Xiao, JingBo Zhu
| Challenge: | High-order numerical methods enhance performance in tasks like NLP but introduce a performance-efficiency trade-off due to increased computational overhead. |
| Approach: | They propose an iterative implicit Euler Transformer which simplifies high-order numerical methods by iterating implicit Eule. |
| Outcome: | The proposed method improves accuracy and reduces inference overhead by 55% while retaining 99.4% of the original task accuracy. |
Capturing Minds, Not Just Words: Enhancing Role-Playing Language Models with Personality-Indicative Data (2024.findings-emnlp)
Copied to clipboard
| Challenge: | Existing role-playing models focus on character knowledge and tones, but lack personality-indicative data to capture characters' minds. |
| Approach: | They propose to enhance role-playing agents (RPAs) via personality-indicative data by asking psychological scales to capture broad aspects of personality traits in individuals. |
| Outcome: | The proposed model exhibits advanced role-playing capabilities for both general and personality-related evaluations. |
Robust and Scalable Model Editing for Large Language Models (2024.lrec-main)
Copied to clipboard
Yingfa Chen, Zhengyan Zhang, Xu Han, Chaojun Xiao, Zhiyuan Liu, Chen Chen, Kuai Li, Tao Yang, Maosong Sun
| Challenge: | Existing methods that ignore contextual knowledge fail to reliably fall back to parametric knowledge when presented with irrelevant context. |
| Approach: | They propose to use contextual knowledge to update and correct LLMs' knowledge by in-context editing instead of retraining. |
| Outcome: | The proposed method outperforms current state-of-the-art methods by a large margin on a dataset that contains irrelevant questions. |
BabelDOC: Better Layout-Preserving PDF Translation via Intermediate Representation (2026.acl-demo)
Copied to clipboard
| Challenge: | Existing document translation pipelines face a tension between linguistic processing and layout preservation. |
| Approach: | They propose a framework for layout-preserving PDF translation that decouples visual layout metadata from semantic content. |
| Outcome: | The proposed framework improves layout fidelity, visual aesthetics, and terminology consistency over representative baselines while maintaining competitive translation precision. |
Parenting: Optimizing Knowledge Selection of Retrieval-Augmented Language Models with Parameter Decoupling and Tailored Tuning (2025.acl-long)
Copied to clipboard
Yongxin Xu, Ruizhe Zhang, Xinke Jiang, Yujie Feng, Yuzhen Xiao, Xinyu Ma, Runchuan Zhu, Xu Chu, Junfeng Zhao, Yasha Wang
| Challenge: | Existing methods for integrating internal and external knowledge lack effective control mechanisms for generating hallucinations and dealing with outdated knowledge. |
| Approach: | They propose a framework that decouples, identifies, and purposefully optimizes parameter subspaces related to adherence and robustness. |
| Outcome: | The proposed framework decouples, identifies, and purposefully optimizes parameter subspaces related to adherence and robustness. |
A3: Android Agent Arena for Mobile GUI Agents with Essential-State Procedural Evaluation (2026.findings-acl)
Copied to clipboard
Yuxiang Chai, Shunye Tang, Han Xiao, Weifeng Lin, Hanhao Li, Jiayu Zhang, Liang Liu, Pengxiang Zhao, Guangyi Liu, Guozhi Wang, Shuai Ren, Rongduo Han, Haining Zhang, Siyuan Huang, Hongsheng Li
| Challenge: | Existing evaluation methods for mobile GUI agents rely on static frame assessments or offline static apps. |
| Approach: | They propose an evaluation system that leverages large language models as reward models to verify task completion and process achievement. |
| Outcome: | The proposed system addresses the limitations of traditional function based evaluation methods on online dynamic apps. |
RU22Fact: Optimizing Evidence for Multilingual Explainable Fact-Checking on Russia-Ukraine Conflict (2024.lrec-main)
Copied to clipboard
| Challenge: | Existing methods to verify factuality of claims do not provide sufficient evidence for explainable fact-checking systems. |
| Approach: | They propose a method to automatically retrieve and summarize evidence from the Web and a novel multilingual explainable fact-checking dataset on the Russia-Ukraine conflict in 2022. |
| Outcome: | The proposed method can retrieve and summarize evidence from the Web and generate explanations in 16 languages. |
Prove Your Point!: Bringing Proof-Enhancement Principles to Argumentative Essay Generation (2024.emnlp-main)
Copied to clipboard
| Challenge: | Existing arguments generation methods often overlook connections between opinions . Existing methods struggle with providing compelling proof . |
| Approach: | They propose a two-stage framework for argumentative essay generation with a focus on logical enhancement. |
| Outcome: | The proposed framework generates argumentative essays with better logical validity and persuasiveness than baseline models. |
Understanding the Behaviors of Environment-aware Information Retrieval (2026.acl-long)
Copied to clipboard
| Challenge: | Recent retrieval-augmented generation approaches have demonstrated strong capability in handling complex queries. |
| Approach: | They propose a branching-based rollout technique that improves training stability . they find different retrievers exhibit distinct optimal query styles . |
| Outcome: | The proposed method improves training stability and improves retrieval-aware systems. |
InstructEval: Instruction-Tuned Text Evaluator from Human Preference (2024.findings-acl)
Copied to clipboard
| Challenge: | InstructEval is a general text evaluator based on open-source Large Language Models (LLMs). |
| Approach: | They propose to build a general multi-aspect text evaluator based on open-source Large Language Models (LLMs) they use extensive open Human Preference Modeling datasets and a small set of multi-spect annotated data to overcome the shortage of annotation resources for multi-task evaluations. |
| Outcome: | The proposed model performs comparable or superior to commercial LLMs like ChatGPT or GPT-4 in terms of both overall and multi-aspect evaluation tasks. |
Can Foundation Models Watch, Talk and Guide You Step by Step to Make a Cake? (2023.findings-emnlp)
Copied to clipboard
Yuwei Bao, Keunwoo Yu, Yichi Zhang, Shane Storks, Itamar Bar-Yossef, Alex de la Iglesia, Megan Su, Xiao Zheng, Joyce Chai
| Challenge: | despite advances in AI, it remains a challenge to develop interactive task guidance systems that can offer situated, personalized guidance and assist humans in various tasks. |
| Approach: | They propose to use a multimodal benchmark dataset to study whether interactive task guidance systems can be quickly adapted to perceptually enabled tasks. |
| Outcome: | The proposed models demonstrate fair performances in some cases with no training . the results will provide a stepping stone for future work on situated task guidance . |
PRCA: Fitting Black-Box Large Language Models for Retrieval Question Answering via Pluggable Reward-Driven Contextual Adapter (2023.emnlp-main)
Copied to clipboard
| Challenge: | Large Language Models (LLMs) are too large to be fine-tuned with budget constraints and some are only accessible via APIs. |
| Approach: | They propose a pluggable Reward-Driven Contextual Adapter that integrates large language models as generators and trains them to refine the retrieved information. |
| Outcome: | The proposed method improves ReQA performance on three datasets by up to 20% compared to existing methods. |
DrKGC: Dynamic Subgraph Retrieval-Augmented LLMs for Knowledge Graph Completion across General and Biomedical Domains (2025.findings-emnlp)
Copied to clipboard
| Challenge: | Knowledge graph completion (KGC) aims to predict missing triples in knowledge graphs . current approaches encode graph context in textual form, which fails to exploit its potential . |
| Approach: | a new method is proposed to predict missing triples in knowledge graphs by leveraging existing triples and textual information. |
| Outcome: | The proposed model learns structural embeddings and logical rules within the KG and extracts a subgraph for each query guided by the learned rules. |
Synthetic Socratic Debates: Examining Persona Effects on Moral Decision and Persuasion Dynamics (2025.emnlp-main)
Copied to clipboard
Jiarui Liu, Yueqi Song, Yunze Xiao, Mingqian Zheng, Lindia Tjuatja, Jana Schaich Borg, Mona T. Diab, Maarten Sap
| Challenge: | a study of multi-dimensional persona effects in AI-AI debates shows that personas influence moral stances and debate outcomes . political ideology and personality traits exert the strongest influence, according to our study . |
| Approach: | They propose to use a 6-dimensional persona space to simulate structured debates . they find political ideology and personality traits exert the strongest influence . |
| Outcome: | The study shows that personas affect moral stances and debate outcomes . political ideology and personality traits exert the strongest influence . |
Vanessa: Visual Connotation and Aesthetic Attributes Understanding Network for Multimodal Aspect-based Sentiment Analysis (2024.findings-emnlp)
Copied to clipboard
| Challenge: | Existing methods to analyze images focus on superficial features or descriptions, omitting subtle contextual information. |
| Approach: | They propose a Visual Connotation and Aesthetic Attributes Understanding Network (Vanessa) for Multimodal Aspect-based Sentiment Analysis. |
| Outcome: | The proposed network captures both implicit and explicit sentimental cues and can be used to enrich textual sentiment analysis. |
W-RST: Towards a Weighted RST-style Discourse Framework (2021.acl-long)
Copied to clipboard
| Challenge: | We show that weighted discourse trees from auxiliary tasks can benefit downstream applications . linguistic theories play a less and less critical role in the field of discourse . |
| Approach: | They propose a weighted-RST framework that assigns a binary assessment of importance between text segments by a relation attribute. |
| Outcome: | The proposed framework can be replaced by real-valued scores, the authors show . they show that weighted discourse trees can benefit key NLP downstream applications . |
Autoregressive Pre-Training on Pixels and Texts (2024.emnlp-main)
Copied to clipboard
| Challenge: | pixel-based language modeling integrates visual and textual data to improve performance of language models. |
| Approach: | They propose a method that integrates visual and textual data into an autoregressive framework. |
| Outcome: | The proposed method improves performance of pixel-based language models by incorporating visual and textual data. |
Dr.Academy: A Benchmark for Evaluating Questioning Capability in Education for Large Language Models (2024.acl-long)
Copied to clipboard
| Challenge: | Recognizing LLMs’ capability to generate educational content can lead to advances in automated and personalized learning. |
| Approach: | They propose to evaluate the questioning capability in education as a teacher of large language models by evaluating their generated educational questions. |
| Outcome: | The proposed model can generate educational content that aligns with human perspectives and is more apt as an interdisciplinary teacher. |
SimANS: Simple Ambiguous Negatives Sampling for Dense Text Retrieval (2022.emnlp-industry)
Copied to clipboard
Kun Zhou, Yeyun Gong, Xiao Liu, Wayne Xin Zhao, Yelong Shen, Anlei Dong, Jingwen Lu, Rangan Majumder, Ji-rong Wen, Nan Duan
| Challenge: | Existing methods for sapping negatives from large document pool suffer from the uninformative or false negative problem. |
| Approach: | They propose a method to sample negatives from a large document pool using a new sampling probability distribution. |
| Outcome: | The proposed method can be used to sample more ambiguous negatives on four public and one industry datasets. |
RetroMAE: Pre-Training Retrieval-oriented Language Models Via Masked Auto-Encoder (2022.emnlp-main)
Copied to clipboard
| Challenge: | Existing methods for dense retrieval are not effective, but there are still challenges. |
| Approach: | They propose a retrieval oriented pre-training paradigm based on Masked Auto-Encoder (MAE) where the sentence embedding is generated from the encoder’s masked input and the original sentence is recovered based upon the sentence embedded and decoded input via mangled language modeling. |
| Outcome: | The proposed model significantly improves the SOTA performance on a wide range of NLP benchmarks, like BEIR and MS MARCO. |
Unveiling the Potential of BERT-family: A New Recipe for Building Scalable, General and Competitive Large Language Models (2025.acl-long)
Copied to clipboard
| Challenge: | Generative large language models (LLMs) have significantly influenced various aspects of society, reshaping how we access and interact with information and knowledge. |
| Approach: | They propose a pre-training task that helps BERT-family excel in wider applications . they also explore the integration of cutting-edge technologies into their models to further enhance their capabilities. |
| Outcome: | The proposed model exhibits performance levels comparable to current SOTA LLMs across a spectrum of tasks. |
FaStFact: Faster, Stronger Long-Form Factuality Evaluations in LLMs (2025.findings-emnlp)
Copied to clipboard
Yingjia Wan, Haochen Tan, Xiao Zhu, Xinyu Zhou, Zhiwei Li, Qingsong Lv, Changxuan Sun, Jiaqi Zeng, Yi Xu, Jianqiao Lu, Yinhong Liu, Zhijiang Guo
| Challenge: | Prior evaluation pipelines fail to evaluate factuality of long-form LLMs due to inefficiency and costly human assessment. |
| Approach: | They propose a fast and strong evaluation pipeline that can evaluate factuality of long-form LLMs . they propose 'faStFact' to reduce cost of web searching and inference calling . |
| Outcome: | The proposed evaluation pipeline achieves highest alignment with human evaluation and efficiency among existing baselines. |
TokenTiming: A Dynamic Alignment Method for Universal Speculative Decoding Model Pairs (2026.acl-long)
Copied to clipboard
| Challenge: | Speculative decoding (SD) is a useful tool for accelerating large language models . but its utility is limited by a fundamental constraint: draft and target models must share the same vocabulary . |
| Approach: | They propose an algorithm that uses a draft token sequence to get a new target token sequence and then uses DTW to build a mapping to transfer probability distributions. |
| Outcome: | The proposed method shows 1.57x speedup on various tasks. |
AutoSchemaKG: Autonomous Knowledge Graph Construction through Dynamic Schema Induction from Web-Scale Corpora (2026.acl-long)
Copied to clipboard
Jiaxin Bai, Wei Fan, Qi Hu, Qing Zong, Chunyang Li, Hong Ting Tsang, Hongyu Luo, Yauwai Yim, Haoyu Huang, Xiao Zhou, Feng Qin, Tianshi Zheng, Xi Peng, Xin Yao, Huiwen Yang, Leijie Wu, JI Yi, Gong Zhang, Renhai Chen, Yangqiu Song
| Challenge: | Existing knowledge graph construction frameworks require predefined schemas, limiting their scalability and domain coverage. |
| Approach: | They propose a framework for fully autonomous knowledge graph construction that eliminates the need for predefined schemas. |
| Outcome: | The proposed framework outperforms state-of-the-art models on multi-hop QA tasks and enhances LLM factuality. |
Read it in Two Steps: Translating Extremely Low-Resource Languages with Code-Augmented Grammar Books (2025.acl-long)
Copied to clipboard
| Challenge: | Using code rules improves rule retrieval and application of grammar books in low-resource languages. |
| Approach: | They propose to decompose a grammar rule retrieval and application step into two steps . they propose to represent grammar rules as code functions to facilitate LLM reasoning . |
| Outcome: | The proposed model significantly boosts rule retrieval and application, resulting in 13.1% BLEU improvement. |
Refining Sample Embeddings with Relation Prototypes to Enhance Continual Relation Extraction (2021.acl-long)
Copied to clipboard
| Challenge: | Existing methods to extract relationships from texts depend on memory size and replay these memorized samples in subsequent tasks. |
| Approach: | They propose to use a model to extract relations between entities from texts where the samples of different relations are delivered into the model continuously. |
| Outcome: | The proposed model outperforms the state-of-the-art models and avoids catastrophic forgetting. |
Human Guided Exploitation of Interpretable Attention Patterns in Summarization and Topic Segmentation (2022.emnlp-main)
Copied to clipboard
| Challenge: | Existing studies have investigated the multi-head self-attention mechanism of transformers. |
| Approach: | They propose to use a human-in-the-loop pipeline to discover task-specific attention patterns and inject them into transformer models to improve their accuracy. |
| Outcome: | The proposed methods improve the performance of transformer models by incorporating predefined patterns into their attention matrices. |
Self-Constructed Context Decompilation with Fined-grained Alignment Enhancement (2024.findings-emnlp)
Copied to clipboard
| Challenge: | Decompilation is the process of converting compiled code back into a high-level programming language for analysis when source code is unavailable. |
| Approach: | They propose two methods to improve decompilation performance without fine-tuning and fine-grained alignment enhancement to achieve further improvements. |
| Outcome: | The proposed methods achieved a Re-Executability performance improvement of approximately 3.90% on the Decompile-Eval benchmark, establishing a new state-of-the-art performance of 52.41%. |
A Span-Extraction Dataset for Chinese Machine Reading Comprehension (D19-1)
Copied to clipboard
| Challenge: | Existing reading comprehension datasets are mostly in English . MRC is a new field of research that aims to comprehend the context of articles and answer the questions based on them. |
| Approach: | They propose a Span-Extraction dataset for Chinese machine reading comprehension to add language diversities to existing reading comprehension datasets. |
| Outcome: | The proposed dataset is composed of 20,000 real questions annotated on Wikipedia paragraphs by human experts. |
ToxiCloakCN: Evaluating Robustness of Offensive Language Detection in Chinese with Cloaking Perturbations (2024.emnlp-main)
Copied to clipboard
| Challenge: | Existing large language models struggle with systematically perturbed data designed to evade detection mechanisms. |
| Approach: | They propose a large language model with homophonic substitutions and emoji transformations to test their models' robustness against cloaking perturbations. |
| Outcome: | The proposed model underperforms in detecting offensive content when perturbations are applied to Chinese language datasets. |
Efficient Integration of External Knowledge to LLM-based World Models via Retrieval-Augmented Generation and Reinforcement Learning (2025.findings-emnlp)
Copied to clipboard
| Challenge: | Existing attempts to enhance LLM-based world models through prompting or fine-tuning approaches are either requiring human knowledge or computationally extensive. |
| Approach: | They propose a framework that leverages retrieval-augmented generation to integrate external knowledge to LLM-based world models. |
| Outcome: | The proposed framework outperforms baseline models and exhibits strong generalizability. |
CQR-SQL: Conversational Question Reformulation Enhanced Context-Dependent Text-to-SQL Parsers (2022.findings-emnlp)
Copied to clipboard
| Challenge: | Existing text-to-SQL methods focus on making full use of history context, but neglect to explicitly comprehend the schema and conversational dependency. |
| Approach: | They propose a CQR-SQL that explicitly exploits schema and conversational dependency for multi-turn SQL parsing. |
| Outcome: | The proposed method exploits schema and contextual dependency for multi-turn SQL parsing. |
ChemAmp: Amplified Chemistry Tools via Composable Agents (2026.findings-acl)
Copied to clipboard
Zhucong Li, Powei Chang, Jin Xiao, Zhijian Zhou, Qianyu He, Jiaqing Liang, Fenglei Cao, Xu Yinghui, Yuan Qi
| Challenge: | LLM-based agents are powerful tools for automating complex scientific workflows, especially in chemistry, but their single-task performance is limited by tool constraints. |
| Approach: | They propose a framework that optimizes the collective capabilities of specialized tools by dynamic coordination within individual tasks. |
| Outcome: | The proposed framework outperforms chemistry-specialized models, generalist LLMs, and agent systems with tool orchestration. |
CAST: Corpus-Aware Self-similarity Enhanced Topic modelling (2025.naacl-long)
Copied to clipboard
Yanan Ma, Chenghao Xiao, Chenhan Yuan, Sabine N Van Der Veer, Lamiece Hassan, Chenghua Lin, Goran Nenadic
| Challenge: | Existing topic modelling methods encode contextual information of documents while ignoring contextual details of candidate centroid words. Existing methods are limited by the contextualization gap. |
| Approach: | They propose a topic modelling method that builds upon candidate centroid word embeddings contextualized on the dataset and a self-similarity-based method to filter out less meaningful tokens. |
| Outcome: | The proposed method significantly enhances the coherence and diversity of generated topics, and handles noisy data, outperforming strong baselines. |
SFTMix: Elevating Language Model Instruction Tuning with Mixup Recipe (2026.acl-long)
Copied to clipboard
| Challenge: | Efforts to improve instruction tuning often focus on higher-quality supervised fine-tuning datasets, typically requiring data filtering with proprietary LLMs or human annotation. |
| Approach: | They propose a Mixup-based recipe that elevates LLM instruction tuning without relying on well-curated datasets. |
| Outcome: | The proposed model improves instruction-following and healthcare-specific tasks with consistent improvements across LLM families and SFT datasets. |
ByteSized32: A Corpus and Challenge Task for Generating Task-Specific World Models Expressed as Text Games (2023.emnlp-main)
Copied to clipboard
| Challenge: | We show that language models can generate explicit, interpretable, and interactive world models of scientific and common-sense reasoning tasks. |
| Approach: | They propose a corpus of 32 reasoning-focused text games expressed as hundreds of lines of Python code to facilitate this task. |
| Outcome: | The proposed games can generate runnable games on unseen topics in 28% of cases. |
QUDSELECT: Selective Decoding for Questions Under Discussion Parsing (2024.emnlp-main)
Copied to clipboard
| Challenge: | Question Under Discussion (QUD) uses implicit questions to reveal discourse relationships between sentences. |
| Approach: | They propose a framework that selectively decodes the QUD dependency structures considering the QUC criteria. |
| Outcome: | The proposed framework outperforms the state-of-the-art baseline models by 9% in human evaluation and 4% in automatic evaluation. |
Natural Language Video Localization with Learnable Moment Proposals (2021.emnlp-main)
Copied to clipboard
| Challenge: | Existing methods for video moment localization have poor performance due to predefined rules. |
| Approach: | They propose a model with a fixed set of learnable moment proposals with 'border-aware loss' they propose to localize the video moment corresponding to the query by locating the start and end timestamps in an untrimmed video. |
| Outcome: | The proposed model outperforms state-of-the-art models on two challenging benchmarks. |
Video Question Answering: Datasets, Algorithms and Challenges (2022.emnlp-main)
Copied to clipboard
| Challenge: | Recent advances in video question answering have led to a surge in popularity . despite the popularity, VideoQA remains one of the greatest challenges . |
| Approach: | They categorize the video question-answer datasets into normal VideoQA, multi-modal VideoQA and knowledge-based VideoQA according to the modalities invoked in the question-announcement pairs. |
| Outcome: | The proposed methods are mainly designed for Factoid QA and inference VideoQA . the proposed methods have been compared with other methods and are robust and interpretable. |
Exploring Label Hierarchy in a Generative Way for Hierarchical Text Classification (2022.coling-1)
Copied to clipboard
| Challenge: | Existing methods for hierarchical text classification are lacking in the field of natural language processing. |
| Approach: | They propose a hierarchy-aware T5 model with path-adaptive attention mechanism to exploit hierarchical dependency across different levels. |
| Outcome: | The proposed model outperforms state-of-the-art models especially in Macro-F1 and low Macro. |
Dual Context-Guided Continuous Prompt Tuning for Few-Shot Learning (2022.findings-acl)
Copied to clipboard
| Challenge: | Existing prompt-based paradigms have shown their competitive performance in many NLP tasks, but their effectiveness varies upon the model and training data. |
| Approach: | They propose a dual context-guided continuous prompt tuning method that integrates contextual information into the input input. |
| Outcome: | The proposed method outperforms existing prompt tuning methods in the few-shot setting and can be used in many NLP tasks. |
SciCustom: A Framework for Custom Evaluation of Scientific Capabilities in Large Language Models (2026.acl-long)
Copied to clipboard
Yiyang Gu, Junwei Yang, Junyu Luo, Ye Yuan, Bin Feng, Yingce Xia, Shufang Xie, Kaili Liu, Bohan Wu, Qi Shi, Haoran Li, Beier Xiao, Zhiping Xiao, Xiao Luo, Weizhi Zhang, Philip S. Yu, Zequn Liu, Ming Zhang
| Challenge: | Existing evaluations of large language models fail to reflect fine-grained capabilities . existing benchmarks are manually curated or domain-generic, limiting scalability and alignment with real use cases. |
| Approach: | They propose a framework that allows custom construction of benchmarks from large-scale scientific data to evaluate application-specific scientific capabilities in LLMs. |
| Outcome: | The proposed framework reveals fine-grained differences in scientific capabilities that standard benchmarks overlook . it allows custom construction of benchmarks from large-scale scientific data to evaluate application-specific capabilities in LLMs. |
Aspect Sentiment Classification with Document-level Sentiment Preference Modeling (2020.acl-main)
Copied to clipboard
| Challenge: | Existing studies consider Aspect Sentiment Classification (ASC) as an independent sentence-level classification problem aspect by aspect. |
| Approach: | They propose a Cooperative Graph Attention Networks approach for cooperatively learning aspect-related sentence representation. |
| Outcome: | The proposed approach outperforms the state-of-the-art methods in document-level sentiment classification. |
Not All Directions Matter: Towards Structured and Task-Aware Low-Rank Model Adaptation (2026.acl-long)
Copied to clipboard
Xi Xiao, Chenrui Ma, Yunbei Zhang, Chen Liu, Zhuxuanzi Wang, Yanshu Li, Lin Zhao, Guosheng Hu, Tianyang Wang, Hao Xu
| Challenge: | Low-Rank Adaptation (LoRA) is a key parameter-efficient fine-tuning method . however, its effectiveness is hampered by semantic drift and structural incoherence . |
| Approach: | They propose a low-rank Adaptation framework that tackles semantic drift and structural incoherence by pruning task-irrelevant directions. |
| Outcome: | Experiments on large language models, vision models, and vision models show that the proposed framework outperforms LoRA and advanced dynamic rank allocation and sparsity-based methods. |
Multi-Modal Entities Matter: Benchmarking Multi-Modal Entity Alignment (2025.coling-main)
Copied to clipboard
| Challenge: | Existing MMEA datasets consider multi-modal data as attributes of textual entities, neglecting correlations between the multi-modal data. |
| Approach: | They propose a multi-modal entity alignment dataset that models multi-dimensional data as textual entities in the MMKG. |
| Outcome: | The proposed dataset can learn the structural information of entities by considering both intra-modal and cross-modal relations and infer the similarity of different types of entity pairs. |
Reinforcement Learning for Large Language Models via Group Preference Reward Shaping (2025.emnlp-main)
Copied to clipboard
Huaisheng Zhu, Siyuan Xu, Hangfan Zhang, Teng Xiao, Zhimeng Guo, Shijie Zhou, Shuyue Hu, Vasant G. Honavar
| Challenge: | Existing methods for fine-tuning Large Language Models (LLMs) are expensive and sensitive to reward model quality. |
| Approach: | They propose a method that leverages preference-based comparisons rather than precise numerical rewards. |
| Outcome: | Experiments show that GPRS outperforms critic-model-free RL algorithms on RLHF and reasoning tasks. |
AdaLoGN: Adaptive Logic Graph Network for Reasoning-Based Machine Reading Comprehension (2022.acl-long)
Copied to clipboard
| Challenge: | Existing methods and limitations for machine reading comprehension are insufficient for logical reasoning over text. |
| Approach: | They propose a neural-symbolic approach which passes messages over a graph representing logical relations between text units to predict an answer. |
| Outcome: | The proposed approach outperforms existing methods on ReClor and LogiQA. |
Improving Autoregressive Grammatical Error Correction with Non-autoregressive Models (2023.findings-acl)
Copied to clipboard
| Challenge: | Autoregressive models assign low probabilities to tokens that need corrections . grammatical error correction (GEC) is widely applied to natural language processing tasks . |
| Approach: | They propose to use a non-autoregressive model as an auxiliary model to train GEC models to correct grammatical errors in sentences. |
| Outcome: | The proposed method outperforms baselines on English and Chinese GEC tasks significantly. |
A Syntactically Constrained Bidirectional-Asynchronous Approach for Emotional Conversation Generation (D18-1)
Copied to clipboard
| Challenge: | Existing neural language models generate generic responses with poor logic and no emotion. |
| Approach: | They propose a syntactically constrained bidirectional-asynchronous approach for emotional conversation generation using pre-generated emotion keywords and topic keywords. |
| Outcome: | The proposed approach improves the diversity of responses and boosts logic and emotion compared with baselines. |
Astra: Activation-Space Tail-Eigenvector Low-Rank Adaptation of Large Language Models (2026.findings-acl)
Copied to clipboard
| Challenge: | Existing methods for fine-tuning pre-trained models are limited due to suboptimal activation subspaces. |
| Approach: | They propose a method that leverages tail eigenvectors of model output activations to construct low-rank adapters. |
| Outcome: | The proposed method outperforms existing methods across 16 benchmarks and surpasses full fine-tuning in certain scenarios. |
Syntactic and Semantic-driven Learning for Open Information Extraction (2020.findings-emnlp)
Copied to clipboard
| Challenge: | Experimental results show that our approach significantly outperforms the supervised counterparts, and can even achieve competitive performance to supervised state-of-the-art (SoA) model. |
| Approach: | They propose a syntactic and semantic-driven learning approach that can learn open IE models without human-labelled data by leveraging syntakic and semantic knowledge as noisier, higher-level supervision. |
| Outcome: | The proposed approach outperforms supervised counterparts and can achieve competitive performance to supervised state-of-the-art models. |
PsyMem: Fine-grained Psychological Alignment and Explicit Memory Control for Advanced Role-Playing LLMs (2026.tacl-1)
Copied to clipboard
| Challenge: | Existing role-playing models rely on superficial textual descriptions or simplistic metrics, inadequately modeling both intrinsic and extrinsic character dimensions. |
| Approach: | They propose a framework that integrates fine-grained psychological attributes and explicit memory control for role-playing. |
| Outcome: | The proposed framework outperforms baseline models in human-likeness and character fidelity. |
AGRank: Augmented Graph-based Unsupervised Keyphrase Extraction (2022.aacl-main)
Copied to clipboard
| Challenge: | Unsupervised keyphrase extraction (UKE) is highly anticipated because no labeled data is needed to train a model. |
| Approach: | They propose an augmented graph-based unsupervised model to identify keyphrases from a document by integrating graph and deep learning methods. |
| Outcome: | The proposed model is effective and robust for long and short documents. |
LIONs: An Empirically Optimized Approach to Align Language Models (2024.emnlp-main)
Copied to clipboard
| Challenge: | Recent studies have focused on aligning large language models with pre-trained datasets. |
| Approach: | They conduct a rigorous analysis of a three-stage training pipeline using sequence packing, loss masking and increasing the preference dataset size in DPO to improve the performance of language models. |
| Outcome: | The proposed models outperform the official instruct models tuned with closed-source data and algorithms. |
RiTeK: A Dataset for Large Language Models Complex Reasoning over Textual Knowledge Graphs in Medicine (2026.findings-acl)
Copied to clipboard
Jiatan Huang, Mingchen Li, Zonghai Yao, Dawei Li, Yuxin Zhang, Zhichao Yang, Yongkang Xiao, Feiyun Ouyang, Xiaohan Li, Shuo Han, Hong yu
| Challenge: | Existing methods for retrieving medical textual knowledge Graphs struggle to perform well, a study finds . existing methods struggle to provide accurate answers to complex questions, he says . |
| Approach: | They synthesize user queries integrating diverse topological structures, relational information, and complex textual descriptions. |
| Outcome: | a new dataset for medical textual knowledge graphs shows that existing methods struggle to perform well . main bottlenecks lie in the scarcity of existing medical TKGs and the limited expressiveness of their topological structures . |
Identifying Tension in Holocaust Survivors’ Interview: Code-switching/Code-mixing as Cues (2022.lrec-1)
Copied to clipboard
| Challenge: | Using CS/CM as a linguistic phenomenon could be a sign of tension in Holocaust survivors’ interviews. |
| Approach: | They annotated CS/CM codes and annotate silence situations in an open corpus . they found that most annotations were captured in the tension places . |
| Outcome: | The proposed method shows that annotations are captured in the tension places . the study calls for more research endeavors on tension detection . |
Curse of Knowledge: Your Guidance and Provided Knowledge are biasing LLM Judges in Complex Evaluation (2025.findings-emnlp)
Copied to clipboard
| Challenge: | a recent study has focused on simple settings, but their reliability in complex tasks remains understudied. |
| Approach: | They propose to use large language models as judges to evaluate reliability in complex tasks . they use a challenge benchmark to expose and quantify Auxiliary Information Induced Biases . |
| Outcome: | The proposed benchmark exposes and quantifies Auxiliary Information Induced Biases across 12 basic and 3 advanced scenarios. |
Mnemis: Dual-Route Retrieval on Hierarchical Graphs for Long-Term LLM Memory (2026.acl-long)
Copied to clipboard
Zihao Tang, Xin Yu, Ziyu Xiao, Zengxuan Wen, Zelin Li, Jiaxi Zhou, Hualei Wang, Haohua Wang, Haizhen Huang, Weiwei Deng, Feng Sun, Qi Zhang
| Challenge: | Existing methods for retrieving historical messages are based on similarity-based mechanisms. |
| Approach: | They propose a system that integrates System-1 similarity search with a complementary System-2 mechanism, termed Global Selection. |
| Outcome: | The proposed framework achieves state-of-the-art on long-term memory benchmarks and 93.9 on LoCoMo and 91.6 on LongMemEval-S. |
Evaluating Evaluation Metrics: A Framework for Analyzing NLG Evaluation Metrics using Measurement Theory (2023.emnlp-main)
Copied to clipboard
| Challenge: | Existing evaluation metrics are conflated and can mislead models, resulting in downstream harms. |
| Approach: | They propose a framework for conceptualizing and evaluating the reliability and validity of evaluation metrics based on empirical data. |
| Outcome: | The proposed framework formalizes the source of measurement error and offers statistical tools for evaluating evaluation metrics based on empirical data. |
REVEALER: Reinforcement-Guided Visual Reasoning for Element-Level Text-Image Alignment Evaluation (2026.acl-long)
Copied to clipboard
| Challenge: | Existing methods for text-to-image alignment evaluation rely on coarse-grained metrics or static Question Answering pipelines that lack fine-grounded interpretability and struggle to reflect human preferences. |
| Approach: | They propose a reinforcement-guided visual reasoning framework for element-level text-to-image alignment evaluation. |
| Outcome: | The proposed framework achieves state-of-the-art results on four benchmarks and surpasses the strong proprietary Gemini 3 Pro and Training-based baselines. |
InCharacter: Evaluating Personality Fidelity in Role-Playing Agents through Psychological Interviews (2024.acl-long)
Copied to clipboard
Xintao Wang, Yunze Xiao, Jen-tse Huang, Siyu Yuan, Rui Xu, Haoran Guo, Quan Tu, Yaying Fei, Ziang Leng, Wei Wang, Jiangjie Chen, Cheng Li, Yanghua Xiao
| Challenge: | Existing methods focus on knowledge and linguistic patterns of characters. |
| Approach: | They propose to evaluate character fidelity of role-playing agents with psychological scales . they propose to use psychological scale to measure personality traits of RPAs based on personality traits. |
| Outcome: | The proposed model reproduces character fidelity with psychological scales and shows that it is effective in measuring personality traits. |
From Complex to Simple: Enhancing Multi-Constraint Complex Instruction Following Ability of Large Language Models (2024.findings-emnlp)
Copied to clipboard
| Challenge: | Large language models (LLMs) follow instructions with elaborate requirements, yet it remains under-explored how to enhance their ability to follow complex instructions with multiple constraints. |
| Approach: | They propose a method to obtain and utilize effective training data to enhance LLMs' ability to follow complex instructions with multiple constraints. |
| Outcome: | The proposed framework improves models' ability to follow instructions generally and generalize effectively across out-of-domain, in domain, and adversarial settings while maintaining general capabilities. |
IELM: An Open Information Extraction Benchmark for Pre-Trained Language Models (2022.emnlp-main)
Copied to clipboard
| Challenge: | Recent studies show pre-trained LMs store linguistic and relational knowledge . pre-training LM models can answer "fill-in-the-blank" questions based on pre-defined relations . |
| Approach: | They propose an open information extraction benchmark for pre-trained language models . they turn pre-trained LMs into zero-shot OIE systems to examine open relational information . |
| Outcome: | The proposed benchmark outperforms state-of-the-art methods on factual OIE datasets without training sets. |
Plug-and-Play Knowledge Injection for Pre-trained Language Models (2023.acl-long)
Copied to clipboard
Zhengyan Zhang, Zhiyuan Zeng, Yankai Lin, Huadong Wang, Deming Ye, Chaojun Xiao, Xu Han, Zhiyuan Liu, Peng Li, Maosong Sun, Jie Zhou
| Challenge: | Existing knowledge injection methods are not suitable for enhancing pre-trained language models with external knowledge bases. |
| Approach: | They propose a plug-and-play knowledge injection method where knowledge bases are injected into frozen existing downstream models by a knowledge plugin. |
| Outcome: | The proposed method improves the performance of knowledge injection on knowledge-driven tasks while keeping model parameters frozen. |
Attribute or Abstain: Large Language Models as Long Document Assistants (2024.emnlp-main)
Copied to clipboard
| Challenge: | Existing approaches to attribution have only been evaluated in RAG settings, where initial retrieval confounds performance. |
| Approach: | They propose to use a benchmark to evaluate attribution on long document tasks . they find that citations and additional retrieval perform best for large models . |
| Outcome: | The proposed approach performs best on large and fine-tuned models, while additional retrieval can help for small, prompted models. |
Neighborhood Matching Network for Entity Alignment (2020.acl-main)
Copied to clipboard
| Challenge: | Structural heterogeneity between knowledge graphs is an outstanding challenge for entity alignment. |
| Approach: | They propose a framework for entity alignment that uses a neighborhood matching module to combine neighborhood differences. |
| Outcome: | The proposed framework outperforms existing methods on three datasets. |
PACE: Predictive Adaptive Context Extraction for Long-Horizon LLM Agents (2026.acl-long)
Copied to clipboard
Lei Wei, Xiao Peng, null Tt, Guannan Zhang, Chenhao Jiang, Hongyu Li, Lanbo Lin, Yuanwu Xu, Jiayao Liu, Kesu Wang, Bin Wang
| Challenge: | Large Language Model (LLM) agents struggle with ultra-long-horizon tasks requiring hundreds or thousands of interaction steps. |
| Approach: | They propose a framework that reconceptualizes context management as a Next Step Prediction problem. |
| Outcome: | The proposed framework improves task success rates and robust cross-lingual performance. |
UI-Copilot: Advancing Long-Horizon GUI Automation via Tool-Integrated Policy Optimization (2026.acl-long)
Copied to clipboard
Zhengxi Lu, Fei Tang, Guangyi Liu, Jin Ma, Kaitao Song, Xu Tan, Wenqi Zhang, Weiming Lu, Jun Xiao, Yueting Zhuang, Yongliang Shen
| Challenge: | Experimental results show that UI-Copilot-7B achieves state-of-the-art performance on challenging MemGUI-Bench, outperforming strong 7B-scale GUI agents such as GUI-Owl-7B and UITARS-1.5-7B. |
| Approach: | They propose a collaborative framework where the GUI agent focuses on task execution while a lightweight copilot provides on-demand assistance for memory retrieval and numerical computation. |
| Outcome: | The proposed framework outperforms GUI-Owl-7B and UI-TARS-1.5-7B on MemGUI-Bench and delivers 17.1% improvement on AndroidWorld over the base Qwen model. |
AndroidLab: Training and Systematic Benchmarking of Android Autonomous Agents (2025.acl-long)
Copied to clipboard
Yifan Xu, Xiao Liu, Xueqiao Sun, Siyi Cheng, Hao Yu, Hanyu Lai, Shudan Zhang, Dan Zhang, Jie Tang, Yuxiao Dong
| Challenge: | Existing studies on Android agents lack systematic research on open-source and closed-source models. |
| Approach: | They propose a framework for Android agents that includes an operation environment and a reproducible benchmark. |
| Outcome: | The proposed framework lifts the success rate of open-source LLMs and LMMs from 4.59% to 21.50% for LLM and 1.93% to 13.28% for LMM. |
A Semantically Consistent and Syntactically Variational Encoder-Decoder Framework for Paraphrase Generation (2020.coling-main)
Copied to clipboard
| Challenge: | Paraphrase generation is a longstanding problem in natural language processing (NLP) Neural network-based methods have shown great progress on paraphrase generation. |
| Approach: | They propose a framework that integrates variational inference on a target-related latent variable to introduce the diversity. |
| Outcome: | The proposed framework outperforms baseline models on the metrics based on n-gram matching and semantic similarity, and it can generate multiple different paraphrases by assembling different syntactic variables. |
Representation-Guided Parameter-Efficient LLM Unlearning (2026.findings-acl)
Copied to clipboard
| Challenge: | Existing methods to unlearning large language models often memorize sensitive or harmful information, but they struggle with the forget-retain trade-off due to the polysemantic nature of LLMs parameters. |
| Approach: | They propose a representation-guided low-rank unlearning approach that leverages the geometric properties of representation spaces to achieve robust and precise unlearning. |
| Outcome: | The proposed approach outperforms state-of-the-art models on TOFU and WMDP benchmarks while maintaining higher model utility. |
SeqAR: Jailbreak LLMs with Sequential Auto-Generated Characters (2025.naacl-long)
Copied to clipboard
| Challenge: | Existing studies have focused on the potential misuse of large language models (LLMs) however, the ability to align LLMs with human values is still vulnerable to malicious attacks. |
| Approach: | They propose a red-teaming strategy to enhance LLM safety by using a framework to design jailbreak prompts automatically. |
| Outcome: | The proposed framework achieves attack success rates of 88% and 60% in cold-start scenarios. |
Rethinking the Alignment of Psychotherapy Dialogue Generation with Motivational Interviewing Strategies (2025.coling-main)
Copied to clipboard
| Challenge: | Motivational interviewing (MI) is a client-centered counseling technique that encourages individuals to change behaviors through emphatic conversations. |
| Approach: | They propose to use large language models to generate more controllable dialogues with explainability by prompting LLMs to predict appropriate strategies as reasoning and utilizing these strategies to guide dialogue generation. |
| Outcome: | The proposed model generates more controllable and explainable dialogues with a set of MI skills. |
LongWeave: A Long-Form Generation Benchmark Bridging Real-World Relevance and Verifiability (2025.findings-emnlp)
Copied to clipboard
Zikai Xiao, Fei Huang, Jianhong Tu, Jianhui Wei, Wen Ma, Yuxuan Zhou, Jian Wu, Bowen Yu, Zuozhu Liu, Junyang Lin
| Challenge: | Existing benchmarks for long-form generation assess real-world queries with hard-to-verify metrics or use synthetic setups that overlook real-life intricacies. |
| Approach: | They propose a new approach that balances verifiable and real-world assessment with Target-Anchored Evaluation. |
| Outcome: | The proposed model balances real-world and verifiable assessment with Target-Anchored Evaluation (TAE) it generates queries, textual materials, and anchors based on verifier targets within real-life scenarios . |
Utility-Oriented Visual Evidence Selection for Multimodal Retrieval-Augmented Generation (2026.acl-long)
Copied to clipboard
| Challenge: | Existing methods for multimodal retrieval-augmented generation rely on semantic relevance or surface-level similarity, which are often misaligned with the actual utility of visual evidence for downstream reasoning. |
| Approach: | They propose a latent notion of evidence usefulness and propose 'surrogate-accelerated' framework that efficiently estimates evidence utility using lightweight multimodal models. |
| Outcome: | The proposed framework outperforms state-of-the-art models while achieving substantial reductions in computational cost. |
Beyond Transcription: Unified Audio Schema for Perception-Aware AudioLLMs (2026.findings-acl)
Copied to clipboard
Linhao Zhang, Yuhan Song, Aiwei Liu, Chuhan Wu, Sijun Zhang, Wei Jia, Yuan Liu, Houfeng Wang, Zhou Xiao
| Challenge: | Recent Audio Large Language Models (AudioLLMs) excel at reasoning tasks, but struggle at elementary auditory perception. |
| Approach: | They propose a framework that organizes audio information into three explicit components in a unified JSON format. |
| Outcome: | The proposed framework boosts fine-grained perception by 10.9% on MMSU over state-of-the-art models while preserving robust reasoning capabilities. |
Improved Knowledge Distillation for Pre-trained Language Models via Knowledge Selection (2022.findings-emnlp)
Copied to clipboard
| Challenge: | Existing studies on knowledge distillation have shown that not all knowledge is necessary for learning a good student model. |
| Approach: | They propose an actor-critic approach to selecting appropriate knowledge to transfer during the process of knowledge distillation. |
| Outcome: | The proposed method outperforms several strong knowledge distillation baselines significantly on the GLUE datasets. |
Faux Polyglot: A Study on Information Disparity in Multilingual Large Language Models (2025.naacl-long)
Copied to clipboard
| Challenge: | Recent surge in multilingual large language models (LLMs) and Retrieval Augmented Generation (RAG) has significantly expanded conversational search across varied linguistic and cultural demographics. |
| Approach: | They found that LLMs displayed systemic bias towards information in the same language as query language in document retrieval and answer generation. |
| Outcome: | The results highlight the linguistic divide within multilingual LLMs in information search systems. |
GeoAgent: To Empower LLMs using Geospatial Tools for Address Standardization (2024.findings-acl)
Copied to clipboard
| Challenge: | Existing approaches to address address standardization are lacking in the current field. |
| Approach: | They propose a framework that incorporates spatial knowledge into address texts and achieves efficient address standardization. |
| Outcome: | The proposed framework incorporates spatial knowledge into address texts and achieves efficient address standardization. |
Language-Specific Layer Matters: Efficient Multilingual Enhancement for Large Vision-Language Models (2025.findings-emnlp)
Copied to clipboard
| Challenge: | Large vision-language models exhibit an imbalance in multilingual capabilities . |
| Approach: | They propose a training recipe that achieves efficient multilingual enhancement for LVLMs by Precise Language Specific layers fine-tuning. |
| Outcome: | The proposed training recipe achieves efficient multilingual enhancement for LVLMs by fine-tuning language specific layers. |
Empowering Backbone Models for Visual Text Generation with Input Granularity Control and Glyph-Aware Training (2024.emnlp-main)
Copied to clipboard
| Challenge: | Existing text-to-image models struggle to generate images with legible visual texts . current models lack support for Chinese texts, misspelling, and lack of diversity . |
| Approach: | They propose to empower backbone models to generate visual texts in Chinese and English . they propose to augment conventional training objective with glyph-aware training losses . |
| Outcome: | The proposed methods can generate visual texts in English and Chinese while maintaining image generation quality. |
Forgetting Curve: A Reliable Method for Evaluating Memorization Capability for Long-Context Models (2024.emnlp-main)
Copied to clipboard
Xinyu Liu, Runsong Zhao, Pengcheng Huang, Chunyang Xiao, Bei Li, Jingang Wang, Tong Xiao, JingBo Zhu
| Challenge: | Existing methods, tasks and benchmarks to measure model’s effective memory length are limited. |
| Approach: | They propose a method called forgetting curve to measure the memorization capability of long-context models. |
| Outcome: | The proposed method is robust to the tested corpus and experimental settings, and can be applied to any model size. |
Not All Citations Are Equal:Entropy-Guided Citation Selection for Noise-Resistant Medical LLM (2026.findings-acl)
Copied to clipboard
| Challenge: | Large language models have demonstrated extensive potential in medical applications . however, their practical deployment in healthcare faces significant challenges . |
| Approach: | They propose a training-free multi-turn reasoning framework and a post-training methodology that provides external knowledge support for large language models. |
| Outcome: | The proposed framework elicits internal thought, external thought, and fusion thought, with an entropy-based reward that encourages selective citation of beneficial external knowledge while penalizing noisy citations. |
Legal Judgment Prediction via Topological Learning (D18-1)
Copied to clipboard
| Challenge: | Existing studies focus on a specific subtask of judgment prediction and ignore the dependencies among subtasks. |
| Approach: | They propose a topological multi-task learning framework that incorporates multiple subtasks and DAG dependencies into judgment prediction. |
| Outcome: | The proposed model improves on baselines on all judgment prediction tasks. |
Multi-Channel Convolutional Neural Network for Twitter Emotion and Sentiment Recognition (N19-1)
Copied to clipboard
| Challenge: | Existing methods to analyze tweets are based on lexical features and a multi-channel convolutional neural architecture. |
| Approach: | They propose a neural network which can use different emotion and sentiment indicators such as hashtags, emoticons and emojis present in tweets to improve the performance of emotion and feelings identification. |
| Outcome: | The proposed model can use hashtags, emoticons and emojis present in tweets and improves emotion and sentiment identification. |
Skill Discovery for Software Scripting Automation via Offline Simulations with LLMs (2026.findings-eacl)
Copied to clipboard
Paiheng Xu, Gang Wu, Xiang Chen, Tong Yu, Chang Xiao, Franck Dernoncourt, Tianyi Zhou, Wei Ai, Viswanathan Swaminathan
| Challenge: | Large Language Models (LLMs) can generate code from natural language queries, but runtime code generation is limited due to unverified code, security risks, longer response times, and higher computational costs. |
| Approach: | They propose an offline simulation framework to curate a software-specific skillset by exploiting large language models and publicly available scripting guides. |
| Outcome: | The proposed framework significantly improves automation success rates, reduces response time, and saves runtime token costs compared to traditional runtime code generation. |
Hyperbolic Capsule Networks for Multi-Label Classification (2020.acl-main)
Copied to clipboard
| Challenge: | Existing methods for classification of labels are limited by feature aggregation and encoding. |
| Approach: | They propose to use hyperbolic capsule networks to capture fine-grained label information . they also propose a new routing method to adaptively adjust capsule number during routing . |
| Outcome: | The proposed method significantly improves the performance of multi-label classification on tail labels. |
World to Code: Multi-modal Data Generation via Self-Instructed Compositional Captioning and Filtering (2024.emnlp-main)
Copied to clipboard
| Challenge: | Recent advances in Vision-Language Models and the scarcity of high-quality multi-modal alignment data have inspired numerous researches on synthetic VLM data generation. |
| Approach: | They propose a multi-modal data construction pipeline that organizes the final output into a Python code format. |
| Outcome: | The proposed pipeline improves visual question answering and visual grounding benchmarks across different VLMs. |
Metaphor Reasoning is Meta-reasoning (2026.acl-long)
Copied to clipboard
Qianyu He, Junting Lu, Yikai Zhang, Siyu Yuan, Xiaojun Meng, Jiansheng Wei, Jiaqing Liang, Yanghua Xiao
| Challenge: | Existing work on metaphor reasoning's impact on reasoning abilities is limited. |
| Approach: | They propose a system for synthesizing metaphorical riddles that satisfy five quality dimensions: diverse, balanced, reasoning-oriented, challenging, and verifiable. |
| Outcome: | The proposed system improves reasoning abilities across six domains using only thousands of metaphorical riddles. |
Joint Document-Level Event Extraction via Token-Token Bidirectional Event Completed Graph (2023.acl-long)
Copied to clipboard
| Challenge: | a joint exaction method can be used to extract document-level event records . it avoids inefficiency and error propagation issues in traditional pipeline methods . |
| Approach: | They propose a joint exaction method that can avoid inefficiency and error propagation issues . they propose eType-Role1-Roul2 as the edge type to reveal which tokens play argument roles . |
| Outcome: | The proposed method can avoid inefficiency and error propagation issues in traditional pipeline methods. |
Saber: Efficient Sampling with Adaptive Acceleration and Backtracking Enhanced Remasking for Diffusion Language Model in Code Generation (2026.acl-long)
Copied to clipboard
| Challenge: | Diffusion language models (DLMs) offer advantages in parallel generation and bidirectional context modeling, but they face a critical trade-off between inference speed and output quality for tasks with strict structural constraints such as code generation. |
| Approach: | They propose an efficient sampling algorithm that reduces the number of tokens unmasked per step based on the model’s evolving confidence. |
| Outcome: | The proposed method improves Pass@1 accuracy by 1.9% while achieving 251.4% inference speedup. |
In-Context Learning with Long-Context Models: An In-Depth Exploration (2025.naacl-long)
Copied to clipboard
| Challenge: | In-context learning is limited by context length, but it can be used for many tasks. |
| Approach: | They study the behavior of in-context learning at an extreme context length . example retrieval shows excellent performance at low context lengths but has diminished gains . |
| Outcome: | The proposed model can perform many tasks with reasonable accuracy when a few examples are provided in-context. |
Multi-layer Representation Fusion for Neural Machine Translation (C18-1)
Copied to clipboard
| Challenge: | Neural machine translation systems require a number of stacked layers for deep models, but the prediction depends on the sentence representation of the top-most layer with no access to low-level representations. |
| Approach: | They propose a multi-layer representation fusion approach to fusing stacked layers to learn a better representation from the stack. |
| Outcome: | The proposed approach yields 0.92 and 0.56 BLEU points over the strong Transformer baseline on IWSLT German-English and NIST Chinese-English MT tasks respectively. |
Step-by-Step Mastery: Enhancing Soft Constraint Following Ability of Large Language Models (2025.findings-acl)
Copied to clipboard
| Challenge: | In real-world scenarios, user instructions often contain soft constraints, which are semantically related and cannot be rule-based verified, posing challenges for large language models. |
| Approach: | They propose a pipeline to construct datasets with high-quality outputs for instructions containing soft constraints automatically and use Direct Preference Optimization (DPO) as the training method. |
| Outcome: | The proposed model improves the LLMs' soft constraint following ability by using direct preference optimization (DPO) and constraint quantity. |
HEGEL: Hypergraph Transformer for Long Document Summarization (2022.emnlp-main)
Copied to clipboard
| Challenge: | Abstract: Extractive summarization for long documents is challenging due to the extended structured input context. |
| Approach: | They propose a hypergraph neural network for extractive summarization by capturing cross-sentence relations. |
| Outcome: | The proposed model can capture cross-sentence relations and latent topics and keywords coreference, and section structure, and can be applied to scientific papers. |
Predicting Entity Salience in Extremely Short Documents (2024.emnlp-industry)
Copied to clipboard
| Challenge: | False positive: ES is a natural language understanding task that determines which entities are most salient to a passage . Falsity: Popsicle, Frank Epperson and San Francisco are salient entities . |
| Approach: | They propose a lightweight and data-efficient approach for entity salience detection on short documents . they propose he use of a human-labeled dataset to evaluate entity salient on short questions . |
| Outcome: | The proposed approach achieves competitive performance over state-of-the-art models at significant cost and latency advantages. |
Detection of Propaganda Using Logistic Regression (D19-50)
Copied to clipboard
| Challenge: | Various propaganda techniques are used to manipulate peoples perspectives to foster a predetermined agenda. |
| Approach: | They propose a Logistic Regression-based tool that automatically classifies whether a sentence is propagandistic or not. |
| Outcome: | The proposed tool outperforms the baseline on linguistic and semantic features. |
Emotion Recognition in Multi-Speaker Conversations through Speaker Identification, Knowledge Distillation, and Hierarchical Fusion (2026.findings-eacl)
Copied to clipboard
| Challenge: | Emotion recognition in multi-speaker conversations faces significant challenges due to speaker ambiguity and severe class imbalance. |
| Approach: | They propose a speaker identification module that leverages audio-visual synchronization to accurately identify the active speaker and hierarchical attention fusion with composite loss functions to handle class imbalance. |
| Outcome: | The proposed framework achieves 67.75% and 72.44% weighted F1 scores on MELD and IEMOCAP datasets, with notable improvements on minority emotion classes. |
Task-Agnostic Detector for Insertion-Based Backdoor Attacks (2024.findings-naacl)
Copied to clipboard
| Challenge: | Existing methods for textual backdoor detection are task-specific and less effective beyond sentence classification. |
| Approach: | They propose a task-agnostic method for backdoor detection that leverages final layer logits and an efficient pooling technique. |
| Outcome: | TABDet can jointly learn from diverse task-specific models, demonstrating superior detection efficacy over traditional methods. |
A Unified Knowledge Graph Augmentation Service for Boosting Domain-specific NLP Tasks (2023.findings-acl)
Copied to clipboard
| Challenge: | Existing domain-specific pre-trained language models lack domain knowledge in domain-focused training. |
| Approach: | They propose a unified domain language model development service to inject domain knowledge into the PLM fine-tuning stage. |
| Outcome: | Experiments on domain-specific text classification and QA tasks verify the effectiveness and generalizability of KnowledgeDA. |
Fine-tuning Large Language Models for Improving Factuality in Legal Question Answering (2025.coling-main)
Copied to clipboard
| Challenge: | Hallucination remains a critical challenge in large language models (LLMs) in high-stake domains such as legal question answering. |
| Approach: | They propose a method to mitigate hallucination in legal question answering by using behavior cloning and a novel Hard Sample-aware Direct Preference Optimization. |
| Outcome: | The proposed method improves non-hallucinated Statute Rate, Statute Relevance Rate, Legal Claim Truthfulness, and traditional metrics. |
PrismRAG: Boosting RAG Factuality with Distractor Resilience and Strategized Reasoning (2025.emnlp-industry)
Copied to clipboard
Mohammad Kachuee, Teja Gollapudi, Minseok Kim, Yin Huang, Kai Sun, Xiao Yang, Jiaqi Wang, Nirav Shah, Yue Liu, Aaron Colak, Anuj Kumar, Wen-tau Yih, Xin Luna Dong
| Challenge: | Existing methods to improve factuality of large language models (LLMs) rely on human-engineered instructions. |
| Approach: | They propose a retrieval-augmented generation framework that trains the model with distractor-aware QA pairs mixing gold evidence with subtle distractor passages and instills reasoning-centric habits that make the LLM plan, rationalize, and synthesize without extensive human engineered instructions. |
| Outcome: | The proposed framework outperforms state-of-the-art solutions across 12 open-book RAG QA benchmarks and is being deployed in production. |
PLANET: Dynamic Content Planning in Autoregressive Transformers for Long-form Text Generation (2022.acl-long)
Copied to clipboard
| Challenge: | Existing methods for text generation still suffer from incoherence problems . Neural sequence-to-sequence (seq2sequ) models generate fluent results . |
| Approach: | They propose a novel generation framework that leverages autoregressive self-attention mechanism to conduct content planning and surface realization dynamically. |
| Outcome: | The proposed framework outperforms baseline models and generates more coherent texts with richer contents. |
Zero-Resource Hallucination Prevention for Large Language Models (2024.findings-emnlp)
Copied to clipboard
| Challenge: | Existing methods for detecting hallucinations post-generation suffer from inconsistent performance due to the influence of instruction format and model style. |
| Approach: | They propose a new technique that evaluates the model’s familiarity with the concepts present in the input instruction and withholding the generation of response in case of unfamiliar concepts under the zero-resource setting. |
| Outcome: | The proposed technique shows superior performance across four different large language models and demonstrates that it can be used to mitigate hallucinations in LLMs. |
Non-Autoregressive Translation by Learning Target Categorical Codes (2021.naacl-main)
Copied to clipboard
| Challenge: | Existing non-autoregressive text generation models still fall behind in translation quality . authors propose a model that learns implicitly categorical codes as latent variables . |
| Approach: | They propose a non-autoregressive Transformer model that implicitly categorizes latent variables into decoding . they find it improves translation quality by introducing more informative decoder inputs . |
| Outcome: | The proposed model achieves comparable or better performance in machine translation tasks than strong baselines. |
Natural Language to Code Generation in Interactive Data Science Notebooks (2023.acl-long)
Copied to clipboard
Pengcheng Yin, Wen-Ding Li, Kefan Xiao, Abhishek Rao, Yeming Wen, Kensen Shi, Joshua Howland, Paige Bailey, Michele Catasta, Henryk Michalewski, Oleksandr Polozov, Charles Sutton
| Challenge: | Data scientists use computational notebooks to perform data wrangling and analytic tasks. |
| Approach: | They build a benchmark program that synthesizes programs given NL intents from users by using a Python code language model. |
| Outcome: | The proposed model outperforms public code LMs in a dataset of 1078 code generation problems using the pandas data analysis framework in data science notebooks. |
Task-Related In-Context Learning (2026.findings-acl)
Copied to clipboard
| Challenge: | Standard in-context learning assumes identical output spaces between test and retrieval datasets . however, in practice, these datasets can be fully aligned, partially alignes, or fully disjoint in label space . |
| Approach: | They propose a framework for in-context learning under output-space mismatch . they identify demonstrations relevant to the test label space via a Bayesian probabilistic criterion . |
| Outcome: | The proposed framework achieves state-of-the-art results across three LLMs, three task types, and four datasets. |
Self-supervised Cross-modal Pretraining for Speech Emotion Recognition and Sentiment Analysis (2022.findings-emnlp)
Copied to clipboard
| Challenge: | Existing approaches to multimodal speech emotion recognition and sentiment analysis have not improved results due to their relatively simple fusion mechanisms and lack of proper cross-modal pretraining. |
| Approach: | They propose a deep-fused audio-text bi-modal transformer with carefully designed cross-modal fusion mechanism and stage-wise cross-mod pretraining scheme to facilitate cross-modulation. |
| Outcome: | The proposed method exceeds benchmarks on public IEMOCAP emotion and CMU-MOSEI sentiment datasets by a large margin. |
RouterHGC: Optimized Router for LLM-based Multi-Agent Systems via Heterogeneous Graph Contrastive Learning (2026.findings-acl)
Copied to clipboard
| Challenge: | Large Language Models (LLMs)-driven Multi-Agent Systems (MAS) have demonstrated remarkable scalability and generalizability across complex tasks. |
| Approach: | They propose a new framework for routing using large language models . they formalize routing as node selection through edge-weight prediction . |
| Outcome: | The proposed framework outperforms the best single LLM and baselines on five datasets . it achieves 0.80%–6.17% accuracy gains on MATH and HotpotQA while reducing inference cost by 27.40%. |
SgSum:Transforming Multi-document Summarization into Sub-graph Selection (2021.emnlp-main)
Copied to clipboard
| Challenge: | Existing extractive multi-document summarization methods score each sentence individually and extract salient sentences one by one. |
| Approach: | They propose a novel framework for extractive multi-document summarization that selects a sub-graph as the summary instead of selecting salient sentences. |
| Outcome: | The proposed framework improves on existing methods on multi-document datasets and human evaluations show it produces more coherent and informative summaries. |
InstructDiff: Domain-Adaptive Data Selection via Contrastive Entropy for Efficient LLM Fine-Tuning (2026.acl-long)
Copied to clipboard
| Challenge: | Existing data selection methods suffer from severe domain specificity . existing methods for general instruction-following fail on reasoning tasks . |
| Approach: | They propose a framework that operationalizes contrastive entropy as a domain-adaptive selection criterion through warmup calibration, bi-directional NLL filtering, and entropic-based ranking. |
| Outcome: | Experiments show that InstructDiff outperforms baseline training on reasoning tasks while using only 10% of the data. |
Dynamically Fused Graph Network for Multi-hop Reasoning (P19-1)
Copied to clipboard
| Challenge: | Text-based question answering (TBQA) has been studied extensively in recent years. |
| Approach: | They propose a Dynamically Fused Graph Network to answer questions requiring multiple scattered evidence and reasoning over them. |
| Outcome: | The proposed method achieves competitive results on a public TBQA dataset and produces interpretable reasoning chains. |
EfficientLLM: Unified Pruning-Aware Pretraining for Auto-Designed Compact Language Models (2026.acl-long)
Copied to clipboard
Xingrun Xing, Zheng Liu, Shitao Xiao, Boyan Gao, Yiming Liang, Haokun Lin, Xianlin Zeng, Guoqi Li, Jiajun Zhang
| Challenge: | Large language models (LLMs) driven by scaling laws can be developed in large model sizes. |
| Approach: | They propose a pruning-aware pretraining approach that decouples LLM pruning from direct pretraining. |
| Outcome: | The proposed model outperforms pretraining models with 100M 1B parameters in commen sense benchmarks. |
KERAG: Knowledge-Enhanced Retrieval-Augmented Generation for Advanced Question Answering (2025.findings-emnlp)
Copied to clipboard
| Challenge: | Traditional Knowledge Graph Question Answering (KGQA) methods rely on semantic parsing to retrieve knowledge strictly necessary for answer generation. |
| Approach: | They propose a retrieval-filtering-summarization pipeline that enhances QA coverage by retrieving a broader subgraph likely to contain relevant information. |
| Outcome: | The proposed pipeline surpasses state-of-the-art solutions by about 7% in quality and exceeds GPT-4o (Tool) by 10-21%. |
Chart2Code53: A Large-Scale Diverse and Complex Dataset for Enhancing Chart-to-Code Generation (2025.emnlp-main)
Copied to clipboard
Tianhao Niu, Yiming Cui, Baoxin Wang, Xiao Xu, Xin Yao, Qingfu Zhu, Dayong Wu, Shijin Wang, Wanxiang Che
| Challenge: | Existing Chart2code-related training datasets suffer from limited scale, limited type coverage, and inadequate complexity. |
| Approach: | They propose to synthesize chart2code-related training datasets using web plotting code and chart images to address these challenges. |
| Outcome: | The proposed dataset exhibits the greatest diversity and higher complexity compared to other open-source Chart2code related datasets. |
ANALOGYKB: Unlocking Analogical Reasoning of Language Models with A Million-scale Knowledge Base (2024.acl-long)
Copied to clipboard
| Challenge: | ANALOGYKB is a million-scale analogy knowledge base based on existing knowledge graphs (KGs) based upon relational knowledge triples, we can discover new analogies using the corresponding relations between concepts. |
| Approach: | They propose a million-scale analogy knowledge base derived from existing knowledge graphs (KGs) ANALOGYKB identifies analogies of the same relations and analogies from analogous relations . |
| Outcome: | The proposed model enables both smaller LMs and LLMs to gain better analogical reasoning capabilities. |
Joint Training of Candidate Extraction and Answer Selection for Reading Comprehension (P18-1)
Copied to clipboard
| Challenge: | Various advanced neural models have been proposed for reading comprehension, but most models ignore its relations with other answer candidates. |
| Approach: | They propose to model reading comprehension as an extract-then-select two-stage procedure . they first extract answer candidates from passages, then select the final answer by combining information from all candidates. |
| Outcome: | The proposed approach improves state-of-the-art performance on open-domain reading comprehension datasets. |
ViDove: A Translation Agent System with Multimodal Context and Memory-Augmented Reasoning (2025.emnlp-demos)
Copied to clipboard
Yichen Lu, Wei Dai, Jiaen Liu, Ching Wing Kwok, Zongheng Wu, Xudong Xiao, Ao Sun, Sheng Fu, Jianyuan Zhan, Yian Wang, Takatomo Saito, Sicheng Lai
| Challenge: | Recent advances in Large Language Models (LLMs) have demonstrated remarkable capabilities in Machine Translation (MT) tasks. |
| Approach: | They propose a translation agent system designed for multimodal input that leverages visual and contextual background information to enhance the translation process. |
| Outcome: | The proposed translation agent achieves significantly higher translation quality in subtitle generation and general translation tasks compared to previous state-of-the-art systems. |
Llama2Vec: Unsupervised Adaptation of Large Language Models for Dense Retrieval (2024.acl-long)
Copied to clipboard
| Challenge: | Dense retrieval requires discriminative embeddings to represent the semantic relationship between query and document. |
| Approach: | They propose an unsupervised approach that performs unsupervised adaptation of large language models for dense retrieval. |
| Outcome: | The proposed model improves on a variety of dense retrieval benchmarks and is available on github. |
Physician Detection of Clinical Harm in Machine Translation: Quality Estimation Aids in Reliance and Backtranslation Identifies Critical Errors (2023.emnlp-main)
Copied to clipboard
| Challenge: | a major challenge in the practical use of Machine Translation (MT) is that users lack information on translation quality to make informed decisions about how to rely on outputs. |
| Approach: | They evaluate quality estimation feedback in vivo with a human study in a medical setting. |
| Outcome: | The proposed method improves appropriate reliance on MT, but backtranslation helps detect harmful errors. |
Dynosaur: A Dynamic Growth Paradigm for Instruction-Tuning Data Curation (2023.emnlp-main)
Copied to clipboard
| Challenge: | Existing methods for instruction tuning do not include associating instructions with existing datasets. |
| Approach: | They propose a dynamic growth paradigm for the automatic curation of instruction-tuning data . they use existing datasets to automatically construct instruction-uning datasets . |
| Outcome: | The proposed model reduces the API cost for generating instructions and provides high-quality data. |
SentiX: A Sentiment-Aware Pre-Trained Model for Cross-Domain Sentiment Analysis (2020.coling-main)
Copied to clipboard
| Challenge: | Pre-trained language models have been widely applied to cross-domain NLP tasks like sentiment analysis, but fine-tuning them on the source domain tends to overfit, leading to inferior results on the target domain. |
| Approach: | They propose to pre-train a sentiment-aware language model (SentiX) via domain-invariant sentiment knowledge from large-scale review datasets and utilize it for cross-domain sentiment analysis tasks without fine-tuning. |
| Outcome: | The proposed model achieves state-of-the-art in all the cross-domain sentiment analysis tasks and can be trained with only 1% samples and better than BERT with 90% samples. |
Effective Contrastive Weighting for Dense Query Expansion (2023.acl-long)
Copied to clipboard
| Challenge: | Verbatim queries that do not adequately express the user's search intent are often lexical inadequacies. |
| Approach: | They propose a contrastive weighting model that learns to select the most useful expansion embeddings for semantic search. |
| Outcome: | The proposed model outperforms existing methods while maintaining its efficiency. |
Divide and Conquer: Legal Concept-guided Criminal Court View Generation (2024.findings-emnlp)
Copied to clipboard
| Challenge: | Existing methods for creating rationales for criminal cases do not pay enough attention to the important legal concepts. |
| Approach: | They propose a legal concept-guided court view generation framework that generates rationales based on predicted legal concepts . they first divide the court view into sub-views, then employ a solver and verifier to generate and select rationale. |
| Outcome: | The proposed model generates coherent and coherent court views on a real-world criminal case dataset. |
Multi-Task Label Embedding for Text Classification (D18-1)
Copied to clipboard
| Challenge: | Existing work treats labels of each task as independent and meaningless one-hot vectors, which cause a loss of potential label information. |
| Approach: | They propose to combine multi-task learning with semantic vectors to convert labels into vectors . their results are based on extensive experiments on five benchmark datasets based in chinese . |
| Outcome: | The proposed model can improve performance on five benchmark datasets on text classification tasks. |
BFS-Prover: Scalable Best-First Tree Search for LLM-based Automatic Theorem Proving (2025.acl-long)
Copied to clipboard
| Challenge: | Existing approaches to theorem proving in large language models rely on value functions and/or Monte Carlo Tree Search (MCTS), but the potential of simpler methods like Best-First Tree Search remains underexplored. |
| Approach: | They propose a scalable expert iteration framework that implements strategic data filtering at each expert iteration round, excluding problems solvable via beam search node expansion to focus on harder cases. |
| Outcome: | The proposed framework achieves a state-of-the-art score of 72.95 on the MiniF2F test set and challenges the perceived necessity of complex tree search methods. |
Word-Conditioned 3D American Sign Language Motion Generation (2024.findings-emnlp)
Copied to clipboard
| Challenge: | Sign words are the building blocks of any sign language. |
| Approach: | They propose a word-conditioned 3D American Sign Language (ASL) generation model that synthesizes real-time motion sequences for sign words. |
| Outcome: | The proposed model outperforms the baseline model in the task of sign word generation. |
Tree Representations in Transition System for RST Parsing (2020.coling-main)
Copied to clipboard
| Challenge: | Existing studies have proposed a series of actions to build a right-heavy binarized tree for RST parsing, but the nodes of the binary-nuclear relations have the same nuclear type as those of the multi-nullar relations. |
| Approach: | They propose a nuclear type for multi-nuclear relations and a new action to construct a multi-branch tree. |
| Outcome: | The proposed nuclear type and action are more capable of capturing multi-nuclear relation and the joint action is more suitable than the separate one. |
Natural Logic at the Core: Dynamic Rewards for Entailment Tree Generation (2025.findings-acl)
Copied to clipboard
| Challenge: | Existing approaches to generating entailment trees lack logical consistency . static reward structures or intricate dependencies within multi-step reasoning are often ignored . |
| Approach: | They propose a method that integrates natural logic principles into reinforcement learning to guide entailment tree generation. |
| Outcome: | Experiments on EntailmentBank show that the proposed method improves interpretability and generalization. |
How Do Large Language Models Perform in Dynamical System Modeling (2025.findings-naacl)
Copied to clipboard
| Challenge: | Recent data-driven methods often use graph neural networks (GNNs) to learn interactions between objects. |
| Approach: | They propose prompting techniques for dynamical system modeling and evaluate their performance . they find that large language models demonstrate competitive performance without training . |
| Outcome: | The proposed methods show competitive performance without training compared to state-of-the-art methods in dynamical system modeling. |
Bone Soups: A Seek-and-Soup Model Merging Approach for Controllable Multi-Objective Generation (2025.acl-long)
Copied to clipboard
| Challenge: | Existing approaches focus on merging language models tuned on single objectives . existing approaches ignore the impacts of competing objectives on model tuning . |
| Approach: | They propose a model merging approach that seeks a series of backbone models and merges them according to user preferences. |
| Outcome: | The proposed approach exhibits strong controllability and Pareto optimality in controllable multi-objective generation. |
Jailbreaking Prompt Attack: A Controllable Adversarial Attack against Diffusion Models (2025.findings-naacl)
Copied to clipboard
| Challenge: | Text-to-image (T2I) models can be used to generate harmful content such as sexually explicit, unfaithful, and misleading or Not-Safe-for-Work (NSFW) images. |
| Approach: | They propose a more practical and universal attack that does not require the presence of a target model. |
| Outcome: | The proposed attack bypasses both text and image safety checkers while preserving high semantic alignment with the target prompt. |
UCFE: A User-Centric Financial Expertise Benchmark for Large Language Models (2025.findings-naacl)
Copied to clipboard
Yuzhe Yang, Yifei Zhang, Yan Hu, Yilin Guo, Ruoli Gan, Yueru He, Mingcong Lei, Xiao Zhang, Haining Wang, Qianqian Xie, Jimin Huang, Honghai Yu, Benyou Wang
| Challenge: | Recent advances in large language models (LLMs) have expanded their potential applications in finance. |
| Approach: | They propose a framework to evaluate the ability of large language models to handle financial tasks using human expert evaluations and task-specific interactions. |
| Outcome: | The proposed framework evaluates the ability of large language models to handle complex financial tasks and combines human expert evaluations with dynamic, task-specific interactions to simulate the complexities of evolving financial scenarios. |
AutoGraph-R1: End-to-End Reinforcement Learning for Knowledge Graph Construction (2026.acl-long)
Copied to clipboard
Hong Ting Tsang, Jiaxin Bai, Haoyu Huang, Qiao Xiao, Tianshi Zheng, Baixuan Xu, Shujie Liu, Yangqiu Song
| Challenge: | Currently, knowledge graphs are decoupled from their downstream application, resulting in suboptimal graph structures. |
| Approach: | They propose a framework to directly optimize KG construction for task performance using Reinforcement Learning (RL). |
| Outcome: | The proposed framework improves performance across multiple QA benchmarks and consistently achieves significant performance gains over task-agnostic baseline graphs. |
LEAF: Large Language Diffusion Model for Time Series Forecasting (2025.findings-emnlp)
Copied to clipboard
| Challenge: | Recent work has applied large language models (LLMs) into time series forecasting, but they lack an understanding of holistic temporal patterns with potential error accumulation. |
| Approach: | They propose a framework that marries Larg e Langu age Diffusion Model with time series forecasting (LEAF) they propose converting time series into tokens and adopting language diffusion models to capture temporal dependencies. |
| Outcome: | The proposed framework generates future predictions with a diffusion model from a holistic view. |
Adaptive Layer Selection for Layer-Wise Token Pruning in LLM Inference (2026.findings-acl)
Copied to clipboard
| Challenge: | Large language models (LLMs) have demonstrated remarkable capabilities in processing long contexts. |
| Approach: | They propose a training-free method that adaptively chooses the selection layer for KV cache reduction . they exploit the variance of token ranks ordered by attention score to optimize decoding . |
| Outcome: | The proposed method outperforms state-of-the-art token pruning methods on InfiniteBench, RULER, and NIAH benchmarks. |
Combining Static Word Embeddings and Contextual Representations for Bilingual Lexicon Induction (2021.findings-acl)
Copied to clipboard
| Challenge: | Bilingual Lexicon Induction (BLI) aims to map words in one language to their translations in another. |
| Approach: | They propose a mechanism to combine static word embeddings and contextual representations to utilize the advantages of both paradigms. |
| Outcome: | The proposed method improves performance on supervised and unsupervised BLI benchmarks on all language pairs by average improving 3.2 points over baselines. |
MICO: Selective Search with Mutual Information Co-training (2022.coling-1)
Copied to clipboard
| Challenge: | Selective search is designed to reduce the latency and computation in modern large-scale search systems. |
| Approach: | They propose a mutual information CO-training framework for selective search with minimal supervision using the search logs. |
| Outcome: | The proposed framework outperforms existing competitive benchmarks on multiple metrics and significantly outperformed existing baselines. |
RecMem: Recurrence-based Memory Consolidation for Efficient and Effective Long-Running LLM Agents (2026.findings-acl)
Copied to clipboard
| Challenge: | Existing memory systems invoke LLMs to extract episodic and semantic memory, and this leads to substantial token consumption. |
| Approach: | They propose a method that stores incoming interactions in a subconscious memory layer and encodes them using lightweight embedding models for retrieval. |
| Outcome: | Experiments show that RecMem reduces the memory construction token cost of three SOTA memory systems by up to 87% while exceeding their accuracy. |
Tucker Decomposition with Frequency Attention for Temporal Knowledge Graph Completion (2023.findings-acl)
Copied to clipboard
| Challenge: | Existing models for temporal knowledge graph completion only consider the combination of one relation with one timestamp, ignoring the global nature of the embedding. |
| Approach: | They propose a temporal knowledge Graph Completion model that captures global temporal dependencies between one relation and the entire timestamp. |
| Outcome: | The proposed model outperforms the state-of-the-art models on three standard TKGC datasets on several metrics. |
HealMe: Harnessing Cognitive Reframing in Large Language Models for Psychotherapy (2024.acl-long)
Copied to clipboard
Mengxi Xiao, Qianqian Xie, Ziyan Kuang, Zhicheng Liu, Kailai Yang, Min Peng, Weiguang Han, Jimin Huang
| Challenge: | Large Language Models (LLMs) can be used in psychotherapy to overcome challenges such as shame, distrust, and resource scarcity. |
| Approach: | They propose a cognitive reframing therapy method that uses empathetic dialogue to address deep-rooted negative thoughts and fosters rational, balanced perspectives. |
| Outcome: | The proposed model outperforms other models in terms of empathy, guidance, and logical coherence, demonstrating its effectiveness and potential positive impact on psychotherapy. |
PartialFormer: Modeling Part Instead of Whole for Machine Translation (2024.findings-acl)
Copied to clipboard
| Challenge: | Existing feed-forward neural networks have significant computational and parametric overhead. |
| Approach: | They propose a parameter-efficient Transformer architecture that utilizes multiple smaller FFNs to reduce parameters and computation while maintaining essential hidden dimensions. |
| Outcome: | The proposed architecture reduces computational and parameter overhead while maintaining essential hidden dimensions. |
Personalized Abstractive Summarization by Tri-agent Generation Pipeline (2024.findings-eacl)
Copied to clipboard
| Challenge: | Existing research shows that large language models do not consistently satisfy users' preferences or expectations. |
| Approach: | They propose a tri-agent generation pipeline that includes a generator, an instructor, and an editor to enhance output personalization. |
| Outcome: | The proposed pipeline generates outputs that better meet user expectations on two abstractive summarization datasets. |
MDC-Bench: A Multidisciplinary Causal Benchmark Based on Causal Structures for Evaluating Large Language Models (2026.findings-acl)
Copied to clipboard
Peng Wang, Yuxiong Yan, Xiao Ding, Kai Xiong, Bibo Cai, Chao Peng, Yutai Hou, Dandan Tu, Bing Qin, Ting Liu
| Challenge: | Existing causal datasets focus on the commonsense domain, but LLMs perform poorly when answering complex questions. |
| Approach: | They propose a multidisciplinary causal evaluation benchmark to assess LLMs' knowledge and skills. |
| Outcome: | The proposed model improves in domain specialization, structural diversity, and task complexity. |
AgentReview: Exploring Peer Review Dynamics with LLM Agents (2024.emnlp-main)
Copied to clipboard
| Challenge: | Existing methods of peer review analysis do not address multivariate nature of the process, account for latent variables, and are constrained by privacy concerns due to the sensitive nature of data. |
| Approach: | They propose a large language model based peer review simulation framework which effectively disentangles the impacts of multiple latent factors and addresses the privacy issue. |
| Outcome: | The proposed framework disentangles the impacts of multiple latent factors and addresses privacy concerns. |
AIR-Bench: Automated Heterogeneous Information Retrieval Benchmark (2025.acl-long)
Copied to clipboard
| Challenge: | Evaluation benchmarks based on predefined domains and human-labeled data face limitations in addressing evaluation needs for emerging domains. |
| Approach: | They propose an automated information retrieval benchmark based on predefined domains and human-labeled data . AIR-Bench is automated and Heterogeneous with three key features . |
| Outcome: | The proposed benchmarks are based on predefined domains and human-labeled data. |
Learning Architectures from an Extended Search Space for Language Modeling (2020.acl-main)
Copied to clipboard
Yinqiao Li, Chi Hu, Yuhao Zhang, Nuo Xu, Yufan Jiang, Tong Xiao, Jingbo Zhu, Tongran Liu, Changliang Li
| Challenge: | Neural architecture search (NAS) has advanced in recent years but most NAS systems restrict search to learning architectures of a recurrent or convolutional cell. |
| Approach: | They propose a general approach to learn both intra-cell and inter-cell architectures . they implement their approach in a differentiable architecture search system . |
| Outcome: | The proposed approach outperforms the baseline on PTB and WikiText data and shows good transferability to other systems. |
Reinforcing Agentic Search Via Reward Density Optimization (2026.acl-long)
Copied to clipboard
| Challenge: | Reinforcement Learning with Verifiable Rewards (RLVR) is a promising approach for enhancing agentic search, but its performance is often hindered by reward sparsity . |
| Approach: | They propose a new research problem to improve the reward obtained per unit of exploration cost by using a system that decomposes long-horizon tasks into intermediate objectives and assigns process-level rewards to provide denser learning signals. |
| Outcome: | The proposed framework outperforms strong baselines on several agentic search benchmarks and achieves comparable performance to that of advanced proprietary models. |
Complex Hyperbolic Knowledge Graph Embeddings with Fast Fourier Transform (2022.emnlp-main)
Copied to clipboard
| Challenge: | Existing studies have shown that the choice of space for knowledge graph (KG) embeddings has significant effects on the performance of KG completion tasks. |
| Approach: | They propose to use the Fourier transform to convert between real and complex hyperbolic space to capture hierarchical patterns. |
| Outcome: | The proposed models outperform the baseline models for knowledge graph (KG) embeddings. |
Exploring Large Language Models for Effective Rumor Detection on Social Media (2025.naacl-long)
Copied to clipboard
| Challenge: | Large-scale contexts hinder LLMs’ reasoning abilities while moderate contexts perform better for LLM. |
| Approach: | They propose a semantic-propagation collaboration-base framework that integrates small language models with LLMs for effective rumor detection. |
| Outcome: | The proposed framework bridges the gap between LLMs and LLM in facing long, structured data and offers a novel solution for rumor detection on social media. |
PromptARA: Improving Deep Representation in Hybrid Automatic Readability Assessment with Prompt and Orthogonal Projection (2023.findings-emnlp)
Copied to clipboard
| Challenge: | Readability assessment aims to automatically classify texts based on readers’ reading levels. |
| Approach: | They propose a hybrid automatic readability assessment model using prompts to improve deep feature representations and an orthogonal projection layer to fuse both deep and linguistic features. |
| Outcome: | The proposed model outperforms state-of-the-art models over four English and two Chinese corpora and demonstrates that it is more efficient than existing models. |
Diagnosing the First-Order Logical Reasoning Ability Through LogicNLI (2021.emnlp-main)
Copied to clipboard
| Challenge: | Existing studies have focused on diagnosing LMs' reasoning abilities in natural language understanding tasks. |
| Approach: | They propose a diagnostic method for first-order logic reasoning with a proposed benchmark, LogicNLI. |
| Outcome: | The proposed method disentangles the target FOL reasoning from commonsense inference and can be used to diagnose LMs from four perspectives: accuracy, robustness, generalization, and interpretability. |
Self-Evolving GPT: A Lifelong Autonomous Experiential Learner (2024.acl-long)
Copied to clipboard
| Challenge: | Existing approaches to provide LLMs with textual task-solving experience rely on manual efforts to acquire and apply such experience for each task. |
| Approach: | They propose a lifelong autonomous experiential learning framework based on LLMs that learns and accumulates experience through experience transfer and induction. |
| Outcome: | The proposed framework performs reliably in each intermediate step and improves GPT-3.5 and GPT-4 on widely used NLP datasets. |
ToW: Thoughts of Words Improve Reasoning in Large Language Models (2025.naacl-long)
Copied to clipboard
Zhikun Xu, Ming Shen, Jacob Dineen, Zhaonan Li, Xiao Ye, Shijie Lu, Aswin Rrv, Chitta Baral, Ben Zhou
| Challenge: | Unlike other data augmentation methods, thoughts of words (TOW) views next-word prediction as a core reasoning task and injects fine-grained thoughts into pre-training texts. |
| Approach: | They propose a training-time data-augmentation method called thoughts of words (TOW) that injects fine-grained thoughts directly into a next-word prediction task and teaches the model to understand how the observed next word is related to previous contexts. |
| Outcome: | The proposed method reduces model hallucination by 10% and improves reasoning performance by 7% to 9% on average. |
Teaching Your Models to Understand Code via Focal Preference Alignment (2025.emnlp-main)
Copied to clipboard
Jie Wu, Haoling Li, Xin Zhang, Xiao Liu, Yangyu Huang, Jianwen Luo, Yizhen Zhang, Zuchao Li, Ruihang Chu, Yujiu Yang, Scarlett Li
| Challenge: | Existing methods for supervised fine-tuning focus on unit test feedback to construct preference pairs. |
| Approach: | They propose a preference alignment framework that mimics human iterative debugging to refine Code LLMs. |
| Outcome: | Experiments show that Preference Learning improves on BigCodeBench and BigCodeBind tasks. |
HAIC: Improving Human Action Understanding and Generation with Better Captions for Multi-modal Large Language Models (2025.acl-long)
Copied to clipboard
Xiao Wang, Jingyun Hua, Weihong Lin, Yuanxing Zhang, Fuzheng Zhang, Jianlong Wu, Di Zhang, Liqiang Nie
| Challenge: | Existing studies have shown that high-quality video captions can improve MLLMs' performance on videos involving human actions. |
| Approach: | They propose a data annotation pipeline to collect videos featuring clear human actions from the Internet and annotate them in a standardized caption format that uses human attributes to distinguish individuals. |
| Outcome: | The proposed pipeline combines two datasets to evaluate human action understanding. |
Parsing Natural Language into Propositional and First-Order Logic with Dual Reinforcement Learning (2022.coling-1)
Copied to clipboard
Xuantao Lu, Jingping Liu, Zhouhong Gu, Hanwen Tong, Chenhao Xie, Junyang Huang, Yanghua Xiao, Wenguang Wang
| Challenge: | Existing methods to parse natural language into structured logical expressions have limitations due to paucity of labeled data. |
| Approach: | They propose a scoring model to automatically learn a model-based reward . they also propose introducing a Chinese-PL/FOL dataset to compensate for paucity of labeled data . |
| Outcome: | The proposed model outperforms competitors on several datasets. |
Towards Long Context Hallucination Detection (2025.findings-naacl)
Copied to clipboard
Siyi Liu, Kishaloy Halder, Zheng Qi, Wei Xiao, Nikolaos Pappas, Phu Mon Htut, Neha Anna John, Yassine Benajiba, Dan Roth
| Challenge: | Large language models are prone to contextual hallucination, generating information that is either unsubstantiated or contradictory to the given context. |
| Approach: | They propose a dataset specifically designed for long-context hallucination detection. |
| Outcome: | The proposed architecture outperforms existing models while providing faster inference. |
Combining Humor and Sarcasm for Improving Political Parody Detection (2022.naacl-main)
Copied to clipboard
| Challenge: | Parody is a figurative device used for mimicking entities for comedic or critical purposes. |
| Approach: | They propose a multi-encoder model that combines three parallel encoders to enrich parody-specific representations with humor and sarcasm information. |
| Outcome: | The proposed model outperforms state-of-the-art methods on a dataset of political parody tweets. |
HighMATH: Evaluating Math Reasoning of Large Language Models in Breadth and Depth (2025.findings-emnlp)
Copied to clipboard
Yan Liu, Minghui Zhang, Bojian Xiong, Yifan Xiao, Yinong Sun, Yating Mei, Longyu Zeng, Jingchao Yang, Yang Wang, Deyi Xiong
| Challenge: | a gap in math models' accuracy has been widened with the development of large language models (LLMs) . a new study aims to bridge this gap by evaluating a set of high-level math reasoning models . |
| Approach: | They propose to evaluate large language models on existing math benchmarks to bridge this gap . they collect 5,293 problems from Chinese senior high school mathematics exams . |
| Outcome: | The proposed model is based on o1-like models and a high-level model. |
Extract-Select: A Span Selection Framework for Nested Named Entity Recognition with Generative Adversarial Training (2022.findings-acl)
Copied to clipboard
| Challenge: | Existing studies treat named entity recognition as a sequential labeling problem. |
| Approach: | They propose a span selection framework for nested named entity recognition . they propose nesting entities with different input categories would be separately extracted . |
| Outcome: | The proposed framework outperforms competing models on four benchmark datasets. |
FedCSR: A Federated Framework for Multi-Platform Cross-Domain Sequential Recommendation with Dual Contrastive Learning (2025.coling-main)
Copied to clipboard
Dongyi Zheng, Hongyu Zhang, Jianyang Zhai, Lin Zhong, Lingzhi Wang, Jiyuan Feng, Xiangke Liao, Yonghong Tian, Nong Xiao, Qing Liao
| Challenge: | Existing federated frameworks for cross-domain sequential recommendation rely on user alignment, which increases communication costs and privacy risks. |
| Approach: | They propose a federated cross-domain sequential recommendation framework that eliminates the need for user alignment between platforms. |
| Outcome: | The proposed framework eliminates the need for user alignment between platforms. |
TernaryBERT: Distillation-aware Ultra-low Bit BERT (2020.emnlp-main)
Copied to clipboard
| Challenge: | Transformer-based pre-training models like BERT are computationally expensive and limited to resource-constrained devices. |
| Approach: | They propose a method which ternarizes the weights in a fine-tuned BERT model. |
| Outcome: | The proposed method outperforms the other methods on the GLUE and SQUAD benchmarks while being 14.9x smaller. |
ESC-Eval: Evaluating Emotion Support Conversations in Large Language Models (2024.emnlp-main)
Copied to clipboard
Haiquan Zhao, Lingyu Li, Shisong Chen, Shuqi Kong, Jiaan Wang, Kexin Huang, Tianle Gu, Yixu Wang, Jian Wang, Liang Dandan, Zhixu Li, Yan Teng, Yanghua Xiao, Yingchun Wang
| Challenge: | Emotion Support Conversation (ESC) is a crucial application for reducing stress and providing emotional guidance. |
| Approach: | They re-organize 2,801 role-playing cards to define roles of role-players . they train a specific role- playing model called ESC-Role which behaves more like a confused person than GPT-4 . |
| Outcome: | The proposed model behaves more like a confused person than GPT-4, and the model performs better than GPLs. |
TimeArena: Shaping Efficient Multitasking Language Agents in a Time-Aware Simulation (2024.acl-long)
Copied to clipboard
| Challenge: | e.g., GPT-4 still lag behind humans in effective multitasking, a study finds . current textual simulations do not adequately address the notion of time . |
| Approach: | They propose a textual simulated environment that incorporates complex temporal dynamics and constraints that better reflect real-life planning scenarios. |
| Outcome: | The proposed model incorporates complex temporal dynamics and constraints that better reflect real-life planning scenarios. |
LEVEN: A Large-Scale Chinese Legal Event Detection Dataset (2022.findings-acl)
Copied to clipboard
Feng Yao, Chaojun Xiao, Xiaozhi Wang, Zhiyuan Liu, Lei Hou, Cunchao Tu, Juanzi Li, Yun Liu, Weixing Shen, Maosong Sun
| Challenge: | Existing legal event detection datasets only cover incomprehensive event types and have limited annotated data. |
| Approach: | They present a large-scale Chinese legal event detection dataset . they use legal events as side information to promote downstream applications . |
| Outcome: | The proposed method improves 2.2 points precision in low-resource judgment prediction and 1.5 points precision for unsupervised case retrieval. |
Jellyfish: Instruction-Tuning Local Large Language Models for Data Preprocessing (2024.emnlp-main)
Copied to clipboard
| Challenge: | Until 2021, most efforts were concentrated on one or two specific tasks such as error detection (ED) and data imputation (DI). |
| Approach: | They propose to instruction tune local LLMs as universal DP task solvers that operate on a local, single, and low-priced GPU, ensuring data security and enabling further customization. |
| Outcome: | The proposed models deliver competitiveness and generalizability to unseen tasks while barely compromising the base models’ abilities in NLP tasks. |
CoMeT: Collaborative Memory Transformer for Efficient Long Context Modeling (2026.acl-long)
Copied to clipboard
Runsong Zhao, Shilei Liu, Jiwei Tang, Langming Liu, Haibin Chen, Weidong Zhang, Yujin Yuan, Tong Xiao, JingBo Zhu, Wenbo Su, Bo Zheng
| Challenge: | a novel architecture that enables LLMs to handle arbitrarily long sequences with constant memory usage and linear time complexity is a major barrier to long-context processing. |
| Approach: | They propose a novel architecture that enables LLMs to handle arbitrarily long sequences with constant memory usage and linear time complexity. |
| Outcome: | The proposed architecture can handle arbitrarily long sequences with constant memory usage and linear time complexity. |
Cross-modal Contrastive Attention Model for Medical Report Generation (2022.coling-1)
Copied to clipboard
| Challenge: | Existing methods for medical report generation are unable to capture useful information from historical cases. |
| Approach: | They propose a model that captures both visual and semantic information from similar cases. |
| Outcome: | The proposed model outperforms the state-of-the-art models on almost all metrics on IU X-Ray and MIMIC-CXR benchmarks. |
Multifaceted Evaluation of Audio-Visual Capability for MLLMs: Effectiveness, Efficiency, Generalizability and Robustness (2025.findings-emnlp)
Copied to clipboard
| Challenge: | Multi-modal large language models have been used for processing and understanding information from diverse modalities. |
| Approach: | They propose to evaluate the audio-visual capabilities of multi-modal large language models . they focus on effectiveness, efficiency, generalizability, and robustness . |
| Outcome: | The proposed models exhibit strong zero-shot and few-shot generalization abilities . their success relies heavily on the vision modality, which impairs performance when visual input is corrupted or missing. |
Knowledge-to-SQL: Enhancing SQL Generation with Data Expert LLM (2024.findings-acl)
Copied to clipboard
| Challenge: | Existing methods for Generating accurate SQL queries for user questions rely on the capability of large language models (LLMs) however, some knowledge is not explicitly included in the database schema and user question or has been learned by LLMs. |
| Approach: | They propose a Knowledge-to-SQL framework that employs tailored Data Expert LLM (DELLM) to provide helpful knowledge for all text-to SQL models. |
| Outcome: | The proposed framework improves the state-of-the-art approaches for text-to-SQL tasks by leveraging a data expert LLM (DELLM) to provide useful knowledge for all text- to-SqL models. |
UCTG: A Unified Controllable Text Generation Framework for Query Auto-Completion (2025.coling-industry)
Copied to clipboard
| Challenge: | Existing approaches to control text generation (CTG) are essentially challenging to adapt to various control objectives and constraints, which results in mixed success. |
| Approach: | They propose a unified controllable text generation framework which integrates a control module, a prompt module, and a generation module. |
| Outcome: | The proposed framework significantly improves query accuracy and coherence in tasks with different objectives and constraints. |
IndoCL: Benchmarking Indonesian Language Development Assessment (2024.findings-emnlp)
Copied to clipboard
| Challenge: | Recent interest has surged in applying natural language processing (NLP) and machine learning (ML) to evaluate language development in both first (L1) and second (L2) language acquisition. |
| Approach: | They propose to use an Indonesian corpus as a benchmark for LDA tasks and to use existing large-scale language models to improve performance. |
| Outcome: | The proposed model extracts language-independent features, relieving laborious computation and reliance on specific language. |
Unveiling Language Competence Neurons: A Psycholinguistic Approach to Model Interpretability (2025.coling-main)
Copied to clipboard
| Challenge: | a new study explores how large language models capture aspects of human linguis-tic ability . large language model performance is limited by the mechanisms behind their performance . |
| Approach: | They employ psycholinguistic paradigms to explore neuron-level representations in language models . they found that large language models exhibit human-like abilities in three tasks . |
| Outcome: | The proposed model shows human-like abilities in sound-shape association, gender association and implicit causality. |
MMLU-ProX: A Multilingual Benchmark for Advanced Large Language Model Evaluation (2025.emnlp-main)
Copied to clipboard
Weihao Xuan, Rui Yang, Heli Qi, Qingcheng Zeng, Yunze Xiao, Aosong Feng, Dairui Liu, Yun Xing, Junjue Wang, Fan Gao, Jinghui Lu, Yuang Jiang, Huitao Li, Xin Li, Kunyu Yu, Ruihai Dong, Shangding Gu, Yuekang Li, Xiaofei Xie, Felix Juefei-Xu, Foutse Khomh, Osamu Yoshie, Qingyu Chen, Douglas Teodoro, Nan Liu, Randy Goebel, Lei Ma, Edison Marrese-Taylor, Shijian Lu, Yusuke Iwasawa, Yutaka Matsuo, Irene Li
| Challenge: | Existing large language model evaluation benchmarks focus on English, while current multilingual tasks lack parallel questions that specifically assess cross-lingual reasoning abilities. |
| Approach: | They propose a comprehensive benchmark covering 29 languages, built on an English benchmark. |
| Outcome: | The MMLU-ProX is a comprehensive benchmark covering 29 languages, built on an English benchmark. |
HER: Human-like Reasoning and Reinforcement Learning for LLM Role-playing (2026.findings-acl)
Copied to clipboard
Chengyu Du, Xintao Wang, Aili Chen, Weiyuan Li, Rui Xu, Junteng Liu, Zishan Huang, Rong Tian, Zijun Sun, Yuhao Li, Liheng Feng, Deming Ding, Pengyu Zhao, Yanghua Xiao
| Challenge: | Existing models for LLM role-playing lack high-quality datasets with explicit reasoning traces and reliable reward signals aligned with human preferences. |
| Approach: | They propose a unified framework for cognitive-level persona simulation that strictly distinguishes characters’ first-person thinking processes from LLMs’ third-person reasoning. |
| Outcome: | The proposed framework outperforms the Qwen3-32B baseline model and achieves a 30.26% and 14.97% performance on the minimax benchmarks. |
BERT4GCN: Using BERT Intermediate Layers to Augment GCN for Aspect-based Sentiment Classification (2021.emnlp-main)
Copied to clipboard
| Challenge: | Existing approaches to Aspect-based sentiment classification ignore sequential features of context and lack syntactic knowledge of sentences. |
| Approach: | They propose a model which integrates sequential grammatical features from context and syntactic knowledge from dependency graphs to augment GCN to better encode dependency graph outputs. |
| Outcome: | The proposed model outperforms state-of-the-art models when equipped with contextual word embedding from pre-training language models. |
GATE: Graph-based Adaptive Tool Evolution Across Diverse Tasks (2026.acl-long)
Copied to clipboard
Jianwen Luo, Yiming Huang, Jinxiang Meng, Fangyu Lei, Shizhu He, Xiao Liu, Shanshan Jiang, Bin Dong, Jun Zhao, Kang Liu
| Challenge: | Existing toolsets that use large language models are limited to single-task settings. |
| Approach: | They propose a framework that dynamically constructs and evolves a hierarchical graph of reusable tools across multiple scenarios. |
| Outcome: | The proposed framework achieves up to 4.3 faster milestone completion in Minecraft compared to the previous state-of-the-art method and provides an average improvement of 9.23% over existing tool-making methods in code generation tasks and 10.03% in agent tasks. |
SciText2Eq: Assessing LLMs for Explainable Equation Generation for Scientific Creativity (2026.findings-acl)
Copied to clipboard
| Challenge: | Prior work has addressed problems in unstructured grounding, multi-equation dependency, and human-aligned evaluation. |
| Approach: | They construct a dataset of scientific texts and evaluate it using an explainable equation generation workflow using automatic metrics and human judgments. |
| Outcome: | The proposed model achieves moderate performance on lexical and syntactic similarity, but struggles with semantic accuracy. |
MAPO: Boosting Large Language Model Performance with Model-Adaptive Prompt Optimization (2023.findings-emnlp)
Copied to clipboard
Yuyan Chen, Zhihao Wen, Ge Fan, Zhengyu Chen, Wei Wu, Dayiheng Liu, Zhixu Li, Bang Liu, Yanghua Xiao
| Challenge: | Existing research emphasizes the importance of adapting prompts to specific tasks, rather than specific LLMs. |
| Approach: | They propose a model-adaptive prompt optimizer method that optimizes original prompts for each LLM in downstream tasks. |
| Outcome: | The proposed method can optimize prompts for an LLM in downstream tasks. |
LayerNorm Induces Recency Bias in Transformer Decoders (2026.findings-acl)
Copied to clipboard
| Challenge: | Existing studies show that stacking causal self-attention layers alone induces a positional bias in attention scores toward earlier tokens, but this differs from the bias toward later tokens observed in Transformer decoders, known as recency bias. |
| Approach: | They propose to stack causal self-attention layers and layer norm to induce recency bias in Transformer decoders by analyzing the interaction between causal self and other architectural components. |
| Outcome: | The proposed method provides new theoretical insights into how positional information interacts with architectural components and suggests improvements in positional encoding strategies. |
Easy Samples Are All You Need: Self-Evolving LLMs via Data-Efficient Reinforcement Learning (2026.findings-acl)
Copied to clipboard
| Challenge: | Experimental results show that EasyRL consistently outperforms state-of-the-art baselines due to the substantial annotation cost and issues such as model collapse or reward hacking. |
| Approach: | They propose a supervised RL approach with a divide-and-conquer strategy that simulates the human cognitive acquisition curve using easy labeled data. |
| Outcome: | The proposed approach outperforms state-of-the-art models on mathematical and scientific benchmarks using only 10% of easy labeled data. |
Training Flexible Depth Model by Multi-Task Learning for Neural Machine Translation (2020.findings-emnlp)
Copied to clipboard
| Challenge: | Experimental results show that multitask learning can support decoding in 24 depth configurations and is superior to individual training. |
| Approach: | They propose to use multi-task learning to train a flexible depth model that can adapt to different depth configurations during inference. |
| Outcome: | The proposed model can support decoding in 24 depth configurations and is superior to the individual training and another flexible depth model training method——LayerDrop. |
Select, Extract and Generate: Neural Keyphrase Generation with Layer-wise Coverage Attention (2021.acl-long)
Copied to clipboard
| Challenge: | Generally, documents are truncated before being inputs to deep neural networks, resulting in missing keyphrases . evaluators use layer-wise coverage attention to cover all the critical points in a document . |
| Approach: | They propose a neural keyphrase generation model that identifies the salient sentences in a document and an extractor-generator that jointly extracts and generates keyphrases from the selected sentences. |
| Outcome: | The proposed model outperforms the state-of-the-art keyphrase generation methods on keyphrases generated from scientific and web documents. |
Enhancing Multilingual Reasoning via Steerable Model Merging (2026.findings-acl)
Copied to clipboard
Zhuoran Li, Rui Xu, Jian Yang, Junnan Liu, Zhijun Chen, Qianren Mao, Hongcheng Guo, Jiaheng Liu, Likang Xiao, Ming LI, Xiaojie Wang
| Challenge: | Model merging is an effective technique for composing the capabilities of a multilingual model and a reasoning model. |
| Approach: | They propose a model merging framework that modulates the contribution of each source model. |
| Outcome: | Experiments show that the proposed model merging framework outperforms strong baselines on multilingual reasoning benchmarks across 21 different languages. |
Neighbors Are Not Strangers: Improving Non-Autoregressive Translation under Low-Frequency Lexical Constraints (2022.naacl-main)
Copied to clipboard
| Challenge: | Existing approaches to lexically constrained neural machine translation suffer from high latency. |
| Approach: | They propose a plug-in algorithm for non-autoregressive translation for this problem . they propose ACT to familiarize the model with the source-side context of constraints . |
| Outcome: | The proposed model improves over the backbone constrained NAT model in constraint preservation and translation quality, especially for rare constraints. |
Learning Visually-Grounded Semantics from Contrastive Adversarial Samples (C18-1)
Copied to clipboard
| Challenge: | Existing frameworks for grounding distributional representations of texts on the visual domain are limited . effective and efficient grounding of distributional embeddings remains challenging . |
| Approach: | They propose to ground distributional representations of texts on the visual domain using visual-semantic embeddings. |
| Outcome: | The proposed model improves on a diverse set of downstream tasks and defends known-type adversarial attacks. |
Task-Agnostic Low-Rank Adapters for Unseen English Dialects (2023.emnlp-main)
Copied to clipboard
| Challenge: | a recent study found that LLMs are trained on corpora disproportionally weighted in favor of Standard American English . prior work on dialect struggle with generalizing to evolving and emerging dialects in a scalable manner. |
| Approach: | They propose a method that leverages linguistic knowledge to enable resource-efficient adaptation . their method disentangles dialect-specific and cross-dialectal information . |
| Outcome: | a new method improves generalization to unseen dialects in a task-agnostic fashion . it achieves the best or most competitive performance across 5 dialects . |
Augmenting Large Language Model Translators via Translation Memories (2023.findings-acl)
Copied to clipboard
Yongyu Mu, Abudurexiti Reheman, Zhiquan Cao, Yuchun Fan, Bei Li, Yinqiao Li, Tong Xiao, Chunliang Zhang, Jingbo Zhu
| Challenge: | Using translation memories (TMs) as prompts is a promising approach to in-context learning of machine translation models. |
| Approach: | They propose to use translation memories (TMs) as prompts to prompt large language models (LLMs) they find that the ability of LLMs to "understand" prompts is helpful . |
| Outcome: | The results are comparable to state-of-the-art NMT systems with bilingual data and are tuned on downstream tasks. |
Semantic-Space Exploration and Exploitation in RLVR for LLM Reasoning (2026.findings-acl)
Copied to clipboard
Fanding Huang, Guanbo Huang, Xiao Fan, Yi He, Xiao Liang, Xiao Chen, Qinting Jiang, Faisal Nadeem Khan, Jingyan Jiang, Zhi Wang
| Challenge: | Recent advances in Reinforcement Learning with Verifiable Rewards (RLVR) have substantially improved the reasoning abilities of Large Language Models (LLMs). |
| Approach: | They propose a method that balances exploration and exploitation in the hidden-state space of response trajectories. |
| Outcome: | The proposed model yields consistent improvements across models, algorithms and reasoning benchmarks. |
Instructions are all you need: Self-supervised Reinforcement Learning for Instruction Following (2026.acl-long)
Copied to clipboard
| Challenge: | Existing reinforcement learning approaches suffer from dependency on external supervision and sparse reward signals from multi-constraint tasks. |
| Approach: | They propose a self-supervised reinforcement learning framework that eliminates dependency on external supervision by deriving reward signals directly from instructions and generating pseudo-labels for reward model training. |
| Outcome: | The proposed framework achieves strong improvements across 3 in-domain and 5 out-of-domain datasets while maintaining computational efficiency. |
Jointly Multiple Events Extraction via Attention-based Graph Information Aggregation (D18-1)
Copied to clipboard
| Challenge: | Event extraction is of practical utility in natural language processing . it is common that multiple events exist in the same sentence, causing difficulties in extracting them . |
| Approach: | They propose a framework to jointly extract multiple event triggers and arguments . they introduce syntactic shortcut arcs to enhance information flow and attention-based graph convolution networks to model graph information. |
| Outcome: | The proposed framework achieves competitive results compared with state-of-the-art methods. |
Cross-Domain Data Integration for Named Entity Disambiguation in Biomedical Text (2021.findings-emnlp)
Copied to clipboard
| Challenge: | Existing methods for named entity disambiguation are limited by coarse-grained structural resources in biomedical knowledge bases and training datasets that provide low coverage over uncommon resources. |
| Approach: | They propose a method that integrates structural knowledge from general text knowledge bases to the medical domain. |
| Outcome: | The proposed method improves disambiguation accuracy on two benchmark medical NED datasets by up to 57 points. |
SPS: Steering Probability Squeezing for Better Exploration in Reinforcement Learning for Large Language Models (2026.findings-acl)
Copied to clipboard
Yifu Huo, Chenglong Wang, Ziming Zhu, Shunjie Xing, Peinan Feng, Tongran Liu, Qiaozhi He, Tian Hua Zhou, null Changxiaojia, JingBo Zhu, Zhengtao Yu, Tong Xiao
| Challenge: | Reinforcement learning (RL) training typically improves single-sample success rates but limited exploration of diverse reasoning trajectories. |
| Approach: | They propose a training paradigm that interleaves conventional RL with inverse reinforcement learning (IRL) they propose 'Steering Probability Squeezing' to enhance exploration without external supervision . |
| Outcome: | The proposed training paradigm improves Pass@k and improves exploration of diverse reasoning trajectories without external supervision. |
Systematically Exploring Redundancy Reduction in Summarizing Long Documents (2020.aacl-main)
Copied to clipboard
| Challenge: | Summarization tasks are often based on importance and diversity, but there is a trade-off between importance and non-redundancy. |
| Approach: | They propose to organize existing methods into categories based on when and how redundancy is considered and propose three additional methods balancing non-redundancy and importance in a general and flexible way. |
| Outcome: | The proposed methods achieve state-of-the-art on two scientific paper datasets, Pubmed and arXiv, while reducing redundancy significantly. |
A Dual-Attention Network for Joint Named Entity Recognition and Sentence Classification of Adverse Drug Events (2020.findings-emnlp)
Copied to clipboard
| Challenge: | Adverse drug events (ADEs) are a leading cause of death in the United States and cost around $30 $130 billion every year. |
| Approach: | They propose a multi-grained joint deep network to learn ADE entity recognition and ADE sentence classification tasks. |
| Outcome: | The proposed model improves state-of-art F1 score on the MADE 1.0 benchmark of EHR notes. |
Personality Understanding of Fictional Characters during Book Reading (2023.acl-long)
Copied to clipboard
| Challenge: | Existing methods to predict characters' personalities have not been studied in the NLP field due to the lack of appropriate datasets mimicking the process of book reading. |
| Approach: | They propose a dataset to predict characters' personalities that uses an exhaustive vocabulary of personality traits as targets. |
| Outcome: | The proposed dataset is efficient and accurate and relies on long-term context to achieve accurate predictions for both machines and humans. |
Ground Every Sentence: Improving Retrieval-Augmented LLMs with Interleaved Reference-Claim Generation (2025.findings-naacl)
Copied to clipboard
| Challenge: | Existing methods to enhance credibility and verifiability of large language models (LLMs) mainly focus on passage-level or paragraph-level references or citations, which fall short in verifikatability. |
| Approach: | They propose a method that provides sentence-level citations in LLM-generated responses. |
| Outcome: | The proposed method achieves 90% accuracy in long-form question-answering tasks. |
Native Sparse Attention: Hardware-Aligned and Natively Trainable Sparse Attention (2025.acl-long)
Copied to clipboard
Jingyang Yuan, Huazuo Gao, Damai Dai, Junyu Luo, Liang Zhao, Zhengyan Zhang, Zhenda Xie, Yuxing Wei, Lean Wang, Zhiping Xiao, Yuqing Wang, Chong Ruan, Ming Zhang, Wenfeng Liang, Wangding Zeng
| Challenge: | Long-context modeling is crucial for next-generation language models, but high computational cost of standard attention mechanisms poses significant computational challenges. |
| Approach: | They propose a natively trained Sparse Attention mechanism that integrates algorithms with hardware-aligned optimizations to achieve efficient long-context modeling. |
| Outcome: | The proposed model maintains or exceeds Full Attention models across general benchmarks, long-context tasks, and instruction-based reasoning. |
Layer-Wise Multi-View Learning for Neural Machine Translation (2020.coling-main)
Copied to clipboard
| Challenge: | Existing approaches to neural machine translation are limited to the topmost encoder layer’s context representation and cannot perceive the lower encoder layers. |
| Approach: | They propose a layer-wise multi-view learning approach to solve this problem by incorporating an auxiliary view into the model. |
| Outcome: | The proposed model can achieve stable results over multiple strong baselines and is agnostic to network architectures. |
CMB: A Comprehensive Medical Benchmark in Chinese (2024.naacl-long)
Copied to clipboard
Xidong Wang, Guiming Chen, Song Dingjie, Zhang Zhiyi, Zhihong Chen, Qingying Xiao, Junying Chen, Feng Jiang, Jianquan Li, Xiang Wan, Benyou Wang, Haizhou Li
| Challenge: | Large Language Models (LLMs) provide a great breakthrough in medicine, says a new study . existing studies on LLMs leverage subjective evaluation, but evaluation in medicine is professional . |
| Approach: | They propose a localized medical benchmark in Chinese rooted in native Chinese . they propose to use traditional Chinese medicine to evaluate large-scale LLMs . |
| Outcome: | a new benchmark is developed to evaluate large-scale LLMs in china . the proposed model is rooted in the native Chinese linguistic and cultural framework . |
A Simple and Effective Approach to Coverage-Aware Neural Machine Translation (P18-2)
Copied to clipboard
| Challenge: | Neural Machine Translation (NMT) models are used to solve translation problems using long-term models. |
| Approach: | They propose a method to seek a better balance between model confidence and length preference for Neural Machine Translation. |
| Outcome: | The proposed model improves on Chinese-English and English-German translation tasks. |
Neural Natural Logic Inference for Interpretable Question Answering (2021.emnlp-main)
Copied to clipboard
| Challenge: | Existing question answering models are based on textual entailment tasks . prior work has focused on QA on premise-based questions . |
| Approach: | They propose a neural-symbolic QA approach that integrates natural logic reasoning within deep learning architectures towards developing effective question answering models. |
| Outcome: | The proposed model outperforms previous work on multiple-choice science questions . it integrates natural logic reasoning within deep learning architectures to build proof paths . |
NaturalCodeBench: Examining Coding Performance Mismatch on HumanEval and Natural User Queries (2024.findings-acl)
Copied to clipboard
| Challenge: | Large language models (LLMs) generate code for productive activities, but current benchmarks for code synthesis are oriented towards introductory tasks on algorithm and data science. |
| Approach: | They propose a code benchmark to mirror the complexity and variety of scenarios in real-world coding tasks. |
| Outcome: | The proposed benchmark improves on 39 large language models with close HumanEval scores and achieves an efficiency increase of more than 4 times. |
Causality-aware Concept Extraction based on Knowledge-guided Prompting (2023.acl-long)
Copied to clipboard
| Challenge: | Concepts in knowledge graphs (KGs) are far from complete in existing knowledge graph models. |
| Approach: | They propose to equip a PLM-based extractor with a knowledge-guided prompt to alleviate concept bias by removing spurious co-occurrence correlations from existing knowledge. |
| Outcome: | The proposed prompt can alleviate concept bias and improve the performance of existing models. |
StrucText-Eval: Evaluating Large Language Model’s Reasoning Ability in Structure-Rich Text (2025.acl-long)
Copied to clipboard
| Challenge: | Structured data has been central to corporate data strategies for decades . however, with the advancement of large language models (LLMs), there has been a significant shift towards the effective utilization of unstructured data. |
| Approach: | They propose an automatic evaluation data generation method to assess LLMs’ reasoning capabilities on structure-rich text. |
| Outcome: | The proposed method supports 8 structured languages and 29 tasks, generating data with adjustable complexity through controllable nesting and structural width. |
MonCulture-Eval: A Hierarchical Benchmark for Evaluating Mongolian Cultural Capabilities of Large Language Models across Scripts and Regions (2026.findings-acl)
Copied to clipboard
| Challenge: | Large Language Models excel at multilingual translation and instruction-following in low-resource settings like Tibetan, but lack cultural intelligence quantification. |
| Approach: | They propose a benchmark to assess the cultural intelligence of Large Language Models in Mongolia . they use a three-layer cognitive hierarchy and specialized tasks to assess their cultural intelligence . |
| Outcome: | The monCulture-Eval benchmark assesses the cultural intelligence of large language models in the Mongolian context across two writing systems and three regional sub-cultures. |
GL-GIN: Fast and Accurate Non-Autoregressive Model for Joint Multiple Intent Detection and Slot Filling (2021.acl-long)
Copied to clipboard
| Challenge: | Existing joint models for multi-intent SLU only consider intent detection while ignoring slot filling task. |
| Approach: | They propose a non-autoregressive model for joint multiple intent detection and slot filling . their framework is 11.5 times faster than existing joint models . |
| Outcome: | The proposed model is 11.5 times faster than existing models and is faster than current models. |
Protein Large Language Models: A Comprehensive Survey (2025.findings-emnlp)
Copied to clipboard
Yijia Xiao, Wanjia Zhao, Junkai Zhang, Yiqiao Jin, Han Zhang, Zhicheng Ren, Renliang Sun, Haixin Wang, Guancheng Wan, Pan Lu, Xiao Luo, Yu Zhang, James Zou, Yizhou Sun, Wei Wang
| Challenge: | Existing studies focus on specific aspects or applications, but this study provides a comprehensive overview of Protein-specific large language models. |
| Approach: | This paper proposes a structured taxonomy of state-of-the-art ProteinLLMs . they analyze how they leverage large-scale protein sequence data for improved accuracy . |
| Outcome: | The proposed model covers their architectures, training datasets, evaluation metrics, and diverse applications. |
Enhancing Legal Case Retrieval via Scaling High-quality Synthetic Query-Candidate Pairs (2024.emnlp-main)
Copied to clipboard
| Challenge: | Existing studies focus on case-to-case retrieval using lengthy queries, which does not match real-world scenarios. |
| Approach: | They propose a method to construct query-candidate pairs and build the largest LCR dataset to date, LEAD. |
| Outcome: | Experimental results show that the method can provide ample training signals for LCR models. |
Do Large Language Models have Problem-Solving Capability under Incomplete Information Scenarios? (2024.findings-acl)
Copied to clipboard
| Challenge: | Existing games such as "Who is undercover" are subjective and difficult to evaluate . |
| Approach: | They propose a game called BrainKing that evaluates LLMs' problem-solving capability under incomplete information scenarios. |
| Outcome: | The proposed game requires LLMs to identify target entities with limited yes-or-no questions and potential misleading answers. |
LLaSE-G1: Incentivizing Generalization Capability for LLaMA-based Speech Enhancement (2025.acl-long)
Copied to clipboard
Boyi Kang, Xinfa Zhu, Zihan Zhang, Zhen Ye, Mingshuai Liu, Ziqian Wang, Yike Zhu, Guobin Ma, Jun Chen, Longshuai Xiao, Chao Weng, Wei Xue, Lei Xie
| Challenge: | Recent advances in language models have demonstrated strong capabilities in semantic understanding and contextual modeling. |
| Approach: | They propose a LLaMA-based language model that incentivizes generalization capabilities for speech enhancement. |
| Outcome: | The proposed language model outperforms prior task-specific discriminative and generative models in acoustic enhancement tasks. |
Android in the Zoo: Chain-of-Action-Thought for GUI Agents (2024.findings-emnlp)
Copied to clipboard
| Challenge: | Existing studies on large language models (LLMs) focus on the semantics of smartphone operations. |
| Approach: | They propose a large language model (LLM) which predicts a sequence of actions of API by analyzing past actions and visual observations. |
| Outcome: | The proposed model improves the prediction of actions on a zero-shot Android-In-The-Zoo dataset compared to previous models . |
SoftDedup: an Efficient Data Reweighting Method for Speeding Up Language Model Pre-training (2024.acl-long)
Copied to clipboard
| Challenge: | Current methods focus on detecting and removing duplicates, which risks the loss of valuable information and neglects the varying degrees of duplication. |
| Approach: | They propose a method that maintains dataset integrity while selectively reducing the sampling weight of data with high commonness. |
| Outcome: | The proposed method significantly improves training efficiency on deduplicated datasets and improves downstream accuracy by 1.77%. |
From A and B to A+B: Can Large Language Models Solve Compositional Math Problems? (2025.emnlp-main)
Copied to clipboard
| Challenge: | Existing studies that create problem variants by adding perturbations to a single problem focus on the interaction between problems. |
| Approach: | They propose a pipeline with 98.2% accuracy to combine two original problems with a logical connection and to evaluate LLMs' generalization ability on the compositional problems. |
| Outcome: | The proposed pipeline can combine two original problems with a logical connection to get a new math problem and evaluate its compositional generalization on the compositional problems. |
MIND: Towards Immersive Psychological Healing with Multi-Agent Inner Dialogue (2025.findings-emnlp)
Copied to clipboard
Yujia Chen, Changsong Li, Yiming Wang, Tianjie Ju, Qingqing Xiao, Nan Zhang, Zifan Kong, Peng Wang, Binyu Yan
| Challenge: | Mental health issues are worsening in today’s competitive society, such as depression and anxiety. |
| Approach: | They propose a multi-agent inner dialogue paradigm that provides more immersive psychological healing environments. |
| Outcome: | The proposed paradigm provides more immersive psychological healing environments. |
Variator: Accelerating Pre-trained Models with Plug-and-Play Compression Modules (2023.findings-emnlp)
Copied to clipboard
Chaojun Xiao, Yuqi Luo, Wenbin Zhang, Pengle Zhang, Xu Han, Yankai Lin, Zhengyan Zhang, Ruobing Xie, Zhiyuan Liu, Maosong Sun, Jie Zhou
| Challenge: | Large language models (LLMs) have been successful on NLP tasks but require huge parameter sizes and computational resources. |
| Approach: | They propose a parameter-efficient acceleration method that enhances computational efficiency through plug-and-play compression plugins. |
| Outcome: | The proposed method saves 53% computational costs using only 0.9% additional parameters with a performance drop of less than 2%. |
Language Model Adaption for Reinforcement Learning with Natural Language Action Space (2024.acl-long)
Copied to clipboard
| Challenge: | Previous research has focused on reducing the size of the natural language action space due to the combinatorial nature of the language. |
| Approach: | They propose mutual-information regularized policy optimization to reduce the action space by dynamically adjusting the prior provided by the pretrained model. |
| Outcome: | The proposed method improves monotonically on the mutual-information regularized RL objective. |
RLHFPoison: Reward Poisoning Attack for Reinforcement Learning with Human Feedback in Large Language Models (2024.acl-long)
Copied to clipboard
| Challenge: | Recent advances in Large Language Models (LLMs) have significantly enhanced the capabilities in natural language processing. |
| Approach: | They propose a method to poison large language models by using annotators to rank a set of collected responses to generate longer tokens. |
| Outcome: | The proposed method can generate longer tokens without harming the original safety alignment performance. |
Denoising Relation Extraction from Document-level Distant Supervision (2020.emnlp-main)
Copied to clipboard
| Challenge: | Existing methods to generate auto-labeled sentences for relation extraction (RE) are difficult to extend to document-level relation extraction as noise from DS may be even multiplied in documents. |
| Approach: | They propose a pre-trained model which de-emphasizes noisy DS data via multiple pre-training tasks. |
| Outcome: | The proposed model can capture useful information from noisy data and achieve promising results on the large-scale DocRE benchmark. |
NLP-ADBench: NLP Anomaly Detection Benchmark (2025.findings-emnlp)
Copied to clipboard
| Challenge: | Anomaly detection (AD) is an important machine learning task, but its effectiveness in detecting harmful content, phishing attempts, and spam reviews is limited. |
| Approach: | They introduce NLP-ADBench, the most comprehensive NLP anomaly detection benchmark to date . it includes eight curated datasets and 19 state-of-the-art algorithms . |
| Outcome: | The NLP-ADBench benchmark includes 19 state-of-the-art methods and 8 curated datasets . no single model dominates across all datasets, indicating need for automated model selection . |
Modeling LLM Unlearning as an Asymmetric Two-Task Learning Problem (2026.acl-long)
Copied to clipboard
| Challenge: | Large language models (LLMs) are inherently dual-use and can be leveraged for both beneficial and harmful purposes. |
| Approach: | They propose a retention-prioritized gradient synthesis framework that decouples task-specific gradient extraction from conflict-aware combination. |
| Outcome: | The proposed method achieves tighter alignment on WMDP Bio and RWKU benchmarks. |
Learning Target-Specific Representations of Financial News Documents For Cumulative Abnormal Return Prediction (C18-1)
Copied to clipboard
| Challenge: | Recent work considers learning dense representations for news titles and abstracts . text representations can address the sparsity of discrete indicators in statistical models . |
| Approach: | They propose to use news abstracts to combine the most informative sentences in news content to learn dense representations for text elements. |
| Outcome: | The proposed model can be used to estimate abnormal returns of companies when compared to titles and abstracts. |
Exploring Layer-wise Information Effectiveness for Post-Training Quantization in Small Language Models (2026.findings-acl)
Copied to clipboard
He Xiao, Qingyao Yang, Dirui Xie, Wendong XU, Zunhai Su, Runming Yang, Haobo Liu, Wenyong Zhou, Zhengwu Liu, Ngai Wong
| Challenge: | Large language models with billions of parameters are often over-provisioned . smaller models exhibit lower robustness under extreme low-bit quantization . |
| Approach: | They propose a hardware-native, metric-driven post-training quantization framework that keeps uniform bit-width within each layer while mixing precision across layers. |
| Outcome: | LieQ reduces large accuracy gap observed for large language models with billions of parameters while preserving standard multiplication kernels. |
bert2BERT: Towards Reusable Pretrained Language Models (2022.acl-long)
Copied to clipboard
Cheng Chen, Yichun Yin, Lifeng Shang, Xin Jiang, Yujia Qin, Fengyu Wang, Zhi Wang, Xiao Chen, Zhiyuan Liu, Qun Liu
| Challenge: | Pre-training large language models can be expensive and wasteful. |
| Approach: | They propose a method which can transfer the knowledge of an existing smaller pre-trained model to a large model through parameter initialization and a two-stage learning method to further accelerate the pre-training. |
| Outcome: | The proposed method can transfer the knowledge of an existing smaller pre-trained model to a large model through parameter initialization and significantly improve the pre-training efficiency of the large model. |
RAPO: An Adaptive Ranking Paradigm for Bilingual Lexicon Induction (2022.emnlp-main)
Copied to clipboard
Zhoujin Tian, Chaozhuo Li, Shuo Ren, Zhiqiang Zuo, Zengxuan Wen, Xinyue Hu, Xiao Han, Haizhen Huang, Denvy Deng, Qi Zhang, Xing Xie
| Challenge: | Existing approaches focus on minimizing distances between words in aligned pairs, while suffering from low discriminative capability to distinguish the relative orders between positive and negative candidates. |
| Approach: | They propose a ranking-oriented induction model to learn personalized mapping function for each word. |
| Outcome: | The proposed model can learn personalized mapping function for each word on public datasets including rich-resource and low-resourced languages. |
A Survey of Reinforcement Learning for Large Language Models under Data Scarcity: Challenges and Solutions (2026.acl-long)
Copied to clipboard
Zhiyin Yu, Yuchen Mou, Juncheng Yan, Junyu Luo, Chunchun Chen, Xing Wei, Yunhui Liu, Hongru Sun, Yuxing Zhang, Jun Xu, Yatao Bian, Ming Zhang, Wei Ye, Tieke He, Jie Yang, Guanjie Zheng, Zhonghai Wu, Bo Zhang, Lei Bai, Xiao Luo
| Challenge: | Existing research on reinforcement learning for LLMs under data scarcity has not been unified. |
| Approach: | They propose a top-up hierarchical framework built around three complementary perspectives: data-centric, training-centric and framework-centric. |
| Outcome: | The proposed framework provides a clear conceptual foundation for understanding the design space of data-efficient RL for large language models and to guide researchers working in this emerging area. |
Grammar-Based Code Representation: Is It a Worthy Pursuit for LLMs? (2025.findings-acl)
Copied to clipboard
Qingyuan Liang, Zhao Zhang, Zeyu Sun, Zheng Lin, Qi Luo, Xiao Yueyi, Yizhou Chen, Yuqun Zhang, Haotian Zhang, Lu Zhang, Chenbin Chenbin, Yingfei Xiong
| Challenge: | Existing research demonstrates the effectiveness of grammar-based code representations in small-scale models, showing their ability to reduce syntax errors and enhance performance. |
| Approach: | They develop a series of billion-scale grammar-based code representations that incorporate grammar rules into the code generation process. |
| Outcome: | Experiments on HumanEval and MBPP show that grammar-based representations reduce syntax errors and improve performance even in billion-scale models. |
Towards Dynamic Theory of Mind: Evaluating LLM Adaptation to Temporal Evolution of Human States (2025.acl-long)
Copied to clipboard
| Challenge: | Existing benchmarks assess basic Theory of Mind abilities but neglect temporal evolution of mental states in real-world social contexts. |
| Approach: | They propose a benchmark specifically designed to evaluate Large Language Models' ability to understand and track the temporal progression of mental states across interconnected scenarios. |
| Outcome: | The proposed benchmarks underperform humans by 44.7% and show that they can model the dynamic nature of human mental states better than existing models. |
Finding the Sweet Spot: Preference Data Construction for Scaling Preference Optimization (2025.acl-long)
Copied to clipboard
| Challenge: | Large language models generate unintended outputs due to their unsupervised nature. |
| Approach: | They propose a method to construct preference pairs of selected and rejected LLMs by repeated random sampling to improve alignment performance. |
| Outcome: | The proposed method improves performance as the sample size increases. |
Improving Diversity of Demographic Representation in Large Language Models via Collective-Critiques and Self-Voting (2023.emnlp-main)
Copied to clipboard
Preethi Lahoti, Nicholas Blumm, Xiao Ma, Raghavendra Kotikalapudi, Sahitya Potluri, Qijun Tan, Hansa Srinivasan, Ben Packer, Ahmad Beirami, Alex Beutel, Jilin Chen
| Challenge: | Existing studies on diversity in large language models focus on the understudied class of fairness and inclusion concern in LLMs. |
| Approach: | They propose a technique to measure diversity in generated responses along people and culture axes by collective-critique and self-voting. |
| Outcome: | The proposed approach outperforms baseline methods and human evaluations with human and automated evaluations. |
MATH-IDN: A Multilingual Mathematical Problem Solving Dataset Featuring Local Languages in Indonesia (2026.findings-eacl)
Copied to clipboard
| Challenge: | Large Language Models excel at mathematical reasoning in English, but their performance in low-resource languages remains underexplored. |
| Approach: | They propose a multilingual benchmark for mathematical problem solving in Indonesian, Javanese, Sundanese, and Buginese with English as a reference. |
| Outcome: | The proposed model reveals significant performance gaps in low-resource languages, particularly Buginese, and highlights key limitations in current multilingual reasoning capabilities. |
Chain-of-Quizzes: Pedagogy-inspired Example Selection in In-Context-Learning (2024.findings-acl)
Copied to clipboard
| Challenge: | In-context learning (ICL) is a powerful tool for enhancing large language models (LLMs) by mimicking the human learning process. |
| Approach: | They propose a Chain-of-Quizzes framework that uses LLMs to answer a quiz to sift 'good' examples, combine them iteratively with the increasing complexity, and utilize a final exam to gauge the combined example chains. |
| Outcome: | The proposed framework outperforms baseline models on diverse reasoning datasets and shows that it is scalable and can be used in future research. |
Deciphering the Impact of Pretraining Data on Large Language Models through Machine Unlearning (2024.findings-acl)
Copied to clipboard
| Challenge: | Existing studies have suggested that the composition of the pretraining corpus exerts a significant impact upon the performance of LLMs. |
| Approach: | They analyze the impact of 48 datasets from 5 major categories of pretraining data of Large Language Models and measure their impacts on LLMs using benchmarks about nine major categories. |
| Outcome: | The proposed analysis provides insights into the organization of data to support more efficient pretraining of Large Language Models. |
GeoSQA: A Benchmark for Scenario-based Question Answering in the Geography Domain at High School Level (D19-1)
Copied to clipboard
| Challenge: | SQA is an emerging application of NLP in the medical, geography, and legal domains. |
| Approach: | They propose a dataset of 1,981 scenarios and 4,110 multiple-choice questions in geography domain at high school level. |
| Outcome: | The proposed dataset consists of 1,981 scenarios and 4,110 multiple-choice questions in the geography domain at high school level. |
DREAM: Disentangling Risks to Enhance Safety Alignment in Multimodal Large Language Models (2025.naacl-long)
Copied to clipboard
Jianyu Liu, Hangyu Guo, Ranjie Duan, Xingyuan Bu, Yancheng He, Shilong Li, Hui Huang, Jiaheng Liu, Yucheng Wang, Chenchen Jing, Xingwei Qu, Xiao Zhang, Pei Wang, Yanan Wu, Jihao Gu, Yangguang Li, Jianke Zhu
| Challenge: | Multimodal Large Language Models (MLLMs) pose unique safety challenges due to their integration of visual and textual data. |
| Approach: | They propose a method to disentangle risks through step-by-step reasoning within multimodal inputs. |
| Outcome: | The proposed approach improves safety alignment in MLLMs by fine-tuning and iterative Reinforcement Learning from AI feedback. |
Boosting Vulnerability Detection of LLMs via Curriculum Preference Optimization with Synthetic Reasoning Data (2025.findings-acl)
Copied to clipboard
| Challenge: | Large language models (LLMs) are capable of detecting software vulnerabilities, but lack of reasoning data hinders their ability to capture underlying vulnerability patterns. |
| Approach: | They propose a framework that excels at mining vulnerability patterns through reasoning data synthesizing and vulnerability-specific preference optimization. |
| Outcome: | The proposed framework improves on SVEN and PrimeVul datasets and improves 12.24%-22.77% accuracy. |
Empirical Analysis of Decoding Biases in Masked Diffusion Models (2026.acl-long)
Copied to clipboard
Pengcheng Huang, Tianming Liu, Zhenghao Liu, Yukun Yan, Shuo Wang, Tong Xiao, Zulong Chen, Maosong Sun
| Challenge: | Existing MDMs employ uncertainty-based decoding strategies that limit their reasoning ability and ultimately degrade generation quality. |
| Approach: | They propose a framework that regularizes uncertainty-based decoding by incorporating two complementary priors to shape global decoding trajectories and promote content informativeness. |
| Outcome: | The proposed framework outperforms existing decoding strategies by more than 7% while achieving comparable performance to autoregressive models of similar parameter scales. |
Teaching Language Models to Self-Improve through Interactive Demonstrations (2024.naacl-long)
Copied to clipboard
| Challenge: | Large language models (LLMs) have been shown to improve performance on downstream tasks by prompting them to analyze and revise their outputs. |
| Approach: | They propose a training algorithm that prompts large language models to analyze and revise their own outputs and uses this feedback to train the small model. |
| Outcome: | The proposed approach improves LLaMA-7B's performance on math and reasoning tasks by up to 7.13%. |
Train in Vain: Functionality-Preserving Poisoning to Prevent Unauthorized Use of Code Datasets (2026.findings-acl)
Copied to clipboard
Yuan Xiao, Jiaming Wang, Yuchen Chen, Wei Song, Jun Sun, Shiqing Ma, Yanzhou Mu, Juan Zhai, Chunrong Fang, Jin Song Dong, Zhenyu Chen
| Challenge: | Existing methods for dataset poisoning require full-dataset poison, which breaks code compilability. |
| Approach: | They propose a functionality-preserving poisoning approach that injects short, compilable weak-use fragments into executed code paths. |
| Outcome: | The proposed method contaminates 10% of the dataset while maintaining 100% compilability and functional correctness. |
FAQ: Mitigating Quantization Error via Regenerating Calibration Data with Family-Aware Quantization (2026.findings-acl)
Copied to clipboard
| Challenge: | representativeness and universality of calibration data remain a bottleneck in quantization accuracy. |
| Approach: | They propose a framework that leverages prior knowledge from LLMs to generate calibration samples . their framework reduces accuracy loss by up to 28.5% compared to baseline . |
| Outcome: | Experiments show that family-aware quantization reduces accuracy loss by up to 28.5% compared to baseline data. |
Decomposed Prompt Tuning via Low-Rank Reparameterization (2023.findings-emnlp)
Copied to clipboard
| Challenge: | Pre-trained language models have achieved remarkable performance on various tasks. |
| Approach: | They propose a decomposed prompt tuning approach that utilizes low-rank matrices to initialize the soft prompt. |
| Outcome: | The proposed method significantly reduces the number of trainable parameters while maintaining effectiveness. |
SciMMIR: Benchmarking Scientific Multi-modal Information Retrieval (2024.findings-acl)
Copied to clipboard
Siwei Wu, Yizhi Li, Kang Zhu, Ge Zhang, Yiming Liang, Kaijing Ma, Chenghao Xiao, Haoran Zhang, Bohao Yang, Wenhu Chen, Wenhao Huang, Noura Al Moubayed, Jie Fu, Chenghua Lin
| Challenge: | Multi-modal information retrieval (MMIR) is a rapidly evolving field . current benchmarks for image-text pairings overlook the scientific domain . |
| Approach: | They develop a scientific domain-specific MMIR benchmark to evaluate image-text pairings using open-access research paper corpora. |
| Outcome: | The proposed benchmarks are based on 530K image-text pairs extracted from scientific documents with detailed captions. |
Analyzing the Rapid Generalization of SFT via the Perspective of Attention Head Activation Patterns (2025.acl-long)
Copied to clipboard
| Challenge: | Currently, LLMs learn in a data-driven schema while the instructions about complex tasks are both scarce and hard to collect or construct. |
| Approach: | They employ a gradient-based method to dissect the process that the Supervised Fine-tuning Process (SFT) adapts LLMs to downstream tasks via the perspective of attention patterns. |
| Outcome: | The proposed method dissects the process that the SFT process adapts LLMs to downstream tasks via the perspective of attention patterns. |
Analyzing Large Language Models’ Capability in Location Prediction (2024.lrec-main)
Copied to clipboard
| Challenge: | Large language models (LLMs) are underutilized in the field of location prediction due to the sparsity of geotagged tweets. |
| Approach: | They present experimental results with four large language models in various instruction finetuning and exemplar settings and analyze whether taking into account the context is beneficial. |
| Outcome: | The proposed model is able to predict location in a variety of settings, including fine tuning and exemplar settings, and it is compared with the best model in the literature. |
Rethinking Network Pruning – under the Pre-train and Fine-tune Paradigm (2021.naacl-main)
Copied to clipboard
| Challenge: | Existing pruning results on benchmark transformers, such as BERT, are not as remarkable as those of convolutional neural networks. |
| Approach: | They propose to apply a knowledge-aware pruning process to transformer-based pre-trained language models to reduce model size and model weight. |
| Outcome: | The proposed pruning method outperforms the leading competitors with a 20-times weight/FLOPs compression and neglectable loss in prediction accuracy. |
T 2 -NER: A Two-Stage Span-Based Framework for Unified Named Entity Recognition with Templates (2023.tacl-1)
Copied to clipboard
| Challenge: | Named Entity Recognition (NER) has evolved from flat to overlapped and discontinuous . NER is a text recognition task that recognizes mentions that represent entities in text . |
| Approach: | They propose a two-stage span-based framework to solve a unified NER task using two stages . they extract entity spans, classify over all entity span pairs and combine them to train two stages. |
| Outcome: | The proposed framework beats all the current competitive baselines on eight benchmark datasets, obtaining the best performance of unified NER. |
GRASP: Replace Redundant Layers with Adaptive Singular Parameters for Efficient Model Compression (2025.emnlp-main)
Copied to clipboard
| Challenge: | Recent studies have demonstrated that many layers are functionally redundant in large language models (LLMs), enabling model compression by removing these layers to reduce inference cost. |
| Approach: | They propose a framework that removes redundant layers to reduce inference cost by preserving sensitivity-aware singular values. |
| Outcome: | The proposed framework outperforms existing methods in 90% of the original model under a 20% compression ratio. |
Controllable Mixed-Initiative Dialogue Generation through Prompting (2023.acl-short)
Copied to clipboard
| Challenge: | Mixed initiative dialogue systems allow all interacting agents to initiate actions to control the interaction. |
| Approach: | They propose to prompt large language models as a drop-in replacement for fine-tuning on conditional generation. |
| Outcome: | The proposed prompts improve fine-tuning and ground truth responses . the results show that generated responses are high . |
On Continual Model Refinement in Out-of-Distribution Data Streams (2022.acl-long)
Copied to clipboard
| Challenge: | Existing continual learning (CL) problems cannot cover real-world scenarios such as out-of-distribution errors. |
| Approach: | They propose a continual model refinement problem formulation to solve this problem . they extend several existing continual learning approaches to the CMR problem based on a general sampling algorithm . |
| Outcome: | The proposed model refinement solution improves on existing models and their performance metrics. |
LocalRQA: From Generating Data to Locally Training, Testing, and Deploying Retrieval-Augmented QA Systems (2024.acl-demos)
Copied to clipboard
| Challenge: | Existing tools for augmented question-answering do not support researchers and developers to customize the training, testing, and deployment process. |
| Approach: | They propose an open-source toolkit that features a wide selection of model training algorithms, evaluation methods, and deployment tools curated from the latest research. |
| Outcome: | The proposed framework trains and deploys 7B-models with the same performance as OpenAI’s text-ada-002 and GPT-4-turbo. |
UNIMO-2: End-to-End Unified Vision-Language Grounded Learning (2022.findings-acl)
Copied to clipboard
| Challenge: | Existing methods for vision-language pre-training can only learn from aligned image-caption data and rely heavily on expensive regional features. |
| Approach: | They propose an end-to-end unified-modal pre-training framework for joint learning . they propose to conduct grounded learning on both images and texts via a sharing grounded space . |
| Outcome: | The proposed model improves visual and visual semantic alignment on images and texts. |
Is ChatGPT a Good Causal Reasoner? A Comprehensive Evaluation (2023.findings-emnlp)
Copied to clipboard
| Challenge: | Existing methods to evaluate ChatGPT's causal reasoning abilities are based on pre-trained language models, but they rely on supervised training. |
| Approach: | They conduct the first comprehensive evaluation of ChatGPT’s causal reasoning capabilities using four state-of-the-art (STA) simulations. |
| Outcome: | The proposed model is not a good causal reasoner, but a great causal interpreter. |
Context-attended Adversarial Reinforcement Learning for Robust Multi-step Retrieval Augmented Generation (2026.findings-acl)
Copied to clipboard
| Challenge: | Existing approaches to multi-step retrieval-augmented generation are susceptible to retrieval noise and fabricated documents in real-world scenarios. |
| Approach: | They propose a framework for multi-step retrieval-augmented generation that incorporates external knowledge into a retriever to generate responses from adversarial samples. |
| Outcome: | The proposed framework improves performance in multiple noisy scenarios and can be used to improve multi-step retrieval-augmented generation. |
Towards Stable Natural Language Understanding via Information Entropy Guided Debiasing (2023.acl-long)
Copied to clipboard
| Challenge: | Existing approaches to debiase Natural Language Understanding models use dataset biases instead of learning the intended task. |
| Approach: | They propose a debiasing framework that detects and purifies dataset biases using information entropy. |
| Outcome: | The proposed framework improves the stability of performance on out-of-distribution datasets for a set of widely adopted NLU models. |
Thermometer of Thoughts: Enhancing LLM’s Exploration via Attention Temperature Modulation (2026.acl-long)
Copied to clipboard
| Challenge: | Recent advances in the reasoning capabilities of large language models have enabled them to tackle complex tasks such as mathematics reasoning. |
| Approach: | They propose a method that modulates attention temperature dynamically to shift LLM's internal focus during reasoning, enabling a dynamic shift between exploratory and focused modes. |
| Outcome: | The proposed method improves Pass@10 by 6.78–14.20% and aggregation accuracy by 9.74% across 7 reasoning benchmarks. |
Coherent Entity Disambiguation via Modeling Topic and Categorical Dependency (2023.findings-emnlp)
Copied to clipboard
| Challenge: | Existing entity disambiguation methods struggle to capture explicit discourse-level dependencies, resulting in incoherent predictions at the abstract level. |
| Approach: | They propose an unsupervised variational autoencoder to extract latent topic vectors of context sentences to enhance coherence of entity predictions. |
| Outcome: | The proposed system achieves state-of-the-art on popular ED benchmarks with an average improvement of 1.3 F1 points. |
On the Zero-Shot Generalization of Machine-Generated Text Detectors (2023.findings-emnlp)
Copied to clipboard
| Challenge: | rampant proliferation of large language models generates text indistinguishable from human-written language. |
| Approach: | They train neural detectors on outputs of a new generator and test their performance on held-out generators. |
| Outcome: | The proposed detectors can be built on training data from medium-sized models. |
Hybrid Inverted Index Is a Robust Accelerator for Dense Retrieval (2023.emnlp-main)
Copied to clipboard
| Challenge: | Inverted file structure is a common technique for accelerating dense retrieval, but its lossy nature degrades it. |
| Approach: | They propose a hybrid index where embedding clusters and salient terms work collaboratively to accelerate dense retrieval. |
| Outcome: | The proposed method achieves lossless retrieval quality with competitive efficiency across index settings. |
AIGT: AI Generative Table Based on Prompt (2025.coling-main)
Copied to clipboard
| Challenge: | Tabular data is an essential resource for many fields, but current methods do not fully utilize the rich information available in tables. |
| Approach: | They propose a method that utilizes metadata information to generate tabular data . they propose long-token partitioning algorithms that enable AIGT to model tables of any scale . |
| Outcome: | The proposed approach achieves state-of-the-art on 14 out of 20 public datasets and two real industry datasets within the Alipay risk control system. |
Efficient Hyperparameter Optimization for LLM Reinforcement Learning (2026.acl-long)
Copied to clipboard
| Challenge: | Existing hyperparameter optimization methods are inefficient in reinforcement learning due to model scale and resource-intensive training cycles. |
| Approach: | They propose a hyperparameter optimization method that adapts both model size and training budget as fidelity. |
| Outcome: | The proposed method significantly improves the computational efficiency of each trial (up to 14.9) over existing HPO methods. |
Fine-Grained Legal Argument-Pair Extraction via Coarse-Grained Pre-training (2024.lrec-main)
Copied to clipboard
| Challenge: | Current methods conceptualize LAE as a supervised sentence-pair classification problem and necessitate extensive manual annotations. |
| Approach: | They propose a model that focuses on fine-grained alignment of argument pairs building upon coarse-grain complaint-defense pairs. |
| Outcome: | The proposed model outperforms baseline models by 3.7 and 2.4 points on average. |
Shall We Pretrain Autoregressive Language Models with Retrieval? A Comprehensive Study (2023.emnlp-main)
Copied to clipboard
Boxin Wang, Wei Ping, Peng Xu, Lawrence McAfee, Zihan Liu, Mohammad Shoeybi, Yi Dong, Oleksii Kuchaiev, Bo Li, Chaowei Xiao, Anima Anandkumar, Bryan Catanzaro
| Challenge: | a recent study shows that retrieval-augmented LMs can improve text generation quality and accuracy. |
| Approach: | They propose a model that reproduces RETRO parameters while retrieving a text corpus . they find RETRO outperforms GPT on text generation with less repetition . |
| Outcome: | The proposed model outperforms standard retrieval-augmented GPT and retrieval augmented GTP on text generation and accuracy tasks. |
Revisiting Self-Play Preference Optimization: On the Role of Prompt Difficulty (2026.findings-acl)
Copied to clipboard
| Challenge: | incorporating difficult prompts into training fails to enhance overall performance, e.g., as prompt difficulty decreases. |
| Approach: | They investigate how prompts of varying difficulty influence self-play preference optimization . they use the reward of sampled responses of a prompt as a proxy for its difficulty . |
| Outcome: | The proposed model improves on difficult prompts and easy prompts, but fails to train on difficult ones and learns from failures. |
DMIN: A Discourse-specific Multi-granularity Integration Network for Conversational Aspect-based Sentiment Quadruple Analysis (2024.findings-acl)
Copied to clipboard
| Challenge: | Existing studies focus on enhancing token-level interactions, but lack sufficient modeling of discourse structure information. |
| Approach: | They propose to use a discourse structure called "thread" to enhance token interaction among different utterances. |
| Outcome: | The proposed model achieves state-of-the-art on two datasets. |
Boosting Event Extraction with Denoised Structure-to-Text Augmentation (2023.findings-acl)
Copied to clipboard
Bo Wang, Heyan Huang, Xiaochi Wei, Ge Shi, Xiao Liu, Chong Feng, Tong Zhou, Shuaiqiang Wang, Dawei Yin
| Challenge: | Existing methods for event extraction neglect grammatical incorrectness, structure misalignment, and semantic drifting . et al., 2004; Ahn, 2006) show that the proposed method generates more diverse text representations for event extracting compared with the state-of-the-art. |
| Approach: | They propose a framework for event extraction that generates additional training data and iteratively selects the effective subset from the generated training data. |
| Outcome: | The proposed method generates more diverse representations of training data and achieves comparable results with the state-of-the-art. |
Real-time Scholarly Retweeting Prediction System (C18-2)
Copied to clipboard
| Challenge: | a scholarly retweeting prediction system is proposed to predict scholarly tweets . re-tweening is an action of reposting others' tweet by using the reretwet button on Twitter . |
| Approach: | They propose a real-time scholarly retweeting prediction system that retrieves scholarly tweets which will be re-tweeled. |
| Outcome: | The proposed system outperforms baseline systems and can predict scientific impact in real-time. |
Copyright Detective: A Forensic System to Evidence LLMs Flickering Copyright Leakage Risks (2026.acl-demo)
Copied to clipboard
Guangwei Zhang, Jianing Zhu, Cheng Qian, Neil Zhenqiang Gong, Rada Mihalcea, Zhaozhuo Xu, Jingrui He, Jiaqi W. Ma, Chaowei Xiao, Bo Li, Ahmed Abbasi, Dongwon Lee, Heng Ji, Denghui Zhang
| Challenge: | **Copyright Detective** is the first interactive forensic system for detecting, analyzing, and visualizing potential copyright risks in LLM outputs. |
| Approach: | They propose a system that detects copyright infringements and visualizes them . they use content recall testing, paraphrase-level similarity analysis and persuasive jailbreak probing . |
| Outcome: | The proposed system detects, analyzes, and visualizes potential copyright risks in LLM outputs. |
On Vision Features in Multimodal Machine Translation (2022.acl-long)
Copied to clipboard
| Challenge: | Recent work on multimodal machine translation (MMT) has focused on the way of incorporating vision features into translation but little attention is given to the quality of vision models. |
| Approach: | They develop a selective attention model to study the patch-level contribution of an image in multimodal machine translation. |
| Outcome: | The proposed model is able to learn translation from the visual modality on probing tasks and is compared with existing models. |
Shallow-to-Deep Training for Neural Machine Translation (2020.emnlp-main)
Copied to clipboard
| Challenge: | Experimental results show that deep training is 1:4 faster than training from scratch. |
| Approach: | They propose a shallow-to-deep training method that learns deep models by stacking shallow models. |
| Outcome: | The proposed method is 1:4 faster than training from scratch and achieves BLEU scores of 30:33 and 43:29 on two translation tasks. |
Middleware for LLMs: Tools Are Instrumental for Language Agents in Complex Environments (2024.emnlp-main)
Copied to clipboard
| Challenge: | Large language models (LLMs) are generalist agents capable of operating within complex environments. |
| Approach: | They propose a class of tools that can serve as a middleware layer shielding LLMs from environmental complexity. |
| Outcome: | The proposed tool can shield the LLM from environmental complexity in two representative complex environments. |
COSMOS: Connectivity-Oriented Submodular Maximization for Optimal Subgraph Retrieval (2026.acl-long)
Copied to clipboard
| Challenge: | Existing paradigms treat facts independently or employ myopic search, failing to optimize collective subgraph utility. |
| Approach: | They propose a framework that formalizes evidence retrieval as a constrained submodular maximization problem. |
| Outcome: | The proposed framework captures the trade-off between information relevance and structural complexity. |
FashionKLIP: Enhancing E-Commerce Image-Text Retrieval with Fashion Multi-Modal Conceptual Knowledge Graph (2023.acl-industry)
Copied to clipboard
Xiaodan Wang, Chengyu Wang, Lei Li, Zhixu Li, Ben Chen, Linbo Jin, Jun Huang, Yanghua Xiao, Ming Gao
| Challenge: | Recent advances in visual-language pre-trained (VLP) models have greatly improved cross-modal retrieval performance . however, the fine-grained interactions between objects from different modalities are far from well-established . e-commerce domain lacks sufficient training data and fine-granular cross-modulal knowledge . |
| Approach: | They propose a visual-language pre-trained (VLP) image-text retrieval model that integrates cross-modal knowledge into the model to improve performance. |
| Outcome: | The proposed model improves performance on e-commerce image-text retrieval task by a large margin. |
Jailbreaking Attacks vs. Content Safety Filters: How Far Are We in the LLM Safety Arms Race? (2026.findings-acl)
Copied to clipboard
| Challenge: | Existing studies have focused on the models, neglecting the full deployment pipeline . previous studies have underestimated the practical success of these attacks . |
| Approach: | They evaluate the effectiveness of jailbreak attacks targeting LLM safety alignment . they highlight critical gaps and call for further refinement of detection accuracy and usability . |
| Outcome: | The proposed attacks can detect at least one safety filter across the entire deployment pipeline. |
RoCoIns: Enhancing Robustness of Large Language Models through Code-Style Instructions (2024.lrec-main)
Copied to clipboard
| Challenge: | Large Language Models (LLMs) have shown remarkable capabilities in following human instructions and solving NLU tasks. |
| Approach: | They propose to use code style instructions to replace typically natural language instructions to provide more precise instructions and strengthen the robustness of LLMs. |
| Outcome: | The proposed method outperforms natural language models on eight robustness datasets and achieves an improvement of 5.68% in test set accuracy and a reduction of 5.66 points in Attack Success Rate (ASR). |
Enhancing Neural Machine Translation Through Target Language Data: A kNN-LM Approach for Domain Adaptation (2025.acl-long)
Copied to clipboard
Abudurexiti Reheman, Hongyu Liu, Junhao Ruan, Abudukeyumu Abudula, Yingfeng Luo, Tong Xiao, JingBo Zhu
| Challenge: | Neural machine translation (NMT) has made significant progress in recent years, yet often suffers from translating in new domains, which is called domain adaptation. |
| Approach: | They propose a method that leverages semantically similar target language sentences in the kNN framework and generates a probability distribution over these sentences during decoding. |
| Outcome: | The proposed method generates a probability distribution over similar target language sentences and then interpolates with the model’s distribution. |
VL-Calibration: Decoupled Confidence Calibration for Large Vision-Language Models Reasoning (2026.acl-long)
Copied to clipboard
| Challenge: | Existing verbalized confidence calibration methods for large vision language models optimize a single holistic confidence score using binary answer-level correctness. |
| Approach: | They propose a reinforcement learning framework that explicitly decouples confidence into visual and reasoning confidence. |
| Outcome: | Experiments show that the proposed framework decouples confidence into visual and reasoning confidence while suppressing ungrounded hallucinations while preserving valid perception. |
Enhancing Multimodal Named Entity Recognition through Adaptive Mixup Image Augmentation (2025.coling-main)
Copied to clipboard
| Challenge: | Current named entity recognition methods struggle with text-image mismatch problem due to a lack of visual context. |
| Approach: | They propose an adaptive mixup image augmentation method that generates augmented images based on matching score between text and image . |
| Outcome: | The proposed method can be integrated into existing models and demonstrate consistent performance improvements. |
Crafting Customisable Characters with LLMs: A Persona-Driven Role-Playing Agent Framework (2025.findings-emnlp)
Copied to clipboard
Bohao Yang, Dong Liu, Chenghao Xiao, Kun Zhao, Chen Tang, Chao Li, Lin Yuan, Yang Guang, Chenghua Lin
| Challenge: | Large Language Models (LLMs) are capable of generating human-like text, but the potential for freely customisable characters remains underexplored. |
| Approach: | They propose a framework which employs Large Language Models to create freely customisable characters through personalised characteristic feature injection. |
| Outcome: | The proposed framework provides valuable insights for developing more accurate and customisable human simulacra. |
LongBench: A Bilingual, Multitask Benchmark for Long Context Understanding (2024.acl-long)
Copied to clipboard
Yushi Bai, Xin Lv, Jiajie Zhang, Hongchang Lyu, Jiankai Tang, Zhidian Huang, Zhengxiao Du, Xiao Liu, Aohan Zeng, Lei Hou, Yuxiao Dong, Jie Tang, Juanzi Li
| Challenge: | Large language models (LLMs) can only handle texts a few thousand tokens long, limiting their applications on longer sequence inputs, such as books, reports, and codebases. |
| Approach: | They propose a bilingual, multi-task benchmark for long context understanding that extends context windows and more sophisticated memory mechanisms to improve models' long context capabilities. |
| Outcome: | The proposed model outperforms open-source models but struggles on longer contexts. |
Gold-Medal-Level Olympiad Geometry Solving with Efficient Heuristic Auxiliary Constructions (2026.acl-long)
Copied to clipboard
Boyan Duan, Xiao Liang, Shuai Lu, Yaoxiang Wang, Yelong Shen, Kai-Wei Chang, Ying Nian Wu, Mao Yang, Weizhu Chen, Yeyun Gong
| Challenge: | Existing methods for geometry theorem proving in Euclidean geometry are challenging and require a neural network to perform. |
| Approach: | They propose a method for adding auxiliary points in geometry that runs on CPUs without relying on neural network-based inference. |
| Outcome: | The proposed method achieves silver-medal-level human performance on IMO-30 benchmark. |
MirageBackdoor: A Stealthy Attack that Induces Think-Well-Answer-Wrong Reasoning (2026.acl-long)
Copied to clipboard
| Challenge: | Existing CoT backdoor attacks manipulate intermediate reasoning steps to steer the model toward incorrect answers, but these corrupted reasoning traces are readily detected by prevalent process-monitoring defenses. |
| Approach: | They propose a backdoor attack that exploits the model's post-output space to preserve clean CoTs while selectively steering the final answer toward a specific target. |
| Outcome: | Experiments show that MirageBD achieves over 90% success rate across four datasets and five models with a poison ratio of only 5%. |
Parameter-Efficient Prompt Tuning Makes Generalized and Calibrated Neural Text Retrievers (2023.findings-emnlp)
Copied to clipboard
| Challenge: | Prompt tuning is a technique that updates few parameters in pre-trained models for language understanding and generation tasks. |
| Approach: | They propose to leverage prompt tuning for neural text retrieval to improve generalization and cross-domain generalization. |
| Outcome: | The proposed approach can mitigate the two issues faced by fine-tuning retrieval methods and improve the out-of-domain zero-shot generalization of the retrieval models. |
Human-Centered Evaluation of Language Technologies (2024.emnlp-tutorials)
Copied to clipboard
| Challenge: | a lack of human-centered considerations about people’s needs for language technologies is causing an “evaluation crisis” in NLP. |
| Approach: | This tutorial introduces perspectives and methodologies from human-computer interaction (HCI) it will introduce what to evaluate for, how generalizable the results are to the real-world contexts, and pragmatic costs to conduct the evaluation. |
| Outcome: | This tutorial introduces perspectives and methodologies from human-computer interaction (HCI) the tutorial will also encourage reflection on how these HCI perspectives and methods can complement NLP evaluation through Q&A discussions and a hands-on exercise. |
ExCAR: Event Graph Knowledge Enhanced Explainable Causal Reasoning (2021.acl-long)
Copied to clipboard
| Challenge: | Existing work infers the causation between events based on knowledge from annotated causal event pairs, but additional evidence information is unexploited. |
| Approach: | They propose an Event graph knowledge enhanced explainable CAusal Reasoning framework that acquires additional evidence information from a large-scale causal event graph as logical rules for causal reasoning. |
| Outcome: | The proposed framework outperforms state-of-the-art methods in human evaluation and in animal models. |
Collision to Cognition: Hash-Driven Graph Construction for Efficient RAG (2026.acl-long)
Copied to clipboard
Chuang Zhou, Zheng Yuan, Linhao Luo, Zhaozhuo Xu, Yilin Xiao, Junnan Dong, Siyu An, di Yin, Xing Sun, Xiao Huang
| Challenge: | Retrieval-augmented generation (RAG) has been used for enhancing large language models with external knowledge. |
| Approach: | They propose a framework for mining efficient graph structures via hashing to enhance RAG . they adopt an inductive paradigm where global graph structure emerges from local hash collisions . |
| Outcome: | The proposed framework outperforms existing baselines while requiring no GPU resources or token budget. |
Com2 : A Causal-Guided Benchmark for Exploring Complex Commonsense Reasoning in Large Language Models (2025.acl-long)
Copied to clipboard
Kai Xiong, Xiao Ding, Yixin Cao, Yuxiong Yan, Li Du, Yufei Zhang, Jinglong Gao, Jiaqian Liu, Bing Qin, Ting Liu
| Challenge: | Existing works focus on complex tasks like math and code, while complex commonsense reasoning remains underexplored due to its uncertainty and lack of structure. |
| Approach: | They propose to build a benchmark for large language models based on complex commonsense reasoning based upon causal event graphs and causal theory. |
| Outcome: | The proposed benchmark combines a complex commonsense reasoning benchmark with a detective story to achieve a more challenging subset. |
SWING: Balancing Coverage and Faithfulness for Dialogue Summarization (2023.findings-eacl)
Copied to clipboard
Kung-Hsiang Huang, Siffi Singh, Xiaofei Ma, Wei Xiao, Feng Nan, Nicholas Dingwall, William Yang Wang, Kathleen McKeown
| Challenge: | Existing approaches to dialogue summarization rely on features of conversation data. |
| Approach: | They propose to use natural language inference models to improve coverage and faithfulness . they use fine-grained training signals to encourage model to generate missing content . |
| Outcome: | The proposed model achieves higher faithfulness and coverage while maintaining conciseness compared to prior methods. |
Latent Learningscape Guided In-context Learning (2024.findings-acl)
Copied to clipboard
| Challenge: | Existing methods to select demonstrations based on surface-level semantic similarities fall short of identifying the most fitting ones. |
| Approach: | They propose a method that characterizes latent learningscape features of demonstrations and uses them to create more effective prompts. |
| Outcome: | The proposed method outperforms leading models in arithmetic, commonsense, and symbolic reasoning tasks showing an average increase in scores by 7.4 percentage points. |
Large Language Models Can Be Contextual Privacy Protection Learners (2024.emnlp-main)
Copied to clipboard
Yijia Xiao, Yiqiao Jin, Yushi Bai, Yue Wu, Xianjun Yang, Xiao Luo, Wenchao Yu, Xujiang Zhao, Yanchi Liu, Quanquan Gu, Haifeng Chen, Wei Wang, Wei Cheng
| Challenge: | Large Language Models (LLMs) have demonstrated remarkable linguistic comprehension and generation capability, but when applied to specialized industries, they face challenges such as hallucination, insufficient domain knowledge, and failing to incorporate the latest domain knowledge. |
| Approach: | They propose a paradigm for fine-tuning LLMs that effectively injects domain-specific knowledge while safeguarding inference-time data privacy. |
| Outcome: | The proposed model protects private data while enhancing the model's knowledge. |
Benchmarking Automated Clinical Language Simplification: Dataset, Algorithm, and Evaluation (2022.coling-1)
Copied to clipboard
| Challenge: | Existing studies to translate medical jargon into layperson-understandable language focus on accuracy and readability aspects of clinical language. |
| Approach: | They propose to construct a dataset to support automated clinical language simplification and propose a model that mimics the human annotation procedure. |
| Outcome: | The proposed model matches human annotation procedures and achieves state-of-the-art performance compared with baselines. |
LRBench and Judge-R1: Principled Evaluation and Training of LLM-Based Judges for Long-Context Reasoning (2026.findings-acl)
Copied to clipboard
| Challenge: | Existing benchmarks for evaluating large language models (LLMs) under long contexts are underexplored. |
| Approach: | They propose a large-scale benchmark for evaluating large language models (LLMs) that combines reinforcement learning with multi-turn search to enable grounded and principle-aware evaluation. |
| Outcome: | The proposed model outperforms single-turn baselines across domains and principles. |
Fine-grained Entity Typing via Label Reasoning (2021.emnlp-main)
Copied to clipboard
| Challenge: | Existing approaches to fine-grained entity typing are based on independent classification paradigms, which make them difficult to recognize inter-dependent, long-tailed and fine-granular entities. |
| Approach: | They propose a label reasoning network that exploits label dependencies knowledge entailed in the data. |
| Outcome: | The proposed network can model, learn and reason complex labels in a sequence-to-set, end-to end manner. |
Proactive Guidance of Multi-Turn Conversation in Industrial Search (2025.acl-industry)
Copied to clipboard
| Challenge: | Large Language Models (LLMs) have advanced multi-turn conversation systems, emphasizing the need for proactive guidance to enhance users’ interactions. |
| Approach: | They propose a goal-adaptive supervised fine-tuning framework that generates proactive guidance for users to click for the next turn of the conversation. |
| Outcome: | The proposed framework achieves 86.10% accuracy in offline evaluation (+23.95% over baseline) and 25.28% CTR in online deployment (149.06% relative improvement). |
Pay More Attention to Images: Numerous Images-Oriented Multimodal Summarization (2025.naacl-long)
Copied to clipboard
| Challenge: | Existing multimodal summarization approaches struggle with scenarios involving multiple images as input. |
| Approach: | They propose a task to generate multimodal summaries by integrating multiple images as input . they propose 'multimodal information evaluation' method that measures differences between generated summary and input based on multimodal input - and compares various methods . |
| Outcome: | The proposed method correlates more closely with human judgments than five widely used metrics . |
Automated Profile Inference with Language Model Agents (2026.findings-acl)
Copied to clipboard
| Challenge: | Existing privacy protections for large language models (LLMs) are limited due to the potential for malicious applications. |
| Approach: | They propose an automated profile inference framework that can extract personal information from public online activities by an adversary with the help of large language model (LLM) based agents. |
| Outcome: | The proposed framework is highly effective and efficient and the inferred attributes are both identifiable and sensitive, posing significant privacy risks. |
Prior Relational Schema Assists Effective Contrastive Learning for Inductive Knowledge Graph Completion (2024.lrec-main)
Copied to clipboard
| Challenge: | Existing knowledge graphs lack robustness and incompleteness to provide link prediction. |
| Approach: | They propose to capture prior schema-level interactions related to relations by leveraging entity type information and introduce schema-guided negatives to bolster the efficiency of normal contrastive representation learning. |
| Outcome: | The proposed method achieves state-of-the-art performance on multiple established metrics across multiple datasets for link prediction. |
InternLM-Law: An Open-Sourced Chinese Legal Large Language Model (2025.coling-main)
Copied to clipboard
| Challenge: | InternLM-Law is a large language model (LLM) tailored for addressing diverse legal tasks related to Chinese laws. |
| Approach: | They introduce a large language model (LLM) tailored for addressing diverse legal tasks related to Chinese laws. |
| Outcome: | The proposed model performs better than existing models in a variety of legal tasks related to Chinese laws. |
Instructional Fingerprinting of Large Language Models (2024.naacl-long)
Copied to clipboard
| Challenge: | Large language models (LLMs) require considerable cost to train from scratch . fingerprinting is essential to protect intellectual property and to ensure downstream users and developers adhere to their license terms. |
| Approach: | They propose a method for fingerprinting Large language models that implants a private key into the model to generate specific text when the key is present. |
| Outcome: | The proposed method prevents publisher overclaim and maintains robustness against fingerprint guessing and parameter-efficient training. |
AnalyticKWS: Towards Exemplar-Free Analytic Class Incremental Learning for Small-footprint Keyword Spotting (2025.findings-acl)
Copied to clipboard
| Challenge: | Keyword spotting (KWS) is a useful mechanism to identify spoken commands in voice-enabled systems, but catastrophic forgetting is causing models to lose their ability to recognize earlier keywords. |
| Approach: | They propose an exemplar-free method that updates model parameters without revisiting earlier data. |
| Outcome: | The proposed method outperforms existing continual learning methods on a variety of datasets and settings. |
Joint Event Extraction with Hierarchical Policy Network (2020.coling-main)
Copied to clipboard
| Challenge: | Existing work on event extraction (EE) is pipelined or uses a joint structure but does not utilize information interactions among event triggers, event arguments, and argument roles. |
| Approach: | They propose to exploit role information of arguments in an event and devise a Hierarchical Policy Network to perform joint EE. |
| Outcome: | The proposed system outperforms existing methods and is more powerful for sentences with multiple events. |
STGN: an Implicit Regularization Method for Learning with Noisy Labels in Natural Language Processing (2022.emnlp-main)
Copied to clipboard
| Challenge: | Existing work to mitigate the effect of noisy labels is limited to specific tasks or training procedures, making it hard to be widely used. |
| Approach: | They propose a stochastic tailor-made gradient noise to mitigate the effect of noisy labels by introducing benign noise into stochistic gradient descent. |
| Outcome: | The proposed method can be used to discriminate correct samples from incorrect ones and boost existing training methods. |
BASS: Boosting Abstractive Summarization with Unified Semantic Graph (2021.acl-long)
Copied to clipboard
| Challenge: | Abstractive summarization for long-document or multi-document remains challenging for Seq2Seq as it does not analyze long-distance relations in text. |
| Approach: | They propose a framework for Boosting Abstractive Summarization based on a unified Semantic graph which aggregates co-referent phrases distributing across a long range of context and conveys rich relations between phrases. |
| Outcome: | The proposed framework improves document representation and summary generation process by leveraging the graph structure. |
Noise Robust Named Entity Understanding for Voice Assistants (2021.naacl-industry)
Copied to clipboard
Deepak Muralidharan, Joel Ruben Antony Moniz, Sida Gao, Xiao Yang, Justine Kao, Stephen Pulman, Atish Kothari, Ray Shen, Yinying Pan, Vivek Kaul, Mubarak Seyed Ibrahim, Gang Xiang, Nan Dun, Yidan Zhou, Andy O, Yuan Zhang, Pooja Chitkara, Xuan Wang, Alkesh Patel, Kushal Tayal, Roger Zheng, Peter Grasch, Jason D Williams, Lin Li
| Challenge: | Named Entity Recognition and Entity Linking are challenging for voice assistants . utterances are relatively short, so there is not much context to help disambiguate . |
| Approach: | They propose a Named Entity Understanding system that combines NER and EL in a joint reranking module. |
| Outcome: | The proposed framework improves NER accuracy by up to 3.13% and EL accuracy by 3.6% in F1 score . it also leads to better accuracies in other natural language understanding tasks . |
Extractive Summarization of Long Documents by Combining Global and Local Context (D19-1)
Copied to clipboard
| Challenge: | Existing methods for extractive and abstractive summarization are far from human performance. |
| Approach: | They propose a neural single-document extractive summarization model for long documents that incorporates both the global context of the whole document and the local context. |
| Outcome: | The proposed model outperforms previous models on ROUGE-1, ROUGEE-2 and METEOR scores on two datasets of scientific papers. |
X-ray Made Simple: Lay Radiology Report Generation and Robust Evaluation (2026.findings-acl)
Copied to clipboard
Kun Zhao, Chenghao Xiao, Sixing Yan, Haoteng Tang, William K. Cheung, Noura Al Moubayed, Liang Zhan, Chenghua Lin
| Challenge: | Technical language and templated nature of professional reports hinder patient comprehension and allow models to artificially boost lexical metrics such as BLEU by reproducing common report patterns. |
| Approach: | They propose a layman's RRG framework that leverages layperson-friendly language to enhance patient accessibility and promote robust evaluation and report generation by encouraging models to focus on semantic accuracy over rigid templates. |
| Outcome: | The proposed framework improves model performance with more layman-style data, compared to templated professional language and inflated lexical scores. |
PIGuard: Prompt Injection Guardrail via Mitigating Overdefense for Free (2025.acl-long)
Copied to clipboard
| Challenge: | Prompt injection attacks pose a critical threat to large language models, enabling goal hijacking and data leakage. |
| Approach: | They propose a prompt guard model that incorporates a new training strategy to mitigate over-defense for free . PIGuard significantly reduces the bias on trigger words, enabling fine-grained evaluation . |
| Outcome: | The proposed model outperforms the existing model on diverse benchmarks by 30.4%. |
Data Augmentation with Hierarchical SQL-to-Question Generation for Cross-domain Text-to-SQL Parsing (2021.emnlp-main)
Copied to clipboard
| Challenge: | Existing approaches to parse text-to-SQL data are lacking labeled data for unseen evaluation databases. |
| Approach: | They propose a framework for enhancing SQL queries by automatically producing large numbers of SQL queries based on an abstract syntax tree grammar. |
| Outcome: | The proposed framework can produce high-quality natural language questions over strong baselines. |
Enhancing Explainable Rating Prediction through Annotated Macro Concepts (2024.acl-long)
Copied to clipboard
| Challenge: | Existing models learn user and item embeddings and generate reasons based on these embedds. |
| Approach: | They propose a concept-based explanation framework that leverages macro concepts to bridge the gap between the user/item embeddings and the recommendation reasons. |
| Outcome: | Extensive experiments on three datasets prove the proposed model is superior to existing models. |
Logits Reranking via Semantic Labels for Hard Samples in Text Classification (2024.findings-emnlp)
Copied to clipboard
| Challenge: | Existing research on text classification models ignores the semantic information inherent in labels, treating them as one-hot vectors. |
| Approach: | They propose a model-agnostic method that leverages label semantics and auto detection of hard samples to improve classification accuracy. |
| Outcome: | The proposed method shows significant improvements across different PLMs. |
Complex Logical Query Answering by Calibrating Knowledge Graph Completion Models (2024.findings-acl)
Copied to clipboard
| Challenge: | Existing methods to solve complex logical queries are not well-calibrated . CKGC is lightweight and effective, allowing the model to quickly converge . |
| Approach: | They propose a method for calibrating KGC models to adapt to complex logical queries . they map the values of predictions of KGC to the range [0, 1] . |
| Outcome: | The proposed method can significantly boost model performance in complex logical query answering task. |
ConFit v2: Improving Resume-Job Matching using Hypothetical Resume Embedding and Runner-Up Hard-Negative Mining (2025.findings-acl)
Copied to clipboard
| Challenge: | Existing methods to model resume-job fit are sparse since job seekers apply to only a few jobs. |
| Approach: | They propose two techniques to enhance the encoder’s contrastive training process by augmenting job data with hypothetical reference resume generated by a large language model and creating high-quality hard negatives from unlabeled resume/job pairs using a novel hard-negative mining strategy. |
| Outcome: | The proposed method outperforms ConFit and prior methods on two real-world datasets and achieves an average improvement of 13.8% in recall and 17.5% in nDCG across job-ranking and resume-ranker tasks. |
CritiqueLLM: Towards an Informative Critique Generation Model for Evaluation of Large Language Model Generation (2024.acl-long)
Copied to clipboard
Pei Ke, Bosi Wen, Andrew Feng, Xiao Liu, Xuanyu Lei, Jiale Cheng, Shengyuan Wang, Aohan Zeng, Yuxiao Dong, Hongning Wang, Jie Tang, Minlie Huang
| Challenge: | Existing models for NLP evaluations lack the ability to generate informative critiques in pointwise grading and pairwise comparison especially without references. |
| Approach: | They propose a method which can acquire pointwise grading critiques with pseudo references and revise these critiques via multi-path prompting to obtain informative evaluation data in different tasks and settings. |
| Outcome: | The proposed method outperforms all open-source models and even GPT-4 in system-level correlations of pointwise grading. |
Taming Language Models for Text-attributed Graph Learning with Decoupled Aggregation (2025.acl-long)
Copied to clipboard
| Challenge: | Existing approaches to learning text-attributed graphs neglect interaction between textual and structural information. |
| Approach: | They propose a framework that integrates textual and structural information into TAG learning . they propose combining semantic aggregation and structural aggregations to improve learning a . |
| Outcome: | The proposed framework outperforms state-of-the-art learning methods while requiring less resources. |
A General Framework for Adaptation of Neural Machine Translation to Simultaneous Translation (2020.aacl-main)
Copied to clipboard
| Challenge: | Despite the success of neural machine translation, simultaneous neural machine translators are challenging due to syntactic structure difference and simultaneity requirements. |
| Approach: | They propose a framework for adapting neural machine translation to translate simultaneously . they propose 'prefix translation' that utilizes a consecutive NMT model to translate source prefixes . |
| Outcome: | The proposed framework balancing quality and latency on three translation corpora and two language pairs shows that it performs well. |
Capturing Conversational Interaction for Question Answering via Global History Reasoning (2022.findings-naacl)
Copied to clipboard
| Challenge: | Existing studies have studied history-dependent reasoning for question answering . utilizing global conversation history for enhancement is gaining interest . |
| Approach: | They propose to establish long-distance dependency among global utterances in multi-turn conversation. |
| Outcome: | The proposed method improves on QuAC by 1%, yielding the F1 score of 73.7%. |
Lexicon Enhanced Chinese Sequence Labeling Using BERT Adapter (2021.acl-long)
Copied to clipboard
| Challenge: | Existing methods for Chinese sequence labelling only fuse lexicon features via a shallow and random initialized sequence layer and do not integrate them into the bottom layers of BERT. |
| Approach: | They propose a Lexicon Enhanced BERT model which integrates external lexicon knowledge into BERT layers directly by a lexiccon Adapter layer. |
| Outcome: | The proposed model integrates external lexicon knowledge into BERT layers directly by a Lexicon Adapter layer. |
Improving Precancerous Case Characterization via Transformer-based Ensemble Learning (2022.emnlp-industry)
Copied to clipboard
Yizhen Zhong, Jiajie Xiao, Thomas Vetterli, Mahan Matin, Ellen Loo, Jimmy Lin, Richard Bourgon, Ofer Shapira
| Challenge: | Application of natural language processing (NLP) to cancer pathology reports has been focused on detecting cancer cases, ignoring precancerous cases. |
| Approach: | They developed transformer-based deep neural network NLP models to perform the CRC phenotyping with the goal of extracting precancerous lesion attributes and distinguishing cancer and precancirous cases. |
| Outcome: | The proposed model achieves 0.914 macro-F1 scores for classifying patients into negative, non-advanced adenoma, advanced adénoma and CRC. |
SpiderFlow: Efficient Topology-Aware Scheduling for LLM Training Across Decentralized GPU Clusters (2026.acl-long)
Copied to clipboard
| Challenge: | Existing approaches to training large language models lack topologyaware task scheduling mechanisms and model parallelization strategies. |
| Approach: | They propose a topology-aware scheduling system specifically designed for decentralized GPU clusters . they propose heuristic methods at the inter-cluster level with ILP-based optimization within clusters. |
| Outcome: | The proposed system reduces job completion time by 1.2-1.3 and improves throughput by 1.12-1.25 . it also reduces scheduling overhead by 20-90 on average compared to state-of-the-art scheduling systems. |
Zero-Shot Open-Schema Entity Structure Discovery (2026.eacl-long)
Copied to clipboard
Xueqiang Xu, Jinfeng Xiao, James Barry, Mohab Elkaref, Jiaru Zou, Pengcheng Jiang, Yunyi Zhang, Maxwell J Giammona, Geeth De Mel, Jiawei Han
| Challenge: | Existing methods based on large language models (LLMs) rely heavily on predefined entity attribute schemas or annotated datasets, often leading to incomplete extraction results. |
| Approach: | They propose a novel approach to entity structure extraction that does not require any schema or annotated datasets. |
| Outcome: | Experiments show that ZOES improves LLMs’ ability to extract more complete entity structures across three different domains, showcasing both the effectiveness and generalizability of the method. |
InfoPO: On Mutual Information Maximization for Large Language Model Alignment (2025.naacl-long)
Copied to clipboard
Teng Xiao, Zhen Ge, Sujay Sanghavi, Tian Wang, Julian Katz-Samuels, Marc Versage, Qingjun Cui, Trishul Chilimbi
| Challenge: | Recent studies have shown that direct preference optimization and its variants can be useful for fine-tuning large language models with human preferences data. |
| Approach: | They propose a preference fine-tuning algorithm that effectively and efficiently aligns large language models using preference data. |
| Outcome: | Extensive experiments show that the proposed algorithm outperforms established baselines on reasoning tasks. |
Beyond One-Size-Fits-All: Inversion Learning for Highly Effective NLG Evaluation Prompts (2026.tacl-1)
Copied to clipboard
| Challenge: | Evaluating natural language generation systems is challenging due to the diversity of valid outputs. |
| Approach: | They propose an inversion learning method that learns effective reverse mappings from model outputs back to their input instructions. |
| Outcome: | The proposed method requires only a single evaluation sample and eliminates manual prompt engineering. |
TartanMaroon: Multi-Agent Academic Advising with Iterative Negotiation and Transparent Collaboration (2026.acl-demo)
Copied to clipboard
| Challenge: | Academic advising is a critical yet resourceintensive component of higher education . monolithic model must simultaneously maintain awareness of heterogeneous institutional constraints . |
| Approach: | They propose a multi-agent academic advising system that handles the full complexity spectrum of student queries. |
| Outcome: | The proposed system handles the full complexity spectrum of student queries . it also provides a real-time transparency interface streaming agent reasoning and negotiation rounds to users . the system is released open-source and has been rated highly by users based on their results . |
Dynamic Low-rank Estimation for Transformer-based Language Models (2023.findings-emnlp)
Copied to clipboard
| Challenge: | RankDyna is a matrix decomposition method that can be used to compress Transformer-based language models. |
| Approach: | They propose a matrix decomposition method that enables dynamic rank resource allocation . they say it can outperform current SOTA methods under various parameter budget levels . |
| Outcome: | The proposed method outperforms current SOTA methods under various budget levels . the proposed method is more efficient with higher compression rates . |
MultiLingPoT: Boosting Mathematical Reasoning in LLMs through Multilingual Program Integration (2025.findings-emnlp)
Copied to clipboard
| Challenge: | Program-of-Thought is an important way for LLMs to solve mathematical problems. |
| Approach: | They propose a multilingual programme reasoning method that uses program instead of natural language in reasoning and proposes to integrate multilingual integration into the training and inference. |
| Outcome: | The proposed method improves individual language’s reasoning accuracy by 2.5% and improves performance by 8%. |
TinyBERT: Distilling BERT for Natural Language Understanding (2020.findings-emnlp)
Copied to clipboard
| Challenge: | Pre-trained language models are computationally expensive and difficult to efficiently execute on resource-restricted devices. |
| Approach: | They propose a Transformer distillation method that performs Transformer distillations at pre-training and task-specific learning stages. |
| Outcome: | The proposed method accelerates inference and reduces model size while maintaining accuracy. |
Lifelong Pretraining: Continually Adapting Language Models to Emerging Corpora (2022.naacl-main)
Copied to clipboard
| Challenge: | Pretrained language models are typically learned over a large, static corpus and fine-tuned for various downstream tasks. |
| Approach: | They propose to continuously update a pretrained language model to adapt to emerging data and to keep track of the model's performance. |
| Outcome: | The proposed model can adapt to new corpora while retaining knowledge in earlier domains. |
DataLab: A Platform for Data Analysis and Intervention (2022.acl-demo)
Copied to clipboard
Yang Xiao, Jinlan Fu, Weizhe Yuan, Vijay Viswanathan, Zhoumianze Liu, Yixin Liu, Graham Neubig, Pengfei Liu
| Challenge: | Existing tools and research focus on how to interpret and manipulate data, despite its crucial role in machine learning, . existing tools and researchers focus on systems on top of existing data, rather than how to use it. |
| Approach: | They propose a unified data-oriented platform that allows users to interactively analyze the characteristics of data and provides a standard interface for many data processing operations. |
| Outcome: | The proposed platform allows users to analyze the characteristics of data and provides a standardized interface so that many data processing operations can be provided within a single interface. |
StepCoder: Improving Code Generation with Reinforcement Learning from Compiler Feedback (2024.acl-long)
Copied to clipboard
Shihan Dou, Yan Liu, Haoxiang Jia, Enyu Zhou, Limao Xiong, Junjie Shan, Caishuang Huang, Xiao Wang, Xiaoran Fan, Zhiheng Xi, Yuhao Zhou, Tao Ji, Rui Zheng, Qi Zhang, Tao Gui, Xuanjing Huang
| Challenge: | Existing work integrates reinforcement learning with compiler feedback to enhance code generation quality but the long code generated by LLMs makes RL exploration ineffective. |
| Approach: | They propose a framework that integrates reinforcement learning and compiler feedback to enhance code generation quality. |
| Outcome: | The proposed framework outperforms state-of-the-art approaches in corresponding benchmarks and integrates reinforcement learning with compiler feedback to improve code generation quality. |
Mixing Inference-time Experts for Enhancing LLM Reasoning (2025.emnlp-main)
Copied to clipboard
| Challenge: | Existing methods for improving reasoning quality in large language models are limited to using a single expert. |
| Approach: | They propose a framework that finetunes and merges expert logits from one LLM . they use commonsense and entailment reasoning experts to improve chain-of-thought reasoning . |
| Outcome: | The proposed framework outperforms baselines on three question-answering datasets. |
Can LLMs Estimate Student Struggles? Human-AI Difficulty Alignment with Proficiency Simulation for Item Difficulty Prediction (2026.findings-acl)
Copied to clipboard
| Challenge: | Accurate estimation of item (question or task) difficulty suffers from the cold start problem. |
| Approach: | They propose to use large-scale empirical analysis to examine human-AI Difficulty Alignment . they find that models struggle to simulate the capability limitations of students . |
| Outcome: | The proposed model size is not reliably helpful for human-AI alignment . high performance often impedes accurate difficulty estimation, the authors say . |
Marrying LLMs with Dynamic Forecasting: A Graph Mixture-of-expert Perspective (2025.findings-naacl)
Copied to clipboard
| Challenge: | Recent data-driven approaches often use graph neural networks (GNNs) to learn relationships in dynamical systems. |
| Approach: | They propose a framework which leverages large language models to enhance generalization capabilities of dynamical system modeling. |
| Outcome: | The proposed framework improves on existing methods and compares to baselines. |
CharacterGLM: Customizing Social Characters with Large Language Models (2024.emnlp-industry)
Copied to clipboard
Jinfeng Zhou, Zhuang Chen, Dazhen Wan, Bosi Wen, Yi Song, Jifan Yu, Yongkang Huang, Pei Ke, Guanqun Bi, Libiao Peng, JiaMing Yang, Xiyao Xiao, Sahand Sabour, Xiaohan Zhang, Wenjing Hou, Yijia Zhang, Yuxiao Dong, Hongning Wang, Jie Tang, Minlie Huang
| Challenge: | Character-based dialogue systems (CharacterDial) allow users to customize social characters for social interactions. |
| Approach: | They will collect a large-scale Chinese corpus of characters with diverse categories and behaviors and develop CharacterGLM models to address these challenges. |
| Outcome: | Experiments show that CharacterGLM outperforms most popular open- and closed-source LLMs and performs comparable to GPT-4. |
Disambiguated Lexically Constrained Neural Machine Translation (2023.findings-acl)
Copied to clipboard
| Challenge: | Current approaches to LCNMT assume that pre-specified lexicon constraints are contextually appropriate. |
| Approach: | They propose a framework that disambiguates constraints based on contexts at first and integrates them into LCNMT. |
| Outcome: | The proposed approach outperforms baseline approaches on benchmark datasets and comprehensive experiments in multiple target constraints. |
Beyond Superficial Tests: Adversarial Refinement for Reliable Property-Based Testing (2026.findings-acl)
Copied to clipboard
| Challenge: | Large Language Models (LLMs) have demonstrated remarkable proficiency in code generation, yet their application to Property-Based Testing (PBT) remains fraught with a superficiality gap. |
| Approach: | They propose an agentic framework that hardens software properties through Adversarial Refinement. |
| Outcome: | a new framework hardens software properties through Adversarial Refinement that detects and fixes bugs in top-tier libraries. |
GumbelSoft: Diversified Language Model Watermarking via the GumbelMax-trick (2024.acl-long)
Copied to clipboard
| Challenge: | Large language models generate human-like content, but they also pose a problem with generation diversity, negatively impacting generation diversity and user experience. |
| Approach: | They propose a Logits-Addition watermark and three variants that aim to enhance diversity to overcome generation diversity challenges. |
| Outcome: | The Logits-Addition watermark outperforms the Logits+Trick-based watermark in diversity tests and outperformed other decoding-based methods by 0.1 to 0.3. |
What Makes an Ideal Quote? Recommending “Unexpected yet Rational” Quotations via Novelty (2026.acl-long)
Copied to clipboard
| Challenge: | Prior systems focus on topical relevance and overlook what makes quotes memorable. |
| Approach: | They propose a system that maps quotations and contexts into deep-meaning labels for label-enhanced retrieval. |
| Outcome: | The proposed system can recommend quotations that are contextually novel while semantically coherent. |
SEMIROUTER: Sparse-Data Enhanced Routing for Adaptive Multi-LLM System (2026.eacl-long)
Copied to clipboard
| Challenge: | Existing routing methods suffer from poor scalability and dependence on datasets for training . energy footprint is also considered in the decision to implement our new LLM routing framework . |
| Approach: | They propose a new LLM routing framework that dynamically allocates queries to the most appropriate LLM. |
| Outcome: | The proposed method improves data efficiency, adaptability, and routing accuracy compared to existing methods. |
An Alignment-Agnostic Model for Chinese Text Error Correction (2021.findings-emnlp)
Copied to clipboard
| Challenge: | Existing models for Chinese text error correction can correct mistaken, missing and redundant characters, but they cannot handle missing or redundant characters. |
| Approach: | They propose an alignment-agnostic framework to correct Chinese text errors . framework detects missing and redundant characters and can be used as a cold start model . |
| Outcome: | The proposed framework can handle both text aligned and non-aligned situations and can serve as a cold start model when no annotation data are provided. |
Teaching Large Language Models an Unseen Language on the Fly (2024.findings-acl)
Copied to clipboard
| Challenge: | Existing large language models struggle to support numerous low-resource languages . Existing models lack sufficient training data for effective parameter updating . |
| Approach: | They propose a framework for adapting LLMs to unseen languages by in-context learning. |
| Outcome: | The proposed framework improves Chinese-to-Zhuang translation performance and Zhuan-to Chinese translation performance. |
NoisywikiHow: A Benchmark for Learning with Real-world Noisy Labels in Natural Language Processing (2023.findings-acl)
Copied to clipboard
| Challenge: | Large-scale datasets in the real world often contain label noise, which can cause model overfitting and degrade generalization. |
| Approach: | They propose to use label noise to imitate human errors in annotations . they use a noisy label noise benchmark to evaluate their methods . |
| Outcome: | The proposed benchmarks are different from data with heterogeneous label noises in the real world. |
Adaptive Ordered Information Extraction with Deep Reinforcement Learning (2023.findings-acl)
Copied to clipboard
| Challenge: | Existing methods for information extraction follow a fixed extraction order for complex tasks with multiple elements to be extracted in one instance. |
| Approach: | They propose an adaptive ordered IE paradigm to find optimal element extraction order for different instances and a reinforcement learning framework to generate optimal order dynamically. |
| Outcome: | The proposed method beats existing methods and improves on several public datasets. |
Effective In-Context Example Selection through Data Compression (2024.findings-acl)
Copied to clipboard
| Challenge: | In-context learning has been validated in large language models, but the mechanism and selection strategy for in-cont example selection lacks systematic and in-depth research. |
| Approach: | They propose a data compression approach to select in-context examples using large language models. |
| Outcome: | The proposed method shows a significant improvement of 5.90% across five real-world datasets using four language models. |
FreeAL: Towards Human-Free Active Learning in the Era of Large Language Models (2023.emnlp-main)
Copied to clipboard
| Challenge: | Modern machine learning models require a huge collection of precisely labeled data, which can be labor-intensive and time-consuming. |
| Approach: | They propose a collaborative learning framework that interactively distills and filters the task-specific knowledge from LLMs. |
| Outcome: | The proposed framework improves zero-shot performance on eight benchmark datasets without human supervision. |
Jointly Learning Entity and Relation Representations for Entity Alignment (D19-1)
Copied to clipboard
| Challenge: | Entity alignment is a viable method for integrating heterogeneous knowledge among different knowledge graphs (KGs). |
| Approach: | They propose a Graph Convolutional Network-based framework for learning relation representations by embedding relation seeds into entities and incorporating relation approximation into entities to iteratively improve alignment. |
| Outcome: | The proposed approach outperforms state-of-the-art methods on three real-world cross-lingual datasets. |
Light Up the Shadows: Enhance Long-Tailed Entity Grounding with Concept-Guided Vision-Language Models (2024.findings-acl)
Copied to clipboard
| Challenge: | Multi-Modal Knowledge Graphs (MMKGs) are knowledge graphs that integrate and align information from diverse modalities (e.g., text and images). |
| Approach: | They propose a framework that integrates image-text pairs of long-tailed entities and a concept guidance module that offers explainability and enables human verification. |
| Outcome: | The proposed framework improves the accuracy of recognizing long-tailed image-text pairs compared to baselines and also offers flexibility and explainability. |
Modeling Event Background for If-Then Commonsense Reasoning Using Context-aware Variational Autoencoder (D19-1)
Copied to clipboard
| Challenge: | Understanding event and event-centered commonsense reasoning is crucial for natural language processing (NLP). |
| Approach: | They propose a If-Then commonsense reasoning dataset Atomic and an RNN-based Seq2Seq model to facilitate this. |
| Outcome: | The proposed model improves the accuracy and diversity of inferences compared with baseline methods. |
NiuTrans.LMT: Toward Inclusive and Scalable Multilingual Machine Translation with LLMs (2026.acl-long)
Copied to clipboard
Yingfeng Luo, Ziqiang Xu, Yuxuan Ouyang, MuRun Yang, DingYang Lin, Kaiyan Chang, Tong Zheng, Bei Li, Peinan Feng, Quan Du, Tong Xiao, JingBo Zhu
| Challenge: | Large language models have significantly advanced Multilingual Machine Translation (MMT) yet scaling to many languages while maintaining robust performance across directions remains challenging. |
| Approach: | They propose a strategy to reduce the number of translations in one direction . they propose auxiliary parallel sentences to promote cross-lingual transfer . |
| Outcome: | The proposed model performs on par with or better than substantially larger baselines. |
BOOKWORLD: From Novels to Interactive Agent Societies for Story Creation (2025.acl-long)
Copied to clipboard
| Challenge: | Recent advances in large language models (LLMs) have enabled social simulation through multi-agent systems. |
| Approach: | They propose a system for constructing and simulating book-based multi-agent societies that simulates established fictional worlds and characters. |
| Outcome: | The proposed system generates high-quality stories while maintaining fidelity to the source books, surpassing previous methods with a win rate of 75.36%. |
LogicPoison: Logical Attacks on Graph Retrieval-Augmented Generation (2026.acl-long)
Copied to clipboard
Yilin Xiao, Jin Chen, Qinggang Zhang, Yujing Zhang, Chuang Zhou, Longhao Yang, Lingfei Ren, Xin Yang, Xiao Huang
| Challenge: | Graph-based Retrieval-Augmented Generation (GraphRAG) enhances the reasoning capabilities of Large Language Models (LLMs) however, traditional RAG attacks are difficult to pose an effective threat to GraphRAg systems. |
| Approach: | They propose a novel attack framework that targets logical reasoning rather than injecting false contents into GraphRAG systems by grounding their responses in structured knowledge graphs. |
| Outcome: | The proposed framework outperforms state-of-the-art attacks on GraphRAG systems in both effectiveness and stealth. |
POINTS-Reader: Distillation-Free Adaptation of Vision-Language Models for Document Conversion (2025.emnlp-main)
Copied to clipboard
Yuan Liu, Zhongyin Zhao, Le Tian, Haicheng Wang, Xubing Ye, Yangxiu You, Zilin Yu, Chuhan Wu, Zhou Xiao, Yang Yu, Jie Zhou
| Challenge: | Existing approaches to training document conversion models with manual annotation are costly and time-consuming, and training student models by distilling outputs from teacher models can significantly limit their performance in real-world applications. |
| Approach: | They propose a fully automated framework for constructing high-quality document extraction datasets and models capable of handling diverse document formats and layouts. |
| Outcome: | The proposed model outperforms existing models and improves on annotated documents. |
FUSE: Measure-Theoretic Compact Fuzzy Set Representation for Taxonomy Expansion (2024.findings-acl)
Copied to clipboard
| Challenge: | Existing work models taxonomy concepts as vectors or geometric objects, but fuzzy sets are efficient for concept modeling. |
| Approach: | They propose a set representation learning task based on fuzzy set approximation . they demonstrate remarkable improvements in taxonomy expansion using FUSE . |
| Outcome: | The proposed framework improves taxonomy expansion performance by 23% over baselines. |
Are People Located in the Places They Mention in Their Tweets? A Multimodal Approach (2022.coling-1)
Copied to clipboard
| Challenge: | Experimental results show that a neural architecture that combines both modalities yields better results. |
| Approach: | They propose a neural architecture that combines both modalities to solve the problem of determining whether people are located in tweets. |
| Outcome: | The proposed model combines both modalities to produce better results . |
The GaoYao Benchmark: A Comprehensive Framework for Evaluating Multilingual and Multicultural Abilities of Large Language Models (2026.acl-long)
Copied to clipboard
Yilun Liu, Chunguang Zhao, Mengyao Piao, Lingqi Miao, Shimin Tao, Minggui HE, Chenxin Liu, Zhang Li, null Mahongxia, Jiaxin Guo, Chen Liu, Liqun Deng, Jiansheng Wei, Xiaojun Meng, Fanyi Du, Daimeng Wei, Yanghua Xiao
| Challenge: | Existing multilingual evaluation benchmarks neglect cultural nuances and lack language coverage in subjective tasks. |
| Approach: | They propose a framework that categorizes evaluation tasks into three cultural layers and nine cognitive sub-layers. |
| Outcome: | The proposed framework surpasses prior coverage by up to 111% on 20+ LLMs. |
DA-Code: Agent Data Science Code Generation Benchmark for Large Language Models (2024.emnlp-main)
Copied to clipboard
Yiming Huang, Jianwen Luo, Yan Yu, Yitong Zhang, Fangyu Lei, Yifan Wei, Shizhu He, Lifu Huang, Xiao Liu, Jun Zhao, Kang Liu
| Challenge: | DA-Code is a code generation benchmark designed to assess LLMs on agent-based data science tasks. |
| Approach: | They propose a code generation benchmark specifically designed for LLMs on agent-based data science tasks. |
| Outcome: | The benchmark performs better than existing frameworks, but lacks accuracy . it is based on real-world data, and includes examples that cover a wide range of tasks . |
SlideCoder: Layout-aware RAG-enhanced Hierarchical Slide Generation from Design (2025.emnlp-main)
Copied to clipboard
Wenxin Tang, Jingyu Xiao, Wenxuan Jiang, Xi Xiao, Yuhang Wang, Xuxin Tang, Qing Li, Yuehe Ma, Junliang Liu, Shisong Tang, Michael R. Lyu
| Challenge: | Existing natural language-based LLM generation methods struggle to capture visual and structural nuances of slide designs. |
| Approach: | They propose a layout-aware framework for generating editable slides from reference images . they propose python code that translates NL instructions into Python code to construct each slide . |
| Outcome: | The proposed framework outperforms state-of-the-art models by up to 40.5 points . it also outperformed open-source models with improved reverse-engineered data. |
Bridging Internal Consistency and External Alignment: A Causal and Dynamic Interpretability Framework for LLM Generation (2026.acl-long)
Copied to clipboard
| Challenge: | Existing interpretability methods focus on internal and external aspects of the model . existing explanations often focus on surface correlations or static dependencies . |
| Approach: | They propose a causal and dynamic interpretability framework for Large Language Models . they characterize backdoor-adjusted causal effects of generated prefix and prompt . |
| Outcome: | The proposed framework provides a unified causal view of internal consistency and external alignment in LLM generation dynamics. |
Don’t be Contradicted with Anything! CI-ToD: Towards Benchmarking Consistency for Task-oriented Dialogue System (2021.emnlp-main)
Copied to clipboard
| Challenge: | Consistency Identification has been used for preventing inconsistent response generation, but few efforts have been made to task-oriented dialogue. |
| Approach: | They propose a dataset for Consistency Identification in task-oriented dialog system. |
| Outcome: | The proposed dataset is based on a single label and provides fine-grained labels to encourage model to know what inconsistent sources lead to it. |
Teaching Language Models to Self-Improve by Learning from Language Feedback (2024.findings-acl)
Copied to clipboard
| Challenge: | Recent advances in Large Language Models (LLMs) generate content that can be untruthful or harmful. |
| Approach: | They propose a method that leverages model feedback for alignment . they use a base language model to generate initial responses, critiqued and refined . |
| Outcome: | The proposed method outperforms strong baselines across diverse tasks and model sizes. |
Pairwise Supervised Contrastive Learning of Sentence Representations (2021.emnlp-main)
Copied to clipboard
| Challenge: | Recent efforts to improve sentence representation learning have a common weakness . siamese or triplet loss only learns from individual sentence pairs or tripletes . |
| Approach: | They propose a discrimination-based approach to bridge entailment and contradiction understanding with categorical concept encoding. |
| Outcome: | The proposed method outperforms the state-of-the-art method on downstream tasks . it improves 10%–13% on clustering tasks and 5%–6% on STS tasks compared with the previous method . |
Generative Entity Typing with Curriculum Learning (2022.emnlp-main)
Copied to clipboard
| Challenge: | Entity typing fails to assign an entity to the types beyond the predefined type set. |
| Approach: | They propose a generative entity typing paradigm that assigns types to entities . traditional classification-based approaches fail to assign entities to the types beyond the predefined set . they employ curriculum learning to train the model on heterogeneous data . |
| Outcome: | The proposed model outperforms the state-of-the-art model on heterogeneous training data. |
FlowBench: Revisiting and Benchmarking Workflow-Guided Planning for LLM-based Agents (2024.findings-emnlp)
Copied to clipboard
| Challenge: | LLM-based agents are susceptible to undesired planning hallucinations when lacking specific knowledge for expertise-intensive tasks. |
| Approach: | They propose a benchmark to evaluate the efficacy of workflow-guided agent planning by formalizing different formats of workflow knowledge. |
| Outcome: | The proposed benchmark aims to improve the planning reliability of LLM-based agents by incorporating external workflow-related knowledge. |
Learning from Textual Radiology Reports: A Benchmark Dataset for Coronary CT Angiography (2026.acl-industry)
Copied to clipboard
Sudharshan Balaji, Zhiyu Liu, Zhengyuan Jiang, Shuo Lei, Yimin Chen, Yang Xiao, Shone O. Almeida, Mathew Joseph Karivelil, Christopher Malanga, Ning Wang
| Challenge: | CCTA reports provide an assessment of coronary disease severity to guide patient management. |
| Approach: | They propose a pipeline that decouples structuring from classification by an LLM-based parser . CCTA-RADS is the largest publicly available dataset of CCDA reports . |
| Outcome: | The proposed approach improves the F1-score by 6%-13% compared with direct methods. |
MetaPro Online: A Computational Metaphor Processing Online System (2023.acl-demo)
Copied to clipboard
| Challenge: | Metaphors do not take literal meanings in contexts, which may cause difficulties for language learners and machines to understand them. |
| Approach: | They propose a computational metaphor processing online system that queries metaphoricity labels, paraphrases and concept mappings for non-domain-specific text. |
| Outcome: | The proposed system can query metaphoricity labels, paraphrases, and concept mappings for non-domain-specific text without coding background. |
Things not Written in Text: Exploring Spatial Commonsense from Visual Signals (2022.acl-long)
Copied to clipboard
| Challenge: | Pretrained language models fail in many NLP tasks, but are ineffective in spatial commonsense reasoning. |
| Approach: | They propose a spatial commonsense benchmark that focuses on relative scales of objects and the positional relationship between people and objects under different actions. |
| Outcome: | The proposed framework outperforms pretrained models in answering spatial questions. |
Coarse-to-Fine Grounded Memory for LLM Agent Planning (2025.emnlp-main)
Copied to clipboard
| Challenge: | Existing methods to enhance LLM with offline experiences or online trajectory analysis focus on single-granularity memory derived from dynamic environmental interactions. |
| Approach: | They propose a framework that grounds coarse-to-fine memories with LLM to enable flexible adaptation to diverse scenarios. |
| Outcome: | Extensive experiments on AlfWorld, Webshop and ScienceWorld show that the proposed framework outperforms baselines and comprehensively optimizes memory-enhanced LLM Agent system. |
Label-Specific Document Representation for Multi-Label Text Classification (D19-1)
Copied to clipboard
| Challenge: | Existing methods to classify documents using labels only assign one label to document . multi-label text classification is a challenging task because of the huge amount of documents, words and labels. |
| Approach: | They propose a Label-Specific Attention Network (LSAN) to learn a label-specific document representation. |
| Outcome: | The proposed model outperforms state-of-the-art methods on four datasets . it can predict low-frequency labels, and it can be used in sentimental analysis . |
Multi-Grained Knowledge Distillation for Named Entity Recognition (2021.naacl-main)
Copied to clipboard
| Challenge: | Pre-trained big models have delivered top performance in Seq2seq modeling, but their deployments in real-world applications are often hindered by excessive computations and memory demands. |
| Approach: | They propose a distillation scheme to efficiently transfer knowledge from big models to their cheaper counterparts. |
| Outcome: | The proposed scheme maximizes the assimilation of knowledge from the teacher model to the student model. |
Align-smatch: A Novel Evaluation Method for Chinese Abstract Meaning Representation Parsing based on Alignment of Concept and Relation (2022.lrec-1)
Copied to clipboard
| Challenge: | Abstract Meaning Representation abstracts the meaning of sentences into a single-rooted, acyclic and directed graph. |
| Approach: | They propose to use a metric to evaluate concept alignment and relation alignment to improve Chinese AMR parsing evaluation methods. |
| Outcome: | The proposed method is more robust and compatible with concept alignment and relation alignment and more robust in evaluating arcs. |
Whisper-UT: A Unified Translation Framework for Speech and Text (2025.emnlp-main)
Copied to clipboard
Cihan Xiao, Matthew Wiesner, Debashish Chakraborty, Reno Kriz, Keith Cunningham, Kenton Murray, Kevin Duh, Luis Tavarez-Arce, Paul McNamee, Sanjeev Khudanpur
| Challenge: | Encoder-decoder models have achieved remarkable success in speech and text tasks, but efficiently adapting them to diverse uni/multimodal scenarios remains a challenge. |
| Approach: | They propose a framework that leverages lightweight adapters to enable seamless adaptation across tasks. |
| Outcome: | The proposed framework improves speech translation performance through a 2-stage decoding strategy without requiring 3-way parallel data. |
MedCite: Can Language Models Generate Verifiable Text for Medicine? (2025.findings-acl)
Copied to clipboard
| Challenge: | Existing LLM-based medical question answering systems lack citation generation and evaluation capabilities, raising concerns about their adoption in practice. |
| Approach: | They propose a framework that facilitates the design and evaluation of LLM citations for medical tasks and a retrieval-citation method that generates high-quality citation. |
| Outcome: | The proposed method achieves superior citation precision and recall improvements compared to strong baseline methods and correlates well with annotation results from professional experts. |
OS Agents: A Survey on MLLM-based Agents for Computer, Phone and Browser Use (2025.acl-long)
Copied to clipboard
Xueyu Hu, Tao Xiong, Biao Yi, Zishu Wei, Ruixuan Xiao, Yurun Chen, Jiasheng Ye, Meiling Tao, Xiangxin Zhou, Ziyu Zhao, Yuhuai Li, Shengze Xu, Shenzhi Wang, Xinchen Xu, Shuofei Qiao, Zhaokai Wang, Kun Kuang, Tieyong Zeng, Liang Wang, Jiwei Li, Yuchen Eleanor Jiang, Wangchunshu Zhou, Guoyin Wang, Keting Yin, Zhou Zhao, Hongxia Yang, Fan Wu, Shengyu Zhang, Fei Wu
| Challenge: | a new generation of (M)LLMs is enabling the creation of superintelligent AI assistants . OS Agents can complete tasks autonomously and have the potential to significantly enhance the lives of billions of users worldwide. |
| Approach: | They propose to build OS Agents that operate within operating systems' GUIs and GUIs . they examine evaluation metrics and benchmarks to identify promising directions . |
| Outcome: | The proposed agents are based on operating systems (OS) and operating systems frameworks. |
Chain-of-Reasoning: Towards Unified Mathematical Reasoning in Large Language Models via a Multi-Paradigm Perspective (2025.acl-long)
Copied to clipboard
Yiyao Yu, Yuxiang Zhang, Dongdong Zhang, Xiao Liang, Hengyuan Zhang, Xingxing Zhang, Mahmoud Khademi, Hany Hassan Awadalla, Junjie Wang, Yujiu Yang, Furu Wei
| Challenge: | Existing work shows that LLMs rely on single-paradigm reasoning that limits their effectiveness across diverse tasks. |
| Approach: | They propose a new framework that integrates multiple reasoning paradigms to enable synergistic collaboration. |
| Outcome: | The proposed model outperforms current SOTA models in theorem proving tasks and the MATH benchmark in arithmetic tasks. |
MultiAgentESC: A LLM-based Multi-Agent Collaboration Framework for Emotional Support Conversation (2025.emnlp-main)
Copied to clipboard
| Challenge: | Existing studies focus on generating responses directly and neglect integration of domain-specific reasoning and expert interaction. |
| Approach: | They propose a training-free multi-agent collaboration framework for ESC to emulate human-like process of providing emotional support through dialogue analysis, strategy deliberation, and response generation. |
| Outcome: | The proposed framework excels at providing emotional support and diversifying support strategy selection. |
Find Your Optimal Teacher: Personalized Data Synthesis via Router-Guided Multi-Teacher Distillation (2026.acl-long)
Copied to clipboard
Hengyuan Zhang, Shiping Yang, Xiao Liang, Chenming Shang, Yuxuan Jiang, Chaofan Tao, Jing Xiong, Hayden Kwok-Hay So, Ruobing Xie, Angel X. Chang, Ngai Wong
| Challenge: | Existing studies show that stronger models are not always optimal teachers, suggesting a mismatch between the teacher’s output and the student’s learning ability. |
| Approach: | They propose a method that routes each prompt to its optimal teacher via a query-level router that jointly considers the student models’ learnability and teacher models’ response quality. |
| Outcome: | The proposed method outperforms baselines on six benchmarks including instruct tuning and math reasoning settings. |
A Survey of Large Language Model-Based Search Agents (2026.acl-long)
Copied to clipboard
Yunjia Xi, Jianghao Lin, Yongzhao Xiao, Zheli Zhou, Rong Shan, Te Gao, Jiachen Zhu, Weiwen Liu, Yong Yu, Weinan Zhang
| Challenge: | Large Language Models (LLMs) have revolutionized web search, but their integration is static and cannot handle complex contexts. |
| Approach: | They analyze existing research and analyze existing work from the perspectives of architecture, optimization, application, and evaluation. |
| Outcome: | The proposed models can comprehend user intentions and context and execute multi-turn retrieval with dynamic planning, extending search capabilities far beyond the web. |
Improving Neural Abstractive Document Summarization with Structural Regularization (D18-1)
Copied to clipboard
| Challenge: | Recent advances in document summarization fail to capture long-term structure of documents and multi-sentence summaries, resulting in information loss and repetitions. |
| Approach: | They propose to leverage structural information of documents and multi-sentence summaries to improve document summarization performance. |
| Outcome: | The proposed model outperforms state-of-the-art models on document summarization tasks. |
RePD: Defending Jailbreak Attack through a Retrieval-based Prompt Decomposition Process (2025.findings-naacl)
Copied to clipboard
| Challenge: | Large Language Models (LLMs) are still susceptible to jailbreak exploits despite rigorous pre-training and fine-tuning focused on ethical alignment . |
| Approach: | They propose a Retrieval-based attack Retriest-based Prompt Decomposition framework that decomposes harmful queries embedded within user prompts into a one-shot learning example to effectively teach the LLM to discern and separate malicious components. |
| Outcome: | The proposed framework is capable of decomposing harmful queries from the original query and enhancing the resilience of large language models against jailbreak attacks without compromising their performance. |
Enhancing Dual-Encoders with Question and Answer Cross-Embeddings for Answer Retrieval (2021.findings-emnlp)
Copied to clipboard
| Challenge: | Existing approaches to solve question answering (QA) problems are limited by the need for text generation and answer retrieval. |
| Approach: | They propose to introduce QA interaction features in scoring function but at the cost of low efficiency in inference stage. |
| Outcome: | The proposed framework significantly outperforms the state-of-the-art method on multiple answer retrieval datasets. |
Different Data, Different Modalities! Reinforced Data Splitting for Effective Multimodal Information Extraction from Social Media Posts (2022.coling-1)
Copied to clipboard
| Challenge: | Recent multimodal information extraction approaches overestimate the significance of images. |
| Approach: | They propose a general data splitting strategy to divide social media posts into two sets to achieve better performance under information extraction models of the corresponding modalities. |
| Outcome: | The proposed method outperforms existing models on two different multimodal information extraction tasks. |
QA‐LIGN: Aligning LLMs through Constitutionally Decomposed QA (2025.findings-emnlp)
Copied to clipboard
Jacob Dineen, Aswin Rrv, Qin Liu, Zhikun Xu, Xiao Ye, Ming Shen, Zhaonan Li, Shijie Lu, Chitta Baral, Muhao Chen, Ben Zhou
| Challenge: | QA-LIGN decomposes monolithic rewards into interpretable principle-specific evaluations . scalar rewards obscure which objectives drive the training signal . |
| Approach: | a new method decomposes monolithic rewards into interpretable principle-specific evaluations . QA-LIGN reduces attack success rates by up to 68.7% while maintaining a 0.67% false refusal rate . |
| Outcome: | QA-LIGN reduces attack success rates by up to 68.7% while maintaining a 0.67% false refusal rate . the results outperform DPO and GRPO with state-of-the-art reward models given equivalent training . |
LogicNMR: Probing the Non-monotonic Reasoning Ability of Pre-trained Language Models (2022.findings-emnlp)
Copied to clipboard
| Challenge: | Existing work examines the non-monotonic reasoning ability of pre-trained language models. |
| Approach: | They construct a non-monotonic reasoning benchmark with explicit default rules and iterative updates. |
| Outcome: | The proposed model achieves a higher accuracy than the benchmark, but performs poorly on the benchmark. |
Multi-Task Neural Model for Agglutinative Language Translation (2020.acl-srw)
Copied to clipboard
| Challenge: | Neural machine translation (NMT) has been gaining popularity in high-resource translation tasks, but struggles in low-ressource and morphologically-rich scenarios. |
| Approach: | They propose a multi-task neural model that jointly learns to perform bi-directional translation and agglutinative language stemming. |
| Outcome: | The proposed model can significantly improve translation performance on agglutinative languages by using a small amount of monolingual data. |
Wav-BERT: Cooperative Acoustic and Linguistic Representation Learning for Low-Resource Speech Recognition (2021.findings-emnlp)
Copied to clipboard
| Challenge: | Existing methods to learn the transfer from speech to text are unexplored . how to solve the representation discrepancy of speech and text is unexplorable . |
| Approach: | They propose a cooperative acoustic and linguistic representation learning method to fuse and utilize contextual information of speech and text. |
| Outcome: | The proposed method outperforms existing methods on low-resource speech recognition. |
Order Matters: Investigate the Position Bias in Multi-constraint Instruction Following (2025.findings-acl)
Copied to clipboard
| Challenge: | Existing large language models struggle to follow multi-constraint instructions in real-world applications. |
| Approach: | They propose to quantify the difficulty distribution of constraints by a novel Difficulty Distribution Index (CDDI) they find that LLMs are more performant when presented with constraints in a “hard-to-easy” order. |
| Outcome: | The proposed model is more performant when presented with constraints in a “hard-to-easy” order, compared with existing models with different architectures and sizes of parameters. |
Outcome-Grounded Advantage Reshaping for Fine-Grained Credit Assignment in Mathematical Reasoning (2026.acl-long)
Copied to clipboard
Ziheng Li, Liu Kang, Feng Xiao, Luxi Xing, Qingyi Si, Zhuoran Li, Weikang Gong, Deqing Yang, Yanghua Xiao, Hongcheng Guo
| Challenge: | Group Relative Policy Optimization (GRPO) uses a coarse-grained credit assignment mechanism that propagates group-level rewards uniformly to to every token in a sequence, neglecting the varying contribution of individual reasoning steps. |
| Approach: | They introduce Outcome-grounded Advantage Reshaping (OAR) which redistributes advantages based on how much each token influences the model’s final answer. |
| Outcome: | Empirical results show that OAR-G outperforms GRPO on a high-fidelity attribution signal and suppresses low-impact tokens while preserving the advantage mass. |
Query-Aware Knowledge Retrieval via Hyperbolic Structuring (2026.acl-long)
Copied to clipboard
Chuang Zhou, Junnan Dong, Yilin Xiao, Shengyuan Chen, Su Dong, di Yin, Xing Sun, Zhaozhuo Xu, Xiao Huang
| Challenge: | Existing approaches focus primarily on retrieving isolated factual knowledge entities while neglecting the critical reasoning relationships. |
| Approach: | They propose a query-centric retrieval framework that explicitly integrates structured knowledge graphs to support complex reasoning tasks. |
| Outcome: | Extensive experiments on three benchmark datasets show that HyperRAG outperforms baselines. |
Large Language Models Are Still Misled by Simple Bias Ensembles (2026.findings-acl)
Copied to clipboard
| Challenge: | Existing benchmarks for large language models are constrained to datasets where each sample is manually injected with only one type of bias. |
| Approach: | They propose a multi-bias benchmark where each sample contains multiple types of biases. |
| Outcome: | The proposed benchmark shows that existing LLMs and debiasing methods perform poorly on this benchmark, highlighting the challenge of eliminating compounded biases. |
TokenShapley: Token Level Context Attribution with Shapley Value (2025.findings-acl)
Copied to clipboard
| Challenge: | Large language models (LLMs) have strong capabilities in in-context learning, but verifying the correctness of their generated responses remains a challenge. |
| Approach: | They propose a token-level attribution method that combines Shapley value-based data attribution with KNN-based retrieval techniques to improve attribution accuracy. |
| Outcome: | TokenShapley outperforms state-of-the-art methods on four benchmarks . it achieves an 11–23% improvement in accuracy on the benchmarks. |
AndroidGen: Building an Android Language Agent under Data Scarcity (2025.acl-long)
Copied to clipboard
| Challenge: | Existing LLMs lack high-quality data sources and lack robust data filtration strategies. |
| Approach: | They develop a framework to enhance the capabilities of LLM-based agents under data scarcity. |
| Outcome: | The proposed framework improves the capabilities of LLM-based agents under data scarcity. |
Dynamics of Cognitive Heterogeneity: Investigating Behavioral Biases in Multi-Stage Supply Chains with LLM-Based Simulation (2026.acl-long)
Copied to clipboard
| Challenge: | Recent advances in Large Language Models (LLMs) allow repeatable experiments in which individual characteristics can be precisely defined. |
| Approach: | They propose a scalable experimental paradigm using Large Language Models to simulate multi-stage supply chain dynamics. |
| Outcome: | The proposed model systematically replicates and validates the results of a behavioral simulation on agents in multi-stage supply chain dynamics. |
Large Margin Representation Learning for Robust Cross-lingual Named Entity Recognition (2025.acl-long)
Copied to clipboard
| Challenge: | Existing approaches to name entity recognition neglect distribution skewness and pseudo-label bias . despite promising results, current approaches neglect these problems . |
| Approach: | They propose a framework that optimizes an adaptively reweighted contrastive loss to handle class skewness and pseudo-label bias. |
| Outcome: | The proposed framework outperforms existing methods on multiple benchmarks. |
APEX: Learning Adaptive Priorities for Multi-Objective Alignment in Vision-Language Generation (2026.findings-acl)
Copied to clipboard
Dongliang Chen, Xinlin Zhuang, Junjie Xu, Luojian Xie, Zehui Wang, Jiaxi Zhuang, Haolin Yang, Liang Dou, Xiao He, Xingjiao Wu, Ying Qian
| Challenge: | APEX optimizes for text-to-image generation by combining learning potential, conflict penalty, and progress need. |
| Approach: | They propose an algorithm that stabilizes heterogeneous rewards and dynamically schedules objectives . they propose a method that achieves better Pareto trade-offs across four heterogenous objectives based on P3 Adaptive Priorities . |
| Outcome: | The proposed algorithm achieves better pareto trade-offs across four heterogeneous objectives while maintaining competitive OCR accuracy. |
GuiLoMo: Allocating Experts and Ranks for LoRA-MoE via Bilevel Optimization with GuidedSelection Vectors (2025.findings-emnlp)
Copied to clipboard
Xinrong Chen, Hengyuan Zhang, Yingmin Qiu, Xiao Liang, Ziyue Li, Guanyu Wang, Weiping Li, Tong Mo, Hayden Kwok-Hay So, Ngai Wong
| Challenge: | Low-Rank Adaptation (LoRA) methods are efficient for a large language model with reduced computational costs. |
| Approach: | They propose a layer-wise expert numbers and ranks allocation strategy with GuidedSelection Vectors. |
| Outcome: | The proposed method achieves superior or comparable performance to all baselines on three backbone models. |
Sentiment Tagging with Partial Labels using Modular Architectures (P19-1)
Copied to clipboard
| Challenge: | Many NLP learning tasks can be decomposed into sub-tasks, each associated with a partial label. |
| Approach: | They propose a modular learning approach where sub-tasks are learned using functional modules . they propose 'learning with partial labels' approach that decomposes tasks into partial labels . |
| Outcome: | The proposed approach can simplify learning and reduce supervision efforts. |
PsychePass: Calibrating LLM Therapeutic Competence via Trajectory-Anchored Tournaments (2026.findings-acl)
Copied to clipboard
| Challenge: | evaluating therapeutic competence of large language models remains challenging due to unstructured and longitudinal nature of counseling. |
| Approach: | They propose a framework that calibrates the therapeutic competence of LLMs via trajectory-anchored tournaments. |
| Outcome: | The proposed framework calibrates the therapeutic competence of LLMs via trajectory-anchored tournaments. |
Dialect-SQL: An Adaptive Framework for Bridging the Dialect Gap in Text-to-SQL (2025.emnlp-main)
Copied to clipboard
| Challenge: | Existing Text-to-SQL research focuses on specific database systems, limiting adaptability to different dialects. |
| Approach: | They propose a framework that employs Object Relational Mapping (ORM) code as an intermediate language to bridge this gap. |
| Outcome: | The proposed framework outperforms existing methods that generate SQL queries directly. |
Chunk, Align, Select: A Simple Long-sequence Processing Method for Transformers (2024.acl-long)
Copied to clipboard
| Challenge: | Existing transformer-based models struggle with long-sequence processing due to computational costs . a framework to enhance long-content processing of transformers is proposed . |
| Approach: | They propose a framework to enhance long-sequence processing of transformers by three steps . they demonstrate that the framework significantly outperforms prior long-quence processors . |
| Outcome: | The proposed framework outperforms baseline models on long-sequence summarization and reading comprehension tasks. |
DU-VLG: Unifying Vision-and-Language Generation via Dual Sequence-to-Sequence Pre-training (2022.findings-acl)
Copied to clipboard
| Challenge: | Existing vision-and-language generation models cannot utilize pair-wise images and text through bi-directional generation due to the limitations of the model structure and pre-training objectives. |
| Approach: | They propose a framework which unifies vision-and-language generation as sequence generation problems. |
| Outcome: | The proposed framework achieves better performance than variants trained with uni-directional generation objectives or the variant without the commitment loss on image captioning and text-to-image generation datasets. |
A Neural Transition-based Joint Model for Disease Named Entity Recognition and Normalization (2021.acl-long)
Copied to clipboard
| Challenge: | Existing models for disease recognition and normalization ignore text surface form of each candidate concept, causing boundary inconsistency. |
| Approach: | They propose a neural transition-based joint model to normalize disease entities from biomedical text. |
| Outcome: | The proposed model improves on two publicly available datasets. |
Isotropy-Enhanced Conditional Masked Language Models (2023.findings-emnlp)
Copied to clipboard
| Challenge: | Existing non-autoregressive models with auto-regressing decoding paradigms have been used for various text generation tasks to accelerate inference but at the cost of generation quality to some extent. |
| Approach: | They propose to use Look Neighbors strategy to enhance learning of target token representations during training to achieve a good balance between inference speedup and generation quality. |
| Outcome: | The proposed models outperform current models on 4 WMT datasets and outperformed the current SoTA results. |
Modality-Aware Integration with Large Language Models for Knowledge-Based Visual Question Answering (2024.acl-long)
Copied to clipboard
| Challenge: | Existing methods to integrate multimodal knowledge in a modality-agnostic manner can be sub-optimal. |
| Approach: | They propose a modality-aware integration with large language models (LLMs) that leverages multimodal knowledge for both image understanding and knowledge reasoning. |
| Outcome: | The proposed model is able to bridge a tight inter-modal exchange while preserving insightful intra-modal learning. |
Anchoring the Cache: Mitigating Contextual Hallucination in KV-Compressed Long-Context Summarization (2026.acl-long)
Copied to clipboard
| Challenge: | Recent studies show that KV cache compression can increase hallucination scores in LLMs . modern LLM models support extremely long sequences, but their impact on model hallucinosity remains underexplored. |
| Approach: | They propose a decoding-phase strategy that selectively removes generated KV pairs from retrieval heads responsible for retrieving critical information from source context. |
| Outcome: | The proposed method reduces hallucination across multiple models and datasets while preserving computational efficiency. |
Improved Differentiable Architecture Search for Language Modeling and Named Entity Recognition (D19-1)
Copied to clipboard
| Challenge: | Neural architecture search (NAS) is a popular approach for finding new models and freeing researchers from the hard work of designing network architectures. |
| Approach: | They propose differentiable neural architecture search methods for natural language processing . they remove the softmax-local constraint and apply it to named entity recognition . |
| Outcome: | The proposed method outperforms strong baselines on the language modeling task. |
Improving Visual-Semantic Embedding with Adaptive Pooling and Optimization Objective (2023.eacl-main)
Copied to clipboard
Zijian Zhang, Chang Shu, Ya Xiao, Yuan Shen, Di Zhu, Youxin Chen, Jing Xiao, Jey Han Lau, Qian Zhang, Zheng Lu
| Challenge: | Recent VSE models combine simple pooling methods with hard triplet loss to improve performance. |
| Approach: | They propose an adaptive pooling strategy that allows the model to learn how to aggregate features through a combination of simple pooling methods. |
| Outcome: | The proposed strategy outperforms current state-of-the-art systems on image-to-text and text-toimage retrieval. |
P-Tuning: Prompt Tuning Can Be Comparable to Fine-tuning Across Scales and Tasks (2022.acl-short)
Copied to clipboard
| Challenge: | Existing methods of prompt tuning cannot handle hard sequence labeling tasks. |
| Approach: | They propose to optimize prompt tuning to tune continuous prompts with a frozen language model. |
| Outcome: | The proposed method matches finetuning with prompt tuning while having only 0.1%-3% tuned parameters. |
FaithfulRAG: Fact-Level Conflict Modeling for Context-Faithful Retrieval-Augmented Generation (2025.acl-long)
Copied to clipboard
| Challenge: | Existing faithful RAG approaches enforce strict context adherence, but they forcibly suppress the model’s parametric knowledge, which undermines the model's internal knowledge structure and increases the risk of misinterpreting the context. |
| Approach: | They propose a framework that resolves knowledge conflicts by explicitly modeling discrepancies between the model’s parametric knowledge and retrieved context. |
| Outcome: | The proposed framework outperforms state-of-the-art methods in knowledge conflict cases and identifies conflicting knowledge at the fact level and designs a self-thinking process. |
ERNIE-Gram: Pre-Training with Explicitly N-Gram Masked Language Modeling for Natural Language Understanding (2021.naacl-main)
Copied to clipboard
| Challenge: | Existing methods to model coarse-grained linguistic information do not integrate coarse-gram information into pre-training. |
| Approach: | They propose an explicitly n-gram masking method to enhance integration of coarse-grained linguistic information into pre-training. |
| Outcome: | The proposed method outperforms existing models on English and Chinese text corpora and fine-tunes on 19 downstream tasks. |
RouteLMT: Learned Sample Routing for Hybrid LLM Translation Deployment (2026.acl-industry)
Copied to clipboard
Yingfeng Luo, Hongyu Liu, DingYang Lin, Kaiyan Chang, Chenglong Wang, Bei Li, Quan Du, Tong Xiao, JingBo Zhu
| Challenge: | Existing routing strategies rely on heuristics, external predictors, or absolute quality estimation to capture whether the large model provides a worthwhile improvement over the small one. |
| Approach: | They propose a budget allocation problem for routing large model to large model . they propose heuristics, external predictors, or absolute quality estimation to determine the optimal signal for budgeted decisions. |
| Outcome: | The proposed model outperforms heuristics, quality/difficulty estimation baselines and achieves a superior quality–budget Pareto frontier. |
AgencyBench: Benchmarking the Frontiers of Autonomous Agents in 1M-Token Real-World Contexts (2026.acl-long)
Copied to clipboard
Keyu Li, Junhao Shi, Yang Xiao, Mohan Jiang, Jie Sun, Yunze Wu, Dayuan Fu, Shijie Xia, Xiaojie Cai, Tianze Xu, Weiye Si, Wenjie Li, Dequan Wang, Pengfei Liu
| Challenge: | Existing benchmarks focus on single agentic capability, failing to capture long-horizon real-world scenarios. |
| Approach: | They propose a benchmark that evaluates 6 agentic capabilities across 32 real-world scenarios. |
| Outcome: | Experiments show that closed-source models outperform open-source model (48.4% vs 32.1%) integrating models with advanced scaffolds to form autonomous agents is a paradigm shift. |
Learning Deep Transformer Models for Machine Translation (P19-1)
Copied to clipboard
| Challenge: | Neural machine translation models have advanced the previous state-of-the-art by learning mappings between sequences via neural networks and attention mechanisms. |
| Approach: | They propose to use layer normalization to pass the combination of previous layers to the next layer to improve the model. |
| Outcome: | The proposed model outperforms the shallow Transformer-Big/Base baseline model on English-German and Chinese-English tasks by 0.4-2.4 BLEU points. |
ARNOR: Attention Regularization based Noise Reduction for Distant Supervision Relation Classification (P19-1)
Copied to clipboard
| Challenge: | Distant supervision is used for relation classification but it introduces noisy labels . a novel approach to distant supervision relation classification is proposed . |
| Approach: | They propose a framework for distant supervision relation classification using attention regularization and attention regularizing . they assume that a trustable relation label should be explained by the neural attention model . |
| Outcome: | The proposed framework improves on the NYT data and noise reduction effect over state-of-the-art methods. |
RaFe: Ranking Feedback Improves Query Rewriting for RAG (2024.findings-emnlp)
Copied to clipboard
Shengyu Mao, Yong Jiang, Boli Chen, Xiao Li, Peng Wang, Xinyu Wang, Pengjun Xie, Fei Huang, Huajun Chen, Ningyu Zhang
| Challenge: | Large Language Models (LLMs) and Retrieval Augmentation Generation (RAG) techniques have evolved to enhance document retrieval by reformulating queries. |
| Approach: | They propose a framework for training query rewriting models that leverages a reranker framework. |
| Outcome: | The proposed framework provides ranking feedback aligned well with the rewriting objectives without needing signals from annotations and supports both online and offline training models. |
CONSTRUCTURE: Benchmarking CONcept STRUCTUre REasoning for Multimodal Large Language Models (2024.findings-emnlp)
Copied to clipboard
Zhiwei Zha, Xiangru Zhu, Yuanyi Xu, Chenghua Huang, Jingping Liu, Zhixu Li, Xuwu Wang, Yanghua Xiao, Bei Yang, Xiaoxiao Xu
| Challenge: | Existing multimodal large language models lack the ability to perceive the visual world with a deep concept structure cognition. |
| Approach: | They propose a concept-level benchmark to assess MLLMs’ hierarchical concept understanding and reasoning abilities. |
| Outcome: | The proposed model outperforms state-of-the-art models in concept structure reasoning evaluation. |
When Personalization Misleads: Understanding and Mitigating Hallucinations in Personalized LLMs (2026.findings-acl)
Copied to clipboard
| Challenge: | Personalization can inadvertently distort factual reasoning when faced with factual queries. |
| Approach: | They propose a lightweight inference-time approach that mitigates personalization-induced factual distortions while preserving personalized behavior. |
| Outcome: | Experiments across multiple LLM backbones and personalization methods show that FPPS significantly improves factual accuracy while maintaining personalized performance. |
DocFusion: A Unified Framework for Document Parsing Tasks (2025.findings-acl)
Copied to clipboard
Mingxu Chai, Ziyu Shen, Chong Zhang, Yue Zhang, Xiao Wang, Shihan Dou, Jihua Kang, Jiazheng Zhang, Qi Zhang
| Challenge: | Existing methods for document parsing often employ multiple models, limiting performance . Existing models often employ discrete tokens, whereas recognition relies on continuous coordinates . |
| Approach: | They propose a Gaussian-Kernel Cross-Entropy Loss (GK-CEL) that unifies detection and recognition by enabling generative frameworks to handle both tasks simultaneously. |
| Outcome: | The proposed model performs competitively across four core document parsing tasks. |
Large Language Models as Foundations for Next-Gen Dense Retrieval: A Comprehensive Empirical Assessment (2024.emnlp-main)
Copied to clipboard
| Challenge: | Pre-trained language models have limited generalization capabilities and performance challenges. |
| Approach: | They evaluate 15 different backbone LLMs and non-LLMs to evaluate their performance . larger models and extensive pre-training consistently enhance in-domain accuracy and data efficiency . |
| Outcome: | The results show that larger models and extensive pre-training enhance in-domain accuracy and data efficiency. |
Similarity = Value? Consultation Value-Assessment and Alignment for Personalized Search (2025.emnlp-main)
Copied to clipboard
| Challenge: | Existing methods rely on semantic similarity to align historical consultations with current queries due to the absence of ‘value’ labels, but this lacks exploration of needs in user consultations. |
| Approach: | They propose a consultation value assessment framework that evaluates historical consultations from three novel perspectives: (1) Scenario Scope Value, (2) Posterior Action Value, and (3) Time Decay Value. |
| Outcome: | The proposed model outperforms baselines on public and commercial datasets on both retrieval and ranking tasks. |
iTool: Reinforced Fine-Tuning with Dynamic Deficiency Calibration for Advanced Tool Use (2025.emnlp-main)
Copied to clipboard
Yirong Zeng, Xiao Ding, Yuxian Wang, Weiwen Liu, Yutai Hou, Wu Ning, Xu Huang, Duyu Tang, Dandan Tu, Bing Qin, Ting Liu
| Challenge: | Synthesizing tool-use data through real-world simulations is effective for enhancing large language models (LLMs) however, training gains decay as synthetic data increases, and the model struggles to benefit from more synthetic data. |
| Approach: | They propose an iterative reinforced fine-tuning strategy to improve LLMs with external tools to augment their capabilities. |
| Outcome: | The proposed method achieves 13.11% better performance than the same-size base model and outperforms larger open-source and closed-source models. |
Towards More Accurate Uncertainty Estimation In Text Classification (2020.emnlp-main)
Copied to clipboard
Jianfeng He, Xuchao Zhang, Shuo Lei, Zhiqian Chen, Fanglan Chen, Abdulaziz Alhamadani, Bei Xiao, ChangTien Lu
| Challenge: | Existing models of uncertainty score depend on winning score, which is the maximum probability in a semantic vector. |
| Approach: | They propose to generate accurate uncertainty score by improving the confidence of winning scores by reducing the effect of overconfidence of winning score and considering the impact of different categories simultaneously. |
| Outcome: | The proposed model reduces the effect of overconfidence of winning score and considers impact of different categories of uncertainty simultaneously. |
Investigating Inference-time Scaling for Chain of Multi-modal Thought: A Preliminary Study (2025.findings-acl)
Copied to clipboard
| Challenge: | Inference-time scaling of chain-of-thought (CoT) has been demonstrated as a promising approach for addressing multi-modal reasoning tasks. |
| Approach: | They propose to integrate visual and textual modalities within the reasoning process . they adopt a consistency-enhanced verifier to ensure effective guidance for both methods across different thought paradigms. |
| Outcome: | The proposed method outperforms text-only reasoning on 10 tasks spanning diverse domains and requires higher token consumption for processing richer visual inputs. |
Rethinking and Improving Multi-task Learning for End-to-end Speech Translation (2023.emnlp-main)
Copied to clipboard
| Challenge: | auxiliary tasks are highly consistent with end-to-end speech translation (ST) but their effectiveness has not been thoroughly studied. |
| Approach: | They propose an improved multi-task learning approach for the ST task that bridges the modal gap by mitigating the difference in length and representation. |
| Outcome: | The proposed approach achieves state-of-the-art on the MuST-C dataset with 20.8% of training time required by the current SOTA method. |
AGIF: An Adaptive Graph-Interactive Framework for Joint Multiple Intent Detection and Slot Filling (2020.findings-emnlp)
Copied to clipboard
| Challenge: | Existing models focus on the single intent scenario, ignoring the fine-grained multiple intents information integration for token-level slot prediction. |
| Approach: | They propose an Adaptive Graph-Interactive Framework for joint multiple intent detection and slot filling . they propose an intent-slot graph interaction layer to model the strong correlation between the slot and intents . |
| Outcome: | The proposed framework improves on three multi-intent datasets and new state-of-the-art performance on single-intention datasets. |
UNIVID: Unified Vision-Language Model for Video Moderation (2026.acl-industry)
Copied to clipboard
Kejuan Yang, Yizhuo Zhang, Mingyuan Du, Yue Zhang, Dixin Zheng, Kaili Zhao, Yang Xiao, Hanzhong Liang, Kenan Xiao
| Challenge: | Existing video moderation systems rely on fragmented black-box classification models that are difficult to maintain and lack transparency. |
| Approach: | They propose a Unified Vision-Language model for Video Moderation that generates policy-aware captions that serve as an interpretable intermediate representation. |
| Outcome: | The proposed model reduces violation leakage and overkill rate by 42.7% while reducing maintenance costs. |
Semi-supervised Fine-tuning for Large Language Models (2025.findings-naacl)
Copied to clipboard
| Challenge: | Existing LLMs require labeled data, which can be costly in real-world applications. |
| Approach: | They propose a framework that can fully exploit labeled and unlabeled data for LLM fine-tuning . they conducted experiments using GPT-4o-mini and Llama-3.1 on seven general or domain-specific datasets . |
| Outcome: | The proposed framework can fully exploit labeled and unlabeled data for LLM alignment from a propagate-and-select manner. |
Can Language Models Serve as Text-Based World Simulators? (2024.acl-short)
Copied to clipboard
| Challenge: | Recent advances in large language models (LLMs) have pointed towards an alternative approach by leveraging the huge amount of knowledge contained in their pre-training datasets. |
| Approach: | They build and use a benchmark to quantify how well text-based simulators can serve as text-driven world simulators. |
| Outcome: | The proposed benchmark aims to quantify how well language models can serve as world simulators. |
Pi-SQL: Enhancing Text-to-SQL with Fine-Grained Guidance from Pivot Programming Languages (2025.findings-emnlp)
Copied to clipboard
| Challenge: | Existing prompt-based methods craft meticulous text guidelines and examples to facilitate SQL generation, but their accuracy is hindered by the large semantic gap between the texts and the low-resource SQL programs. |
| Approach: | They propose to use Python as a pivot to bridge between natural language query and SQL program. |
| Outcome: | The proposed method improves the execution accuracy of the best-performing baseline by up to 3.20. |
Why Can Distillation Work with Limited Resources? A Systematic Study (2026.findings-acl)
Copied to clipboard
Xiao Hu, Xingyu Lu, Liyuan Mao, YiFan Zhang, Tianke Zhang, Bin Wen, Fan Yang, Tingting Gao, Guorui Zhou
| Challenge: | Recent advances in large language models have driven reasoning performance . low-resource distillation can boost models' performance, but a framework is missing . |
| Approach: | They conduct a controlled experiment to find out why low-resource distillation can boost model performance . they find that distillation enhances the presence of advanced cognitive behaviors . |
| Outcome: | The proposed model shows more flexible reasoning, the authors show . they show that distillation enhances the presence of advanced cognitive behaviors . |
Learning to Contextually Aggregate Multi-Source Supervision for Sequence Labeling (2020.acl-main)
Copied to clipboard
| Challenge: | Existing methods for Sequence Labeling require high-quality annotations, but imperfect annotations are relatively easy to obtain from crowdsourcing (noisy labels) Existing approaches to learn a model without knowing the underlying ground truth label sequences in the target domain are expensive and time-consuming. |
| Approach: | They propose a framework Consensus Network that can be trained on annotations from multiple sources. |
| Outcome: | The proposed framework improves on learning with crowd annotations and unsupervised cross-domain model adaptation in two practical settings. |
Attribution-Guided Multi-Object Hallucination and Bias Detection in Vision-Language Models (2026.eacl-long)
Copied to clipboard
| Challenge: | Existing methods struggle with multi-object grounding because language priors dominate visual evidence, causing hallucinated or biased objects to produce attention distributions or similarity scores nearly indistinguishable from those of real objects. |
| Approach: | They propose a Shapley value-based attribution framework that uses Kernel SHAP and multi-layer fusion to detect hallucinated and biased objects. |
| Outcome: | Evaluated on ADE and COCO datasets, SHAPLENS improves hallucination detection accuracy by 8–12% and F1 by 10–14% over baselines. |
DiffuSum: Generation Enhanced Extractive Summarization with Diffusion (2023.findings-acl)
Copied to clipboard
| Challenge: | Existing methods for extractive summarization are formulated as a sequence labeling problem by making individual sentence label predictions. |
| Approach: | They propose a novel paradigm for extractive summarization by directly generating summary sentences with diffusion models and extracting sentences based on sentence representation matching. |
| Outcome: | The proposed framework achieves state-of-the-art extractive results on CNN/DailyMail with ROUGE scores of 44.83/22.56/40.56. |
Topic-DPR: Topic-based Prompts for Dense Passage Retrieval (2023.findings-emnlp)
Copied to clipboard
| Challenge: | Prior research focused on optimizing a single prompt as a continuous prompt, but this approach leads to a semantic space collapse, preventing differentiation between relevant and irrelevant passages. |
| Approach: | They propose a dense passage retrieval model that uses topic-based prompts and propose 'positive and negative sampling strategies' to boost dense retrieval efficiency. |
| Outcome: | The proposed model surpasses state-of-the-art retrieval techniques and improves space uniformity. |
Improving Knowledge Base Construction from Robust Infobox Extraction (N19-2)
Copied to clipboard
| Challenge: | Existing knowledge bases are incomplete, resulting in poor answers and incompleteness. |
| Approach: | They propose a method to extract Wikipedia infobox tables to populate an existing KB. |
| Outcome: | The proposed method improves accuracy and completeness of the final KB significantly compared to DBpedia's baseline method. |
ChatGPT as an Attack Tool: Stealthy Textual Backdoor Attack via Blackbox Generative Model Trigger (2024.naacl-long)
Copied to clipboard
| Challenge: | Textual backdoor attacks are increasingly challenging to detect due to the use of advanced generative models such as GPT-4. |
| Approach: | They propose a framework that harnesses advanced generative models to execute stealthier backdoor attacks on text classifiers. |
| Outcome: | The proposed framework achieves state-of-the-art attack success rate of 97.35% over four sentiment classification tasks and four human cognition stealthiness tests. |
Generating Reasonable and Diversified Story Ending Using Sequence to Sequence Model with Adversarial Training (C18-1)
Copied to clipboard
| Challenge: | Story generation is a challenging problem in artificial intelligence (AI) . previous work focused on learning statistical models of event sequences from large-scale text corpora . |
| Approach: | They propose to use adversarial training to generate reasonable story endings . their model includes a generator that defines the policy of generating a story ending . |
| Outcome: | The proposed model achieves better performance on the task of Story Cloze Test with an accuracy of 62.6% compared with state-of-the-art baseline methods. |
Competition-Level Problems are Effective LLM Evaluators (2024.findings-acl)
Copied to clipboard
Yiming Huang, Zhenghao Lin, Xiao Liu, Yeyun Gong, Shuai Lu, Fangyu Lei, Yaobo Liang, Yelong Shen, Chen Lin, Nan Duan, Weizhu Chen
| Challenge: | Large language models (LLMs) have demonstrated impressive reasoning capabilities, yet there is ongoing debate about their capabilities and the potential data contamination problem. |
| Approach: | They propose to evaluate the reasoning capabilities of large language models in solving recent competition-level programming problems in Codeforces. |
| Outcome: | The proposed model has experienced a cliff-like decline in problems after September 2021, which shows the potential data contamination and the challenges for any existing LLM to solve unseen complex reasoning problems. |
SADA: Bridging In-Context Learning and Fine-Tuning via State-Aligned Distillation Adapters (2026.acl-long)
Copied to clipboard
| Challenge: | Prompt-based in-context learning and parameter fine-tuning are dominant paradigms for incorporating external information into large language models, but they incur high inference costs or require expensive retraining. |
| Approach: | They propose to convert prompts into temporary adapter weights to bridge this gap by converting prompts to temporary adapters. |
| Outcome: | The proposed model outperforms baselines on long-context language modeling and downstream NLU and summarization benchmarks while significantly reducing memory footprint and latency. |
Defenses Against Prompt Attacks Learn Surface Heuristics (2026.acl-long)
Copied to clipboard
| Challenge: | Large language models (LLMs) are increasingly deployed in security-sensitive applications . recent defenses rely on supervised fine-tuning with benign and malicious labels . position bias arises when benign content placed later in a prompt is rejected at much higher rates . |
| Approach: | They analyze three recurring shortcut behaviors induced by supervised fine-tuning . position bias arises when benign content placed later in a prompt is rejected . token trigger bias occurs when strings common in attack data raise rejection probability . |
| Outcome: | The proposed model overrides intended logic when adversarial instructions appear . the proposed model has low rejection rates but narrow correlations in defense data . |
QueryAttack: Jailbreaking Aligned Large Language Models Using Structured Non-natural Query Language (2025.findings-acl)
Copied to clipboard
Qingsong Zou, Jingyu Xiao, Qing Li, Zhi Yan, Yuhang Wang, Li Xu, Wenxuan Wang, Kuofeng Gao, Ruoyu Li, Yong Jiang
| Challenge: | Existing methods to bypass security defenses of large language models (LLMs) are not effective, but QueryAttack can be jailbroken. |
| Approach: | They propose a framework to examine generalizability of safety alignment by translating malicious queries into structured non-natural query languages. |
| Outcome: | The proposed framework can achieve high attack success rates and jailbreak various defense methods on mainstream LLMs. |
CVE-Bench: Benchmarking LLM-based Software Engineering Agent’s Ability to Repair Real-World CVE Vulnerabilities (2025.naacl-long)
Copied to clipboard
| Challenge: | Large Language Models (LLMs) and LLM agents have demonstrated significant potential in this domain by understanding descriptions in natural language and generating corresponding formal code. |
| Approach: | They propose an evaluation framework that provides LLM agents with a test environment that simulates the real-world vulnerability repair process. |
| Outcome: | The proposed framework can repair 21% of vulnerabilities at its best, but lacks expert knowledge . the evaluation framework can only repair 29% of vulnerabilities, but it can be used in real-world scenarios . |
Online Iterative Self-Alignment for Radiology Report Generation (2025.acl-long)
Copied to clipboard
| Challenge: | Existing methods for RRG rely on supervised fine-tuning based on data pairs of radiological images and corresponding radiologist-annotated reports. |
| Approach: | They propose a method that performs supervised fine-tuning on data pairs of radiological images and corresponding radiologist-annotated reports. |
| Outcome: | The proposed method surpasses existing methods and achieves state-of-the-art performance across multiple evaluation metrics. |
A Graph Enhanced BERT Model for Event Prediction (2022.findings-acl)
Copied to clipboard
| Challenge: | Existing methods to predict subsequent events use sparsity of event graph to improve performance. |
| Approach: | They propose to automatically build event graph using a BERT model by adding a structured variable to the model to learn to predict event connections. |
| Outcome: | The proposed model outperforms state-of-the-art models on two event prediction tasks. |
CSR-Bench: Benchmarking LLM Agents in Deployment of Computer Science Research Repositories (2025.naacl-long)
Copied to clipboard
| Challenge: | Large Language Models (LLMs) have demonstrated significant advances in computer science research . current agent-related applications include code writing, code base generation, code correction and more. |
| Approach: | They propose a benchmark to assess the effectiveness of Large Language Models (LLMs) they propose GitHub agent framework that automates deployment of GitHub repositories . |
| Outcome: | The proposed framework improves the deployment of GitHub code repositories and thereby boosts developer productivity. |
Transparent and Scrutable Recommendations Using Natural Language User Profiles (2024.acl-long)
Copied to clipboard
| Challenge: | Recent advances in Large Language Models (LLMs) rely on implicit or explicit feedback from users to suggest new items, resulting in a lack of transparency and a user's ability to scrutinize and modify their preferences. |
| Approach: | They propose to use a natural language (NL) user profile to summarize a user's preferences and then use it to fine-tune a LLM using only NL profiles to make transparent and scrutable recommendations. |
| Outcome: | The proposed model performs on two benchmarking rating prediction datasets and is comparable to existing models. |
Polymorphic Universal Transformer (2026.acl-long)
Copied to clipboard
Yilong Chen, Zitian Gao, Yihao Xiao, Jason Klein Liu, Xinyu Yang, Yifan Luo, Haoming Luo, Zhengmao Ye, Tingwen Liu, Ran Tao, Bryan Dai
| Challenge: | Compute Distribution Skew is a pathological phenomenon in ultra-deep recurrent models . it causes over-smoothing, representation rank collapse, and degraded reasoning performance. |
| Approach: | They propose a dynamic architecture that redefines recursive computation by decoupling parameter count from depth. |
| Outcome: | The proposed model significantly improves representation rank and reasoning robustness while reducing computation by 64.7%. |
Any Information Is Just Worth One Single Screenshot: Unifying Search With Visualized Information Retrieval (2025.acl-long)
Copied to clipboard
| Challenge: | Existing multimodal retrieval models are lacking in visual representations of multimodal data. |
| Approach: | They propose a visualized information retrieval paradigm where multimodal information is represented by a unified visual format called Screenshots for various retrieval applications. |
| Outcome: | The proposed model is based on a large dataset of screenshots from diverse sources . it is compared with existing models and lays a solid foundation for the new model . |
Plug-and-Play Document Modules for Pre-trained Models (2023.acl-long)
Copied to clipboard
Chaojun Xiao, Zhengyan Zhang, Xu Han, Chi-Min Chan, Yankai Lin, Zhiyuan Liu, Xiangyang Li, Zhonghua Li, Zhao Cao, Maosong Sun
| Challenge: | Large-scale pre-trained models have been widely adopted for document-oriented NLP tasks, such as question answering. |
| Approach: | They propose to decouple document encoding from downstream tasks by introducing a document plugin into the backbone of a PTM. |
| Outcome: | The proposed model can encode documents once and for all across different scenarios. |
Contrastive Learning for Many-to-many Multilingual Neural Machine Translation (2021.acl-long)
Copied to clipboard
| Challenge: | Existing multilingual machine translation approaches focus on English-centric directions, while non-English directions lag behind. |
| Approach: | They propose a multilingual machine translation system with an emphasis on non-English directions. |
| Outcome: | The proposed model outperforms existing models on English-centric and non-English directions on multilingual translation benchmarks. |
SudoLM: Learning Access Control of Parametric Knowledge with Authorization Alignment (2025.acl-long)
Copied to clipboard
| Challenge: | Existing preference alignment is a one-size-fits-all alignment mechanism, where the part of the large language model parametric knowledge with non-preferred features is uniformly blocked to all the users. |
| Approach: | They propose a framework that lets LLMs learn access control over parametric knowledge for users with different credentials via authorization alignment. |
| Outcome: | Experiments on two application scenarios show that the proposed framework effectively controls the user’s access to parametric knowledge and maintains its general utility. |
Memory-Augmented LLM-based Multi-Agent System for Automated Feature Generation on Tabular Data (2026.acl-long)
Copied to clipboard
| Challenge: | Existing methods for automated feature generation rely on predefined operator libraries and do not incorporate feature semantics, limiting their ability to produce high-quality features. |
| Approach: | They propose a Memory-Augmented LLM-based Multi-Agent System (MALMAS) that decomposes the generation process into agents with distinct responsibilities. |
| Outcome: | The proposed method extracts informative features from raw tabular data without manual intervention and is crucial for accurate, generalizable machine learning. |
Geneverse: A Collection of Open-source Multimodal Large Language Models for Genomic and Proteomic Research (2024.findings-emnlp)
Copied to clipboard
| Challenge: | generative Large Language Models (LLMs) are a promising tool for biomedical and healthcare research. |
| Approach: | They propose to use finetuned LLMs and multimodal LLM for genomic and proteomics tasks. |
| Outcome: | The proposed models outperform closed-source models in genomic and proteomics tasks and are highly accurate. |
BIPEFT: Budget-Guided Iterative Search for Parameter Efficient Fine-Tuning of Large Pretrained Language Models (2024.findings-emnlp)
Copied to clipboard
| Challenge: | Existing methods for parameter-efficient fine-tuning are limited by computational and storage requirements. |
| Approach: | They propose a budget-guided iterative search strategy to disentangle binary module and rank dimension search spaces and early selection strategies based on parameter budgets. |
| Outcome: | The proposed method significantly improves search efficiency on public benchmarks. |
Beneath Surface Similarity: Large Language Models Make Reasonable Scientific Analogies after Structure Abduction (2023.findings-emnlp)
Copied to clipboard
| Challenge: | Existing studies have focused on word analogies, but they neglect structures that underpin analogical reasoning. |
| Approach: | They propose a task to abduct structures that form an analogy between two systems to evaluate their analogical reasoning abilities. |
| Outcome: | The proposed task is based on 400 scientific analogies from 13 different fields and is compared with a standard SCAR benchmark. |
Concise and Organized Perception Facilitates Reasoning in Large Language Models (2025.findings-naacl)
Copied to clipboard
| Challenge: | Extensive experimental results on several popular logical benchmarks (ProofWriter, PrOntoQA, PrONtoQA-OOD, and FOLIO) and mathematical benchmark (DI-GSM) show that COP significantly outperforms previous state-of-the-art methods. |
| Approach: | They propose a reasoning approach called Concise and Organized Perception (COP) that carefully analyzes the given statements to identify the most pertinent information while eliminating redundancy efficiently. |
| Outcome: | The proposed approach outperforms state-of-the-art methods on several popular logical benchmarks and mathematical benchmarks. |
Enhancing Visual-Language Modality Alignment in Large Vision Language Models via Self-Improvement (2025.findings-naacl)
Copied to clipboard
Xiyao Wang, Jiuhai Chen, Zhaoyang Wang, Yuhang Zhou, Yiyang Zhou, Huaxiu Yao, Tianyi Zhou, Tom Goldstein, Parminder Bhatia, Taha Kass-Hout, Furong Huang, Cao Xiao
| Challenge: | Existing methods for visual and language alignment depend on external models or data, leading to uncontrollable and unstable results. |
| Approach: | They propose a framework that enhances visual and language alignment without external dependencies by incorporating an in-context self-critic mechanism that constructs preference pairs for tuning. |
| Outcome: | The proposed framework outperforms existing methods and improves performance on 14 hallucination and comprehensive benchmarks. |
SepSeq: A Training-Free Framework for Long Numerical Sequence Processing in LLMs (2026.findings-acl)
Copied to clipboard
Jie Sun, Yu Liu, Lu Han, Qiwen Deng, Xiang Shu, Yang Xiao, Lintao Ma, Xingyu Lu, Jun Zhou, Pengfei Liu, Jiancan Wu, Xiang Wang
| Challenge: | Existing large-scale large-context models suffer from performance degradation when processing long numerical sequences. |
| Approach: | They propose a framework to mitigate attention dispersion by strategically inserting separator tokens into the model to recalibrat attention to local segments while preserving global context. |
| Outcome: | The proposed framework improves accuracy and reduces inference token consumption by 16.4% on 9 widely-adopted LLMs. |
CMNEE:A Large-Scale Document-Level Event Extraction Dataset Based on Open-Source Chinese Military News (2024.lrec-main)
Copied to clipboard
| Challenge: | Current research focuses on the general news or financial domains, with relatively few studies for military domain. |
| Approach: | They propose to annotate Chinese military news events from documents using a schema for the military domain. |
| Outcome: | The proposed dataset is large-scale, document-level open-source for the military domain . it contains 17,000 documents and 29,223 events, which are all manually annotated . |
A Knowledge-driven Adaptive Collaboration of LLMs for Enhancing Medical Decision-making (2025.emnlp-main)
Copied to clipboard
| Challenge: | Medical decision-making often involves integrating knowledge from multiple clinical specialties. static, pre-assigned roles hinder adaptability and dynamic knowledge integration. |
| Approach: | They propose a Knowledge-driven Adaptive Multi-Agent Collaboration framework that emulates large language models to emulate expert teamwork. |
| Outcome: | The proposed framework outperforms single-agent and advanced multi-agend methods on two real-world medical scenarios. |
Inverting the Shield: Systematically Generating Safety Tests from Policy Specifications (2026.acl-long)
Copied to clipboard
| Challenge: | Existing safety evaluation paradigms rely on constructed benchmarks or dynamic red-teaming to probe potential vulnerabilities. |
| Approach: | They propose a framework that integrates specification-based software testing with AI safety. |
| Outcome: | The proposed framework achieves higher coverage and attack success counts compared to baselines. |
DeepStruct: Pretraining of Language Models for Structure Prediction (2022.findings-acl)
Copied to clipboard
| Challenge: | Pretrained language models perform structural understanding tasks that focus on understanding one aspect of the text. |
| Approach: | They propose a method for improving the structural understanding abilities of language models by pretraining them to generate structures from the text on task-agnostic corpora. |
| Outcome: | The proposed model performs state-of-the-art on 21 of 28 datasets. |
How Does NLP Benefit Legal System: A Summary of Legal Artificial Intelligence (2020.acl-main)
Copied to clipboard
| Challenge: | Legal Artificial Intelligence (LegalAI) focuses on applying artificial intelligence to help legal tasks. |
| Approach: | They introduce the history, current state, and future directions of research in LegalAI . they illustrate the tasks from the perspectives of legal professionals and NLP researchers . |
| Outcome: | The proposed system can reduce heavy and redundant work for legal professionals . it can also provide a reliable reference to those who are not familiar with the legal domain . |
On Hallucination and Predictive Uncertainty in Conditional Language Generation (2021.eacl-main)
Copied to clipboard
| Challenge: | Modern deep neural network models have brought drastic improvements in generation quality measured by standard metrics on different natural language generation tasks. |
| Approach: | They propose a beam search extension to reduce hallucination in conditional language generation by adding a prediction extension to beam search. |
| Outcome: | The proposed extension improves trading performance on standard metric for less hallucination with the proposed beam search variant. |
Hierarchical Multi-label Text Classification with Horizontal and Vertical Category Correlations (2021.emnlp-main)
Copied to clipboard
| Challenge: | Existing approaches to hierarchical multi-label text classification ignore vertical category correlations or exploit dependencies across levels without considering horizontal correlations . |
| Approach: | They propose a hierarchical multi-label text classification framework that considers both vertical and horizontal category correlations. |
| Outcome: | The proposed framework improves on real-world HMTC datasets with significant improvements over baselines. |
Are LLMs Capable of Data-based Statistical and Causal Reasoning? Benchmarking Advanced Quantitative Reasoning with Data (2024.findings-acl)
Copied to clipboard
| Challenge: | Quantitative reasoning with data is a critical skill to analyze data, yet the assessment of such ability remains limited. |
| Approach: | They propose a quantitative reasoning with data benchmark to evaluate Large Language Models' ability in statistical and causal reasoning with real-world data. |
| Outcome: | The proposed model GPT-4 achieves an accuracy of 58%, while open-source model Deepseek-coder-instruct gets the highest accuracy of 37%. |
Allies: Prompting Large Language Model with Beam Search (2023.findings-emnlp)
Copied to clipboard
| Challenge: | Existing methods to build LLMs with stacking are limited by their information coverage and low fault tolerance. |
| Approach: | They propose a method that leverages large language models to iteratively generate new queries from an input query. |
| Outcome: | The proposed method outperforms baselines on open-domain question answering benchmarks. |
TextFlint: Unified Multilingual Robustness Evaluation Toolkit for Natural Language Processing (2021.acl-demo)
Copied to clipboard
Xiao Wang, Qin Liu, Tao Gui, Qi Zhang, Yicheng Zou, Xin Zhou, Jiacheng Ye, Yongxin Zhang, Rui Zheng, Zexiong Pang, Qinzhuo Wu, Zhengyan Li, Chong Zhang, Ruotian Ma, Zichu Fei, Ruijian Cai, Jun Zhao, Xingwu Hu, Zhiheng Yan, Yiding Tan, Yuan Hu, Qiyuan Bian, Zhihua Liu, Shan Qin, Bolin Zhu, Xiaoyu Xing, Jinlan Fu, Yue Zhang, Minlong Peng, Xiaoqing Zheng, Yaqian Zhou, Zhongyu Wei, Xipeng Qiu, Xuanjing Huang
| Challenge: | Existing approaches to textual robustness evaluation focus on slightly modifying the input data, which maintains the original meaning and results in a different prediction. |
| Approach: | They propose a multilingual robustness evaluation toolkit for NLP that integrates universal text transformations, task-specific transformations and adversarial attack. |
| Outcome: | The toolkit includes universal text transformation, task-specific transformation, adversarial attack, subpopulation, and their combinations to provide comprehensive robustness analyses. |
Fine-Grained and Multi-Dimensional Metrics for Document-Level Machine Translation (2025.naacl-srw)
Copied to clipboard
| Challenge: | Large language models excel in machine translation, but most studies focus on sentence-level translation. |
| Approach: | They propose to use LLMs as a judge paradigm to evaluate document-level translations by directly prompting them to translate entire documents in a single pass. |
| Outcome: | The proposed method improves translation quality even without document-level fine-tuning compared to translating sentences separately . |
SOLAR-RL: Semi-Online Long-horizon Assignment Reinforcement Learning (2026.findings-acl)
Copied to clipboard
Jichao Wang, Liuyang Bian, Yufeng Zhou, Han Xiao, Yue Pan, Guozhi Wang, Hao Wang, Zhaoxiong Wang, Yafei Wen, Xiaoxin Chen, Shuai Ren, Lingfang Zeng
| Challenge: | Existing approaches to training GUI agents on dynamic tasks are based on SFT or Behavior Cloning. |
| Approach: | They propose a framework that integrates global trajectory insights directly into offline learning . they reconstruct diverse rollout candidates from static data and detect first failure point . |
| Outcome: | The proposed framework improves long-horizon task completion rates and robustness compared to baselines. |
Process-based Self-Rewarding Language Models (2025.findings-acl)
Copied to clipboard
| Challenge: | Existing methods to reward LLMs' outputs are not effective in mathematical reasoning scenarios and may lead to a decline in performance. |
| Approach: | They propose a process-based self-rewarding pipeline that integrates long-thought reasoning, step-wise LLM-as-a-Judge, and step- wise preference optimization within the existing paradigm. |
| Outcome: | The proposed model improves the performance of Large Language Models on multiple mathematical reasoning benchmarks and shows that it can surpass human capabilities. |
Semi-supervised Autoencoding Projective Dependency Parsing (2020.coling-main)
Copied to clipboard
| Challenge: | Existing models for semi-supervised dependency parsing use labeled data, but they require large amounts of labeles. |
| Approach: | They propose two end-to-end autoencoding models for semi-supervised graph-based projective dependency parsing. |
| Outcome: | The proposed models outperform a semi-supervised model on WSJ and UD dependency parsing data sets. |
DSRM: Boost Textual Adversarial Training with Distribution Shift Risk Minimization (2023.acl-long)
Copied to clipboard
| Challenge: | Existing adversarial training methods require multi-step gradient ascents or word substitutions to obtain adversarials, which impairs the effectiveness of adversariarial training. |
| Approach: | They propose a procedure for instead adversarial training with only clean data that estimates the adversarials loss by perturbing the input data’s probability distribution rather than their embeddings. |
| Outcome: | The proposed procedure reduces time consumption by up to 70% compared to current best-performing adversarial training methods. |
Towards Open-Domain Twitter User Profile Inference (2023.findings-acl)
Copied to clipboard
| Challenge: | Existing approaches to user profile inference focus on limited attributes and can reveal users' private information. |
| Approach: | They propose a prompt-based generation method which can infer values implicitly mentioned in Twitter user profiles. |
| Outcome: | The proposed method can infer more comprehensive user profiles than baseline extraction-based methods, but limitations remain to be applied for real-world use. |
FinMME: Benchmark Dataset for Financial Multi-Modal Reasoning Evaluation (2025.acl-long)
Copied to clipboard
Junyu Luo, Zhizhuo Kou, Liming Yang, Xiao Luo, Jinsheng Huang, Zhiping Xiao, Jingshu Peng, Chengzhong Liu, Jiaming Ji, Xuanzhe Liu, Sirui Han, Ming Zhang, Yike Guo
| Challenge: | Multimodal Large Language Models (MLLMs) have experienced rapid development in recent years, but there is a notable lack of effective and specialized multimodal evaluation datasets in the financial domain. |
| Approach: | They introduce FinMME, a multimodal large language model with 11,000 financial research samples and 20 annotators. |
| Outcome: | The proposed model performs better than state-of-the-art models, highlighting its challenging nature. |
Humanizing Machines: Rethinking LLM Anthropomorphism Through a Multi-Level Framework of Design (2025.emnlp-main)
Copied to clipboard
| Challenge: | Large Language Models (LLMs) exhibit anthropomorphism characteristics – human-like qualities portrayed across their outlook, language, behavior, and reasoning functions. |
| Approach: | They propose that anthropomorphism should be treated as a design concept that can be intentionally tuned to support user goals. |
| Outcome: | The proposed design should reflect interaction between artifact designers and interpreters, and should be based on cues embedded in the artifactor and the (cognitive) responses of interpreters to the cue. |
Shall We Team Up: Exploring Spontaneous Cooperation of Competing LLM Agents (2024.findings-emnlp)
Copied to clipboard
Zengqing Wu, Run Peng, Shuyuan Zheng, Qianying Liu, Xu Han, Brian Kwon, Makoto Onizuka, Shaojie Tang, Chuan Xiao
| Challenge: | Large Language Models (LLMs) are increasingly used in social simulations, where they are guided by carefully crafted instructions to exhibit human-like behaviors. |
| Approach: | They propose to use Large Language Models (LLMs) as agents to simulate the gradual transition from non-cooperative to cooperative behaviors of agents. |
| Outcome: | The proposed model can simulate the gradual transition from non-cooperative to cooperative behaviors in three competitive scenarios. |
Generative Personality Simulation via Theory-Informed Structured Interview (2026.eacl-long)
Copied to clipboard
Pengda Wang, Huiqi Zou, Han Jiang, Hanjie Chen, Tianjun Sun, Xiaoyuan Yi, Ziang Xiao, Frederick L. Oswald
| Challenge: | Personality structured interviews are often lacking in advancing social science research. |
| Approach: | They propose a method to incorporate psychological insights into LLM simulations . they use a measure theory grounded evaluation procedure to evaluate reliability and validity . |
| Outcome: | The proposed method improves human-like heterogeneity in LLM-simulated personality data and predicts personality-related behavioral outcomes. |
HumanLLM: Benchmarking and Improving LLM Anthropomorphism via Human Cognitive Patterns (2026.acl-long)
Copied to clipboard
Xintao Wang, Jian Yang, Weiyuan Li, Rui Xie, Jen-tse Huang, Jun Gao, Shuai Huang, Yueping Kang, Yuanli Guo, Hongwei Feng, Yanghua Xiao
| Challenge: | Large Language Models (LLMs) have demonstrated remarkable capabilities in reasoning and generation, serving as the foundation for advanced persona simulation and Role-Playing Language Agents (RPLAs). |
| Approach: | They propose a framework that treats psychological patterns as interacting causal forces and synthesizes 113 scenarios where 2-5 patterns reinforce, conflict, or modulate each other. |
| Outcome: | The proposed framework outperforms Qwen3-32B on multi-pattern dynamics despite 4 fewer parameters. |
Natural Evolution-based Dual-Level Aggregation for Temporal Knowledge Graph Reasoning (2024.findings-emnlp)
Copied to clipboard
| Challenge: | Existing models ignore asynchronous characteristics of event evolution, resulting in suboptimal performance. |
| Approach: | They propose a Natural Evolution-based Dual-level Aggregation framework for TKG reasoning that incorporates asynchronous characteristics of event evolution into the model. |
| Outcome: | The proposed model incorporates the asynchronous characteristics of event evolution for representation computation, thus improving prediction performance. |
DANCE: Diversity-attended Dynamic Caching with Asymmetric Quantization for Test-time Adaptation of Vision-Language Models (2026.findings-acl)
Copied to clipboard
| Challenge: | Existing approaches to test-time adaptation of vision-language models measure prediction entropy but these samples tend to approach prototypes with limited coverage of data distributions. |
| Approach: | They propose a new approach for test-time adaptation of vision-language models . they construct a dynamic cache to store diversity-aware test samples . |
| Outcome: | The proposed approach is more efficient than current methods on augmented visual models. |
Modeling Semantic Compositionality with Sememe Knowledge (P19-1)
Copied to clipboard
| Challenge: | Semantic compositionality (SC) is defined as the phenomenon that the meaning of a complex linguistic unit can be composed of the meanings of its constituents. |
| Approach: | They propose to incorporate sememes into SC models and employ them in learning multiword expressions. |
| Outcome: | The proposed models achieve significant performance boost compared to baseline methods without sememe knowledge. |
How Do Large Language Models Perform on PDE Discovery: A Coarse-to-fine Perspective (2025.findings-emnlp)
Copied to clipboard
| Challenge: | Existing methods to identify partial differential equations using large language models suffer from performance degradation under extreme data scarcity. |
| Approach: | They propose a framework to use large language models to identify underlying partial differential equations out of very limited observations of a physical system. |
| Outcome: | The proposed framework is based on a coarse-to-fine paradigm to discover PDEs out of very limited observations of a physical system. |
TinyJudge: Unverifiable Constraint Alignment via Lightweight Specialist Ensembles (2026.acl-long)
Copied to clipboard
Yirong Zeng, Yufei Liu, Xiao Ding, Yutai Hou, Yuxian Wang, Wu Ning, Haonan Song, Dandan Tu, Qixun Zhang, Yuxiang He, Bibo Cai, Ting Liu
| Challenge: | Instruction Following (IF) is a core capability of LLMs, requiring strict adherence to diverse constraints. |
| Approach: | They propose a framework that uses tiny language models to evaluate instruction following . they propose to use a set of specialized tiny language model to provide rewards for soft constraints. |
| Outcome: | The proposed framework outperforms baseline models by 12% and speeds up training time by 3. |
Exploring and Mitigating Shortcut Learning for Generative Large Language Models (2024.lrec-main)
Copied to clipboard
| Challenge: | Recent large language models (LLMs) have incredible instruction-following capabilities while maintaining strong task completion ability. |
| Approach: | They propose a framework to encourage LLMs to Forget Spurious correlations and Learn from In-context information. |
| Outcome: | The proposed framework can mitigate shortcut learning by forging spurious correlations and learning from in-context information. |
Gen-SQL: Efficient Text-to-SQL By Bridging Natural Language Question And Database Schema With Pseudo-Schema (2025.coling-main)
Copied to clipboard
| Challenge: | Recent studies have shifted paradigms and leveraged Large Language Models (LLMs) to tackle the challenging task of Text-to-SQL. |
| Approach: | They propose a framework that leverages large language models to generate SQL queries . they exploit prior knowledge from the LLM to enhance embedding-based retriever . |
| Outcome: | The proposed method improves embedding-based retriever and reduces cost. |
Dialogue-RAG: Enhancing Retrieval for LLMs via Node-Linking Utterance Rewriting (2025.acl-long)
Copied to clipboard
| Challenge: | Large Language Models (LLMs) and Retrieval Augmented Generation (RAG) methods have demonstrated significant potential on tasks across multiple domains. |
| Approach: | They propose a lightweight IUR model for query rewriting to complete key information in dialogue to enhance retrieval. |
| Outcome: | The proposed model improves retrieval and generation ability of RAG system in multi-round dialogue scenarios. |
Instructed Language Models with Retrievers Are Powerful Entity Linkers (2023.emnlp-main)
Copied to clipboard
| Challenge: | Generative approaches powered by large language models have demonstrated emergent abilities in tasks that require complex reasoning abilities. |
| Approach: | They propose a sequence-to-sequence training objective with instruction-tuning that enables casual language models to perform entity linking over knowledge bases. |
| Outcome: | The proposed framework outperforms existing approaches with +6.8 F1 points gain on average and huge advantage in training data efficiency and compute consumption. |