Papers by Fan Fan
Task Matters: Knowledge Requirements Shape LLM Responses to Context–Memory Conflict (2026.findings-acl)
Copied to clipboard
| Challenge: | Prior work has shown that large language models favor parametric knowledge under conflict, but this setting assumes that tasks should always rely on the provided passage. |
| Approach: | They propose a model-agnostic diagnostic framework that holds underlying knowledge constant while injecting controlled conflicts across tasks with varying knowledge requirements. |
| Outcome: | Evaluating representative open-source LLMs, the proposed framework holds underlying knowledge constant while injecting controlled conflicts across tasks with varying knowledge requirements. |
GLGR: Question-aware Global-to-Local Graph Reasoning for Multi-party Dialogue Reading Comprehension (2023.findings-emnlp)
Copied to clipboard
| Challenge: | Existing approaches for multi-hop reasoning are lacking for local graph reasoning . existing approaches neglect local semantic structures in utterances . |
| Approach: | They propose a question-aware global-to-local graph reasoning approach that expands the canonical Interlocutor-Utterance graph by introducing a query node. |
| Outcome: | The proposed approach outperforms existing methods on Molweni and FriendsQA. |
Soundwave: Less is More for Speech-Text Alignment in LLMs (2025.acl-long)
Copied to clipboard
| Challenge: | Existing end-to-end speech large language models rely on large-scale annotated data for training, while data-efficient training has not been discussed in depth. |
| Approach: | They propose a training strategy and a novel architecture to address representation space gap and sequence length inconsistency in speech and text. |
| Outcome: | The proposed model outperforms other advanced speech LLMs in speech translation and AIR-Bench speech tasks with only a fraction of the training data. |
OSC: Cognitive Orchestration through Dynamic Knowledge Alignment in Multi-Agent LLM Collaboration (2025.findings-emnlp)
Copied to clipboard
| Challenge: | Prior work has advanced agent selection and result aggregation, efficient linguistic interactions for deep collaboration among expert agents remain a critical bottleneck. |
| Approach: | They propose a knowledge-aware adaptive collaboration framework to enhance cognitive synergy in multi-agent systems with large language models. |
| Outcome: | The proposed framework improves synergy between agents and language models by enabling agents to dynamically perceive their collaborators’ cognitive states. |
MedEBench: Diagnosing Reliability in Text-Guided Medical Image Editing (2025.findings-emnlp)
Copied to clipboard
| Challenge: | Text-guided image editing has seen significant progress in natural image domains, but its application in medical imaging remains limited. |
| Approach: | a new benchmark is designed to diagnose reliability in text-guided medical image editing. a clinically grounded evaluation framework measures Editing Accuracy, Context Preservation, and Visual Quality. |
| Outcome: | a new benchmark is designed to diagnose reliability in medical image editing. |
LaCo: Layer-wise Compensation for Pruned Large Language Models (2026.acl-long)
Copied to clipboard
| Challenge: | Existing methods for predicting performance degradations of Large Language Models (LLMs) neglect the structural distortions caused by sparsity. |
| Approach: | They propose a framework that reorients the recovery paradigm from global adaptation to hierarchical representation alignment by sequentially optimizing each layer to reconstruct the model's hidden states. |
| Outcome: | The proposed framework surpasses parameter-efficient baselines in perplexity reduction and zero-shot reasoning. |
S2S-Arena: Evaluating Paralinguistic Instruction Following in Speech-to-Speech Models (2026.acl-long)
Copied to clipboard
Feng Jiang, Zhiyu Lin, Yiyang Liu, Liumeng Xue, Fan Bu, Yuhao Du, Xiangying Chen, Benyou Wang, Haizhou Li
| Challenge: | Existing benchmarks rely heavily on text-based evaluation and largely ignore paralinguistic cues such as prosody, emotion, and speaker traits. |
| Approach: | They propose a speech-native benchmark for evaluating instruction-following S2S models with explicit assessment of both semantic understanding and paralinguistic expression. |
| Outcome: | The proposed system enables more natural, robust, and human-aligned speech agents. |
QUITO-X: A New Perspective on Context Compression from the Information Bottleneck Theory (2025.findings-emnlp)
Copied to clipboard
Yihang Wang, Xu Huang, Bowen Tian, Yueyang Su, Lei Yu, Huaming Liao, Yixing Fan, Jiafeng Guo, Xueqi Cheng
| Challenge: | Existing methods for compressing context by removing redundant tokens are inconsistent with the objective of retaining the most important tokens when conditioning on a given query. |
| Approach: | They propose a method that uses information bottleneck theory to compress context . they propose to remove redundant tokens using metrics such as self-information or perplexity . |
| Outcome: | The proposed method achieves a 25% increase in compression rate compared to the state-of-the-art . |
DSP: Discriminative Soft Prompts for Zero-Shot Entity and Relation Extraction (2023.findings-acl)
Copied to clipboard
| Challenge: | Prompt-based methods have shown their efficacy in transferring general knowledge within pre-trained language models (PLMs) however, when applied to zero-shot entity and relation extraction, they struggle with the limited coverage of verbalizers to labels and the slow inference speed. |
| Approach: | They propose a method which reformulates zero-shot tasks into token discrimination tasks without having to construct verbalizers. |
| Outcome: | The proposed method outperforms baselines on two zero-shot entity recognition datasets with higher inference speed and achieves 7.5% improvement over previous state-of-the-art models on Wiki-ZSL and FewRel. |
Grid Tagging Scheme for Aspect-oriented Fine-grained Opinion Extraction (2020.findings-emnlp)
Copied to clipboard
| Challenge: | Aspect-oriented Fine-grained Opinion Extraction (AFOE) aims to extract aspect terms and opinion terms from review text in the form of opinion pairs or opinion triplets. |
| Approach: | They propose a grid-based AFOE tagging scheme to address the task in an end-to-end fashion only with one unified grid tracking task. |
| Outcome: | The proposed tagging scheme outperforms baselines and achieves state-of-the-art performance. |
Reinforcement Learning for Diffusion LLMs via Energy-Based Gibbs Alignment (2026.acl-long)
Copied to clipboard
| Challenge: | Diffusion Large Language Models (dLLMs) offer parallel decoding and bidirectional context modeling . aligning dLLms with reinforcement learning (RL) remains a challenge . |
| Approach: | They propose a variational framework that reformulates RL for dLLMs as a distribution matching problem. |
| Outcome: | The proposed framework reformulates RL for dLLMs as a distribution matching problem. |
Queens are Powerful too: Mitigating Gender Bias in Dialogue Generation (2020.emnlp-main)
Copied to clipboard
| Challenge: | Social biases present in data are often directly reflected in the predictions of models trained on that data. |
| Approach: | They analyze gender bias in dialogue data and propose techniques to mitigate it . they use counterfactual data augmentation, targeted data collection, and bias controlled training . |
| Outcome: | The proposed techniques mitigate gender bias by balancing genderedness of generated dialogue utterances. |
GUARD: Glocal Uncertainty-Aware Robust Decoding for Effective and Efficient Open-Ended Text Generation (2025.findings-emnlp)
Copied to clipboard
Yuanhao Ding, Esteban Garces Arias, Meimingwei Li, Julian Rodemann, Matthias Aßenmacher, Danlu Chen, Gaojuan Fan, Christian Heumann, Chongsheng Zhang
| Challenge: | GUARD is a self-adaptive decoding method that balances coherence with diversity in open-ended text generation. |
| Approach: | They propose a self-adaptive decoding method that balances coherence and diversity . they combine global entropy estimates with local entropic deviations to integrate uncertainty . |
| Outcome: | GUARD achieves a good balance between diversity and coherence while exhibiting significant improvements in generation speed. |
Non-Autoregressive Semantic Parsing for Compositional Task-Oriented Dialog (2021.naacl-main)
Copied to clipboard
| Challenge: | Semantic parsing using sequence-to-sequence models is stymied by higher compute requirements and higher latency. |
| Approach: | They propose a non-autoregressive approach to predict semantic parse trees with an efficient seq2seq model architecture. |
| Outcome: | The proposed architecture achieves an 81% reduction in latency on TOP dataset and retains competitive performance over non-pretrained models on three different semantic parsing datasets. |
Hardware-Aware Parallel Prompt Decoding for Memory-Efficient Acceleration of LLM Inference (2025.findings-emnlp)
Copied to clipboard
Hao Mark Chen, Wayne Luk, Yiu Ka Fai Cedric, Rui Li, Konstantin Mishchenko, Stylianos Venieris, Hongxiang Fan
| Challenge: | Auto-regressive decoding of Large Language Models results in significant overheads in hardware performance . a novel parallel prompt decoding approach is proposed to overcome these limitations . |
| Approach: | They propose a parallel prompt decoding that uses a single model for speculation and verification. |
| Outcome: | The proposed approach speeds up auto-regressive decoding of large language models 2.49 times . it can be used on mobileLlama to Vicuna-13B on a wide range of benchmarks . |
IUQ: Interrogative Uncertainty Quantification for Long-Form Large Language Model Generation (2026.acl-long)
Copied to clipboard
| Challenge: | Recent approaches to quantify uncertainty in LLMs produce short or constrained answer sets, but many real-world applications require long-form and free-form text generation. |
| Approach: | They propose a framework that leverages inter-sample consistency and intra-sampled faithfulness to quantify the uncertainty in long-form LLM outputs. |
| Outcome: | The proposed framework provides reliable measures of claim-level uncertainty and the model’s faithfulness over two widely used long-form generation datasets. |
NPHardEval: Dynamic Benchmark on Reasoning Ability of Large Language Models via Complexity Classes (2024.acl-long)
Copied to clipboard
| Challenge: | Complex reasoning ability is one of the most important features of Large Language Models. |
| Approach: | They propose a new benchmark that measures the reasoning ability of Large Language Models . it contains 900 algorithmic questions belonging to the NP-Hard complexity class . |
| Outcome: | The proposed benchmark contains 900 questions belonging to the NP-Hard complexity class and is updated on a monthly basis. |
Multi-Dimensional Gender Bias Classification (2020.emnlp-main)
Copied to clipboard
| Challenge: | a novel framework decomposes gender bias in text along several pragmatic and semantic dimensions . language is a primary means by which people communicate, express identities and categorize themselves . unwanted gender biases can affect downstream applications, leading to poor user experiences . |
| Approach: | They propose a framework that decomposes gender bias in text along several dimensions . they annotate eight large scale datasets with gender information and collect a benchmark . |
| Outcome: | The proposed framework decomposes gender bias in text along several pragmatic and semantic dimensions. |
Adaptive Policy with Wait-k Model for Simultaneous Translation (2023.emnlp-main)
Copied to clipboard
| Challenge: | Existing approaches to simultaneous machine translation require a robust read/write policy . a standalone multi-path wait-k model performs competitively with adaptive policies . |
| Approach: | They propose a more flexible approach by decoupling the adaptive policy model from the translation model. |
| Outcome: | The proposed approach outperforms baseline approaches in translation tasks. |
DraDDP: A Multimodal Multi-Party Dialogue Discourse Parsing Dataset (2026.findings-acl)
Copied to clipboard
| Challenge: | Existing studies on multi-party dialogue discourse parsing focus on textual modality and two-party dialog . et al., 2016) focused on text-based discourse parses, ignoring the complexity and richness of multimodal interactions in real-world scenarios. |
| Approach: | They construct the first publicly available English multimodal dataset for multi-party dialogue discourse parsing based on American TV dramas. |
| Outcome: | The proposed dataset contains 495 dialogue segments with 6,374 utterances and 9.1 hours of parallel video content, covering rich multi-party interaction scenarios. |
Disentangling Logic: The Role of Context in Large Language Model Reasoning Capabilities (2025.findings-acl)
Copied to clipboard
Wenyue Hua, Kaijie Zhu, Lingyao Li, Lizhou Fan, Mingyu Jin, Shuhang Lin, Haochen Xue, Zelong Li, Jindong Wang, Yongfeng Zhang
| Challenge: | Using large language models, large language model models can be used to evaluate reasoning abilities in context-rich scenarios. |
| Approach: | They construct datasets for both propositional logic and abductive logic reasoning with four difficulty levels across 12 distinct domains based on Wikipedia categorization and those with purely abstract variables. |
| Outcome: | The proposed model can be used to benchmark LLMs in real-world scenarios, but not in context-rich scenarios. |
SHARP: Unlocking Interactive Hallucination via Stance Transfer in Role-Playing LLMs (2025.findings-acl)
Copied to clipboard
| Challenge: | Existing studies on social interactions neglect hallucination while struggling with poor generalizability and implicit character fidelity judgments. |
| Approach: | They propose a generalizable and explicit paradigm for uncovering interactive patterns of Large Language Models across diverse worldviews by defining interactive hallucination through stance transfer and SHARP, a benchmark built by extracting relations from commonsense knowledge graphs. |
| Outcome: | The proposed paradigm is generalizable and explicit and demonstrates its effectiveness and stability. |
Hierarchical Neural Story Generation (P18-1)
Copied to clipboard
| Challenge: | a hierarchical model that generates a premise and then conditions on it creates fluent text . a novel form of model fusion improves the relevance of the story to the prompt . |
| Approach: | They use a hierarchical model that first generates a premise, then transforms it into a text . they use fusion to improve relevance of the story to the prompt and add a gated mechanism to model context . |
| Outcome: | The proposed model improves on strong baselines on automated and human evaluations. |
FB-Bench: A Fine-Grained Multi-Task Benchmark for Evaluating LLMs’ Responsiveness to Human Feedback (2025.emnlp-main)
Copied to clipboard
| Challenge: | Existing research focuses on benchmarking LLMs in single-turn dialogues, neglecting the nuanced nature of human feedback within real-world usage scenarios. |
| Approach: | They propose a fine-grained, multi-task benchmark designed to evaluate LLMs’ responsiveness to human feedback under real-world usage scenarios in Chinese. |
| Outcome: | The proposed benchmarks show that human feedback can significantly impact LLMs’ responsiveness in real-world usage scenarios. |
DocAssistant: Integrating Key-region Reading and Step-wise Reasoning for Robust Document Visual Question Answering (2025.findings-emnlp)
Copied to clipboard
| Challenge: | Existing document understanding models focus on key information and generate answers straightforwardly . existing models ignore evidence from source documents and lack interpretability . |
| Approach: | They propose a visual encoder that fuses text into visual encoded visual encodes . they use multimodal large language models as data generators and checkers to generate step-wise question-and-answer pairs for document images. |
| Outcome: | The proposed model can answer step-wise questions without compromising the performance of the original model. |
CDGP: Automatic Cloze Distractor Generation based on Pre-trained Language Model (2022.findings-emnlp)
Copied to clipboard
| Challenge: | Existing approaches to generate cloze distractors with carefully-designed distractors are limited due to wrong option selection. |
| Approach: | They propose to employ pre-trained language models as an alternative to cloze distractor generation by using pre-designed distractors. |
| Outcome: | The proposed model improves the state-of-the-art cloze test score from 14.94 to 34.17 (NDCG@10) The proposed framework improves clozing distractors by incorporating pre-trained language models. |
Beyond Token Length: Step Pruner for Efficient and Accurate Reasoning in Large Language Models (2026.findings-acl)
Copied to clipboard
| Challenge: | Existing reinforcement learning methods for large reasoning models suffer from excessive verbosity, known as "overthinking." Existing models penalize generated tokens to promote conciseness, but these methods encounter two challenges: they may develop hacking behavior in later stages of training by discarding reasoning steps. |
| Approach: | They propose a framework that steers large reasoning models toward more efficient reasoning . they prioritize correctness while imposing penalties for redundant steps . |
| Outcome: | The proposed framework reduces token usage by 69.7% on AIME24. |
Maximizing the Effectiveness of Larger BERT Models for Compression (2025.acl-long)
Copied to clipboard
| Challenge: | Existing methods for capturing large BERT models as teachers do not fully exploit the potential advantages of larger teachers. |
| Approach: | They propose a method that leverages a pretrained teacher model to guide the training of a lightweight student model to enhance knowledge transfer. |
| Outcome: | The proposed method enhances knowledge transfer by leveraging a pretrained teacher model to guide the training of a lightweight student model. |
ToolSafety: A Comprehensive Dataset for Enhancing Safety in LLM-Based Agent Tool Invocations (2025.emnlp-main)
Copied to clipboard
| Challenge: | Current models exhibit notable vulnerabilities in maintaining safety during multi-step tool interactions and in indirect harm scenarios. |
| Approach: | They propose a safety fine-tuning dataset to fine- tune LLMs into assistants . they propose to use synthesized trajectories and realistic, context-aware sample generation . |
| Outcome: | The proposed model maintains safety in multi-step and indirect harm scenarios with little impact on helpfulness. |
FOLIO: Natural Language Reasoning with First-Order Logic (2024.emnlp-main)
Copied to clipboard
Simeng Han, Hailey Schoelkopf, Yilun Zhao, Zhenting Qi, Martin Riddell, Wenfei Zhou, James Coady, David Peng, Yujie Qiao, Luke Benson, Lucy Sun, Alexander Wardle-Solano, Hannah Szabó, Ekaterina Zubova, Matthew Burtell, Jonathan Fan, Yixin Liu, Brian Wong, Malcolm Sailor, Ansong Ni, Linyong Nan, Jungo Kasai, Tao Yu, Rui Zhang, Alexander Fabbri, Wojciech Kryscinski, Semih Yavuz, Ye Liu, Xi Lin, Shafiq Joty, Yingbo Zhou, Caiming Xiong, Rex Ying, Arman Cohan, Dragomir Radev
| Challenge: | Existing benchmarks for logical reasoning in large language models lack language naturalness or limited complexity. |
| Approach: | They propose to use first-order logic annotations to evaluate logical reasoning capabilities of large language models. |
| Outcome: | The proposed dataset evaluates the FOL reasoning ability of supervised fine-tuning on medium-sized language models. |
LOT: A Story-Centric Benchmark for Evaluating Chinese Long Text Understanding and Generation (2022.tacl-1)
Copied to clipboard
| Challenge: | Existing benchmarks for natural language processing focus on understanding or generating short texts . lack of standardized benchmarks makes it difficult to assess and compare models . |
| Approach: | They propose a story-centric benchmark for Chinese long text modeling that aggregates two understanding tasks and two generation tasks. |
| Outcome: | The proposed model outperforms similar-sized models on understanding and generation tasks. |
LANID: LLM-assisted New Intent Discovery (2024.lrec-main)
Copied to clipboard
| Challenge: | Data annotation is expensive in Task-Oriented Dialogue systems. |
| Approach: | They propose a framework that leverages Large Language Models' zero-shot capability to enhance the performance of a smaller text encoder on the NID task. |
| Outcome: | The proposed framework surpasses all strong baselines in both unsupervised and semi-supervised settings. |
MDPO: Customized Direct Preference Optimization with a Metric-based Sampler for Question and Answer Generation (2025.coling-main)
Copied to clipboard
| Challenge: | Existing methods for QA data generation are limited by the dependence of existing evaluation metrics on ground truth labels. |
| Approach: | They propose a set of unsupervised evaluation metrics for QA data that enable multidimensional assessment based on the relationships among context,question and answer. |
| Outcome: | The proposed method outperforms state-of-the-art methods on public datasets and shows that it produces high-quality and domain-specific QA pairs. |
NavRAG: Generating User Demand Instructions for Embodied Navigation through Retrieval-Augmented LLM (2025.findings-acl)
Copied to clipboard
| Challenge: | High-performance vision-and-language navigation models require large amounts of training data, the high cost of manual annotating has seriously hindered this field. |
| Approach: | They propose a retrieval-augmented generation framework that generates user demand instructions for vision-and-language navigation. |
| Outcome: | The proposed model achieves SOTA performance on the REVERIE benchmark. |
DynamicFocalPO: Adaptive Focusing Strategy for Preference Optimization (2026.findings-acl)
Copied to clipboard
| Challenge: | Recent preference optimization algorithms such as Direct Preference Optimization (DPO) have become prevalent for aligning large language models with human preferences. |
| Approach: | They propose a preference optimization algorithm that introduces a modulating factor that down-weighs misranked preference pairs and employs focusing strategy that adapts over the course of training. |
| Outcome: | Experiments show that DynamicFocalPO surpasses both DPO and FocalPO on benchmarks including Alpaca Eval 2.0 and Arena-Hard using Mistral-Base-7B and Llama-3-Instruct-8B. |
Improving Faithfulness in Abstractive Summarization with Contrast Candidate Generation and Selection (2021.naacl-main)
Copied to clipboard
| Challenge: | Recent studies have shown that current models are prone to generating unfaithful summaries . a proposed method is effective in identifying and correcting extrinsic hallucinations . |
| Approach: | They propose a model-agnostic post-processing technique to correct unfaithful summaries . they generate alternative candidates where names and quantities are replaced with compatible ones . |
| Outcome: | The proposed method corrects extrinsic hallucinations in unfaithful summaries. |
LoRAMoE: Alleviating World Knowledge Forgetting in Large Language Models via MoE-Style Plugin (2024.acl-long)
Copied to clipboard
Shihan Dou, Enyu Zhou, Yan Liu, Songyang Gao, Wei Shen, Limao Xiong, Yuhao Zhou, Xiao Wang, Zhiheng Xi, Xiaoran Fan, Shiliang Pu, Jiang Zhu, Rui Zheng, Tao Gui, Qi Zhang, Xuanjing Huang
| Challenge: | Experimental results show that, as the instruction data increases, LoRAMoE can significantly improve the ability to process downstream tasks, while maintaining the world knowledge stored in the LLM. |
| Approach: | They propose a framework that introduces several low-rank adapters and integrates them by using a router network to freeze the backbone model and force a portion of LoRAs to focus on leveraging world knowledge to solve downstream tasks. |
| Outcome: | The proposed framework freezes the backbone model and forces a portion of LoRAs to focus on leveraging world knowledge to solve downstream tasks, to alleviate world knowledge forgetting. |
Do Explanations Help Users Detect Errors in Open-Domain QA? An Evaluation of Spoken vs. Visual Explanations (2021.findings-acl)
Copied to clipboard
| Challenge: | despite interest in explainable AI, there is increasing skepticism as to whether explanations are useful to end-users in downstream applications. |
| Approach: | They conduct user studies to measure whether explanations help users decide when to accept or reject an ODQA system's answer. |
| Outcome: | The proposed study shows that explanations outperform baselines across modalities but the best strategy varies with the modality. |
Schoenfeld’s Anatomy of Mathematical Reasoning by Language Models (2026.acl-long)
Copied to clipboard
| Challenge: | Large language models expose reasoning traces, yet their underlying cognitive structure and steps remain difficult to identify and analyze beyond surface-level statistics. |
| Approach: | They propose a framework that explicitly abstracts reasoning traces into functional reasoning steps such as Analysis, Explore, Implement, Verify, etc. |
| Outcome: | The proposed framework reveals reproducible thinking dynamics and structural differences between reasoning and non-reasoning models, which are not apparent from token-level views. |
The Retrieval Bottleneck: Scaling Laws for Reinforcement Learning in RAG (2026.acl-long)
Copied to clipboard
| Challenge: | Retrieval-augmented generation (RAG) has become the dominant paradigm for building knowledge-intensive language systems. |
| Approach: | They propose a sigmoidal scaling law that shows that retrieval quality determines the asymptotic performance ceiling. |
| Outcome: | The proposed model achieves strong performance on knowledge-intensive benchmarks while retaining the predictable scaling long available for pre-training but previously absent in RAG-RL. |
Unified Contextual Query Rewriting (2023.acl-industry)
Copied to clipboard
Yingxue Zhou, Jie Hao, Mukund Rungta, Yang Liu, Eunah Cho, Xing Fan, Yanbin Lu, Vishal Vasudevan, Kellen Gillespie, Zeynab Raeesy
| Challenge: | Large-scale conversational AI agents such as Alexa, Siri, and Google Assistant are becoming increasingly popular in real-world applications to assist users in daily life. |
| Approach: | They propose a unified contextual query rewriting model that unifies QR for friction reduction and contextual carryover . they leverage the text-to-text unified framework which uses independent tasks with weighted loss to account for task importance . |
| Outcome: | The proposed model reduces friction and contextual carryover by using multiple auxiliary tasks. |
HermEs: Interactive Spreadsheet Formula Prediction via Hierarchical Formulet Expansion (2023.acl-long)
Copied to clipboard
Wanrong He, Haoyu Dong, Yihuai Gao, Zhichao Fan, Xingzhuo Guo, Zhitao Hou, Xiao Lv, Ran Jia, Shi Han, Dongmei Zhang
| Challenge: | HermEs is a spreadsheet formula prediction language that is difficult for Excel users without programming experience to master. |
| Approach: | They propose a hierarchical approach to formula prediction via HiEraRchical forMulet ExpanSion . they propose generating formulas in a fixed order using hierarchically generated formulas . |
| Outcome: | The proposed approach improves formula prediction accuracy by guaranteeing correct grammar and streamlining token-level decoding with high-level Formulet. |
Harmful Factuality: LLMs Correcting What They Shouldn’t (2026.findings-eacl)
Copied to clipboard
| Challenge: | Large Language Models (LLMs) are trained for factual accuracy, but can conflict with the critical demand for source fidelity. |
| Approach: | They propose a reproducible framework to elicit and measure HFH using controlled entity-level perturbations and strategic entity selection. |
| Outcome: | The proposed framework reduces HFH rates by 50% across summarization, rephrasing, and QA tasks. |
SEK: Self-Explained Keywords Empower Large Language Models for Code Generation (2025.findings-acl)
Copied to clipboard
| Challenge: | Large language models (LLMs) have achieved impressive performance in code generation. |
| Approach: | They propose a technique that extracts and explicates the key terms in the problem description with the LLM itself. |
| Outcome: | The proposed technique improves the Pass@1 of DeepSeek-Coder-V2-Instruct from 85.4% to 93.3% on the humaneval benchmark. |
Reasoning over Public and Private Data in Retrieval-Based Systems (2023.tacl-1)
Copied to clipboard
| Challenge: | Existing retrieval systems assume relevant corpora are fully (e.g., publicly) accessible, but users are often unwilling to expose their private data to entities hosting public data. |
| Approach: | They propose a split iterative retrieval problem involving iterating retrieval over multiple privacy scopes and propose 'concurrentQA' benchmark to test this problem. |
| Outcome: | The proposed method improves on the existing retrieval methods but still suffers performance degradations when applied to a dataset from a public and private distribution. |
WW-CSL: A New Dataset for Word-Based Wearable Chinese Sign Language Detection (2024.lrec-main)
Copied to clipboard
| Challenge: | Sign language is an effective non-verbal communication mode for the hearingimpaired people. |
| Approach: | They propose a three-form scheme to represent dynamic CSL gestures using a word-based dataset. |
| Outcome: | The proposed framework integrates the local sequential sensor data derived from the wearable-based CSL gestures with the global, fine-grained skeleton representations captured from video-based gestures simultaneously. |
Q-TOD: A Query-driven Task-oriented Dialogue System (2022.emnlp-main)
Copied to clipboard
| Challenge: | Existing pipelined task-oriented dialogue systems have difficulties adapting to unseen domains . end-to-end systems are plagued by large-scale knowledge bases in practice . |
| Approach: | They propose a query-driven task-oriented dialogue system that extracts dialogue context information into a natural language query. |
| Outcome: | The proposed system outperforms strong baselines and establishes a new state-of-the-art performance on three publicly available task-oriented dialogue datasets. |
PPC-GPT: Federated Task-Specific Compression of Large Language Models via Pruning and Chain-of-Thought Distillation (2025.emnlp-main)
Copied to clipboard
| Challenge: | Large Language Models (LLMs) are becoming more popular and are gaining widespread use in artificial intelligence. |
| Approach: | They propose a unified framework that addresses both privacy preservation and model compression in federated settings. |
| Outcome: | The proposed framework maintains competitive performance comparable to full-sized LLMs while ensuring robust privacy protection through its federated architecture. |
Incorporating Syntax and Semantics in Coreference Resolution with Heterogeneous Graph Attention Network (2021.naacl-main)
Copied to clipboard
| Challenge: | Existing neural coreference resolution models lack syntactic and semantic information . however, such information has been shown to benefit other tasks. |
| Approach: | They propose a graph-based model that incorporates syntactic and semantic structures of sentences. |
| Outcome: | The proposed model incorporates syntactic and semantic structures of sentences. |
Magnet: Multi-turn Tool-use Data Synthesis and Distillation via Graph Translation (2025.acl-long)
Copied to clipboard
Fan Yin, Zifeng Wang, I-Hung Hsu, Jun Yan, Ke Jiang, Yanfei Chen, Jindong Gu, Long Le, Kai-Wei Chang, Chen-Yu Lee, Hamid Palangi, Tomas Pfister
| Challenge: | Large language models have been shown to be effective in multi-turn interactions . however, their performance may be limited in complex, multi-turned interactions involving users and multiple tools. |
| Approach: | They propose a framework for synthesizing high-quality training trajectories to enhance the function calling capability of large language model agents in multi-turn conversations with humans. |
| Outcome: | The proposed model outperforms the teacher model by 68.01 on BFCL-v3 and 73.30 on ToolQuery. |
Dropping Experts, Recombining Neurons: Retraining-Free Pruning for Sparse Mixture-of-Experts LLMs (2025.findings-emnlp)
Copied to clipboard
| Challenge: | Sparse Mixture-of-Experts (SMoE) architectures require loading all expert parameters . previous work focused on expert pruning and merging but focused on neuron-level structure . |
| Approach: | They propose a task-agnostic framework for expert pruning and reconstruction . it prunes redundant experts using router statistics, then decomposes them into neuron-level expert segments . |
| Outcome: | The proposed framework reduces the number of experts and memory usage, making it easier to deploy. |
TARo: Token-level Adaptive Routing for LLM Test-time Alignment (2026.findings-acl)
Copied to clipboard
Arushi Rai, Qiang Zhang, Hanqing Zeng, Yunkai Zhang, Dipesh Tamboli, Xiangjun Fan, Zhuokai Zhao, Lizhu Zhang
| Challenge: | Large language models (LLMs) exhibit strong reasoning capabilities but typically require expensive post-training to reach high performance. |
| Approach: | They propose to use token-level Adaptive Routing to steer frozen LLMs toward structured reasoning entirely at inference time. |
| Outcome: | Extensive experiments show that TARo significantly improves reasoning performance by up to +22.4% over base model and +8.4% . |
MED-COREASONER: Reducing Language Disparities in Medical Reasoning via Language-Informed Co-Reasoning (2026.acl-long)
Copied to clipboard
Fan Gao, Sherry T. Tong, Jiwoong Sohn, Jiahao Huang, Junfeng Jiang, Ding Xia, Piyalitt Ittichaiwong, Kanyakorn Veerakanjana, Hyunjae Kim, Qingyu Chen, Edison Marrese-Taylor, Kazuma Kobayashi, Akiko Aizawa, Irene Li
| Challenge: | Existing models that use English and local languages have a multilingual gap . a language-informed co-reasoning framework can be used to improve multilingual reasoning . |
| Approach: | They propose a language-informed co-reasoning framework that elicits parallel English and local-language reasoning and abstracts them into structured concepts. |
| Outcome: | Experiments show that Med-CoReasoner improves multilingual reasoning performance by 5% . the framework produces clinically sound and culturally grounded reasoning traces . |
In Plain Sight: Media Bias Through the Lens of Factual Reporting (D19-1)
Copied to clipboard
| Challenge: | lexical bias stems from content realization, or how things are said, but other forms of bias stem from content selection and organization. |
| Approach: | They use a dataset to analyze news articles annotated with 1,727 bias spans to investigate informational bias. |
| Outcome: | The proposed model shows that informational bias appears more frequently than lexical bias. |
Dependency Parsing as MRC-based Span-Span Prediction (2022.acl-long)
Copied to clipboard
| Challenge: | Existing methods for dependency parsing address the issue that edges should be constructed at the text span/subtree level rather than word level. |
| Approach: | They propose a method that constructs dependency trees by directly modeling span-span relations by modeling subtree-subtree relationships. |
| Outcome: | The proposed method constructs dependency trees by modeling span-span relations . it can retrieve missing spans in the span proposal stage, which leads to higher recall . |
LLM as Effective Streaming Processor: Bridging Streaming-Batch Mismatches with Group Position Encoding (2025.findings-acl)
Copied to clipboard
| Challenge: | Existing methods for adapting LLMs to streaming rely on expensive re-encoding or limited scalability. |
| Approach: | They propose a group position encoding paradigm built on batch architectures to enhance consistency between streaming and batch modes. |
| Outcome: | The proposed method outperforms existing methods on cross-lingual and cross-modal tasks. |
Re-ViLM: Retrieval-Augmented Visual Language Model for Zero and Few-Shot Image Captioning (2023.findings-emnlp)
Copied to clipboard
Zhuolin Yang, Wei Ping, Zihan Liu, Vijay Korthikanti, Weili Nie, De-An Huang, Linxi Fan, Zhiding Yu, Shiyi Lan, Bo Li, Mohammad Shoeybi, Ming-Yu Liu, Yuke Zhu, Bryan Catanzaro, Chaowei Xiao, Anima Anandkumar
| Challenge: | Existing methods for image-to-text generation store all knowledge within parameters, thus requiring computational-expensive fine-tuning. |
| Approach: | They propose a Retrieval-augmented Visual Language Model that stores all the knowledge within parameters and can be used to retrieve it from the external database. |
| Outcome: | The proposed model significantly boosts performance for image-to-text generation tasks with 4x less parameters compared with baseline methods. |
Enhancing Attributed Question Answering using Tailored Progressive Curriculum Learning (2025.findings-emnlp)
Copied to clipboard
| Challenge: | Attributed Question Answering models are not yet leveraged to enhance their essential capabilities, including evidence identification, cross-source relation recognition and anti-distraction reasoning. |
| Approach: | They propose a progressive progressive curriculum learning approach that optimizes both encoder-decoder and decoder-only AQA models. |
| Outcome: | The proposed approach improves both encoder-decoder and decoder-only AQA models on the quotesum benchmark. |
SDiaReward: Modeling and Benchmarking Spoken Dialogue Rewards with Modality and Colloquialness (2026.acl-long)
Copied to clipboard
Jingyu Lu, Yuhan Wang, Fan Zhuo, Xize Cheng, Changhao Pan, Xueyi Pu, Yifu Chen, Chenyuhao Wen, Tianle Liang, Zhou Zhao
| Challenge: | SDiaReward is an end-to-end spoken dialogue system that integrates paralinguistic nuances and spontaneous nature of human conversation. |
| Approach: | They propose an end-to-end multi-turn reward model trained on SDiaReward-Dataset . it is a collection of episode-level preference pairs targeting modality and colloquiality gaps . |
| Outcome: | The proposed model outperforms general-purpose audio LLMs in episode-level evaluation. |
Enhancing Retrieval-Augmented Generation via Evidence Tree Search (2025.acl-long)
Copied to clipboard
| Challenge: | Evidence retrieval is used to enhance Large Language Models (LLMs) but in real-world applications, it often returns lengthy documents with redundant or irrelevant content, confusing downstream readers. |
| Approach: | They propose a framework that reformulates evidence retrieval as a dynamic tree expansion process. |
| Outcome: | The proposed framework outperforms existing methods on five datasets. |
CrowdAgent: Multi-Agent Managed Multi-Source Annotation System (2025.emnlp-demos)
Copied to clipboard
Maosheng Qin, Renyu Zhu, Mingxuan Xia, null Chenchenkai, Zhen Zhu, Minmin Lin, Junbo Zhao, Lu Xu, Changjie Fan, Runze Wu, Haobo Wang
| Challenge: | Recent approaches to annotate data focus on labeling, but lack holistic process control . a novel system that integrates task assignment, data annotation, and quality/cost management is needed . |
| Approach: | They propose a multi-agent system that integrates task assignment, data annotation, and quality/cost management. |
| Outcome: | The proposed system automates human management by using a collaborative multi-agent system. |
A Closer Look at Few-Shot Out-of-Distribution Intent Detection (2022.coling-1)
Copied to clipboard
| Challenge: | Existing methods for few-shot out-of-distribution (OOD) intent detection are not adequate . despite its importance, few- shot OOD intent detection is a challenging problem . |
| Approach: | They propose a latent representation generation and self-supervision approach to solve few-shot OOD intent detection problem. |
| Outcome: | The proposed approach is highly effective and could improve state-of-the-art methods for few-shot OOD intent detection. |
1+1>2: Can Large Language Models Serve as Cross-Lingual Knowledge Aggregators? (2024.emnlp-main)
Copied to clipboard
| Challenge: | Large Language Models (LLMs) have been recognized for their impressive capabilities in natural language processing (NLP). |
| Approach: | They propose a method to enhance the multilingual performance of Large Language Models by aggregating knowledge from diverse languages. |
| Outcome: | The proposed method reduces the performance disparity across languages and offers valuable insights for further exploration. |
On the Robustness of Language Encoders against Grammatical Errors (2020.acl-main)
Copied to clipboard
| Challenge: | Pre-trained language encoders are effective in facilitating downstream natural language processing tasks, but they often assume training and test corpora are clean and it is unclear how the models behave when confronted with noisy input. |
| Approach: | They conduct adversarial attacks to simulate grammatical errors on clean text data. |
| Outcome: | The proposed model performs better when confronted with natural grammatical errors than when faced with noisy input. |
Luring as a Proxy: Evaluating Corpus Transferability for Cybergrooming Detection (2026.acl-short)
Copied to clipboard
| Challenge: | Prior research has noted that cybergrooming often involves the use of luring communication strategies to manipulate minors. |
| Approach: | They examine the potential transferability of corpora from luring contexts for cybergrooming detection. |
| Outcome: | The proposed model can be generalized across domains and performs better on corpora with salient toxicity and distinctive stylistic features. |
LLMs are Better Than You Think: Label-Guided In-Context Learning for Named Entity Recognition (2025.emnlp-main)
Copied to clipboard
| Challenge: | Named Entity Recognition (NER) tasks are performed using only a few demonstrations. |
| Approach: | They propose a method that leverages training labels through token-level statistics to improve ICL performance. |
| Outcome: | The proposed method outperforms existing methods on five NER datasets and is robust in low-resource settings. |
AgentCourt: Simulating Court with Adversarial Evolvable Lawyer Agents (2025.findings-acl)
Copied to clipboard
Guhong Chen, Liyang Fan, Zihan Gong, Nan Xie, Zixuan Li, Ziqiang Liu, Chengming Li, Qiang Qu, Hamid Alinejad-Rokny, Shiwen Ni, Min Yang
| Challenge: | Existing legal language models struggle with dynamic courtroom interactions, resulting in overfitting to standardized legal tasks. |
| Approach: | They propose a new adversarial evolutionary approach for agents that performs dynamic knowledge learning and evolution through structured adversarials in a simulated courtroom program. |
| Outcome: | The proposed approach outperforms existing LLM-based models in three critical dimensions: cognitive agility, professional knowledge, and logical rigor. |
HELPD: Mitigating Hallucination of LVLMs by Hierarchical Feedback Learning with Vision-enhanced Penalty Decoding (2024.emnlp-main)
Copied to clipboard
| Challenge: | Existing work detects hallucination by directly judging whether an object exists in an image, overlooking the association between the object and semantics. |
| Approach: | They propose a framework that incorporates hallucination feedback at both object and sentence semantic levels to alleviate over 15% of hallucinism. |
| Outcome: | The proposed framework can alleviate over 15% of hallucination even with a marginal degree of training. |
Cross-layer Attention Sharing for Pre-trained Large Language Models (2026.tacl-1)
Copied to clipboard
Yongyu Mu, Yuzhang Wu, Yuchun Fan, Chenglong Wang, Hengyu Li, Jiali Zeng, Qiaozhi He, Murun Yang, Fandong Meng, Jie Zhou, Tong Xiao, Jingbo Zhu
| Challenge: | Existing studies focus on compressing the Key-Value cache or grouping attention heads, while overlooking redundancy between layers. |
| Approach: | They propose a lightweight substitute for self-attention in well-trained LLMs that uses feed-forward networks to align attention heads between adjacent layers and low-rank matrices to approximate differences in layer-wise attention weights. |
| Outcome: | The proposed model reduces redundancy by sharing weights across layers while maintaining high response quality while reducing redundant calculations within 53% 84% of the total layers. |
Youling: an AI-assisted Lyrics Creation System (2020.emnlp-demos)
Copied to clipboard
Rongsheng Zhang, Xiaoxi Mao, Le Li, Lin Jiang, Lin Chen, Zhiwei Hu, Yadong Xi, Changjie Fan, Minlie Huang
| Challenge: | Recent studies have focused on a single pass of lyrics generation with little human intervention. |
| Approach: | They propose an AI-assisted lyrics creation system that supports one pass full-text generation and interactive generation modes. |
| Outcome: | The proposed system supports full-text generation and interactive generation modes . it also provides a revision module which enables users to revise undesired lyrics repeatedly. |
Evaluating Generative Language Models in Information Extraction as Subjective Question Correction (2024.lrec-main)
Copied to clipboard
| Challenge: | Modern large language models (LLMs) perform poorly in elementary tasks like relation extraction and event extraction due to two issues in conventional evaluation methods. |
| Approach: | They propose a method to evaluate large language models by incorporating a human annotation schema. |
| Outcome: | The proposed evaluation method improves matching between model outputs and golden labels. |
Controlling Risk of Retrieval-augmented Generation: A Counterfactual Prompting Framework (2024.findings-emnlp)
Copied to clipboard
| Challenge: | Existing studies on retrieval-augmented generation (RAG) rarely address the issue of predictive uncertainty, i.e., how likely it is that a RAG model’s prediction is incorrect. |
| Approach: | They propose a framework that induces RAG models to alter latent factors and analyzes the effect on their answers. |
| Outcome: | The proposed framework identifies two critical factors affecting RAG models' confidence in their answers and analyzes the effect on their answers. |
Governance in Motion: Co-evolution of Constitutions and AI models for Scalable Safety (2025.emnlp-main)
Copied to clipboard
Chenhao Huang, Ziyu Shen, Yicong Ren, Huiyuan Zheng, Jiazheng Zhang, Mingxu Chai, Ming Zhang, Shihan Dou, Fan Mo, Jie Shi, Tao Gui, Qi Zhang, Xuanjing Huang
| Challenge: | Existing approaches to align large language models with human preferences lack flexibility . static alignment preferences lack the ability to correct misaligned behaviors as they emerge . |
| Approach: | They propose a framework that enables dynamic and continuous alignment of large language models with human preferences. |
| Outcome: | The proposed framework improves safety and accuracy of a 7B model with human annotations. |
Interpreting Twitter User Geolocation (2020.acl-main)
Copied to clipboard
| Challenge: | Existing methods for identifying user geolocation suffer from a lack of interpretability on the corresponding results. |
| Approach: | They adopt influence functions to interpret the behavior of GNN-based models by identifying the importance of training users when predicting locations. |
| Outcome: | The proposed method provides meaningful explanations on prediction results and also uncovers the so-called "black-box" GNN-based models by investigating the effect of individual nodes. |
MMBoundary: Advancing MLLM Knowledge Boundary Awareness through Reasoning Step Confidence Calibration (2025.acl-long)
Copied to clipboard
| Challenge: | Existing methods calibrate model confidence on entire response, which leads to incorrect answers with high confidence. |
| Approach: | They propose a framework that advances the knowledge boundary awareness of multimodal large language models through reasoning step confidence calibration. |
| Outcome: | Empirical results show that the proposed framework outperforms existing methods across domains and metrics. |
You Don’t Know My Favorite Color: Preventing Dialogue Representations from Revealing Speakers’ Private Personas (2022.naacl-main)
Copied to clipboard
| Challenge: | Social chatbots evolve rapidly with large pretrained language models. |
| Approach: | They propose effective defense objectives to protect persona leakage from hidden states by a simple neural network. |
| Outcome: | The proposed defense objectives reduce the attack accuracy from 37.6% to 0.5% while preserving language models’ powerful generation ability. |
wav2vec-S: Adapting Pre-trained Speech Models for Streaming (2024.findings-acl)
Copied to clipboard
| Challenge: | Pre-trained speech models have advanced speech-related tasks, including speech recognition and translation. |
| Approach: | They propose a pre-trained speech model that incorporates modifications to ensure consistent speech representations during training and inference phases for streaming speech inputs. |
| Outcome: | The proposed model outperforms baseline models on speech recognition and translation tasks and achieves a superior balance between quality and latency. |
MedOdyssey: A Medical Domain Benchmark for Long Context Evaluation Up to 200K Tokens (2025.findings-naacl)
Copied to clipboard
| Challenge: | Existing benchmarks in the generic domain have evaluated long-context capabilities for LLMs. |
| Approach: | They propose a medical long-context benchmark with seven length levels ranging from 4K to 200K tokens. |
| Outcome: | The proposed benchmarks have seven length levels ranging from 4K to 200K tokens. |
PreP-OCR: A Complete Pipeline for Document Image Restoration and Enhanced OCR Accuracy (2025.acl-long)
Copied to clipboard
| Challenge: | Existing pipelines that combine document image restoration with semantic-aware post-OCR correction can improve text extraction from degraded images. |
| Approach: | They propose a two-stage pipeline that combines document image restoration with semantic-aware post-OCR correction to enhance both visual clarity and textual consistency. |
| Outcome: | The proposed pipeline reduces character error rates by 63.9-70.3% on 13,831 pages of real historical documents in English, French, and Spanish compared to OCR on raw images. |
DEMO: A Statistical Perspective for Efficient Image-Text Matching (2024.naacl-long)
Copied to clipboard
| Challenge: | Image-text matching is a problem that seeks to connect vision and language through semantic understanding. |
| Approach: | They propose a deep unsupervised hashing-based approach for image-text matching . they characterize each image using multiple augmented views, which are considered as samples . |
| Outcome: | The proposed approach achieves superior performance on image-text matching datasets compared with state-of-the-art methods. |
If an LLM Were a Character, Would It Know Its Own Story? Evaluating Lifelong Learning in LLMs (2026.acl-long)
Copied to clipboard
Siqi Fan, Xiusheng Huang, Yiqun Yao, Xuezhi Fang, Kang Liu, Peng Han, Shuo Shang, Aixin Sun, Yequan Wang
| Challenge: | Existing benchmarks for large language models (LLMs) fail to capture these dynamics, focusing on static, open-ended evaluations. |
| Approach: | They propose a benchmark to assess lifelong learning in large language models . they use two episodic datasets rich in narrative structure and character interactions . |
| Outcome: | Experiments on LLMs show that non-parametric methods outperform parametric ones in managing stateful learning. |
Transformer Working Memory Enables Regular Language Reasoning And Natural Language Length Extrapolation (2023.findings-emnlp)
Copied to clipboard
| Challenge: | Existing models of working memory are limited by self-attention, but we propose a new variant of regular programming that can model regular languages. |
| Approach: | They propose a Transformer variant that constructs working memory along the depth dimension . they find it rediscovers the local windowed attention effect needed for length extrapolation . |
| Outcome: | The proposed model rediscovers the local windowed attention effect needed for length extrapolation. |
RARR: Researching and Revising What Language Models Say, Using Language Models (2023.acl-long)
Copied to clipboard
Luyu Gao, Zhuyun Dai, Panupong Pasupat, Anthony Chen, Arun Tejasvi Chaganty, Yicheng Fan, Vincent Zhao, Ni Lao, Hongrae Lee, Da-Cheng Juan, Kelvin Guu
| Challenge: | Language models (LMs) excel at many tasks but often produce unsupported or misleading content. |
| Approach: | They propose a system that finds attribution for any text generation model and post-edits it to fix unsupported content. |
| Outcome: | The proposed system improves attribution while preserving the original output. |
C2KD: Cross-layer and Cross-head Knowledge Distillation for Small Language Model-based Recommendation (2025.findings-acl)
Copied to clipboard
| Challenge: | Large Language Models (LLMs) show promise but their size and high inference costs limit deployment on resource-constrained devices. |
| Approach: | They propose a framework to transfer task-relevant knowledge from two complementary dimensions to Large Language Models (LLMs) Large Language models (LLMS) have demonstrated great potential in sequential recommendation tasks . |
| Outcome: | Extensive experiments across diverse model families show that the proposed framework achieves competitive performance compared to LLMs. |
On the Role of Entity and Event Level Conceptualization in Generalizable Reasoning: A Survey of Tasks, Methods, Applications, and Future Directions (2025.findings-emnlp)
Copied to clipboard
Weiqi Wang, Tianqing Fang, Haochen Shi, Baixuan Xu, Wenxuan Ding, Liyu Zhang, Wei Fan, Jiaxin Bai, Haoran Li, Xin Liu, Yangqiu Song
| Challenge: | Conceptualization is a fundamental element of human cognition and plays a pivotal role in generalizable reasoning. |
| Approach: | They propose to categorize different types of conceptualizations into four levels based on the types of instances being conceptualized. |
| Outcome: | The proposed categorization of different types of conceptualizations into four levels based on the types of instances being conceptualized . |
AutoAgent: A Fully-Automated and Zero-Code Framework for LLM Agents (2026.findings-acl)
Copied to clipboard
| Challenge: | Large Language Model (LLM) agents have demonstrated remarkable capabilities in task automation and intelligent decision-making. |
| Approach: | They propose a Fully-Automated and highly Self-Developing framework that enables users to create and deploy LLM agents using natural language alone. |
| Outcome: | AutoAgent is a fully-automated and highly self-developing framework that enables users to create and deploy LLM agents using natural language alone. |
HiSVD: Principled Low-Rank Approximation of LLMs via Hierarchical Modeling of Information Capacity and Spectral Structure (2026.acl-long)
Copied to clipboard
| Challenge: | Existing methods for generating layer importance ignore the fine-grained influence of spectral distribution shape. |
| Approach: | They propose a hierarchical rank allocation framework with two stages to address this gap . they propose SVD-based lowrank approximation that exploits spectral heterogeneity . |
| Outcome: | Experiments show that HiSVD outperforms state-of-the-art methods on LLMs . |
MAPS: Motivation-Aware Personalized Search via LLM-Driven Consultation Alignment (2025.acl-long)
Copied to clipboard
| Challenge: | Existing personalized product search methods assume that users’ query fully captures their real motivation, but in practice, user's queries do not always articulate the requirements. |
| Approach: | They propose a Motivation-Aware Personalized Search method that embeds queries and consultations into a unified semantic space via LLMs and utilizes a Mixture of Attention Experts (MoAE) to prioritize critical semantics. |
| Outcome: | Extensive experiments on real and synthetic data show that the proposed method outperforms existing methods in retrieval and ranking tasks. |
UniLG: A Unified Structure-aware Framework for Lyrics Generation (2023.acl-long)
Copied to clipboard
| Challenge: | Existing works ignore musical attributes hidden behind lyrics and structure of lyrics . existing works ignore structure of generated lyrics and do not consider structure of songs . |
| Approach: | They propose a framework for conditional lyrics generation that considers structure and relationship between lyrics and music. |
| Outcome: | The proposed framework improves the structure modeling and unifies different conditions for different types of lyrics generation. |
MIND: A Multi-agent Framework for Zero-shot Harmful Meme Detection (2025.acl-long)
Copied to clipboard
| Challenge: | a rapid expansion of memes on social media highlights the need for effective methods to detect harmful content. |
| Approach: | They propose a multi-agent framework for zero-shot harmful meme detection that does not rely on annotated data. |
| Outcome: | The proposed framework outperforms existing zero-shot approaches on three meme datasets. |
Towards Human-aligned Evaluation for Linear Programming Word Problems (2024.lrec-main)
Copied to clipboard
Linzi Xing, Xinglu Wang, Yuxi Feng, Zhenan Fan, Jing Xiong, Zhijiang Guo, Xiaojin Fu, Rindra Ramamonjison, Mahdi Mostajabdaveh, Xiongwei Han, Zirui Zhou, Yong Zhang
| Challenge: | Existing evaluation methodologies for MWPs diverge from human judgment and face challenges in recognizing mathematically equivalent answers. |
| Approach: | They propose an evaluation metric rooted in graph edit distance that features benefits such as permutation invariance and more accurate program equivalence identification. |
| Outcome: | The proposed evaluation metric features benefits such as permutation invariance and more accurate program equivalence identification. |
DisComp: A Two-Stage Prompt Optimization Framework Combining Task-Agnostic and Task-Aware Compression (2025.findings-naacl)
Copied to clipboard
| Challenge: | Extended prompts can lead to substantial computational overhead and increased hardware demands, limiting the scalability and efficiency of large language models. |
| Approach: | They propose a two-stage prompt compression framework that combines task-agnostic and task-based strategies to efficiently compress prompt length without compromising performance. |
| Outcome: | The proposed framework outperforms task-agnostic and task-specific compression methods on three benchmark datasets and is up to 6.56 faster at inference compared to the best token-level compression method. |
Dynamic Energy-Based Contrastive Learning with Multi-Stage Knowledge Verification for Event Causality Identification (2025.emnlp-main)
Copied to clipboard
| Challenge: | Existing methods for event causal identification rely on rule-based or random sampling strategies, which introduce spurious causal positives. |
| Approach: | They propose an ECI method enhanced by Dynamic Energy-based Contrastive Learning with multi-stage knowledge verification which generates high-quality contrastive samples and effectively suppresses spurious causal disturbances. |
| Outcome: | The proposed method outperforms state-of-the-art methods on two benchmarks. |
Vulnerability of LLMs’ Stated Belief? LLMs Belief Resistance Check Through Strategic Persuasive Conversation Interventions (2026.findings-acl)
Copied to clipboard
| Challenge: | Large Language Models (LLMs) are increasingly employed in question-answering tasks. |
| Approach: | They analyze how different persuasive strategies influence stated belief stability . they also examine whether verbalized confidence prompting increases vulnerability . |
| Outcome: | The proposed model exhibits extreme compliance, with 82.5% of belief changes occurring at the first persuasive turn. |
PreCo: A Large-scale Dataset in Preschool Vocabulary for Coreference Resolution (D18-1)
Copied to clipboard
| Challenge: | Existing methods for coreference resolution are based on word2vec-like representations of entities. |
| Approach: | They propose a large-scale English dataset for coreference resolution . they use 38K documents and 12.5M words from English-speaking preschoolers . |
| Outcome: | The proposed dataset is more efficient with higher training-test overlap than OntoNotes . the study also shows that mention detection and clustering are more efficient on PreCo . |
LLMs Can Achieve High-quality Simultaneous Machine Translation as Efficiently as Offline (2025.findings-acl)
Copied to clipboard
| Challenge: | Large language models perform well in offline machine translation when the complete source sentence is provided . however, in many real scenarios, the source tokens arrive in a streaming manner and simultaneous machine translation is required . |
| Approach: | They propose a new paradigm that includes constructing supervised fine-tuning data for simultaneous machine translation (SiMT) to achieve SiMT, source and target tokens are rearranged into interleaved sequences, separated by special tokens according to varying latency requirements. |
| Outcome: | The proposed approach achieves state-of-the-art performance across various SiMT benchmarks and evaluation metrics while maintaining efficient auto-regressive decoding. |
Can We Edit Factual Knowledge by In-Context Learning? (2023.emnlp-main)
Copied to clipboard
| Challenge: | In-context knowledge editing (IKE) is a new paradigm for NLP research that can be applied to large language models with tens or hundreds of parameters. |
| Approach: | They propose to use in-context knowledge editing (IKE) without gradient updating to edit factual knowledge without a gradient update. |
| Outcome: | The proposed method achieves a competitive success rate compared to gradient-based methods on GPT-J but with fewer side effects. |
SGPVT: Self-Generated Proximal Visual Tokens for Mitigating Proximal Collateral Damage in MLLM Unlearning (2026.acl-long)
Copied to clipboard
| Challenge: | Existing approaches focus on general utility metrics, overlooking the preservation of semantically related concepts. |
| Approach: | They propose a method that introduces self-generated proximal visual tokens to prevent forgetting vulnerability. |
| Outcome: | The proposed framework outperforms existing methods in preserving semantically related concepts while achieving effective target unlearning. |
Muffin or Chihuahua? Challenging Multimodal Large Language Models with Multipanel VQA (2024.acl-long)
Copied to clipboard
Yue Fan, Jing Gu, Kaiwen Zhou, Qianqi Yan, Shan Jiang, Ching-Chen Kuo, Yang Zhao, Xinze Guan, Xin Wang
| Challenge: | Multipanel images are a common form of visual representations, and humans can achieve approximately 99% accuracy on these questions. |
| Approach: | They propose a benchmark that tests multipanel visual reasoning models with 6,600 triplets of questions, answers, and multipanel images. |
| Outcome: | The proposed benchmark features 6,600 triplets of questions, answers, and multipanel images that challenge state-of-the-art Multimodal Large Language Models (MLLMs) human users can attain approximately 99% accuracy on these questions, compared with previous benchmarks. |
MinerU2.5: A Decoupled Vision-Language Model for Efficient High-Resolution Document Parsing (2026.acl-industry)
Copied to clipboard
Junbo Niu, Zheng Liu, Zhuangcheng Gu, Bin Wang, Linke Ouyang, Zhiyuan Zhao, Tao Chu, Tianyao He, Fan Wu, Qintong Zhang, Zhenjiang Jin, Guang Liang, Rui Zhang, Wenzheng Zhang, Yuan Qu, Zhifei Ren, Yuefeng Sun, Zirui Tang, Boyu Niu, Yuanhong Zheng, Dongsheng Ma, Ziyang Miao, Hejun Dong, Siyi Qian, Junyuan Zhang, Fangdong Wang, Jingzhou Chen, Xiaomeng Zhao, Liqun Wei, Wei Li, Shasha Wang, RuiLiang Xu, Yuanyuan Cao, Lu Chen, Qianqian Wu, Huaiyu Gu, Lindong Lu, Dechen Lin, null Shenguanlin, Xuanhe Zhou, Linfeng Zhang, Yuhang Zang, Xiaoyi Dong, Jiaqi Wang, Bo Zhang, Lei Bai, Pei Chu, Weijia Li, Jiang Wu, Lijun Wu, Zhenxiang Li, Guangyu Wang, Zhongying Tu, Chao Xu, Kai Chen, Bowen Zhou, Dahua Lin, Wentao Zhang, Conghui He
| Challenge: | Document images are characterized by higher resolutions, denser content, and more complex structural layouts. |
| Approach: | They propose a 1.2B-parameter document parsing vision-language model that decouples layout analysis from local content recognition. |
| Outcome: | The proposed model surpasses general-purpose and domain-specific models on multiple benchmarks while maintaining significantly lower computational overhead. |
Alternative Input Signals Ease Transfer in Multilingual Machine Translation (2022.acl-long)
Copied to clipboard
| Challenge: | Recent work in multilingual machine translation (MMT) has focused on the potential of positive transfer between languages. |
| Approach: | They propose to augment training data with alternative signals that unify different writing systems, such as phonetic, romanized, and transliterated input. |
| Outcome: | The proposed model outperforms strong ensemble baselines on Indic and Turkic languages by 1.3 BLEU points on both languages. |
On Fake News Detection with LLM Enhanced Semantics Mining (2024.emnlp-main)
Copied to clipboard
| Challenge: | Existing methods for detecting fake news use only news embeddings to capture the lexical semantics between tokens. |
| Approach: | They propose a topic-based model with prompts to extract news embeddings from LLMs and a generalized page-rank model to extract local and global semantics. |
| Outcome: | The proposed model shows superior performance on five benchmark datasets over seven baseline methods. |
Generating Biographies on Wikipedia: The Impact of Gender Bias on the Retrieval-Based Generation of Women Biographies (2022.acl-long)
Copied to clipboard
| Challenge: | Existing efforts to encourage article creation focus on reducing the gender gap in Wikipedia articles. |
| Approach: | They propose a model that retrieves web evidence and generates biographies section by section . they analyze available web evidence to determine the accuracy of the generated text . |
| Outcome: | The proposed model can generate biographies section by section, including citation information, using retrieval mechanisms and a cache-based pre-trained encoder-decoder. |
Improving Dialogue Discourse Parsing through Discourse-aware Utterance Clarification (2025.acl-long)
Copied to clipboard
| Challenge: | Extensive experiments on the STAC and Molweni datasets demonstrate that our approach effectively resolves ambiguities and significantly outperforms the state-of-the-art (SOTA) baselines. |
| Approach: | They propose a Discourse-aware Clarification Module (DCM) that generates clarifications for the parser through systematic clarification type reasoning and discourse goal reasoning. |
| Outcome: | Extensive experiments on the STAC and Molweni datasets demonstrate that the proposed module significantly outperforms the state-of-the-art (SOTA) framework. |
A BERT-based Distractor Generation Scheme with Multi-tasking and Negative Answer Training Strategies. (2020.findings-emnlp)
Copied to clipboard
| Challenge: | Existing distractor generation methods are far from practical, and there are still room for improvement. |
| Approach: | They propose a distractor generation scheme with multi-tasking and negative answer training strategies for generating multiple distractors. |
| Outcome: | The proposed scheme improves the state-of-the-art results from 28.65 to 39.81 (BLEU 1 score) and generates multiple distractors shows strong distracting power for multiple choice questions. |
Efficient Shapley Values Estimation by Amortization for Text Classification (2023.acl-long)
Copied to clipboard
| Challenge: | Shapley Values are often estimated with a small number of stochastic model evaluations, but this can only be mitigated by aggregating thousands of model evaluation. |
| Approach: | They propose to combine a model with thousands of model evaluations to estimate Shapley Values without additional model evaluation. |
| Outcome: | The proposed model estimates Shapley Values accurately with up to 60 times speedup compared to traditional methods and does not suffer from stability issues as inference is deterministic. |
LEAF: Towards Lightweight Explainable Hateful Video Detection via Self-Grounding CoT Guided Stage-Wise Distillation (2026.findings-acl)
Copied to clipboard
| Challenge: | Existing methods for detecting hateful videos rely on opaque models with no insight into their decisions. |
| Approach: | They propose a lightweight, explainable video detection framework that distills "explainability" from LMMs into efficient Smaller Multimodal Models (SMMs) they use a self-grounded chain-of-thought mechanism to generate unbiased supervision signals for videos . |
| Outcome: | The proposed framework outperforms existing methods in detection accuracy and explainability on three video benchmarks. |
RRNorm: A Novel Framework for Chinese Disease Diagnoses Normalization via LLM-Driven Terminology Component Recognition and Reconstruction (2024.findings-acl)
Copied to clipboard
| Challenge: | Clinical Terminology Normalization (CTN) aims at finding standard terms from a given termbase for mentions extracted from clinical texts. |
| Approach: | They propose a method that leverages reasoning capability of large language models to recognize components of terms and automate decomposition. |
| Outcome: | The proposed strategy achieves state-of-the-art on the experimental dataset. |
Balancing Knowledge Breadth and Task Depth for Effective Domain Adaptation Fine-Tuning (2026.findings-acl)
Copied to clipboard
| Challenge: | a lack of knowledge breadth and task depth can hinder curriculum learning in domains such as medicine and finance. |
| Approach: | They propose a two-dimensional curriculum learning framework that coordinates model training along two orthogonal axes: the knowledge dimension and the task dimension. |
| Outcome: | The proposed framework improves accuracy on medical evaluations by 2.49% and on financial evaluations 1.2% compared with the second-best method. |
The Flores-101 Evaluation Benchmark for Low-Resource and Multilingual Machine Translation (2022.tacl-1)
Copied to clipboard
Naman Goyal, Cynthia Gao, Vishrav Chaudhary, Peng-Jen Chen, Guillaume Wenzek, Da Ju, Sanjana Krishnan, Marc’Aurelio Ranzato, Francisco Guzmán, Angela Fan
| Challenge: | a lack of good evaluation benchmarks hinders progress in low-resource and multilingual machine translation . despite advances in translation quality for a handful of languages, many low-source languages are not even supported by most popular translation engines. |
| Approach: | They propose a high-quality evaluation benchmark for machine translation using 3001 sentences from Wikipedia . they aim to improve evaluation of models on long tail of low-resource languages . |
| Outcome: | The proposed evaluation benchmarks are based on 3001 sentences extracted from Wikipedia . the results show that the models can be used to evaluate multilingual systems . |
Reinforced Product Metadata Selection for Helpfulness Assessment of Customer Reviews (D19-1)
Copied to clipboard
| Challenge: | a helpful review is largely concerned with the metadata of its target product . a selector learns from both the key-value product metadata and one of its reviews to take an action . |
| Approach: | They propose a framework that uses product metadata to assess helpfulness of free-text reviews . they use two real-world datasets from amazon.com and Yelp.com to test the framework . |
| Outcome: | The proposed framework can achieve state-of-the-art performance with substantial improvements . it uses two real-world datasets from Amazon.com and Yelp.com . |
iMOVE : Instance-Motion-Aware Video Understanding (2025.findings-acl)
Copied to clipboard
Jiaze Li, Yaya Shi, Zongyang Ma, Haoran Xu, Yandong.bai Yandong.bai, Huihui Xiao, Ruiwen Kang, Fan Yang, Tingting Gao, Di Zhang
| Challenge: | Recent advances in Video Large Language Models have led to rapid development, significantly enhancing the capture of overall video semantics and achieving remarkable performance in general video understanding tasks. |
| Approach: | They propose a large-scale instance-motion-aware video instruction-tuning dataset iMOVE that utilizes Event-awful Spatiotemporal Efficient Modeling to retain informative instance spatiotemporal motion details while maintaining computational efficiency. |
| Outcome: | The proposed model excels in video temporal understanding and general video understanding. |
Can We Trust AI Doctors? A Survey of Medical Hallucination in Large Language and Large Vision-Language Models (2025.findings-acl)
Copied to clipboard
Zhihong Zhu, Yunyan Zhang, Xianwei Zhuang, Fan Zhang, Zhongwei Wan, Yuyan Chen, QingqingLong QingqingLong, Yefeng Zheng, Xian Wu
| Challenge: | Hallucination is a critical challenge for large language models and large vision-language models (LVLMs) however, dedicated research on medical hallucinations remains unexplored. |
| Approach: | They provide a unified perspective on medical hallucination for both LLMs and LVLMs, and delve into its causes. |
| Outcome: | The proposed models have demonstrated impressive performance on a variety of medical benchmarks. |
Do VLMs Have a Moral Backbone? A Study on the Fragile Morality of Vision-Language Models (2026.findings-acl)
Copied to clipboard
Zhining Liu, Tianyi Wang, Xiao Lin, Penghao Ouyang, Gaotang Li, Ze Yang, Hui Liu, Sumit Keswani, Vishwa Pardeshi, Huijun Zhao, Wei Fan, Hanghang Tong
| Challenge: | Vision-Language Models (VLMs) have advanced multimodal learning, driving progress in cross-modal reasoning. |
| Approach: | They propose to examine moral robustness of vision-language models by analyzing their moral stances under multimodal perturbations. |
| Outcome: | The proposed model-agnostic multimodal perturbations expose VLMs to a variety of moral vulnerabilities, including a sycophancy trade-off where stronger instruction-following models are more susceptible to persuasion. |
DiffLM: Controllable Synthetic Data Generation via Diffusion Language Models (2025.findings-acl)
Copied to clipboard
| Challenge: | Recent advances in large language models (LLMs) have significantly enhanced their knowledge and generative capabilities, leading to a surge of interest in leveraging LLMs for high-quality data synthesis. |
| Approach: | They propose a controllable data synthesis framework based on variational autoencoder which leverages diffusion models to reserve more information of original distribution and format structure in the learned latent distribution. |
| Outcome: | The proposed framework generates high-quality data with performance exceeding that of real data by 2%–7% on seven real-world datasets. |
Negative Sample is Negative in Its Own Way: Tailoring Negative Sentences for Image-Text Retrieval (2022.findings-naacl)
Copied to clipboard
| Challenge: | Existing approaches to retrieve hard negative sentences are limited in the scale of the dataset thus fail to identify negative samples of high difficulty for every image. |
| Approach: | They propose to use a model to generate synthetic negative sentences with higher difficulty by masking and refilling the images and performing word discrimination and word correction tasks to improve retrieval and generation. |
| Outcome: | The proposed model generates synthetic negative sentences with higher difficulty on MS-COCO and Flickr30K and is robust and faithful to state-of-the-art training. |
Travel on the ICD Tree: Benchmarking Agentic Reasoning for ICD Coding from Chinese Electronic Medical Records (2026.findings-acl)
Copied to clipboard
| Challenge: | Accurate International Classification of Diseases (ICD) coding is crucial for hospital management and healthcare data governance. |
| Approach: | They propose a framework to evaluate ICD coding based on complete EMRs . they use a dataset of 560 real clinical records covering 434 common diseases . |
| Outcome: | The proposed framework explores the capability boundaries of large language models under different paradigms. |
DeepSynth-Eval: Objectively Evaluating Information Consolidation in Deep Survey Writing (2026.findings-acl)
Copied to clipboard
Hongzhi Zhang, Yuanze Hu, Tinghai Zhang, Jia Fu, Tao Wang, Junwei Jing, Zhaoxin Fan, Wei Bi, Ruiming Tang, Han Li, Guorui Zhou, Kun Gai
| Challenge: | Large Language Models (LLMs) are evolving towards autonomous agents . retrieval capabilities are well-benchmarked, but post-retrieval synthesis is under-evaluated due to open-ended writing. |
| Approach: | They propose a benchmark to evaluate information consolidation capabilities using survey papers as gold standards. |
| Outcome: | The proposed benchmark analyzes the post-retrieval synthesis stage of large language models . it leverages high-quality survey papers as gold standards and reverse-engineers research requests . the proposed benchmark outperforms single-turn generation and reduces hallucinations . |
Enhancing Foundation Models in Transaction Understanding with LLM-based Sentence Embeddings (2025.emnlp-industry)
Copied to clipboard
| Challenge: | Existing foundation models for tabular transactional data rely on index-based representations for categorical merchant fields. |
| Approach: | They propose a framework that uses LLM-generated embeddings as semantic initializations for lightweight transaction models. |
| Outcome: | The proposed framework improves performance on large transaction datasets. |
VisiPruner: Decoding Discontinuous Cross-Modal Dynamics for Efficient Multimodal LLMs (2025.emnlp-main)
Copied to clipboard
| Challenge: | Multimodal Large Language Models (MLLMs) suffer from significant computational overhead due to the quadratic growth of attention computations with the number of multimodal tokens. |
| Approach: | They propose a training-free pruning framework that prunes multimodal tokens without a trained pruning method. |
| Outcome: | The proposed pruning framework outperforms existing token pruning methods and generalizes across diverse MLLMs. |
Listen, Decipher and Sign: Toward Unsupervised Speech-to-Sign Language Recognition (2023.findings-acl)
Copied to clipboard
Liming Wang, Junrui Ni, Heting Gao, Jialu Li, Kai Chieh Chang, Xulin Fan, Junkai Wu, Mark Hasegawa-Johnson, Chang Yoo
| Challenge: | Existing supervised sign language recognition systems rely on well-annotated data . instead, an unsupervised speech-to-sign language recognition system learns to translate between spoken and sign languages by observing only non-parallel speech and sign-language corpora. |
| Approach: | They propose an unsupervised speech-to-sign language recognition system that can translate between spoken and sign languages by observing only non-parallel speech and sign-language corpora. |
| Outcome: | The proposed approach outperforms baseline models on sign language corpora by 50% . the proposed approach is available at https://github.com/cactuswiththoughts/UnsupSpeech2Sign.git . |
RAG+: Enhancing Retrieval-Augmented Generation with Application-Aware Reasoning (2025.emnlp-main)
Copied to clipboard
Yu Wang, Shiwan Zhao, Zhihu Wang, Ming Fan, Xicheng Zhang, Yubo Zhang, Zhengfan Wang, Heyuan Huang, Ting Liu
| Challenge: | Existing RAG paradigms often overlook the cognitive step of applying knowledge, leaving a gap between retrieved facts and task-specific reasoning. |
| Approach: | They introduce a module extension that integrates application-aware reasoning into the RAG pipeline. |
| Outcome: | Experiments show that RAG+ outperforms standard RAG variants and achieves gains of 3–5% in complex scenarios. |
AgentV-RL: Scaling Reward Modeling with Agentic Verifier (2026.findings-acl)
Copied to clipboard
Jiazheng Zhang, Ziche Fu, Zhiheng Xi, Wenqing Jing, Mingxu Chai, Wei He, Guoqiang Zhang, Chenghao Fan, Chenxin An, Wenxiang Chen, Zhicheng Liu, Haojie Pan, Dingwei Zhu, Tao Gui, Qi Zhang, Xuanjing Huang
| Challenge: | Existing approaches to improve LLM reasoning are limited in complex domains and lack external grounding makes verifiers unreliable on computation-intensive tasks. |
| Approach: | They propose a framework that transforms reward modeling into a multi-turn, tool-augmented deliberative process. |
| Outcome: | The proposed framework surpasses state-of-the-art ORMs by 25.2% under parallel and sequential TTS. |
When Efficiency Becomes a Vulnerability: Computational Cost Attacks on WebAgents (2026.acl-long)
Copied to clipboard
| Challenge: | Existing WebAgents suffer from computational cost attacks due to long reasoning processes and excessive computational cost. |
| Approach: | They propose a framework that generates adversarial prompts and a reinforcement learning-enhanced selector to identify the most effective perturbations. |
| Outcome: | The proposed framework exploits large language models to generate diverse adversarial prompts and a reinforcement learning–enhanced selector to identify the most effective perturbations. |
From Paraphrasing to Semantic Parsing: Unsupervised Semantic Parsing via Synchronous Semantic Decoding (2021.acl-long)
Copied to clipboard
Shan Wu, Bo Chen, Chunlei Xin, Xianpei Han, Le Sun, Weipeng Zhang, Jiansong Chen, Fan Yang, Xunliang Cai
| Challenge: | Experimental results show that Synchronous Semantic Decoding (SSD) can achieve state-of-the-art unsupervised semantic parsing performance on multiple datasets. |
| Approach: | They propose an unsupervised method which solves the semantic gap and the structure gap by leveraging paraphrasing and grammar-constrained decoding. |
| Outcome: | The proposed method can solve the semantic gap and structure gap on multiple datasets. |
Breach in the Shield: Unveiling the Vulnerabilities of Large Language Models (2026.eacl-long)
Copied to clipboard
| Challenge: | Large Language Models and Vision Language Model (LLMs) have impressive performance across a wide range of tasks, yet remain vulnerable to external and internal perturbations. |
| Approach: | They propose a stability measure called FI, First order local Influence, which quantifies the sensitivity of individual parameters and input dimensions. |
| Outcome: | The proposed stability measure measures the sensitivity of parameters and input dimensions across LLMs and VLMs. |
Augmenting Transformers with KNN-Based Composite Memory for Dialog (2021.tacl-1)
Copied to clipboard
| Challenge: | Recent work has focused on learning architectures with large memories capable of storing external knowledge. |
| Approach: | They propose a method to augment generative Transformer neural networks with information fetching modules. |
| Outcome: | The proposed approach improves performance in generative dialog modeling . external knowledge is retrieved from Wikipedia, images, and human-written dialog utterances . |
CondenseFlow: Scalable Latent Space Collaboration via Semantic Compression for Multi-Agent Systems (2026.findings-acl)
Copied to clipboard
| Challenge: | Full-state latent communication in LLMs suffers from memory overhead scaling linearly with collaboration rounds. |
| Approach: | They propose a lightweight module that uses learnable semantic probes to compress KV caches into fixed-size representations. |
| Outcome: | The proposed module reduces KV cache memory by over 99% and inference latency by approximately 20% on seven benchmarks spanning six models . it outperforms text-based methods by 1.7 percentage points on average across all configurations while outperforming existing methods by 1.7%. |
Computer Assisted Translation with Neural Quality Estimation and Automatic Post-Editing (2020.findings-emnlp)
Copied to clipboard
| Challenge: | Using neural machine translation to approximate human parity is difficult due to the lack of parallel training corpora. |
| Approach: | They propose an end-to-end deep learning framework for quality estimation and automatic post-editing of machine translation output. |
| Outcome: | The proposed framework achieves state-of-the-art performance on the English–German dataset and human translators can significantly expedite their post-editing processing with the model. |
Sentiment-Aware Word and Sentence Level Pre-training for Sentiment Analysis (2022.emnlp-main)
Copied to clipboard
Shuai Fan, Chen Lin, Haonan Li, Zhenghao Lin, Jinsong Su, Hang Zhang, Yeyun Gong, JIan Guo, Nan Duan
| Challenge: | Existing pre-trained language representation models (PLMs) capture sentiment information from word-level while under-considering sentence-level information. |
| Approach: | They propose a Sentiment-aware pre-trained language model with combined Word-level and Sentence-level Pre-training tasks that enhance the PLM’s knowledge about sentiment words. |
| Outcome: | The proposed model achieves state-of-the-art on various sentence-level and aspect-level sentiment classification benchmarks. |
KETCHUP: K-Step Return Estimation for Sequential Knowledge Distillation (2026.findings-eacl)
Copied to clipboard
| Challenge: | Empirical evaluation shows that our approach yields superior performance in both standard task metrics and large language model (LLM)-based evaluation. |
| Approach: | They propose a K-step return estimation method for reinforcement learning (RL)-based knowledge distillation in text generation tasks using the Bellman Optimality Equation. |
| Outcome: | The proposed method performs better on standard task metrics and large language model evaluations on three text generation tasks. |
Mixture-of-Minds: Multi-Agent Reinforcement Learning for Table Understanding (2026.acl-long)
Copied to clipboard
Yuhang Zhou, Mingrui Zhang, Ke Li, Mingyi Wang, Qiao Liu, Qifei Wang, Jiayi Liu, Fei Liu, Serena Li, Weiwei LI, Mingze Gao, Abhishek Kumar, Xiangjun Fan, Zhuokai Zhao, Lizhu Zhang
| Challenge: | Large language models (LLMs) have shown promise on understanding and reasoning over tables, but current approaches remain limited. |
| Approach: | They propose a multi-agent framework that decomposes table reasoning into three specialized roles: planning, coding, and answering. |
| Outcome: | The proposed framework decomposes table reasoning into three specialized roles: planning, coding, and answering. |
BiKT: Enabling Bidirectional Knowledge Transfer Between Pretrained Models and Sequential Downstream Tasks (2024.findings-emnlp)
Copied to clipboard
| Challenge: | Existing frameworks adapt from initial pretrained model to each downstream task directly, but ignore sequential nature of downstream tasks and feedback effect on pretrained models. |
| Approach: | They propose a framework to enable bidirectional knowledge transfer between pretrained models and downstream tasks in rounds. |
| Outcome: | The proposed framework improves on 9 GLUE datasets and 6 SuperGLUEs. |
DiSCo: Device-Server Collaborative LLM-based Text Streaming Services (2025.findings-acl)
Copied to clipboard
| Challenge: | Large language models (LLMs) have introduced significant cost and quality of experience (QoE) challenges in serving millions of daily requests. |
| Approach: | They propose a device-server cooperative scheduler that optimizes users’ QoE by adaptively routing requests and migrating response generation between endpoints while maintaining cost constraints. |
| Outcome: | Evaluations on real-world workloads show that the proposed scheduler can reduce tail TTFT (11-52%) and mean TTTT (6-78%) while maintaining comparable QoE levels. |
Transition-based Directed Graph Construction for Emotion-Cause Pair Extraction (2020.acl-main)
Copied to clipboard
| Challenge: | Existing methods to extract emotions and causes from unannotated text are pipelined, causing error propagation. |
| Approach: | They propose to transform a task into a procedure of parsing-like directed graph construction . they propose to generate a directed graph with labeled edges based on a sequence of actions . |
| Outcome: | The proposed method outperforms the state-of-the-art methods by 6.71% (p0.01) in F1 measure. |
Meta-Learning Adversarial Domain Adaptation Network for Few-Shot Text Classification (2021.findings-acl)
Copied to clipboard
| Challenge: | Existing approaches for few-shot text classification rely on exploitation of lexical features and distributional signatures on training data, while neglecting to strengthen the model's ability to adapt to new tasks. |
| Approach: | They propose a meta-learning framework integrated with an adversarial domain adaptation network to improve the model's adaptive ability and generate high-quality text embedding for new classes. |
| Outcome: | The proposed framework outperforms the state-of-the-art models on four datasets and shows clear superiority over existing models. |
Automating eHMI Action Design with LLMs for Automated Vehicle Communication (2025.findings-emnlp)
Copied to clipboard
| Challenge: | Currently, eHMIs employ predefined text messages and manually designed actions to perform these messages . this limits the real-world deployment of ehMIs, where adaptability in dynamic scenarios is essential. |
| Approach: | They propose a pipeline that integrates large language models and 3D renderers to generate executable actions for controlling eHMIs and rendering action clips. |
| Outcome: | The proposed pipeline integrates large language models and 3D renderers to generate executable actions for controlling eHMIs and rendering action clips. |
On Sample Based Explanation Methods for NLP: Faithfulness, Efficiency and Semantic Evaluation (2021.acl-long)
Copied to clipboard
| Challenge: | Existing methods for explaining "black-box" models such as Influence Functions are becoming more popular. |
| Approach: | They propose a semantic-based evaluation metric that can better align with humans’ judgment of explanations than the widely adopted diagnostic or re-training measures. |
| Outcome: | The proposed method can better align with humans’ judgment of explanations than diagnostic or re-training measures. |
CoMoL: Efficient Mixture of LoRA Experts via Dynamic Core Space Merging (2026.findings-acl)
Copied to clipboard
Jie Cao, Zhenxuan Fan, Zhuonan Wang, Tianwei Lin, Ziyuan Zhao, Rolan Yan, Wenqiao Zhang, Feifei Shao, Hongwei Wang, Jun Xiao, Siliang Tang
| Challenge: | Existing PEFT methods suffer from limited parameter efficiency and coarse-grained adaptation due to proliferation of LoRA experts and instance-level routing. |
| Approach: | They propose a new MoE-LoRA framework that incorporates expert diversity, parameter efficiency, and fine-grained adaptation. |
| Outcome: | The proposed framework outperforms existing methods on multiple tasks while maintaining parameter efficiency. |
Learning to Selectively Learn for Weakly-supervised Paraphrase Generation (2021.emnlp-main)
Copied to clipboard
| Challenge: | Existing approaches to generate paraphrases with weak supervision are limited in real-world scenarios due to the lack of coherent and controllable generated paraphrase. |
| Approach: | They propose a method to generate high-quality paraphrases with weak supervision . they obtain abundant weakly-labeled parallel sentences via retrieval-based pseudo paraphrase expansion . |
| Outcome: | The proposed approach achieves significant improvements over existing methods and is even comparable in performance with supervised state-of-the-arts. |
Leveraging Prefix Transfer for Multi-Intent Text Revision (2023.acl-short)
Copied to clipboard
Ruining Chong, Cunliang Kong, Liu Wu, Zhenghao Liu, Ziye Jin, Liner Yang, Yange Fan, Hanghang Fan, Erhong Yang
| Challenge: | Text revision is a necessary process to improve text quality. |
| Approach: | They propose a multi-intent text revision system that can revise texts without explicit intent annotation. |
| Outcome: | The proposed system outperforms baselines on the IteraTeR dataset and significantly improves the SARI score with more than 3% improvement. |
Enhancing Goal-oriented Proactive Dialogue Systems via Consistency Reflection and Correction (2025.acl-long)
Copied to clipboard
| Challenge: | Unlike traditional dialogue systems, goal-oriented proactive dialogue systems focus on achieving specific objectives by actively guiding and anticipating user needs. |
| Approach: | They propose a model-agnostic two-stage Consistency Reflection and Correction framework that allows the model to reflect on discrepancies between generated responses and dialogue contexts and suggest possible corrections. |
| Outcome: | The proposed framework significantly improves the consistency between generated responses and dialogue contexts on three datasets. |
FedCoT: Federated Chain-of-Thought Distillation for Large Language Models (2025.findings-emnlp)
Copied to clipboard
| Challenge: | Large Language Models (LLMs) have emerged as a transformative force in artificial intelligence, demonstrating exceptional proficiency across various tasks. |
| Approach: | They propose a federated framework for the Chain-of-Thought distillation of knowledge from LLMs to SLMs, while adhering to privacy requirements. |
| Outcome: | The proposed framework ensures secure knowledge transfer from an LLM on a high-powered server to an SLM on resource-constrained client while adhering to privacy requirements. |
Maximum Score Routing For Mixture-of-Experts (2025.findings-acl)
Copied to clipboard
| Challenge: | Traditional mixture-of-experts (MoE) networks impose an expert capacity constraint to ensure GPU-friendly computation. |
| Approach: | They propose a routing paradigm that dynamically allocates input tokens to top-k experts through differentiable sparse transformations, enabling scalable model capacity while preserving computational efficiency. |
| Outcome: | The proposed model achieves lower training losses and higher evaluation scores at equivalent FLOPs compared to constrained and unconstrained baselines. |
ReFL: Reflective Feedback Learning for Hallucination Detection of Large Language Models (2026.acl-long)
Copied to clipboard
| Challenge: | Existing methods for detecting hallucinations depend on external knowledge sources, incurring high computational costs and limiting real-time applicability, or extract the model’s internal states, leading to poor generalization. |
| Approach: | They propose a hallucination detection framework that leverages corrective in-context learning to guide LLMs to recognize their own prediction errors and adjust internal representations, critically without updating model weights. |
| Outcome: | The proposed framework outperforms existing methods on two benchmark datasets and achieves state-of-the-art performance. |
LLM-REDIAL: A Large-Scale Dataset for Conversational Recommender Systems Created from User Behaviors with LLMs (2024.findings-acl)
Copied to clipboard
| Challenge: | Existing CRS datasets suffer from data inextensibility and semantic inconsistency . |
| Approach: | They introduce the LLM-REDIAL dataset to facilitate the research in CRS by leveraging large language models to generate high-quality dialogues. |
| Outcome: | The proposed dataset is the largest multi-domain CRS dataset which consists of 47.6k multi-turn dialogues with 482.6k utterances across 4 domains. |
Better Simultaneous Translation with Monotonic Knowledge Distillation (2023.acl-long)
Copied to clipboard
| Challenge: | Existing methods to train offline MT models require generating target tokens before source sentence is fully consumed. |
| Approach: | They propose a method that leverages traditional translation models as teachers to generate monotonic yet accurate reference translations for sequence-level knowledge distillation. |
| Outcome: | The proposed approach improves on strong baselines and on a monotonic version of the WMT15 De-En test set. |
Using Local Knowledge Graph Construction to Scale Seq2Seq Models to Multi-Document Inputs (D19-1)
Copied to clipboard
| Challenge: | Current approaches extract portions of web text as input to Sequence-to-Sequence models . a problem is generating relevant knowledge from noisy and redundant input such as webpages . |
| Approach: | They propose to restructure free text into local knowledge graphs that are linearized into sequences . they propose to encode the graph as a sequence and then linearize it into a structured sequence . |
| Outcome: | The proposed method compresses web search information and reduces redundancy . it can be used for open-domain question answering and multi-document summarization tasks . |
AmericasNLI: Evaluating Zero-shot Natural Language Understanding of Pretrained Multilingual Models in Truly Low-resource Languages (2022.acl-long)
Copied to clipboard
Abteen Ebrahimi, Manuel Mager, Arturo Oncevay, Vishrav Chaudhary, Luis Chiruzzo, Angela Fan, John Ortega, Ricardo Ramos, Annette Rios, Ivan Vladimir Meza Ruiz, Gustavo Giménez-Lugo, Elisabeth Mager, Graham Neubig, Alexis Palmer, Rolando Coto-Solano, Thang Vu, Katharina Kann
| Challenge: | Pretrained multilingual models can perform cross-lingual transfer in a zero-shot setting, even for unseen languages. |
| Approach: | They propose to extend XNLI to 10 indigenous languages of the Americas and test multiple zero-shot and translation-based approaches. |
| Outcome: | The proposed model can perform cross-lingual transfer in a zero-shot setting even for languages unseen during pretraining. |
Large Language Models Can Solve Real-World Planning Rigorously with Formal Verification Tools (2025.naacl-long)
Copied to clipboard
| Challenge: | Large Language Models (LLMs) struggle to generate correct plans for multi-constraint planning problems . a recent study showed that large language models have significant potential in solving planning problems. |
| Approach: | They propose an LLM-based planning framework that formalizes and solves multi-constraint planning problems as constrained satisfiability problems. |
| Outcome: | The proposed framework achieves a success rate of 93.9% and is effective with diverse paraphrased prompts. |
Query Structure Modeling for Inductive Logical Reasoning Over Knowledge Graphs (2023.acl-long)
Copied to clipboard
| Challenge: | Existing methods for inductive reasoning over knowledge graphs lack the ability to model the logical structures of complex queries. |
| Approach: | They propose a structure-modeled textual encoding framework for inductive logical reasoning over KGs that encodes linearized query structures and entities using pre-trained language models to find answers. |
| Outcome: | The proposed framework encodes query structures and entities using pre-trained language models to find answers. |
FinChain: A Symbolic Benchmark for Verifiable Chain-of-Thought Financial Reasoning (2026.acl-long)
Copied to clipboard
Zhuohan Xie, Daniil Orel, Rushil Thareja, Dhruv Sahnan, Hachem Madmoun, Fan Zhang, Debopriyo Banerjee, Georgi Nenkov Georgiev, Xueqing Peng, Lingfei Qian, Jimin Huang, Jinyan Su, Aaryamonvikram Singh, Rui Xing, Rania Elbadry, Chen Xu, Haonan Li, Fajri Koto, Ivan Koychev, Tanmoy Chakraborty, Yuxia Wang, Salem Lahlou, Veselin Stoyanov, Sophia Ananiadou, Preslav Nakov
| Challenge: | Existing benchmarks emphasize final numerical answers while neglecting intermediate reasoning steps. |
| Approach: | They propose a symbolic benchmark for verifiable Chain-of-Thought evaluation in finance . FINCHAIN spans 58 topics across 12 financial domains and three difficulty levels . |
| Outcome: | The proposed benchmark aims to bridge symbolic reasoning and factual verification. |
Sparsity-Accelerated Training for Large Language Models (2024.findings-acl)
Copied to clipboard
| Challenge: | Large language models (LLMs) have demonstrated proficiency across various NLP tasks but often require additional training, such as continual pre-training and supervised fine-tuning. |
| Approach: | They propose to leverage sparsity in pre-trained LLMs to accelerate training by disregarding computations for unimportant neurons. |
| Outcome: | The proposed framework achieves comparable or superior performance to standard training while significantly accelerating the process. |
Tokenizer-Aware Cross-Lingual Adaptation of Decoder-Only LLMs through Embedding Relearning and Swapping (2026.eacl-long)
Copied to clipboard
| Challenge: | Large Language Models (LLMs) have been primarily focused on English, leaving the multilingual ability unexplored. |
| Approach: | They propose a technique that creates new tokenizers and tunes embeddings on fixed model weights for target language adaptation. |
| Outcome: | The proposed method is light-weight and performant but has limitations for older models and high resource languages. |
A Distance-Aware Multi-Task Framework for Conversational Discourse Parsing (2022.coling-1)
Copied to clipboard
| Challenge: | Existing studies have focused on graph-based and transition-based discourse parsing, but no study has investigated the advantages of both paradigms for conversational discourse paring. |
| Approach: | They propose a distance-aware multi-task framework that incorporates the strengths of transition-based paradigms to facilitate conversational discourse parsing. |
| Outcome: | The proposed framework improves the graph-based paradigm on long-distance dependency links. |
WESR: A Benchmark and Strong Baseline for Word-level Event-Speech Recognition (2026.findings-acl)
Copied to clipboard
Chenchen Yang, Kexin Huang, Liwei Fan, Qian Tu, Botian Jiang, Dong Zhang, Linqi Yin, Shimin Li, Zhaoye Fei, Qinyuan Cheng, Xipeng Qiu
| Challenge: | aaron carroll: the precise localization of non-verbal vocal events remains a critical yet under-explored challenge. carroll says current methods suffer from insufficient task definitions with limited category coverage. carrol: knowing exactly where an event occurred is not enough; knowing exactly what it happened is. |
| Approach: | They propose a taxonomy of 21 vocal events with a new categorization into discrete versus continuous types. |
| Outcome: | The proposed model disentangles ASR errors from event detection while maintaining ASR quality. |
Dissecting Human and LLM Preferences (2024.acl-long)
Copied to clipboard
| Challenge: | a recent study shows that human and Large Language Model preferences are important for model fine-tuning and evaluation. |
| Approach: | They dissect the preferences of human and 32 different Large Language Models to understand their quantitative composition. |
| Outcome: | The proposed model is compared with 32 different large language models using real-world user-model conversations. |
Towards More Efficient Post-training via Fourier Domain Adapter Framework (2025.findings-emnlp)
Copied to clipboard
| Challenge: | FDA reparameterizes the core projection operation of the adapter module directly in the Fourier domain. |
| Approach: | They propose a framework that reparameterizes the core projection operation of the adapter module directly in the Fourier domain. |
| Outcome: | The proposed framework outperforms existing parameter-efficient fine-tuning methods on GLUE, E2E NLG, and instruction tuning benchmarks. |
One Refiner to Unlock Them All: Inference-Time Reasoning Elicitation via Reinforcement Query Refinement (2026.acl-long)
Copied to clipboard
| Challenge: | Existing alignment methods for Large Language Models (LLMs) are expensive and lack the flexibility to fully activate their latent reasoning capabilities. |
| Approach: | They propose a modular framework that treats reasoning elicitation as an inference-time alignment task. |
| Outcome: | The proposed framework outperforms baselines by 2.1% on average across diverse architectures and benchmarks. |
Selecting and Merging: Towards Adaptable and Scalable Named Entity Recognition with Large Language Models (2025.acl-long)
Copied to clipboard
| Challenge: | Existing approaches to align large language models with information extraction tasks are costly and not all training data benefits target domains. |
| Approach: | They propose a framework which dynamically Selects and Merges expert models at inference time and combines experts beneficial to target domains. |
| Outcome: | The proposed framework outperforms the unified model by 10% on multiple benchmarks. |
GRICE: A Grammar-based Dataset for Recovering Implicature and Conversational rEasoning (2021.findings-acl)
Copied to clipboard
| Challenge: | a grammar-based dialogue dataset, GRICE, is designed to bring implicature into pragmatic reasoning in conversations . implicature recovery is a key component of open-ended dialogue reasoning . |
| Approach: | They propose a grammar-based dialogue dataset to bring implicature into pragmatic reasoning . they use a hierarchical grammar model to generate the entire dataset . |
| Outcome: | The proposed model shows a significant performance gap between baseline methods and human models . the model shows an overall performance boost in conversational reasoning . |
Does Gender Matter? Towards Fairness in Dialogue Systems (2020.coling-main)
Copied to clipboard
| Challenge: | Recent studies have shown that AI is unfair in many real-world applications such as computer vision and recommendations. |
| Approach: | They propose to use a benchmark dataset to study the fairness of dialogue systems to understand their bias. |
| Outcome: | The proposed methods reduce the bias in dialogue systems significantly. |
ConRPG: Paraphrase Generation using Contexts as Regularizer (2021.emnlp-main)
Copied to clipboard
| Challenge: | Existing methods for paraphrase generation lack reliable supervision signals. |
| Approach: | They propose an unsupervised paradigm for paraphrase generation based on contextual language models, candidate filtering and paraphrase model training based upon the selected candidates. |
| Outcome: | The proposed paradigm outperforms existing paraphrase generation methods in supervised and unsupervised setups. |
Diagnosing Failures in Large Language Models’ Answers: Integrating Error Attribution into Evaluation Framework (2025.findings-acl)
Copied to clipboard
| Challenge: | Existing evaluation models lack error attribution capability due to their proprietary nature. |
| Approach: | They propose a misattribution framework with 6 primary and 15 secondary categories to facilitate in-depth analysis. |
| Outcome: | The proposed framework is based on a dataset specifically designed for error attribution, along with the corresponding scores and feedback. |
Logic-Driven Context Extension and Data Augmentation for Logical Reasoning of Text (2022.findings-acl)
Copied to clipboard
| Challenge: | Existing methods for logical reasoning of text focus on contextual semantics while struggling to explicitly model the logical inference process. |
| Approach: | They propose a logic-driven context extension framework and a data-driven augmentation algorithm that uses contrastive learning to better capture logical information. |
| Outcome: | The proposed framework outperforms existing methods on two benchmark datasets, ReClor and LogiQA. |
Out-of-Scope Intent Detection with Self-Supervision and Discriminative Training (2021.acl-long)
Copied to clipboard
| Challenge: | Existing methods for out-of-scope intent detection rely on strong assumptions on data distribution and confidence threshold selection. |
| Approach: | They propose a method to train an out-of-scope intent classifier in a fully end-to-end manner by simulating the test scenario in training. |
| Outcome: | The proposed method improves on four benchmark dialogue datasets and improves over state-of-the-art methods. |
Automatic Distractor Generation for Multiple Choice Questions in Standard Tests (2020.coling-main)
Copied to clipboard
| Challenge: | Existing methods to generate distractors for multiple choice questions are expensive and time-consuming. |
| Approach: | They propose a question and answer guided distractor generation framework to automate distractors generated by domain experts. |
| Outcome: | The proposed model outperforms existing models and achieves state-of-the-art on a large-scale dataset. |
Compete to Complete: Co-opetition Adversarial Learning for Retrieval-Augmented Generation (2026.acl-long)
Copied to clipboard
| Challenge: | Existing approaches to reduce hallucination in large language models lack a robust mechanism for generating a generative model. |
| Approach: | They propose a framework that formulates retriever–generator training in RAG as a minimax game. |
| Outcome: | The proposed framework improves retrieval-augmented generation performance on seven benchmark datasets. |
DecBERT: Enhancing the Language Understanding of BERT with Causal Attention Masks (2022.findings-naacl)
Copied to clipboard
| Challenge: | Experimental results show that Transformer Encoder model can't automatically capture word order, so explicit position embeddings are required to be fed into the target model. |
| Approach: | They propose a Transformer-based language model DecBERT that uses a causal attention mask to capture word order. |
| Outcome: | The proposed model improves on the GLUE language understanding benchmark and accelerates the pre-training process. |
From Relevance to Utility: Evidence Retrieval with Feedback for Fact Verification (2023.findings-emnlp)
Copied to clipboard
| Challenge: | Existing evidence retrieval models are based on probability ranking principle . existing models do not align with retrieval-enhanced verification frameworks . |
| Approach: | They propose a feedback-based evidence retriever that optimizes the evidence retrieval process by incorporating feedback from the claim verifier. |
| Outcome: | Empirical studies show that the proposed method is superior to baseline methods. |
Towards Zero-shot Learning for End-to-end Cross-modal Translation Models (2023.findings-emnlp)
Copied to clipboard
| Challenge: | End-to-end zero-shot speech translation model is based on a zero-shot approach, but it is less competitive because of the limited amount of data available for multiple modalities. |
| Approach: | They propose an end-to-end zero-shot speech translation model that connects two pre-trained uni-modality modules via word rotator’s distance. |
| Outcome: | The proposed model performs better than or as well as those of the CTC-based models and can be trained in an end-to-end style to avoid error propagation. |
MentalGLM Series: Explainable Large Language Models for Mental Health Analysis on Chinese Social Media (2025.emnlp-main)
Copied to clipboard
Wei Zhai, Nan Bai, Qing Zhao, Jianqiang Li, Fan Wang, Hongzhi Qi, Meng Jiang, Xiaoqin Wang, Bing Xiang Yang, Guanghui Fu
| Challenge: | Social media is a key platform for emotional expression, yet deep learning lacks flexibility and interpretability. |
| Approach: | They propose to use Chinese social media to train interpretable mental health instruction datasets to test models' ability to explain their decisions. |
| Outcome: | The proposed models outperform deep learning and LLMs on three mental health downstream tasks and demonstrate their potential for clinical applications. |
Contextual Fine-to-Coarse Distillation for Coarse-grained Response Selection in Open-Domain Conversations (2022.acl-long)
Copied to clipboard
Wei Chen, Yeyun Gong, Can Xu, Huang Hu, Bolun Yao, Zhongyu Wei, Zhihao Fan, Xiaowu Hu, Bartuer Zhou, Biao Cheng, Daxin Jiang, Nan Duan
| Challenge: | Existing studies focus on coarse-grained response selection in retrieval-based dialogue systems. |
| Approach: | They propose a Contextual Fine-to-Coarse (CFC) distilled model for coarse-grained response selection in open-domain conversations. |
| Outcome: | The proposed model improves over baseline methods on two datasets based on the Reddit comments dump and Twitter corpus compared with baseline methods. |
Leveraging Contrastive Learning and Knowledge Distillation for Incomplete Modality Rumor Detection (2023.findings-emnlp)
Copied to clipboard
| Challenge: | Existing rumor detection models neglect the semantic coherence between text and image components in multimodal posts . Existing models neglect incomplete modalities in single modal posts, such as missing text or images . |
| Approach: | They propose a framework for incomplete modality rumor detection that captures semantic consistency between text and image pairs while enhancing model generalization to incomplete modalities within individual posts. |
| Outcome: | The proposed framework outperforms state-of-the-art methods on two English and two Chinese benchmark datasets for rumor detection in social media. |
ClinicalMC: A Benchmark for Multi-Course Clinical Decision-Making with Large Language Models (2026.findings-acl)
Copied to clipboard
| Challenge: | Existing benchmarks assess LLM performance in single-course settings and lack systematic evaluation in multi-course scenarios, where a patient’s condition evolves over time. |
| Approach: | They propose to use large language models to assess their performance in multi-course clinical decision-making scenarios where a patient’s condition evolves over time. |
| Outcome: | The proposed model includes 1,275 Chinese and 5,804 English samples across four stages from admission to discharge. |
Task-adaptive Label Dependency Transfer for Few-shot Named Entity Recognition (2023.findings-acl)
Copied to clipboard
| Challenge: | Existing methods for Named Entity Recognition (NER) ignore label dependency, resulting in suboptimal performance. |
| Approach: | They propose a meta-learning method to make label dependency transferable by learning general initialization and individual parameter update rule for label dependency. |
| Outcome: | The proposed method improves existing methods by learning general initialization and individual parameter update rule for label dependency. |
Process-Level Representation of Scientific Protocols with Interactive Annotation (2021.eacl-main)
Copied to clipboard
| Challenge: | Existing efforts to automate wet lab workflows are focusing on graph-prediction models that capture both concrete, exact quantities ("30 minutes") and vague instructions ("swirl") |
| Approach: | They manually annotate PEGs in a corpus of complex lab protocols with a novel interactive textual simulator that keeps track of entity traits and semantic constraints during annotation. |
| Outcome: | The proposed graph-prediction models are good at entity identification and local relation extraction while addressing challenges such as cross-sentence relations and long-range coreference. |
A Large Scale Speech Sentiment Corpus (2020.lrec-1)
Copied to clipboard
| Challenge: | Existing corpus for sentiment analysis uses text inputs, but voice inputs are becoming more important as smart assistants and mobile voice control become more prevalent. |
| Approach: | They propose to extend the Switchboard-1 Telephone Speech Corpus by adding sentiment labels from 3 different human annotators for every transcript segment. |
| Outcome: | The proposed corpus contains 49500 labeled speech segments covering 140 hours of audio. |
LLM-Coordination: Evaluating and Analyzing Multi-agent Coordination Abilities in Large Language Models (2025.findings-naacl)
Copied to clipboard
| Challenge: | Large Language Models (LLMs) have demonstrated emergent common-sense reasoning and Theory of Mind (ToM) capabilities, making them promising candidates for developing coordination agents. |
| Approach: | They propose to use Large Language Models (LLMs) to analyze coordination models in Pure Coordination settings where agents must cooperate to maximize gains. |
| Outcome: | The proposed benchmark evaluates LLMs through two distinct tasks: Agentic Coordination and Coordination Question Answering. |
Incomplete Utterance Rewriting with Editing Operation Guidance and Utterance Augmentation (2024.emnlp-main)
Copied to clipboard
| Challenge: | Existing generation methods on Incomplete Utterance Rewriting (IUR) can generate coherent utterances, but they often include irrelevant and redundant tokens in rewritten utteras . |
| Approach: | They propose a multi-task learning framework that uses editing operation labels to guide generation model to focus on critical tokens in dialogue context. |
| Outcome: | The proposed model outperforms state-of-the-art models on open-domain and task-oriented dialogues on three datasets. |
MMAC: A Multilingual, Multimodal Alignment Framework for Cultural Grounding Evaluation (2026.acl-long)
Copied to clipboard
Weihua Zheng, Zhengyuan Liu, Tanmoy Chakraborty, Weiwen Xu, Xiaoxue Gao, Bryan Chen Zhengyu Tan, Bowei Zou, Chang Liu, Yujia Hu, Xing Xie, Xiaoyuan Yi, Jing Yao, Chaojun Wang, Long Li, Rui Liu, Huiyao Liu, Koji Inoue, Ryuichi Sumida, Tatsuya Kawahara, Fan Xu, Lingyu Ye, Wei Tian, Dongjun Kim, Jimin Jung, Jaehyung Seo, Nadya Yuki Wangsajaya, Pham Minh Duc, Ojasva Saxena, Palash Nandi, Xiyan Tao, Wiwik Karlina, Tuan Luong, Keertana Arun Vasan, Roy Ka-Wei Lee, Nancy F. Chen
| Challenge: | Existing models lack cultural alignment across modalities and languages . a new framework to assess cultural awareness across linguistics and languages is needed . |
| Approach: | They propose a framework that integrates tri-modally aligned cultural benchmarks and a five-dimensional evaluation protocol to assess cross-country awareness disparities. |
| Outcome: | The proposed framework assesses cultural awareness disparities across modalities and languages . it is the first dataset aligned at the input level across text, image, and speech . |
From Implicit Graph Encoding to Explicit Evidence: A Training-Free LLM Framework for Temporal Knowledge Graph Reasoning (2026.findings-acl)
Copied to clipboard
Guo Tang, Ke Cheng, Huiming Fan, Heng Chang, Wenxiang Zheng, Xianhao Ou, Junjia Xiang, Ming Liu, Yujun Zhou, Li Lanyu, Bing Qin
| Challenge: | Existing Large Language Models (LLMs) struggle with implicit modality alignment and suboptimal graph linearization. |
| Approach: | They propose a training-free, test-time adaptive framework that reframes TKG prediction as explicit evidence-driven reasoning. |
| Outcome: | ExE-LLM outperforms fully trained graph neural networks on four benchmarks . it achieves SOTA performance in inductive settings, significantly outperforming fully trained neural networks . |
Improving Multi-party Dialogue Generation via Topic and Rhetorical Coherence (2024.emnlp-main)
Copied to clipboard
| Challenge: | Existing studies on multi-party dialogue generation focus on the reply-to structure of dialogue histories, but they neglect the coherence between generated responses and target utterances. |
| Approach: | They propose a Reinforcement Learning approach emphasizing Topic and Rhetorical Coherence to enhance the model's perception of coherence with the target utterance. |
| Outcome: | The proposed approach significantly outperforms the state-of-the-art baselines on two popular datasets. |
From LLMs to MLLMs: Exploring the Landscape of Multimodal Jailbreaking (2024.emnlp-main)
Copied to clipboard
| Challenge: | Recent advances in Large Language Models (LLMs) have demonstrated remarkable performance across various tasks, effectively following instructions to meet diverse user needs. |
| Approach: | They propose a framework for evaluation benchmarks and attack techniques for LLMs and MLLMs to enhance their security. |
| Outcome: | The proposed frameworks have been exploited to exploit the weaknesses of LLMs and MLLMs. |
SPIDE: Serial and Parallel Intertwined Speculative Decoding (2026.findings-acl)
Copied to clipboard
Wenru Xu, Peixuan Xu, Ziqi Yang, Ming Hu, Zihui Wang, Jianzhong Qi, Rongshan Yu, Xiaoliang Fan, Cheng Wang
| Challenge: | Speculative decoding (SD) is a training-free SD framework that orchestrates dynamic alternation combining serial dynamic drafting with parallel draft verification. |
| Approach: | They propose a serial and parallel intertwined speculative DEcoding framework that orchestrates dynamic alternation combining serial dynamic drafting and parallel draft verification. |
| Outcome: | The proposed framework accelerates inference while reducing the LLM usage costs. |
Benchmarking Vision-Language Models on Chinese Ancient Documents: From OCR to Knowledge Reasoning (2026.findings-acl)
Copied to clipboard
Haiyang Yu, Yuchuan Wu, Fan Shi, Jinghui Lu, Ke Niu, Xiaodong Ge, Minghan Zhuo, Jingqun Tang, Bin Li
| Challenge: | Existing document benchmarks focus on English printed texts or simplified Chinese . current vision-language models struggle with visual complexity and poor adaptability . |
| Approach: | They propose a benchmark to evaluate Chinese ancient documents' visual/linguistic complexity . ancient documents are valuable cultural heritage, but they face challenges in digitization and understanding . |
| Outcome: | the first benchmark for Chinese ancient documents evaluates VLMs from OCR to knowledge reasoning . ancient documents carry thousands of years of Chinese history and culture . traditional methods only scan images, while current models struggle with visual complexity . |
Alignment for Efficient Tool Calling of Large Language Models (2025.emnlp-main)
Copied to clipboard
| Challenge: | Recent advances in tool learning have enabled large language models to integrate external tools, enhancing their task performance by expanding their knowledge boundaries. |
| Approach: | They propose a framework that combines probabilistic knowledge boundary estimation with dynamic decision-making to allow LLMs to better assess when to invoke tools based on their confidence. |
| Outcome: | The proposed framework shows significant improvements in tool efficiency by reducing unnecessary tool usage. |
Sentiment Knowledge Enhanced Self-supervised Learning for Multimodal Sentiment Analysis (2023.findings-acl)
Copied to clipboard
| Challenge: | Existing studies have used general approaches to alleviate the overfitting of supervised models based on video data with sentiment annotations. |
| Approach: | They propose to capture common sentimental patterns in unlabeled videos using sentiment knowledge and non-verbal behavior to embed sentiment information into pre-trained multimodal representations. |
| Outcome: | The proposed model outperforms the baseline and achieves new State-Of-The-Art (SOTA) results. |
Text-to-TrajVis: Enabling Trajectory Data Visualizations from Natural Language Questions (2026.findings-acl)
Copied to clipboard
| Challenge: | Existing datasets for this task are limited and there is no suitable one available. |
| Approach: | They propose a new visualization language called Trajectory Visualization Language (TVL) to facilitate querying trajectory data and generating visualizations. |
| Outcome: | The proposed language can be used to query and generate trajectory data and generate visualizations with large language models. |
Lattice Transformer for Speech Translation (P19-1)
Copied to clipboard
| Challenge: | Recent advances in sequence modeling have highlighted the strengths of the transformer architecture. |
| Approach: | They propose a general lattice transformer for speech translation where the input is the output of the automatic speech recognition (ASR) they propose 'controllable' lattica attention mechanism to consume latent representations. |
| Outcome: | The proposed model outperforms baseline and lattice LSTM on the Chinese-English translation task. |
ACORD: An Expert-Annotated Retrieval Dataset for Legal Contract Drafting (2025.acl-long)
Copied to clipboard
Steven H Wang, Maksim Zubkov, Kexin Fan, Sarah Harrell, Yuyang Sun, Wei Chen, Andreas Plesner, Roger Wattenhofer
| Challenge: | Contract clause retrieval is critical to contract drafting because of its high quality and complexity. |
| Approach: | They propose the first expert-annotated benchmark specifically designed for contract clause retrieval . ACORD focuses on complex contract clauses such as Limitation of Liability, Indemnification, Change of Control . |
| Outcome: | The atticus clause retrieval dataset shows promising results but needs improvement . the benchmark can be used as an IR benchmark for the NLP community . |
Mind Reader: Latent User Demand-Guided Content Optimization for Generative Search Engine (2026.acl-long)
Copied to clipboard
Tong Chen, JiaWei Guo, Yuxi Li, Baiming Chen, Houxing Ren, Zhang Zhiwei, Yunxiang Zhang, Hanyang Xia, Kun Liang, Zhaoran Fan
| Challenge: | Generative Search Engines (GSEs) have reshaped information retrieval and Generating Engine Optimization (GEO) emerges to improve the content visibility in GSEs’ responses. |
| Approach: | They propose a method to optimize content to cover latent semantic information of GSEs by decomposing query into diverse perspectives and capturing underlying semantic information. |
| Outcome: | The proposed method outperforms baselines and effectively improves content visibility (with up to 2.44x objective metrics and 1.23x subjective metrics on average). |
SEAVER: Attention Reallocation for Mitigating Distractions in Language Models for Conditional Semantic Textual Similarity Measurement (2024.findings-emnlp)
Copied to clipboard
| Challenge: | Conditional Semantic Textual Similarity (C-STS) introduces specific limiting conditions to the traditional Semantics task. |
| Approach: | They propose a conditional semantic textual similarity (C-STS) task that introduces specific limiting conditions to the traditional Semantic Textual Similarity task. |
| Outcome: | The proposed model outperforms existing models on the C-STS-2023 test set and consistently improves on million-scale fine-tuning baseline models (up to 3 points). |
ARM2: Adaptive Reasoning Model with Vision Understanding and Executable Code (2026.findings-acl)
Copied to clipboard
| Challenge: | Large Reasoning Models suffer from the "over-thinking" problem, causing performance degradation. |
| Approach: | They propose a unified model that balances reasoning performance and efficiency across multiple formats through a reinforcement learning framework augmented with length-aware optimization. |
| Outcome: | The proposed model reduces token costs while preserving performance compared to traditional models. |
SrDetection: A Self-Referential Framework for Data Leakage Detection in Code Large Language Models (2026.findings-acl)
Copied to clipboard
Shuaimin Li, Liyang Fan, Zeyang li, Zhuoyue Wan, Yufang Lin, Shiwen Ni, Feiteng Fang, Hamid Alinejad-Rokny, Yuanfeng Song, Kun Jing, Chen Jason Zhang, Min Yang
| Challenge: | Existing methods for evaluating code large language models assume access to proprietary training corpora or use external reference sets with manually tuned, non-generalizable thresholds. |
| Approach: | They propose a framework for self-referential leakage detection for gray-box and black-box settings. |
| Outcome: | The proposed framework improves average F1 by 21.52 points in the gray-box setting and 14.46 points in black-box settings over strong baselines. |
Active Instruction Tuning: Improving Cross-Task Generalization by Training on Prompt Sensitive Tasks (2023.emnlp-main)
Copied to clipboard
| Challenge: | Instruction tuning (IT) achieves impressive zero-shot generalization results by training large language models on diverse tasks with instructions. |
| Approach: | They propose a framework to identify informative tasks and then actively tune models on selected tasks. |
| Outcome: | The proposed method outperforms baseline strategies for task selection on NIV2 and Self-Instruct datasets. |
CoRe-MMRAG: Cross-Source Knowledge Reconciliation for Multimodal RAG (2025.acl-long)
Copied to clipboard
| Challenge: | Recent advances in Multimodal Large Language Models have significantly improved reasoning and generation tasks by leveraging joint vision-language representations. |
| Approach: | They propose a framework that reconciles inconsistencies across knowledge sources . they use a four-stage pipeline to generate an internal response from parametric knowledge . |
| Outcome: | Experiments on KB-VQA show that CoRe-MMRAG achieves performance gains of 5.6% and 9.3% over baseline methods. |
Fixing Distribution Shifts of LLM Self-Critique via On-Policy Self-Play Training (2025.acl-long)
Copied to clipboard
| Challenge: | Large language models show impressive performance in a wide range of linguistic tasks, but their performance on complex reasoning tasks is still signif-icantly lower than the human level. |
| Approach: | They propose a reinforcement learning framework to synchronize the reasoning and critique capabilities of language models by using Monte Carlo sampling to give appropriate rewards to the model's critique content. |
| Outcome: | The proposed framework improves the model's reasoning and critique capabilities by 5.40 and 3.66 points, respectively, compared to the best baseline approach. |
Alleviating Hallucinations from Knowledge Misalignment in Large Language Models via Selective Abstention Learning (2025.acl-long)
Copied to clipboard
Lei Huang, Xiaocheng Feng, Weitao Ma, Yuchun Fan, Xiachong Feng, Yuxuan Gu, Yangfan Ye, Liang Zhao, Weihong Zhong, Baoxin Wang, Dayong Wu, Guoping Hu, Lingpeng Kong, Tong Xiao, Ting Liu, Bing Qin
| Challenge: | Large language models (LLMs) suffer from severe hallucination issues due to the knowledge misalignment between the pre-training stage and the supervised fine-tuning stage. |
| Approach: | They propose a training objective with an abstention mechanism that selectively rejects tokens that misalign with the desired knowledge distribution via a special [REJ] token. |
| Outcome: | The proposed model selectively rejects tokens that misalign with the desired knowledge distribution via a special [REJ] token. |
Merging Experts into One: Improving Computational Efficiency of Mixture of Experts (2023.emnlp-main)
Copied to clipboard
| Challenge: | Extensive experiments show that MEO significantly improves computational efficiency . compared to dense networks, sparsely activated networks only employ a few parameters for each input . |
| Approach: | They propose a method that merges multiple experts into one to reduce computation costs . they demonstrate that a sparse Mixture of Experts (MoE) can reduce the cost by activating a small subset of parameters for each input . |
| Outcome: | The proposed approach reduces the computational cost to that of a single expert by 83.3% compared to 82.6% in vanilla MoE. |
LogicST: A Logical Self-Training Framework for Document-Level Relation Extraction with Incomplete Annotations (2024.emnlp-main)
Copied to clipboard
| Challenge: | Document-level relation extraction (DocRE) is difficult due to the vast number of entity pairs. |
| Approach: | They propose a neural-logic self-training framework that iteratively resolves conflicts and constructs the minimal diagnostic set for updating models. |
| Outcome: | The proposed framework outperforms existing methods on the document-level relation extraction (docRE) benchmark. |
RBPtool: A Deep Language Model Framework for Multi-Resolution RBP-RNA Binding Prediction and RNA Molecule Design (2025.emnlp-main)
Copied to clipboard
Jiyue Jiang, Yitao Xu, Zikang Wang, Yihan Ye, Yanruisheng Shao, Yuheng Shan, Jiuming Wang, Xiaodan Fan, Jiao Yuan, Yu Li
| Challenge: | RNA-binding proteins play key roles in post-transcriptional gene regulation . existing methods focus on shallow sequence features or coarse structural representations . large language models allow for precise modeling and biologically informed de novo RNA design . |
| Approach: | They extend RPI15223 into a multi-resolution, structure-level RBP-RNA dataset and introduce RBPtool, a framework that fuses sequence and structural information. |
| Outcome: | The proposed framework achieves state-of-the-art performance on public benchmarks and the RPI15223 dataset while supporting fine-grained level predictions. |
PathQG: Neural Question Generation from Facts (2020.emnlp-main)
Copied to clipboard
| Challenge: | Existing research for question generation encodes text as a sequence of tokens without explicitly modeling fact information. |
| Approach: | They propose to incorporate facts in the input text for question generation in a comprehensive way. |
| Outcome: | The proposed model outperforms state-of-the-art models and human evaluation shows it generates relevant and informative questions. |
On-policy Reinforcement Fine-tuning with Offline reward for Multi-step Embodied Planning (2026.acl-long)
Copied to clipboard
| Challenge: | Embodied planning requires agents to make coherent multi-step decisions based on dynamic visual observations and verbal goals. |
| Approach: | They propose an On-policy Reinforcement fine-tuning framework with offline rewards for Embodied Task Planning that preserves generalization benefits of RFT while addressing costly interaction and sparse rewards. |
| Outcome: | The proposed framework outperforms closed-source and online-RL methods on EmbodiedBench, a recent benchmark for interactive embodied tasks. |
TimeSAF: Towards LLM-Guided Semantic Asynchronous Fusion for Time Series Forecasting (2026.acl-long)
Copied to clipboard
| Challenge: | Existing time series forecasting methods use a deep synchronous fusion strategy . high-level abstract semantics are inappropriately entangled with low-level temporal dynamics . |
| Approach: | They propose a framework based on hierarchical asynchronous fusion that decouples unimodal feature learning from cross-modal interaction. |
| Outcome: | The proposed framework outperforms state-of-the-art approaches on long-term forecasting benchmarks. |
Can Reasoning Help Large Language Models Capture Human Annotator Disagreement? (2026.eacl-long)
Copied to clipboard
Jingwei Ni, Yu Fan, Vilém Zouhar, Donya Rooein, Alexander Miserlis Hoyle, Mrinmaya Sachan, Markus Leippold, Dirk Hovy, Elliott Ash
| Challenge: | Variation in human annotation (i.e., disagreements) is common in NLP, but it is unclear whether it is possible to model this variation in LLMs. |
| Approach: | They evaluate the influence of different reasoning settings on LLM disagreement modeling . RLVR-style reasoning degrades performance in disagreement modeling, they find . |
| Outcome: | The proposed reasoning settings improve LLM disagreement modeling, while RLVR-style reasoning degrades it. |
Multilingual AMR-to-Text Generation (2020.emnlp-main)
Copied to clipboard
| Challenge: | Existing work on generating text from structured data into English has focused on bridging the gap between structure and natural language (NL) and semantically underspecified input and fully specified output. |
| Approach: | They propose a multilingual approach that can decode into 21 different languages . they leverage advances in cross-lingual embeddings and pretraining to generate multilingual models . |
| Outcome: | The proposed model surpasses baselines that generate into one language in eighteen languages. |
PENTATRON: PErsonalized coNText-Aware Transformer for Retrieval-based cOnversational uNderstanding (2022.emnlp-industry)
Copied to clipboard
| Challenge: | In a large fraction of the global traffic from smart digital assistants, frictions in dialogues may be attributed to incorrect understanding of the entities in a user's query due to factors including ambiguous mentions, mispronunciation, background noise and faulty on-device signal processing. |
| Approach: | They propose a parametric transformer-based language model to learn patterns from in-session customer-device interactions coupled with a non-parametric personalized entity index to compute the correct query. |
| Outcome: | The proposed system improves on the existing system and shows that it can learn the correct query from in-session customer-device interactions. |
Fewer is More: Boosting Math Reasoning with Reinforced Context Pruning (2024.emnlp-main)
Copied to clipboard
| Challenge: | Large Language Models (LLMs) have shown impressive capabilities, yet they struggle with math reasoning. |
| Approach: | They propose a coarse-to-fine pruner that prunes unimportant tokens to fit the context window. |
| Outcome: | The proposed approach outperforms prompting baselines across various LLMs and 5 math datasets and achieves 4.55% absolute improvements without any fine-tuning. |
Where to Attack: A Dynamic Locator Model for Backdoor Attack in Text Classifications (2022.coling-1)
Copied to clipboard
| Challenge: | BackDoor Attack (BDA) study aims to train a poisoned model with clean data and some trigger-embedded instances to perform normally on normal inputs. |
| Approach: | They propose to train a poisoned model with clean and poisonest inputs . they propose to use triggers to predict those poisonets as target labels . |
| Outcome: | The proposed model can predict P2P dynamically without human intervention. |
Enhancing Event Causality Identification with LLM Knowledge and Concept-Level Event Relations (2025.coling-main)
Copied to clipboard
| Challenge: | Existing methods to identify causal relationships between events often overlook the dependencies between similar events. |
| Approach: | They propose an ECI method enhanced by LLM Knowledge and Concept-Level Event Relations (LKCER) the method constructs a conceptual-level heterogeneous event graph by leveraging local contextual information of related event mentions. |
| Outcome: | The proposed method outperforms previous state-of-the-art methods on both benchmarks, EventStoryLine and Causal-TimeBank. |
Conversational Recommender System and Large Language Model Are Made for Each Other in E-commerce Pre-sales Dialogue (2023.findings-emnlp)
Copied to clipboard
Yuanxing Liu, Weinan Zhang, Yifan Chen, Yuchi Zhang, Haopeng Bai, Fan Feng, Hengbin Cui, Yongbin Li, Wanxiang Che
| Challenge: | E-commerce pre-sales dialogues elicit user needs and preferences for items . large language models lack domain-specific knowledge for accurate recommendations . |
| Approach: | They propose two collaboration strategies to integrate CRS and large language models in pre-sales dialogues. |
| Outcome: | The proposed methods can be very effective in some cases, the authors say . |
EMCompress: Video-LLMs with Endomorphic Multimodal Compression (2026.findings-acl)
Copied to clipboard
| Challenge: | Static, sparse frame sampling either dilutes evidence across task-irrelevant segments at significant cost or misses fine-grained temporal semantics altogether. |
| Approach: | They propose a novel task that compresses multimodal input while preserving answer invariance across reasonable downstream models. |
| Outcome: | The proposed task surpasses prior methods by 0.40 F-1 with competitive query rewriting. |
Compressing then Matching: An Efficient Pre-training Paradigm for Multimodal Embedding (2026.acl-long)
Copied to clipboard
Da Li, Yuxiao Luo, Keping Bi, Jiafeng Guo, Wei Yuan, Biao Yang, Yan Wang, Fan Yang, Tingting Gao, Guorui Zhou
| Challenge: | Recent approaches demonstrate that MLLMs can be adapted into competitive embedding models via large-scale contrastive learning. |
| Approach: | They propose a compressed pre-training phase which serves as a warm-up stage for contrastive learning. |
| Outcome: | The proposed model achieves state-of-the-art among MLLMs of comparable size on the MMEB, realizing optimization in both efficiency and effectiveness. |
AnyTrans: Translate AnyText in the Image with Large Scale Models (2024.findings-emnlp)
Copied to clipboard
| Challenge: | Recent advances in natural language processing and computer vision have made it possible to translate images with text in one language into equivalent images displaying that text translated into another language. |
| Approach: | They propose an all-encompassing framework for the task–In-Image Machine Translation (IIMT) that incorporates contextual cues from both textual and visual elements during translation. |
| Outcome: | The proposed framework can be constructed using open-source models and requires no training, making it highly accessible and expandable. |
DESED: Dialogue-based Explanation for Sentence-level Event Detection (2022.coling-1)
Copied to clipboard
Yinyi Wei, Shuaipeng Liu, Jianwei Lv, Xiangyu Xi, Hailei Yan, Wei Ye, Tong Mo, Fan Yang, Guanglu Wan
| Challenge: | Existing methods for sentence-level event detection depend on manual annotations or domain expertise to design sophisticated templates and rules. |
| Approach: | They propose a dialogue-based explanation paradigm to enhance sentence semantics for event detection. |
| Outcome: | The proposed method can be applied to two event detection datasets. |
Leibniz: Theory-of-Mind Driven Neuro-Symbolic Logical Reasoning via Multi-Agent Collaboration (2026.acl-long)
Copied to clipboard
| Challenge: | Existing methods for logical reasoning with large language models suffer from insufficient rule semantic grounding and weak rule application mechanisms. |
| Approach: | They propose a theory-of-mind driven neuro-symbolic reasoning framework that integrates natural language and symbolic representations throughout the reasoning process. |
| Outcome: | The proposed model surpasses state-of-the-art models in reasoning accuracy and flexibility. |
CharacterEval: A Chinese Benchmark for Role-Playing Conversational Agent Evaluation (2024.acl-long)
Copied to clipboard
| Challenge: | CharacterEval is a benchmark for comprehensive RPCA assessment in Chinese . authors show that Chinese LLMs exhibit more promising capabilities than GPT-4 in role-playing conversation. |
| Approach: | They propose a Chinese benchmark for comprehensive RPCA assessment . they use a dataset of Chinese role-playing dialogues and character profiles . |
| Outcome: | The proposed benchmark demonstrates that Chinese LLMs exhibit more promising capabilities than GPT-4 in Chinese role-playing conversation. |
TP-RAG: Benchmarking Retrieval-Augmented Large Language Model Agents for Spatiotemporal-Aware Travel Planning (2025.emnlp-main)
Copied to clipboard
| Challenge: | Existing studies on large language models (LLMs) focus on basic plan validity, but neglect critical aspects such as route efficiency, POI appeal, and real-time adaptability. |
| Approach: | They propose a benchmark for retrieval-augmented, spatiotemporal-aware travel planning that integrates retrieved trajectories with LLMs’ intrinsic reasoning. |
| Outcome: | The proposed framework improves spatial efficiency and POI rationality while challenging universality and robustness due to conflicting references and noisy data. |
CCMatrix: Mining Billions of High-Quality Parallel Sentences on the Web (2021.acl-long)
Copied to clipboard
| Challenge: | Using a curated common crawl corpus, we were able to mine 10.8 billion parallel sentences out of which only 2.9 billions are aligned with English. |
| Approach: | They use 32 snapshots of a curated common crawl corpus totaling 71 billion unique sentences to mine 10.8 billion parallel sentences out of which only 2.9 billions are aligned with English. |
| Outcome: | The proposed system outperforms the best single systems on the WMT’19 test set for English-German/Russian/Chinese and outperformed the best submission at the 2020 WAT workshop. |
Interpretable Operational Risk Classification with Semi-Supervised Variational Autoencoder (2020.acl-main)
Copied to clipboard
| Challenge: | Existing text classification frameworks for operational risk prediction lack interpretability and labeled data are often misaligned. |
| Approach: | They propose a semi-supervised text classification framework that integrates multi-head attention mechanism with Semi-supervised variational inference for operational risk classification. |
| Outcome: | The proposed framework outperforms baseline methods on a real-world dataset and can use unlabeled data to learn visually interpretable representations. |
ReRec: Reasoning-Augmented LLM-based Recommendation Assistant via Reinforcement Fine-tuning (2026.acl-long)
Copied to clipboard
| Challenge: | Existing reasoning-augmented systems that handle complex queries are lacking . we present a framework that enhances LLM-based recommendation assistants . |
| Approach: | They propose a reinforcement fine-tuning framework that enhances LLM-based recommendation . they use a dual-graph Enhanced Reward Shaping framework to integrate recommendation metrics . |
| Outcome: | The proposed framework outperforms state-of-the-art recommendations and preserves core abilities. |
Aerial Vision-and-Dialog Navigation (2023.findings-acl)
Copied to clipboard
| Challenge: | Aerial visionand-dialling navigation (AVDN) is a new approach to autonomous drones that can converse with humans and follow natural language commands to complete tasks. |
| Approach: | They propose to use Aerial Visionand-Dialog Navigation (AVDN) to navigate a drone via natural language conversation by collecting a dataset of over 3k recorded navigation trajectories with asynchronous human-human dialogs between commanders and followers. |
| Outcome: | The proposed system can converse with humans and follow natural language commands to fly to the expected destination. |
Multi-grained Attention Network for Aspect-Level Sentiment Classification (D18-1)
Copied to clipboard
| Challenge: | Existing approaches to aspect sentiment classification use coarse-grained attention mechanisms . a novel approach captures word-level interaction between aspect and context . |
| Approach: | They propose a novel multi-grained attention network model for aspect level sentiment classification . they use a fine-grounded attention mechanism to capture word-level interaction between aspect and context . |
| Outcome: | The proposed model outperforms the state-of-the-art methods on three datasets . it shows that aspect-level interactions can bring extra useful information and improve performance . |
Benchmark Self-Evolving: A Multi-Agent Framework for Dynamic LLM Evaluation (2025.coling-main)
Copied to clipboard
| Challenge: | Recent advances in Large Language Models have demonstrated remarkable performance across tasks. |
| Approach: | They propose a benchmark self-evolving framework to dynamically evaluate rapidly advancing Large Language Models. |
| Outcome: | The proposed framework extends existing benchmarks to extend models across tasks and tasks. |
Unveiling the Lack of LVLM Robustness to Fundamental Visual Variations: Why and Path Forward (2025.findings-acl)
Copied to clipboard
| Challenge: | Large Vision Language Models (LVLMs) have shown impressive performance on various vision-language tasks. |
| Approach: | They propose a benchmark framework for evaluating Visual Variation Robustness of Large Vision Language Models that incorporates automated evaluation dataset generation and principled metrics for thorough robustness assessment. |
| Outcome: | The proposed framework identifies a vulnerability to visual variations affecting even advanced models that excel at complex vision-language tasks but significantly underperform on simple tasks like object recognition. |
ADDMU: Detection of Far-Boundary Adversarial Examples with Data and Model Uncertainty Estimation (2022.emnlp-main)
Copied to clipboard
| Challenge: | Existing methods show poor performance under Far Boundary (FB) adversarial examples. |
| Approach: | They propose to use a new technique to detect adversarial examples based on data and model uncertainty to outperform existing methods. |
| Outcome: | The proposed method outperforms existing methods by 3.6 and 6.0 AUC points under each scenario. |
Unknown Intent Detection Using Gaussian Mixture Model with an Application to Zero-shot Intent Classification (2020.acl-main)
Copied to clipboard
| Challenge: | Existing methods for unknown intent detection are limited by prior knowledge of class labels. |
| Approach: | They propose to use a Gaussian mixture model to model utterance embeddings with a distribution and inject dynamic class semantic information into Gausssian means. |
| Outcome: | The proposed model performs well on three real task-oriented dialogue datasets in two languages. |
M³GQA: A Multi-Entity Multi-Hop Multi-Setting Graph Question Answering Benchmark (2025.acl-long)
Copied to clipboard
| Challenge: | GraphRAG systems have achieved remarkable progress in enhancing performance and reliability of large language models. |
| Approach: | They propose a GraphRAG benchmark focusing on multi-entity queries with six settings for comprehensive evaluation. |
| Outcome: | The proposed method can construct diverse data with semantically correct ground-truth reasoning paths. |
ChatGPT Rates Natural Language Explanation Quality like Humans: But on Which Scales? (2024.lrec-main)
Copied to clipboard
| Challenge: | Traditionally, evaluating NLEs through gathering human judgments is a tedious task due to the subjective nature of human evaluations. |
| Approach: | They examine the alignment between ChatGPT and human assessments across multiple scales and compare them using paired comparisons and dynamic prompting. |
| Outcome: | The proposed model aligns better with humans in coarser scales and provides semantically similar examples in the prompt. |
Structure-Unified M-Tree Coding Solver for Math Word Problem (2022.emnlp-main)
Copied to clipboard
| Challenge: | Existing models that take into account the binary tree structure of mathematical expressions have achieved better performance, but the output space is non-deterministic. |
| Approach: | They propose a Structure-Unified M-Tree Coding Solver which applies a tree with any M branches to unify the output structures. |
| Outcome: | The proposed model outperforms several state-of-the-art models under similar experimental conditions and performs much better under low-resource conditions. |
MARIO: MAth Reasoning with code Interpreter Output - A Reproducible Pipeline (2024.findings-acl)
Copied to clipboard
| Challenge: | Large language models lack mathematical reasoning, a hurdle on the path to true artificial general intelligence. |
| Approach: | They propose a protocol for fine-tuning large language models with a Python code interpreter to enhance the text analysis of the LLMs. |
| Outcome: | The proposed protocol improves the performance of a 7B-parameter LLM on the GSM8K and MATH datasets while allowing for an outlier-free value model-based inference method. |
MulDimIF: A Multi-Dimensional Constraint Framework for Evaluating and Improving Instruction Following in Large Language Models (2026.findings-acl)
Copied to clipboard
Junjie Ye, Caishuang Huang, Zhuohan Chen, Wenjie Fu, Chenyuan Yang, Leyi Yang, Yilong Wu, Peng Wang, Meng Zhou, Xiaolong Yang, Tao Gui, Qi Zhang, Zhongchao Shi, Jianping Fan, Xuanjing Huang
| Challenge: | Existing research has focused on constraint categories, offering little guidance for improving instruction following abilities. |
| Approach: | They propose a multi-dimensional constraint framework that allows for instruction following . they construct 9,106 code-verifiable samples and evaluate 18 LLMs . |
| Outcome: | The proposed framework improves instruction following performance without compromising general performance. |
Multilingual Translation from Denoising Pre-Training (2021.findings-acl)
Copied to clipboard
Yuqing Tang, Chau Tran, Xian Li, Peng-Jen Chen, Naman Goyal, Vishrav Chaudhary, Jiatao Gu, Angela Fan
| Challenge: | Recent work shows potential of training one model for multilingual machine translation . but little has been explored on the potential to combine denoising pretraining with multilingual translation in a single model. |
| Approach: | They propose to combine denoising pretraining with multilingual machine translation in a single model. |
| Outcome: | The proposed model improves over models trained from scratch and bilingually for translation into English. |
CETA: A Consensus Enhanced Training Approach for Denoising in Distantly Supervised Relation Extraction (2022.coling-1)
Copied to clipboard
| Challenge: | Existing methods for relation extraction use noisy instances and poor quality training data. |
| Approach: | They propose a sentence-level DSRE method that denies noisy samples from the wrong classification space on the feature space by enhancing the classification consensus between two discrepant classifiers. |
| Outcome: | The proposed method outperforms existing methods on widely-used benchmarks and significantly outperformed existing methods. |
An Empirical Study of Clinical Note Generation from Doctor-Patient Encounters (2023.eacl-main)
Copied to clipboard
| Challenge: | Medical doctors spend 52 to 102 minutes per day writing clinical notes from patient encounters. |
| Approach: | They propose to use a new dataset to generate automated and manual clinical notes from doctor-patient conversations in a clinical setting. |
| Outcome: | The proposed model could reduce the time spent writing clinical notes from doctor-patient conversations in a clinical setting. |
PLATO-XL: Exploring the Large-scale Pre-training of Dialogue Generation (2022.findings-aacl)
Copied to clipboard
Siqi Bao, Huang He, Fan Wang, Hua Wu, Haifeng Wang, Wenquan Wu, Zhihua Wu, Zhen Guo, Hua Lu, Xinxian Huang, Xin Tian, Xinchao Xu, Yingzhan Lin, Zheng-Yu Niu
| Challenge: | Experimental results show PLATO-XL achieves state-of-the-art results across multiple conversational tasks. |
| Approach: | They propose to train PLATO-XL models with up to 11 billion parameters, trained on Chinese and English social media conversations. |
| Outcome: | The proposed model achieves state-of-the-art on multiple conversational tasks, verifying its potential as a foundation model of conversational AI. |
FaithLM: Towards Faithful Explanations for Large Language Models (2026.eacl-long)
Copied to clipboard
Yu-Neng Chuang, Guanchu Wang, Chia-Yuan Chang, Ruixiang Tang, Shaochen Zhong, Fan Yang, Andrew Wen, Mengnan Du, Xuanting Cai, Vladimir Braverman, Xia Hu
| Challenge: | Large language models (LLMs) produce natural language explanations, but they lack faithfulness and do not reflect the evidence the model uses to decide. |
| Approach: | They propose a model-agnostic framework that evaluates and improves the faithfulness of LLM explanations without token masking or task-specific heuristics. |
| Outcome: | The proposed framework improves faithfulness of large language models without masking or heuristics. |
See2Refine: Vision-Language Feedback Improves LLM-Based eHMI Action Designers (2026.acl-long)
Copied to clipboard
| Challenge: | External Human-Machine Interfaces (eHMIs) are emerging as promising solutions to address this communication gap. |
| Approach: | They propose a framework that uses vision-language models (VLMs) for perceptual evaluation as automated visual feedback to improve an LLM-based eHMI action designer. |
| Outcome: | The proposed framework outperforms prompt-only LLM designers and manually specified baselines in three eHMI modalities and multiple LLM model sizes. |
PEToolLLM: Towards Personalized Tool Learning in Large Language Models (2025.findings-acl)
Copied to clipboard
| Challenge: | Existing tool learning studies focus on general-purpose tool-use capability, but ignore the importance of personalized tool-user preferences. |
| Approach: | They propose a framework to adapt Large Language Models to personalized tool learning task, which is trained through supervised fine-tuning and direct preference optimization. |
| Outcome: | Extensive experiments on PEToolBench show that the proposed framework outperforms existing LLMs in the personalized tool learning task. |
Suggest-Verify-Revise: A Three-Stage Document-Level Event Causality Identification with Narrative Consistency (2026.acl-long)
Copied to clipboard
| Challenge: | Existing methods for document-level Event Causality Identification rely on local semantic similarity for independent event-pair discrimination . Existing approaches ignore the influence of the overall narrative backbone in the propagation of causal dependencies and the role differentiation of events within multi-cause/multi-effect structures. |
| Approach: | They propose a suggest-verify-revise approach for document-level Event Causality Identification with narrative consistency (SVRECI) they integrate heuristic causal suggestions generated by an LLM with structural suggestions derived from hypergraph modeling . |
| Outcome: | The proposed approach outperforms existing methods on event-storylines and Causal-TimeBank datasets. |
Translate the Beauty in Songs: Jointly Learning to Align Melody and Translate Lyrics (2023.findings-emnlp)
Copied to clipboard
| Challenge: | Song translation requires both translation of lyrics and alignment of music notes . human translators of songs need to have a mastery of cultural traditions and the poetic usage of both source and target languages . |
| Approach: | They propose a model that can model lyric translation and lyrics-melody alignment . they use an encoder-decoder framework that can translate lyrics and determine number of aligned notes . |
| Outcome: | The proposed framework can translate lyrics and determine the number of aligned notes at each decoding step. |
Learning to Ask Denotative and Connotative Questions for Knowledge-based VQA (2024.findings-emnlp)
Copied to clipboard
| Challenge: | Large language models have attracted increasing attention due to their prominent performance on various tasks. |
| Approach: | They propose to let LLMs learn to ask informative questions to collect visual information . they introduce concepts of denotation and connotation to promote image and question understanding . |
| Outcome: | The proposed model can generate high-quality questions and efficiently collect required information without expensive training or annotations. |
Towards IP Intelligence: Benchmarking Large Language Models on Intellectual Property Knowledge and Practice (2026.findings-acl)
Copied to clipboard
Qiyao Wang, Guhong Chen, Hongbo Wang, Huaren Liu, Minghui Zhu, Zhifei Qin, Li Linwei, Yilin Yue, Shiqiang Wang, Jiayan Li, Wu Yihang, Ziqiang Liu, Longze Chen, Run Luo, Liyang Fan, Jiaming Li, Lei Zhang, Kan Xu, Hamid Alinejad-Rokny, Chengming Li, Shiwen Ni, Yuan Lin, Min Yang
| Challenge: | Existing datasets and benchmarks focus only on patents or cover limited aspects of the IP field, lacking alignment with real-world scenarios. |
| Approach: | They propose a bilingual IP task taxonomy and a large-scale bilingual benchmark to evaluate LLMs in real-world IP practice. |
| Outcome: | The proposed model achieves only 75.8% accuracy, indicating room for improvement . open-source IP and law-oriented models lag behind closed-source general-purpose models . |
BattleAgent: Multi-modal Dynamic Emulation on Historical Battles to Complement Historical Analysis (2024.emnlp-demo)
Copied to clipboard
Shuhang Lin, Wenyue Hua, Lingyao Li, Che-Jui Chang, Lizhou Fan, Jianchao Ji, Hang Hua, Mingyu Jin, Jiebo Luo, Yongfeng Zhang
| Challenge: | Recent advances in large language models have demonstrated impressive reasoning capabilities, indicating their potential to serve as the foundation for agents. |
| Approach: | They propose a detailed emulation system that combines large vision-language model and multi-agent system to emulate dynamic interactions between multiple agents over a period of time. |
| Outcome: | The proposed system combines large vision-language model and multi-agent system to emulate dynamic interactions between agents and their environments over a period of time. |
Mask Attention Networks: Rethinking and Strengthen Transformer (2021.naacl-main)
Copied to clipboard
Zhihao Fan, Yeyun Gong, Dayiheng Liu, Zhongyu Wei, Siyuan Wang, Jian Jiao, Nan Duan, Ruofei Zhang, Xuanjing Huang
| Challenge: | Existing research explores to enhance the two sublayers separately to improve the capability of Transformer for text representation. |
| Approach: | They propose to combine SAN and Feed-Forward Networks to create a dynamic mask attention network with a learnable mask matrix which can model localness adaptively. |
| Outcome: | The proposed model outperforms the original Transformer on translation and text summarization tasks. |
Contextual Rephrase Detection for Reducing Friction in Dialogue Systems (2021.emnlp-main)
Copied to clipboard
| Challenge: | Large-scale conversational AI based dialogue systems like Alexa, Siri, and Google Assistant, are getting more and more prevalent in real-world applications to help users across the globe. |
| Approach: | They propose a contextual rephrase detection model ContReph to automatically identify rephrasings from multi-turn dialogues using contextual information and user-agent interaction signals. |
| Outcome: | The proposed model outperforms the pairwise rephrase detection models by leveraging the context and user-agent interaction signals. |
Structure-Aware Zero-Shot Relational Learning for Knowledge Graphs without External Knowledge (2026.findings-acl)
Copied to clipboard
| Challenge: | Existing methods for Zero-shot Relational Learning depend on external knowledge, resulting in increased annotation costs and limited practical applicability. |
| Approach: | They propose a structure-aware paradigm that performs ZRL without external knowledge . it leverages intrinsic structural patterns in KGs to bridge semantic correlations for new relations with existing ones. |
| Outcome: | The proposed paradigm achieves 10.66% improvement in MRR while reducing annotation costs and enhancing practical applicability on three real-world benchmarks. |
X-LeBench: A Benchmark for Extremely Long Egocentric Video Understanding (2025.findings-emnlp)
Copied to clipboard
Wenqi Zhou, Kai Cao, Hao Zheng, Yunze Liu, Xinyi Zheng, Miao Liu, Per Ola Kristensson, Walterio W. Mayol-Cuevas, Fan Zhang, Weizhe Lin, Junxiao Shen
| Challenge: | Existing benchmark datasets focus on short to moderately long videos, leaving a substantial gap in evaluating extensive, ultra-long egocentric video recordings. |
| Approach: | X-LeBench is a benchmark dataset designed to evaluate long egocentric video recordings . it uses a life-logging pipeline to produce realistic, coherent daily plans . |
| Outcome: | X-LeBench is a new benchmark dataset designed to evaluate long-form egocentric video understanding . the approach produces realistic, coherent daily plans aligned with real-world video data . |
User-Assistant Bias in LLMs (2026.findings-acl)
Copied to clipboard
| Challenge: | Modern large language models are typically trained using structured role tags . asymmetries in training data associated with different role tags can potentially introduce inductive biases. |
| Approach: | They propose a task-agnostic benchmark to test user–assistant bias in large language models . they find human-preference alignment amplifies user bias, reasoning fine-tuning reduces it . |
| Outcome: | The proposed benchmark tests show that most instruction-tuned models exhibit strong user bias . human-preference alignment amplifies user bias, while reasoning fine-tuning reduces it. |
JointCQ: Improving Factual Hallucination Detection with Joint Claim and Query Generation (2026.findings-acl)
Copied to clipboard
| Challenge: | Existing methods for detecting factual hallucinations in generated content exhibit limitations in the first two stages of the halluciation detection pipeline. |
| Approach: | They propose a joint claim-and-query generation framework that can detect factual hallucinations in generated content. |
| Outcome: | The proposed method outperforms existing methods on open-domain QA hallucination detection benchmarks. |
Empathy in Diversity: Personalized Depression and Anxiety Therapy via Dialogue State Tracking and Patient-Aware Planning (2026.acl-long)
Copied to clipboard
Xinwei Yang, Junyi Fan, Yuqing Liu, Jiaxuan Wang, Jiashuai Zhang, Hongru Liang, Wenqiang Lei, Yao Song
| Challenge: | Recent efforts have turned to large language models (LLMs) as therapeutic agents for psychological therapy tasks, yet robustness across diverse patients remains underexplored. |
| Approach: | They propose a realistic role-play protocol for evaluating therapeutic dialogue agents and a de-identified, expert-annotated corpus of therapist–patient dialogues. |
| Outcome: | The proposed framework outperforms baselines on therapeutic outcomes and dialogue quality while improving conversational efficiency. |
A Lightweight Mixture-of-Experts Neural Machine Translation Model with Stage-wise Training Strategy (2024.findings-naacl)
Copied to clipboard
| Challenge: | Using mixture-of-experts (MoE) to deal with language heterogeneity is a challenge in neural machine translation (NMT). |
| Approach: | They propose a lightweight MoE-based NMT model that is trained via an elaborate stage-wise training strategy. |
| Outcome: | The proposed model achieves stable improvements in translation tasks by introducing fewer extra parameters compared to baseline models. |
NegotiationToM: A Benchmark for Stress-testing Machine Theory of Mind on Negotiation Surrounding (2024.findings-emnlp)
Copied to clipboard
Chunkit Chan, Cheng Jiayang, Yauwai Yim, Zheye Deng, Wei Fan, Haoran Li, Xin Liu, Hongming Zhang, Weiqi Wang, Yangqiu Song
| Challenge: | Theory of mind evaluations currently focus on testing models using machine-generated data or game settings prone to shortcuts and spurious correlations. |
| Approach: | They propose a benchmark to stress-test machine ToM in real-world negotiation surrounding covered multi-dimensional mental states. |
| Outcome: | The proposed benchmark builds upon the Belief-Desire-Intention theory and conducts the necessary empirical experiments to evaluate large language models. |
CL-QR: Cross-Lingual Enhanced Query Reformulation for Multi-lingual Conversational AI Agents (2023.emnlp-industry)
Copied to clipboard
| Challenge: | Existing QR systems that reformulate defective user queries are limited in English due to the scarcity of non-English QR labels. |
| Approach: | They propose a query reformulation method which reformulates defective user queries to improve non-English QR performance. |
| Outcome: | The proposed framework improves non-English QR performance by leveraging abundant reformulation resources in English. |
Just Adjust One Prompt: Enhancing In-Context Dialogue Scoring via Constructing the Optimal Subgraph of Demonstrations and Prompts (2023.emnlp-main)
Copied to clipboard
| Challenge: | Using large language models as chatbots can cause hallucinations and lack of empathy, authors report . a dimension-agnostic scoring method is proposed to improve the performance of chatbot performance . |
| Approach: | They propose a dimension-agnostic scoring method that leverages in-context learning . they propose to automatically generate prompts and then request the LLM multiple times . |
| Outcome: | The proposed method outperforms baselines on five datasets. |
Towards Transferable Personality Representation Learning based on Triplet Comparisons and Its Applications (2025.emnlp-main)
Copied to clipboard
Kai Tang, Rui Wang, Renyu Zhu, Minmin Lin, Xiao Ding, Tangjie Lv, Changjie Fan, Runze Wu, Haobo Wang
| Challenge: | Existing methods for personality analysis treat corpus as a single unit for classification, but this approach presents several challenges. |
| Approach: | They propose a task paradigm for text-based personality representation learning that uses a triplet personality trend comparison dataset to learn single-sentence personality embeddings with desirable metric properties. |
| Outcome: | The proposed model significantly boosts performance across various applications, including personality detection, personality retrieval, and emotion translation prediction. |
Enhancing Goal-oriented Proactive Dialogue Systems via Dynamic Multi-dimensional Consistency Optimization (2025.findings-emnlp)
Copied to clipboard
| Challenge: | Existing work on goal-oriented proactive dialogue systems failed to address the multi-dimensional consistency issue between generated responses and key contextual elements. |
| Approach: | They propose a Dynamic Multi-dimensional Consistency Reinforcement Learning framework which measures the impact of each consistency dimension on overall dialogue quality and provides feedback to improve response quality. |
| Outcome: | The proposed framework significantly improves the consistency of generated responses on two datasets. |
CMQCIC-Bench: A Chinese Benchmark for Evaluating Large Language Models in Medical Quality Control Indicator Calculation (2025.findings-acl)
Copied to clipboard
Guangya Yu, Yanhao Li, Zongying Jiang, Yuxiong Jin, Li Dai, Yupian Lin, Ruihui Hou, Weiyan Zhang, Yongqi Fan, Qi Ye, Jingping Liu, Tong Ruan
| Challenge: | Medical quality control indicators are essential to assess the qualifications of healthcare institutions for medical services. |
| Approach: | They propose a Chinese electronic medical records-based dataset for MQCIC and propose CF-IR method that disentangles clinical fact verification and inferential rule reasoning actions. |
| Outcome: | The proposed method outperforms Chain-of-Thought methods on 20 representative LLMs, covering general and medical models. |
Guiding the Flowing of Semantics: Interpretable Video Captioning via POS Tag (D19-1)
Copied to clipboard
| Challenge: | Existing models of video captioning use a network and semantics are mixed into one feature. |
| Approach: | They propose an Adaptive Semantic Guidance Network which instantiates whole video semantics to different POS-aware semantics with supervision of part of speech (POS) tag. |
| Outcome: | Extensive experiments show that the proposed model is more efficient than state-of-the-art models. |
SLAM: Towards Efficient Multilingual Reasoning via Selective Language Alignment (2025.coling-main)
Copied to clipboard
Yuchun Fan, Yongyu Mu, YiLin Wang, Lei Huang, Junhao Ruan, Bei Li, Tong Xiao, Shujian Huang, Xiaocheng Feng, Jingbo Zhu
| Challenge: | Large language models (LLMs) have demonstrated significant improvements in reasoning abilities, but these improvements are primarily focused on English, leading to inferior performance in non-English scenarios. |
| Approach: | They propose a multilingual reasoning alignment approach that fine-tunes the layers responsible for multilingual comprehension in one stage. |
| Outcome: | The proposed method fine-tunes 6 of the 9 layers responsible for multilingual comprehension, while reducing training time by 4.1-11.9 compared to the two-stage method. |
Reformatted Alignment (2024.findings-emnlp)
Copied to clipboard
| Challenge: | Current methods to improve data quality are labor-intensive or prone to factual errors caused by LLM hallucinations. |
| Approach: | They propose a method which reformats the responses of instruction data into a format that better aligns with pre-established criteria and the collated evidence. |
| Outcome: | The proposed approach minimizes human annotation, hallucination, and the difficulty in scaling, remaining orthogonal to existing alignment techniques. |
FinCARDS: Card-Based Analyst Reranking for Financial Document Question Answering (2026.findings-acl)
Copied to clipboard
| Challenge: | Existing reranking frameworks optimize semantic relevance, leading to unstable rankings and opaque decisions on long documents. |
| Approach: | They propose a structured reranking framework that reframes financial evidence selection as constraint satisfaction under a finance-aware schema. |
| Outcome: | FINCARDS improves early-rank retrieval over lexical and LLM-based reranking baselines while reducing ranking variance. |
Self-Awareness before Action: Mitigating Logical Inertia via Proactive Cognitive Awareness (2026.findings-acl)
Copied to clipboard
| Challenge: | Existing work on abductive and long-context reasoning reports that current models still lack self-awareness of missing premises. |
| Approach: | They propose a reasoning framework that introduces self-awareness of missing premises before making the final decision. |
| Outcome: | SABA achieves best performance on all three difficulty splits of detective puzzle benchmark . a small early mistake can remain uncorrected and can guide later reasoning . |
fairseq: A Fast, Extensible Toolkit for Sequence Modeling (N19-4)
Copied to clipboard
Myle Ott, Sergey Edunov, Alexei Baevski, Angela Fan, Sam Gross, Nathan Ng, David Grangier, Michael Auli
| Challenge: | OpenNMT is a community-built toolkit written in multiple languages with an emphasis on extensibility. |
| Approach: | They propose to use PyTorch to train custom sequence models for translation, summarization, language modeling, and other tasks. |
| Outcome: | The proposed toolkit is fast, extensible, and useful for both research and production. |
Toward Secure Tuning: Mitigating Security Risks from Instruction Fine-Tuning (2026.acl-long)
Copied to clipboard
Yanrui Du, Fenglei Fan, Sendong Zhao, Jiawei Cao, Ming Ma, Danyang Zhao, Shuren Qi, Ting Liu, Bing Qin
| Challenge: | Instruction Fine-Tuning (IFT) has emerged as a critical technique for customizing Large Language Models (LLMs) however, recent studies have revealed that IFT can compromise the built-in security mechanisms of LLMs, posing significant security risks. |
| Approach: | They propose a method that shifts learning burden onto security-robust parameters and propose 'warm-up' phase that preferentially trains Mods_Rob to learn low-level features with minimal security risk. |
| Outcome: | The proposed method reduces security risks without sacrificing performance gains across knowledge-intensive datasets. |
ProMCP: Profiling Token Flows and Latency Costs in Model Context Protocol–Based LLM Agents (2026.findings-acl)
Copied to clipboard
| Challenge: | Large Language Models are increasingly used as agents that interact with external tools and data sources to solve tasks that require fresh knowledge, precise computation, or action in a real environment. |
| Approach: | They propose a framework that decomposes the MCP workflow into a six-stage communication pipeline and enables granular attribution of computational costs. |
| Outcome: | The proposed framework decomposes the MCP workflow into a six-stage communication pipeline, enabling granular attribution of computational costs. |
mrCAD: Multimodal Communication to Refine Computer-aided Designs (2025.findings-emnlp)
Copied to clipboard
William P McCarthy, Saujas Vaduguru, Karl D.d. Willis, Justin Matejka, Judith E Fan, Daniel Fried, Yewen Pu
| Challenge: | generative AI excels at creating artifacts in a single turn but can struggle to make precise refinements that match our design intent. |
| Approach: | They propose to use multi-turn interactions to iterate and refine computer-aided designs (CADs) they use text and drawing to communicate with each other over multiple rounds of interaction . |
| Outcome: | mrCAD consists of 6,082 communication games, 15,163 instruction-execution rounds, played between 1,092 pairs of humans. |
Eidos, INDRA, & Delphi: From Free Text to Executable Causal Models (N19-4)
Copied to clipboard
Rebecca Sharp, Adarsh Pyarelal, Benjamin Gyori, Keith Alcock, Egoitz Laparra, Marco A. Valenzuela-Escárcega, Ajay Nagesh, Vikas Yadav, John Bachman, Zheng Tang, Heather Lent, Fan Luo, Mithun Paul, Steven Bethard, Kobus Barnard, Clayton Morrison, Mihai Surdeanu
| Challenge: | a paper proposes a method for building probabilistic models of complex phenomena such as food insecurity . currently, these models are hand-built for each new situation and require months to construct . |
| Approach: | They propose an approach that builds executable probabilistic models from raw, free text. |
| Outcome: | The proposed approach builds executable probabilistic models from raw, free text. |
Position-Aware Depth Decay Decoding (D3): Boosting Large Language Model Inference Efficiency (2025.findings-acl)
Copied to clipboard
| Challenge: | Recent dynamic computation methods show that not all components are required for inference, enabling a training-free pipeline. |
| Approach: | They propose a token-position aware layer skipping framework to save 1.5x times operations efficiently while maintaining performance. |
| Outcome: | The proposed algorithm achieves 1.5x speedup on large language models with no retraining and with comparable performance on the GSM8K and BBH benchmarks. |
Visualization of the Topic Space of Argument Search Results in args.me (D18-2)
Copied to clipboard
Yamen Ajjour, Henning Wachsmuth, Dora Kiesel, Patrick Riehmann, Fan Fan, Giuliano Castiglia, Rosemary Adejoh, Bernd Fröhlich, Benno Stein
| Challenge: | args.me is the first search engine for controversial topics . it ranks pro and con arguments by their relevance to a topic . |
| Approach: | They propose a visualization interface for result exploration that provides an overview of main aspects in a barycentric coordinate system. |
| Outcome: | The proposed search engine is the first dedicated argument search engine on the web. |
An Empirical Study on Multiple Information Sources for Zero-Shot Fine-Grained Entity Typing (2021.emnlp-main)
Copied to clipboard
| Challenge: | Auxiliary information from multiple sources has been demonstrated to be effective in zero-shot fine-grained entity typing (ZFET) however, there is no comprehensive understanding of how to make better use of the existing information sources and how they affect the performance of ZFET. |
| Approach: | They propose a multi-source fusion model targeting auxiliary information from multiple sources to improve zero-shot fine-grained entity typing (ZFET) |
| Outcome: | The proposed model achieves 11.42% and 22.84% gains over state-of-the-art baselines on BBN and Wiki respectively with regard to macro F1 scores. |
Feedback to Reasoning: LLM-Assisted Molecular Optimization with Domain Feedback and Historical Reasoning (2026.findings-acl)
Copied to clipboard
Wenhan Gao, Xiran Fan, Chin-Chia Michael Yeh, Jiarui Sun, Yuzhong Chen, Menghai Pan, Mahashweta Das, Yi Liu
| Challenge: | Existing methods for molecular optimization do not leverage domain feedback and historical knowledge with reasoning traces and chemical insights. |
| Approach: | They propose a conversational molecular optimization pipeline that enables LLMs to accumulate and retrieve past actions, rationales, and feedback. |
| Outcome: | The proposed framework transforms LLMs from passive text generators into agentic experts that learn both actions and reasoning from experience. |
Pre-train or Annotate? Domain Adaptation with a Constrained Budget (2021.emnlp-main)
Copied to clipboard
| Challenge: | Recent work shows that pre-training in-domain language models can boost performance when adapting to a new domain. |
| Approach: | They propose to combine annotation and pre-training to maximize performance under budget constraints. |
| Outcome: | The proposed approach is based on the annotation cost of three procedural text datasets and pre-training cost of 3 in-domain language models. |
Efficient Data Learning for Open Information Extraction with Pre-trained Language Models (2023.findings-emnlp)
Copied to clipboard
| Challenge: | Experimental results indicate that, compared to previous SOTA methods, OK-IE requires only 1/100 of the training data (900 instances) and 1/120 of the time (3 minutes) to achieve comparable results. |
| Approach: | They propose a framework that transforms OpenIE into the pre-training task form of the T5 model, thereby reducing the need for extensive training data. |
| Outcome: | The proposed framework transforms OpenIE into the pre-training task form of the T5 model, reducing the need for extensive training data and significantly reducing training time. |
Generating Fact Checking Briefs (2020.emnlp-main)
Copied to clipboard
Angela Fan, Aleksandra Piktus, Fabio Petroni, Guillaume Wenzek, Marzieh Saeidi, Andreas Vlachos, Antoine Bordes, Sebastian Riedel
| Challenge: | Existing work has framed fact checking as classification, often supported by a claim as input. |
| Approach: | They propose to use natural language briefs to increase the accuracy of fact checking . they show that QABriefer increases the accuracy by 10% while QABries reduce time . |
| Outcome: | The proposed model increases the accuracy of crowdworkers by 10% while reducing the time required by 20%. |
kFolden: k-Fold Ensemble for Out-Of-Distribution Detection (2021.emnlp-main)
Copied to clipboard
| Challenge: | Existing studies studying OOD detection in NLP often rely on external data to diversify model predictions. |
| Approach: | They propose a framework which mimics OOD detection behavior without external data . they take text classification as an archetype and compare them to existing datasets . |
| Outcome: | The proposed framework can resolve in- and out-distribution examples in a natural way using existing datasets. |
Idea23D: Collaborative LMM Agents Enable 3D Model Generation from Interleaved Multimodal Inputs (2025.coling-main)
Copied to clipboard
| Challenge: | Existing 3D AIGC methods don’t fully unleash human creativity. |
| Approach: | They propose a framework that generates 3D content from multimodal inputs . they propose 198 multimodal text inputs for 3D generation tasks . |
| Outcome: | The proposed framework generates 3D content from multimodal inputs without human intervention. |
Beyond Surface-Level Patterns: An Essence-Driven Defense Framework Against Jailbreak Attacks in LLMs (2025.findings-acl)
Copied to clipboard
| Challenge: | Existing methods focus on surface-level patterns, overlooking the deeper attack essences. |
| Approach: | They propose an Essence-Driven Defense Framework Against Jailbreak Attacks in Aligned Large Language Models that extracts the "attack essence" from a diverse set of known attack instances and stores it in an offline vector database. |
| Outcome: | The proposed framework outperforms existing methods by reducing the Attack Success Rate by at least 20%, underscoring its superior robustness against jailbreak attacks. |
RQUGE: Reference-Free Metric for Evaluating Question Generation by Answering the Question (2023.findings-acl)
Copied to clipboard
Alireza Mohammadshahi, Thomas Scialom, Majid Yazdani, Pouya Yanki, Angela Fan, James Henderson, Marzieh Saeidi
| Challenge: | Existing metrics for evaluating the quality of automatically generated questions are expensive and penalise valid questions that may not have high lexical or semantic similarity to the reference questions. |
| Approach: | They propose a question-answering and span scorer metric based on the answerability of the candidate question given the context. |
| Outcome: | The proposed metric has higher correlation with human judgment without relying on the reference question. |
CAMIEval: Enhancing NLG Evaluation through Multidimensional Comparative Instruction-Following Analysis (2025.naacl-long)
Copied to clipboard
| Challenge: | Evaluating the quality of texts generated by language models has always been a challenging task in natural language processing (NLP). |
| Approach: | They propose a multidimensional comparative evaluation method based on instruction-following that combines relevance, factuality, and adherence with a concrete Chain-of-Thoughts process to enhance the accuracy of evaluations. |
| Outcome: | The proposed method outperforms existing methods in correlation with human evaluations on two NLG evaluation benchmarks. |
Pruning via Merging: Compressing LLMs via Manifold Alignment Based Layer Merging (2024.emnlp-main)
Copied to clipboard
Deyuan Liu, Zhanyue Qin, Hairu Wang, Zhao Yang, Zecheng Wang, Fangying Rong, Qingbin Liu, Yanchao Hao, Bo Li, Xi Chen, Cunhang Fan, Zhao Lv, Dianhui Chu, Zhiying Tu, Dianbo Sui
| Challenge: | Existing methods for parameter pruning fail to utilize the knowledge from pruned parameters. |
| Approach: | They propose a method that uses manifold learning and the Information Bottleneck measure to merge similar layers to preserve model performance. |
| Outcome: | The proposed method outperforms pruning methods on multiple datasets and LLMs with quantization and achieves substantial compression ratios. |
Exploring Concept Depth: How Large Language Models Acquire Knowledge and Concept at Different Layers? (2025.coling-main)
Copied to clipboard
Mingyu Jin, Qinkai Yu, Jingyuan Huang, Qingcheng Zeng, Zhenting Wang, Wenyue Hua, Haiyan Zhao, Kai Mei, Yanda Meng, Kaize Ding, Fan Yang, Mengnan Du, Yongfeng Zhang
| Challenge: | Large language models have shown remarkable performances across a wide range of tasks, but mechanisms by which they encode tasks of varying complexity remain poorly understood. |
| Approach: | They propose to explore the possibility that LLMs process concepts in different layers . they propose to categorize concepts based on their level of abstraction . |
| Outcome: | The proposed model can process complex concepts in shallow layers, the authors show . the proposed model could be used to prob complex tasks in shallow ones . |
VideoScore: Building Automatic Metrics to Simulate Fine-grained Human Feedback for Video Generation (2024.emnlp-main)
Copied to clipboard
Xuan He, Dongfu Jiang, Ge Zhang, Max Ku, Achint Soni, Sherman Siu, Haonan Chen, Abhranil Chandra, Ziyan Jiang, Aaran Arulraj, Kai Wang, Quy Do, Yuansheng Ni, Bohan Lyu, Yaswanth Narsupalli, Rongqi Fan, Zhiheng Lyu, Bill Yuchen Lin, Wenhu Chen
| Challenge: | Existing video metrics are lagging behind in providing reliable scores over generated videos due to lack of large-scale human-annotated dataset. |
| Approach: | They propose to use VideoFeedback to train a human-annotated multi-aspect score over 37.6K synthesized videos from 11 existing video generative models. |
| Outcome: | The proposed model outperforms the prior best metrics by 50 points in the test. |
NeuSym-RAG: Hybrid Neural Symbolic Retrieval with Multiview Structuring for PDF Question Answering (2025.acl-long)
Copied to clipboard
Ruisheng Cao, Hanchong Zhang, Tiancheng Huang, Zhangyi Kang, Yuxin Zhang, Liangtai Sun, Hanqi Li, Yuxun Miao, Shuai Fan, Lu Chen, Kai Yu
| Challenge: | Existing approaches to retrieval augmented generation neglect PDF structure and layout . individual PDFs often exceed prompt limits and user queries may span multiple documents. |
| Approach: | They propose a hybrid neural symbolic retrieval framework which combines both paradigms in an interactive process. |
| Outcome: | The proposed framework organizes semi-structured PDF content into relational database and vectorstore . it defeats both RAG and structured baselines on three PDF-based QA datasets . |
Prompt Tuning with Contradictory Intentions for Sarcasm Recognition (2023.eacl-main)
Copied to clipboard
| Challenge: | Recent advances have shown that Pre-trained Language Models (PLMs) can achieve promising performance in many downstream Natural Language Processing (NLP) tasks. |
| Approach: | They propose to incorporate prior knowledge about contradictory intentions into prompt tuning for sarcasm recognition by mimicking the actual intention by verbalizer engineering. |
| Outcome: | The proposed model mimics the actual intention by prompt construction and indicates whether the actual intent contradicts the literal content by verbalizer engineering. |
CoMIF: Modeling of Complex Multiple Interaction Factors for Conversation Generation (2025.coling-main)
Copied to clipboard
| Challenge: | Existing methods for generating human-like dialogues lack implicit correlations among factors . different factors may alternately dominate token-level response generation during decoding . |
| Approach: | They propose a framework that can model complex multiple interaction factors to generate human-like conversations. |
| Outcome: | The proposed framework generates human-like conversations with multiple factors compared to state-of-the-art methods . et al. show that the proposed framework produces superior results over existing methods compared with the state- of-the art methods based on multiple datasets . |
Can Small Language Models Help Large Language Models Reason Better?: LM-Guided Chain-of-Thought (2024.lrec-main)
Copied to clipboard
| Challenge: | Existing frameworks for guiding a language model in reasoning tasks are limited by their tendency to generate low-quality rationales that are repetitive and vacuous. |
| Approach: | They propose a framework that leverages a lightweight language model for guiding a black-box large LM in reasoning tasks. |
| Outcome: | The proposed framework outperforms baselines in answer prediction accuracy. |
Think Faster Than Words: Efficient LLM Chain-of-Thought Reasoning via Dynamic Shortcut Decoding (2026.acl-long)
Copied to clipboard
| Challenge: | Existing methods that prune or employ early stopping to reduce latency often compromise reasoning reliability. |
| Approach: | They propose a shortcut decoding framework that integrates probes over internal hidden states with step-level entropy to detect convergence of reasoning during generation and adaptively selects between a fast-exit path and a stability-verified path to remove redundant steps while preserving answer correctness. |
| Outcome: | The proposed framework reduces token usage by approximately 35% and maintains accuracy comparable to full CoT decoding. |
Datamart-Agent: LLM-Driven Game-Theoretic Agent for Data Marketplace Modeling (2026.findings-acl)
Copied to clipboard
| Challenge: | Existing studies on data marketplaces model static equilibria and complete information, which limits their realism. |
| Approach: | They propose an LLM-driven game-theoretic agent that makes equilibrium-consistent decisions in analytically tractable data marketplaces with evolving and incomplete-information. |
| Outcome: | The proposed framework matches equilibrium-consistent decision execution in a static data marketplace with a dynamic game tree memory and mechanism-guided reflection without updating parameters. |
Does Chain-of-Thought Reasoning Really Reduce Harmfulness from Jailbreaking? (2025.findings-acl)
Copied to clipboard
| Challenge: | Existing jailbreak attacks fail against reasoning models enhanced by Chain-of-Thought (CoT) reasoning. |
| Approach: | They propose a jailbreak method that uses Chain-of-Thought reasoning to reduce harmfulness from jailbreaking. |
| Outcome: | The proposed jailbreak method performs well against open AI models and deepseek-R1 reasoning models. |
CADMate: Generating CAD Assembly Plan with Geometric Chain-of-Thought and Spatial Physical Rewards (2026.acl-long)
Copied to clipboard
| Challenge: | Computer-aided design (CAD) is crucial in prototyping complex 3D objects . designers manually define assembly sequences for individual CAD parts . |
| Approach: | They propose a framework for computer-aided design that predicts actions for CAD parts . they use a reference design image and disassembled parts to generate 6-DoF transformations . |
| Outcome: | The proposed framework outperforms existing MLLMs in the design of CAD assemblies. |
To What Extent Do Natural Language Understanding Datasets Correlate to Logical Reasoning? A Method for Diagnosing Logical Reasoning. (2022.coling-1)
Copied to clipboard
| Challenge: | Reasoning and knowledge-related skills are considered as fundamental skills for natural language understanding (NLU) tasks. |
| Approach: | They propose a method to diagnose correlations between an NLU dataset and a specific skill. |
| Outcome: | The proposed method is able to diagnose correlations between dataset and logical reasoning skill on 8 MRC and 3 NLI datasets. |
GigaSpeech 2: An Evolving, Large-Scale and Multi-domain ASR Corpus for Low-Resource Languages with Automated Crawling, Transcription and Refinement (2025.acl-long)
Copied to clipboard
Yifan Yang, Zheshu Song, Jianheng Zhuo, Mingyu Cui, Jinpeng Li, Bo Yang, Yexing Du, Ziyang Ma, Xunying Liu, Ziyuan Wang, Ke Li, Shuai Fan, Kai Yu, Wei-Qiang Zhang, Guoguo Chen, Xie Chen
| Challenge: | GigaSpeech 2 is a large-scale, multi-domain, multilingual speech recognition corpus for low-resource languages. |
| Approach: | They propose a large-scale, multi-domain, multilingual speech recognition corpus for low-resource languages and an automated pipeline for data crawling, transcription, and label refinement. |
| Outcome: | The proposed corpus reduces the word error rate for Thai, Indonesian, and Vietnamese on a realistic YouTube test set by 25% to 40% compared to Whisper large-v3. |
Improve Speech Translation Through Text Rewrite (2025.coling-industry)
Copied to clipboard
| Challenge: | Recent advances in speech translation (ST) research have focused on the unique characteristics of spontaneous speech, including accents and presentation quality. |
| Approach: | They propose to transform transcribed speech into a cleaner style more in line with the expectations of translation models built from written text. |
| Outcome: | Experiments on public and in-house translation models show that the proposed model can be effectively distilled into a standalone translation model. |
Strategies for Structuring Story Generation (P19-1)
Copied to clipboard
| Challenge: | Existing language models generate word by word, but fail to capture high-level interactions . a novel decomposition approach allows more abstract representations to be generated first . |
| Approach: | They propose models which abstract over actions and entities to create stories . they generate predicate-argument structure, then replace placeholders with context-sensitive names . |
| Outcome: | The proposed models improve diversity and coherence of events and entities in generated stories. |
InferenceDynamics: Adaptive LLM Routing through Structured Capability and Knowledge Profiling (2026.acl-long)
Copied to clipboard
Haochen Shi, Tianshi Zheng, Weiqi Wang, Baixuan Xu, Chunyang Li, Chunkit Chan, Tao Fan, Yangqiu Song
| Challenge: | Large Language Model (LLM) routing is a pivotal technique for navigating a diverse landscape of LLMs. |
| Approach: | They propose a flexible and scalable multi-dimensional routing framework that models the capability and knowledge of models. |
| Outcome: | The proposed framework can be used to generalize and identify top-performing models for group-level routing using modern benchmarks including MMLU-Pro, GPQA, BigGenBench, and LiveBench. |
Text-Tuple-Table: Towards Information Integration in Text-to-Table Generation via Global Tuple Extraction (2024.emnlp-main)
Copied to clipboard
| Challenge: | Existing approaches to condensing textual information into concise and structured tables are limited in their applicability in broader contexts. |
| Approach: | They propose a benchmark dataset for generating summary tables of competitions based on real-time commentary texts that incorporates large-scale textual information into concise and structured tables. |
| Outcome: | The proposed method exhibits strong generalization abilities, surpassing previous approaches on several other text-to-table datasets. |
ClueAnchor: Clue-Anchored Knowledge Reasoning Exploration and Optimization for Retrieval-Augmented Generation (2025.findings-emnlp)
Copied to clipboard
Hao Chen, Yukun Yan, Sen Mei, Wanxiang Che, Zhenghao Liu, Qi Shi, Xinze Li, Yuchun Fan, Pengcheng Huang, Qiushi Xiong, Zhiyuan Liu, Maosong Sun
| Challenge: | Existing RAG systems often underutilize the retrieved documents, authors say . they fail to extract and integrate key clues needed to support faithful and interpretable reasoning . |
| Approach: | a new framework extracts key clues from retrieved content and generates multiple reasoning paths . the framework optimizes the model by selecting the most appropriate reasoning path . |
| Outcome: | Experiments show that ClueAnchor outperforms baseline RAG frameworks in completeness and robustness. |
Chain-of-Thought Tuning: Masked Language Models can also Think Step By Step in Natural Language Understanding (2023.emnlp-main)
Copied to clipboard
| Challenge: | Chain-of-Thought (CoT) is a technique that guides large language models to decompose complex tasks into multi-step reasoning processes. |
| Approach: | They propose a two-step reasoning framework based on prompt tuning to implement step-by-step thinking for MLMs on NLU tasks. |
| Outcome: | The proposed framework outperforms baselines and achieves state-of-the-art performance on two NLU tasks. |
Simulating Dual-Process Thinking in Dialogue Topic Shift Detection (2025.coling-main)
Copied to clipboard
| Challenge: | Existing methods for topic shift detection focus on shallow local reasoning, overlooking the importance of considering the global historical structure and local details to elucidate the underlying causes of topic shift. |
| Approach: | They propose a dual-process theory for dialogue topic shift detection that employs Large Language Models to extract and store the global topic structure of historical dialogue, while a reasoning module introduces a LLM to generate reasoning samples between the response and the most recent topic of historical dialog. |
| Outcome: | The proposed framework outperforms the state-of-the-art on three public datasets and is based on a dual-process theory. |
Exploiting Contextual Knowledge in LLMs through 𝒱-usable Information based Layer Enhancement (2025.acl-long)
Copied to clipboard
| Challenge: | Existing approaches to enhance the context-faithfulness of Large Language Models (LLMs) ignore the fundamental mechanism of how contextual information is processed within LLMs’ internal states. |
| Approach: | They propose a method that enhances the utilization of contextual knowledge within LLMs’ internal representations by employing V-usable information analysis. |
| Outcome: | The proposed method improves context-faithfulness generation in Question-Answering tasks, particularly in scenarios involving unknown or conflicting contextual knowledge. |
Attention Alignment and Flexible Positional Embeddings Improve Transformer Length Extrapolation (2024.findings-naacl)
Copied to clipboard
| Challenge: | Existing methods for length extrapolation are tailored for natural language modeling, a task known to have strong recency bias. |
| Approach: | They propose two attention alignment strategies to improve T5's long-context utilization capability without fine-tuning. |
| Outcome: | The proposed methods improve the long-context utilization capability of T5 on language modeling, retrieval, multi-document question answering, and code completion tasks without any fine-tuning. |
Interview Evaluation: A Novel Approach for Automatic Evaluation of Conversational Question Answering Models (2023.emnlp-main)
Copied to clipboard
| Challenge: | Existing evaluation methods for CQA use pre-collected human-human conversations . previous methods use model-predicted dialogue history instead of ground truth . |
| Approach: | They propose an automatic evaluation approach that uses the model's dialogue history to evaluate models. |
| Outcome: | The proposed method improves on existing models and their evaluations on QuAC and CoQA. |
Uni-Retrieval: A Multi-Style Retrieval Framework for STEM’s Education (2025.acl-long)
Copied to clipboard
| Challenge: | Current retrieval models focus on natural text-image retrieval, which is insufficient for STEM education contexts due to ambiguities in the retrieval process. |
| Approach: | They propose a diverse expression retrieval task tailored to educational scenarios . they extract query style features as prototypes and build a continuously updated Prompt Bank . |
| Outcome: | The proposed model outperforms existing retrieval models in most retrieval tasks. |
WikiSeeker: Rethinking the Role of Vision-Language Models in Knowledge-Based Visual Question Answering (2026.findings-acl)
Copied to clipboard
| Challenge: | Existing methods for Knowledge-Based Visual Question Answering rely on images as the retrieval key, and often overlook or misplace the role of Vision-Language Models (VLMs) |
| Approach: | They propose a multi-modal RAG framework that assigns VLMs two specialized agents: a Refiner and an Inspector. |
| Outcome: | Experiments on EVQA, InfoSeek, and M2KR show that the proposed framework achieves state-of-the-art performance with significant improvements in both retrieval accuracy and answer quality. |
Probing Multi-modal Machine Translation with Pre-trained Language Model (2021.findings-acl)
Copied to clipboard
| Challenge: | Multi-modal machine translation (MMT) aimed at using images to help disambiguate the target during translation but recent studies showed that visual features are either negligible or incremental. |
| Approach: | They propose to incorporate a visual language model on the source side to improve multi-modal translation quality significantly. |
| Outcome: | The proposed model improves the translation quality significantly on the multi-modal dataset. |
Cross-lingual Social Misinformation Detector based on Hierarchical Mixture-of-Experts Adapter (2025.coling-main)
Copied to clipboard
| Challenge: | a global trend of misinformation is affecting non-native speaker users who are more susceptible to misinformation on foreign social media platforms. |
| Approach: | They propose a method to integrate sentiment analysis as an auxiliary task and a hierarchical routing strategy and expert-mask mechanism to enhance cross-lingual social misinformation detection. |
| Outcome: | The proposed method improves cross-lingual social misinformation detection in non-native speakers with only monolingual social media histories. |
CGF: Constrained Generation Framework for Query Rewriting in Conversational AI (2022.emnlp-industry)
Copied to clipboard
Jie Hao, Yang Liu, Xing Fan, Saurabh Gupta, Saleh Soltan, Rakesh Chada, Pradeep Natarajan, Chenlei Guo, Gokhan Tur
| Challenge: | Large-scale conversational AI agents such as Alexa, Siri and Google Assistant help millions of users to perform a lot of tasks. |
| Approach: | They propose a Constrained Generation Framework for query rewriting at global and personalized levels. |
| Outcome: | The proposed framework significantly boosts the query rewriting performance. |
Structure-aware Domain Knowledge Injection for Large Language Models (2025.acl-long)
Copied to clipboard
| Challenge: | Structure-aware Continual Pre-Training (SCPT) and Structure-Aware Supervised Fine-Tuning (SSFT) are two-stage strategies for knowledge injection and alignment that reduces the training corpus needs to 5% while achieving 100% of traditional knowledge injection performance. |
| Approach: | They propose a method to efficiently transform foundation Large Language Models into domain specialists by using two-stage strategies: Structure-aware Continual Pre-Training and Structure-Aware Supervised Fine-Tuning. |
| Outcome: | The proposed method significantly reduces the training corpus needs to a mere 5% while achieving 100% of traditional knowledge injection performance. |
Schema-Driven Information Extraction from Heterogeneous Tables (2024.findings-emnlp)
Copied to clipboard
| Challenge: | Existing work on information extraction from tables has focused on developing custom pipelines for each table collection. |
| Approach: | They propose a task that transforms tabular data into structured records following a human-authored schema. |
| Outcome: | The proposed task achieves F1 scores ranging from 74.2 to 96.1 while maintaining cost efficiency. |
A Reinforcement Learning Framework for Natural Question Generation using Bi-discriminators (C18-1)
Copied to clipboard
| Challenge: | Existing research on visual question generation is focused on training models to fit the annotated data set that makes them indifferent from other language generation tasks. |
| Approach: | They propose to use two discriminators to enhance the training of a visual question generator to ask natural questions about an image. |
| Outcome: | The proposed model outperforms state-of-the-art models in terms of automatic and human evaluation metrics. |
Latent Positional Information is in the Self-Attention Variance of Transformer Language Models Without Positional Embeddings (2023.acl-short)
Copied to clipboard
| Challenge: | Recent research has called into question the necessity of positional embeddings in transformer language models. |
| Approach: | They propose to discard positional embeddings in transformer language models to facilitate more efficient pretraining. |
| Outcome: | The proposed model encodes strong positional information through shrinkage of self-attention variance. |
DeepPlanner: Scaling Planning Capability for Deep Research Agents via Advantage Shaping (2026.findings-acl)
Copied to clipboard
| Challenge: | Existing approaches to planning involve implicit planning or introduce explicit planners without systematically optimizing the planning stage. |
| Approach: | They propose an end-to-end RL framework that enhances the planning capabilities of deep research agents. |
| Outcome: | Experiments show that DeepPlanner improves planning quality and achieves state-of-the-art results under a lower training budget. |
Live-Aid: A Large-Scale Dialogue Dataset and Benchmark for Interleaved Multi-party Interactions in Live Streaming (2026.findings-acl)
Copied to clipboard
Yiming Lei, Yize Fan, Zeming Liu, Jiaji Dong, Hui Qiu, Haitao Leng, Qingjie Liu, Kehai Chen, Tingting Gao, Yunhong Wang
| Challenge: | Existing Multimodal Large Language Models struggle with dynamic interactions due to the scarcity of high-quality interleaved data. |
| Approach: | They propose a large-scale interleaved live interaction Chinese dataset with human-annotated video responses. |
| Outcome: | The proposed model can be used to evaluate live interactions in Chinese over 1,100 hours and 80,037 dialogue turns. |
SedarEval: Automated Evaluation using Self-Adaptive Rubrics (2024.findings-emnlp)
Copied to clipboard
| Challenge: | Existing evaluation paradigms rely on generic scoring rubrics that fail to consider the specificities of each question and its problem-solving process. |
| Approach: | They propose a new evaluation paradigm based on self-adaptive rubrics that mimic a human evaluator's analytical process. |
| Outcome: | The proposed evaluation paradigm achieves higher concordance rate with human graders than existing paradigms, including GPT-4. |
FairSteer: Inference Time Debiasing for LLMs with Dynamic Activation Steering (2025.findings-acl)
Copied to clipboard
| Challenge: | Existing prompt-based debiasing methods exhibit instability due to sensitivity to prompt changes . fine-tuning-based techniques incur substantial computational overhead and catastrophic forgetting . |
| Approach: | They propose a debiasing framework that encodes fairness-related features into separable directions in the hidden activation space. |
| Outcome: | The proposed framework performs inference-time debiasing without requiring retraining or prompt design . it detects bias signatures in activations and then computes debiased steering vectors . the proposed framework is available to download in the u.s. |
ChartGaze: Enhancing Chart Understanding in LVLMs with Eye-Tracking Guided Attention Refinement (2025.emnlp-main)
Copied to clipboard
Ali Salamatian, Amirhossein Abaskohi, Wan-Cyuan Fan, Mir Rayat Imtiaz Hossain, Leonid Sigal, Giuseppe Carenini
| Challenge: | Chart question answering (CQA) is a key research challenge for large vision-language models . recent efforts focus on leveraging LVLMs directly on chart images . |
| Approach: | They propose a gaze-guided attention refinement that aligns image-text attention with human fixations to improve chart reasoning quality and interpretability. |
| Outcome: | The proposed approach improves answer accuracy and attention alignment yielding gains of up to 2.56 percentage points across multiple models. |
MUSS: Multilingual Unsupervised Sentence Simplification by Mining Paraphrases (2022.lrec-1)
Copied to clipboard
| Challenge: | MUSS trains strong models using sentence-level paraphrase data instead of labeled simplification data. |
| Approach: | They propose a multilingual unsupervised sentence simplification system that does not require labeled simplification data. |
| Outcome: | The proposed model outperforms the previous best supervised models on English, French, and Spanish benchmarks despite not using labeled simplification data. |
DecoCal: Decoding with Calibration in Diffusion Large Language Models (2026.acl-long)
Copied to clipboard
| Challenge: | Diffusion Large Language Models (DLLMs) generate text via iterative token denoising . but decoding is challenging, with many tokens appearing predictable early . |
| Approach: | They propose a Decoding framework that performs Calibration of token-level confidence across diffusion steps and leverages the calibrated results to guide decoding decisions. |
| Outcome: | Experiments on multiple DLLMs and benchmarks show that DecoCal improves generation accuracy compared to existing strategies. |
SlotRefine: A Fast Non-Autoregressive Model for Joint Intent Detection and Slot Filling (2020.emnlp-main)
Copied to clipboard
| Challenge: | Slot filling and intent detection are two main tasks in spoken language understanding systems. |
| Approach: | They propose a non-autoregressive slot filling model with two-pass iteration mechanism to handle uncoordinated slots problem. |
| Outcome: | The proposed model significantly outperforms previous models in slot filling task while speeding up decoding. |
Long-Short Term Masking Transformer: A Simple but Effective Baseline for Document-level Neural Machine Translation (2020.emnlp-main)
Copied to clipboard
| Challenge: | Recent advances in deep learning have led to significant improvement of document-level neural machine translation (NMT). |
| Approach: | They propose a long-short term masking self-attention on top of the standard transformer to capture the long-range dependence and reduce the propagation of errors. |
| Outcome: | The proposed model captures the long-range dependence and reduces errors on two publicly available document-level datasets. |
Overcoming Catastrophic Forgetting During Domain Adaptation of Seq2seq Language Generation (2022.naacl-main)
Copied to clipboard
| Challenge: | Existing work on lifelong learning requires incremental memory space to learn a model . existing work on experience replay or elastic weighted consolidation requires incremental space . |
| Approach: | They propose a framework that leverages a recall optimization mechanism to memorize parameters of previous tasks via regularization and a domain drift estimation algorithm to compensate the drift between different domains in the embedding space. |
| Outcome: | The proposed framework outperforms SOTA models on paraphrase and dialog response generation tasks. |
Cogito: A Cognitive Agentic Framework Driven by Dynamic Graph of Thoughts for Financial Report Generation (2026.findings-acl)
Copied to clipboard
| Challenge: | Existing approaches to financial report generation are insufficient to handle dynamic uncertainties of real-world financial environments. |
| Approach: | They propose a cognitively grounded agentic framework for professional financial report generation that is driven by Dynamic Graph of Thoughts and a social collaboration mechanism to facilitate coordinated agent interaction. |
| Outcome: | The proposed framework is based on a dynamic reasoning model and social collaboration mechanism. |
TaCube: Pre-computing Data Cubes for Answering Numerical-Reasoning Questions over Tabular Data (2022.emnlp-main)
Copied to clipboard
| Challenge: | Existing auto-regressive pre-trained language models are challenged by recent emerging numerical reasoning datasets due to the error-prone implicit calculation. |
| Approach: | They propose a pre-computation tool to pre-compute aggregation/arithmetic results for the table in advance, so they are handy and readily available for PLMs to answer numerical reasoning questions. |
| Outcome: | The proposed model improves on TAT-QA and T5 and BART-large on multiple benchmarks. |
Chain-of-Talkers (CoTalk): Fast Human Annotation of Dense Image Captions (2025.emnlp-main)
Copied to clipboard
| Challenge: | Existing approaches for optimizing human annotation efforts are limited . et al., 2015) suggest that densely annotated image captions improve vision-language alignment . |
| Approach: | They propose an AI-in-the-loop methodology to maximize the number of annotated samples and improve their comprehensiveness under fixed budget constraints. |
| Outcome: | The proposed method improves annotation speed and retrieval performance over the parallel method. |
Logic-guided Semantic Representation Learning for Zero-Shot Relation Classification (2020.coling-main)
Copied to clipboard
| Challenge: | Existing methods to zero-shot relation classification can only identify seen relations . existing methods rely on descriptive information to improve understandability of relation types . |
| Approach: | They propose a logic-guided semantic representation learning model for zero-shot relation classification that builds connections between seen and unseen relations via implicit and explicit semantic representations with knowledge graph embeddings and logic rules. |
| Outcome: | The proposed model can generalize to unseen relation types and achieve promising improvements. |
A Generative Framework for Personalized Sticker Retrieval (2025.findings-emnlp)
Copied to clipboard
| Challenge: | Existing relevance-based generative retrieval methods lack personalization, leading to a mismatch between diverse user expectations and the retrieved results. |
| Approach: | They propose a representation learning model that learns discriminative user representations to encode user-specific sticker preferences. |
| Outcome: | The proposed framework outperforms state-of-the-art methods in generating relevant stickers for queries. |
QueryLink: Leveraging Query-Memory Alignment for Long-Term Reasoning in LLM Agents (2026.findings-acl)
Copied to clipboard
| Challenge: | Existing approaches to integrating external memory prioritize memory organization while overlooking a critical semantic gap between implicit, intent-driven queries and explicit, narrative-based memories. |
| Approach: | They propose a framework that leverages Query-Memory Alignment to project both queries and memories into a shared semantic space. |
| Outcome: | The proposed framework significantly outperforms SOTA methods on the LoCoMo and LongMemEval benchmarks and can be integrated as a plug-and-play component to boost existing vector-based systems like A-MEM. |
MinosEval: Distinguishing Factoid and Non-Factoid for Tailored Open-Ended QA Evaluation with LLMs (2025.findings-acl)
Copied to clipboard
| Challenge: | Existing evaluation methods overlook the distinction between factoid and non-factoidic questions. |
| Approach: | They propose a method that distinguishes open-ended questions and ranks candidate answers . they propose QA requires longer answer statements and nuanced reasoning processes . |
| Outcome: | The proposed method better aligns with human annotations and offers more interpretable results. |
CapArena: Benchmarking and Analyzing Detailed Image Captioning in the LLM Era (2025.findings-acl)
Copied to clipboard
Kanzhi Cheng, Wenpo Song, Jiaxin Fan, Zheng Ma, Qiushi Sun, Fangzhi Xu, Chenyang Yan, Nuo Chen, Jianbing Zhang, Jiajun Chen
| Challenge: | Image captioning has been a challenge for vision-language researchers for decades . current VLMs focus on tasks like visual question answering (YA) but image captioning is not as advanced as expected. |
| Approach: | They evaluate VLMs' performance on image captioning using human annotations . they find that some metrics show high caption-level agreement with humans . |
| Outcome: | The proposed model outperforms open-source models on image captioning . it achieves 93.4% correlation with human rankings at $4 per test . |
XToM: Exploring the Multilingual Theory of Mind for Large Language Models (2026.acl-long)
Copied to clipboard
Chunkit Chan, Yauwai Yim, Hongchuan Zeng, Zhiying Zou, Xinyuan Cheng, Zhifan Sun, Zheye Deng, Kawai Chung, Yuzhuo Ao, Fan Yixiang, Cheng Jiayang, Ercong Nie, Ginny Wong, Helmut Schmid, Hinrich Schuetze, Simon See, Yangqiu Song
| Challenge: | Existing evaluations of ToM in LLMs are limited to English, neglecting the linguistic diversity that shapes human cognition. |
| Approach: | They propose a multilingual benchmark that evaluates ToM across five languages . they find that models excel in multilingual language understanding, but their ToM performance varies across languages. |
| Outcome: | The proposed benchmark evaluates LLMs across five languages and incorporates diverse task scenarios. |
The Medium Is Not the Message: Deconfounding Document Embeddings via Linear Concept Erasure (2025.emnlp-main)
Copied to clipboard
| Challenge: | Embedding-based similarity metrics can be influenced by content dimensions and spurious attributes like the text’s source or language. |
| Approach: | They propose a debiasing algorithm that removes observed confounders from encoder representations and removes them from the encoder. |
| Outcome: | The proposed method improves on out-of-distribution benchmarks and on benchmarks, but performance is not affected. |
FinReporting: An Agentic Workflow for Localized Reporting of Cross-Jurisdiction Financial Disclosure (2026.acl-demo)
Copied to clipboard
Fan Zhang, Mingzi Song, Rania Elbadry, Yankai Chen, Shaobo Wang, Yixi Zhou, Xunwen Zheng, Yueru He, Yuyang Dai, Georgi Nenkov Georgiev, Ayesha Gull, Muhammad Usman Safder, Fan Wu, Liyuan Meng, Fengxian Ji, Junning Zhao, Xueqing Peng, Jimin Huang, YU Chen, Xue Liu, Preslav Nakov, Zhuohan Xie
| Challenge: | FinReporting is an agentic workflow for localized cross-jurisdiction financial reporting . existing approaches assume a single-market setting and overlook structural differences across jurisdictions . |
| Approach: | They propose a workflow that decomposes financial reporting into auditable stages . they use Large Language Models to extract and summarize corporate disclosures . |
| Outcome: | The proposed system decomposes reporting into auditable stages . it improves consistency and reliability under heterogeneous reporting regimes. |
Structural Supervision for Word Alignment and Machine Translation (2022.findings-acl)
Copied to clipboard
| Challenge: | Existing knowledge on syntactic structure neglects the rich structural information from target tokens and the structural similarity between the source and target sentences. |
| Approach: | They propose to incorporate syntactic structure of both source and target tokens into the encoder-decoder framework, tightly correlating the internal logic of word alignment and machine translation for multi-task learning. |
| Outcome: | The proposed method outperforms baselines on four publicly available language pairs and consistently outperformed baselines in alignment accuracy and translation quality. |
AgentGL: Towards Agentic Graph Learning with LLMs via Reinforcement Learning (2026.acl-long)
Copied to clipboard
| Challenge: | Existing agentic frameworks treat external information as unstructured text and fail to leverage topological dependencies inherent in real-world data. |
| Approach: | They propose to reframe graph learning as an interleaved process of topology-aware navigation and LLM-based inference. |
| Outcome: | The proposed framework outperforms strong GraphLLMs and GraphRAG benchmarks in multiple LLM backbones. |
An LLM-based Framework for Biomedical Terminology Normalization in Social Media via Multi-Agent Collaboration (2025.coling-main)
Copied to clipboard
| Challenge: | Experimental results indicate that our approach exhibits competitive performance. |
| Approach: | They propose a tuning-free approach to normalize non-standard terms using large language models . they use a search engine and a domain knowledge base to expand the short texts into accurate descriptions . |
| Outcome: | The proposed approach is based on the "Recall and Re-rank" framework . it can be used to identify the standard term in a specified termbase for non-standardized mentions . |
AutoSchemaKG: Autonomous Knowledge Graph Construction through Dynamic Schema Induction from Web-Scale Corpora (2026.acl-long)
Copied to clipboard
Jiaxin Bai, Wei Fan, Qi Hu, Qing Zong, Chunyang Li, Hong Ting Tsang, Hongyu Luo, Yauwai Yim, Haoyu Huang, Xiao Zhou, Feng Qin, Tianshi Zheng, Xi Peng, Xin Yao, Huiwen Yang, Leijie Wu, JI Yi, Gong Zhang, Renhai Chen, Yangqiu Song
| Challenge: | Existing knowledge graph construction frameworks require predefined schemas, limiting their scalability and domain coverage. |
| Approach: | They propose a framework for fully autonomous knowledge graph construction that eliminates the need for predefined schemas. |
| Outcome: | The proposed framework outperforms state-of-the-art models on multi-hop QA tasks and enhances LLM factuality. |
Masked Language Models Know Which are Popular: A Simple Ranking Strategy for Commonsense Question Answering (2022.findings-emnlp)
Copied to clipboard
| Challenge: | Empirical results show that pre-trained language models can improve the typical answer generation of GLMs. |
| Approach: | They propose a ranking strategy that exploits WordNet to train a ranker that picks out the most popular answers for commonsense questions. |
| Outcome: | The proposed ranking strategy is tested on a commonsense question answering (QA) dataset and on negative samples from WordNet. |
Bridging by Word: Image Grounded Vocabulary Construction for Visual Captioning (P19-1)
Copied to clipboard
| Challenge: | Existing research on image captioning generates frequent n-grams with irrelevant words. |
| Approach: | They propose to construct an image-grounded vocabulary incorporating visual information and relations among words into the decoding process directly. |
| Outcome: | The proposed framework is compared with state-of-the-art models on MS COCO and Flickr30k and shows that it is more efficient than existing models. |
PlatoLM: Teaching LLMs in Multi-Round Dialogue via a User Simulator (2024.acl-long)
Copied to clipboard
| Challenge: | Recent efforts to democratize ChatGPT have focused on leveraging real user and ChatGPP dialogues, but the most direct human needs are often ignored. |
| Approach: | They propose a method to simulate human behavior better by using real human-like questions extracted from real human conversations as a learning goal and a user simulator called ‘Socratic’. |
| Outcome: | The proposed model achieves SoTA performance among LLaMA-based 7B models in MT-Bench. |
SummaCoz: A Dataset for Improving the Interpretability of Factual Consistency Detection for Summarization (2024.findings-emnlp)
Copied to clipboard
| Challenge: | Summarization is an important application of Large Language Models. |
| Approach: | They integrate human-annotated and model-generated natural language explanations to elucidate how a summary deviates and becomes inconsistent with its source article. |
| Outcome: | The proposed model provides rationales for its judgments and improves its accuracy significantly. |
Empowering Reliable Visual-Centric Instruction Following in MLLMs (2026.findings-acl)
Copied to clipboard
| Challenge: | Existing benchmarks for evaluating instruction-following capabilities focus on verbal instructions in the textual modality. |
| Approach: | They propose to incorporate vision-dependent constraints into instruction design to enable a more rigorous assessment of how well MLLMs align their outputs with both visual input and textual instructions. |
| Outcome: | The proposed benchmark incorporates vision-dependent constraints into instruction design, enabling a more rigorous and fine-grained assessment of how well MLLMs align their outputs with both visual input and textual instructions. |
Learning to Adapt to Low-Resource Paraphrase Generation (2022.emnlp-main)
Copied to clipboard
| Challenge: | Conventional approaches to paraphrase generation often rely on a large number of parallel paraphrases, which require a lot of domain knowledge. |
| Approach: | They propose an adapter for paraphrase generation models optimized by meta-learning to overcome domain shifting problem when training on scarce labeled data. |
| Outcome: | The proposed model achieves state-of-the-art on three benchmark datasets. |
Advancing the Robustness of Large Language Models through Self-Denoised Smoothing (2024.naacl-short)
Copied to clipboard
Jiabao Ji, Bairu Hou, Zhen Zhang, Guanhua Zhang, Wenqi Fan, Qing Li, Yang Zhang, Gaowen Liu, Sijia Liu, Shiyu Chang
| Challenge: | Existing adversarial attacks can cause LLMs to make wrong predictions on downstream tasks or generate harmful content misaligned with human values. |
| Approach: | They propose to use randomized smoothing to add noise to the input and then make predictions based on these denoised versions. |
| Outcome: | The proposed method surpasses existing methods in both empirical and certified robustness in defending against adversarial perturbations for both downstream tasks and human alignments (i.e., jailbreak attacks). |
You Only Query Twice: Multimodal Rumor Detection via Evidential Evaluation from Dual Perspectives (2025.coling-main)
Copied to clipboard
| Challenge: | Existing rumor detectors exhibit limitations in fully exploiting responses to the source tweet as essential public opinions, and in explaining and indicating the reliability of the results obtained. Existing research mainly combats this with content and response-based detection methods. |
| Approach: | They propose a Large Language Model with both multimodal source content and the corresponding response set to extract contrasting evidence to enable maximal utilization of informative responses. |
| Outcome: | The proposed approach can indicate the model’s uncertainty (i.e., reliability) of the results. |
Partial Or Complete, That’s The Question (N19-1)
Copied to clipboard
| Challenge: | Existing annotation schemes aim at acquiring completely annotated structures, but partial annotations can be costly and hinder learning. |
| Approach: | They propose a method to find out that learning from partial structures can sometimes outperform learning from complete ones. |
| Outcome: | The proposed method outperforms existing methods in three different structured learning tasks. |
Pre3: Enabling Deterministic Pushdown Automata for Faster Structured LLM Generation (2025.acl-long)
Copied to clipboard
Junyi Chen, Shihao Bai, Zaijun Wang, Siyu Wu, Chuheng Du, Hailong Yang, Ruihao Gong, Shengzhong Liu, Fan Wu, Guihai Chen
| Challenge: | Existing methods for structured generation of outputs are inefficient under large inference batches. |
| Approach: | They propose a new LLM-based method that parses LR(1) grammars into a pushdown automaton and exploits deterministic pushdown automation to optimize the constrained LLM decoding efficiency. |
| Outcome: | The proposed method improves time per output token (TPOT) by 40% and throughput by 36% . |
AgentRM: Enhancing Agent Generalization with Reward Modeling (2025.acl-long)
Copied to clipboard
Yu Xia, Jingru Fan, Weize Chen, Siyu Yan, Xin Cong, Zhong Zhang, Yaxi Lu, Yankai Lin, Zhiyuan Liu, Maosong Sun
| Challenge: | Existing LLM-based agents have strong performance on held-in tasks, but their generalizability to unseen tasks remains poor. |
| Approach: | They propose a reward-based generalizable reward model to guide the policy model for effective test-time search. |
| Outcome: | The proposed agentRM outperforms existing agents on held-in tasks by 8.8 points on average. |
Interleaved Tool-Call Reasoning for Protein Function Understanding (2026.acl-long)
Copied to clipboard
| Challenge: | Recent advances in large language models have highlighted the effectiveness of chain-of-thought reasoning in symbolic domains such as mathematics and programming. |
| Approach: | They propose a tool-augmented protein reasoning agent that unifies problem decomposition, tool invocation, and grounded answer generation. |
| Outcome: | The proposed protein function understanding agent outperforms text-only reasoning models with an average performance improvement of 103%. |
Scaling Laws for Code: A More Data-Hungry Regime (2026.acl-long)
Copied to clipboard
Xianzhen Luo, Wenzhen Zheng, Qingfu Zhu, Rongyi Zhang, Houyi Li, Siming Huang, YuanTao Fan, Wanxiang Che
| Challenge: | Code Large Language Models (LLMs) are revolutionizing software engineering, but scaling laws are primarily analyzed on Natural Language (NL). |
| Approach: | They fit Chinchilla law and Farsser law to test scaling laws for code . they find code is more data-hungry and requires higher data-to-parameter ratio . |
| Outcome: | The proposed scaling laws show that the more expressive Farsser law offers greater accuracy and scales with model size. |
Fusion-in-T5: Unifying Variant Signals for Simple and Effective Document Ranking with Attention Fusion (2024.lrec-main)
Copied to clipboard
| Challenge: | Current document ranking pipelines involve multiple ranking layers to integrate different information step-by-step. |
| Approach: | They propose a novel re-ranker Fusion-in-T5 which integrates text matching information, ranking features, and global document information into one single unified model via templated-based input and global attention. |
| Outcome: | The proposed model significantly improves ranking performance over complex cascade pipelines. |
Domain-Lifelong Learning for Dialogue State Tracking via Knowledge Preservation Networks (2021.emnlp-main)
Copied to clipboard
Qingbin Liu, Pengfei Cao, Cao Liu, Jiansong Chen, Xunliang Cai, Fan Yang, Shizhu He, Kang Liu, Jun Zhao
| Challenge: | Existing offline DST models require a fixed dataset to train . Existing domain-lifelong learning methods are impractical in real-world applications . |
| Approach: | They propose a domain-lifelong learning method to continuously train a DST model on new data to learn incessantly emerging new domains while avoiding catastrophically forgetting old learned domains. |
| Outcome: | The proposed method outperforms state-of-the-art lifelong learning methods by 4.25% and 8.27% on the MultiWOZ and the SGD benchmarks. |
Leveraging AMR Graph Structure for Better Sequence-to-Sequence AMR Parsing (2024.lrec-main)
Copied to clipboard
| Challenge: | Recent studies on AMR parsing often regard this task as a seq2seq translation problem. |
| Approach: | They propose to translate AMR graphs into AMR token sequences in pre-processing and recover AMR from sequences after decoding. |
| Outcome: | The proposed approach outperforms baseline and achieves 85.5 0.1 and 84.2 0.2 Smatch scores on AMR 2.0 and AMR 3.0. |
Best Practices for Distilling Large Language Models into BERT for Web Search Ranking (2025.coling-industry)
Copied to clipboard
| Challenge: | Recent studies have highlighted the potential of Large Language Models (LLMs) as zero-shot relevance rankers. |
| Approach: | They propose to use a ranking loss to transfer ranking knowledge from LLMs to smaller models like BERT. |
| Outcome: | The proposed model has been successfully integrated into a commercial web search engine as of February 2024. |
Personalized Topic Selection Model for Topic-Grounded Dialogue (2024.findings-acl)
Copied to clipboard
| Challenge: | Existing topic-grounded dialogue systems tend to predict user-uninteresting and contextually irrelevant topics due to noise within side information sources. |
| Approach: | They propose a personalized topic selection model for topic-grounded dialogue that selectively aggregates side information to generate engaging responses. |
| Outcome: | The proposed model outperforms state-of-the-art models on multiple evaluation metrics. |
RecMind: Large Language Model Powered Agent For Recommendation (2024.findings-naacl)
Copied to clipboard
Yancheng Wang, Ziyan Jiang, Zheng Chen, Fan Yang, Yingxue Zhou, Eunah Cho, Xing Fan, Yanbin Lu, Xiaojiang Huang, Yingzhen Yang
| Challenge: | Existing recommendations systems are limited in generalizing to new tasks due to model scale and data size constraints. |
| Approach: | They propose an LLM-powered autonomous recommender agent, RecMind, which is capable of leveraging external knowledge to provide zero-shot personalized recommendations. |
| Outcome: | The proposed model outperforms existing zero/few-shot LLM-based recommendation baseline methods in various tasks and achieves comparable performance to a fully trained recommendation model P5. |
Learning to Speak and Act in a Fantasy Text Adventure Game (D19-1)
Copied to clipboard
Jack Urbanek, Angela Fan, Siddharth Karamcheti, Saachi Jain, Samuel Humeau, Emily Dinan, Tim Rocktäschel, Douwe Kiela, Arthur Szlam, Jason Weston
| Challenge: | Existing studies on grounded dialogue use only statistical regularities of text data, without explicit understanding of the world that the text describes. |
| Approach: | They propose a large-scale crowdsourced text adventure game as a research platform for studying grounded dialogue. |
| Outcome: | The proposed game allows agents to perceive, emote, and act whilst conducting dialogue with other agents. |
Co-DETECT: Collaborative Discovery of Edge Cases in Text Classification (2025.emnlp-demos)
Copied to clipboard
Chenfei Xiong, Jingwei Ni, Yu Fan, Vilém Zouhar, Donya Rooein, Lorena Calvo-Bartolomé, Alexander Miserlis Hoyle, Zhijing Jin, Mrinmaya Sachan, Markus Leippold, Dirk Hovy, Mennatallah El-Assady, Elliott Ash
| Challenge: | Social scientists often need to develop codebooks that can be reliable but require significant human effort. |
| Approach: | They propose a mixed-initiative annotation framework that integrates human expertise with automatic annotation guided by large language models. |
| Outcome: | The proposed framework integrates human expertise with automatic annotation guided by large language models. |
Adapting Offline Speech Translation Models for Streaming with Future-Aware Distillation and Inference (2023.emnlp-main)
Copied to clipboard
| Challenge: | Existing approaches to streaming speech translation use an offline model with a wait-k policy . however, there is a mismatch problem with an offline inference model trained with complete utterances . |
| Approach: | They propose an offline streaming speech translation model with wait-k policy to support different latency requirements. |
| Outcome: | The proposed model achieves better trade-offs between translation quality and latency than baselines. |
ViLL-E: Video LLM Embeddings for Retrieval (2026.acl-long)
Copied to clipboard
| Challenge: | Video Large Language Models excel at video understanding tasks where outputs are textual . however, they underperform specialized embedding-based models in Retrieval tasks . |
| Approach: | They propose a video-LLM-based model with an embedding generation mechanism that allows the model to "think longer" for complex videos and stop early for easy ones. |
| Outcome: | The proposed model outperforms specialized embedding-based models in video understanding tasks while remaining competitive on VideoQA tasks. |
Making Pre-trained Language Models Better Learn Few-Shot Spoken Language Understanding in More Practical Scenarios (2023.findings-acl)
Copied to clipboard
| Challenge: | Existing few-shot Spoken Language Understanding models need to be trained on a set of data-rich source domains and adapt to the target domain with a few examples. |
| Approach: | They propose a scenario where only a pre-trained language model and a few labeled examples are used to train few-shot SLU models. |
| Outcome: | The proposed model outperforms existing models on few-shot settings by reducing the number of slot labels and reducing training complexity. |
Understanding the Cooking Process with English Recipe Text (2023.findings-acl)
Copied to clipboard
| Challenge: | Existing approaches to translate recipes into a flow graph have performance problems . authors propose a framework to construct a graph from recipe text . |
| Approach: | They propose a framework that can be used to translate recipes into a flow graph representation. |
| Outcome: | The proposed framework can predict the edge label and achieve the overall F1 score of 92.2 on the English recipe flow graph corpus. |
Multi-Scale Spectral Selection and Entropy-Guided Uncertainty Fusion for Multimodal Rumor Detection (2026.findings-acl)
Copied to clipboard
| Challenge: | Existing methods for multimodal content detection fail to capture cross-modal semantic inconsistencies and ignore inherent noise in multimodal features. |
| Approach: | They propose a multimodal rumor detection method based on a frequency domain spectral selection method and entropy-guided uncertainty fusion method to capture cross-modal semantic inconsistencies. |
| Outcome: | The proposed method outperforms state-of-the-art methods in multimodal rumor detection . it shows stronger detection capability and robustness on multiple datasets . |
Knowledge as A Bridge: Improving Cross-domain Answer Selection with External Knowledge (C18-1)
Copied to clipboard
| Challenge: | Existing approaches to answer selection are limited in domains with limited labeled data. |
| Approach: | They propose a Knowledge-aware Attentive Network framework for cross-domain answer selection that uses the knowledge base as a bridge to enable knowledge transfer from the source domain to the target domain. |
| Outcome: | The proposed model outperforms strong competitors by a noticeable margin in cross-domain answer selection. |
Language-Specific Layer Matters: Efficient Multilingual Enhancement for Large Vision-Language Models (2025.findings-emnlp)
Copied to clipboard
| Challenge: | Large vision-language models exhibit an imbalance in multilingual capabilities . |
| Approach: | They propose a training recipe that achieves efficient multilingual enhancement for LVLMs by Precise Language Specific layers fine-tuning. |
| Outcome: | The proposed training recipe achieves efficient multilingual enhancement for LVLMs by fine-tuning language specific layers. |
Dissecting Transformer Length Extrapolation via the Lens of Receptive Field Analysis (2023.acl-long)
Copied to clipboard
| Challenge: | Length extrapolation allows training a transformer language model on short sequences that preserves perplexities when tested on substantially longer sequences. |
| Approach: | They propose a relative positional embedding design that uses longer than the training sequence to create sandwich. |
| Outcome: | The proposed model can extrapolate to L ex L tr much better than other models. |
Improving Factual Consistency of News Summarization by Contrastive Preference Optimization (2024.findings-emnlp)
Copied to clipboard
Huawen Feng, Yan Fan, Xiong Liu, Ting-En Lin, Zekun Yao, Yuchuan Wu, Fei Huang, Yongbin Li, Qianli Ma
| Challenge: | Recent advances in news summarization have created problems with “hallucinations” that are factually inconsistent with the source text. |
| Approach: | They propose to disentangle LLMs’ propensities to generate faithful and fake content by adopting a probing-based specific training method to improve their capacity of distinguishing two types of propensity. |
| Outcome: | The proposed method disentangles LLMs’ propensities to generate faithful and fake content and improves their ability to distinguish between two types of propensity. |
Attending Sentences to detect Satirical Fake News (C18-1)
Copied to clipboard
| Challenge: | Existing approaches to capture news satire do not explore sentence and document difference . |
| Approach: | They propose a hierarchical deep neural network approach for satire detection . it is able to capture satirical news both at the sentence level and document level . |
| Outcome: | The proposed approach can capture satire at sentence and document levels. |
FiNE: Filtering and Improving Noisy Data Elaborately with Large Language Models (2025.naacl-long)
Copied to clipboard
| Challenge: | Currently, there are two mainstream methods for improving data integrity: data filtering and data augmentation. |
| Approach: | They propose a method to improve data integrity by combining data filtering and data augmentation with LLMs. |
| Outcome: | The proposed method surpasses the open-source chat version on HalluQA by 8.45 on the open source version. |
Nash-Pruned CredMAS: Dynamic Panel Pruning for VLM-MAS using Nash-based Selection and Doubly-Robust Credits (2026.findings-acl)
Copied to clipboard
| Challenge: | Multi-Agent Systems (MAS) are expensive due to static panel designs, where all N agents communicate at every T round. |
| Approach: | They propose an economic framework that transforms agent selection into a dynamic resource allocation game. |
| Outcome: | The proposed system reduces token consumption by over 25% on challenging benchmarks while reducing token consumption. |
On the Step Length Confounding in LLM Reasoning Data Selection (2026.findings-acl)
Copied to clipboard
Bing Wang, Rui Miao, Chen Shen, Shaotian Yan, Kaiyuan Liu, Ximing Li, Xiaosong Yuan, Sinan Fan, Jun Zhang, Jieping Ye
| Challenge: | Existing pipelines generate long reasoning data from more capable Large Language Models (LLMs) and apply manually heuristic or naturalness-based selection methods to filter high-quality samples. |
| Approach: | They propose to use supervised fine-tuning to generate long reasoning data from more capable Large Language Models and apply manually heuristic or naturalness-based selection methods to filter high-quality samples. |
| Outcome: | Experiments on four LLMs and five evaluation benchmarks show that the proposed approach is effective in mitigating step length confounding problem. |
Somali Information Retrieval Corpus: Bridging the Gap between Query Translation and Dedicated Language Resources (2023.emnlp-main)
Copied to clipboard
| Challenge: | Existing research on the Somali language information retrieval relies on query translation . lack of digital resources is key obstacle to advancing language technologies . |
| Approach: | They develop an annotated corpus for Somali information retrieval using query expansion technique. |
| Outcome: | The proposed corpus comprises 2335 documents collected from well-known online sites . it can be used for text classification-related tasks and question-answering research purposes. |
Transfer Learning for Text Classification via Model Risk Analysis (2024.findings-emnlp)
Copied to clipboard
| Challenge: | Existing approaches to text classification are limited by distribution drift and misprediction risk. |
| Approach: | They propose a model risk analysis approach to adapt a pre-trained DNN model to a new dataset given only a small set of representative data. |
| Outcome: | The proposed model performs considerably better than existing approaches on real datasets. |
Multimodal Language Models See Better When They Look Shallower (2025.emnlp-main)
Copied to clipboard
Haoran Chen, Junyan Lin, Xinghao Chen, Yue Fan, Jianfeng Dong, Xin Jin, Hui Su, Jinlan Fu, Xiaoyu Shen
| Challenge: | Existing studies show that multimodal large language models extract visual features from the final layers of a pretrained Vision Transformer. |
| Approach: | They propose a feature fusion method that strategically incorporates shallower layers . they propose MLLMs that extract visual features from the final layers of a pretrained Vision Transformer . |
| Outcome: | The proposed method outperforms deep layers on fine-grained visual tasks . it is the first comprehensive study of visual layer selection for MLLMs . |
Saber: Efficient Sampling with Adaptive Acceleration and Backtracking Enhanced Remasking for Diffusion Language Model in Code Generation (2026.acl-long)
Copied to clipboard
| Challenge: | Diffusion language models (DLMs) offer advantages in parallel generation and bidirectional context modeling, but they face a critical trade-off between inference speed and output quality for tasks with strict structural constraints such as code generation. |
| Approach: | They propose an efficient sampling algorithm that reduces the number of tokens unmasked per step based on the model’s evolving confidence. |
| Outcome: | The proposed method improves Pass@1 accuracy by 1.9% while achieving 251.4% inference speedup. |
Noisy Self-Training with Synthetic Queries for Dense Retrieval (2023.findings-emnlp)
Copied to clipboard
| Challenge: | Existing neural retrieval models require training on a sufficient number of human-labelled query-passage pairs to work well. |
| Approach: | They propose a noisy self-training framework with synthetic queries to improve retrieval methods. |
| Outcome: | The proposed method outperforms baselines on general-domain and out-of-domain retrieval benchmarks on low-resource settings and is data efficient and data efficient. |
How do Language Models Reshape Entity Alignment? A Survey of LM-Driven EA Methods: Advances, Benchmarks, and Future (2025.emnlp-main)
Copied to clipboard
| Challenge: | Entity alignment (EA) is critical for knowledge graph (KG) integration. |
| Approach: | They propose a taxonomy that categorizes methods in three stages: data preparation, feature embedding, and alignment. |
| Outcome: | The proposed taxonomy categorizes methods in three key stages: data preparation, feature embedding, and alignment. |
ReCode: Reinforcing Code Generation with Reasoning-Process Rewards (2026.acl-long)
Copied to clipboard
| Challenge: | Bringing process-level supervision into RL often neglects optimizing reasoning quality. |
| Approach: | They propose a framework for RL that integrates reasoning-process rewards with strict execution outcomes and a benchmark comprising preference pairs of superior and inferior reasoning processes. |
| Outcome: | The proposed framework outperforms the base version of ReCode by 16.1% and reaches performance comparable to GPT-4-Turbo. |
TranSHER: Translating Knowledge Graph Embedding with Hyper-Ellipsoidal Restriction (2022.emnlp-main)
Copied to clipboard
| Challenge: | Existing knowledge graph embedding methods restrict entities on hyper-ellipsoid surfaces, resulting in suboptimal knowledge graph completion. |
| Approach: | They propose a score function that leverages relation-specific translations between head and tail entities to relax constraints on hyper-ellipsoid surfaces. |
| Outcome: | The proposed method achieves state-of-the-art performance on link prediction and generalizes well to datasets in different domains and scales. |
LoPT: Lossless Parallel Tokenization Acceleration for Long Context Inference of Large Language Model (2026.acl-long)
Copied to clipboard
| Challenge: | Existing parallel tokenization methods suffer from inconsistent results due to boundary artifacts that occur after merging. |
| Approach: | They propose a Lossless Parallel Tokenization framework that ensures output identical to standard sequential tokenization. |
| Outcome: | The proposed method achieves significant speedup while guaranteeing lossless tokenization. |
Training Simultaneous Speech Translation with Robust and Random Wait-k-Tokens Strategy (2023.emnlp-main)
Copied to clipboard
| Challenge: | Simultaneous Speech Translation (SimulST) is a task focused on ensuring high-quality translation of speech in low-latency situations. |
| Approach: | They propose a token-level cross-modal alignment method to improve the translation of text to audio . they use audio transcription pairs to pre-train the encoder and a random wait-k-tokens strategy to optimize the task. |
| Outcome: | The proposed method achieves better trade-off between translation quality and latency. |
Stop Hardening Everything: A Training-Free Neuron-Level Defense for Neural Ranking Models (2026.acl-long)
Copied to clipboard
| Challenge: | Existing defenses for neural ranking models are data-centric and require retraining and adversarial data generation. |
| Approach: | They propose a model-centric defense that addresses vulnerability at its architectural source without costly retraining or adversarial data generation. |
| Outcome: | The proposed approach outperforms state-of-the-art models on MS MARCO and TREC 19 while maintaining strong performance on clean data. |
Efficient Cluster-Based k-Nearest-Neighbor Machine Translation (2022.acl-long)
Copied to clipboard
| Challenge: | k-Nearest-Neighbor Machine Translation (kNN-MT) is a non-parametric solution for domain adaptation . previous studies have shown that kNN retrieval is at the expense of high latency . |
| Approach: | They propose to use clustering to improve retrieval efficiency by combining a non-parametric MT with an in-domain feature-based retrieval module. |
| Outcome: | The proposed method reduces translation latency by 57% while maintaining the most useful information of the original datastore. |
Instruct-of-Reflection: Enhancing Large Language Models Iterative Reflection Capabilities via Dynamic-Meta Instruction (2025.naacl-long)
Copied to clipboard
| Challenge: | Existing approaches involve models iterating and improving their previous responses based on internal reflection ability or external feedback. |
| Approach: | They propose a reflection framework that leverages meta-thoughts and self-consistency to enhance the iterative reflection capability of Large LanguageModels. |
| Outcome: | The proposed framework achieves an average improvement of 10.1% over established baselines in mathematical and commonsense reasoning tasks, highlighting its efficacy and applicability. |
Self-Reinforcing Controllable Synthesis of Rare Relational Data via Bayesian Calibration (2026.findings-acl)
Copied to clipboard
Chongsheng Zhang, Hao Wang, Zelong Yu, Esteban Garces Arias, Julian Rodemann, Zhanshuo Zhang, Qilong Li, Gaojuan Fan, Krikamol Muandet, Christian Heumann
| Challenge: | Existing approaches to synthesis of relational/structured tabular data lack effective feedback mechanism to optimize quality of generated data. |
| Approach: | They propose a relational data generator with dynamic guidance framework that uses chain-of-thought steps to generate tabular data for enhancing downstream imbalanced classification performance. |
| Outcome: | The proposed framework outperforms existing approaches in both data fidelity and downstream imbalanced classification performance on real and synthetic datasets. |
ClimAgent: LLM as Agents for Autonomous Open-ended Climate Science Analysis (2026.findings-acl)
Copied to clipboard
| Challenge: | Existing approaches to climate research are limited to simple Q A tasks . a lack of data and computational expertise has created bottlenecks . |
| Approach: | They propose a general-purpose autonomous framework to perform end-to-end climate research tasks across diverse climate sub-fields. |
| Outcome: | The proposed framework outperforms state-of-the-art benchmarks in rigorousness and practicality. |
Advancing Regular Language Reasoning in Linear Recurrent Neural Networks (2024.naacl-short)
Copied to clipboard
| Challenge: | Existing linear recurrent neural networks have been used for natural language and long-range modeling for decades. |
| Approach: | They propose a linear recurrent neural network with a block-diagonal transition matrix and a transition matrix for LRNNs. |
| Outcome: | The proposed model is the only one capable of performing length extrapolation on regular language tasks such as Sum, Even Pair, and Modular Arithmetic. |
PRompt Optimization in Multi-Step Tasks (PROMST): Integrating Human Feedback and Heuristic-based Sampling (2024.emnlp-main)
Copied to clipboard
| Challenge: | Prompt optimization aims to find the best prompt to a large language model (LLM) for a given task. |
| Approach: | They propose a method to optimize prompts for LLM-driven multi-step tasks using a human-designed feedback rule. |
| Outcome: | The proposed method outperforms human-engineered prompts and several other prompt optimization methods on 11 representative multi-step tasks. |
A Recurrent BERT-based Model for Question Generation (D19-58)
Copied to clipboard
| Challenge: | Existing QG models rely on recurrent neural networks (RNNs) but the inherent sequential nature of the RNN models suffers from the problem of handling long sequences. |
| Approach: | They propose to employ a pre-trained BERT language model to tackle question generation tasks. |
| Outcome: | The proposed model outperforms the existing models on the question-answering dataset SQuAD and advances the BLEU 4 score from 16.85 to 22.17. |
FlowSearch: Advancing Deep Research with Dynamic Structured Knowledge Flow (2026.acl-long)
Copied to clipboard
Yusong Hu, Runmin Ma, Yue Fan, Jinxin Shi, Zongsheng Cao, Yuhao Zhou, Jiakang Yuan, Shuaiyu Zhang, Shiyang Feng, Xiangchao Yan, Shufei Zhang, Wenlong Zhang, Lei Bai, Bo Zhang
| Challenge: | FlowSearch is a multi-agent framework that actively constructs and evolves a dynamic structured knowledge flow to drive subtask execution and reasoning. |
| Approach: | They propose a multi-agent framework that actively constructs and evolves a dynamic structured knowledge flow to drive subtask execution and reasoning. |
| Outcome: | The proposed framework achieves competitive performance on GAIA, HLE, GPQA and TRQA benchmarks and is available to download. |
Boot and Switch: Alternating Distillation for Zero-Shot Dense Retrieval (2023.findings-emnlp)
Copied to clipboard
| Challenge: | Existing approaches to enhance dense retrieval models are unwieldy, such as requiring explicit supervision, complex model architectures, or massive external models. |
| Approach: | They propose an unsupervised method to enhance passage retrieval in zero-shot settings by iterating a loop that a dense retriever learns from supervision signals provided by a reranker. |
| Outcome: | The proposed method outperforms leading supervised and unsupervised retrievers on the BEIR benchmark while showing strong adaptation abilities to tasks and domains that were unseen during training. |
Causal-Debias: Unifying Debiasing in Pretrained Language Models and Fine-tuning via Causal Invariant Learning (2023.acl-long)
Copied to clipboard
| Challenge: | Existing methods to remove unwanted stereotypical associations from pretrained language models (PLMs) are often focused on removing unwanted stereotypes from PLMs. |
| Approach: | They propose a framework to remove unwanted stereotypical associations in pretrained language models . they propose bias-relevant factors are causal, while labelrelevant factors causal . |
| Outcome: | The proposed framework reduces stereotypical associations after PLMs are fine-tuned . the proposed framework mitigates bias from a causal invariant perspective . |
GUI-Bee: Align GUI Action Grounding to Novel Environments via Autonomous Exploration (2025.emnlp-main)
Copied to clipboard
| Challenge: | Recent work of GUI action grounding fine-tunes data from pre-trained MLLMs, but data is limited to specific GUI environments. |
| Approach: | They propose to use a GUI-based agent to collect environment-specific data and fine-tune GUI grounding models with the collected data. |
| Outcome: | The proposed model can be extended to other GUI environments to improve performance. |
Reasoning Model Unlearning: Forgetting Traces, Not Just Answers, While Preserving Reasoning Skills (2025.emnlp-main)
Copied to clipboard
Changsheng Wang, Chongyu Fan, Yihua Zhang, Jinghan Jia, Dennis Wei, Parikshit Ram, Nathalie Baracaldo, Sijia Liu
| Challenge: | Existing methods for LRM unlearning overlook critical information leakage in reasoning traces, even when final answers are successfully removed. |
| Approach: | They propose a method that suppresses reasoning traces while preserving the model's general reasoning ability. |
| Outcome: | The proposed method significantly reduces reasoning trace leakage and achieves strong performance across reasoning and safety benchmarks, including WMDP, StrongReject, JBB-Behaviors and WildJailbreak. |
Chase: A Large-Scale and Pragmatic Chinese Dataset for Cross-Database Context-Dependent Text-to-SQL (2021.acl-long)
Copied to clipboard
| Challenge: | XDTS is a cross-database context-dependent text-to-sql problem with wide range of applications. |
| Approach: | They present a large-scale Chinese dataset for cross-database context-dependent Text-to-SQL . they find that only 35% of questions are context-independent and 28% of SQL queries are easy . |
| Outcome: | The proposed approach achieves an exact match accuracy of 40% over all questions and 16% over all question sequences. |
ReAgent: Reversible Multi-Agent Reasoning for Knowledge-Enhanced Multi-Hop QA (2025.emnlp-main)
Copied to clipboard
Zhao Xinjie, Fan Gao, Xingyu Song, Yingjian Chen, Rui Yang, Yanran Fu, Yuyang Wang, Yusuke Iwasawa, Yutaka Matsuo, Irene Li
| Challenge: | Multi-hop question answering (QA) is a central challenge in natural language processing . early mistakes can cause errors and undermine the final result, authors say . |
| Approach: | They propose a reversible multi-agent reasoning framework that backtracks to earlier valid states when conflicts arise. |
| Outcome: | Empirical evaluation shows that the framework improves on forward-only benchmarks by 6% . the approach enables agents to backtrack to valid states when conflicts arise . |
DSPM-NLG: A Dual Supervised Pre-trained Model for Few-shot Natural Language Generation in Task-oriented Dialogue System (2023.findings-acl)
Copied to clipboard
| Challenge: | Existing models for few-shot natural language generation are based on a dual correlation between NLG and SLU from the perspective of probability. |
| Approach: | They propose a dual supervised pre-trained model to regularize the pre-training process . they use a probabilistic approach to learn the dual correlation between NLG and SLU . |
| Outcome: | The proposed model outperforms the previous state-of-the-art models on a few-shot dataset. |
Which Reasoning Trajectories Teach Students to Reason Better? A Simple Metric of Informative Alignment (2026.acl-long)
Copied to clipboard
Yuming Yang, Mingyoung Lai, Wanxu Zhao, Xiaoran Fan, Zhiheng Xi, Mingqi Wu, Chiyue Huang, Jun Zhao, Haijun Lv, Jian Tong, Yunhua Zhou, Yicheng Zou, Qipeng Guo, Tao Gui, Qi Zhang, Xuanjing Huang
| Challenge: | Existing methods assess suitability primarily through student likelihood, favoring trajectories that align closely with the student model’s current behavior but overlooking more informative ones. |
| Approach: | They propose a Rank–Surprisal Ratio metric that captures both alignment and informativeness to assess the suitability of a reasoning trajectory. |
| Outcome: | The proposed metric captures both alignment and informativeness to assess the suitability of a reasoning trajectory. |
PASTA: Table-Operations Aware Fact Verification via Sentence-Table Cloze Pre-training (2022.emnlp-main)
Copied to clipboard
| Challenge: | Table-based fact verification has attracted a lot of attention recently due to the lack of datasets that can be used to pre-train language models to be aware of common table operations. |
| Approach: | They propose a table-based fact verification tool that pre-trains language models to be aware of common table operations such as aggregating a column or comparing tuples. |
| Outcome: | The proposed method outperforms previous methods on two table-based fact verification datasets TabFact and SEM-TAB- FACTS. |
Learning to Control the Specificity in Neural Response Generation (P18-1)
Copied to clipboard
| Challenge: | Existing generative conversational models tend to favor general and trivial responses which appear frequently. |
| Approach: | They propose a controlled response generation mechanism to handle different utterance-response relationships in terms of specificity. |
| Outcome: | The proposed model outperforms state-of-the-art models under automatic and human evaluations. |
Tackling Long Code Search with Splitting, Encoding, and Aggregating (2024.lrec-main)
Copied to clipboard
| Challenge: | Existing pretraining models take the first 256 tokens of code snippets by default, limiting the input length to 512. |
| Approach: | They propose a baseline SEA model which splits long code into code blocks and aggregates them to obtain a comprehensive long code representation. |
| Outcome: | The proposed model can model long code without changing their internal structure and re-pretraining. |
Instances Need More Care: Rewriting Prompts for Instances with LLMs in the Loop Yields Better Zero-Shot Performance (2024.findings-acl)
Copied to clipboard
| Challenge: | Large language models (LLMs) have revolutionized zero-shot task performance, mitigating the need for task-specific annotations while enhancing task generalizability. |
| Approach: | They propose an approach that optimizes the zero-shot prompts for individual task instances following an innovative manner of "LLMs in the loop" their results show that PRomPTed outperforms naive zero- shot approaches and a strong baseline which refines the task output instead of the input prompt. |
| Outcome: | The proposed approach outperforms naive approaches and a strong baseline which refines the task output instead of the input prompt. |
Dynosaur: A Dynamic Growth Paradigm for Instruction-Tuning Data Curation (2023.emnlp-main)
Copied to clipboard
| Challenge: | Existing methods for instruction tuning do not include associating instructions with existing datasets. |
| Approach: | They propose a dynamic growth paradigm for the automatic curation of instruction-tuning data . they use existing datasets to automatically construct instruction-uning datasets . |
| Outcome: | The proposed model reduces the API cost for generating instructions and provides high-quality data. |
One Agent to Serve All: a Lite-Adaptive Stylized AI Assistant for Millions of Multi-Style Official Accounts (2026.findings-acl)
Copied to clipboard
| Challenge: | Existing methods for prompting in official accounts are computationally prohibitive and lack contextually grounded responses. |
| Approach: | They propose a lite-adaptive framework for stylized contextual question answering that scales to millions of official accounts. |
| Outcome: | The proposed framework can serve large volumes of official accounts with minimal overhead while maintaining stylistic diversity. |
FedMKT: Federated Mutual Knowledge Transfer for Large and Small Language Models (2025.coling-main)
Copied to clipboard
| Challenge: | Recent research in large language models (LLMs) has focused on enabling clients to fine-tune their locally deployed homogeneous LLMs collaboratively or on transferring knowledge from server-based LLM to small language models at downstream clients. |
| Approach: | They propose a parameter-efficient federated mutual knowledge transfer framework for large and small language models that allows for token alignment and selective knowledge transfer between client-side LLMs and a server-side SLM. |
| Outcome: | The proposed framework enhances the performance of both LLMs and SLMs with clients' unique domain insights while preserving the server's LLM and client's unique domain insight. |
Did You Read the Instructions? Rethinking the Effectiveness of Task Definitions in Instruction Learning (2023.acl-long)
Copied to clipboard
| Challenge: | Large language models have shown impressive performance in following natural language instructions to solve unseen tasks. |
| Approach: | They propose two strategies to help large language models better leverage task instructions . they propose to remove 60% of tokens from the task definitions while maintaining model performance . |
| Outcome: | The proposed approach achieves 4.2 Rouge-L improvement over 119 unseen test tasks. |
AutoSUIT Bench - Automated Security UnIt Test Benchmark for LLM Coding (2026.findings-acl)
Copied to clipboard
Samuel Osebe, Fan Yang, Junyi Li, Yue Gu, Yongxin Wang, Satyapriya Krishna, Kai-Wei Chang, Aram Galstyan, Rahul Gupta, Weitong Ruan
| Challenge: | Large Language Models (LLMs) are evolving rapidly on code generation tasks. |
| Approach: | They propose to automate the vulnerability code benchmark creation with iterative auto validation. |
| Outcome: | The proposed benchmark covers 232 CWE categories across C/C++, Java, and Python languages. |
Read Anywhere Pointed: Layout-aware GUI Screen Reading with Tree-of-Lens Grounding (2024.emnlp-main)
Copied to clipboard
| Challenge: | Existing models for GUI understanding ignore a key GUI-referring task: screen reading based on user-indicated points. |
| Approach: | They propose a Tree-of-Lens agent that constructs a Hierarchical Layout Tree based on user input points and a GUI screenshot. |
| Outcome: | The proposed agent can interpret the Screen Point-and-Read task on mobile, web, and operating systems. |
AbsInstruct: Eliciting Abstraction Ability from LLMs through Explanation Tuning with Plausibility Estimation (2024.acl-long)
Copied to clipboard
Zhaowei Wang, Wei Fan, Qing Zong, Hongming Zhang, Sehyun Choi, Tianqing Fang, Xin Liu, Yangqiu Song, Ginny Wong, Simon See
| Challenge: | Existing work shows that LLMs are deficient in abstract ability, and how to improve it remains unexplored. |
| Approach: | They propose a framework AbsInstruct to enhance LLMs’ abstract ability through instruction tuning. |
| Outcome: | The proposed framework can enhance LLMs’ abstraction ability with strong generalization performance while maintaining their general instruction-following abilities. |
HD-PiSSA: High-Rank Distributed Orthogonal Adaptation (2025.emnlp-main)
Copied to clipboard
| Challenge: | Existing methods for large language models constrain update to low-rank subspaces, limiting expressiveness and performance. |
| Approach: | They propose a distributed PEFT approach that initializes adapters across different devices and aggregates their delta updates collectively on (W) Empirically, HD-PiSSA provides 16 higher effective updated ranks than data-parallel LoRA or PiSSA when fine-tuning on 8 GPUs with the same per-device adapter rank. |
| Outcome: | Empirically, HD-PiSSA outperforms LoRA and PiSSA in math, code, and multi-task learning tasks. |
Locate Then Ask: Interpretable Stepwise Reasoning for Multi-hop Question Answering (2022.coling-1)
Copied to clipboard
| Challenge: | Existing methods for multi-hop reasoning ignore grounding on supporting facts of each step, which tends to generate inaccurate decompositions. |
| Approach: | They propose an interpretable stepwise reasoning framework that incorporates supporting sentences and questions at each intermediate step and utilizes the inference of the current hop for the next until reasoning out the final result. |
| Outcome: | The proposed model can boost performance and yield a better interpretable reasoning process without decomposition supervision. |
HAD: HAllucination Detection Language Models Based on a Comprehensive Hallucination Taxonomy (2026.acl-industry)
Copied to clipboard
| Challenge: | relying on large language models for information has raised concerns about reliability and accuracy of outputs. |
| Approach: | They propose a hallucination taxonomy with 11 categories for various NLG tasks and propose HAllucination Detection models which integrate hallucinism detection, span-level identification, and correction into a single inference process. |
| Outcome: | The proposed models outperform baselines on HaluEval, FactCHD, and FaithBench, confirming their robustness and versatility. |
From Data-Centric to Sample-Centric: Enhancing LLM Reasoning via Progressive Optimization (2026.acl-long)
Copied to clipboard
| Challenge: | Reinforcement learning with verifiable rewards (RLVR) has recently advanced the reasoning capabilities of large language models (LLMs). |
| Approach: | They propose a method that incorporates partial solution prefixes from expert demonstrations to guide the policy. |
| Outcome: | The proposed methods outperform strong baselines, yielding faster convergence and a higher performance ceiling. |
LCDS: A Logic-Controlled Discharge Summary Generation System Supporting Source Attribution and Expert Review (2025.acl-demo)
Copied to clipboard
| Challenge: | Large language models (LLMs) are capable of generating inaccurate discharge summary content or fabricating information without valid sources. |
| Approach: | They propose a tool for empowering LLMs with Logic-Controlled Discharge Summary generation. |
| Outcome: | The proposed tool identifies the writing logic of discharge summaries and integrates it with EMRs to generate silver discharge summararies. |
AI Hospital: Benchmarking Large Language Models in a Multi-agent Medical Interaction Simulator (2025.coling-main)
Copied to clipboard
| Challenge: | Recent large language models (LLMs) have demonstrated superior performance in static medical question answering benchmarks, rivaling even human experts. |
| Approach: | They propose a multi-agent framework emulating dynamic medical interactions between Doctor as player and NPCs including Patient and Examiner to assess the performance of LLM-driven Doctor agents in simulated clinical scenarios. |
| Outcome: | The proposed framework emulates dynamic medical interactions between Doctor as player and NPCs including Patient and Examiner. |
Towards Boosting the Open-Domain Chatbot with Human Feedback (2023.acl-long)
Copied to clipboard
| Challenge: | Existing frameworks for pre-training open-domain dialogue models with social media comments generate coherent replies but have difficulties producing engaging responses. |
| Approach: | They propose a framework to boost the open-domain chatbot by leveraging human feedback and annotating the model's candidate responses. |
| Outcome: | The proposed framework boosts the open-domain chatbot by leveraging human demonstrated responses and leveraging the implicit preference in the data collection process. |
PEAP: Proactive Embodied Action Sequence Planning with Joint Understanding of Vision and Audio Perception (2026.acl-long)
Copied to clipboard
| Challenge: | Embodied action sequence planning focuses on the capability of embodied agents to implement action planning via environmental perception without explicit human instructions. |
| Approach: | They propose to use a multimodal dataset to evaluate the performance of multiple large language models to evaluate their models' environmental perception capabilities. |
| Outcome: | The proposed model shows that it lacks accurate environmental perception capabilities and that it can improve on the PEAP dataset. |
Training Verifier to Assessing Complex Real-World Tool-Use Trajectories (2026.findings-acl)
Copied to clipboard
Linzhuang Sun, Mingyang Chen, Hao Liang, Tianpeng Li, Zhou Yijie, Chenzheng Zhu, Tianyu Guo, Huanyao Zhang, Jingxuan Wei, Bihui Yu, Fan Yang, Wentao Zhang
| Challenge: | Existing methods for training effective AI agents often resort to synthetic data generation. |
| Approach: | They propose a plug-and-play framework for data quality control in tool-use scenarios . they construct a tool-verify dataset and release a benchmark to assess its performance . |
| Outcome: | The proposed framework surpasses Qwen2.5-72B-Instruct on Tool-V-Bench and the previous APIGen-MT dataset. |
Explain the Synth: Interpretable Evaluation of LLM Data Synthesis (2026.acl-long)
Copied to clipboard
| Challenge: | Large language models (LLMs) are increasingly used to generate tabular data. |
| Approach: | They propose a framework that uses a rule-based model as a shared explanatory language to examine the explanation of real versus synthetic data. |
| Outcome: | The proposed framework compares the explanatory structure induced by real versus synthetic data. |
Active Listening: Personalized Question Generation in Open-Domain Social Conversation with User Model Based Prompting (2024.findings-emnlp)
Copied to clipboard
| Challenge: | Existing work shows that users of conversational systems want a more personalized experience . Question Generation tasks focus on factual questions from textual excerpts . |
| Approach: | They hypothesize that conversational systems want a more personalized experience . they use large language models capable of casual conversation to generate PQs . |
| Outcome: | The proposed model produces the most natural and engaging responses against competing models. |
Contrastive Instruction Tuning (2024.findings-acl)
Copied to clipboard
| Challenge: | Current LLMs exhibit limited robustness to unseen instructions, generating inconsistent outputs when the same instruction is phrased with slightly varied forms or language styles. |
| Approach: | They propose a method which maximizes the similarity between the hidden representations of semantically equivalent instruction-instance pairs while minimizing the similarities between semantically different ones. |
| Outcome: | Experiments on the PromptBench benchmark show that Contrastive Instruction Tuning improves LLMs’ robustness to unseen instructions with variations across character, word, sentence, and semantic levels by +2.5% in accuracy. |
DAM: Dynamic Attention Mask for Long-Context Large Language Model Inference Acceleration (2025.findings-acl)
Copied to clipboard
| Challenge: | Long-context understanding is crucial for many NLP applications, but transformers struggle with efficiency due to quadratic complexity of self-attention. |
| Approach: | They propose a dynamic sparse attention mechanism that assigns adaptive masks at the attention-map level, preserving heterogeneous attention patterns. |
| Outcome: | The proposed method achieves high alignment with full-attention models while reducing memory and compute overhead. |
CFBench: A Comprehensive Constraints-Following Benchmark for LLMs (2025.acl-long)
Copied to clipboard
Tao Zhang, ChengLIn Zhu, Yanjun Shen, Wenjing Luo, Yan Zhang, Hao Liang, Tao Zhang, Fan Yang, Mingan Lin, Yujing Qiao, Weipeng Chen, Bin Cui, Wentao Zhang, Zenan Zhou
| Challenge: | Existing evaluations of Large Language Models (LLMs) focus on fragmented constraints or narrow scenarios, but they overlook the comprehensiveness and authenticity of constraints from the user’s perspective. |
| Approach: | They propose a Chinese Comprehensive Constraints Following Benchmark for LLMs that compiles constraints from real-world instructions and constructs a systematic framework for constraint types. |
| Outcome: | The proposed framework integrates multi-dimensional assessment criteria with requirement prioritization, covering various perspectives of constraints, instructions, and requirement fulfillment. |
FedProxy: Federated Fine-Tuning of LLMs via Proxy SLMs and Heterogeneity-Aware Fusion (2026.acl-long)
Copied to clipboard
| Challenge: | Existing methods for fine-tuning Large Language Models (LLMs) suffer from a performance bottleneck . Existing approaches like Offsite-Tuning (OT) secure the LLMs IP . |
| Approach: | They propose a framework that replaces weak adapters with a unified, powerful Proxy Small Language Model (SLM) they propose 'resource-friendly' compression and 'robust optimization' to handle data heterogeneity. |
| Outcome: | Experiments show that FedProxy outperforms OT and centralized fine-tuning methods. |
InfiMM-WebMath-40B: Advancing Multimodal Pre-Training for Enhanced Mathematical Reasoning (2025.findings-emnlp)
Copied to clipboard
Xiaotian Han, Yiren Jian, Xuefeng Hu, Haogeng Liu, Yiqi Wang, Qihang Fan, Yuang Ai, Huaibo Huang, Ran He, Zhenheng Yang, Quanzeng You
| Challenge: | InfiMM-WebMath-40B is a dataset of interleaved image-text documents . it consists of 24 million web pages, 85 million image URLs, and 40 billion text tokens . |
| Approach: | InfiMM-WebMath-40B is a high-quality dataset of interleaved image-text documents . it contains 24 million web pages, 85 million image URLs, and 40 billion text tokens . |
| Outcome: | InfiMM-WebMath-40B is a high-quality dataset of interleaved image-text documents . it consists of 24 million web pages, 85 million image URLs, and 40 billion text tokens . |
GrandGuard: Taxonomy, Benchmark, and Safeguards for Elderly-Chatbot Interaction Safety (2026.findings-acl)
Copied to clipboard
Changxuan Fan, Xi Yang, Yueyuan Zheng, Bin Zhou, Yuanping Wang, Wenbin Hu, Huihao Jing, Ki Sen Hung, Dazhao Du, Haoran Li, Janet Hui-wen Hsiao, Yangqiu Song
| Challenge: | a survey of older adults shows that many LLMs mishandle elderly-specific contextual risks. |
| Approach: | They propose a framework to assess elderly-specific contextual risks in LLM interactions . they use a taxonomy to identify 50 fine-grained risk types across mental well-being, financial, medical, toxicity, and privacy domains . |
| Outcome: | a new framework assesses elderly-specific contextual risks in LLM interactions . it achieves 96.2% and 90.9% unsafe-prompt detection accuracy, respectively . |
LegalDrill: Diagnosis-Driven Synthesis for Legal Reasoning in Small Language Models (2026.acl-industry)
Copied to clipboard
Tianchun Li, Haochen Liu, Vishwa Pardeshi, Xingchen Wang, Tianci Liu, Huijun Zhao, Wei Fan, Jing Gao
| Challenge: | Small language models (SLMs) are promising for real-world deployment but struggle with high-stakes legal reasoning tasks. |
| Approach: | They propose a diagnostic-driven synthesis framework that extracts and refines reasoning trajectories from a capable teacher via fine-grained prompting and a self-reflective verification is employed to adaptively select the most effective data for the SLM student. |
| Outcome: | The proposed framework extracts and refines reasoning trajectories from a capable teacher via fine-grained prompting, then a self-reflective verification is employed to adaptively select the most effective data for the student. |
Minimize Exposure Bias of Seq2Seq Models in Joint Entity and Relation Extraction (2020.findings-emnlp)
Copied to clipboard
Ranran Haoran Zhang, Qianying Liu, Aysa Xuemo Fan, Heng Ji, Daojian Zeng, Fei Cheng, Daisuke Kawahara, Sadao Kurohashi
| Challenge: | Existing methods to extract relation triplets from plain text introduce exposure bias . prior work has focused on pipeline methods that ignore intrinsic interactions between subtasks and propagate classification errors through the tasks. |
| Approach: | They propose a model that reduces the decoding length to three within a triplet and removes the order among triplets. |
| Outcome: | The proposed model overfits to both datasets while showing better generalization. |
Evaluation Agent: Efficient and Promptable Evaluation Framework for Visual Generative Models (2025.acl-long)
Copied to clipboard
| Challenge: | Existing evaluation methods rely on rigid pipelines that overlook user needs and provide numerical results without clear explanations. |
| Approach: | They propose an evaluation framework that employs human-like strategies for efficient, dynamic, multi-round evaluations using only a few samples per round. |
| Outcome: | The evaluation agent framework reduces evaluation time to 10% of traditional methods while delivering comparable results. |
Analyzing and Internalizing Complex Policy Documents for LLM Agents (2026.acl-long)
Copied to clipboard
Jiateng Liu, Zhenhailong Wang, Xiaojiang Huang, Yingjie Li, Xiang Li, Chenlei Guo, Xing Fan, Ruhi Sarikaya, Heng Ji
| Challenge: | Large language model agents rely on in-context policy documents to act as effective user assistants. |
| Approach: | They propose an agentic benchmark generator with Controllable Complexity in agent policy across four levels to evaluate agents under increasing complexity. |
| Outcome: | The proposed method outperforms the baseline in data-sparse and high-complexity settings. |
VoxMind: An End-to-End Agentic Spoken Dialogue System (2026.acl-long)
Copied to clipboard
Tianle Liang, Yifu Chen, Shengpeng Ji, Yijun Chen, Zhiyang Jia, Jingyu Lu, Fan Zhuo, Xueyi Pu, Yangzhuo Li, Zhou Zhao
| Challenge: | Existing research on end-to-end spoken dialogue models has focused on core perception and generation, with limited exploration of tool-augmented extensions. |
| Approach: | They propose a framework to equip end-to-end spoken dialogue models with comprehensive agentic abilities by leveraging a 470-hour AgentChat dataset. |
| Outcome: | The proposed framework outperforms Gemini-2.5-Pro on spoken agent tasks while maintaining general conversational quality. |
Response Wide Shut? Surprising Observations in Basic Vision Language Model Capabilities (2025.acl-long)
Copied to clipboard
| Challenge: | Vision-language Models have been shown to be highly capable but lacking basic visual understanding skills. |
| Approach: | They propose to examine the limitations of vision-language models on visual tasks by constructing a series of tests that probe which components of design may be lacking. |
| Outcome: | The proposed tests compare VLMs to other models on visual encoders, intermediate vision-language projection and LLM-decoder outputs. |
TL-Training: A Task-Feature-Based Framework for Training Large Language Models in Tool Use (2025.findings-emnlp)
Copied to clipboard
Junjie Ye, Yilong Wu, Sixian Li, Yuming Yang, Zhiheng Xi, Tao Gui, Qi Zhang, Xuanjing Huang, Peng Wang, Zhongchao Shi, Jianping Fan, Zhengyin Du
| Challenge: | a new approach to training large language models (LLMs) overlooks task-specific characteristics in tool use, leading to performance bottlenecks. |
| Approach: | They propose a task-feature-based framework that mitigates the effects of suboptimal training data . they use a dataset to train large-scale LLMs and a reward mechanism tailored to error categories . |
| Outcome: | The proposed framework matches or surpasses open- and closed-source LLMs in tool-use performance using only 1,217 training data points. |
Cooperative Denoising for Distantly Supervised Relation Extraction (C18-1)
Copied to clipboard
| Challenge: | Existing methods for distantly supervised relation extraction suffer from noisy labeling problem, which can severely degrade its performance. |
| Approach: | They propose a framework for distantly supervised relation extraction that leverages text corpus and knowledge graph and a cooperative module involving their mutual learning. |
| Outcome: | The proposed method reduces the noisy labels and achieves substantial improvement over the state-of-the-art methods. |
A Simple Concatenation can Effectively Improve Speech Translation (2023.acl-short)
Copied to clipboard
| Challenge: | Experimental results show that in our unified cross-modal ST model, models can effectively utilize the auxiliary information from speech and text. |
| Approach: | They propose a unified cross-modal ST method which concatenates speech and text as the input and builds a teacher that can utilize both cross-modities simultaneously. |
| Outcome: | The proposed method can effectively utilize the auxiliary information from speech and text, and achieve compelling results on MuST-C datasets. |
Giving Control Back to Models: Enabling Offensive Language Detection Models to Autonomously Identify and Mitigate Biases (2024.findings-emnlp)
Copied to clipboard
| Challenge: | Existing models often rely on specific words to predict offensive content, compromising model fairness and potentially exacerbates biases against vulnerable and minority groups. |
| Approach: | They propose a bias self-awareness and data self-iteration framework to help models identify and mitigate biases by integrating multiple natural language processing techniques. |
| Outcome: | The proposed framework reduces false positive rate of models in in-distribution and out-of-difference tests, enhances model accuracy and fairness, and shows promising performance improvements on larger datasets. |
MoC: Mixtures of Text Chunking Learners for Retrieval-Augmented Generation System (2025.acl-long)
Copied to clipboard
| Challenge: | Existing methods for text chunking are limited by text chunks and lack of domain-specific knowledge. |
| Approach: | They propose a dual-metric evaluation method to quantify text chunking quality . they aim to generate a structured list of chunking regular expressions . |
| Outcome: | The proposed method enables direct quantification of chunking quality . it substantiates the need to integrate LLMs into chunking process . |
Your LLM Agents are Temporally Blind: The Misalignment Between Tool Use Decisions and Human Time Perception (2026.findings-acl)
Copied to clipboard
Yize Cheng, Arshia Soltani Moakhar, Chenrui Fan, Parsa Hosseini, Kazem Faghih, Zahra Sodagar, Wenxiao Wang, Soheil Feizi
| Challenge: | Large language model agents assume a stationary context, failing to account for real-world time elapsed between messages. |
| Approach: | They construct a dataset of multi-turn user–agent message trajectories across 76 scenarios . they collect human preferences between "calling a tool" and "directly answering" they also examine whether existing models lack human temporal perception . |
| Outcome: | The results show that existing models display poor alignment with human temporal perception . the findings provide insights to foster the development of more time-aware and human-aligned agents. |
MMLU-ProX: A Multilingual Benchmark for Advanced Large Language Model Evaluation (2025.emnlp-main)
Copied to clipboard
Weihao Xuan, Rui Yang, Heli Qi, Qingcheng Zeng, Yunze Xiao, Aosong Feng, Dairui Liu, Yun Xing, Junjue Wang, Fan Gao, Jinghui Lu, Yuang Jiang, Huitao Li, Xin Li, Kunyu Yu, Ruihai Dong, Shangding Gu, Yuekang Li, Xiaofei Xie, Felix Juefei-Xu, Foutse Khomh, Osamu Yoshie, Qingyu Chen, Douglas Teodoro, Nan Liu, Randy Goebel, Lei Ma, Edison Marrese-Taylor, Shijian Lu, Yusuke Iwasawa, Yutaka Matsuo, Irene Li
| Challenge: | Existing large language model evaluation benchmarks focus on English, while current multilingual tasks lack parallel questions that specifically assess cross-lingual reasoning abilities. |
| Approach: | They propose a comprehensive benchmark covering 29 languages, built on an English benchmark. |
| Outcome: | The MMLU-ProX is a comprehensive benchmark covering 29 languages, built on an English benchmark. |
ACCESS : A Benchmark for Abstract Causal Event Discovery and Reasoning (2025.naacl-long)
Copied to clipboard
Vy Vo, Lizhen Qu, Tao Feng, Yuncheng Hua, Xiaoxi Kang, Songhai Fan, Tim Dwyer, Lay-Ki Soon, Gholamreza Haffari
| Challenge: | Existing methods for identifying event causality in NLP are limited in their scale and rely on lexical cues. |
| Approach: | They propose a benchmark for identifying abstract causality from a large-scale dataset. |
| Outcome: | The proposed benchmark can be leveraged for enhancing QA reasoning performance in LLMs. |
MAPO: Boosting Large Language Model Performance with Model-Adaptive Prompt Optimization (2023.findings-emnlp)
Copied to clipboard
Yuyan Chen, Zhihao Wen, Ge Fan, Zhengyu Chen, Wei Wu, Dayiheng Liu, Zhixu Li, Bang Liu, Yanghua Xiao
| Challenge: | Existing research emphasizes the importance of adapting prompts to specific tasks, rather than specific LLMs. |
| Approach: | They propose a model-adaptive prompt optimizer method that optimizes original prompts for each LLM in downstream tasks. |
| Outcome: | The proposed method can optimize prompts for an LLM in downstream tasks. |
FRVA: Fact-Retrieval and Verification Augmented Entailment Tree Generation for Explainable Question Answering (2024.findings-acl)
Copied to clipboard
| Challenge: | Existing methods for generating a entailment tree exhibit the reasoning chains from knowledge facts to predicted answers, but they have large fact search spaces and error accumulation problems resulting in the generation of invalid steps. |
| Approach: | They propose a Fact-Retrieval and Verification Augmented bidirectional entailment tree generation method that contains two systems. |
| Outcome: | The proposed method outperforms existing models and achieves state-of-the-art performance in fact selection and structural correctness. |
DP-GTR: Differentially Private Prompt Protection via Group Text Rewriting (2025.findings-emnlp)
Copied to clipboard
| Challenge: | Existing methods for prompt privacy focus on document-level rewriting, neglecting rich, multi-granular representations of text. |
| Approach: | a framework that leverages local differential privacy and composition theorem via group text rewriting is proposed . the framework is compatible with existing rewrite techniques and is publicly available at anonymous.4open.science for reproducibility. |
| Outcome: | DP-GTR is the first framework to integrate document-level and word-level information while exploiting in-context learning to improve privacy and utility. |
Enhancing Hyperbolic Knowledge Graph Embeddings via Lorentz Transformations (2024.findings-acl)
Copied to clipboard
| Challenge: | Existing methods for knowledge graph embedding rely on tangent approximation and are not fully hyperbolic. |
| Approach: | They propose a fully hyperbolic KGE method that represents entities as points in the Lorentz model and represents relations as the intrinsic transformation. |
| Outcome: | The proposed method captures various types of relations including hierarchical structures. |
Few-Shot Anaphora Resolution in Scientific Protocols via Mixtures of In-Context Experts (2022.findings-emnlp)
Copied to clipboard
| Challenge: | In-context learning has emerged as a promising approach to resolve anaphora, but there are challenges in applying it to scientific protocols. |
| Approach: | They propose a method which combines predictions of hundreds of in-context experts and combines them to yield a 30% increase in F1 over a competitive prompt retrieval baseline. |
| Outcome: | The proposed method yields 30% increase in F1 score over a competitive prompt retrieval baseline. |
MERIT: Multi-Agent Collaboration for Unsupervised Time Series Representation Learning (2025.findings-acl)
Copied to clipboard
| Challenge: | Existing approaches to time series representation learning are time-consuming and expert-dependent, which are difficult to generalize across different tasks. |
| Approach: | They propose to use large language model agent to guide unsupervised time series representation learning and a framework to integrate three LLM agents to collaboratively generate positive views for time series data. |
| Outcome: | The proposed framework integrates large language model (LLM) agent to guide unsupervised time series representation learning and compares it with state-of-the-art baselines on multiple time series datasets. |
Augmenting Large Language Model Translators via Translation Memories (2023.findings-acl)
Copied to clipboard
Yongyu Mu, Abudurexiti Reheman, Zhiquan Cao, Yuchun Fan, Bei Li, Yinqiao Li, Tong Xiao, Chunliang Zhang, Jingbo Zhu
| Challenge: | Using translation memories (TMs) as prompts is a promising approach to in-context learning of machine translation models. |
| Approach: | They propose to use translation memories (TMs) as prompts to prompt large language models (LLMs) they find that the ability of LLMs to "understand" prompts is helpful . |
| Outcome: | The results are comparable to state-of-the-art NMT systems with bilingual data and are tuned on downstream tasks. |
Semantic-Space Exploration and Exploitation in RLVR for LLM Reasoning (2026.findings-acl)
Copied to clipboard
Fanding Huang, Guanbo Huang, Xiao Fan, Yi He, Xiao Liang, Xiao Chen, Qinting Jiang, Faisal Nadeem Khan, Jingyan Jiang, Zhi Wang
| Challenge: | Recent advances in Reinforcement Learning with Verifiable Rewards (RLVR) have substantially improved the reasoning abilities of Large Language Models (LLMs). |
| Approach: | They propose a method that balances exploration and exploitation in the hidden-state space of response trajectories. |
| Outcome: | The proposed model yields consistent improvements across models, algorithms and reasoning benchmarks. |
XGLUE: A New Benchmark Dataset for Cross-lingual Pre-training, Understanding and Generation (2020.emnlp-main)
Copied to clipboard
Yaobo Liang, Nan Duan, Yeyun Gong, Ning Wu, Fenfei Guo, Weizhen Qi, Ming Gong, Linjun Shou, Daxin Jiang, Guihong Cao, Xiaodong Fan, Ruofei Zhang, Rahul Agrawal, Edward Cui, Sining Wei, Taroon Bharti, Ying Qiao, Jiun-Hung Chen, Winnie Wu, Shuguang Liu, Fan Yang, Daniel Campos, Rangan Majumder, Ming Zhou
| Challenge: | XGLUE provides a benchmark dataset to train large-scale cross-lingual pre-trained models . XCLUE provides 11 diversified tasks that cover both understanding and generation scenarios . |
| Approach: | They introduce a new benchmark dataset to train large-scale cross-lingual pre-trained models using multilingual and bilingual corpora. |
| Outcome: | The proposed dataset is labeled in English and includes only natural language understanding tasks. |
An Enhanced Knowledge Injection Model for Commonsense Generation (2020.coling-main)
Copied to clipboard
Zhihao Fan, Yeyun Gong, Zhongyu Wei, Siyuan Wang, Yameng Huang, Jian Jiao, Xuanjing Huang, Nan Duan, Ruofei Zhang
| Challenge: | a recent study shows that digging the relationship of concepts from scratch is non-trivial for commonsense generation tasks. |
| Approach: | They use a retrieve-and-edit framework to retrieve a prototype with these concepts . they use qt and qq to generate commonsense questions at scale . |
| Outcome: | The proposed method significantly improves the performance on commonsense generation tasks. |
ToolEyes: Fine-Grained Evaluation for Tool Learning Capabilities of Large Language Models in Real-world Scenarios (2025.coling-main)
Copied to clipboard
Junjie Ye, Guanyu Li, SongYang Gao, Caishuang Huang, Yilong Wu, Sixian Li, Xiaoran Fan, Shihan Dou, Tao Ji, Qi Zhang, Tao Gui, Xuanjing Huang
| Challenge: | Existing evaluations of tool learning focus on validation of tools for large language models with expected outcomes, but this focus ignores the complex capabilities required for LLMs to effectively use tools. |
| Approach: | They propose a fine-grained system for evaluation of large language models’ tool learning capabilities in authentic scenarios. |
| Outcome: | The proposed system examines seven real-world scenarios, analyzing five dimensions crucial to LLMs in tool learning: format alignment, intent comprehension, behavior planning, tool selection, and answer organization. |
Don’t Mess with Mister-in-Between: Improved Negative Search for Knowledge Graph Completion (2023.eacl-main)
Copied to clipboard
| Challenge: | Existing methods for knowledge graph completion use a dual-encoding framework with a bottleneck that allows for fast approximate search over a vast collection of candidates. |
| Approach: | They propose to use a dual-encoder framework to find more informative negatives by searching for candidates with high lexical overlaps. |
| Outcome: | The proposed methods improve on the large-scale Wikidata5M dataset and combine different kinds of strategies to achieve state-of-the-art performance. |
STINMatch: Semi-Supervised Semantic-Topological Iteration Network for Financial Risk Detection via News Label Diffusion (2023.emnlp-main)
Copied to clipboard
Xurui Li, Yue Qin, Rui Zhu, Tianqianjin Lin, Yongming Fan, Yangyang Kang, Kaisong Song, Fubang Zhao, Changlong Sun, Haixu Tang, Xiaozhong Liu
| Challenge: | Commercial news provides rich semantics and timely information for automated financial risk detection. |
| Approach: | They propose a semi-supervised Semantic-Topological Iteration Network, STINMatch, along with a news-enterprise knowledge graph to endorse the risk detection enhancement. |
| Outcome: | The proposed model outperforms existing models in terms of generalization and semantics and annotation. |
MiniRAG: A Lightweight RAG system with Small Language Models (2026.acl-long)
Copied to clipboard
| Challenge: | Existing RAG frameworks rely on Large Language Models (LLMs) for all stages of the process, resulting in high computational costs and resource demands. |
| Approach: | They propose a semantic-aware heterogeneous graph indexing mechanism that combines text chunks and named entities in a unified structure and a lightweight topology-enhanced retrieval approach that leverages graph structures for efficient knowledge discovery without requiring advanced language capabilities. |
| Outcome: | The proposed system achieves comparable performance to LLM-based methods while requiring only 25% of the storage space. |
Activating Distributed Visual Region within LLMs for Efficient and Effective Vision-Language Training and Inference (2025.acl-long)
Copied to clipboard
| Challenge: | Existing Large Vision-Language Models (LVLMs) learn visual capacity through visual instruction tuning. |
| Approach: | They propose a method for LVLMs to be trained by selective layers tuning . they propose removing non-critical layers outside the visual region . |
| Outcome: | The proposed approach preserves nearly 99% of visual performance and improves textual task results while reducing training time. |
Revisiting Machine Translation for Cross-lingual Classification (2023.emnlp-main)
Copied to clipboard
| Challenge: | Recent work in cross-lingual learning has pivoted around multilingual models, which are typically pretrained on unlabeled corpora in multiple languages using some form of language modeling objective. |
| Approach: | They propose to use a stronger machine translation system to mitigat mismatch between training on original text and running inference on machine translated text. |
| Outcome: | The proposed approach is highly task dependent and calls into question the dominance of multilingual models for cross-lingual classification. |
Visual Named Entity Linking: A New Dataset and A Baseline (2022.findings-emnlp)
Copied to clipboard
| Challenge: | Existing tasks in Visual Entity Linking (VEL) rely on textual data to complement multi-modal linking or only link objects with general entities. |
| Approach: | They propose a task to link regions of images with corresponding entities in Knowledge Bases . they propose three sub-tasks, based on a human-annotated visual person dataset . |
| Outcome: | The proposed task is based on a human-annotated visual person linking dataset . the proposed sub-tasks are validated on the WIKIPerson dataset based upon the proposed methods . |
KiPT: Knowledge-injected Prompt Tuning for Event Detection (2022.coling-1)
Copied to clipboard
| Challenge: | Existing prompt-based methods may suffer from low precision because they lack event-related semantic knowledge. |
| Approach: | They propose a Knowledge-injected Prompt Tuning model to improve prompt tuning . event detection aims to detect events from text by identifying and classifying event triggers . |
| Outcome: | The proposed model outperforms baseline models in few-shot scenarios. |
Few-Shot Semantic Dependency Parsing via Graph Contrastive Learning (2024.lrec-main)
Copied to clipboard
| Challenge: | Existing graph neural networks (GNNs) have shown promising performance on semantic dependency parsing (SDP) training a high-performing model requires a large amount of labeled data and it is prone to over-fitting in the absence of sufficient labele . |
| Approach: | They propose a syntax-guided graph contrastive learning framework to train GNNs with unlabeled data and fine-tune pre-trained GNN models with few-shot labeled SDP data. |
| Outcome: | The proposed framework achieves promising results when few-shot training samples are available. |
Self-Critique Guided Iterative Reasoning for Multi-hop Question Answering (2025.findings-acl)
Copied to clipboard
Zheng Chu, Huiming Fan, Jingchang Chen, Qianyu Wang, Mingda Yang, Jiafeng Liang, Zhongjie Wang, Hao Li, Guo Tang, Ming Liu, Bing Qin
| Challenge: | Large language models (LLMs) have demonstrated remarkable reasoning capabilities, but they still face challenges in knowledge-intensive multi-hop reasoning. |
| Approach: | They propose a method that uses self-critique feedback to guide iterative reasoning by enabling iteration and self-evaluation of its intermediate reasoning steps. |
| Outcome: | The proposed method surpasses the previous SOTA by 8.6% on three multi-hop reasoning datasets. |
Manifold Adversarial Augmentation for Neural Machine Translation (2021.findings-acl)
Copied to clipboard
| Challenge: | Recent studies show that NMT models can drop significantly when small perturbations are added to input sentences. |
| Approach: | They propose a data augmentation approach to sample sentences from the vicinity distributions in higher-level representations. |
| Outcome: | The proposed method improves translation accuracy on training samples from higher-level representations. |
A Meta-framework for Spatiotemporal Quantity Extraction from Text (2022.acl-long)
Copied to clipboard
| Challenge: | a meta-framework for news events that extracts quantities from text is proposed . a previous work on news events focused on extracting event mentions, attributes, and relationships . |
| Approach: | They propose a meta-framework for solving the NLP problem of spatiotemporal quantity extraction . they demonstrate the framework is general and extensible, and shareable crowdsourcing pipeline and baseline models are used . |
| Outcome: | The proposed framework is general and extensible, the authors say . it can extract quantity from news streams, quickly respond to emergencies, investigate incidents . |
SynKB: Semantic Search for Synthetic Procedures (2022.emnlp-demos)
Copied to clipboard
| Challenge: | SynKB is an open-source, automatically extracted knowledge base of chemical synthesis protocols. |
| Approach: | They propose to make SynKB available as an open-source tool for chemists . synKB supports more flexible queries about reaction conditions . |
| Outcome: | The proposed open-source tool has higher recall and high precision than proprietary chemistry databases. |
Paraphrase Generation as Unsupervised Machine Translation (2022.coling-1)
Copied to clipboard
| Challenge: | Existing methods for paraphrase generation rely on labeled datasets or are limited in narrow domains. |
| Approach: | They propose a paradigm for paraphrase generation by treating the task as unsupervised machine translation based on pairs of unlabeled monolingual sentences. |
| Outcome: | The proposed paradigm can generate paraphrases on a large unlabeled monolingual corpus without relying on bilingual sentence pairs. |
On the Intractability to Synthesize Factual Inconsistencies in Summarization (2024.findings-eacl)
Copied to clipboard
| Challenge: | Existing methods for detecting factual inconsistencies in abstractive summarization are lacking in factual consistency detection. |
| Approach: | They propose to use real model-generated summaries with human annotations to detect factual inconsistencies. |
| Outcome: | The proposed model outperforms the SOTA on CoGenSumm, FactCC, Frank, and SummEval datasets. |
TLUE: A Tibetan Language Understanding Evaluation Benchmark (2025.emnlp-main)
Copied to clipboard
Fan Gao, Cheng Huang, Yutong Liu, Nyima Tashi, Xiangxiang Wang, Thupten Tsering, Ban Ma-bao, Renzeng Duojie, Gadeng Luosang, Rinchen Dongrub, Dorje Tashi, Xiao Feng Cd, Yongbin Yu, Hao Wang
| Challenge: | Low-resource languages, like Tibetan, remain underrepresented in large language models' evaluations. |
| Approach: | They propose a Tibetan Language Understanding Evaluation Benchmark to assess LLMs' proficiency in Tibetan . they use a multi-task understanding benchmark and a safety benchmark to evaluate models . |
| Outcome: | The proposed benchmark shows that most large language models perform below the random baseline, especially in Tibetan language processing. |
MedEureka: A Medical Domain Benchmark for Multi-Granularity and Multi-Data-Type Embedding-Based Retrieval (2025.findings-naacl)
Copied to clipboard
| Challenge: | Embedding-based retrieval (EBR) is a mainstream approach in information retrieval. |
| Approach: | They propose an enriched benchmark to evaluate retrieval capabilities of embedding models . they use four levels of granularity and six types of medical texts to prompt instruction-fine-tuned embeddable models. |
| Outcome: | The proposed benchmark evaluates the retrieval capabilities of embedding models with multi-granularity and multi-data types. |
Well Begun is Half Done: Low-resource Preference Alignment by Weak-to-Strong Decoding (2025.findings-acl)
Copied to clipboard
| Challenge: | Low-resource methods for LLM alignment have been popular, but still face challenges in obtaining high-quality and aligned content. |
| Approach: | They propose a framework to enhance alignment ability of base models by the guidance of a small aligned model. |
| Outcome: | The proposed framework outperforms baseline methods while avoiding degradation on downstream tasks. |
Business as Rulesual: A Benchmark and Framework for Business Rule Flow Modeling with LLMs (2026.acl-long)
Copied to clipboard
| Challenge: | Existing benchmarks for extracting structured procedural knowledge from unstructured business documents are limited by simplistic schemas and shallow logical dependencies. |
| Approach: | They propose a framework for extracting structured procedural knowledge from unstructured business documents . they propose BREX, a carefully curated benchmark comprising 409 real-world business documents and 2,855 expert-annotated rules . |
| Outcome: | The proposed framework outperforms standard prompts in rule extraction and execution. |
Entity Tracking via Effective Use of Multi-Task Learning Model and Mention-guided Decoding (2023.eacl-main)
Copied to clipboard
| Challenge: | State-of-the-art entity tracking approaches either design complicated model architectures or rely on task-specific pre-training to achieve good results. |
| Approach: | They propose a multi-task learning-enabled entity tracking approach that utilizes knowledge gained from general domain tasks to improve entity tracking. |
| Outcome: | The proposed approach achieves state-of-the-art on two popular entity tracking datasets, even though it does not require any task-specific architecture design or pre-training. |
KILT: a Benchmark for Knowledge Intensive Language Tasks (2021.naacl-main)
Copied to clipboard
Fabio Petroni, Aleksandra Piktus, Angela Fan, Patrick Lewis, Majid Yazdani, Nicola De Cao, James Thorne, Yacine Jernite, Vladimir Karpukhin, Jean Maillard, Vassilis Plachouras, Tim Rocktäschel, Sebastian Riedel
| Challenge: | Existing models for knowledge-intensive language tasks require access to large, external knowledge sources. |
| Approach: | They propose a benchmark for knowledge-intensive language tasks (KILT) they test a shared dense vector index coupled with a seq2seq model to generate disambiguated text. |
| Outcome: | The proposed model outperforms tailor-made approaches on fact checking, open-domain question answering and dialog by generating disambiguated text. |
Improving Dialogue Discourse Parsing via Reply-to Structures of Addressee Recognition (2023.emnlp-main)
Copied to clipboard
| Challenge: | Existing approaches to learn dialogue discourse parsing with related tasks require additional annotation, thus limiting their generality. |
| Approach: | They propose a multitasking framework that integrates dialogue discourse parsing with addressee recognition to reflect relation-based structure of dialogue. |
| Outcome: | The proposed framework outperforms baselines on the Molweni and STAC datasets. |
MUSIED: A Benchmark for Event Detection from Multi-Source Heterogeneous Informal Texts (2022.emnlp-main)
Copied to clipboard
| Challenge: | Recent efforts to classify unstructured texts into specific types have been limited in practical scenarios. |
| Approach: | They propose to use Chinese text conversations and phone conversations to expand event detection to the scenarios involving informal and heterogeneous texts. |
| Outcome: | The proposed dataset is based on user reviews, text conversations, and phone conversations in a leading e-commerce platform for food service. |
CCG: Rare-Label Prediction via Neural SEM–Driven Causal Game (2025.findings-emnlp)
Copied to clipboard
| Challenge: | Multi-label classification (MLC) faces persistent challenges from label imbalance, spurious correlations, distribution shifts, especially in rare label prediction. |
| Approach: | They propose a Causal Cooperative Game framework that models multi-player cooperative process for multi-label classification. |
| Outcome: | The proposed framework improves rare label prediction and overall robustness compared to baselines. |
Consistent Discourse-level Temporal Relation Extraction Using Large Language Models (2025.findings-emnlp)
Copied to clipboard
| Challenge: | Recent advances in large language models (LLMs) have spurred research on temporal relation extraction tasks. |
| Approach: | They propose a framework to improve LLMs’ temporal relation extraction capabilities using context selection, prompts inspired by Allen’s interval algebra and reflection-based consistency learning. |
| Outcome: | The proposed framework improves LLMs’ extraction capabilities by focusing on context selection, prompts inspired by Allen’s interval algebra and reflection-based consistency learning. |
Effective Long-Context Scaling of Foundation Models (2024.naacl-long)
Copied to clipboard
Wenhan Xiong, Jingyu Liu, Igor Molybog, Hejia Zhang, Prajjwal Bhargava, Rui Hou, Louis Martin, Rashi Rungta, Karthik Abinav Sankararaman, Barlas Oguz, Madian Khabsa, Han Fang, Yashar Mehdad, Sharan Narang, Kshitiz Malik, Angela Fan, Shruti Bhosale, Sergey Edunov, Mike Lewis, Sinong Wang, Hao Ma
| Challenge: | Large language models (LLMs) are rapidly deployed and continue to evolve through scaling. |
| Approach: | They propose a method to train strong long-context LLMs that are capable of utilizing massive context windows of up to 32,000 tokens. |
| Outcome: | The proposed model can surpass gpt-3.5-turbo-16k's overall performance on long-context benchmarks with a cost-effective instruction tuning procedure that is free of expensive annotations. |
Bootstrapped Pre-training with Dynamic Identifier Prediction for Generative Retrieval (2024.findings-acl)
Copied to clipboard
| Challenge: | Existing methods for document retrieval rely on static document identifiers . experimental results show that generative retrieval is outperforms dense retrieval in document retrievals. |
| Approach: | They propose a bootstrapped pre-training method that dynamically adjusts document identifiers during pre-train to accommodate the continuing memorization of the corpus. |
| Outcome: | The proposed method significantly outperforms existing pre-training generative retrieval baselines and performs well even in zero-shot settings. |
BiasGuard: A Reasoning-Enhanced Bias Detection Tool for Large Language Models (2025.findings-acl)
Copied to clipboard
| Challenge: | Existing methods for identifying bias in LLM-generated content face limitations . existing methods rely on pattern-based learning, which makes it challenging to understand intentions . |
| Approach: | They propose a bias detection tool that explicitly analyzes inputs and reasons through fairness specifications to provide accurate judgments. |
| Outcome: | The proposed tool outperforms existing tools and improves accuracy and reduces over-fairness misjudgments. |
Enhancing Chain-of-Thought Reasoning with Critical Representation Fine-tuning (2025.acl-long)
Copied to clipboard
Chenxi Huang, Shaotian Yan, Liang Xie, Binbin Lin, Sinan Fan, Yue Xin, Deng Cai, Chen Shen, Jieping Ye
| Challenge: | Representation Fine-tuning (ReFT) is a proposed method for improving parameter efficiency . however, it yields suboptimal performance, as fixed-position representations have uncertain impact on outputs . |
| Approach: | They propose a method that fine-tunes critical representations in a low-rank linear subspace while freezing the base model. |
| Outcome: | The proposed method improves accuracy of LLaMA-2-7B and ReFT by 18.2 and 3.8 on GSM8K. |
KCL: Few-shot Named Entity Recognition with Knowledge Graph and Contrastive Learning (2024.lrec-main)
Copied to clipboard
| Challenge: | Named Entity Recognition (NER) is a key subtask in natural language processing but is limited to a few labeled samples. |
| Approach: | They propose a few-shot method that harnesses the power of Knowledge Graph and Contrastive Learning to improve the prototypical semantic space learning. |
| Outcome: | The proposed method improves the prototypical semantic space learning by using knowledge graphs and contrastive learning to learn the label semantic representation. |
HS-GC: Holistic Semantic Embedding and Global Contrast for Effective Text Clustering (2024.lrec-main)
Copied to clipboard
| Challenge: | In this paper, we introduce Holistic Semantic Embedding and Global Contrast (HS-GC) to learn the instance- and cluster-level representations. |
| Approach: | They propose a novel loss function that exploits different layers of semantic information in a deep neural network to provide a more holistic semantic text representation. |
| Outcome: | The proposed model outperforms the state-of-the-art model on five text datasets and improves clustering accuracy of 5.9% and 3.2% on the StackOverflow and TREC datasets. |
Exploratory Neural Relation Classification for Domain Knowledge Acquisition (C18-1)
Copied to clipboard
| Challenge: | Existing methods for relation classification are limited and lack of low-frequency relations in specific domains. |
| Approach: | They propose a method to learn a classifier on pre-defined relations and discover new relations expressed in texts. |
| Outcome: | The proposed method can classify entities into a finite set of relations and discover relations with high precision and recall. |
A Knowledge Regularized Hierarchical Approach for Emotion Cause Analysis (D19-1)
Copied to clipboard
| Challenge: | Emotion cause analysis aims to identify the reasons behind emotions . previous models focus on learning architecture with local textual information . |
| Approach: | They propose a method to extract emotion cause with hierarchical neural model and knowledge-based regularizations by sentiment lexicon and common knowledge. |
| Outcome: | The proposed method outperforms baselines on two public datasets in different languages and outperformed competitive baselines by 2.08%. |
Lightweight LLM Agent Memory with Small Language Models (2026.acl-long)
Copied to clipboard
Jiaquan Zhang, Chaoning Zhang, Shuxu Chen, Zhenzhen Huang, Pengcheng Zheng, Zhicheng Wang, Ping Guo, Fan Mo, Sung-Ho Bae, Jie Zou, Jiwei Wei, Yang Yang
| Challenge: | Existing external memory systems for LLMs have low online overhead but are unstable in accumulating latency over long interactions. |
| Approach: | They propose a lightweight memory system for better agent memory driven by Small Language Models . lightmem modularizes memory retrieval, writing, and long-term consolidation . they show consistent gains across model scales and high efficiency . |
| Outcome: | The proposed system improves agent memory but has low latency and low online overhead . it separates online processing from offline consolidation to enable efficient memory invocation . the proposed system achieves an average F1 improvement of 2.5 over A-MEM on LoCoMo . |
Mathematical Proof as a Litmus Test: Revealing Failure Modes of Advanced Large Reasoning Models (2026.acl-long)
Copied to clipboard
| Challenge: | Large reasoning models have demonstrated remarkable mathematical problem-solving abilities, but their true reasoning shortcomings are often hidden. |
| Approach: | They propose to leverage the rigor and methodological complexity of mathematical proofs as a diagnostic tool to expose hidden failures. |
| Outcome: | The proposed model evaluation exploits the rigor and complexity of proof problems to uncover 10 fine-grained errors. |
DeTriever: Decoder-representation-based Retriever for Improving NL2SQL In-Context Learning (2025.coling-main)
Copied to clipboard
Raymond Li, Yuxi Feng, Zhenan Fan, Giuseppe Carenini, Weiwei Zhang, Mohammadreza Pourreza, Yong Zhang
| Challenge: | In-context Learning (ICL) has proven to be effective in a variety of complex tasks, but the selection of the most beneficial demonstration examples remains an open research problem. |
| Approach: | They propose a demonstration retrieval framework that learns a weighted combination of LLM hidden states where rich semantic information is encoded. |
| Outcome: | Experiments on two popular NL2SQL benchmarks show that the proposed method outperforms state-of-the-art models. |
RoTBench: A Multi-Level Benchmark for Evaluating the Robustness of Large Language Models in Tool Learning (2024.emnlp-main)
Copied to clipboard
Junjie Ye, Yilong Wu, Songyang Gao, Caishuang Huang, Sixian Li, Guanyu Li, Xiaoran Fan, Qi Zhang, Tao Gui, Xuanjing Huang
| Challenge: | Current research emphasizes LLMs’ capacity to utilize tools in well-structured environments while overlooking their stability when confronted with the inevitable noise of the real world. |
| Approach: | They propose a multi-level benchmark to evaluate the robustness of large language models in tool learning by establishing five external environments with varying levels of noise. |
| Outcome: | The proposed model outperforms the GPT-4 model in tool learning in three critical phases: tool selection, parameter identification, and content filling. |
Feeling Rules in Language Models: Mapping Norms of Emotional Appropriateness Across Roles, Institutions, and Intensity (2026.acl-long)
Copied to clipboard
| Challenge: | Existing benchmarks measure whether Large language models recognize emotions . authors: LLMs can be used to validate, but they can still judge anger inappropriately . |
| Approach: | They propose a benchmark to measure whether Large language models validate anger . they use explicit norm judgments and implicit acceptability tests to measure norms . |
| Outcome: | The study finds that large differences in sanctioning thresholds and institutional norm signatures are not reducible to overall strictness. |
Triggerless Backdoor Attack for NLP Tasks with Clean Labels (2022.naacl-main)
Copied to clipboard
Leilei Gan, Jiwei Li, Tianwei Zhang, Xiaoya Li, Yuxian Meng, Fei Wu, Yi Yang, Shangwei Guo, Chun Fan
| Challenge: | Backdoor attacks are a new threat to neural natural language processing models due to the fragility and lack of interpretability of NLP models. |
| Approach: | They propose a method to perform backdoor attacks without an external trigger . they propose to use clean-labeled examples to generate poisoned clean-labelled examples . |
| Outcome: | The proposed strategy is effective and hard to defend due to its triggerless nature. |
Competency-Aware Neural Machine Translation: Can Machine Translation Know its Own Translation Quality? (2022.emnlp-main)
Copied to clipboard
| Challenge: | Neural machine translation models are often criticized for failures that happen without competency awareness. |
| Approach: | They propose a method that extends conventional NMT with a self-estimator to translate a source sentence and estimate its competency. |
| Outcome: | The proposed method performs on translation tasks intact and on quality estimation tasks better than existing methods. |
Evaluating Factual Consistency of Texts with Semantic Role Labeling (2023.starsem-1)
Copied to clipboard
| Challenge: | Existing evaluation methods rely on task-specific language models, which in turn hampers interpretation of generated scores. |
| Approach: | They propose a reference-free evaluation metric for text summarization that measures factuality . their method generates fact tuples from Semantic Role Labels, applied to both input and summary texts. |
| Outcome: | The proposed evaluation metric is comparable with state-of-the-art methods and has a stable generalization across datasets. |
Bilateral Masking with prompt for Knowledge Graph Completion (2024.findings-naacl)
Copied to clipboard
| Challenge: | Existing word matching methods fail to obtain satisfactory single embedding representations for entities. |
| Approach: | They propose a bi-encoder-based approach to enhance entity representations by using prompts to narrow the distance between the predicted entity and the known entity. |
| Outcome: | The proposed model achieves state-of-the-art performance on the WN18RR dataset. |
RASPberry: Retrieval-Augmented Monte Carlo Tree Self-Play with Reasoning Consistency for Multi-Hop Question Answering (2025.findings-acl)
Copied to clipboard
| Challenge: | Existing methods for generating and analyzing multiple document knowledge are not effective for multi-hop question answering. |
| Approach: | They propose a Monte Carlo tree-based approach to inference-time scaling using RASPberry. |
| Outcome: | Experimental results show that the proposed method achieves better inference-time scaling on smaller LLMs. |
Exploring Reasoning Reward Model for Agents (2026.findings-acl)
Copied to clipboard
Kaixuan Fan, Kaituo Feng, Manyuan Zhang, Tianshuo Peng, Zhixun Li, Yilei Jiang, Shuang Chen, Xiangyu Yue
| Challenge: | Existing methods for agentic reinforcement learning rely on sparse outcome-based reward for training, leading to suboptimal results. |
| Approach: | They propose an agent-based reward model that produces structured feedback for agentic trajectories, including an explicit reasoning trace and a focused critique. |
| Outcome: | The proposed model produces structured feedback for agentic trajectories including an explicit reasoning trace, a focused critique, and an overall score that evaluates process performance. |
RoCEL: Advancing Table Entity Linking through Distinctive Row and Column Contexts (2024.emnlp-main)
Copied to clipboard
| Challenge: | Existing methods for table entity linking ignore row and column contexts . existing methods for TEL focus on understanding sequential text contexts, making it difficult to adapt to the row and columns structure of tables. |
| Approach: | They propose to leverage row and column contexts to enhance the semantics of mentions in entity disambiguation. |
| Outcome: | The proposed method outperforms the state-of-the-art (SOTA) baseline by 1.5% on the in-domain dataset and 3.7% on average across three out-of domain datasets. |
Contextual Domain Classification with Temporal Representations (2021.naacl-industry)
Copied to clipboard
| Challenge: | Existing studies that incorporate context in SLU have focused on domains where context is limited to a few minutes. |
| Approach: | They propose temporal representations that combine wall-clock second difference and turn order offset information to utilize both recent and distant context in a novel large-scale setup. |
| Outcome: | The proposed model reduces 13.04% of classification errors compared to baseline . previous studies have focused on domains where context is limited to a few minutes . |
CALM: Unleashing the Cross-Lingual Self-Aligning Ability of Language Model Question Answering (2025.findings-naacl)
Copied to clipboard
| Challenge: | Large Language Models (LLMs) are pre-trained on extensive multilingual corpora to acquire both language-specific cultural knowledge and general knowledge. |
| Approach: | They propose to use the **C**ross-Lingual Self-**Aligning ability of **L**anguage **M**odels to align knowledge across languages. |
| Outcome: | The proposed model performs well in both zero-shot and retrieval-augmented settings. |
PILE: Pairwise Iterative Logits Ensemble for Multi-Teacher Labeled Distillation (2022.emnlp-industry)
Copied to clipboard
Lianshang Cai, Linhao Zhang, Dehong Ma, Jun Fan, Daiting Shi, Yi Wu, Zhicong Cheng, Simiu Gu, Dawei Yin
| Challenge: | Pre-trained language models have been a key part of ranking systems . knowledge distillation is widely used to maintain high performance while keeping efficient computations. |
| Approach: | They propose an algorithm to combine knowledge from multi-teachers and label information to achieve competitive performance in offline and online experiments. |
| Outcome: | The proposed method has been deployed in a real-world commercial search system. |
Infinite Babble: Inflating 3D Vision-Language Model Inference Overhead via Adversarial Geometric Perturbation (2026.findings-acl)
Copied to clipboard
| Challenge: | 3D Vision-Language Models (VLMs) are critical cognitive backbone for spatial intelligence, but their reliance on autoregressive decoding introduces a fundamental vulnerability regarding inference efficiency. |
| Approach: | They propose a framework that triggers computational and economic exhaustion in 3D-VLMs by injecting imperceptible noise that forces the model into a state of pathological verbosity. |
| Outcome: | The proposed framework amplifies output length and energy consumption by up to 6.45, demonstrating a potent capability to drain system resources. |
Benchmarking for Domain-Specific LLMs: A Case Study on Academia and Beyond (2025.findings-emnlp)
Copied to clipboard
| Challenge: | Comp-Comp is an iterative benchmarking framework grounded in the principles of comprehensiveness and compactness. |
| Approach: | They propose a benchmark framework that incorporates the principle of comprehensiveness and compactness. |
| Outcome: | The proposed framework is domain-agnostic and adaptable to a wide range of specialized fields. |
RCTEA: Richness-guided Co-training for Temporal Entity Alignment (2026.findings-acl)
Copied to clipboard
| Challenge: | Existing TEA models fail to capture the orthogonal yet complementary effect between structural and temporal features. |
| Approach: | They propose a framework that jointly models structural and temporal aspects of Temporal Knowledge Graphs for entity alignment. |
| Outcome: | The proposed framework achieves state-of-the-art on public TEA benchmarks. |
Multimodal Inconsistency Reasoning (MMIR): A New Benchmark for Multimodal Reasoning Models (2025.findings-acl)
Copied to clipboard
| Challenge: | Existing Multimodal Large Language Models (MLLMs) are predominantly trained on consistent visual-textual inputs, leaving open the question of whether they can handle semantic mismatches in layout-rich content. |
| Approach: | They propose to use multimodal inconsistency reasoning to assess MLLMs' ability to reason about semantic mismatches in webpages, presentation slides, and posters. |
| Outcome: | The proposed model outperforms open-source models in detecting inconsistencies in webpages, presentation slides, and posters while remaining vulnerable to inconsistent errors. |
COSMOS: Connectivity-Oriented Submodular Maximization for Optimal Subgraph Retrieval (2026.acl-long)
Copied to clipboard
| Challenge: | Existing paradigms treat facts independently or employ myopic search, failing to optimize collective subgraph utility. |
| Approach: | They propose a framework that formalizes evidence retrieval as a constrained submodular maximization problem. |
| Outcome: | The proposed framework captures the trade-off between information relevance and structural complexity. |
NL2TL: Transforming Natural Languages to Temporal Logics using Large Language Models (2023.emnlp-main)
Copied to clipboard
| Challenge: | Temporal Logic (TL) can be used to specify complex high-level specifications for systems in many engineering domains. |
| Approach: | They propose a framework for translation between NL and TL using Large Language Models . they use a dataset to create a model with 23K NL-TL pairs and human annotation . |
| Outcome: | The proposed framework achieves higher accuracy (> 95%) using only 10% training data compared with baseline model. |
Thinking Traps in Long Chain-of-Thought: A Measurable Study and Trap-Aware Adaptive Restart (2026.findings-acl)
Copied to clipboard
null Chenkang, Fan Yu, Junjie Nian, Sihan Zhao, Zhuoka Feng, Zijun Yao, Wang Heng, Yu Minshen, Yixin Cao
| Challenge: | Experiments show that extended generation does not guarantee correctness . a recurring pattern in Long-CoT failures is a problem for large reasoning models . |
| Approach: | They propose a test-time control framework that truncates the trajectory before the trap segment and adaptively restarts decoding. |
| Outcome: | Experiments show that TAAR improves reasoning performance without fine-tuning model parameters. |
Key Mention Pairs Guided Document-Level Relation Extraction (2022.coling-1)
Copied to clipboard
| Challenge: | Document-level Relation Extraction (DocRE) aims to identify the relations between entities in a given document. |
| Approach: | They propose a document-level relation extraction model with two modules to model mention-level relations. |
| Outcome: | The proposed model outperforms existing state-of-the-art models on two public DocRE datasets and outperformed existing models. |
MCLE-Mol: Empowering LLM with Molecular Comprehension and Low-Cost Continual Evolution for Interpretable Property Prediction (2026.findings-acl)
Copied to clipboard
Zhili Pu, Lantian Zhang, Hao Duan, Zhixing Zhang, Keyun Zhu, Yongqi Fan, Ruihui Hou, Tong Ruan, Yun Tang
| Challenge: | Large language models (LLMs) offer a new paradigm for molecular property prediction (MPP), yet a semantic gap between natural language and molecul representations limits their ability to capture structure–activity relationships (SAR). |
| Approach: | They propose an ML–LLM–Rule collaborative framework for MPP that injects ML-derived substructure attribution values into LLMs and calibrates them under specific chemical contexts. |
| Outcome: | The proposed framework outperforms baseline models on multiple benchmark datasets and is highly interpretable. |
OpenCoder: The Open Cookbook for Top-Tier Code Large Language Models (2025.acl-long)
Copied to clipboard
Siming Huang, Tianhao Cheng, Jason Klein Liu, Weidi Xu, Jiaran Hao, Liuyihan Song, Yang Xu, Jian Yang, Jiaheng Liu, Chenchen Zhang, Linzheng Chai, Ruifeng Yuan, Xianzhen Luo, Qiufeng Wang, YuanTao Fan, Qingfu Zhu, Zhaoxiang Zhang, Yang Gao, Jie Fu, Qian Liu, Houyi Li, Ge Zhang, Yuan Qi, Xu Yinghui, Wei Chu, Zili Wang
| Challenge: | Code LLMs lack reproducible data pipelines and training protocols for reproducible advancements in code intelligence. |
| Approach: | They propose a top-tier code LLM that releases model weights and inference code . reproducible data pipelines, rigorous experimental ablation results and training protocols are included . |
| Outcome: | The proposed model achieves comparable performance to leading models and serves as an "open cookbook" reproducible training data, rigorous experimental ablation results, and detailed training protocols are also included in the model. |
UNO Arena for Evaluating Sequential Decision-Making Capability of Large Language Models (2024.emnlp-main)
Copied to clipboard
Zhanyue Qin, Haochuan Wang, Deyuan Liu, Ziyang Song, Cunhang Fan, Zhao Lv, Jinlin Wu, Zhen Lei, Zhiying Tu, Dianhui Chu, Xiaoyan Yu, Dianbo Sui
| Challenge: | Existing LLMs demonstrate powerful capabilities between tasks, but can they make sequential decisions? |
| Approach: | They propose to evaluate sequential decision-making capability of large language models (LLMs) using novel metrics based Monte Carlo methods. |
| Outcome: | The proposed benchmark improves sequential decision-making performance compared to the vanilla LLM player. |
DELAN: Dual-Level Alignment for Vision-and-Language Navigation by Cross-Modal Contrastive Learning (2024.lrec-main)
Copied to clipboard
| Challenge: | Existing studies focus on cross-modal attention at the fusion stage, but modality features generated by disparate uni-encoders reside in their own spaces, leading to a decline in the quality of cross-modulation and decision-making. |
| Approach: | They propose a framework to align navigation-related modalities before fusion by cross-modal contrastive learning. |
| Outcome: | The proposed framework integrates with the majority of existing models, resulting in improved navigation performance on various VLN benchmarks, including R2R, R4R, and CVDN. |
MTR: A Dataset Fusing Inductive, Deductive, and Defeasible Reasoning (2023.findings-acl)
Copied to clipboard
| Challenge: | Existing datasets for logical reasoning focus on monotonic logic and a single form of reasoning. |
| Approach: | They propose to use a dataset to study the human-like reasoning in machine reading comprehension. |
| Outcome: | The proposed dataset shows that state-of-the-art neural models perform noticeably worse than expected. |
AgentPro: Enhancing LLM Agents with Automated Process Supervision (2025.emnlp-main)
Copied to clipboard
| Challenge: | Existing frameworks lack explicit supervision during the reasoning process, which may lead to error propagation across reasoning chains. |
| Approach: | They propose a framework which automates process supervision for large language model agents by automatically generating step-level annotations and developing a process reward model based on these annotations. |
| Outcome: | The proposed framework outperforms existing agent-based methods on four datasets and achieves a 6.32% increase in accuracy. |
Step-level Value Preference Optimization for Mathematical Reasoning (2024.findings-emnlp)
Copied to clipboard
| Challenge: | Existing methods for generating preference-level annotations do not capture the fine-grained quality of model outputs in multi-step reasoning tasks. |
| Approach: | They propose an algorithm to automatically annotate step-level preferences for multi-step reasoning using Monte Carlo Tree Search. |
| Outcome: | The proposed algorithm achieves state-of-the-art performance on in-domain and out-of domain mathematical reasoning benchmarks. |
Instantly Learning Preference Alignment via In-context DPO (2025.naacl-long)
Copied to clipboard
| Challenge: | Presently, mainstream approaches to HPA heavily depend on fine-tuning . however, the huge computational and annotation costs of fine-timing are hard to ignore . |
| Approach: | They propose a tuning-free approach to HPA using LLMs' decoding . they first rethink the derivation procedures of DPO and build an instant scorer . |
| Outcome: | The proposed approach outperforms existing methods even with tuning-free baselines and an upgraded scorer. |
Text-to-ES Bench: A Comprehensive Benchmark for Converting Natural Language to Elasticsearch Query (2025.acl-long)
Copied to clipboard
DonggeXue DonggeXue, Zhili Pu, Zhentao Xia, Hongli Sun, Ruihui Hou, Guangya Yu, Yupian Lin, Yongqi Fan, Jingping Liu, Tong Ruan
| Challenge: | Recent research on text-to-Query has explored using large language models to convert user query intent to executable code. |
| Approach: | They propose a novel semantic parsing task that leverages large language models to generate domain-specific language and post-processing code to support multi-index Elasticsearch queries. |
| Outcome: | The proposed model outperforms DeepSeek-R1 on the large Elasticsearch Dataset (LED) and BirdES datasets. |
Knowledge Graph Retrieval-Augmented Generation for LLM-based Recommendation (2025.acl-long)
Copied to clipboard
| Challenge: | Large Language Models (LLMs) have produced significant advances in the field of recommender systems. |
| Approach: | They propose to retrieve up-to-date structure information from the knowledge graph to augment recommendations by leveraging external knowledge sources. |
| Outcome: | Experiments on a large dataset show that the proposed method is effective in enhancing LLM-based recommendations. |
Understanding the Thinking Process of Reasoning Models: A Perspective from Schoenfeld’s Episode Theory (2025.emnlp-main)
Copied to clipboard
Ming Li, Nan Zhang, Chenrui Fan, Hong Jiao, Yanbin Fu, Sydney Peters, Qingshu Xu, Robert Lissitz, Tianyi Zhou
| Challenge: | Large Reasoning Models (LRMs) generate extensive chain-of-thought reasoning, but we lack a principled framework for understanding how these thoughts are structured. |
| Approach: | They propose a method to analyze the reasoning traces of Large Reasoning Models using Schoenfeld’s Episode Theory. |
| Outcome: | The proposed framework provides a theoretically grounded methodology for interpreting LRM cognition and enables future work on more controllable and transparent reasoning systems. |
Multiplex Graph Neural Network for Extractive Text Summarization (2021.emnlp-main)
Copied to clipboard
| Challenge: | Existing methods for extractive text summarization do not consider multiple types of inter-sentential relationships, nor model intra-sententential relationships. |
| Approach: | They propose a novel method to combine different types of relationships among sentences and words to model sentence embedding. |
| Outcome: | The proposed model is compared with existing methods on CNN/DailyMail benchmark dataset to demonstrate its effectiveness. |
Self-Knowledge Distillation for Knowledge Graph Embedding (2024.lrec-main)
Copied to clipboard
| Challenge: | Knowledge graph embedding (KGE) is an important task for many downstream applications. |
| Approach: | They propose to use self-knowledge distillation to learn a low-dimensional model from a pre-trained high-dimensional one. |
| Outcome: | The proposed model can improve model performance while maintaining lightweight structure. |
LlamaDuo: LLMOps Pipeline for Seamless Migration from Service LLMs to Small-Scale Local LLMs (2025.acl-long)
Copied to clipboard
| Challenge: | LLMOps pipelines are used to migrate knowledge and abilities from service-oriented LLMs to smaller, locally manageable models. |
| Approach: | They propose an LLMOps pipeline for the seamless migration of knowledge and abilities from service-oriented LLMs to smaller, locally manageable models. |
| Outcome: | Experiments with leading-edge LLMs show that the proposed pipeline can scale to meet various tasks and domains. |
End-to-End Optimization for Multimodal Retrieval-Augmented Generation via Reward Backpropagation (2025.findings-emnlp)
Copied to clipboard
| Challenge: | MM-RAG is a promising approach for enhancing the reliability and factuality of large vision-language models . current methods focus on component-level optimizations and necessitate extensive component-specific training datasets . |
| Approach: | They propose a new paradigm that backpropagates global rewards to each component . this backpropage transforms local losses into specific local losses . |
| Outcome: | The proposed paradigm achieves high training efficiency on knowledge-intensive multimodal benchmarks. |
Exploring Graph Learning Tasks with Pure LLMs: A Comprehensive Benchmark and Investigation (2026.findings-acl)
Copied to clipboard
| Challenge: | Recent studies focus on performance benchmarks without fully comparing LLMs to graph learning models. |
| Approach: | They evaluate off-the-shelf and instruction-tuned graph learning models across a variety of scenarios. |
| Outcome: | The proposed models outperform traditional graph learning models in few-shot settings, the authors show . their models out perform models with instruction tuning, and they show excellent generalization and robustness. |
MadaKV: Adaptive Modality-Perception KV Cache Eviction for Efficient Multimodal Long-Context Inference (2025.acl-long)
Copied to clipboard
Kunxi Li, Zhonghua Jiang, Zhouzhou Shen, ZhaodeWang ZhaodeWang, Chengfei Lv, Shengyu Zhang, Fan Wu, Fei Wu
| Challenge: | Existing KV cache eviction methods fail to capture modality-specific information, resulting in suboptimal performance. |
| Approach: | They propose a modality-adaptive key-value (KV) cache eviction strategy to enhance the efficiency of multimodal large language models in long-context inference. |
| Outcome: | The proposed method reduces the KV cache memory footprint and model inference latency while maintaining high accuracy across multimodal long-context tasks. |
Enhancing Multi-party Dialogue Discourse Parsing with Explanation Generation (2025.coling-main)
Copied to clipboard
| Challenge: | Multi-party dialogue discourse parsing is an important and challenging task in natural language processing. |
| Approach: | They propose a model to integrate external knowledge from Large Language Models to analyze dialogue discourse structures and semantic relations between utterances in multi-party conversations. |
| Outcome: | The proposed model outperforms the state-of-the-art (SOTA) models on two public datasets. |
SeedBench: A Multi-task Benchmark for Evaluating Large Language Models in Seed Science (2025.acl-long)
Copied to clipboard
Jie Ying, Zihong Chen, Zhefan Wang, Wanli Jiang, Chenyang Wang, Zhonghang Yuan, Haoyang Su, Huanjun Kong, Fan Yang, Nanqing Dong
| Challenge: | Seed science is essential for modern agriculture, but its application in seed science remains limited due to a shortage of experts and limited availability of online resources. |
| Approach: | They evaluate 26 leading large language models and compare them against a set of benchmarks . they find that there is a gap between the power of LLMs and real-world seed science problems . |
| Outcome: | The new seed benchmark highlights the gap between the power of large language models and real-world seed science problems. |
FaithBench: A Diverse Hallucination Benchmark for Summarization by Modern LLMs (2025.naacl-short)
Copied to clipboard
Forrest Sheng Bao, Miaoran Li, Renyi Qu, Ge Luo, Erana Wan, Yujia Tang, Weisi Fan, Manveer Singh Tamber, Suleman Kazi, Vivek Sourabh, Mike Qi, Ruixuan Tu, Chenyu Xu, Matthew Gonzales, Ofer Mendelevitch, Amin Ahmad
| Challenge: | Existing evaluations of hallucinations in large language models suffer from a lack of diversity and recency in the LLM and LLM families considered. |
| Approach: | They propose a summarization hallucination benchmark that challenges models to disagree on hallucines . they use models to generate answers or summaries from textual input . |
| Outcome: | The proposed model combines the best of 10 modern LLMs with ground truth annotations. |
RTCFake: Speech Deepfake Detection in Real-Time Communication (2026.findings-acl)
Copied to clipboard
Jun Xue, Zhuolin Yi, Yihuan Huang, Yanzhen Ren, Yujie Chen, Cunhang Fan, Zicheng Su, Yongcheng Zhang, Bo Cai
| Challenge: | Existing detection studies focus on offline simulations and struggle to cope with complex distortions introduced during RTC transmission. |
| Approach: | They propose a large-scale speech deepfake dataset tailored for RTC scenarios . the dataset is constructed by transmitting speech through multiple social media and conferencing platforms . |
| Outcome: | The proposed dataset is constructed by transmitting speech through multiple mainstream social media and conferencing platforms, enabling precise pairing between offline and online speech. |
A Survey on Multi-modal Intent Recognition: Recent Advances and New Frontiers (2025.findings-emnlp)
Copied to clipboard
| Challenge: | Multi-modal intent recognition (MIR) requires integrating non-verbal cues from real-world contexts to enhance human intention understanding. |
| Approach: | They present a comprehensive review of multi-modal intent recognition . they provide a survey of the field covering textual, visual, and acoustic signals . |
| Outcome: | The present survey summarises the current state of multi-modal intent recognition . it includes a comprehensive taxonomy and advanced methods . |
Incorporating Lexical and Syntactic Knowledge for Unsupervised Cross-Lingual Transfer (2024.lrec-main)
Copied to clipboard
| Challenge: | Unsupervised cross-lingual transfer is a process of transferring knowledge between languages without explicit supervision. |
| Approach: | They propose a framework that combines lexical and syntactic knowledge to enhance learning . they use a code-switching technique to implicitly teach lexica and a syntaktic-based graph attention network to help encode syntakic structure. |
| Outcome: | The proposed framework outperforms baselines of zero-shot cross-lingual transfer with 1.0 3.7 points on text classification, named entity recognition, and semantic parsing tasks. |
Enhancing Explainable Rating Prediction through Annotated Macro Concepts (2024.acl-long)
Copied to clipboard
| Challenge: | Existing models learn user and item embeddings and generate reasons based on these embedds. |
| Approach: | They propose a concept-based explanation framework that leverages macro concepts to bridge the gap between the user/item embeddings and the recommendation reasons. |
| Outcome: | Extensive experiments on three datasets prove the proposed model is superior to existing models. |
TInR: Exploring Tool-Internalized Reasoning in Large Language Models (2026.acl-long)
Copied to clipboard
| Challenge: | Existing methods rely on external tool documentation during reasoning, leading to tool mastery difficulty, tool size constraints, and inference inefficiency. |
| Approach: | They propose a tool-internalized reasoning framework for unified reasoning and tool usage that integrates external tools into Large Language Models (LLMs) to address these issues, they propose 'tool-internet-based' reasoning. |
| Outcome: | The proposed method achieves superior performance across in-domain and out-of-domain settings, highlighting its effectiveness and efficiency. |
TinyAlign: Boosting Lightweight Vision-Language Models by Mitigating Modal Alignment Bottlenecks (2026.findings-acl)
Copied to clipboard
Yuanze Hu, Xinyu Wang, Zhichao Yang, Gen Li, Ye Qiu, Zhaoxin Fan, Yifan Sun, Wenjun wu, Jin Dong, Xiaotie Deng
| Challenge: | Lightweight Vision-Language Models (VLMs) are indispensable for resource-constrained applications. |
| Approach: | They propose a framework that retrieves context from a memory bank to enhance alignment . they propose EMI-based approach to align vision and language models . |
| Outcome: | The proposed framework reduces training loss, accelerates convergence, and enhances task performance with negligible computational overhead. |
Target-oriented Opinion Words Extraction with Target-fused Neural Sequence Labeling (N19-1)
Copied to clipboard
| Challenge: | Opinion target extraction and opinion words extraction are two fundamental subtasks in Aspect Based Sentiment Analysis (ABSA). |
| Approach: | They propose a new subtask for Aspect Based Sentiment Analysis to extract opinion words as pairs from a given opinion target. |
| Outcome: | The proposed model outperforms existing methods significantly on several popular ABSA benchmarks. |
Uncovering the Potential of ChatGPT for Discourse Analysis in Dialogue: An Empirical Study (2024.lrec-main)
Copied to clipboard
| Challenge: | Large language models have shown remarkable capability in many downstream tasks, yet their ability to understand discourse structures of dialogues remains less explored. |
| Approach: | They aim to systematically inspect ChatGPT’s performance in two discourse analysis tasks: topic segmentation and discourse parsing. |
| Outcome: | The proposed model can give more reasonable topic structures than human annotations but only linearly parses the hierarchical rhetorical structures. |
Layer-wise Model Pruning based on Mutual Information (2021.emnlp-main)
Copied to clipboard
| Challenge: | In spite of impressive results of neural networks, the huge model size has hindered their applications in cases where computation and memory resources are limited. |
| Approach: | They propose a method for layer-wise pruning using mutual information based feature selection in SVMs and logistic regression. |
| Outcome: | The proposed pruning strategy offers greater speedup and higher performance than weight-based pruning methods. |
Unifying Cross-Lingual and Cross-Modal Modeling Towards Weakly Supervised Multilingual Vision-Language Pre-training (2023.acl-long)
Copied to clipboard
| Challenge: | Existing studies address the problem of translating English data into other languages, but they are limited in form and scale. |
| Approach: | They propose a framework to unify cross-lingual and cross-modal pre-training by using English data. |
| Outcome: | The proposed framework unifies cross-lingual and cross-modal pre-training on different data. |
UEGP: Unified Expert-Guided Pre-training for Knowledge Rekindle (2024.findings-naacl)
Copied to clipboard
Yutao Mou, Kexiang Wang, Jianhe Lin, Dehong Ma, Jun Fan, Daiting Shi, Zhicong Cheng, Gu Simiu, Dawei Yin, Weiran Xu
| Challenge: | Existing paradigms for pre-training and fine-tuning have limitations . knowledge rekindle aims to break through performance upper bounds of experts without introducing additional annotated data. |
| Approach: | They propose a new paradigm for pre-training and fine-tuning that aims to re-incorporate the fine- tuned expert model into the training cycle and break through performance upper bounds of experts. |
| Outcome: | The proposed model breaks through performance upper bounds of experts without additional annotated data. |
Exploring the Potential of Large Language Models in Generating Code-Tracing Questions for Introductory Programming Courses (2023.findings-emnlp)
Copied to clipboard
| Challenge: | Using large language models, we generate code-tracing questions based on code snippets and descriptions. |
| Approach: | They propose to use large language models to generate code-tracing questions in introductory programming courses by using GPT4 prompts. |
| Outcome: | The proposed model generates code-tracing questions based on code snippets and descriptions. |
StepCoder: Improving Code Generation with Reinforcement Learning from Compiler Feedback (2024.acl-long)
Copied to clipboard
Shihan Dou, Yan Liu, Haoxiang Jia, Enyu Zhou, Limao Xiong, Junjie Shan, Caishuang Huang, Xiao Wang, Xiaoran Fan, Zhiheng Xi, Yuhao Zhou, Tao Ji, Rui Zheng, Qi Zhang, Tao Gui, Xuanjing Huang
| Challenge: | Existing work integrates reinforcement learning with compiler feedback to enhance code generation quality but the long code generated by LLMs makes RL exploration ineffective. |
| Approach: | They propose a framework that integrates reinforcement learning and compiler feedback to enhance code generation quality. |
| Outcome: | The proposed framework outperforms state-of-the-art approaches in corresponding benchmarks and integrates reinforcement learning with compiler feedback to improve code generation quality. |
OmniCompliance-100K: A Multi-Domain, Rule-Grounded, Real-World Safety Compliance Dataset (2026.findings-acl)
Copied to clipboard
| Challenge: | Existing LLM safety datasets rely on ad-hoc taxonomies and lack rule-grounded, real-world cases. |
| Approach: | They construct a rule-grounded, real-world case dataset OmniCompliance-100K from a compliance perspective using a powerful web-searching agent. |
| Outcome: | The proposed dataset spans 74 regulations and policies across a wide range of domains including security and privacy regulations, content safety and user data privacy policies, financial security requirements, medical device risk management standards, educational integrity guidelines, and protections of fundamental human rights. |
DynGL-SDP: Dynamic Graph Learning for Semantic Dependency Parsing (2022.coling-1)
Copied to clipboard
| Challenge: | Existing parsers that learn graph representations based on static graphs are error-prone and disjointed . Graph-based parser can parse sentences efficiently but suffer from error propagation . |
| Approach: | They propose a dynamic graph learning framework to learn graph representations based on a static graph constructed by an existing parser. |
| Outcome: | The proposed parser outperforms the previous parsers on the SemEval-2015 task 18 dataset in three languages. |
MTO: A Multi-turn Conversational Text-to-OverpassQL Dataset for Enhanced OpenStreetMap Query Generation (2026.findings-acl)
Copied to clipboard
| Challenge: | a framework for constructing multi-turn Text-to-OverpassQL dialogue datasets is proposed . a dataset of over 7,800 dialogues contains more than 20,000 individual utterances . |
| Approach: | They propose a framework for constructing multi-turn Text-to-OverpassQL dialogue datasets . they convert Overpass queries into syntax trees using a custom parser based on OverpassQl . |
| Outcome: | The proposed dataset includes over 7,800 dialogues, each containing 2 to 4 user utterances . it is the first multi-turn Text-to-OverpassQL dataset built upon the OverpassNL corpus . |
Towards Noise-Tolerant Speech-Referring Video Object Segmentation: Bridging Speech and Text (2023.emnlp-main)
Copied to clipboard
| Challenge: | Recent advances in vision-language learning have significantly advanced Human-Computer Interactions (HCI). |
| Approach: | They propose a method to align the semantic spaces between speech and text by incorporating two modules to align semantic spaces. |
| Outcome: | The proposed method outperforms state-of-the-art approaches on AVOS benchmarks. |
HoWToBench: Holistic Evaluation for LLM’s Capability in Human-level Writing using Tree of Writing (2026.acl-long)
Copied to clipboard
Andrew Zhuoer Feng, Cunxiang Wang, Yu Luo, Lin Fan, Irene Zhou, Zikang Wang, Xiaotao Gu, Jie Tang, Hongning Wang, Minlie Huang
| Challenge: | Evaluating the writing capabilities of large language models remains a significant challenge due to the multidimensional nature of writing skills and the limitations of existing metrics. |
| Approach: | They propose to model the aggregation weights of sub-features in a tree-structured workflow and propose a Chinese writing benchmark that mitigates biases. |
| Outcome: | The proposed tree-of-writing (ToW) measures the writing capabilities of large language models (LLMs) in Chinese and shows that it mitigates biases and achieves a *0.93* Pearson correlation with human judgments. |
BiasAlert: A Plug-and-play Tool for Social Bias Detection in LLMs (2024.emnlp-main)
Copied to clipboard
| Challenge: | Existing evaluation approaches rely on fixed-form outputs and cannot adapt to flexible open-text generation scenarios. |
| Approach: | They propose a plug-and-play tool to detect social bias in open-text LLMs. |
| Outcome: | Extensive experiments show that BiasAlert outperforms state-of-the-art methods in detecting bias in open-text generation scenarios. |
Maria: A Visual Experience Powered Conversational Agent (2021.acl-long)
Copied to clipboard
| Challenge: | Existing studies focus on grounding conversational agents on text-only corpora, but they lack the perception ability to our physical world. |
| Approach: | They propose to ground conversational agents on images retrieved from large-scale image indexes . they propose to use visual knowledge to generate informative responses based on the extracted knowledge . |
| Outcome: | The proposed agent outperforms state-of-the-art methods on automatic metrics and human evaluation. |
NUWA-XL: Diffusion over Diffusion for eXtremely Long Video Generation (2023.acl-long)
Copied to clipboard
Shengming Yin, Chenfei Wu, Huan Yang, Jianfeng Wang, Xiaodong Wang, Minheng Ni, Zhengyuan Yang, Linjie Li, Shuguang Liu, Fan Yang, Jianlong Fu, Ming Gong, Lijuan Wang, Zicheng Liu, Houqiang Li, Nan Duan
| Challenge: | Existing work generates long videos segment by segment sequentially, which is inefficient. |
| Approach: | They propose a Diffusion over Difference architecture for eXtremely Long video generation. |
| Outcome: | The proposed architecture reduces the average inference time from 7.55min to 26s (94.26%) and generates high-quality long videos with both global and local coherence. |
stopes - Modular Machine Translation Pipelines (2022.emnlp-demos)
Copied to clipboard
Pierre Andrews, Guillaume Wenzek, Kevin Heffernan, Onur Çelebi, Anna Sun, Ammar Kamran, Yingzhe Guo, Alexandre Mourachko, Holger Schwenk, Angela Fan
| Challenge: | Neural machine translation is a natural language deep learning application that needs data to be trained. |
| Approach: | They describe a framework that empowers scalability and versatility for research use cases. |
| Outcome: | The proposed framework empowers scalability and versatility for research use cases. |
CLFFRD: Curriculum Learning and Fine-grained Fusion for Multimodal Rumor Detection (2024.lrec-main)
Copied to clipboard
| Challenge: | Existing multimodal rumor detection models overlook sample difficulty and order when training . Existing models overlook text-level difficulty, image-level and multimodal difficulty when training samples . |
| Approach: | They propose a curriculum learning framework that uses fine-grained fusion to detect rumors . they propose fusion-based methods that combine text and images to enhance semantic cohesion . |
| Outcome: | The proposed framework outperforms state-of-the-art models on English and Chinese benchmark datasets. |
Apertus: Democratizing Open and Compliant LLMs for Global Language Environments (2026.acl-long)
Copied to clipboard
Alejandro Hernández-Cano, Alexander Hägele, Allen Hao Huang, Angelika Romanou, Antoni-Joan Solergibert, Barna Pásztor, Bettina Messmer, Dhia Garbaya, Eduard Frank Ďurech, Ido Hakimi, Juan Garcia Giraldo, Mete Ismayilzada, Negar Foroutan, Skander Moalla, Tiancheng Chen, Vinko Sabolčec, Yixuan Xu, Michael Aerni, Badr AlKhamissi, Inés Altemir Marinas, Mohammad Hossein Amani, Matin Ansaripour, Ilia Badanin, Harold Benoit, Emanuela Boros, Nicholas John Browning, Fabian Bösch, Maximilian Böther, Niklas Canova, Camille Challier, Clément Charmillot, Jonathan Coles, Jan Milan Deriu, Arnout Devos, Lukas Drescher, Daniil Dzenhaliou, Maud Ehrmann, Dongyang Fan, Simin Fan, Silin Gao, Miguel Gila, María Grandury, Diba Hashemi, Alexander Miserlis Hoyle, Jiaming Jiang, Mark Klein, Andrei Kucharavy, Anastasiia Kucherenko, Frederike Lübeck, Roman Machacek, Theofilos Ioannis Manitaras, Andreas Marfurt, Kyle Matoba, Simon Matrenok, Henrique Mendonça, Fawzi Roberto Mohamed, Syrielle Montariol, Luca Mouchel, Sven Najem-Meyer, Jingwei Ni, Gennaro Oliva, Matteo Pagliardini, Elia Palme, Andrei Panferov, Léo Paoletti, Marco Passerini, Ivan Pavlov, Auguste Poiroux, Kaustubh Ponkshe, Nathan Ranchin, Javier Rando, Mathieu Sauser, Jakhongir Saydaliev, Mukhammadali Sayfiddinov, Marian Schneider, Stefano Schuppli, Marco Scialanga, Andrei Semenov, Kumar Shridhar, Raghav Singhal, Anna Sotnikova, Alexander Sternfeld, Ayush Kumar Tarun, Paul Teiletche, Jannis Vamvas, Xiaozhe Yao, Hao Zhao, Alexander Ilic, Ana Klimovic, Andreas Krause, Caglar Gulcehre, David Rosenthal, Elliott Ash, Florian Tramèr, Joost VandeVondele, Livio Veraldi, Martin Rajman, Thomas C. Schulthess, Torsten Hoefler, Antoine Bosselut, Martin Jaggi, Imanol Schlag
| Challenge: | Apertus is a fully open suite of large language models (LLMs) designed to address responsibility shortcomings in today’s open model ecosystem, namely data responsibility and global representation. |
| Approach: | They propose to release a fully open suite of large language models (LLMs) that address data responsibility and global representation shortcomings in today’s open model ecosystem. |
| Outcome: | The proposed model is pretrained on openly available data and suppresses verbatim recall of data while retaining task performance. |
Privacy Checklist: Privacy Violation Detection Grounding on Contextual Integrity Theory (2025.naacl-long)
Copied to clipboard
| Challenge: | Existing privacy studies focus on sub-fields, but they focus on a few sub-domains. |
| Approach: | They propose to use the Health Insurance Portability and Accountability Act of 1996 as an example to develop a checklist that covers social identities, private attributes, and existing privacy regulations. |
| Outcome: | The proposed checklist covers social identities, private attributes, and existing privacy regulations. |
Evaluating Large Language Models on Wikipedia-Style Survey Generation (2024.findings-acl)
Copied to clipboard
Fan Gao, Hang Jiang, Rui Yang, Qingcheng Zeng, Jinghui Lu, Moritz Blum, Tianwei She, Yuang Jiang, Irene Li
| Challenge: | Recent studies have shown that large language models can perform well in general tasks, but their effectiveness and limitations in domainspecific tasks remain unclear. |
| Approach: | They examine the proficiency of Large Language Models (LLMs) in generating succinct survey articles specific to the niche field of NLP in computer science. |
| Outcome: | The LLMs perform better in generating succinct survey articles specific to the niche field of NLP in computer science, compared to human-authored surveys, but they exhibit bias in evaluation. |
Graph Meets LLM: A Novel Approach to Collaborative Filtering for Robust Conversational Understanding (2023.emnlp-industry)
Copied to clipboard
| Challenge: | Defective queries impact the robustness of conversational AI systems such as Alexa, Siri or Google Assistant. |
| Approach: | They propose a Personalized Query Rewriting system that takes into account individual preferences or unique error patterns identified from a user's historical interactions with the conversational AI. |
| Outcome: | The proposed approach has been proven on a large-scale real-world dataset and online A/B experiments. |
Markov Chain of Thought for Efficient Mathematical Reasoning (2025.naacl-long)
Copied to clipboard
| Challenge: | Existing studies have sought to enhance the mathematical reasoning capabilities of large language models. |
| Approach: | They propose a Markov Chain of Thought (MCoT) that compresses previous reasoning steps into a simplified question. |
| Outcome: | The proposed method improves efficiency and maintains comparable accuracy. |
Towards Efficient and Effective Diffusion Language Model Inference via Semantic-Aware Adaptive Denoising (2026.acl-long)
Copied to clipboard
| Challenge: | Existing acceleration works cannot accurately detect semantically stabilized tokens and then skip computation, leading to sub-optimal speedup in practice. |
| Approach: | They propose a semantic-aware adaptive denoising framework that encodes scalar confidence scores into an evolution-awful feature vector and clusters vectors proactively and adaptively identify semantically converged tokens. |
| Outcome: | The proposed framework outperforms the SOTA competitor in speed and quality . it can detect semantically stabilized tokens and skip computation, resulting in sub-optimal speedup . |
RealBehavior: A Framework for Faithfully Characterizing Foundation Models’ Human-like Behavior Mechanisms (2023.findings-emnlp)
Copied to clipboard
Enyu Zhou, Rui Zheng, Zhiheng Xi, Songyang Gao, Xiaoran Fan, Zichu Fei, Jingting Ye, Tao Gui, Qi Zhang, Xuanjing Huang
| Challenge: | Existing studies on human-like behaviors in foundation models do not verify their faithfulness . a simple application of psychological tools cannot faithfully characterize all human-type behaviors . |
| Approach: | They propose a framework to characterize humanoid behaviors in foundation models . they argue that a simple application of psychological tools cannot faithfully characterize all human-like behaviors . |
| Outcome: | The proposed framework assesses the faithfulness of results based on reproducibility, internal consistency, and generalizability. |
MM-Verify: Enhancing Multimodal Reasoning with Chain-of-Thought Verification (2025.acl-long)
Copied to clipboard
| Challenge: | MM-Verifier and MM Reasoner are a powerful multimodal reasoning model . large language models (LLMs) have demonstrated exceptional performance across tasks spanning myriad domains. |
| Approach: | They propose a method which combines tree search and verification to generate high-quality chain-of-thought data. |
| Outcome: | The proposed method outperforms all larger models on the MathCheck, MathVista, and MathVerse benchmarks. |
PICD-Instruct: A Generative Instruction Learning Framework for Few-Shot Multi-Intent Spoken Language Understanding (2025.findings-emnlp)
Copied to clipboard
| Challenge: | Recent advances in large language models (LLMs) have utilized instruction learning frameworks to model intent-slot interdependencies, typically requiring abundant data for effective training. |
| Approach: | They propose a generative framework based on Basic Instructions (BI), Pairwise Interaction Instructions and Contrastive Distinct Instructions to solve these challenges. |
| Outcome: | The proposed framework achieves state-of-the-art performance on public datasets. |
Entity-Relation Extraction as Multi-Turn Question Answering (P19-1)
Copied to clipboard
| Challenge: | Identifying entities and their relations is the prerequisite of extracting structured knowledge from unstructured raw texts. |
| Approach: | They propose a new paradigm for the task of entity-relation extraction . they cast the task as a multi-turn question answering problem . |
| Outcome: | The proposed paradigm significantly outperforms previous best models on the ACE and CoNLL04 datasets. |
ConEntail: An Entailment-based Framework for Universal Zero and Few Shot Classification with Supervised Contrastive Pretraining (2023.eacl-main)
Copied to clipboard
| Challenge: | Existing models for text classification are not universally applicable and lack annotated data. |
| Approach: | They propose a framework for universal zero and few shot classification with supervised contrastive pretraining that can generalize to diverse classification tasks in both zero and many shot settings. |
| Outcome: | The proposed framework outperforms baseline models in zero and few shot settings. |
EmojiPrompt: Generative Prompt Obfuscation for Privacy-Preserving Communication with Cloud-based LLMs (2025.naacl-long)
Copied to clipboard
| Challenge: | Recent advances in Large Language Models (LLMs) have substantially expanded their applicability across diverse fields, such as personalized recommendations, health report analysis, and financial decision-making. |
| Approach: | They propose a generative transformation paradigm that obfuscates user data with linguistic and non-linguistic elements before submitting it to cloud-based LLMs. |
| Outcome: | The proposed paradigm obfuscates user private data while maintaining performance compared to the unobflated version. |
Multi-Granularity Fusion Text Semantic Matching Based on WoBERT (2024.lrec-main)
Copied to clipboard
| Challenge: | Existing text-matching methods struggle with semantic nuances in short texts . a novel approach to improve text semantic matching is being developed . |
| Approach: | They propose a multi-granularity fusion model that harnesses a pre-trained language model to capture text semantic nuances. |
| Outcome: | The proposed model improves on Chinese short text matching datasets compared to traditional methods . the proposed model captures individual text semantic nuances and improves accuracy . |
Sentence Similarity Based on Contexts (2022.tacl-1)
Copied to clipboard
| Challenge: | Existing methods to measure sentence similarity face limited dataset size and training-test gap . existing methods lack large-scale labeled datasets with labeles that are labor-intensive and expensive . |
| Approach: | They propose a framework that measures sentence similarity by comparing probabilities of generating two sentences given the same context. |
| Outcome: | The proposed framework achieves significant performance boosts over baselines under supervised and unsupervised settings. |
Analyzing the Effects of Supervised Fine-Tuning on Model Knowledge from Token and Parameter Levels (2025.emnlp-main)
Copied to clipboard
Junjie Ye, Yuming Yang, Yang Nan, Shuo Li, Qi Zhang, Tao Gui, Xuanjing Huang, Peng Wang, Zhongchao Shi, Jianping Fan
| Challenge: | Large language models (LLMs) acquire substantial world knowledge during pretraining, which is further shaped by post-training techniques such as supervised fine-tuning (SFT). |
| Approach: | They evaluate closed-book question answering (CBQA) performance across five LLMs from the LLaMA-2 and LLama-3 families and examine the impact of supervised fine-tuning on model knowledge. |
| Outcome: | The proposed model performance is 14% worse than models fine-tuned on 1,920 samples and 12% worse on 240 samples. |
FORTAP: Using Formulas for Numerical-Reasoning-Aware Table Pretraining (2022.acl-long)
Copied to clipboard
| Challenge: | Tables store rich numerical data, but numerical reasoning over tables is still a challenge. |
| Approach: | They propose a spreadsheet formula is a valuable supervision for numerical reasoning in tables. |
| Outcome: | The proposed method outperforms state-of-the-art methods on three representative datasets of formula prediction, question answering, and cell type classification. |
Synergistic Augmentation: Enhancing Cross-Domain Zero-Shot Slot Filling with Small Model-Assisted Large Language Models (2025.findings-acl)
Copied to clipboard
| Challenge: | Existing approaches to slot filling are limited due to data scarcity and timeconsuming efforts. |
| Approach: | They propose a framework that harnesses the power of a small model to augment inferential capabilities of LLMs without additional training. |
| Outcome: | The proposed framework improves slot filling performance on a spoken language dataset and a NER dataset. |
Pretraining Data Detection for Large Language Models: A Divergence-based Calibration Method (2024.emnlp-main)
Copied to clipboard
| Challenge: | Existing methods to detect text in training corpus are limited due to their low token probabilities. |
| Approach: | They propose a method to calibrate token probabilities for pretraining data detection by using a divergence-based calibration method. |
| Outcome: | The proposed method significantly outperforms existing methods on Chinese text on English-language benchmarks and patents. |
ORMind: A Cognitive-Inspired End-to-End Reasoning Framework for Operations Research (2025.acl-industry)
Copied to clipboard
| Challenge: | Large Language Models (LLMs) have shown promising results in various domains, but their practical application in industry-relevant operations research presents significant challenges and opportunities. |
| Approach: | They propose a cognitive-inspired framework that enhances optimization through counterfactual reasoning . they use a workflow that transforms requirements into mathematical models and executable solver code . |
| Outcome: | Experiments show that ORMind outperforms existing methods in the NL4Opt dataset and ComplexOR dataset. |
Automatic Generation of Citation Texts in Scholarly Papers: A Pilot Study (2020.acl-main)
Copied to clipboard
| Challenge: | Existing studies on automatic generation of citation texts in scholarly papers have not investigated this problem. |
| Approach: | They propose to train an implicit citation extraction model based on BERT and a multi-source pointer-generator network with cross attention mechanism for citation text generation. |
| Outcome: | The proposed model can generate short texts to describe cited papers in scholarly papers with training data. |
Reconstructing Capsule Networks for Zero-shot Intent Classification (D19-1)
Copied to clipboard
| Challenge: | Existing methods for intent classification are limited due to fast-emerging intents . a recent study shows that existing methods are not effective in recognizing unseen intents. |
| Approach: | They propose to reconstruct capsule networks for zero-shot intent classification by using latent information from labeled utterances. |
| Outcome: | The proposed method outperforms existing methods on two task-oriented dialogue datasets in different languages. |
Building Parallel Monolingual Gan Chinese Dialects Corpus (L18-1)
Copied to clipboard
| Challenge: | In particular, we manually annotate a Gan Chinese Dialects Corpus (GCDC) including 131.5 hours and 310 documents with 6 different genres, containing news, official document, story, prose, poet, letter and speech, from 19 different Gan regions. |
| Approach: | They propose a scheme to represent Gan Chinese dialects using Chinese character, Chinese Pinyin and Chinese audio forms. |
| Outcome: | The proposed scheme is based on a Gan Chinese Dialects Corpus (GCDC) with 131.5 hours and 310 documents with 6 different genres, containing news, official document, story, prose, poet, letter and speech, from 19 different Gan regions. |
Looking Beyond the One: Operationalizing and Eliciting Visual Ambiguity in VLLMs (2026.acl-long)
Copied to clipboard
| Challenge: | Visual question answering systems typically collapse ambiguity, committing to a single interpretation during decoding and evaluation. |
| Approach: | They operationalize ambiguity as the existence of multiple answer-supporting regions in an image . they show that ambiguities are already encoded in their internal representations . |
| Outcome: | The proposed approach makes ambiguity observable without exhaustive annotations . ambiguities are already encoded in models, but not reliably expressed in outputs despite hidden states . |
Structured Minimally Supervised Learning for Neural Relation Extraction (N19-1)
Copied to clipboard
| Challenge: | Recent work shows that distant supervision can cause significant label noise when learning from large quantities of unlabeled text. |
| Approach: | They propose a method that combines the benefits of learning representations and structured learning to predict sentence-level relation mentions given only proposition-level supervision from a KB. |
| Outcome: | The proposed approach outperforms a number of baseline approaches while minimizing label noise. |
Exploring the Potential of Dense Information in Multimodal Alignment (2024.findings-acl)
Copied to clipboard
| Challenge: | Existing methods to enhance captions have limitations such as insufficient detail and excessive hallucinations, resulting in compromised alignment and masking the true potential of dense information. |
| Approach: | They propose a pipeline that generates highly detailed captions for images that facilitates in-depth analysis of the potential for dense information in multimodal alignment. |
| Outcome: | The proposed pipeline significantly improves multimodal alignment and compositional reasoning abilities, surpassing hard negative samples. |
HSS-Synth: Humanities and Social Sciences Data Synthesis for LLMs (2026.findings-acl)
Copied to clipboard
Ru Peng, Tianyu Zhao, Xijun Gu, Zhiting Fan, Haokai Xu, Jinyang Zhang, Yawen Zeng, Yihong Zhuang, Kexin Yang, Junyang Lin, Dayiheng Liu, Junbo Zhao
| Challenge: | High-quality, diverse data are vital for large language models (LLMs) but remain scarce and costly. |
| Approach: | They define the first HSS domain system covering 14 mainstream fields and introduce HSS-Synth. |
| Outcome: | the proposed pipeline outperforms 14 leading baselines on 16 benchmarks. |
Boosting Document-Level Relation Extraction by Mining and Injecting Logical Rules (2022.emnlp-main)
Copied to clipboard
| Challenge: | Document-level relation extraction (DocRE) aims to extract relations of all entity pairs in document. |
| Approach: | They propose a logic enhanced framework that boosts DocRE by mining and injecting logic rules. |
| Outcome: | The proposed framework outperforms LogiRE on two benchmarks. |
OS Agents: A Survey on MLLM-based Agents for Computer, Phone and Browser Use (2025.acl-long)
Copied to clipboard
Xueyu Hu, Tao Xiong, Biao Yi, Zishu Wei, Ruixuan Xiao, Yurun Chen, Jiasheng Ye, Meiling Tao, Xiangxin Zhou, Ziyu Zhao, Yuhuai Li, Shengze Xu, Shenzhi Wang, Xinchen Xu, Shuofei Qiao, Zhaokai Wang, Kun Kuang, Tieyong Zeng, Liang Wang, Jiwei Li, Yuchen Eleanor Jiang, Wangchunshu Zhou, Guoyin Wang, Keting Yin, Zhou Zhao, Hongxia Yang, Fan Wu, Shengyu Zhang, Fei Wu
| Challenge: | a new generation of (M)LLMs is enabling the creation of superintelligent AI assistants . OS Agents can complete tasks autonomously and have the potential to significantly enhance the lives of billions of users worldwide. |
| Approach: | They propose to build OS Agents that operate within operating systems' GUIs and GUIs . they examine evaluation metrics and benchmarks to identify promising directions . |
| Outcome: | The proposed agents are based on operating systems (OS) and operating systems frameworks. |
Feedback-Driven Tool-Use Improvements in Large Language Models via Automated Build Environments (2026.findings-acl)
Copied to clipboard
Junjie Ye, Changhao Jiang, Zhengyin Du, Yufei Xu, Xuesong Yao, Zhiheng Xi, Xiaoran Fan, Qi Zhang, Tao Gui, Xuanjing Huang, Jiecao Chen
| Challenge: | Currently, there are no efficient reinforcement learning (RL) frameworks specifically designed for tool use. |
| Approach: | They propose an automated environment construction pipeline that incorporates scenario decomposition, document generation, function integration, complexity scaling, and localized deployment to enable high-quality training environments without external tools. |
| Outcome: | The proposed framework significantly improves the models’ tool-use performance without degrading their general capabilities. |
Tricks for Training Sparse Translation Models (2022.naacl-main)
Copied to clipboard
| Challenge: | Multitask learning with an unbalanced data distribution skews model learning towards high resource tasks. |
| Approach: | They propose to use a temperature heating mechanism and dense pre-training to mitigate this by training models with a fixed model capacity. |
| Outcome: | The proposed techniques improve performance on two multilingual translation benchmarks compared to BASELayers and Dense scaling baselines and in combination, more than 2x model convergence speed. |
Model-based Large Language Model Customization as Service (2025.emnlp-main)
Copied to clipboard
| Challenge: | Existing large language model services require users to upload data for fine-tuning . current methods for customization are noisy and require sensitive domain data . |
| Approach: | *Llamdex is a framework that facilitates LLM customization as a service . client uploads pre-trained domain-specific *models* rather than data . |
| Outcome: | *Llamdex* framework improves domain-specific accuracy by up to 26% over state-of-the-art private data synthesis methods . |
WavAlign: Enhancing Intelligence and Expressiveness in Spoken Dialogue Models via Adaptive Hybrid Post-Training (2026.findings-acl)
Copied to clipboard
Yifu Chen, Shengpeng Ji, Qian Chen, Tianle Liang, Yangzhuo Li, Ziqing Wang, Wen Wang, Jingyu Lu, Haoxiao Wang, Xueyi Pu, Fan Zhuo, Zhou Zhao
| Challenge: | End-to-end spoken dialogue models have higher potential ceiling in expressiveness and perceptual ability than cascaded systems. |
| Approach: | They propose a modality-aware adaptive post-training recipe that constrains preference updates to the semantic channel and improves acoustic behavior via explicit anchoring. |
| Outcome: | The proposed model improves speech quality and expressiveness across spoken dialogue benchmarks and architectures. |
OpenMEVA: A Benchmark for Evaluating Open-ended Story Generation Metrics (2021.acl-long)
Copied to clipboard
Jian Guan, Zhexin Zhang, Zhuoer Feng, Zitao Liu, Wenbiao Ding, Xiaoxi Mao, Changjie Fan, Minlie Huang
| Challenge: | Existing automatic metrics are observed to correlate poorly with human evaluation. |
| Approach: | They propose to use OpenMEVA to evaluate open-ended story generation metrics. |
| Outcome: | The proposed test suite assesses the capabilities of open-ended story generation metrics on annotated stories and auto-constructed test examples. |
GoldCoin: Grounding Large Language Models in Privacy Laws via Contextual Integrity Theory (2024.emnlp-main)
Copied to clipboard
| Challenge: | Existing research studies privacy by exploring various privacy attacks, defenses, and evaluations within narrowly predefined patterns. |
| Approach: | They propose a framework that leverages the theory of contextual integrity as a bridge to help LLMs understand the complex contexts for judicial assessing privacy violations. |
| Outcome: | The proposed framework bridges the theory of contextual integrity as a bridge, creating numerous synthetic scenarios grounded in relevant privacy statutes (e.g., HIPAA). |
Towards Process-Oriented, Modular, and Versatile Question Generation that Meets Educational Needs (2022.naacl-main)
Copied to clipboard
| Challenge: | NLP-powered automatic question generation (QG) techniques have not been widely adopted in classrooms to date. |
| Approach: | They propose to identify key impediments and improve the usability of NLP-powered automatic question generation techniques by understanding how instructors construct questions and identifying touch points to enhance the underlying NLP models. |
| Outcome: | The proposed methods can be used by 11 instructors across 7 universities and highlight their needs and needs when creating questions. |
Deeper Insights Without Updates: The Power of In-Context Learning Over Fine-Tuning (2024.findings-emnlp)
Copied to clipboard
| Challenge: | Fine-tuning and in-context learning are two prevalent methods in imbuing large language models with task-specific knowledge. |
| Approach: | They propose to use a circuit shift theory to explain why in-context learning is superior to fine-tuning for tasks with implicit patterns. |
| Outcome: | The proposed method can grasp deep patterns and significantly improve accuracy on implicit patterns, compared with fine-tuning and in-context learning. |
Improving Contextual Query Rewrite for Conversational AI Agents through User-preference Feedback Learning (2023.emnlp-industry)
Copied to clipboard
| Challenge: | Contextual query rewriting (CQR) is a crucial component in Conversational AI agents, leveraging contextual information from previous user-agent conversations to improve comprehension of current user intent. |
| Approach: | They propose a framework to enhance the CQR model's capability in generating user preference-aligned rewrites. |
| Outcome: | The proposed framework improves the CQR model's ability to generate user preference-aligned rewrites. |
Synchronous Faithfulness Monitoring for Trustworthy Retrieval-Augmented Generation (2024.emnlp-main)
Copied to clipboard
| Challenge: | Existing studies show that RALMs generate baseless information or contradicts with the retrieved context. |
| Approach: | They propose a lightweight monitor that leverages fine-grained decoding dynamics to synchronously detect unfaithful sentences. |
| Outcome: | Empirical results show that SynCheck outperforms baseline faithfulness detection and FOD outperformed traditional strategies in terms of faithfulness. |
Incorporating Object-Level Visual Context for Multimodal Fine-Grained Entity Typing (2023.findings-emnlp)
Copied to clipboard
| Challenge: | Experimental results show that fine-grained entity typing is superior to text-based methods. |
| Approach: | They propose a task called fine-grained entity typing to classify entities . they propose combining textual and visual contexts to capture fine-granular semantic information . |
| Outcome: | The proposed approach achieves superior classification performance compared to previous text-based approaches. |
Scaling Behaviors of LLM Reinforcement Learning Post-Training: An Empirical Study in Mathematical Reasoning (2026.acl-long)
Copied to clipboard
Zelin Tan, Hejia Geng, Xiaohang Yu, Mulei Zhang, Guancheng Wan, Yifan Zhou, Qiang He, Xiangyuan Xue, Heng Zhou, Yutao Fan, Zhong-Zhi Li, Zaibin Zhang, Guibin Zhang, Chen Zhang, Zhenfei Yin, Philip Torr, Lei Bai
| Challenge: | elucidating scaling laws for large language models (LLMs) during pre-training remains unexplored. |
| Approach: | They characterize how model scale, data, and compute interact during pre-training . they find that large models consistently demonstrate superior compute and data efficiency . |
| Outcome: | The proposed scaling laws offer practical guidance for scaling reasoning capabilities through reinforcement learning post-training. |
Advancing Large Language Model Attribution through Self-Improving (2024.emnlp-main)
Copied to clipboard
Lei Huang, Xiaocheng Feng, Weitao Ma, Liang Zhao, Yuchun Fan, Weihong Zhong, Dongliang Xu, Qing Yang, Hongtao Liu, Bing Qin
| Challenge: | Teaching large language models to generate text with citations to evidence sources requires high-quality attribution data, which is costly and labor-intensive. |
| Approach: | They propose a framework for iteratively improving the attribution capability of large language models (LLMs) by attributing output to verifiable sources. |
| Outcome: | Experiments on three open-domain question-answering datasets show that START improves in aggregating information across multiple sources. |
TeachMaster: Generative Teaching via Code (2026.acl-industry)
Copied to clipboard
Yuheng Wang, Runde Yang, Lin Wu, Jie Zhang, Jingru Fan, Tianle Zhou, Ruoyu Fu, Huatao Li, Ruijie Shi, Siheng Chen, Weinan E, Chen Qian
| Challenge: | Existing methods for creating video content are limited by high costs and slow update cycles. |
| Approach: | They propose a paradigm shifting educators from manual creators to high-level directors who focus on pedagogical intents while agents handle execution. |
| Outcome: | The proposed framework reduces production costs to 0.3% of traditional course videos and provides a robust solution for scalable education. |
Emotion-Cause Pair Extraction as Sequence Labeling Based on A Novel Tagging Scheme (2020.emnlp-main)
Copied to clipboard
| Challenge: | Existing methods to extract emotions and causes from unannotated emotion texts are labor intensive and limited applications in real-world scenarios. |
| Approach: | They propose a novel task to find emotions and corresponding causes in unannotated emotion texts. |
| Outcome: | The proposed model outperforms the state-of-the-art method by 2.26% (p0.001) in F1 measure. |
Similarity = Value? Consultation Value-Assessment and Alignment for Personalized Search (2025.emnlp-main)
Copied to clipboard
| Challenge: | Existing methods rely on semantic similarity to align historical consultations with current queries due to the absence of ‘value’ labels, but this lacks exploration of needs in user consultations. |
| Approach: | They propose a consultation value assessment framework that evaluates historical consultations from three novel perspectives: (1) Scenario Scope Value, (2) Posterior Action Value, and (3) Time Decay Value. |
| Outcome: | The proposed model outperforms baselines on public and commercial datasets on both retrieval and ranking tasks. |
Easy and Efficient Transformer: Scalable Inference Solution For Large NLP Model (2022.naacl-industry)
Copied to clipboard
Gongzheng Li, Yadong Xi, Jingzhen Ding, Duan Wang, Ziyang Luo, Rongsheng Zhang, Bai Liu, Changjie Fan, Xiaoxi Mao, Zeng Zhao
| Challenge: | Recent studies show that transformer-based models are effective over many tasks, but they are expensive to deploy in the industrial application. |
| Approach: | They propose a transformer-based inference solution that optimizes kernels for long inputs and large hidden sizes and a flexible CUDA memory manager to reduce the memory footprint when deploying a large model. |
| Outcome: | The proposed solution achieves an average speedup of 1.40-4.20x on the transformer decoder layer with an A100 GPU. |
Nano: Nested Human-in-the-Loop Reward Learning for Few-shot Language Model Control (2023.findings-acl)
Copied to clipboard
| Challenge: | Existing methods for controlling the distribution of generated text only work with quantified distributions, which require pre-defined categories, proportions of the distribution, or an existing corpus following the desired distributions. |
| Approach: | They propose a few-shot human-in-the-loop training algorithm that allows distribution control for text generation via human feedback. |
| Outcome: | The proposed algorithm achieves state-of-the-art results on single topic/attribute and quantified distribution control compared to previous works. |
Multi-step Jailbreaking Privacy Attacks on ChatGPT (2023.findings-emnlp)
Copied to clipboard
| Challenge: | With the rapid evolution of large language models (LLMs), many downstream NLP tasks can be well solved given appropriate prompts. |
| Approach: | They propose to integrate ChatGPT and Bing GPT3 into their applications to create a set of LLMs that can be used to generate NLP tasks with appropriate prompts. |
| Outcome: | The proposed models can be zero-shot or few-shot learners to solve specified tasks and can even be zero or few shot learners. |
DrDiff: Dynamic Routing Diffusion with Hierarchical Attention for Breaking the Efficiency-Quality Trade-off (2025.emnlp-main)
Copied to clipboard
Jusheng Zhang, Yijia Fan, Kaitong Cai, Zimeng Huang, Xiaofei Sun, Jian Wang, Chengpei Tang, Keze Wang
| Challenge: | et al., 2019; Brown e.t al, 2023; Touvron e t al; 2024; OpenAI, 2024) Large Language Models (LLMs) have demonstrated remarkable capabilities in knowledge encoding and contextual understanding during their pretraining phase. |
| Approach: | They propose a dynamic expert scheduling mechanism that allocates computational resources based on text complexity and a hierarchical sparse attention mechanism that adjusts attention patterns according to a variety of input lengths. |
| Outcome: | The proposed framework overpowers existing methods on long-text generation benchmarks. |
Pre-training Cross-lingual Open Domain Question Answering with Large-scale Synthetic Supervision (2024.emnlp-main)
Copied to clipboard
| Challenge: | Cross-lingual open domain question answering requires multiple models, requiring substantial annotated datasets and auxiliary resources to bridge between languages. |
| Approach: | They propose a selfsupervised method that exploits Wikipedia's cross-lingual link structure . they show that the method outperforms comparable methods on supervised and zero-shot settings . |
| Outcome: | The proposed method outperforms comparable methods on supervised and zero-shot language adaptation settings. |
MedCoach: Enhancing Medical Reasoning in LLMs via Knowledge Graph-Augmented Chain-of-Thought Distillation (2026.findings-acl)
Copied to clipboard
| Challenge: | Existing methods for training specialized reasoning models for the medical domain are limited due to the scarcity of high-quality, large-scale Chain-of-Thought (CoT) data. |
| Approach: | They propose a framework that introduces a dedicated coach role to guide the student model through question decomposition. |
| Outcome: | The proposed framework smooths the learning curve in medical reasoning by facilitating domain adaptation before advancing to complex long-chain reasoning. |
PreGenie: An Agentic Framework for High-quality Visual Presentation Generation (2025.findings-emnlp)
Copied to clipboard
| Challenge: | Visual presentations are vital for effective communication, but they are limited by their complexity and lack of visual understanding. |
| Approach: | a new framework is proposed to generate high-quality visual presentations using multimodal large language models. |
| Outcome: | The proposed framework outperforms existing models in multimodal understanding and content consistency. |
Mitigating Object Hallucinations in MLLMs via Multi-Frequency Perturbations (2025.findings-emnlp)
Copied to clipboard
Shuo Li, Jiajun Sun, Guodong Zheng, Xiaoran Fan, Yujiong Shen, Yi Lu, Zhiheng Xi, Yuming Yang, Wenming Tan, Tao Ji, Tao Gui, Qi Zhang, Xuanjing Huang
| Challenge: | Multimodal large language models have demonstrated remarkable performance in visual-language tasks, but their authenticity is often compromised by object hallucinations. |
| Approach: | They propose a multi-frequency perturbation method that leverages both low-frequency and high-frequency features of images to perturb visual feature representations and explicitly suppress redundant frequency-domain features during inference. |
| Outcome: | The proposed method significantly mitigates object hallucinations across various model architectures. |
Distill Visual Chart Reasoning Ability from LLMs to MLLMs (2025.findings-emnlp)
Copied to clipboard
Wei He, Zhiheng Xi, Wanxu Zhao, Xiaoran Fan, Yiwen Ding, Zifei Shan, Tao Gui, Qi Zhang, Xuanjing Huang
| Challenge: | a new method for generating chart annotations is proposed to improve visual reasoning in multimodal large language models. |
| Approach: | They propose a code-as-intermediary translation method for distilling visual reasoning abilities from LLMs to MLLMs. |
| Outcome: | The proposed method is cost-effective, efficient and scalable. |
PLATO: Pre-trained Dialogue Generation Model with Discrete Latent Variable (2020.acl-main)
Copied to clipboard
| Challenge: | Existing pre-training models for dialogue generation have been proven effective for a wide range of tasks. |
| Approach: | They propose a dialogue generation pre-training framework that leverages bi-directional context and uni-directional characteristic of language generation. |
| Outcome: | The proposed framework is superior to existing models on three publicly available datasets. |
Into the Gray Zone: Domain Contexts Can Blur LLM Safety Boundaries (2026.acl-long)
Copied to clipboard
Ki Sen Hung, Xi Yang, Chang Liu, Haoran Li, Kejiang Chen, Changxuan Fan, Tsun On Kwok, Weiming Zhang, Xiaomeng Li, Yangqiu Song
| Challenge: | a goal of LLM alignment is to balance usefulness with harmlessness, but this conflictes when knowledge serves both legitimate and malicious purposes. |
| Approach: | They propose a framework that combines safety-research contexts with adversarial interactions to exploit a vulnerability in Jargon queries. |
| Outcome: | a framework outperforms existing methods in analyzing Jargon queries, a study shows . it achieves 93% of attacks across seven models, while remaining useful, the authors say . |
GLProtein: Global-and-Local Structure Aware Protein Representation Learning (2025.findings-emnlp)
Copied to clipboard
| Challenge: | Despite advances in protein sequence analysis, there remains potential for further exploration in integrating protein structural information. |
| Approach: | They propose a framework that integrates global structural similarity and local amino acid details to enhance protein pre-training. |
| Outcome: | The proposed framework outperforms existing methods in several bioinformatics tasks. |
A Neural Transition-based Model for Argumentation Mining (2021.acl-long)
Copied to clipboard
| Challenge: | Existing methods for identifying argumentation structures are inefficient and class imbalanced. |
| Approach: | They propose a neural transition-based model that incrementally builds an argumentation graph by generating a sequence of actions. |
| Outcome: | The proposed model can handle tree and non-tree structured argumentation without structural constraints. |
Datasets and Recipes for Video Temporal Grounding via Reinforcement Learning (2025.emnlp-industry)
Copied to clipboard
Ruizhe Chen, Tianze Luo, Zhiting Fan, Heqing Zou, Zhaopeng Feng, Guiyang Xie, Hansheng Zhang, Zhuochen Wang, Zuozhu Liu, Zhang Huaijian
| Challenge: | Existing methods for video temporal grounding suffer from limited temporal awareness and poor generalization. |
| Approach: | They propose a two-stage training framework that integrates supervised fine-tuning with reinforcement learning to improve both the accuracy and robustness of VTG models. |
| Outcome: | The proposed training framework outperforms existing models on multiple benchmarks on open-domain and challenging scenarios. |
SessionIntentBench: A Multi-task Inter-session Intention-shift Modeling Benchmark for E-commerce Customer Behavior Understanding (2026.findings-acl)
Copied to clipboard
Yuqi Yang, Weiqi Wang, Baixuan Xu, Wei Fan, Qing Zong, Chunkit Chan, Zheye Deng, Xin Liu, Yifan Gao, Changlong Yu, Chen Luo, Yang Li, Zheng Li, Qingyu Yin, Bing Yin, Yangqiu Song
| Challenge: | Existing models fail to capture and model customer intention effectively because of insufficient information exploitation and only apparent information like descriptions and titles are used. |
| Approach: | They propose to exploit existing session data to capture and model intention in E-commerce product purchase sessions using a multimodal benchmark. |
| Outcome: | The proposed framework can bridge the gap between intention understanding in simplified research cases like co-buy intention and more complex yet practical scenarios like session history. |
Improving Grammatical Error Correction by Correction Acceptability Discrimination (2024.lrec-main)
Copied to clipboard
| Challenge: | Existing Grammatical Error Correction (GEC) methods overlook the assessment of sentence-level syntax and semantics in the corrected sentence. |
| Approach: | They propose a correction acceptance discrimination task to assess sentence-level syntax and semantics in corrected sentences and a pipeline method to remove invalid corrections. |
| Outcome: | The proposed method improves F0.5 score by 1.01% over 13 GEC systems in the BEA-2019 test set. |
Why Can Distillation Work with Limited Resources? A Systematic Study (2026.findings-acl)
Copied to clipboard
Xiao Hu, Xingyu Lu, Liyuan Mao, YiFan Zhang, Tianke Zhang, Bin Wen, Fan Yang, Tingting Gao, Guorui Zhou
| Challenge: | Recent advances in large language models have driven reasoning performance . low-resource distillation can boost models' performance, but a framework is missing . |
| Approach: | They conduct a controlled experiment to find out why low-resource distillation can boost model performance . they find that distillation enhances the presence of advanced cognitive behaviors . |
| Outcome: | The proposed model shows more flexible reasoning, the authors show . they show that distillation enhances the presence of advanced cognitive behaviors . |
PAIGE: Personalized Adaptive Interactions Graph Encoder for Query Rewriting in Dialogue Systems (2022.emnlp-industry)
Copied to clipboard
| Challenge: | Existing methods to fix faulty queries are limited in their ability to fix them. |
| Approach: | They propose a Personalized Adaptive Interactions Graph Encoder that integrates user's affinities and query semantics to refine utterance embeddings. |
| Outcome: | The proposed Query Rewriting (QR) techniques improve the rewrite accuracy of state-of-the-art baselines by 12.5–17.5% while having nearly ten times fewer parameters. |
SADA: Bridging In-Context Learning and Fine-Tuning via State-Aligned Distillation Adapters (2026.acl-long)
Copied to clipboard
| Challenge: | Prompt-based in-context learning and parameter fine-tuning are dominant paradigms for incorporating external information into large language models, but they incur high inference costs or require expensive retraining. |
| Approach: | They propose to convert prompts into temporary adapter weights to bridge this gap by converting prompts to temporary adapters. |
| Outcome: | The proposed model outperforms baselines on long-context language modeling and downstream NLU and summarization benchmarks while significantly reducing memory footprint and latency. |
On the Sensitivity and Stability of Model Interpretations in NLP (2022.acl-long)
Copied to clipboard
| Challenge: | Recent years have witnessed the emergence of post-hoc interpretations that aim to uncover how NLP models make predictions. |
| Approach: | They propose two new criteria that provide complementary notions of faithfulness to removal-based criteria. |
| Outcome: | The proposed methods overcome limitations of gradient-based methods on removal-based criteria and overcome limitations in the proposed methods. |
Enhancing Distractor Generation for Multiple-Choice Questions with Retrieval Augmented Pretraining and Knowledge Graph Integration (2024.findings-acl)
Copied to clipboard
Han Cheng Yu, Yu An Shih, Kin Man Law, KaiYu Hsieh, Yu Chen Cheng, Hsin Chih Ho, Zih An Lin, Wen-Chuan Hsu, Yao-Chung Fan
| Challenge: | Existing LMs undergo task-agnostic pertaining, but task-specific pretraining has gained prominence. |
| Approach: | They propose retrieval augmented pretraining and task-specific pretraining for DG . they propose to refine language model pretraining to align it more closely with downstream task . |
| Outcome: | The proposed method improves the performance of multiple-choice questions by integrating knowledge graphs and language models. |
Predicting Personal Opinion on Future Events with Fingerprints (2020.coling-main)
Copied to clipboard
| Challenge: | Existing methods to predict users’ opinions on going events may not be able to acquire such content and thus cannot infer an unbiased opinion on emerging events. |
| Approach: | They propose to model opinion on unseen articles based on one’s fingerprinting: the prior reading and commenting history. |
| Outcome: | The proposed model can predict user’s opinion on unseen articles based on one’s fingerprinting: the prior reading and commenting history. |
A Survey on Foundation Language Models for Single-cell Biology (2025.acl-long)
Copied to clipboard
| Challenge: | Existing single-cell foundation language models are based on pre-trained and large language models. |
| Approach: | They review the development of single-cell foundation language models . they discuss data tokenization strategies and pre-training paradigms . |
| Outcome: | The proposed models have shown remarkable performance in a variety of single-cell data analysis tasks. |
A Few Thousand Translations Go a Long Way! Leveraging Pre-trained Models for African News Translation (2022.naacl-main)
Copied to clipboard
David Adelani, Jesujoba Alabi, Angela Fan, Julia Kreutzer, Xiaoyu Shen, Machel Reid, Dana Ruiter, Dietrich Klakow, Peter Nabende, Ernie Chang, Tajuddeen Gwadabe, Freshia Sackey, Bonaventure F. P. Dossou, Chris Emezue, Colin Leong, Michael Beukman, Shamsuddeen Muhammad, Guyo Jarso, Oreen Yousuf, Andre Niyongabo Rubungo, Gilles Hacheme, Eric Peter Wairagala, Muhammad Umair Nasir, Benjamin Ajibade, Tunde Ajayi, Yvonne Gitau, Jade Abbott, Mohamed Ahmed, Millicent Ochieng, Anuoluwapo Aremu, Perez Ogayo, Jonathan Mukiibi, Fatoumata Ouoba Kabore, Godson Kalipe, Derguene Mbaye, Allahsera Auguste Tapo, Victoire Memdjokam Koagne, Edwin Munkoh-Buabeng, Valencia Wagner, Idris Abdulmumin, Ayodele Awokoya, Happy Buzaaba, Blessing Sibanda, Andiswa Bukula, Sam Manthalu
| Challenge: | Low-resource languages are left out of large-scale pretraining datasets . authors explore how to leverage existing pre-trained models to create low-resourced translation systems for 16 African languages. |
| Approach: | They investigate how large-scale pre-trained models can be used to create low-resource translation systems for 16 African languages. |
| Outcome: | The proposed models can translate between hundreds of languages even though there is little parallel data available for training. |
Linguistic Cues for LLM-based Implicit Discourse Relation Classification (2026.findings-eacl)
Copied to clipboard
| Challenge: | Large language models (LLMs) have been successful in many NLP tasks, but they struggle to capture subtle lexical relations between arguments. |
| Approach: | They propose a strategy that enriches arguments with explicit lexical-level semantic cues before fine-tuning. |
| Outcome: | The proposed approach improves F1 scores in cross-domain scenarios by more than 10 points compared to baselines. |
Learning Neural Templates for Recommender Dialogue System (2021.emnlp-main)
Copied to clipboard
Zujie Liang, Huang Hu, Can Xu, Jian Miao, Yingying He, Yining Chen, Xiubo Geng, Fan Liang, Daxin Jiang
| Challenge: | Recent advances in neural models have shown promising progress on this task, but key challenges remain . |
| Approach: | They propose a framework that can decouple dialogue generation from item recommendation . they use a response template generator and item selector to generate a responses template . |
| Outcome: | The proposed framework outperforms the state-of-the-art methods on the benchmark ReDial. |
PrivLM-Bench: A Multi-level Privacy Evaluation Benchmark for Language Models (2024.acl-long)
Copied to clipboard
Haoran Li, Dadi Guo, Donghao Li, Wei Fan, Qi Hu, Xin Liu, Chunkit Chan, Duanyi Yao, Yuan Yao, Yangqiu Song
| Challenge: | generative large language models (LLMs) exhibit surprising capability and integrate previous tasks into a unified text generation formulation. |
| Approach: | They propose a privacy evaluation benchmark to quantify the privacy leakage of language models. |
| Outcome: | The proposed benchmark compares PPLMs with different privacy implementations to find out how privacy leakage is handled. |
Syntax Controlled Knowledge Graph-to-Text Generation with Order and Semantic Consistency (2022.findings-naacl)
Copied to clipboard
| Challenge: | Existing knowledge graph-to-text generation methods focus on sequence-to sequence generation, but the linearized order of KG is obtained through a heuristic search without data-driven optimization. |
| Approach: | They propose to generate easy-to-understand sentences from the knowledge graph . they incorporate part-of-speech syntactic tags to constrain the positions to copy words from the KG and employ a semantic context scoring function to evaluate the semantic fitness for each word in its local context. |
| Outcome: | The proposed method achieves state-of-the-art on two datasets, WebNLG and DART, and achieves high consistency. |
Two-stage Incomplete Utterance Rewriting on Editing Operation (2025.coling-main)
Copied to clipboard
| Challenge: | Existing methods to generate rewritten utterances based on dialogue context ignore coreference and ellipsis in dialogues. |
| Approach: | They propose a framework where the first stage generates editing operations and the second stage rewrites incomplete utterances utilizing the generated editing operations. |
| Outcome: | The proposed framework outperforms the existing models on three IUR datasets. |
Aspect-Based Sentiment Analysis with Syntax-Opinion-Sentiment Reasoning Chain (2025.coling-main)
Copied to clipboard
| Challenge: | Syntactic structures are crucial for capturing aspect-opinion relationships . syntactically based models struggle with linguistic complexities . |
| Approach: | They propose a syntactic-opinion-sentiment reasoning framework that leverages syntaktic information to improve ABSA performance. |
| Outcome: | The proposed framework improves ABSA performance, though smaller LLMs exhibit weaker performance. |
TDCSA: LLM-Guided Top-Down Approach for Robust Citation Sentiment Analysis (2025.findings-acl)
Copied to clipboard
| Challenge: | Citation Sentiment Analysis (CSA) is a key part of academic influence and knowledge diffusion. |
| Approach: | They propose a top-down framework that leverages LLMs’ semantic understanding capabilities to enhance PLM-based Citation Sentiment Analysis. |
| Outcome: | The proposed framework outperforms existing methods while maintaining robustness to quadruple quality variations. |
Discovering Representation Sprachbund For Multilingual Pre-Training (2021.findings-emnlp)
Copied to clipboard
| Challenge: | Existing models perform poorly on many languages and cross-lingual tasks due to typological differences and contradictions between some languages. |
| Approach: | They propose to pre-train multilingual pre-trained models to handle cross-lingual tasks in one model. |
| Outcome: | The proposed model improves performance on cross-lingual tasks compared to baselines on multiple languages . |
ELI5: Long Form Question Answering (P19-1)
Copied to clipboard
| Challenge: | Existing question answering datasets provide extractive or short answers, but less attention has been paid to open-ended questions that require explanations. |
| Approach: | They present a large-scale corpus for long form question answering . they use a Reddit forum to provide elaborate answers to open-ended questions . |
| Outcome: | The proposed model outperforms Seq2Seq, language modeling, and other models in human evaluations. |
Answering Complex Geographic Questions by Adaptive Reasoning with Visual Context and External Commonsense Knowledge (2025.acl-long)
Copied to clipboard
| Challenge: | a new task of answering geographic reasoning questions based on the given image is proposed . the task requires identifying the objects in the image and understanding the background context . |
| Approach: | They propose a task of answering geographic reasoning questions based on the given image . they analyze the image and describe its fine-grained content by text and keywords . |
| Outcome: | The proposed method can be used to answer geographic reasoning questions based on an image . it can be applied to a large-scale dataset with 41,329 samples . |
Denoising Concept Vectors with Sparse Autoencoders for Improved Language Model Steering (2026.findings-eacl)
Copied to clipboard
| Challenge: | Existing methods for steering concept vectors suffer from noisy features in diverse datasets that undermine steering robustness. |
| Approach: | They propose a Sparse Autoencoder-Denoised Concept Vector (SDCV) which selectively keeps the most discriminative SAE latents while reconstructing hidden representations. |
| Outcome: | The proposed method improves steering success rates by 4-16% across six challenging concepts while maintaining topic relevance. |
Inside Out: Evolving User-Centric Core Memory Trees for Long-Term Personalized Dialogue Systems (2026.acl-long)
Copied to clipboard
| Challenge: | Existing personalized dialogue systems struggle to reconcile unbounded interactions with finite context constraints. |
| Approach: | They propose a framework that utilizes a globally maintained PersonaTree as the carrier of long-term user profiling. |
| Outcome: | The proposed framework outperforms existing systems in suppressing contextual noise and persona inconsistency. |
Distractor Generation based on Text2Text Language Models with Pseudo Kullback-Leibler Divergence Regulation (2023.findings-acl)
Copied to clipboard
Hui-Juan Wang, Kai-Yu Hsieh, Han-Cheng Yu, Jui-Ching Tsou, Yu An Shih, Chen-Hua Huang, Yao-Chung Fan
| Challenge: | Existing methods for cloze-style multiple choice questions (MCQs) distractor generation are based on knowledge bases and pre-trained language models. |
| Approach: | They propose to formulate cloze distractor generation task as Text2Text task and propose a pseudo Kullback-Leibler divergence for regulating the generation to consider item discrimination index in education evaluation. |
| Outcome: | The proposed model improves state-of-the-art performance from 10.81 to 22.00 (p@1 score) |
VenusFactory: An Integrated System for Protein Engineering with Data Retrieval and Language Model Fine-Tuning (2025.acl-demo)
Copied to clipboard
Yang Tan, Chen Liu, Jingyuan Gao, Wu Banghao, Mingchen Li, Ruilin Wang, Lingrong Zhang, Huiqun Yu, Guisheng Fan, Liang Hong, Bingxin Zhou
| Challenge: | Pre-trained protein language models have been used in protein engineering, but their adoption is limited due to data collection, task benchmarking, and application challenges. |
| Approach: | They propose a versatile engine that integrates biological data retrieval, standardized task benchmarking, and modular fine-tuning of PLMs. |
| Outcome: | The proposed engine integrates biological data retrieval, task benchmarking, and modular fine-tuning of PLMs. |
Know More about Each Other: Evolving Dialogue Strategy via Compound Assessment (P19-1)
Copied to clipboard
| Challenge: | Existing approaches to generate informative responses based on external knowledge are limited to singleround settings. |
| Approach: | They propose a framework for multi-turn conversations with two dialogue agents . they propose to evaluate dialogues on informativeness and coherence . |
| Outcome: | The proposed framework outperforms state-of-the-art approaches significantly on the publicly available dataset. |
Not Just Classification: Recognizing Implicit Discourse Relation on Joint Modeling of Classification and Generation (2021.emnlp-main)
Copied to clipboard
| Challenge: | Existing methods of implicit discourse relation recognition (IDRR) focus on three aspects: enhancing discourse units representation, enhancing semantic interaction, and joint learning with other tasks. |
| Approach: | They propose a joint model to recognize the relation label and generate the target sentence containing the meaning of relations simultaneously. |
| Outcome: | The proposed model achieves the best performance against several state-of-the-art systems on Chinese and English datasets. |
Long Text Generation by Modeling Sentence-Level and Discourse-Level Coherence (2021.acl-long)
Copied to clipboard
| Challenge: | Existing generation models struggle to maintain a coherent event sequence throughout the generated text. |
| Approach: | They propose a long text generation model which can represent prefix sentences at sentence level and discourse level in the decoding process. |
| Outcome: | The proposed model can generate more coherent texts than state-of-the-art models. |
Multimodal Context Carryover (2022.emnlp-industry)
Copied to clipboard
Prashan Wanigasekara, Nalin Gupta, Fan Yang, Emre Barut, Zeynab Raeesy, Kechen Qin, Stephen Rawls, Xinyue Liu, Chengwei Su, Spurthi Sandiri
| Challenge: | Existing voice-only dialogue systems lack multimodality support, which can lead to costly system redesigns. |
| Approach: | They propose to augment existing voice-only dialogue systems with additional multimodal components to facilitate quick delivery of visual modality support with minimal changes. |
| Outcome: | The proposed framework improves visual modality support with minimal changes on an in-house multi-modal visual navigation data set. |
A Novel Negative Sample Generation Method for Contrastive Learning in Hierarchical Text Classification (2025.coling-main)
Copied to clipboard
| Challenge: | Existing methods for hierarchical text classification struggle with fine-grained labels, leading to difficulties in accurate classification. |
| Approach: | They propose a hierarchical sequence ranking method for generating diverse negative samples using hierarchically structured hierarchic labels. |
| Outcome: | The proposed method achieves state-of-art (SOTA) on two datasets showing that it can distinguish between fine-grained labels and discriminate. |
Summarize, Outline, and Elaborate: Long-Text Generation via Hierarchical Supervision from Extractive Summaries (2022.coling-1)
Copied to clipboard
| Challenge: | Existing models focus on local word prediction, and cannot make high level plans on what to generate. |
| Approach: | They propose a pipelined system that summarises, outlines and elaborates on each bullet point to generate the corresponding segment. |
| Outcome: | The proposed system produces long texts with significantly better quality and faster convergence speed. |
SafeRAG: Benchmarking Security in Retrieval-Augmented Generation of Large Language Model (2025.acl-long)
Copied to clipboard
Xun Liang, Simin Niu, Zhiyu Li, Sensen Zhang, Hanyu Wang, Feiyu Xiong, Zhaoxin Fan, Bo Tang, Jihao Zhao, Jiawei Yang, Shichao Song, Mengwei Wang
| Challenge: | Existing approaches to integrating external knowledge into large language models (LLMs) however, the incorporation of external knowledge increases the vulnerability of LLMs . |
| Approach: | They propose a benchmark to evaluate the RAG security using a dataset . they classify attack tasks into silver noise, inter-context conflict, soft ad, and white Denial-of-Service . |
| Outcome: | The proposed benchmark evaluates the security of RAG against 14 representative RAG components. |
Ambiguous Learning from Retrieval: Towards Zero-shot Semantic Parsing (2023.acl-long)
Copied to clipboard
Shan Wu, Chunlei Xin, Hongyu Lin, Xianpei Han, Cao Liu, Jiansong Chen, Fan Yang, Guanglu Wan, Le Sun
| Challenge: | Existing neural semantic parsers require a large amount of training data which is expensive and difficult to obtain. |
| Approach: | They propose a framework for a supervised retrieval system based on pretrained language models . they propose ambiguous supervision to improve the precision and coverage of the task . |
| Outcome: | The proposed approach outperforms state-of-the-art zero-shot parsing methods in ambiguous supervision. |
Query Enhanced Knowledge-Intensive Conversation via Unsupervised Joint Modeling (2023.acl-long)
Copied to clipboard
| Challenge: | Existing methods to retrieve knowledge-intensive conversations are based on external resources such as Wikipedia databases or search engine results. |
| Approach: | They propose an unsupervised query enhanced approach for knowledge-intensive conversations . they conduct experiments on three knowledge- intensive conversation datasets . |
| Outcome: | The proposed approach performs better than all unsupervised methods across three datasets and achieves competitive performance compared to supervised methods. |
When More Thinking Hurts: Overthinking in LLM Test-Time Compute Scaling (2026.findings-acl)
Copied to clipboard
| Challenge: | Existing research implicitly assumes that longer thinking leads to better results . a recent study suggests that test-time compute scaling is more effective than model scaling . |
| Approach: | They challenge the assumption that longer thinking yields better results . they show that models exhibit overthinking and marginal returns diminish at higher budgets . |
| Outcome: | The proposed framework reduces computation significantly while maintaining comparable accuracy. |
Natural Evolution-based Dual-Level Aggregation for Temporal Knowledge Graph Reasoning (2024.findings-emnlp)
Copied to clipboard
| Challenge: | Existing models ignore asynchronous characteristics of event evolution, resulting in suboptimal performance. |
| Approach: | They propose a Natural Evolution-based Dual-level Aggregation framework for TKG reasoning that incorporates asynchronous characteristics of event evolution into the model. |
| Outcome: | The proposed model incorporates the asynchronous characteristics of event evolution for representation computation, thus improving prediction performance. |
Incorporating Multimodal Information in Open-Domain Web Keyphrase Extraction (2020.emnlp-main)
Copied to clipboard
| Challenge: | Open-domain Keyphrase extraction (KPE) is a fundamental yet complex NLP task . effective designs encode within layout and formatting signals that point to where the important information can be found. |
| Approach: | They propose a multi-modal approach to open-domain keyphrase extraction (KPE) on the Web that leverages layout and formatting signals to aid in the task. |
| Outcome: | The proposed model outperforms state-of-the-art models on the open-domain keyphrase extraction task. |
PLATO-2: Towards Building an Open-Domain Chatbot via Curriculum Learning (2021.findings-acl)
Copied to clipboard
| Challenge: | PLATO-2 is a high-quality open-domain chatbot that can generate one-to-many mappings and improve response quality. |
| Approach: | They propose a curriculum learning process to build a high-quality open-domain chatbot . they use a coarse-grained generation model and latent variables to train a generative model . |
| Outcome: | The proposed model improves on Chinese and English data and can generate diverse responses and select the best response. |
Multilingual Knowledge Graph Completion via Ensemble Knowledge Transfer (2020.findings-emnlp)
Copied to clipboard
| Challenge: | Existing methods for learning missing facts in knowledge graphs are limited by insufficiency of alignment information and inconsistency of described facts. |
| Approach: | They propose a framework for embedding learning and ensemble knowledge transfer across KGs. |
| Outcome: | The proposed framework improves state-of-the-art methods on language-specific KGs. |
RefGPT: Dialogue Generation of GPT, by GPT, and for GPT (2023.findings-emnlp)
Copied to clipboard
| Challenge: | Large Language Models (LLMs) have impressive capability to resolve a wide range of NLP tasks by fine-tuning high-quality instruction data. |
| Approach: | They propose a method to generate huge truthful and customized dialogues without worrying about factual errors caused by the model hallucination. |
| Outcome: | The proposed method solves the model hallucination in dialogue generation by restricting the LLMs to leverage the given reference instead of reciting their own knowledge to generate dialogues. |
Hate Speech Detection Based on Sentiment Knowledge Sharing (2021.acl-long)
Copied to clipboard
| Challenge: | Existing methods for hate speech detection are stereotyped and biased . et al., a paper examining the effectiveness of multitask learning in hate speech recognition tasks . |
| Approach: | They propose a hate speech detection framework based on sentiment knowledge sharing . they extract affective features of the target sentence and use sentiment features from external resources . |
| Outcome: | The proposed model can detect hate speech over two public datasets. |
Multi-grained Named Entity Recognition (P19-1)
Copied to clipboard
| Challenge: | Existing approaches treat Named Entity Recognition (NER) as a sequence labeling task. |
| Approach: | They propose a framework for Multi-Grained Named Entity Recognition where multiple entities or entity mentions in a sentence could be non-overlapping or totally nested. |
| Outcome: | The proposed framework outperforms current state-of-the-art frameworks by 4.4% in terms of the F1 score among nested/non-overlapping NER tasks. |
Beyond Scaling: Measuring and Predicting the Upper Bound of Knowledge Retention in Language Model Pre-Training (2026.acl-long)
Copied to clipboard
Changhao Jiang, Ming Zhang, Yifei Cao, Junjie Ye, Xiaoran Fan, Shihan Dou, Zhiheng Xi, Jiajun Sun, Yi Dong, Yujiong Shen, Jingqi Tong, Baoyu Fan, Tao Gui, Qi Zhang, Xuanjing Huang
| Challenge: | Existing methods to predict performance of large language models are lacking . authors propose a size-dependent mutual information predictor for closed-book question answering accuracy . |
| Approach: | They propose a size-dependent mutual information predictor that integrates knowledge frequency, knowledge specificity, and model size to forecast closed-book question answering accuracy. |
| Outcome: | The proposed method outperforms baseline models and achieves R2 > 0.7 in predicting QA accuracy without additional training. |
STRIDE-ED: A Strategy-Grounded Stepwise Reasoning Framework for Empathetic Dialogue Systems (2026.acl-long)
Copied to clipboard
| Challenge: | Empathetic dialogue requires not only recognizing a user’s emotional state but also making strategy-aware, context-sensitive decisions throughout response generation. |
| Approach: | They propose a STRategy-grounded, interpretable, and DEep reasoning framework that models Empathetic Dialogue through structured, strategy-conditioned reasoning. |
| Outcome: | The proposed framework outperforms existing methods on automatic metrics and human evaluations. |
Improving Contextual Faithfulness of Large Language Models via Retrieval Heads-Induced Optimization (2025.acl-long)
Copied to clipboard
Lei Huang, Xiaocheng Feng, Weitao Ma, Yuchun Fan, Xiachong Feng, Yangfan Ye, Weihong Zhong, Yuxuan Gu, Baoxin Wang, Dayong Wu, Guoping Hu, Bing Qin
| Challenge: | Existing frameworks for retrieval-augmented large language models (LLMs) are lacking in LFQA faithfulness testing. |
| Approach: | They propose a framework to teach retrieval-augmented large language models to explicitly discriminate between faithful and unfaithful generations. |
| Outcome: | The proposed framework outperforms GPT-4o in LFQA scenarios and outperformed existing benchmarks. |
Hyperlink-induced Pre-training for Passage Retrieval in Open-domain Question Answering (2022.acl-long)
Copied to clipboard
Jiawei Zhou, Xiaoguang Li, Lifeng Shang, Lan Luo, Ke Zhan, Enrui Hu, Xinyu Zhang, Hao Jiang, Zhao Cao, Fan Yu, Xin Jiang, Qun Liu, Lei Chen
| Challenge: | Existing methods to train dense passage retrieval have a large data gap between upstream and downstream relevance. |
| Approach: | They propose a method to pre-train the dense retriever with the text relevance induced by hyperlinks within Web documents. |
| Outcome: | The proposed method outperforms existing methods under different scenarios and in the open-domain question answering domain. |
Learning Diverse Responses with Prefix-Conditioned Supervised Fine-Tuning (2026.acl-long)
Copied to clipboard
| Challenge: | Large language models exhibit highly homogeneous, repetitive responses, resulting in inefficient exploration. |
| Approach: | They propose a method that constructs semantically consistent yet distributionally distinct prior contents to different responses and decouple the one-to-many mapping. |
| Outcome: | The proposed method improves absolute performance by 5.3% and increases generation diversity by 198.3% on average while significantly enhancing output diversity and test-time scaling. |
Untangle the KNOT: Interweaving Conflicting Knowledge and Reasoning Skills in Large Language Models (2024.lrec-main)
Copied to clipboard
| Challenge: | Existing studies have explained to what extent LLMs extract conflicting knowledge from the provided text, but they neglect the necessity to reason with conflicting information. |
| Approach: | They construct a dataset for knowledge conflict resolution examination in the form of question answering that divides reasoning with conflicting knowledge into three levels. |
| Outcome: | The proposed dataset enables analysis of reasoning with conflicting knowledge in the form of question answering. |
Joint Slot Filling and Intent Detection via Capsule Neural Networks (P19-1)
Copied to clipboard
| Challenge: | Existing models that label slots and detect intent do not preserve hierarchical relationship between words, slots, and intents. |
| Approach: | They propose a capsule-based neural network model which performs slot filling and intent detection via a dynamic routing-by-agreement schema. |
| Outcome: | The proposed model performs better than existing models and existing models on real-world datasets. |
A STEP towards Interpretable Multi-Hop Reasoning:Bridge Phrase Identification and Query Expansion (2022.lrec-1)
Copied to clipboard
| Challenge: | Identifying bridge phrases remains one of the challenges for multi-hop question answering . |
| Approach: | They propose an unsupervised method for the identification of bridge phrases in multi-hop question answering . they construct a graph of noun phrases from the question and available context . |
| Outcome: | The proposed method improves all downstream components in a multi-hop QA system. |
KuiLeiXi: a Chinese Open-Ended Text Adventure Game (2021.acl-demo)
Copied to clipboard
Yadong Xi, Xiaoxi Mao, Le Li, Lei Lin, Yanjiang Chen, Shuhan Yang, Xuhan Chen, Kailun Tao, Zhi Li, Gongzheng Li, Lin Jiang, Siyan Liu, Zeng Zhao, Minlie Huang, Changjie Fan, Zhipeng Hu
| Challenge: | Recent advances in pre-trained language models have made it possible to generate human-like text. |
| Approach: | They propose to integrate an open-ended text adventure game in Chinese, named KuiLeiXi, where players interact with the AI until the plot goals are reached. |
| Outcome: | The proposed game lacks incentives and relies on players to explore on their own. |
One-Dimensional Object Detection for Streaming Text Segmentation of Meeting Dialogue (2025.findings-acl)
Copied to clipboard
Rui He, Zhongqing Wang, Minjie Qiang, Hongling Wang, Yifan.zhang Yifan.zhang, Hua Xu, Shuai Fan, Guodong Zhou
| Challenge: | Current text segmentation models exhibit numerous limitations, such as imbalances in labels that affect the stability of model training and discrepancies between the model’s training tasks (sentence classification) and the actual text segmenting. |
| Approach: | They implement a sliding window-based segmentation method and employ two different levels of sliding window based balanced label strategies to stabilize the training process of the streaming segmentation model. |
| Outcome: | The proposed method is robust, controllable, and achieves state-of-the-art performance. |
EdgeInfinite: A Memory-Efficient Infinite-Context Transformer for Edge Devices (2025.acl-industry)
Copied to clipboard
| Challenge: | Existing KV cache optimizations struggle with irreversible token eviction in long-output tasks . alternative sequence modeling architectures prove costly to adopt within established Transformer infrastructures. |
| Approach: | They propose a memory-efficient solution for infinite contexts that integrates compressed memory into Transformer-based LLMs through a trainable memory-gating module. |
| Outcome: | The proposed solution achieves comparable performance to baseline Transformer-based LLMs while optimizing memory consumption and time to first token. |
Non-Emotion-Centric Empathetic Dialogue Generation (2025.coling-main)
Copied to clipboard
| Challenge: | Empathy is a social psychology theory that enables individuals to comprehend each other's experiences and emotions, thereby fostering more intimate interpersonal relationships. |
| Approach: | They propose a framework for empathetic dialogue generation based on contrastive learning and context-sensitive entity and social commonsense that punishes responses with incorrect emotions and improves the quality of emotions. |
| Outcome: | The proposed framework improves the quality of empathetic generation and generates more diverse responses in comparison with the state-of-the-art baselines. |
R2H: Building Multimodal Navigation Helpers that Respond to Help Requests (2023.emnlp-main)
Copied to clipboard
| Challenge: | Existing dialog-based embodied datasets are not sufficient to develop intelligent navigation-helper agents capable of navigating users in unfamiliar areas. |
| Approach: | They introduce a novel benchmark, Respond to Help Requests, to promote the development of multi-modal navigation helpers capable of responding to requests for help . they also propose two approaches to construct the navigation-helper agent, including fine-tuning a task-oriented multi-mod response generation model that can see and respond, named SeeRee, and employing . a multi-module large language model in a zero-shot manner. |
| Outcome: | The proposed model outperforms the baseline model and the proposed model on two tasks based on human evaluations and automatic benchmarking. |
ASTRA: An Automated Framework for Strategy Discovery, Retrieval, and Evolution for Jailbreaking LLMs (2026.acl-long)
Copied to clipboard
| Challenge: | Existing methods lack the capability for continuous learning and self-evolution from interactions, limiting the diversity and adaptability of attack strategies. |
| Approach: | They propose an automated framework capable of discovering, retrieving, and evolving attack strategies. |
| Outcome: | The proposed framework outperforms existing baselines in a black-box setting. |
LANG: Reinforcement Learning for Multilingual Reasoning with Language-Adaptive Hint Guidance (2026.acl-long)
Copied to clipboard
Yuchun Fan, Bei Li, Peiguang Li, Yilin Wang, Yongyu Mu, Jian Yang, Xin Chen, Rongxiang Weng, Jingang Wang, Xunliang Cai, JingBo Zhu, Tong Xiao
| Challenge: | Existing methods for enhancing multi-step reasoning have not fully translated to multilingual contexts. |
| Approach: | They propose a framework that leverages language-conditioned hints to guide exploration in non-English reasoning tasks. |
| Outcome: | Empirical results show that the proposed framework improves reasoning performance without compromising language consistency. |
Small Data, Big Impact: Leveraging Minimal Data for Effective Machine Translation (2023.acl-long)
Copied to clipboard
Jean Maillard, Cynthia Gao, Elahe Kalbassi, Kaushik Ram Sadagopan, Vedanuj Goswami, Philipp Koehn, Angela Fan, Francisco Guzman
| Challenge: | Existing datasets are not economical to create large-scale datasets, but for low-resource languages, a few thousand professionally translated sentence pairs can be useful. |
| Approach: | They propose to use a dataset to train machine translation models on pre-existing and synthetic data to augment them with millions of sentences through backtranslation. |
| Outcome: | The proposed model can cover hundreds of languages with high quality training data even when smaller but lower quality datasets are used. |
IntelliCockpitBench: A Comprehensive Benchmark to Evaluate VLMs for Intelligent Cockpit (2025.findings-acl)
Copied to clipboard
| Challenge: | Visual Question Answering (VQA) is a key task in vehicular systems. |
| Approach: | They propose a benchmark that encompasses diverse automotive scenarios . they use images from front, side, and rear cameras, various road types, weather conditions, and interior views . |
| Outcome: | The proposed benchmark includes images from front, side, and rear cameras, various road types, weather conditions, and interior views. |
Mitigating Training Imbalance in LLM Fine-Tuning via Selective Parameter Merging (2024.emnlp-main)
Copied to clipboard
| Challenge: | Existing studies suggest that the order of training samples can affect model performance, but this is not the case. |
| Approach: | They propose to merge supervised fine-tuning models with different data orders to mitigate this imbalance by parameter merging. |
| Outcome: | The proposed method outperforms the weighted-average method on five datasets. |