Papers with generation
AI-assisted Scientific Discovery, Experimentation, Content Generation, and Evaluation (2026.eacl-tutorials)
Copied to clipboard
| Challenge: | This tutorial provides an overview of recent advances in AI-assisted tools and models that support and enhance the scientific research process. |
| Approach: | This tutorial provides an overview of recent advances in AI-assisted tools and models that support and enhance the scientific research process. |
| Outcome: | This tutorial provides an overview of recent advances in AI-assisted tools and models that support and enhance the scientific research process. |
Text Diffusion Model with Encoder-Decoder Transformers for Sequence-to-Sequence Generation (2024.naacl-long)
Copied to clipboard
| Challenge: | Existing diffusion models are applied to continuous feature space while texts are sequences of discrete categorical tokens. |
| Approach: | They propose to use an encoder-decoder Transformer architecture to approach sequence-to-sequence text generation. |
| Outcome: | The proposed model improves on five sequence-to-sequence generation tasks compared to other diffusion-based models regarding text quality and inference time. |
GAP-Gen: Guided Automatic Python Code Generation (2023.eacl-srw)
Copied to clipboard
| Challenge: | Several previous approaches convert a sentence into a formal statement by mapping verbs to functions in the formal language. |
| Approach: | They propose a Guided Automatic Python Code Generation method based on Python syntactic constraints and semantic constraints. |
| Outcome: | The proposed method achieves better results on automatic Python code generation task than previous methods. |
RaLLe: A Framework for Developing and Evaluating Retrieval-Augmented Large Language Models (2023.emnlp-demo)
Copied to clipboard
Yasuto Hoshi, Daisuke Miyashita, Youyang Ng, Kento Tatsuno, Yasuhiro Morioka, Osamu Torii, Jun Deguchi
| Challenge: | Existing libraries for building R-LLMs provide high-level abstractions without sufficient transparency for evaluating and optimizing prompts within specific inference processes. |
| Approach: | They propose an open-source framework to facilitate the development, evaluation, and optimization of R-LLMs for knowledge-intensive tasks. |
| Outcome: | The framework improves hand-crafted prompts, inference processes and quantitatively measures overall system performance. |
Early-Exit and Instant Confidence Translation Quality Estimation (2026.eacl-long)
Copied to clipboard
| Challenge: | Quality estimation models are often opaque and computationally expensive, making them impractical to be part of large-scale pipelines. |
| Approach: | They propose an uncertainty-aware quality estimation model that matches previous approaches at a fraction of their costs. |
| Outcome: | The proposed method reduces evaluation costs by 50% and improves reranking performance. |
Learning with Limited Text Data (2022.acl-tutorials)
Copied to clipboard
| Challenge: | Natural Language Processing (NLP) relies on labeled data to perform state-of-the-art performance . labeles are often required to label large amounts of textual data . this tutorial will provide an overview of labeleing in NLP . |
| Approach: | This tutorial will provide a systematic overview of methods for learning from limited labeled data. |
| Outcome: | This tutorial will provide a systematic and up-to-date overview of the proposed methods . it will highlight current challenges and future directions . |
Deep Reinforcement Learning for NLP (P18-5)
Copied to clipboard
| Challenge: | Many natural language processing tasks can be formulated as deep reinforcement learning (DRL) problems. |
| Approach: | This tutorial provides an introduction to the foundations of deep reinforcement learning . it describes recent advances in designing deep reinforcement for NLP . |
| Outcome: | This tutorial provides an introduction to the foundations of deep reinforcement learning and some practical solutions for NLP tasks. |
Guiding Generation for Abstractive Text Summarization Based on Key Information Guide Network (N18-2)
Copied to clipboard
| Challenge: | Abstractive text summarization models are hard to be controlled in the process of generation, which leads to a lack of key information. |
| Approach: | They propose a guiding generation model that combines extractive and abstractive methods to generate text summarization. |
| Outcome: | The proposed model improves on the CNN/Daily Mail dataset. |
Consultation Checklists: Standardising the Human Evaluation of Medical Note Generation (2022.emnlp-industry)
Copied to clipboard
Aleksandar Savkov, Francesco Moramarco, Alex Papadopoulos Korfiatis, Mark Perera, Anya Belz, Ehud Reiter
| Challenge: | Existing studies have shown that note generation is difficult due to subjective nature of many aspects of output quality. |
| Approach: | They propose a protocol that aims to increase objectivity by grounding evaluations in Consultation Checklists, which are created in a preliminary step and then used as a common point of reference during quality assessment. |
| Outcome: | The proposed protocol shows that the evaluations produced in the study are more objective than the original human note. |
Template-guided Grammatical Error Feedback Comment Generation (2023.eacl-srw)
Copied to clipboard
| Challenge: | Writing corrective feedback on learner text is widespread in language education, but it can be time-consuming for teachers. |
| Approach: | They propose to use feedback comment generation to generate explanatory notes for learners by categorizing comments and constraining outputs of noisy classes. |
| Outcome: | The proposed scheme can be used to generate feedback comment corpora using a broader scope than existing typologies focused on error correction. |
Natural Language Generation: Recently Learned Lessons, Directions for Semantic Representation-based Approaches, and the Case of Brazilian Portuguese Language (P19-2)
Copied to clipboard
| Challenge: | Natural Language Generation (NLG) is a promising area in Natural Language Processing (NLP) . |
| Approach: | They present a review of the literature on Natural Language Generation in Brazilian Portuguese. |
| Outcome: | The proposed approaches are based on the Abstract Meaning Representation formalism and have potential future directions. |
NarraSum: A Large-Scale Dataset for Abstractive Narrative Summarization (2022.findings-emnlp)
Copied to clipboard
| Challenge: | Existing studies focus on summarizing news documents or structured documents. |
| Approach: | They propose to use a large-scale narrative summarization dataset to encourage research . they find there is a performance gap between humans and the models on NarraSum . |
| Outcome: | The proposed dataset shows that humans and state-of-the-art models perform poorly when summarizing a narrative . it contains 122K narratives collected from synopses of movies and TV episodes with diverse genres . |
Toward Diverse Precondition Generation (2021.starsem-1)
Copied to clipboard
| Challenge: | a typical goal for language understanding is to logically connect the events of a discourse, but connective events are not described due to their commonsense nature. |
| Approach: | They propose a system that generates unique and diverse preconditions by using an event sampler, candidate generator, and post-processor. |
| Outcome: | The proposed system can generate unique and diverse preconditions without training on diverse examples. |
Improving Repository-level Code Search with Text Conversion (2024.naacl-srw)
Copied to clipboard
| Challenge: | Existing methods to search for related files based on similarity between code snippets are not effective for repository-level code generation. |
| Approach: | They propose to take similarities between code snippets and the texts converted from them into LLMs to search for related files and perform generation. |
| Outcome: | The proposed method improves the accuracy of code search on the repository level. |
Natural Answer Generation with Heterogeneous Memory (N18-1)
Copied to clipboard
| Challenge: | Recent work on memory augmented encoder-decoder frameworks has shown promising progress for natural language generation tasks. |
| Approach: | They propose a memory-augmented encoder-decoder framework that takes care of memory contents from different sources to explicitly avoid repetition. |
| Outcome: | The proposed approach can produce readable and meaningful answer sentences while maintaining high coverage for given answer information. |
Contrastive Attention for Automatic Chest X-ray Report Generation (2021.findings-acl)
Copied to clipboard
| Challenge: | Recent studies show that learning-based models fail to accurately capture and describe abnormal regions due to data bias. |
| Approach: | They propose a model that compares the current input image with normal images to capture abnormal regions by contrasting the input image and normal images. |
| Outcome: | The proposed model can be easily incorporated into existing models to boost their performance under most metrics. |
Extractive NarrativeQA with Heuristic Pre-Training (D19-58)
Copied to clipboard
| Challenge: | Automated question answering (QA) from text remains a challenge for humans . a striking gap exists between machine and human performance on NLP tasks . |
| Approach: | They propose a heuristic extractive version of a data set to solve the problem of answer extraction rather than generation. |
| Outcome: | The proposed model outperforms previous models on summary-level QA from full narratives and on the METEOR metric. |
UniICL: An Efficient ICL Framework Unifying Compression, Selection, and Generation (2025.acl-long)
Copied to clipboard
| Challenge: | Existing methods to improve reasoning abilities of Large Language Models (LLMs) have limitations due to excessive growth in context length, causing large hardware burden. |
| Approach: | They propose a novel Unified ICL framework that unifies demonstration compression, demonstration selection, and final response generation. |
| Outcome: | The proposed framework unifies demonstration compression, demonstration selection, and final response generation. |
LOT: A Story-Centric Benchmark for Evaluating Chinese Long Text Understanding and Generation (2022.tacl-1)
Copied to clipboard
| Challenge: | Existing benchmarks for natural language processing focus on understanding or generating short texts . lack of standardized benchmarks makes it difficult to assess and compare models . |
| Approach: | They propose a story-centric benchmark for Chinese long text modeling that aggregates two understanding tasks and two generation tasks. |
| Outcome: | The proposed model outperforms similar-sized models on understanding and generation tasks. |
VOLTA: Improving Generative Diversity by Variational Mutual Information Maximizing Autoencoder (2024.findings-naacl)
Copied to clipboard
| Challenge: | generative diversity is a critical yet underexplored issue in natural language generation . previous approaches to enhance diversity of Transformer models have been limited by their latent variables . |
| Approach: | They propose a framework that bridges Transformer with VAE to enhance generative diversity. |
| Outcome: | The proposed framework improves generative diversity while maintaining generative quality. |
OpenT2T: An Open-Source Toolkit for Table-to-Text Generation (2024.emnlp-demo)
Copied to clipboard
Haowei Zhang, Shengyun Si, Yilun Zhao, Lujing Xie, Zhijian Xu, Lyuhao Chen, Linyong Nan, Pengcheng Wang, Xiangru Tang, Arman Cohan
| Challenge: | Existing methods for table-to-text generation are limited and benchmarked on a limited number of datasets. |
| Approach: | They propose to use open-source tools to reproduce existing large language models for performance comparison and expedite the development of new models. |
| Outcome: | The proposed toolkit compares existing large language models on 9 table-to-text generation datasets and maintains a leaderboard to provide insights for future work. |
Understanding and Detecting Hallucinations in Neural Machine Translation via Model Introspection (2023.tacl-1)
Copied to clipboard
| Challenge: | Neural sequence generation models produce outputs that are unrelated to the source text, and are potentially harmful, yet it remains unclear in what conditions they arise and how to mitigate their impact. |
| Approach: | They first identify internal model symptoms of hallucinations by analyzing the relative token contributions to the generation in contrastive hallucinous vs. non-hallucinated outputs generated via source perturbations. |
| Outcome: | The proposed detector outperforms both baseline models and strong classifiers on English-Chinese and German-English translation test beds. |
StRuCom: A Novel Dataset of Structured Code Comments in Russian (2025.acl-srw)
Copied to clipboard
| Challenge: | Existing machine learning models for code comment generation are poorly suited for Russian . existing datasets that contain simple comments and docstrings in English are not suitable for function-level documentation generation. |
| Approach: | They propose a dataset specifically designed for Russian code documentation. |
| Outcome: | The first large-scale dataset specifically designed for Russian code documentation is based on human-written comments from GitHub repositories with synthetically generated ones. |
Symbolic Prompt Program Search: A Structure-Aware Approach to Efficient Compile-Time Prompt Optimization (2024.findings-emnlp)
Copied to clipboard
| Challenge: | Recent work on prompt programs has focused on simple prompt programs or assumed that the structure of a prompt program is fixed. |
| Approach: | They propose a framework to perform symbolic prompt program search for compile-time optimizations of prompt programs. |
| Outcome: | The proposed framework improves performance of complex prompts on instruction tuning, pipeline tuning, prompt compression and more. |
BeamR: Beam Reweighing with Attribute Discriminators for Controllable Text Generation (2022.findings-aacl)
Copied to clipboard
| Challenge: | Recent advances in natural language processing have led to the availability of large pre-trained language models with rich generative capabilities. |
| Approach: | They propose a method to combine generative LMs with attribute discriminators to control different attributes of text generation. |
| Outcome: | The proposed method performs better than existing state-of-the-art approaches in sentiment steering and machine translation formality tasks. |
RadEval: A framework for radiology text evaluation (2025.emnlp-demos)
Copied to clipboard
Justin Xu, Xi Zhang, Javid Abderezaei, Julie Bauml, Roger Boodoo, Fatemeh Haghighi, Ali Ganjizadeh, Eric Brattain, Dave Van Veen, Zaiqiao Meng, David W Eyre, Jean-Benoit Delbrouck
| Challenge: | Evaluating automated radiology report generation systems remains a fundamental challenge in the development of safe, accurate, and clinically useful medical AI. |
| Approach: | They propose a unified, open-source framework for evaluating radiology texts that consolidates a diverse range of metrics from classic ngram overlap (BLEU) and contextual measures (BERTScore) to clinical concept-based scores (GREEN). |
| Outcome: | The framework consolidates a diverse range of metrics from ngram overlap (BLEU) and contextual measures (BERTScore) to clinical concept-based scores (F1CheXbert, F1RadGraph, RaTEScore, SRR-BERT, TemporalEntityF1) and advanced LLMbased evaluators (GREEN). |
Test-Time Strategies for More Efficient and Accurate Agentic RAG (2026.acl-srw)
Copied to clipboard
Abhinav Sharma, Brian Zhang, Deepti Guntur, Zhiyang Zuo, Shreyas Chaudhari, Wenlong Zhao, Franck Dernoncourt, Puneet Mathur, Ryan A. Rossi, Nedim Lipka
| Challenge: | Retrieval-Augmented Generation (RAG) systems face challenges with complex, multi-hop questions. |
| Approach: | They propose to integrate contextualization module and de-duplication module to improve the accuracy of retrieved documents and to reduce the number of turns by 10.5%. |
| Outcome: | The proposed approach achieves a 5.6% increase in EM score and reduces the average number of turns by 10.5% compared to the baseline. |
E2E-VLP: End-to-End Vision-Language Pre-training Enhanced by Visual Learning (2021.acl-long)
Copied to clipboard
| Challenge: | Existing vision-language pre-training methods use a two-step training procedure to learn visual features from image-text pairs. |
| Approach: | They propose a vision-language pre-trained model for V+L understanding and generation using a unified Transformer framework. |
| Outcome: | The proposed model can learn visual representation and semantic alignments between image and text on visual-text pairs and on visual processing tasks. |
ArchiDocGen: Multi-Agent Framework for Expository Document Generation in the Architectural Industry (2025.acl-industry)
Copied to clipboard
Junjie Jiang, Haodong Wu, Yongqi Zhang, Songyue Guo, Bingcen Liu, Caleb Chen Cao, Ruizhe Shao, Chao Guan, Peng Xu, Lei Chen
| Challenge: | drafting method statements is labor-intensive and time-consuming . traditional methods involve using static templates filled in manually by engineers . |
| Approach: | They propose a framework that automates method statement generation by using multi-agent collaboration. |
| Outcome: | The proposed framework achieves 4.38 ContentScore, excelling in specialization, completeness, organization, and clarity. |
Bootstrapping Transliteration with Constrained Discovery for Low-Resource Languages (D18-1)
Copied to clipboard
| Challenge: | Existing approaches to transliteration generation require a large number of training examples. |
| Approach: | They propose a bootstrapping algorithm that uses constrained discovery to improve generation . they show that the model can be used with as few as 500 training examples . |
| Outcome: | The proposed method improves on nine languages written in a unique script. |
EvoAgentX: An Automated Framework for Evolving Agentic Workflows (2025.emnlp-demos)
Copied to clipboard
| Challenge: | Existing MAS frameworks often require manual workflow configuration and lack native support for dynamic evolution and performance optimization. |
| Approach: | They propose an open-source platform that automates generation, execution, and evolutionary optimization of multi-agent workflows. |
| Outcome: | The proposed platform automates generation, execution, and evolutionary optimization of multi-agent workflows. |
How About Kind of Generating Hedges using End-to-End Neural Models? (2023.acl-long)
Copied to clipboard
| Challenge: | hedging is a strategy for softening the impact of a statement in conversation. |
| Approach: | They propose to fine-tune state-of-the-art language models trained on human-human tutoring data and then use a hedge classifier to select the candidate that best matches the expected hedging strategy. |
| Outcome: | The proposed model is feasible in a noisy environment with reranking, and it is compared with other approaches. |
SED-SFT: Selectively Encouraging Diversity in Supervised Fine-Tuning (2026.acl-short)
Copied to clipboard
| Challenge: | Existing studies have proposed a new approach to optimize for SFT followed by RL . existing studies have suggested a method to optimize SFT for large language models . |
| Approach: | They propose a framework that encourages diversity based on token exploration space. |
| Outcome: | Experiments show that SED-SFT significantly improves generation diversity with a negligible computational overhead increase over CE loss. |
Towards Actual (Not Operational) Textual Style Transfer Auto-Evaluation (D19-55)
Copied to clipboard
| Challenge: | elucidates the dangerous current state of style transfer auto-evaluation research. |
| Approach: | They propose ways to aggregate the three metrics into one evaluator. |
| Outcome: | The proposed method could be used to aggregate the three metrics into one evaluator. |
Why Exposure Bias Matters: An Imitation Learning Perspective of Error Accumulation in Language Generation (2022.findings-acl)
Copied to clipboard
| Challenge: | Current language generation models suffer from issues such as repetition, incoherence, and hallucinations . |
| Approach: | They propose to analyze exposure bias from an imitation learning perspective and prove it is a problem . they show that exposure bias leads to an accumulation of errors during generation . |
| Outcome: | The proposed model fails to capture errors during generation and poor generation quality. |
BSharedRAG: Backbone Shared Retrieval-Augmented Generation for the E-commerce Domain (2024.findings-emnlp)
Copied to clipboard
| Challenge: | Existing work adopts separate modules for retrieval and generation, which may be suboptimal since the retrieval task and generation task cannot benefit from each other to improve performance. |
| Approach: | They propose a backbone-shared RAG framework that uses a domain-specific corpus to continuously pre-train a model and then trains two plug-and-play Low-Rank Adaptation modules based on the shared backbone to minimize retrieval and generation losses respectively. |
| Outcome: | The proposed framework outperforms baseline models by 5% and 13% in Hit@3 upon two datasets in retrieval evaluation and by 23% in terms of BLEU-3 in generation evaluation. |
PrefixNLI: Detecting Factual Inconsistencies as Soon as They Arise (2026.acl-long)
Copied to clipboard
| Challenge: | Large Language Models (LLMs) are prone to factually inconsistent statements, known as hallucinations. |
| Approach: | They propose to train a specialized model that detects inconsistencies over text prefixes to improve generation faithfulness by 5-14 F1 points. |
| Outcome: | The proposed model outperforms baseline models by 5-14 F1 points in prefix-level entailment. |
Alleviating Exposure Bias in Abstractive Summarization via Sequentially Generating and Revising (2024.lrec-main)
Copied to clipboard
| Challenge: | Existing approaches to abstractive summarization suffer from exposure bias . Existing solutions bridge this gap through un- or semi-supervised holistic learning . |
| Approach: | They propose to reformat abstractive summarization to sequential generation and revision (SeGRe) this allows the model to assess the flawed summary from a global perspective and modify inappropriate expressions. |
| Outcome: | The proposed model can assess the flawed summary from a global view and modify inappropriate expressions. |
AlphaFin: Benchmarking Financial Analysis with Retrieval-Augmented Stock-Chain Framework (2024.lrec-main)
Copied to clipboard
| Challenge: | Currently, ML&DL methods fail to provide reasons for stock trend predictions, lacking interpretability and reasoning processes. large language models (LLMs) suffer from hallucinations and are unable to keep up with the latest information. |
| Approach: | They develop a method to train large language models to handle financial analysis tasks . they use AlphaFin datasets to compare performance with traditional methods . |
| Outcome: | The proposed method improves stock trend prediction and financial question answering tasks. |
From Sentences to Proof Trees: Leveraging Language Models for Structured Reasoning (2026.eacl-srw)
Copied to clipboard
| Challenge: | Multi-hop reasoning requires a chain of facts to reflect the reasoning behind the answer. |
| Approach: | They propose an inference-guided prompting approach that performs well in natural language questions . they propose a neuro-symbolic approach to reasoning using large language models . |
| Outcome: | The proposed model outperforms all prompting strategies and fine-tunes LLMs trained specifically for proof generation. |
Controllable Summarization with Constrained Markov Decision Process (2021.tacl-1)
Copied to clipboard
| Challenge: | Existing controllable summarization models do not allow users to specify their preference for a particular attribute of the generated summaries. |
| Approach: | They propose a novel training framework based on Constrained Markov Decision Process (CMDP) that includes a reward function and constraints to facilitate better summarization control. |
| Outcome: | The proposed model can be applied to control important attributes of summarization, including length, covered entities, and abstractiveness, while complying with a given attribute’s requirement. |
ZoomR: Memory Efficient Reasoning through Multi-Granularity Key Value Retrieval (2026.acl-long)
Copied to clipboard
David H. Yang, Yuxuan Zhu, Mohammad Mohammadi Amiri, Keerthiram Murugesan, Tejaswini Pedapati, Subhajit Chaudhury, Pin-Yu Chen
| Challenge: | Large language models generate long chain of thoughts but memory footprint grows with output length . prior work on KV cache optimization focused on compressing long input context . |
| Approach: | They propose a new approach that compresses verbose reasoning thoughts into summaries . they use a dynamic KV cache selection policy that leverages these summary keys . |
| Outcome: | The proposed approach reduces memory usage while avoiding full-cache attention at each step. |
Semi-supervised Relation Extraction via Data Augmentation and Consistency-training (2023.eacl-main)
Copied to clipboard
| Challenge: | Obtaining high-quality human labelled data is an expensive and noisy process. |
| Approach: | They propose to leverage unlabelled data to improve the sample efficiency of the models. |
| Outcome: | The proposed methods can be used to extract the Cause-Effect relation between a given head entity and tail entity based on context in the input sentence. |
Demonstrating ViviDoc: Generating Interactive Documents through Human-Agent Collaboration (2026.acl-demo)
Copied to clipboard
| Challenge: | Recent LLM-based agents can automate content creation, but naively applying them yields uncontrollable and unverifiable outputs. |
| Approach: | They propose a human-agent collaborative system that generates interactive educational documents from a single topic input. |
| Outcome: | The proposed system generates documents comparable in quality to human-authored ones. |
WaterBench: Towards Holistic Evaluation of Watermarks for Large Language Models (2024.acl-long)
Copied to clipboard
| Challenge: | Recent studies have developed watermarking algorithms which restrict the generation process to leave an invisible trace for watermark detection. |
| Approach: | They propose a benchmarking procedure that compares different methods to ensure consistent watermarking strength and jointly evaluates their generation and detection performance. |
| Outcome: | The proposed benchmark compares 4 open-source watermarks on 2 LLMs under 2 watermarking strengths and observes the common struggles for current methods on maintaining the generation quality. |
Prompt Augmented Generative Replay via Supervised Contrastive Learning for Lifelong Intent Detection (2022.findings-naacl)
Copied to clipboard
| Challenge: | Existing methods to identify all possible user intents at design time are expensive and require storage of past data. |
| Approach: | They propose to continually train an intent detector on new intents while maintaining performance on prior intents. |
| Outcome: | The proposed method outperforms exemplar replay-based approaches on lifelong intent detection tasks and achieves state-of-the-art on four public datasets. |
PLM-based World Models for Text-based Games (2022.emnlp-main)
Copied to clipboard
| Challenge: | a new study shows that pre-trained world models provide a strong base for world models . worldformer is a text-based game environment that can be used to learn world models in text-driven games. |
| Approach: | They propose to use pre-trained language models to build world models in text-based game environments. |
| Outcome: | The proposed model outperforms state-of-the-art model-free algorithms in Atari games while retaining sample efficiency. |
Exploring Union and Intersection of Visual Regions for Generating Questions, Answers, and Distractors (2024.emnlp-main)
Copied to clipboard
| Challenge: | Existing efforts to generate image-related questions, correct answers, or challenge distractors are limited. |
| Approach: | They propose to put the spotlight on different image regions to diversify QADs . they propose a framework that generates each QAD based on a recurrent multimodal encoder . |
| Outcome: | The proposed framework puts the spotlight on different image regions to diversify QADs. |
VividMed: Vision Language Model with Versatile Visual Grounding for Medicine (2025.naacl-long)
Copied to clipboard
| Challenge: | Vision Language Models (VLMs) have demonstrated promise in generating visually grounded responses, but their application in the medical domain is hindered by unique challenges. |
| Approach: | They propose a vision language model with versatile visual grounding for medicine that generates semantic segmentation masks and instance-level bounding boxes. |
| Outcome: | The proposed model can generate semantic segmentation masks and instance-level bounding boxes, and accommodates various imaging modalities, including both 2D and 3D data. |
Knowledge-augmented Financial Market Analysis and Report Generation (2024.emnlp-industry)
Copied to clipboard
| Challenge: | Existing methods to generate financial market analysis text require extensive financial knowledge and skill of financial analysts. |
| Approach: | They propose a task to generate financial market analysis reports using financial market data using a financial knowledge graph. |
| Outcome: | The proposed framework outperforms large-scale language models and retrieval-augmented baselines in the financial market analysis generation task. |
CriticBench: Benchmarking LLMs for Critique-Correct Reasoning (2024.findings-acl)
Copied to clipboard
| Challenge: | CriticBench is a benchmark designed to assess LLMs’ abilities to critique and refine their reasoning across a variety of tasks. |
| Approach: | They propose a benchmark to assess LLMs' ability to critique and correct reasoning across a variety of tasks. |
| Outcome: | The proposed benchmark examines the performance of 17 large language models in generation, critique, and correction reasoning. |
WebNovelBench: Placing LLM Novelists on the Web Novel Distribution (2026.findings-eacl)
Copied to clipboard
| Challenge: | Existing benchmarks for long-form novel generation lack scale, diversity, or objective measures. |
| Approach: | They propose a framework that assesses long-form novel generation using an LLM-as-Judge approach. |
| Outcome: | The proposed framework differentiates between human-written masterpieces, popular web novels, and LLM-generated content. |
Deriving Language Models from Masked Language Models (2023.acl-short)
Copied to clipboard
| Challenge: | Masked language models do not define an explicit distribution over language, but they assume that tokens masked out are conditionally independent given the unmasked tokens. |
| Approach: | They propose to use a set of MLM's unary conditionals to construct a fully-connected Markov random field over the input to deduce an explicit joint distribution from MLMs. |
| Outcome: | The proposed method outperforms existing Markov random field-based approaches and outperformed the original model's conditionals. |
ChatR1: Reinforcement Learning for Conversational Reasoning and Retrieval Augmented Question Answering (2026.acl-long)
Copied to clipboard
| Challenge: | Unlike static ‘rewrite, retrieve, and generate’ pipelines, ChatR1 interleaves search and reasoning across turns, enabling exploratory and adaptive behaviors learned through RL. |
| Approach: | They propose a reasoning framework based on reinforcement learning (RL) for conversational question answering that interleaves search and reasoning across turns and provides turn-level feedback. |
| Outcome: | The proposed framework outperforms competing models on five CQA datasets, measured by different metrics (F1, BERTScore, and LLM-as-judge). |
Annotate the Way You Think: An Incremental Note Generation Framework for the Summarization of Medical Conversations (2024.lrec-main)
Copied to clipboard
| Challenge: | Existing datasets for summarization of medical conversations are limited to conversation-summary pairs . a novel annotation framework is proposed to capture the summarizing process via an annotation task . |
| Approach: | They propose an incremental note generation framework that captures the human summarization process via an annotation task by instructing annotators to first incrementally create a draft note and polish it into a reference note. |
| Outcome: | The proposed framework shows that the human summarization process is much more efficient and accurate than the current method. |
UniRAG: Universal Retrieval Augmentation for Large Vision Language Models (2025.findings-naacl)
Copied to clipboard
| Challenge: | Large Vision Language Models (LVLMs) have unlocked many complex use cases that require Multi-Modal (MM) understanding and MM generation. |
| Approach: | They propose a plug-and-play technique that adds relevant retrieved information to prompts as few-shot examples during inference. |
| Outcome: | The proposed method significantly improves the output quality of large vision language models when input prompts are augmented with relevant information retrieved by Vision-Language retrievers like UniRAG. |
Adversarial Decoding: Generating Readable Documents for Adversarial Objectives (2026.findings-eacl)
Copied to clipboard
| Challenge: | Existing methods for generating adversarial documents produce gibberish that is easy to detect and filter out. |
| Approach: | They propose a generic text generation technique that produces readable adversarial documents . they demonstrate that adversarials can be used for different objectives . |
| Outcome: | The proposed technique outperforms existing methods while producing readable documents for adversarial objectives. |
Effective QA-Driven Annotation of Predicate–Argument Relations Across Languages (2026.eacl-long)
Copied to clipboard
| Challenge: | Explicit representations of predicate-argument relations are a cornerstone of natural language understanding. |
| Approach: | They propose a cross-linguistic projection approach that reuses an English QA-SRL parser within a constrained translation and word-alignment pipeline to automatically generate question-answer annotations aligned with target-language predicates. |
| Outcome: | The proposed approach outperforms strong multilingual LLMs in Hebrew, Russian, and French. |
Byte Pair Encoding for Symbolic Music (2023.emnlp-main)
Copied to clipboard
| Challenge: | Recent research has focused on reducing the overall sequence length by merging embeddings or combining tokens. |
| Approach: | They propose to convert music into a sequence of discrete tokens using Byte Pair Encoding . they propose to combine tokens with embeddings to improve the results . |
| Outcome: | The proposed method reduces the sequence length while increasing the vocabulary size. |
An Edge-Enhanced Hierarchical Graph-to-Tree Network for Math Word Problem Solving (2021.findings-emnlp)
Copied to clipboard
| Challenge: | Existing work on graph neural networks to capture word relationships neglects the rest of the problem. |
| Approach: | They propose an edge-enhanced hierarchical graph encoder to incorporate edge label information. |
| Outcome: | The proposed model can improve performance on the MAWPS and Math23K datasets compared with state-of-the-art methods. |
Large language models are few-shot clinical information extractors (2022.emnlp-main)
Copied to clipboard
| Challenge: | a long-running goal of clinical NLP is the extraction of important variables trapped in clinical notes. |
| Approach: | They propose to use large language models to tackle diverse clinical extraction tasks . they propose to reannote existing CASI datasets to compare their models with clinical text. |
| Outcome: | The proposed models outperform existing models on few-shot clinical information extraction tasks. |
Are Any-to-Any Models More Consistent Across Modality Transfers Than Specialists? (2025.acl-long)
Copied to clipboard
| Challenge: | equivariance evaluations uncover weak but observable consistency through structured analyses of the intermediate latent space enabled by multiple editing operations. |
| Approach: | They use a dataset of 1,000 images paired with captions, editing instructions, and Q&A pairs to evaluate cross-modal transfers rigorously. |
| Outcome: | The proposed models do not consistently demonstrate greater cross-modal consistency than specialized models in pointwise evaluations such as cyclic consistency. |
RECAP: Towards Precise Radiology Report Generation via Dynamic Disease Progression Reasoning (2023.findings-emnlp)
Copied to clipboard
| Challenge: | Recent studies have focused on producing concise observations while neglecting the precise attributes that determine the severity of diseases. |
| Approach: | They propose a model that generates precise radiology reports via dynamic disease progression reasoning by combining historical and spatiotemporal information. |
| Outcome: | Experiments on two publicly available datasets show the proposed model can generate precise and accurate radiology reports with dynamic disease progression reasoning. |
NeuroPrune: A Neuro-inspired Topological Sparse Training Algorithm for Large Language Models (2024.findings-acl)
Copied to clipboard
Amit Dhurandhar, Tejaswini Pedapati, Ronny Luss, Soham Dan, Aurelie Lozano, Payel Das, Georgios Kollias
| Challenge: | Transformer-based Language Models have become ubiquitous in natural language processing due to impressive performance on various tasks. |
| Approach: | They explore how sparsity affects network topology by exploiting mechanisms seen in biological networks . they show that model-agnostic sparsities are performant across diverse NLP tasks . |
| Outcome: | The proposed model-agnostic sparsity approaches are performant and efficient across NLP tasks. |
TESS: Text-to-Text Self-Conditioned Simplex Diffusion (2024.eacl-long)
Copied to clipboard
Rabeeh Karimi Mahabadi, Hamish Ivison, Jaesung Tae, James Henderson, Iz Beltagy, Matthew Peters, Arman Cohan
| Challenge: | Existing models for diffusion generation are expensive and discrete, resulting in a large number of diffusion steps to generate text. |
| Approach: | They propose a text diffusion model that is fully non-autoregressive and employs a new form of self-conditioning and applies the diffusion process on the logit simplex space rather than the learned embedding space. |
| Outcome: | The proposed model outperforms state-of-the-art non-autoregressive models, requires fewer diffusion steps with minimal drop in performance, and is competitive with pretrained autoregressive sequence-to-sequence models. |
Hence, Socrates is mortal: A Benchmark for Natural Language Syllogistic Reasoning (2023.findings-acl)
Copied to clipboard
Yongkang Wu, Meng Han, Yutao Zhu, Lei Li, Xinyu Zhang, Ruofei Lai, Xiaoguang Li, Yuanhang Ren, Zhicheng Dou, Zhao Cao
| Challenge: | SylloBase is a benchmark for syllogistic reasoning, a critical capability widely required in natural language understanding tasks, such as text entailment and question answering. |
| Approach: | They propose to use a benchmark to learn syllogistic reasoning on a set of templates and to use them to generate and understand slogisms. |
| Outcome: | The proposed benchmark covers a complete taxonomy of syllogism reasoning patterns, and contains both automatically and manually constructed samples. |
Speaking at the Right Level: Literacy-Controlled Counterspeech Generation with RAG-RL (2025.findings-emnlp)
Copied to clipboard
| Challenge: | Existing approaches produce uniform responses, ignoring that health literacy levels affect the accessibility and effectiveness of counterspeech. |
| Approach: | They propose a Controlled-Literacy framework that generates counterspeech adapted to different health literacy levels. |
| Outcome: | The proposed framework outperforms baselines by generating more accessible counterspeech to health misinformation. |
Automatic Multiple-Choice Question Generation and Evaluation Systems Based on LLM: A Study Case With University Resolutions (2025.coling-main)
Copied to clipboard
Sérgio Silva Mucciaccia, Thiago Meireles Paixão, Filipe Wall Mutz, Claudine Santos Badue, Alberto Ferreira de Souza, Thiago Oliveira-Santos
| Challenge: | Multiple choice questions (MCQs) are often used in employee selection and training, but their creation is resource-intensive and requires significant effort and investment. |
| Approach: | They propose to use large language models and prompt engineering techniques to automate the generation and validation of MCQs. |
| Outcome: | The proposed system reduces the burden on human resources and enables scalable, cost-effective MCQ generation. |
Contrastive Decoding Reduces Hallucinations in Large Multilingual Machine Translation Models (2024.eacl-long)
Copied to clipboard
| Challenge: | Hallucinations occur when the target side sentence is detached from the source side sentence, or in other words, when there is a low contribution of the source sentence to the generation of the target sentence. |
| Approach: | They propose to use Contrastive Decoding to maximise the log-likelihood difference between a model and the same model with reduced contribution from the encoder outputs. |
| Outcome: | The proposed algorithm maximises the log-likelihood difference between a model and the same model with reduced contribution from the encoder outputs. |
Personalized Response Generation via Generative Split Memory Network (2021.naacl-main)
Copied to clipboard
| Challenge: | Despite the success of text generation and dialogue systems, how to endow a text generation system with personality traits remains under-investigated. |
| Approach: | They propose a model to generate personalized responses on reddit using user profiles and posting histories. |
| Outcome: | The proposed model improves over the state-of-the-art response generation models. |
An Investigation of Evaluation Methods in Automatic Medical Note Generation (2023.findings-acl)
Copied to clipboard
| Challenge: | Recent studies show that doctors can save significant amounts of time when using automatic note generation. |
| Approach: | They propose task-specific metrics for automatic note generation from medical conversation summarization and generation, including knowledge-graph embedding-based metrics, customized model-based measures with domain-specific weights, and ensemble metrics. |
| Outcome: | The proposed evaluation metrics are compared to existing models and can have different behaviors on different types of clinical notes datasets. |
Training Dynamics for Text Summarization Models (2022.findings-acl)
Copied to clipboard
| Challenge: | Pre-trained language models have shown impressive results when fine-tuned on large summarization datasets. |
| Approach: | They analyze the training dynamics for generation models, focusing on summarization . they find that a propensity to copy the input is learned early in the training process . |
| Outcome: | The proposed model learns at different stages of fine-tuning, the authors show . they show that factual errors are learnt in later stages, but not at high-loss tokens . |
FunnelRAG: A Coarse-to-Fine Progressive Retrieval Paradigm for RAG (2025.findings-naacl)
Copied to clipboard
| Challenge: | Retrieval-Augmented Generation (RAG) is widely adopted in Large Language Models, but is flat and has limitations such as a significant burden on one retriever and constant granularity limits the ceiling of retrieval performance. |
| Approach: | They propose a progressive retrieval paradigm with coarse-to-fine granularity for RAG, termed FunnelRAG, so as to balance effectiveness and efficiency. |
| Outcome: | The proposed paradigm achieves comparable retrieval performance while the time overhead is reduced by nearly 40%. |
Collaborative Chain-of-Agents for Parametric-Retrieved Knowledge Synergy (2026.acl-long)
Copied to clipboard
| Challenge: | Existing RAG methods focus on external retrieval, while ignoring the rich content of the model. |
| Approach: | They propose a framework that enhances explicit synergy over parametric and retrieved knowledge by integrating external retrieval components into the input context of the LLMs. |
| Outcome: | The proposed framework enhances explicit synergy over parametric and retrieved knowledge. |
PagedEviction: Structured Block-wise KV Cache Pruning for Efficient Large Language Model Inference (2026.findings-eacl)
Copied to clipboard
Krishna Teja Chitty-Venkata, Jie Ye, Siddhisanket Raskar, Anthony Kougkas, Xian Sun, Murali Emani, Venkatram Vishwanath, Bogdan Nicolae
| Challenge: | Large Language Models (LLMs) are exploding to large sizes, including GPT, LLaMA, and DeepSeek. |
| Approach: | They propose a fine-grained, structured KV cache pruning strategy that enhances the memory efficiency of vLLM’s PagedAttention. |
| Outcome: | The proposed method integrates seamlessly with PagedAttention without any modifications to its CUDA attention kernels. |
Self-Supervised Position Debiasing for Large Language Models (2024.findings-acl)
Copied to clipboard
| Challenge: | Existing methods for debiasing large language models require external bias knowledge or annotated non-biased samples, which is lacking for position debiases. |
| Approach: | They propose a self-supervised position debiasing framework that leverages unsupervised responses from pre-trained LLMs for debiazing without external bias knowledge. |
| Outcome: | The proposed framework outperforms existing methods in mitigating three types of position biases on eight datasets and five tasks. |
SYNTHVERIFY: Enhancing Zero-Shot Claim Verification through Step-by-Step Synthetic Data Generation (2025.findings-acl)
Copied to clipboard
| Challenge: | Existing methods for claim verification are inefficient or rely on external documents. |
| Approach: | They propose a step-by-step prompting-based synthetic data generation framework to enhance zero-shot claim verification. |
| Outcome: | The proposed framework bridges LLMs’ knowledge gaps in specialized domains without access to external corpora or sacrificing generalizability. |
A Dog Is Passing Over The Jet? A Text-Generation Dataset for Korean Commonsense Reasoning and Evaluation (2022.findings-naacl)
Copied to clipboard
Jaehyung Seo, Seounghoon Lee, Chanjun Park, Yoonna Jang, Hyeonseok Moon, Sugyeong Eo, Seonmin Koo, Heuiseok Lim
| Challenge: | Korean pretrained language models struggle to generate short sentences with a given condition based on compositionality and commonsense reasoning. |
| Approach: | They propose a Korean text-generation dataset for Korean generative commonsense reasoning and language model evaluation using a semi-automatic dataset construction approach. |
| Outcome: | The proposed dataset is available at http://aihub.or.kr/opendata/korea-university. |
Critic-Driven Decoding for Mitigating Hallucinations in Data-to-text Generation (2023.emnlp-main)
Copied to clipboard
| Challenge: | Hallucination of text lacking grounding in input data is a problem in neural data-to-text generation. |
| Approach: | They propose to combine probabilistic output of a generator language model with the output of an “text critic” classifier which guides the generation by assessing the match between the input data and the generated text. |
| Outcome: | The proposed method improves on the WebNLG and OpenDialKG benchmarks. |
Asking Clarification Questions in Knowledge-Based Question Answering (D19-1)
Copied to clipboard
| Challenge: | Existing clarification datasets with limited annotated examples do not address ambiguous phenomena. |
| Approach: | They propose a dataset that allows users to ask clarification questions using open-domain examples. |
| Outcome: | The proposed model achieves better performance than strong baselines and provides new challenges. |
Generating Diverse Translations with Sentence Codes (P19-1)
Copied to clipboard
| Challenge: | Existing methods to generate diverse translations use different sentence structures . Xu et al., 2018: generating multiple valid translations with high diversity is difficult . |
| Approach: | They propose to use sentence codes to condition the sentence generation to obtain diverse translations . they propose to sample multiple candidates, each of which conditioned on a unique code . |
| Outcome: | The proposed method generates paraphrase translations with drastically different structures . the proposed method can be easily adopted to existing translation systems . |
NorEval: A Norwegian Language Understanding and Generation Evaluation Benchmark (2025.findings-acl)
Copied to clipboard
Vladislav Mikhailov, Tita Enstad, David Samuel, Hans Christian Farsethås, Andrey Kutuzov, Erik Velldal, Lilja Øvrelid
| Challenge: | NorEval is a new evaluation suite for large-scale standardized benchmarking of Norwegian generative language models (LMs). |
| Approach: | They propose a new evaluation suite for large-scale standardized benchmarking of Norwegian generative language models (LMs) NorEval consists of 24 high-quality human-created datasets, of which five are created from scratch. |
| Outcome: | The evaluation framework and materials are publicly available. |
Eliciting Implicit Acoustic Styles from Open-domain Instructions to Facilitate Fine-grained Controllable Generation of Speech (2025.emnlp-main)
Copied to clipboard
| Challenge: | Current work relies on pre-defined rules or templates to control the style of speech. |
| Approach: | They propose to use open-domain instructions to generate speech with the acoustic style that meets users’ needs based on their instructions. |
| Outcome: | The proposed model can be used to generate speech with the acoustic style that meets users’ needs based on open-domain instructions. |
Bridging Argument Quality and Deliberative Quality Annotations with Adapters (2023.findings-eacl)
Copied to clipboard
| Challenge: | Assessing the quality of an argument is a complex, highly subjective task . argument quality dimensions are complex and dependent on the context in which it is assessed . |
| Approach: | They propose a multi-task learning framework that incorporates knowledge about related dimensions into the learning process. |
| Outcome: | The proposed framework improves quality prediction in an extrinsic, out-of-domain task. |
MReD: A Meta-Review Dataset for Structure-Controllable Text Generation (2022.findings-acl)
Copied to clipboard
| Challenge: | a new text generation dataset is needed to controllable text summarization, but it lacks the domain knowledge. |
| Approach: | They propose to use existing text generation datasets to leverage input and control signals . they propose to annotate each meta-review sentence manually with a control signal . |
| Outcome: | The proposed method can be used to control the structure of a text generation dataset . it can be applied to a variety of tasks, including a task with a large number of meta-review sentences . |
Know When To Stop: A Study of Semantic Drift in Text Generation (2024.naacl-long)
Copied to clipboard
| Challenge: | Existing methods for text generation make predictions token-by-token, without pre-established text structure. |
| Approach: | They develop a semantic drift score that measures the degree of separation between correct and incorrect facts in generated texts. |
| Outcome: | The proposed methods improve factuality by a large margin compared to baseline and early stopping methods. |
How to Align Multiple Signed Language Corpora for Better Sign-to-Sign Translations? (2025.naacl-long)
Copied to clipboard
| Challenge: | despite the growing need for advanced signing technologies, signed language resources remain scarce. |
| Approach: | They propose a linguistically informed alignment algorithm that matches instances between signed languages . they compare similarities and differences across three signed languages to develop a model . |
| Outcome: | The proposed algorithm performs well on automatic metrics for sign-to-sign translation and generation. |
Negative Sample is Negative in Its Own Way: Tailoring Negative Sentences for Image-Text Retrieval (2022.findings-naacl)
Copied to clipboard
| Challenge: | Existing approaches to retrieve hard negative sentences are limited in the scale of the dataset thus fail to identify negative samples of high difficulty for every image. |
| Approach: | They propose to use a model to generate synthetic negative sentences with higher difficulty by masking and refilling the images and performing word discrimination and word correction tasks to improve retrieval and generation. |
| Outcome: | The proposed model generates synthetic negative sentences with higher difficulty on MS-COCO and Flickr30K and is robust and faithful to state-of-the-art training. |
Beyond Code: Evaluate Thought Steps for Complex Code Generation (2024.lrec-main)
Copied to clipboard
| Challenge: | Existing efforts to generate code in C++ rely on relatively simple programming problems . large language models (LLMs) pre-trained on numerous code data have opened up new opportunities for code generation. |
| Approach: | They propose a task that evaluates the quality of thought steps and code implementation . they construct a dataset of complex programming problems in C++ . |
| Outcome: | The proposed task evaluates the quality of thought steps and code implementation in a C++ programming language. |
Topic-driven Ensemble for Online Advertising Generation (2020.coling-main)
Copied to clipboard
| Challenge: | Existing methods for automating online advertising use open data . subdomains of text vary in use and can lead to reduced quality of adverts generation. |
| Approach: | They propose a neural network-based approach for the automatic generation of online advertising using texts from given webpages as sources. |
| Outcome: | The proposed approach significantly improves the quality of online advertising generated on a Russian dataset. |
FinRAGBench-V: A Benchmark for Multimodal RAG with Visual Citation in the Financial Domain (2025.emnlp-main)
Copied to clipboard
| Challenge: | Existing RAG research focuses on textual data, overlooking rich visual content in financial documents. |
| Approach: | They propose a visual RAG benchmark tailored for finance that integrates multimodal data and provides visual citation to ensure traceability. |
| Outcome: | The proposed visual RAG benchmark integrates multimodal data and provides visual citation to ensure traceability. |
GigaCheck: Detecting LLM-generated Content via Object-Centric Span Localization (2026.findings-acl)
Copied to clipboard
Irina Tolstykh, Aleksandra Tsybina, Sergey Yakubson, Aleksandr Gordeev, Vladimir Dokholyan, Maksim Kuprashevich
| Challenge: | GigaCheck is a framework for AI-generated text detection. |
| Approach: | They propose a dual-strategy framework for AI-generated text detection . they leverage representation learning of fine-tuned LLMs to discern authorship . |
| Outcome: | The proposed framework can detect LLM-generated content with high accuracy and accuracy . it can be used in mixed-authorship scenarios and in academic collaborations . |
Dynamic Topic Tracker for KB-to-Text Generation (2020.coling-main)
Copied to clipboard
| Challenge: | Existing KB-to-text generation models suffer from an off-topic problem . existing models generate unrelated clauses regardless of input data . |
| Approach: | They propose a dynamic topic tracker that learns a global hidden representation for topics and recognizes the corresponding topic during each generation step. |
| Outcome: | The proposed model improves the performance of sentence generation and mitigates off-topic problem. |
The Curious Case of Hallucinatory (Un)answerability: Finding Truths in the Hidden States of Over-Confident Large Language Models (2023.emnlp-main)
Copied to clipboard
| Challenge: | Large language models (LLMs) have been shown to possess impressive capabilities, but they are not problem-free. |
| Approach: | They explore the behavior of large language models when presented with (un)answerable queries. |
| Outcome: | The proposed models encode the answerability of an input query, the authors show . they also show that the first decoded token is a strong indicator . |
MEGATRON-CNTRL: Controllable Story Generation with External Knowledge Using Large-Scale Language Models (2020.emnlp-main)
Copied to clipboard
Peng Xu, Mostofa Patwary, Mohammad Shoeybi, Raul Puri, Pascale Fung, Anima Anandkumar, Bryan Catanzaro
| Challenge: | Existing pre-trained large language models have shown unparalleled generative capabilities, but they are not controllable. |
| Approach: | They propose a framework that uses large-scale language models and adds control to text generation by incorporating an external knowledge base. |
| Outcome: | The proposed model generates more fluent, consistent, and coherent stories with less repetition and higher diversity compared to previous work on the ROC story dataset. |
INSET: Sentence Infilling with INter-SEntential Transformer (2020.acl-main)
Copied to clipboard
| Challenge: | Missing sentence generation fosters a wide range of applications in natural language generation . Developing models for sentence infilling can potentially facilitate many text generation applications . |
| Approach: | They propose a framework to decouple the problem from natural language processing . they propose generating missing sentences that can syntactically and semantically bridge context . |
| Outcome: | The proposed model learns a sentence representation and generates 'missing sentences' the proposed model can be used for document auto-completion and meeting note expansion . |
Think Beyond Words: Exploring Context-Relevant Visual Commonsense for Diverse Dialogue Generation (2022.findings-emnlp)
Copied to clipboard
| Challenge: | Existing approaches to generate intelligent open-domain dialogue agents only consider auxiliary commonsense stored in pure text, ignoring grounding information from the external visual world. |
| Approach: | They propose a VIsual Commonsense enhanced dialogue generaTOR that exploits auxiliary commonsense from images related to context to generate coherent and informative responses. |
| Outcome: | The proposed method outperforms the latest competitive methods in terms of coherence and diversity on two public datasets. |
How to Make Neural Natural Language Generation as Reliable as Templates in Task-Oriented Dialogue (2020.emnlp-main)
Copied to clipboard
| Challenge: | Neural Natural Language Generation (NLG) systems are well known for their unreliability. |
| Approach: | They propose a data augmentation approach which restricts the output of a neural network and guarantees reliability. |
| Outcome: | The proposed approach scored 100% in semantic accuracy on the E2E NLG Challenge dataset, the same as a template system. |
Continuously Steering LLMs Sensitivity to Contextual Knowledge with Proxy Models (2025.emnlp-main)
Copied to clipboard
| Challenge: | Existing approaches to optimize Large Language Models (LLMs) for knowledge conflicts are inefficient or ineffective for large models and are not suitable for black-box models. |
| Approach: | They propose a framework that can continuously steer LLMs’ sensitivity to contextual knowledge at a lightweight cost. |
| Outcome: | The proposed framework can steer LLMs’ sensitivity to contextual knowledge continuously at a lightweight cost. |
Text-to-Text Extraction and Verbalization of Biomedical Event Graphs (2022.coling-1)
Copied to clipboard
| Challenge: | Biomedical events represent complex, graphical, and semantically rich interactions expressed in the scientific literature. |
| Approach: | They propose a framework to solve event extraction and event verbalization with a unified text-to-text approach. |
| Outcome: | The proposed framework achieves greater state-of-the-art performance than single-task competitors and can generate coherent natural language utterances from structured data. |
ShifCon: Enhancing Non-Dominant Language Capabilities with a Shift-based Multilingual Contrastive Framework (2025.acl-long)
Copied to clipboard
Hengyuan Zhang, Chenming Shang, Sizhe Wang, Dongdong Zhang, Yiyao Yu, Feng Yao, Renliang Sun, Yujiu Yang, Furu Wei
| Challenge: | Experiments show that ShifCon significantly enhances the performance of non-dominant languages due to the imbalance in training data across languages. |
| Approach: | They propose a Shift-based multilingual Contrastive framework that aligns the internal forward process of other languages toward that of the dominant one. |
| Outcome: | The proposed framework significantly improves performance of non-dominant languages, particularly for low-resource ones. |
Constrained Decoding with Speculative Lookaheads (2025.naacl-long)
Copied to clipboard
Nishanth Sridhar Nakshatri, Shamik Roy, Rajarshi Das, Suthee Chaidaroon, Leonid Boytsov, Rashmi Gangadharaiah
| Challenge: | Constrained decoding with lookahead heuristics is effective for aligning LLM generations to human preferences, but the extensive lookaheaded roll-out operations for each generated token make it prohibitively expensive. |
| Approach: | They propose a technique that uses lookaheads to align LLMs to human preferences . they propose 2.2x to 12.15x speedup over greedy decoding . |
| Outcome: | The proposed technique achieves 2.2x to 12.15x speedup over greedy decoding without significant performance reduction. |
BERTScore is Unfair: On Social Bias in Language Model-Based Metrics for Text Generation (2022.emnlp-main)
Copied to clipboard
| Challenge: | Currently, pre-trained language model (PLM) based metrics are widely adopted in text generation tasks. |
| Approach: | They propose to use PLMs to encode stereotypical societal biases in PLM-based metrics . they show that popular metrics exhibit higher social bias than traditional metrics based on 6 attributes . |
| Outcome: | The proposed method shows that PLM-based metrics exhibit higher social bias than traditional metrics on 6 attributes. |
How Well Do LLMs Handle Cantonese? Benchmarking Cantonese Capabilities of Large Language Models (2025.findings-naacl)
Copied to clipboard
| Challenge: | Cantonese has scant representation in NLP research, especially compared to other languages from similarly developed regions. |
| Approach: | They propose to evaluate Cantonese LLM performance in factual generation, mathematical logic, complex reasoning, and general knowledge in Cantonesian. |
| Outcome: | The proposed models will evaluate Cantonese's performance in factual generation, mathematical logic, complex reasoning, and general knowledge in Cantone. |
Probabilistic, Structure-Aware Algorithms for Improved Variety, Accuracy, and Coverage of AMR Alignments (2021.acl-long)
Copied to clipboard
| Challenge: | Current algorithms for AMR parsing suffer from limited coverage and less-than-ideal accuracy . a new algorithm for AML uses unsupervised learning and heuristics to align components of AMR graphs to spans in English sentences . |
| Approach: | They propose algorithms for aligning components of Abstract Meaning Representation graphs to spans in English sentences. |
| Outcome: | The proposed approach covers a wider variety of AMR substructures than previously considered . it achieves higher coverage of nodes and edges, and does so with higher accuracy. |
Compete to Complete: Co-opetition Adversarial Learning for Retrieval-Augmented Generation (2026.acl-long)
Copied to clipboard
| Challenge: | Existing approaches to reduce hallucination in large language models lack a robust mechanism for generating a generative model. |
| Approach: | They propose a framework that formulates retriever–generator training in RAG as a minimax game. |
| Outcome: | The proposed framework improves retrieval-augmented generation performance on seven benchmark datasets. |
Leveraging Grammar Induction for Language Understanding and Generation (2024.findings-emnlp)
Copied to clipboard
| Challenge: | Existing grammar induction methods do not provide sufficient performance in downstream tasks. |
| Approach: | They propose an unsupervised grammar induction method for language understanding and generation using a grammar parser and a syntactic mask. |
| Outcome: | The proposed method performs better on from-scratch and pre-trained scenarios. |
SH2: Self-Highlighted Hesitation Helps You Decode More Truthfully (2024.findings-emnlp)
Copied to clipboard
| Challenge: | Large language models (LLMs) have made great progress in text generation but suffer from hallucinations during reasoning and generation. |
| Approach: | They propose an inference-time method to help LLMs decode truthfully by selecting tokens with the lowest probabilities and concatenating them to the original context. |
| Outcome: | The proposed method improves LLaMA-7b, LLama2-7b and Mistral-7b on hallucination tasks. |
Benchmarking Direct Preference Optimization for Medical Large Vision–Language Models (2026.findings-eacl)
Copied to clipboard
| Challenge: | Large vision-language models (LVLMs) are gaining traction in clinical tasks such as diagnostic support, report generation, and medical question answering. |
| Approach: | They present a systematic evaluation of nine DPO variants applied to two leading medical LVLMs. |
| Outcome: | The proposed model improves alignment and reduces severe hallucinations, but yields inconsistent gains over supervised fine-tuning. |
Cross-Media Keyphrase Prediction: A Unified Framework with Multi-Modality Multi-Head Attention and Image Wordings (2020.emnlp-main)
Copied to clipboard
| Challenge: | Existing studies focus on text modeling, ignoring the rich features embedded in the matching images. |
| Approach: | They propose a novel multi-modal multi-head attention model to capture cross-media interactions and image wordings to bridge the two modalities. |
| Outcome: | The proposed model outperforms the current state of the art based on text modeling and image matching . |
Learning Semantic Correspondences from Noisy Data-text Pairs by Local-to-Global Alignments (2020.coling-main)
Copied to clipboard
| Challenge: | Existing methods for data-to-text generation use a large-scale training corpus to learn semantic correspondences between structured input data and associated texts. |
| Approach: | They propose a local-to-global alignment framework that uses local and global models to learn semantic correspondences from large-scale datasets. |
| Outcome: | The proposed framework can be generalized to restaurant and computer domains and improve alignment accuracy. |
KIA: Knowledge-Guided Implicit Vision-Language Alignment for Chest X-Ray Report Generation (2025.coling-main)
Copied to clipboard
| Challenge: | Existing reports on medical images and reports lack fine-grained cross-modal interaction, leading to insufficient understanding of detailed information. |
| Approach: | They propose a framework for establishing cross-modal semantic alignment in radiology report pairs using knowledge-guided implicit vision-language alignment. |
| Outcome: | KIA improves understanding of medical images and reports by incorporating medical knowledge to enhance pathological observation and anatomical landm. |
AutoLoRA: Automatically Tuning Matrix Ranks in Low-Rank Adaptation Based on Meta Learning (2024.naacl-long)
Copied to clipboard
| Challenge: | Large-scale pretraining followed by task-specific finetuning has achieved great success in various NLP tasks. |
| Approach: | They propose a meta learning based framework for automatically identifying the optimal rank of each LoRA layer. |
| Outcome: | The proposed framework is based on a meta learning based framework that can identify the optimal rank of each LoRA layer. |
AraDiCE: Benchmarks for Dialectal and Cultural Capabilities in LLMs (2025.coling-main)
Copied to clipboard
Basel Mousi, Nadir Durrani, Fatema Ahmad, Md. Arid Hasan, Maram Hasanain, Tameem Kabbani, Fahim Dalvi, Shammur Absar Chowdhury, Firoj Alam
| Challenge: | a recent study has found that Arabic is underrepresented in Large Language Models, especially in dialectal variations. |
| Approach: | They propose a benchmark for Arabic Dialect and Cultural Evaluation that evaluates Arabic dialect comprehension and generation. |
| Outcome: | The proposed model outperforms multilingual models on dialect comprehension and generation, but significant challenges persist in dialect identification, generation, and translation. |
LLM-Generated Passphrases That Are Secure and Easy to Remember (2025.findings-naacl)
Copied to clipboard
| Challenge: | Automated password generation is a cornerstone of IT security, but passphrases are often hard to remember and see limited adoption. |
| Approach: | They propose to use large language models to generate passphrases with sufficient entropy . they also use prompt construction to generate a grammatical model with sufficient output entropic . |
| Outcome: | The proposed methods show that the outputs are highly reliable and easy to remember . the proposed methods also show that prompt construction is important in steering the output topic and grammatical structure. |
Identification and Analysis of Personification in Hungarian: The PerSECorp project (2022.lrec-1)
Copied to clipboard
| Challenge: | despite recent findings on the conceptual and linguistic organization of personification, we have relatively little knowledge about its lexical patterns and grammatical templates. |
| Approach: | They propose a corpus-driven approach to personification analysis in cognitive linguistics . they use a semi-automatically processed corpus to annotate personifying linguistic structures . |
| Outcome: | The proposed method consists of annotating a semi-automatic corpus of car reviews in Hungarian . the corpus is structured and annotated manually, and gives an overview of possible data types . |
To Point or Not to Point: Understanding How Abstractive Summarizers Paraphrase Text (2021.findings-acl)
Copied to clipboard
| Challenge: | Abstractive summarization models have seen great improvements in recent years, but there is limited understanding of the strategies different models employ and how they relate their understanding of language. |
| Approach: | They characterize how one popular abstractive model uses an explicit copy/generation switch to control its level of abstraction vs extraction . they find that abstractive summarization models lack the semantic understanding necessary to generate paraphrases that are both abstractive and faithful to the source document. |
| Outcome: | The proposed model uses syntactic boundaries to truncate sentences that are often copied verbatim. |
LUQ: Long-text Uncertainty Quantification for LLMs (2024.emnlp-main)
Copied to clipboard
| Challenge: | Existing research on Uncertainty Quantification (UQ) predominantly targets short text generation, however, real-world applications often necessitate much longer responses. |
| Approach: | They propose a method that ensembles responses from multiple models and selects the response with the lowest uncertainty. |
| Outcome: | The proposed method outperforms baseline methods in correlating with the model’s factuality scores (negative coefficient of -0.85 observed for Gemini Pro). |
Reformulating Domain Adaptation of Large Language Models as Adapt-Retrieve-Revise: A Case Study on Chinese Legal Domain (2024.findings-acl)
Copied to clipboard
| Challenge: | Recent large language models like GPT-4 have demonstrated astonishing zero-shot capabilities in general domain tasks, but they often generate content with hallucinations in specific domains such as Chinese law. |
| Approach: | They propose a framework for adapting large language models (LLMs) to Chinese legal domains by reformulating generation as an adapt-retrieve-revise process. |
| Outcome: | The proposed framework outperforms existing models in the Chinese legal domain by +33.6 points in the zero-shot setting. |
Large Language Models are good multi-lingual learners : When LLMs meet cross-lingual prompts (2025.coling-main)
Copied to clipboard
| Challenge: | Experimental results show that Large Language Models can generate rule-based data in long contexts without following all specified rules. |
| Approach: | They propose a novel prompting strategy Multi-Lingual Prompt which automatically translates the error-prone rule that an LLM struggles to follow into another language, thus drawing greater attention to it. |
| Outcome: | The proposed framework outperforms state-of-the-art prompting methods on public datasets across various tasks, with a specific case study in text-to-MIP instances. |
Activation-Space Personality Steering: Hybrid Layer Selection for Stable Trait Control in LLMs (2026.eacl-long)
Copied to clipboard
| Challenge: | Personality-aware LLMs exhibit implicit personalities in their generation, but reliably controlling or aligning these traits to meet specific needs remains an open challenge. |
| Approach: | They propose a pipeline that extracts hidden state activations from transformer layers using the Big Five Personality Traits framework. |
| Outcome: | The proposed model extracts hidden state activations from transformer layers using the Big Five personality traits (Openness, Conscientiousness, Extraversion, Agreeableness and Neuroticism) |
DreamSync: Aligning Text-to-Image Generation with Image Understanding Feedback (2025.naacl-long)
Copied to clipboard
Jiao Sun, Deqing Fu, Yushi Hu, Su Wang, Royi Rassin, Da-Cheng Juan, Dana Alon, Charles Herrmann, Sjoerd Van Steenkiste, Ranjay Krishna, Cyrus Rashtchian
| Challenge: | Text-to-Image models (T2I) still struggle to produce images that are both aesthetically pleasing and faithful to the user’s input text. |
| Approach: | They propose a training algorithm that trains T2I models to be faithful to the input text. |
| Outcome: | The proposed model improves both the semantic alignment and aesthetic appeal of two diffusion-based T2I models, evidenced by multiple benchmarks (+1.7% on TIFA, +2.9% on DSG1K, +3.4% on VILA aesthetic). |
ExPUNations: Augmenting Puns with Keywords and Explanations (2022.emnlp-main)
Copied to clipboard
Jiao Sun, Anjali Narayan-Chen, Shereen Oraby, Alessandra Cervone, Tagyoung Chung, Jing Huang, Yang Liu, Nanyun Peng
| Challenge: | Puns add the challenge of fusing commonsense and world knowledge with the ability to interpret lexical-semantic ambiguity. |
| Approach: | They propose to augment existing datasets with detailed crowdsourced annotations of puns, keywords and fine-grained funniness ratings to challenge current models' ability to understand and generate humor. |
| Outcome: | The proposed tasks include explanation generation to aid with pun classification and keyword-conditioned pun generation to challenge state-of-the-art models' ability to understand and generate humor. |
LLatrieval: LLM-Verified Retrieval for Verifiable Generation (2024.naacl-long)
Copied to clipboard
| Challenge: | Large language models struggle with factual errors and often produce non-factual and fabricated content. |
| Approach: | They propose to use large language models to generate text with supporting documents to enable the user to flexibly verify the answer. |
| Outcome: | Experiments on ALCE show that LLatrieval significantly outperforms extensive baselines and achieves state-of-the-art results. |
Explaining Generalization of AI-Generated Text Detectors Through Linguistic Analysis (2026.eacl-long)
Copied to clipboard
| Challenge: | Existing studies have reported generalization gaps in AI-text detectors, but they lack insights into the causes. |
| Approach: | They propose to analyze generalization behavior of AI-text detectors using linguistic analysis to explain performance variance. |
| Outcome: | The proposed model can generalize across unseen prompts, model families, and domains, but it can't generalize under distribution shifts. |
Enconter: Entity Constrained Progressive Sequence Generation via Insertion-based Transformer (2021.eacl-main)
Copied to clipboard
| Challenge: | Autoregressive language models do not perform well under hard lexical constraints as they lack fine control of content generation process. |
| Approach: | They propose a new insertion transformer that considers hard lexical constraints and imposes rules over objects in the generated text. |
| Outcome: | The proposed model outperforms baseline models in several performance metrics rendering it more suitable in practical applications. |
RepCodec: A Speech Representation Codec for Speech Tokenization (2024.acl-long)
Copied to clipboard
| Challenge: | Recent advances in large language models have led to discrete speech tokenization, but this discretization can be costly and impedes performance. |
| Approach: | They propose a new speech representation codec for semantic speech tokenization that reconstructs speech representations from speech encoders like HuBERT or data2vec. |
| Outcome: | The proposed method outperforms the widely used k-means clustering approach in speech understanding and generation. |
Retrieving Multimodal Information for Augmented Generation: A Survey (2023.findings-emnlp)
Copied to clipboard
Ruochen Zhao, Hailin Chen, Weishi Wang, Fangkai Jiao, Xuan Long Do, Chengwei Qin, Bosheng Ding, Xiaobao Guo, Minzhi Li, Xingxuan Li, Shafiq Joty
| Challenge: | Large Language Models (LLMs) are increasingly using multimodality to augment their generation ability, but there is no unified perception of at which stage and how to incorporate different modalities. |
| Approach: | They propose to use multimodality to augment Large Language Models (LLMs) this will provide scholars with a deeper understanding of the methods' applications and encourage them to adapt existing techniques to the fast-growing field of LLMs. |
| Outcome: | The proposed methods improve factuality, reasoning, interpretability, and robustness of the generated content. |
Deep Copycat Networks for Text-to-Text Generation (D19-1)
Copied to clipboard
| Challenge: | Text-to-text generation tasks require copying words from the input to the output. |
| Approach: | They propose a transformer-based pointer network for text-to-text generation which generates more abstractive summaries and a further extension of this architecture for automatic post-editing. |
| Outcome: | The proposed model outperforms existing models in text-to-text generation tasks and improves translation accuracy. |
Verify-and-Edit: A Knowledge-Enhanced Chain-of-Thought Framework (2023.acl-long)
Copied to clipboard
| Challenge: | Large language models (LLMs) have a number of shortcomings, including lack of factual correctness. |
| Approach: | They propose a framework to increase prediction factuality by post-editing reasoning chains . they propose to use large language models to generate interpretable reasoning chains. |
| Outcome: | The proposed framework leads to accuracy improvements in open-domain question-answering tasks. |
Evaluating Language Models as Synthetic Data Generators (2025.acl-long)
Copied to clipboard
Seungone Kim, Juyoung Suk, Xiang Yue, Vijay Viswanathan, Seongyun Lee, Yizhong Wang, Kiril Gashteovski, Carolin Lawrence, Sean Welleck, Graham Neubig
| Challenge: | Prior studies have focused on developing effective data generation methods, but lack systematic comparison of different LMs as data generators in a unified setting. |
| Approach: | They propose to use a benchmark to compare language models' data generation abilities against a set of standardized settings and metrics. |
| Outcome: | The proposed benchmark provides standardized settings and metrics to evaluate LMs’ data generation abilities. |
Uncovering Implicit Gender Bias in Narratives through Commonsense Inference (2021.findings-emnlp)
Copied to clipboard
| Challenge: | Pre-trained language models learn harmful biases from their training corpora and may repeat these biase if used for generation. |
| Approach: | They focus on gender biases associated with the protagonist in model-generated stories and use a commonsense reasoning engine to uncover them. |
| Outcome: | The proposed model-generated stories are based on a commonsense reasoning engine and are able to uncover gender biases in the protagonist's motivations, attributes, mental states, and implications on others. |
Twist Decoding: Diverse Generators Guide Each Other (2022.emnlp-main)
Copied to clipboard
Jungo Kasai, Keisuke Sakaguchi, Ronan Le Bras, Hao Peng, Ximing Lu, Dragomir Radev, Yejin Choi, Noah A. Smith
| Challenge: | Using a variety of language generation models, ensembling models is challenging during inference. |
| Approach: | They propose a method that decodes text models that do not assume a shared vocabulary, tokenization or generation order. |
| Outcome: | The proposed method outperforms models decoded in isolation over various scenarios. |
Understanding and Improving the Robustness of Terminology Constraints in Neural Machine Translation (2023.acl-long)
Copied to clipboard
| Challenge: | Existing terminology constraint test sets are blind to this issue due to oversimplified settings . PH methods retain high constraint accuracy but lower translation quality . |
| Approach: | They propose a method that replaces terminology terms with ordered labels . placeholder methods are better at retaining high constraint accuracy but lower translation quality . |
| Outcome: | The proposed method achieves high accuracy and translation quality regardless of the number or length of constraints. |
PEMA: An Offsite-Tunable Plug-in External Memory Adaptation for Language Models (2024.naacl-long)
Copied to clipboard
| Challenge: | Pre-trained language models (PLMs) show impressive performance in various downstream NLP tasks. |
| Approach: | They propose a Parameter-Efficient Fine-Tuning method that integrates with context representations from test data to perform downstream tasks. |
| Outcome: | The proposed method outperforms other methods in memory and latency efficiency and maintains sentence meaning and generating appropriate language and styles. |
Understanding Refusal in Language Models with Sparse Autoencoders (2025.findings-emnlp)
Copied to clipboard
| Challenge: | a study of refusal in instruction-tuned language models identifies latent features that causally mediate refusal behaviors. |
| Approach: | They conduct a mechanistic study of refusal in instruction-tuned LLMs using sparse autoencoders . they identify latent features that causally mediate refusal behaviors using sparsed autoencoding . |
| Outcome: | The proposed method validates refusal-related features across multiple datasets. |
ChartVerse: Scaling Chart Reasoning via Reliable Programmatic Synthesis from Scratch (2026.acl-long)
Copied to clipboard
Zheng Liu, Honglin Lin, Xiaoyang Wang, Xin Gao, Yu Li, Mengzhang Cai, Yun Zhu, Zhanping Zhong, Qizhi Pei, Zhuoshi Pan, Xiaoran Shang, Conghui He, Bin Cui, Wentao Zhang, Lijun Wu
| Challenge: | Existing open-source vision language models lack high-quality training data for chart reasoning . current models are simplistic and repetitive, while associated QA pairs are prone to hallucinations . |
| Approach: | They propose a framework to synthesize complex charts and reliable reasoning data from scratch. |
| Outcome: | Experimental results show that ChartVerse-8B surpasses existing models in QA and difficulty . lack of high-quality training data hampers development of open-source models . |
UniConv: Unifying Retrieval and Response Generation for Large Language Models in Conversations (2025.acl-long)
Copied to clipboard
Fengran Mo, Yifan Gao, Chuan Meng, Xin Liu, Zhuofeng Wu, Kelong Mao, Zhengyang Wang, Pei Chen, Zheng Li, Xian Li, Bing Yin, Meng Jiang
| Challenge: | Existing conversational search systems are usually built with two different models . this separation restricts the system from leveraging the model's intrinsic knowledge simultaneously . Existing studies for developing unified models cannot fully address the aspects of understanding conversational context, managing retrieval independently, and generating responses. |
| Approach: | They propose to unify dense retrieval and response generation for large language models in conversation by fine-tuning and mitigating data discrepancy. |
| Outcome: | The proposed model can outperform existing models on five conversational search datasets and reduce inconsistency risks while mitigating data discrepancy. |
Singlish Message Paraphrasing: A Joint Task of Creole Translation and Text Normalization (2022.coling-1)
Copied to clipboard
| Challenge: | Existing computational approaches to translate languages or creoles back to standard English are challenging . lexical level normalization, syntactic level editing, and semantic level rewriting are key to a successful translation task. |
| Approach: | They propose a computational task to parse Singlish into English using its dialects . they propose to use a dataset to normalize and edit the text to improve translation . |
| Outcome: | The proposed model can improve translation performance and improve stance detection. |
Effective Large Language Model Adaptation for Improved Grounding and Citation Generation (2024.naacl-long)
Copied to clipboard
| Challenge: | Large language models generate "hallucinated" answers that are not factual . despite their widespread adoption, they can generate plausiblesounding but nonfactual information. |
| Approach: | They propose a framework that tunes large language models to self-ground claims and provide citations to retrieved documents. |
| Outcome: | The proposed framework generates superior grounded responses with more accurate citations compared to prompting-based approaches and post-hoc citing-based methods. |
Model Internals-based Answer Attribution for Trustworthy Retrieval-Augmented Generation (2024.emnlp-main)
Copied to clipboard
| Challenge: | Recent research has shown that self-citing large language models (LLMs) fail to faithfully reflect their context usage throughout the generation process. |
| Approach: | They propose a plug-and-play approach using model internals for faithful answer attribution in RAG applications that detects context-sensitive answer tokens and pairs them with retrieved documents contributing to their prediction. |
| Outcome: | The proposed approach achieves citation quality and efficiency comparable to self-citation while allowing for a finer-grained control of attribution parameters. |
Controllable Paraphrase Generation for Semantic and Lexical Similarities (2024.lrec-main)
Copied to clipboard
| Challenge: | Lexically diverse paraphrases are crucial in data augmentation because they enhance the linguistic diversity of the corpus. |
| Approach: | They propose a controllable model for semantic and lexical similarities by attaching tags to the head of the input sentence. |
| Outcome: | The proposed model can paraphrase an input sentence according to the tags specified. |
WIKIGENBENCH:Exploring Full-length Wikipedia Generation under Real-World Scenario (2025.coling-main)
Copied to clipboard
Jiebin Zhang, Eugene J. Yu, Qinyu Chen, Chenhao Xiong, Dawei Zhu, Han Qian, Mingbo Song, Weimin Xiong, Xiaoguang Li, Qun Liu, Sujian Li
| Challenge: | Existing efforts to generate Wikipedia articles for new events fall short of real-world application. |
| Approach: | They propose a benchmark to generate Wikipedia articles for new events under real-world scenarios . they use systematic metrics and LLM-based metrics to assess verifiability, organization, and other aspects aligned with real-life scenarios. |
| Outcome: | The proposed benchmarks show that hierarchical-based methods generate more comprehensive content while fine-tuned methods achieve better verifiability. |
Controlled Generation with Prompt Insertion for Natural Language Explanations in Grammatical Error Correction (2024.lrec-main)
Copied to clipboard
| Challenge: | Existing studies present tokens, examples, and hints for corrections, but do not directly explain the reasons in natural language. |
| Approach: | They propose a method called controlled generation with Prompt Insertion that uses Large Language Models to explain the reasons for corrections in natural language. |
| Outcome: | The proposed method can explain the reasons for corrections in natural language by guiding the LLMs to generate explanations for all correction points. |
Tokenizer-Aware Cross-Lingual Adaptation of Decoder-Only LLMs through Embedding Relearning and Swapping (2026.eacl-long)
Copied to clipboard
| Challenge: | Large Language Models (LLMs) have been primarily focused on English, leaving the multilingual ability unexplored. |
| Approach: | They propose a technique that creates new tokenizers and tunes embeddings on fixed model weights for target language adaptation. |
| Outcome: | The proposed method is light-weight and performant but has limitations for older models and high resource languages. |
TeleMelody: Lyric-to-Melody Generation with a Template-Based Two-Stage Method (2022.emnlp-main)
Copied to clipboard
Zeqian Ju, Peiling Lu, Xu Tan, Rui Wang, Chen Zhang, Songruoyao Wu, Kejun Zhang, Xiang-Yang Li, Tao Qin, Tie-Yan Liu
| Challenge: | a new lyric-to-melody generation system bridges the gap between lyrics and melodies . previous generation systems lack paired data and lack of control on generated melodie. |
| Approach: | They develop a lyric-to-melody generation system with music template to bridge the gap between lyrics and melodies. |
| Outcome: | The proposed system bridges the gap between lyrics and melodies by using music template. |
Turning the Tide: Repository-based Code Reflection (2025.findings-emnlp)
Copied to clipboard
| Challenge: | Code large language models (LLMs) enhance programming by understanding and generating code across languages. |
| Approach: | a new benchmark evaluates code understanding and generation in repositories using code large language models. |
| Outcome: | The proposed model improves code understanding and generation in repositories by evaluating 1,888 test cases across 6 programming languages. |
RoadMapper: A Multi-Agent System for Roadmap Generation of Solving Complex Research Problems (2026.findings-acl)
Copied to clipboard
Jiacheng Liu, Zichen Tang, Zhongjun Yang, Xinyi Hu, Xueyuan Lin, Linwei Jia, Ruofei Bai, Rongjin Li, Shiyao Peng, Haocheng Gao, Haihong E
| Challenge: | Existing tools to generate structured content for research tasks are limited in their ability to generate high-quality roadmaps. |
| Approach: | They propose a benchmark to evaluate the ability of large language models (LLMs) to generate high-quality roadmaps for solving complex research problems. |
| Outcome: | The proposed system can improve LLMs’ ability for roadmap generation while saving 84% of the time required by human experts. |
GUARD: Glocal Uncertainty-Aware Robust Decoding for Effective and Efficient Open-Ended Text Generation (2025.findings-emnlp)
Copied to clipboard
Yuanhao Ding, Esteban Garces Arias, Meimingwei Li, Julian Rodemann, Matthias Aßenmacher, Danlu Chen, Gaojuan Fan, Christian Heumann, Chongsheng Zhang
| Challenge: | GUARD is a self-adaptive decoding method that balances coherence with diversity in open-ended text generation. |
| Approach: | They propose a self-adaptive decoding method that balances coherence and diversity . they combine global entropy estimates with local entropic deviations to integrate uncertainty . |
| Outcome: | GUARD achieves a good balance between diversity and coherence while exhibiting significant improvements in generation speed. |
Test-Time Scaling in Multimodal Foundation Models: A Comprehensive Survey of Generation and Reasoning (2026.findings-acl)
Copied to clipboard
| Challenge: | Recent advances have adapted this paradigm to Multimodal Foundation Models (MFMs), unlocking their potential in multimodal reasoning and generation. |
| Approach: | They propose a taxonomy framework that categorizes existing methodologies into three distinct strategies: sampling-based, feedback-based and search-based approaches. |
| Outcome: | The proposed framework categorizes existing methodologies into three distinct strategies: sampling-based, feedback-based and search-based approaches. |
Writing by Memorizing: Hierarchical Retrieval-based Medical Report Generation (2021.acl-long)
Copied to clipboard
| Challenge: | Existing methods for medical image analysis use predefined template databases or ignore hierarchical nature of medical report generation. |
| Approach: | They propose a hierarchical retrieval mechanism to extract both report and sentence-level templates for clinically accurate report generation. |
| Outcome: | The proposed model extracts both report and sentence-level templates for clinically accurate report generation. |
LLM Braces: Straightening Out LLM Predictions with Relevant Sub-Updates (2025.acl-long)
Copied to clipboard
| Challenge: | Recent studies reveal that much of the knowledge in a Transformer-based Large Language Model (LLM) is encoded in its feed-forward (FFN) layers, where each FNN layer can be interpreted as the summation of sub-updates, each corresponding to a weighted column vector from the FFN’s value parameter matrix. |
| Approach: | They propose a method that computes relevance scores associated with value vectors in FFN layers and leverages these scores to dynamically adjust the contribution of sub-updates. |
| Outcome: | The proposed framework outperforms baseline approaches in fine-tuning and zero-shot settings while requiring significantly fewer tunable parameters. |
Distilling ChatGPT for Explainable Automated Student Answer Assessment (2023.findings-emnlp)
Copied to clipboard
| Challenge: | Existing automated student answer assessment models lack explainable and faithful feedback. |
| Approach: | They propose a framework that leverages ChatGPT for student answer scoring and rationale generation. |
| Outcome: | The proposed method improves the overall QWK score by 11% compared to ChatGPT. |
QBridge: Bridging Natural Language and SQL via Gold Query Rewriting with Agentic Refinement (2026.acl-long)
Copied to clipboard
| Challenge: | Natural language to SQL (NL2SQL) is an intuitive interface for querying structured data . but real user questions are noisy, ambiguous, and weakly grounded to database semantics. |
| Approach: | They propose an agentic feedback-driven NL2SQL framework that bridges natural language and SQL via Gold Query. |
| Outcome: | The proposed framework outperforms strong prompting and agentic baselines on spider, BIRD, and three robustness variants on NL2SQL. |
Scaling LLM Inference Efficiently with Optimized Sample Compute Allocation (2025.naacl-long)
Copied to clipboard
| Challenge: | Existing methods to optimize sample allocations for large language models fail to account for the optimal sampling configuration. |
| Approach: | They propose an algorithm that optimizes sample allocation by finding an optimal mix of different inference configurations. |
| Outcome: | The proposed algorithm achieves better accuracy on SWE-Bench with 3x less compute than the default configuration. |
Language Model Detoxification in Dialogue with Contextualized Stance Control (2022.findings-emnlp)
Copied to clipboard
| Challenge: | Existing work on Language Model detoxification has focused on reducing the toxicity of the generation itself without consideration of the context. |
| Approach: | They propose a method to do context-dependent detoxification without taking into account the stance of the generated response. |
| Outcome: | The proposed method can learn the context-dependent stance control strategies while keeping a low self-toxicity of the underlying LM. |
Prompt Compression and Contrastive Conditioning for Controllability and Toxicity Reduction in Language Models (2022.findings-emnlp)
Copied to clipboard
| Challenge: | We explore the idea of compressing the prompts used to condition language models. |
| Approach: | They explore the idea of compressing the prompts used to condition language models . they show that compressed prompts can retain a substantive amount of information about the original prompt . |
| Outcome: | The proposed method can be extended to controllability and toxicity reduction. |
SPASM: Stable Persona-driven Agent Simulation for Multi-turn Dialogue Generation (2026.findings-acl)
Copied to clipboard
| Challenge: | Large language models are increasingly deployed in multi-turn settings such as tutoring, support, and counseling where reliability depends on preserving consistent roles, personas, and goals across long horizons. |
| Approach: | They propose a framework that decomposes LLM–LLM conversations into a modular, stability-first framework that allows for a stable persona-driven agent simulation for multi-turn dialogue generation. |
| Outcome: | The proposed framework decomposes the LLM-based model into four main components: persona creation, plausibility validation, and natural-language persona crafting. |
Improving Factual Completeness and Consistency of Image-to-Text Radiology Report Generation (2021.naacl-main)
Copied to clipboard
| Challenge: | Existing report generation systems suffer from incomplete and inconsistent generation, despite achieving high performance on natural language metrics such as CIDEr and BLEU. |
| Approach: | They propose two new rewards that encourage the generation of factually complete and consistent radiology reports by using an existing semantic equivalence metric. |
| Outcome: | The proposed system significantly improves the F1 score of a clinical information extraction performance on two open radiology report datasets. |
SciReviewGen: A Large-scale Dataset for Automatic Literature Review Generation (2023.findings-acl)
Copied to clipboard
| Challenge: | Existing literature review models have addressed literature review generation, but lack of large-scale datasets has been a stumbling block. |
| Approach: | They propose to use a large-scale dataset to evaluate automatic literature review generation models. |
| Outcome: | The proposed model can generate summaries comparable to human-written reviews while lacking detailed information. |
Comments as Natural Logic Pivots: Improve Code Generation via Comment Perspective (2024.findings-acl)
Copied to clipboard
| Challenge: | Existing studies decompose complex tasks into intermediate steps by prompting strategies, such as Chain-of-Thought and its variants. |
| Approach: | They propose to use code comments as natural logic pivot between natural language and code language to boost the code generation ability of code LLMs. |
| Outcome: | The proposed method significantly improves the code pass rate on humanEval and MBPP, while the robustness of the logical comment decoding strategy is higher than the Chain-of-thoughts prompting. |
Detecting Hallucination and Coverage Errors in Retrieval Augmented Generation for Controversial Topics (2024.lrec-main)
Copied to clipboard
Tyler A. Chang, Katrin Tomanek, Jessica Hoffmann, Nithum Thain, Erin MacMurray van Liemt, Kathleen Meier-Hellstern, Lucas Dixon
| Challenge: | a growing audience of users is engaging with LLM-driven chatbots. |
| Approach: | They propose a strategy to handle controversial topics in LLM-based chatbots based on Wikipedia’s Neutral Point of View principle. |
| Outcome: | The proposed methods detect errors in the tuned LLM responses even when no training data is available. |
You Don’t Know My Favorite Color: Preventing Dialogue Representations from Revealing Speakers’ Private Personas (2022.naacl-main)
Copied to clipboard
| Challenge: | Social chatbots evolve rapidly with large pretrained language models. |
| Approach: | They propose effective defense objectives to protect persona leakage from hidden states by a simple neural network. |
| Outcome: | The proposed defense objectives reduce the attack accuracy from 37.6% to 0.5% while preserving language models’ powerful generation ability. |
VLM Is a Strong Reranker: Advancing Multimodal Retrieval-augmented Generation via Knowledge-enhanced Reranking and Noise-injected Training (2025.findings-emnlp)
Copied to clipboard
| Challenge: | a significant drawback of Vision-language Models is their reliance on static training data, leading to outdated information and limited contextual awareness. |
| Approach: | They propose a framework with knowledge-enhanced reranking and noise-injected training to improve the VLM's ranking ability. |
| Outcome: | The proposed framework is based on a simple yet effective instruction template and is able to induce its ranking ability and serve it as a reranker to precisely filter the top-k retrieved images. |
On A Scale From 1 to 5: Quantifying Hallucination in Faithfulness Evaluation (2025.findings-naacl)
Copied to clipboard
| Challenge: | Hallucination is a popular topic in natural language generation (NLG). |
| Approach: | They propose to use large language models to evaluate faithfulness of guided NLGs by a rubric template and large language inference models to score the generation on quantifiable scales. |
| Outcome: | The proposed system can provide accurate judgement and explain whether a source and generation are factually consistent. |
Warmup Generations: A Task-Agnostic Approach for Guiding Sequence-to-Sequence Learning with Unsupervised Initial State Generation (2025.acl-long)
Copied to clipboard
| Challenge: | Existing supervised fine-tuning (SFT) methods focus on directly generating the target output without leveraging the benefits of intermediate steps or initial guidance. |
| Approach: | They propose a task-agnostic framework that enables models to generate intermediate "warmup" sequences that are iteratively refined to maximize their contribution to the final output. |
| Outcome: | The proposed framework outperforms traditional supervised fine-tuning methods on translation, summarization, and multi-choice question answering tasks. |
Steering Language Models in Multi-Token Generation: A Case Study on Tense and Aspect (2025.emnlp-main)
Copied to clipboard
| Challenge: | Prior work has focused largely on binary grammatical contrasts, but how do they encode their syntactic knowledge internally? |
| Approach: | They propose to use a multidimensional hierarchical grammar phenomenon to identify distinct, orthogonal directions in residual space to demonstrate causal control over both grammatical features. |
| Outcome: | The proposed model can encode tense and aspect in human-like ways, but effective steering during generation is sensitive to multiple factors and requires manual tuning or automated optimization. |
Amphista: Bi-directional Multi-head Decoding for Accelerating LLM Inference (2025.naacl-long)
Copied to clipboard
Zeping Li, Xinlong Yang, Ziheng Gao, Ji Liu, Guanchen Li, Zhuang Liu, Dong Li, Jinzhang Peng, Lu Tian, Emad Barsoum
| Challenge: | Existing methods such as Medusa lack adequate information interaction between different drafting heads. |
| Approach: | They propose an enhanced speculative decoding framework that builds upon Medusa and integrates a drafting block capable of parallel inference. |
| Outcome: | The proposed framework outperforms Medusa in terms of head accuracy and latency. |
ORGAN: Observation-Guided Radiology Report Generation via Tree Reasoning (2023.acl-long)
Copied to clipboard
| Challenge: | Existing methods to generate radiology reports only rely on high-level plans, but they lack important information. |
| Approach: | They propose an Observation-guided radiology Report Generation framework which generates free-text descriptions for a set of radiographs. |
| Outcome: | The proposed framework outperforms state-of-the-art methods regarding text quality and clinical efficacy. |
Who Gets Which Message? Auditing Demographic Bias in LLM-Generated Targeted Text (2026.findings-acl)
Copied to clipboard
| Challenge: | Large language models generate demographically conditioned persuasive texts at scale . authors argue that such capabilities raise questions about fairness and representational bias in automated communication. |
| Approach: | They propose a framework for evaluating demographic-conditioned targeted messages . they find gender- and age-based asymmetries in male- and youth-targeted messages a . |
| Outcome: | The proposed framework evaluates generated messages across three dimensions: lexical content, language style, and persuasive framing. |
Hierarchical Catalogue Generation for Literature Review: A Benchmark (2023.findings-emnlp)
Copied to clipboard
| Challenge: | Scientific literature review generation aims to extract and organize important information from an abundant collection of reference papers and produces corresponding reviews while lacking a clear and logical hierarchy. |
| Approach: | They propose a task to generate a hierarchical catalogue of a review paper given various references by using a database of 7.6k literature review catalogues and 389k reference papers. |
| Outcome: | The proposed method produces a hierarchical catalogue of a review paper given various references. |
SGG: Learning to Select, Guide, and Generate for Keyphrase Generation (2021.naacl-main)
Copied to clipboard
| Challenge: | Existing keyphrase generation approaches synchronously generate present and absent keyphrases without explicitly distinguishing these two categories. |
| Approach: | They propose to deal with present and absent keyphrases separately with different mechanisms by using a hierarchical neural network with a pointing-based selector and a selection-guided generator. |
| Outcome: | The proposed model outperforms baselines on four keyphrase generation tasks and shows extensibility in natural language generation tasks. |
Elaborative Simplification: Content Addition and Explanation Generation in Text Simplification (2021.findings-acl)
Copied to clipboard
| Challenge: | a new study examines the use of content addition in text simplification when complex concepts need to be explained. |
| Approach: | They present a data-driven study of content addition in text simplification . they analyze 1.3K instances of elaborative simplification in the Newsela corpus . |
| Outcome: | The proposed study shows that contextual specificity can improve elaboration generation performance. |
ParaMac: A General Unsupervised Paraphrase Generation Framework Leveraging Semantic Constraints and Diversifying Mechanisms (2022.findings-emnlp)
Copied to clipboard
| Challenge: | Existing unsupervised methods for paraphrase generation are weak in semantic equivalence or expression diversity. |
| Approach: | They propose a framework for unsupervised paraphrase generation that employs multi-aspect equivalence constraints and multi-granularity diversifying mechanisms to achieve good semantic equvalence and expressive diversity. |
| Outcome: | The proposed framework achieves 9.1% and 3.3% absolute gains over previous SOTA on Quora and MSCOCO and can improve to 18.0% and 4.6% on GLUE. |
An Empirical Study of Generation Order for Machine Translation (2020.emnlp-main)
Copied to clipboard
| Challenge: | a recent study of generation order for machine translation shows it does not affect output quality . Neural sequence models have been successfully applied to a broad range of tasks in recent years . |
| Approach: | They propose a soft order-reward framework that enables models to follow arbitrary oracle generation policies. |
| Outcome: | The proposed framework explores a wide variety of generation orders including uninformed orders, location-based orders, frequency-based or model-based orderings, and model-driven orders. |
DRBO: Mitigating Short Board Effect via Dynamic Reward Balancing in Multi-reward LLM Optimization (2025.findings-emnlp)
Copied to clipboard
| Challenge: | a new framework to optimize large language models (LLMs) for evaluation metrics is needed to balance weaker metrics. |
| Approach: | They propose a Dynamic Reward Balancing Optimization framework to mitigate the "short-board effect" they apply it to single-task and multi-type task scenarios . |
| Outcome: | The proposed framework improves performance and balances performance across multiple metrics. |
Capturing Relations between Scientific Papers: An Abstractive Model for Related Work Section Generation (2021.acl-long)
Copied to clipboard
| Challenge: | Existing related work generation models are inflexible and extract sentences from multiple papers to form a related work discussion. |
| Approach: | They propose a Relation-aware Related work generator which generates an abstractive related work from the given multiple scientific papers in the same research area. |
| Outcome: | The proposed model improves over existing models and can be used to familiarize researchers with the state of the art in the field. |
Chain of Ideas: Revolutionizing Research Via Novel Idea Development with LLM Agents (2025.findings-emnlp)
Copied to clipboard
Long Li, Weiwen Xu, Jiayan Guo, Ruochen Zhao, Xingxuan Li, Yuqian Yuan, Boqiang Zhang, Yuming Jiang, Yifei Xin, Ronghao Dang, Yu Rong, Deli Zhao, Tian Feng, Lidong Bing
| Challenge: | Existing methods for idea generation either trivially prompt LLMs or expose LLM to extensive literature without indicating useful information. |
| Approach: | They propose a chain-of-ideas agent that organizes literature in a chains structure . they propose evaluating idea-generation methods from different perspectives . |
| Outcome: | The proposed agent outperforms existing methods and matches human quality in idea generation. |
When to Speak, When to Abstain: Contrastive Decoding with Abstention (2025.acl-long)
Copied to clipboard
| Challenge: | Large Language Models (LLMs) demonstrate exceptional performance across diverse tasks by leveraging pre-trained (parametric) and external (contextual) knowledge. |
| Approach: | They propose a training-free decoding method that allows LLMs to generate responses when relevant knowledge is available and to abstain otherwise. |
| Outcome: | The proposed method can generate responses when relevant knowledge is available and abstain otherwise. |
Dynamic Knowledge Prompt for Chest X-ray Report Generation (2024.lrec-main)
Copied to clipboard
| Challenge: | Existing methods for radiology report generation fail to incorporate prior knowledge . data bias, sparse features of chest X-ray image make it difficult to generate reports . |
| Approach: | They propose a dynamically integrated framework for chest X-ray report generation that incorporates pulmonary lesion knowledge at the instance-level. |
| Outcome: | The proposed framework can dynamically incorporate pulmonary lesion knowledge at instance-level to facilitate report generation. |
Q-TOD: A Query-driven Task-oriented Dialogue System (2022.emnlp-main)
Copied to clipboard
| Challenge: | Existing pipelined task-oriented dialogue systems have difficulties adapting to unseen domains . end-to-end systems are plagued by large-scale knowledge bases in practice . |
| Approach: | They propose a query-driven task-oriented dialogue system that extracts dialogue context information into a natural language query. |
| Outcome: | The proposed system outperforms strong baselines and establishes a new state-of-the-art performance on three publicly available task-oriented dialogue datasets. |
A-TIP: Attribute-aware Text Infilling via Pre-trained Language Model (2022.coling-1)
Copied to clipboard
| Challenge: | Existing methods for text infilling focus on the infill length of blanks and attribute relevance, but attribute-aware content can be more useful. |
| Approach: | They propose an attribute-aware text infilling method via a Pre-trained language model which contains a text in filling component and a plug-and-play discriminator. |
| Outcome: | The proposed method improves attribute relevance without decreasing text fluency on three open-source datasets. |
A Dataset for Tracking Entities in Open Domain Procedural Text (2020.emnlp-main)
Copied to clipboard
Niket Tandon, Keisuke Sakaguchi, Bhavana Dalvi, Dheeraj Rajagopal, Peter Clark, Michal Guerquin, Kyle Richardson, Eduard Hovy
| Challenge: | Existing tasks require only a small set of attributes to track state changes in procedural text. |
| Approach: | They propose a task where given a procedural text as input, the task is to generate a set of state change tuples for each step. |
| Outcome: | The proposed task generates state change tuples from a set of pre-defined attributes for each step and predicts them from an open vocabulary. |
“Well, Keep Thinking”: Enhancing LLM Reasoning with Adaptive Injection Decoding (2025.findings-acl)
Copied to clipboard
| Challenge: | Large language models (LLMs) exhibit strong reasoning abilities, often attributed to few-shot or zero-shot Chain-of-Thought (CoT) prompting. |
| Approach: | They propose a decoding strategy that nudges LLMs to continue reasoning, thereby preventing immature reasoning processes. |
| Outcome: | The proposed method significantly improves LLM reasoning capabilities on diverse reasoning benchmarks. |
Language Model Augmented Relevance Score (2021.acl-long)
Copied to clipboard
| Challenge: | Existing metrics that compare the candidate with the human reference do not consider the context, resulting in poor correlation with human judgements. |
| Approach: | They propose a language model-aware metric that augments the human reference while considering the context to provide evaluation scores that correlate highly with human judgements. |
| Outcome: | The proposed metric achieves higher correlation with human reference judgements and differentiates well-formed candidates from adversarial samples to a larger degree. |
SSH: Sparse Spectrum Adaptation via Discrete Hartley Transformation (2025.naacl-long)
Copied to clipboard
| Challenge: | Low-rank adaptation (LoRA) has been demonstrated effective in reducing the trainable parameter number when fine-tuning a large foundation model (LLM). |
| Approach: | They propose a low-rank adaptation approach that reduces the number of trainable parameters while enhancing model performance. |
| Outcome: | The proposed approach outperforms existing parameter-efficient fine-tuning methods while achieving substantial reductions in computational cost and memory requirements. |
GanLM: Encoder-Decoder Pre-training with an Auxiliary Discriminator (2023.acl-long)
Copied to clipboard
Jian Yang, Shuming Ma, Li Dong, Shaohan Huang, Haoyang Huang, Yuwei Yin, Dongdong Zhang, Liqun Yang, Furu Wei, Zhoujun Li
| Challenge: | Existing pre-training methods underutilize the benefits of language understanding for generation. |
| Approach: | They propose a GAN-style model for encoder-decoder pre-training with an auxiliary discriminator. |
| Outcome: | The proposed model outperforms existing pre-trained models and achieves state-of-the-art performance. |
Program Structure-aware Language Models: Targeted Software Testing beyond Textual Semantics (2026.findings-acl)
Copied to clipboard
| Challenge: | Recent advances in large language models for test case generation have improved branch coverage via prompt-engineered mutations, limiting their effectiveness for discovering subtle bugs and security vulnerabilities. |
| Approach: | They propose a program structure-aware LLM framework that integrates code property graphs and code semantics to condition test case generation on execution branches. |
| Outcome: | Experiments on real-world projects show that GLMTest improves branch accuracy from 27.4% to 50.2% on TestGenEval benchmark compared with state-of-the-art LLMs, i.e., Claude-Sonnet-4.5 and GPT-4o-mini. |
SelfRACG: Enabling LLMs to Self-Express and Retrieve for Code Generation (2025.emnlp-main)
Copied to clipboard
Qian Dong, Jia Chen, Qingyao Ai, Hongning Wang, Haitao Li, null Yiwu, Yao Hu, Yiqun Liu, Shaoping Ma
| Challenge: | Existing retrieval-augmented code generation methods fail to accurately fetch the knowledge required for code generation for consecutive code fragments. |
| Approach: | They propose a paradigm that enables large language models to Self-express their information needs to enhance retrieval-augmented code generation methods. |
| Outcome: | Experiments show that SelfRACG can retrieve external knowledge that better aligns with the LLM’s own information needs, resulting in superior generation performance compared to vanilla RACG. |
Evidence-Aware Inferential Text Generation with Vector Quantised Variational AutoEncoder (2020.acl-main)
Copied to clipboard
| Challenge: | Existing approaches for inferential text generation ignore context that is not explicitly provided . Existing models ignore background knowledge that provides crucial evidence to generate inferences . |
| Approach: | They propose an approach that automatically finds evidence for an event from a large text corpus and leverages it to guide the generation of inferential texts. |
| Outcome: | The proposed model generates inferential texts from a large text corpus and uses evidence to guide it. |
Feature Extraction and Steering for Enhanced Chain-of-Thought Reasoning in Language Models (2025.emnlp-main)
Copied to clipboard
| Challenge: | Large Language Models (LLMs) can solve reasoning and mathematical problems using the Chain-of-Thought technique, but require costly and long CoT data and fine-tuning. |
| Approach: | They propose a method that uses Sparse Autoencoders to extract interpretable features from vanilla CoT and use them to steer the LLM's internal states. |
| Outcome: | The proposed method uses Sparse Autoencoders (SAEs) to extract interpretable features from vanilla CoT and steer the LLM's internal states during generation. |
Context-Tuning: Learning Contextualized Prompts for Natural Language Generation (2022.coling-1)
Copied to clipboard
| Challenge: | Recent studies have shown that pretrained language models (PLMs) lack sufficient consideration of input semantics to generate natural language. |
| Approach: | They propose a continuous prompting approach to fine-tune PLMs for natural language generation by modeling an inverse generation process from output to input. |
| Outcome: | The proposed method fine-tunes only 0.12% of the parameters while maintaining good performance. |
Revisiting Interpolation Augmentation for Speech-to-Text Generation (2024.findings-acl)
Copied to clipboard
Chen Xu, Jie Wang, Xiaoqian Liu, Qian Dong, Chunliang Zhang, Tong Xiao, JingBo Zhu, Dapeng Man, Wu Yang
| Challenge: | Existing approaches to speech-to-text generation tasks are limited by the lack of extensive labeled datasets. |
| Approach: | They propose to use interpolation augmentation to construct virtual training samples by transforming inputs and labels to enhance generalization in other domains. |
| Outcome: | The proposed approach significantly improves performance across diverse tasks, architectures, and data scales, offering a promising avenue for more robust S2T systems in resource-constrained settings. |
Generating Biographies on Wikipedia: The Impact of Gender Bias on the Retrieval-Based Generation of Women Biographies (2022.acl-long)
Copied to clipboard
| Challenge: | Existing efforts to encourage article creation focus on reducing the gender gap in Wikipedia articles. |
| Approach: | They propose a model that retrieves web evidence and generates biographies section by section . they analyze available web evidence to determine the accuracy of the generated text . |
| Outcome: | The proposed model can generate biographies section by section, including citation information, using retrieval mechanisms and a cache-based pre-trained encoder-decoder. |
How Reliable is Multilingual LLM-as-a-Judge? (2025.findings-emnlp)
Copied to clipboard
| Challenge: | LLMs are a popular evaluation strategy, but their reliability in multilingual evaluation remains uncertain. |
| Approach: | They evaluate five models from different model families across five diverse tasks involving 25 languages. |
| Outcome: | The models perform poorly across languages and average Fleiss’ Kappa is 0.3 . |
DebateCoder: Towards Collective Intelligence of LLMs via Test Case Driven LLM Debate for Code Generation (2025.acl-long)
Copied to clipboard
Jizheng Chen, Kounianhua Du, Xinyi Dai, Weiming Zhang, Xihuai Wang, Yasheng Wang, Ruiming Tang, Weinan Zhang, Yong Yu
| Challenge: | Existing debate-based approaches to code generation are limited due to several reasons: 1) Reliance on different instances of the same LLM for debate, 2) under-utilization of test cases, and 3) reliance on third-party moderators for result consolidation and decision-making. |
| Approach: | They propose to use test cases to analyze code and identify bugs while opposing models generate test cases for each other to challenge each other's code during the debate process. |
| Outcome: | The proposed model collects intelligence of LLMs via test case-driven debate for code generation. |
Extending LLMs to New Languages: A Case Study of Llama and Persian Adaptation (2025.coling-main)
Copied to clipboard
| Challenge: | Large language models (LLMs) are mainly trained on English data and struggle with low-resource languages. |
| Approach: | They propose to add a new language to Llama to improve classification accuracy for Persian tasks by aligning representations through bilingual pretraining and instruction datasets. |
| Outcome: | The proposed model performs on generation and classification tasks with no adverse impact and sometimes even improvements on English tasks. |
Counterfactuals of Counterfactuals: a back-translation-inspired approach to analyse counterfactual editors (2023.findings-acl)
Copied to clipboard
George Filandrianos, Edmund Dervakos, Orfeas Menis Mastromichalakis, Chrysoula Zerva, Giorgos Stamou
| Challenge: | Existing explanations for classifiers are counterfactual or contrastive . lack of universal ground truth for counterf actual edits hinders their evaluation . |
| Approach: | They propose a back translation-inspired evaluation methodology that utilises earlier outputs of the explainer as ground truth proxies to investigate the consistency of explainers. |
| Outcome: | The proposed method can provide valuable insights into the behaviour of predictor and explainer models and infer patterns that would otherwise be obscured. |
Expanding before Inferring: Enhancing Factuality in Large Language Models through Premature Layers Interpolation (2025.emnlp-main)
Copied to clipboard
Dingwei Chen, Ziqiang Liu, Feiteng Fang, Chak Tou Leong, Shiwen Ni, Ahmadreza Argha, Hamid Alinejad-Rokny, Min Yang, Chengming Li
| Challenge: | Existing approaches to generating factually inconsistent outputs are resource-intensive. |
| Approach: | They propose a plug-and-play intervention designed to enhance factuality by inserting premature layers formed through mathematical interpolation with adjacent layers. |
| Outcome: | The proposed intervention reduces hallucinations while outperforming baselines on four datasets. |
CtrlA: Adaptive Retrieval-Augmented Generation via Inherent Control (2025.findings-acl)
Copied to clipboard
Liu Huanshuo, Hao Zhang, Zhijiang Guo, Jing Wang, Kuicai Dong, Xiangyang Li, Yi Quan Lee, Cong Zhang, Yong Liu
| Challenge: | Existing methods focus on detecting LLM’s confidence via statistical uncertainty. |
| Approach: | They propose to use a representation perspective to solve adaptive RAG by enabling dynamic retrieval during generation and enabling retrieval only when the query exceeds LLM's internal knowledge. |
| Outcome: | The proposed framework is superior to existing adaptive RAG methods on a diverse set of tasks. |
Improving Image Captioning with Better Use of Caption (2020.acl-main)
Copied to clipboard
| Challenge: | Existing approaches to image captioning focus on visual attention, but many do not. |
| Approach: | They propose a framework that explores semantics available in captions and leverages that to enhance both image representation and caption generation. |
| Outcome: | The proposed framework outperforms baselines on the MSCOCO dataset and is state-of-the-art under a wide range of evaluation metrics. |
InfAL: Inference Time Adversarial Learning for Improving Research Ideation (2025.findings-emnlp)
Copied to clipboard
| Challenge: | Advancements in Large Language Models (LLMs) have opened new opportunities for scientific discovery by assisting researchers in generating novel hypotheses and ideas. |
| Approach: | They propose an inference time adversarial learning approach that optimizes the utilization of LLMs’ parametric knowledge without additional model training. |
| Outcome: | The proposed approach optimizes the utilization of LLMs’ parametric knowledge without requiring additional model training, making adversarial learning efficient and context-driven. |
Schema Generation for Large Knowledge Graphs Using Large Language Models (2025.findings-emnlp)
Copied to clipboard
| Challenge: | Schemas are a vital part of ontology engineering and require substantial knowledge engineers and domain experts to create them. |
| Approach: | They propose to use large language models to generate schemas in Shape Expressions (ShEx) to bridge the resource gap between knowledge engineers and domain experts. |
| Outcome: | The proposed pipelines use local and global information from knowledge graphs (KGs) to generate high-quality schemas in Shape Expressions (ShEx). |
FactSpotter: Evaluating the Factual Faithfulness of Graph-to-Text Generation (2023.findings-emnlp)
Copied to clipboard
| Challenge: | Graph-to-text (G2T) generation is an important task in natural language generation as it renders graphs accessible to non-technical users in downstream applications such as question answering. |
| Approach: | They propose a metric that correctly identifies factual faithfulness and uses it to determine if a triple is present in a generated text. |
| Outcome: | The proposed metric achieves highest correlation with human annotations on data correctness, data coverage, and relevance. |
LightThinker: Thinking Step-by-Step Compression (2025.emnlp-main)
Copied to clipboard
Jintian Zhang, Yuqi Zhu, Mengshu Sun, Yujie Luo, Shuofei Qiao, Lun Du, Da Zheng, Huajun Chen, Ningyu Zhang
| Challenge: | Recent advances in Large Language Models have demonstrated their remarkable capabilities in complex reasoning tasks, but their efficiency is hindered by the substantial memory and computational costs associated with generating lengthy tokens. |
| Approach: | They propose a method that dynamically compresses verbose thought steps into compact representations and discards original reasoning chains. |
| Outcome: | The proposed method reduces peak memory usage and inference time while maintaining competitive accuracy. |
We Are What We Repeatedly Do: Inducing and Deploying Habitual Schemas in Persona-Based Responses (2023.emnlp-main)
Copied to clipboard
| Challenge: | a variety of personas can be elicited from large language models, but they are opaque and unpredictable. |
| Approach: | They propose an approach to dialogue generation that retrieves relevant schemas to condition a large language model to generate persona-based responses. |
| Outcome: | The proposed method captures habitual knowledge and generates persona-based responses from a large language model. |
Parallel Refinements for Lexically Constrained Text Generation with BART (2021.emnlp-main)
Copied to clipboard
| Challenge: | Existing work injects lexical constraints into the output, which generates generic or ungrammatical sentences and has high computational complexity. |
| Approach: | They propose a model that incorporates pre-specified keywords into the output to control the generated text. |
| Outcome: | The proposed model decomposes the generated text into two sub-tasks and improves the sentence quality. |
Bridging the Memorization-Utilization Gap: Near-Lossless Context Compression via Reinforcement Learning (2026.acl-long)
Copied to clipboard
| Challenge: | Recent advances in context compression have failed to effectively utilize compressed representations for downstream tasks. |
| Approach: | They propose a holistic training paradigm that uses outcome-based RL to enable implicit expansion. |
| Outcome: | The proposed model outperforms previous models on NIAH, LongBench and multi-hop reasoning. |
PALM: Pre-training an Autoencoding&Autoregressive Language Model for Context-conditioned Generation (2020.emnlp-main)
Copied to clipboard
| Challenge: | Existing techniques for natural language understanding and generation use autoencoding and/or autoregressive objectives to train models. |
| Approach: | They propose a self-supervised pre-training scheme that pre-trains an autoencoding and autoregressive language model on a large unlabeled corpus for generating new text conditioned on context. |
| Outcome: | The proposed scheme achieves state-of-the-art results on a variety of language generation benchmarks covering generative question answering, abstractive summarization and conversational response generation. |
From Facts to Insights: A Study on the Generation and Evaluation of Analytical Reports for Deciphering Earnings Calls (2025.coling-main)
Copied to clipboard
| Challenge: | Existing studies have focused on the generation and evaluation of analytical reports derived from Earnings Calls (ECs). |
| Approach: | They propose to use Large Language Models to generate and evaluate analytical reports derived from Earnings Calls (ECs) they propose to introduce specialized agents that introduce diverse viewpoints and desirable topics into the report generation process. |
| Outcome: | The proposed model improves the quality of reports in different settings, while human-written reports remain preferred in the majority of cases. |
StoryAnalogy: Deriving Story-level Analogies from Large Language Models to Unlock Analogical Understanding (2023.emnlp-main)
Copied to clipboard
Cheng Jiayang, Lin Qiu, Tsz Chan, Tianqing Fang, Weiqi Wang, Chunkit Chan, Dongyu Ru, Qipeng Guo, Hongming Zhang, Yangqiu Song, Yue Zhang, Zheng Zhang
| Challenge: | Analogy-making between narratives is crucial for human reasoning . despite its importance, there has been limited research on story analogies . |
| Approach: | They construct a large-scale story-level analogy corpus with 24K story pairs . they find that the tasks are incredibly difficult for large language models such as ChatGPT . |
| Outcome: | The proposed corpus contains 24K story pairs from diverse domains with human annotations on two similarities from the extended Structure-Mapping Theory. |
TransferTOD: A Generalizable Chinese Multi-Domain Task-Oriented Dialogue System with Transfer Capabilities (2024.emnlp-main)
Copied to clipboard
Ming Zhang, Caishuang Huang, Yilong Wu, Shichun Liu, Huiyuan Zheng, Yurui Dong, Yujiong Shen, Shihan Dou, Jun Zhao, Junjie Ye, Qi Zhang, Tao Gui, Xuanjing Huang
| Challenge: | Current datasets cater to user-led systems and are limited to predefined specific scenarios and slots. |
| Approach: | They propose to use a Chinese dialogue dataset to train a model that authentically simulates human-computer dialogues in 30 popular life service scenarios. |
| Outcome: | The proposed model achieves a joint accuracy of 75.09% in out-of-domain evaluations . it also achieves notable abilities in slot filling and questioning . |
Orthogonal Subspace Learning for Language Model Continual Learning (2023.findings-emnlp)
Copied to clipboard
| Challenge: | Existing methods for continual learning in language models suffer catastrophic forgetting when learning sequential tasks. |
| Approach: | They propose an orthogonal low-rank adaptation approach for continual learning in language models that uses orthogons to learn sequentially. |
| Outcome: | The proposed approach outperforms state-of-the-art methods on continual learning benchmarks and preserves generalization ability of LLMs on unseen tasks. |
Analysis of Plan-based Retrieval for Grounded Text Generation (2024.emnlp-main)
Copied to clipboard
| Challenge: | Large, parametric language models (LLMs) produce fluent text for many applications . hallucinations are generation of text that is factually correct and semantically plausible . |
| Approach: | They propose to use learning-tuned LLMs to infuse models with retrieval mechanisms to reduce hallucinations. |
| Outcome: | The proposed approach reduces the frequency of hallucinations by reducing the coverage of relevant facts and generating more informative responses while providing higher attribution rates. |
ProofInfer: Generating Proof via Iterative Hierarchical Inference (2022.emnlp-main)
Copied to clipboard
| Challenge: | Existing proof generation models focus on generating several proof paths instead of a whole tree. |
| Approach: | They propose a method that generates the proof tree via iterative hierarchical inference . they propose coding the proof as plain text without losing structure information . |
| Outcome: | The proposed proof generation model significantly improves performance on widely-used datasets. |
Monitoring Decoding: Mitigating Hallucination via Evaluating the Factuality of Partial Response during Generation (2025.findings-acl)
Copied to clipboard
| Challenge: | Existing methods to mitiga hallucinations rely on sampling multiple full-length generations, which introduces significant response latency and becomes ineffective when the model consistently produces hallucines. |
| Approach: | They propose a framework that dynamically monitors the generation process and selectively applies in-process interventions to revise hallucination-prone tokens. |
| Outcome: | The proposed framework outperforms self-consistency-based approaches in both effectiveness and efficiency, achieving higher factual accuracy while significantly reducing computational overhead. |
BiMediX2 : Bio-Medical EXpert LMM for Diverse Medical Modalities (2025.findings-emnlp)
Copied to clipboard
Sahal Shaji Mullappilly, Mohammed Irfan Kurpath, Sara Pieri, Saeed Yahya Alseiari, Shanavas Cholakkal, Khaled M Aldahmani, Fahad Shahbaz Khan, Rao Muhammad Anwer, Salman Khan, Timothy Baldwin, Hisham Cholakkal
| Challenge: | BiMediX2 is a bilingual (Arabic-English) large multimodal model that supports text-based and image-based medical interactions. |
| Approach: | They introduce BiMediX2, a bilingual (Arabic-English) Bio-Medical EXpert Large Multimodal Model that supports text-based and image-based medical interactions. |
| Outcome: | The model outperforms existing models by over 9% in English and more than 20% in Arabic evaluations. |
How Retrieved Context Shapes Internal Representations in RAG (2026.findings-acl)
Copied to clipboard
| Challenge: | Retrieval-augmented generation (RAG) is a widely adopted approach for enhancing large language models with external knowledge. |
| Approach: | They analyze how different types of retrieved documents affect the hidden states of large language models and how these internal representation shifts relate to downstream generation behavior. |
| Outcome: | The results show that context relevancy and layer-wise processing influence internal representations, providing explanations of LLMs’ output behaviors and insights for RAG system design. |
1+1>2: A Synergistic Sparse and Low-Rank Compression Method for Large Language Models (2025.findings-emnlp)
Copied to clipboard
| Challenge: | Low-rank approximation compresses the model by retaining its essential structure with minimal information loss. |
| Approach: | They propose a method that leverages the strengths of pruning and low-rank approximation for LLMs. |
| Outcome: | The proposed methods surpass the existing methods on LLaMA and Qwen2.5 models. |
Enhancing Generative Retrieval with Reinforcement Learning from Relevance Feedback (2023.emnlp-main)
Copied to clipboard
| Challenge: | End-to-end generative retrieval models produce document identifiers in response to a query . however, this approach has two challenges: an overemphasis on top-1 results at the expense of overall ranking quality. |
| Approach: | They propose a generative retrieval model with reinforcement learning from relevance feedback to align token-level docid generation with document-level relevance estimation. |
| Outcome: | The proposed model aligns token-level docid generation with document-level relevance estimation. |
ELTLM: Evaluation of Longitudinal Temporal Large Multimodal Models in Clinical Scenarios (2026.findings-acl)
Copied to clipboard
| Challenge: | Existing evaluation benchmarks focus on static evaluation of large multimodal models . existing evaluation paradigms neglect a critical aspect of clinical practice: longitudinal analysis . |
| Approach: | They propose a temporal perception and reasoning benchmark to assess models' temporal grounding and consistency. |
| Outcome: | ELTLM features a hierarchical task taxonomy comprising Temporal Perception QA and Temporal Reasoning QA. |
ReCode: Robustness Evaluation of Code Generation Models (2023.acl-long)
Copied to clipboard
Shiqi Wang, Zheng Li, Haifeng Qian, Chenghao Yang, Zijian Wang, Mingyue Shang, Varun Kumar, Samson Tan, Baishakhi Ray, Parminder Bhatia, Ramesh Nallapati, Murali Krishna Ramanathan, Dan Roth, Bing Xiang
| Challenge: | Existing work on robustness in text or code tasks has focused on classification, while robustness for code generation tasks is an uncharted area. |
| Approach: | They propose a robustness evaluation benchmark for code generation models that customizes over 30 transformations specifically for code on docstrings, function and variable names, code syntax, and code format. |
| Outcome: | The proposed model performs better on human annotators and on SOTA models with human annnotators. |
Adversarial Speech Generation and Natural Speech Recovery for Speech Content Protection (2022.lrec-1)
Copied to clipboard
| Challenge: | Currently, researchers focus on how to protect the speaker's identifiable information, represented as voiceprint, contained in the speech. |
| Approach: | They propose a frame-by-frame adversarial speech generation system to protect speech . they build an adversarials-based method that converts adversarially generated speech to human speech. |
| Outcome: | The proposed method can encode and recover any sensitive audio, and it is easy to be conducted with publicly available speech recognition technology. |
Prompt-R1: Collaborative Automatic Prompting Framework via End-to-end Reinforcement Learning (2026.findings-acl)
Copied to clipboard
Wenjin Liu, Haoran Luo, Xueyuan Lin, Haoming Liu, Tiesunlong Shen, Jiapu Wang, Rui Mao, Erik Cambria
| Challenge: | Existing large language models are limited in understanding, reasoning, calculation, and generation, limiting their performance in complex reasoning and dynamic tasks. |
| Approach: | They propose a plug-and-play framework that integrates a small-scale LLM (as agent) with large-scale large-level LLMs (a as environment) they propose generating prompts that are used to interact with LLM, and a double constraint reward that optimizes correctness and quality of generation. |
| Outcome: | The proposed framework significantly outperforms baseline large-scale large-language models across various tasks. |
Error Typing for Smarter Rewards: Improving Process Reward Models with Error-Aware Hierarchical Supervision (2025.findings-emnlp)
Copied to clipboard
| Challenge: | Large Language Models (LLMs) are prone to hallucination, especially during multihop tasks. |
| Approach: | They propose a hierarchical, erroraware discriminative PRM that classifies math errors at each step and combines finegrained signals to estimate step correctness. |
| Outcome: | The proposed model outperforms the prior best in a new stateof-theart PRMScore of 67.7 on a 400Ksample dataset . |
MULTIGUARD: An Efficient Approach for AI Safety Moderation Across Languages and Modalities (2025.emnlp-main)
Copied to clipboard
Sahil Verma, Keegan Hines, Jeff Bilmes, Charlotte Siska, Luke Zettlemoyer, Hila Gonen, Chandan Singh
| Challenge: | Existing approaches to detect harmful queries to large language models are fallible and vulnerable to attacks that exploit mismatched generalization of model capabilities. |
| Approach: | They propose an approach to detect harmful queries to large language models (LLMs) OMNIGUARD identifies internal representations of an LLM/MLLM that are aligned across languages or modalities and builds a language-agnostic or modality-adic classifier for detecting harmful prompts. |
| Outcome: | OMNIGUARD improves harmful prompt classification accuracy by 11.57% over the strongest baseline in a multilingual setting, by 20.44% for image-based prompts, and sets a new SOTA for audio-based ones. |
RetroLLM: Empowering Large Language Models to Retrieve Fine-grained Evidence within Generation (2025.acl-long)
Copied to clipboard
| Challenge: | Existing methods rely on separate retrievers to fetch top-k text chunks for generating evidence, and they lack joint optimization. |
| Approach: | They propose a framework that integrates retrieval and generation into a single, auto-regressive process, enabling LLMs to directly generate fine-grained evidence from the corpus with constrained decoding. |
| Outcome: | Extensive experiments on five open-domain QA datasets demonstrate the proposed framework’s superior performance across both in-domain and out-of-domain tasks. |
Invisible to People but not to Machines: Evaluation of Style-aware HeadlineGeneration in Absence of Reliable Human Judgment (2020.lrec-1)
Copied to clipboard
| Challenge: | Using a data alignment strategy and different training/testing settings, we aim at decoupling content from style and preserving the latter in generation. |
| Approach: | They propose a fine-grained evaluation strategy based on automatic classification to evaluate generated headlines' quality in terms of their newspaper-compliance. |
| Outcome: | The proposed model learns newspaper-specific style, but humans aren't reliable judges for this task, and deserves particular care in its design. |
TextLap: Customizing Language Models for Text-to-Layout Planning (2024.findings-emnlp)
Copied to clipboard
| Challenge: | Creating 2D graphical layouts from text alone is challenging in traditional settings. |
| Approach: | They propose to customize LLMs to allow users to generate professional looking layouts by simply inputting text instructions. |
| Outcome: | The proposed method outperforms existing benchmarks for document generation and graphical design benchmarks. |
Bridging The Gap: Entailment Fused-T5 for Open-retrieval Conversational Machine Reading Comprehension (2023.acl-long)
Copied to clipboard
| Challenge: | Open-retrieval conversational machine reading comprehension (OCMRC) simulates real-life conversation scenes. |
| Approach: | They propose a one-stage end-to-end framework to bridge the information gap between decision-making and question generation in a global understanding manner. |
| Outcome: | The proposed framework achieves new state-of-the-art performance on the OR-ShARC benchmark. |
MedREQAL: Examining Medical Knowledge Recall of Large Language Models via Question Answering (2024.findings-acl)
Copied to clipboard
| Challenge: | Large language models can encode knowledge during pre-training on large text corpora, enabling downstream tasks like question answering (QA). |
| Approach: | They construct a dataset derived from systematic reviews to examine their ability to encode medical knowledge and their recall. |
| Outcome: | The proposed model performs well on the biomedical QA dataset. |
Ask in Any Modality: A Comprehensive Survey on Multimodal Retrieval-Augmented Generation (2025.findings-acl)
Copied to clipboard
Mohammad Mahdi Abootorabi, Amirhosein Zobeiri, Mahdi Dehghani, Mohammadali Mohammadkhani, Bardia Mohammadi, Omid Ghahroodi, Mahdieh Soleymani Baghshah, Ehsaneddin Asgari
| Challenge: | Large Language Models (LLMs) suffer from hallucinations and outdated knowledge due to their reliance on static training data. |
| Approach: | They review training strategies, robustness enhancements, loss functions, and agent-based approaches and outline open challenges and future directions to guide research in this evolving field. |
| Outcome: | The proposed model improves accuracy and accuracy while integrating external dynamic information for improved factual grounding. |
FineCops-Ref: A new Dataset and Task for Fine-Grained Compositional Referring Expression Comprehension (2024.emnlp-main)
Copied to clipboard
| Challenge: | Referring Expression Comprehension (REC) is a cross-modal task that objectively evaluates the capabilities of language understanding, image comprehension, and language-to-image grounding. |
| Approach: | They propose to use a new reference expression comprehension (REC) dataset to evaluate the capabilities of language understanding, image comprehension, and language-to-image grounding. |
| Outcome: | The proposed model is able to reject scenarios where the target object is not visible in the image, a key aspect often overlooked in existing models and approaches. |
TTPA: Token-level Tool-use Preference Alignment Training Framework with Fine-grained Evaluation (2025.findings-emnlp)
Copied to clipboard
| Challenge: | Existing tool-learning methods often overlook fine-grained optimization of internal tool call details. |
| Approach: | They propose a training paradigm for constructing token-level tool-use preference datasets . reversed dataset construction is a method for creating high-quality, multi-turn tool-user datasets by reversing the generation flow. |
| Outcome: | a new training paradigm improves tool-using performance and generalizes results. |
Diffusion Guided Language Modeling (2024.findings-acl)
Copied to clipboard
| Challenge: | Existing guidance methods for text generation are prone to decoding errors and degrade performance. |
| Approach: | They propose a model that steers an auto-regressive language model to generate text with desired properties. |
| Outcome: | The proposed model outperforms existing guidance methods on a wide range of benchmark data sets. |
UniCM: A Unified Consistency Model For Efficient Multimodal Generation and Understanding (2026.findings-acl)
Copied to clipboard
| Challenge: | Consistency models (CMs) have shown promise in the efficient generation of both image and text. |
| Approach: | They propose to use a discrete token for both image and text generation to achieve a unified denoising perspective. |
| Outcome: | The proposed model outperforms SD3 on GenEval and Image Reward while being 1.5 faster at long-sequence generating speed. |
Knowledge-Centric Templatic Views of Documents (2024.findings-emnlp)
Copied to clipboard
| Challenge: | Prior work on document generation has tackled the creation of each separate format as a different task, leading to fragmented learning processes, redundancy in models and methods, and disjointed evaluation. |
| Approach: | They propose a method that unifies the generation and evaluation of templatic views of documents in multiple formats. |
| Outcome: | The proposed method improves performance for heterogeneous downstream applications while reducing the need for task specific evaluation metrics. |
Beyond N-Grams: Rethinking Evaluation Metrics and Strategies for Multilingual Abstractive Summarization (2025.acl-long)
Copied to clipboard
| Challenge: | n-gram-based metrics are considered indicative (even if imperfect) of human evaluation for English, but their suitability for other languages remains unclear. |
| Approach: | They systematically assess evaluation metrics for generation for languages and tasks using n-gram-based and neural-based metrics. |
| Outcome: | The proposed evaluation suite is based on eight languages from four typological families and shows that it is sensitivity to the language type at hand. |
R^3AG: Retriever Routing for Retrieval-Augmented Generation (2026.acl-long)
Copied to clipboard
| Challenge: | Retrieval-augmented generation (RAG) is often bottlenecked by the “one-size-fits-all” retrieval paradigm, as different queries exhibit distinct preferences for different retrievers. |
| Approach: | They propose a novel routing framework that explicitly models the dynamic alignment between queries and retriever capabilities and decomposes retriever capability into two learnable dimensions: retrieval quality and generation utility. |
| Outcome: | Experiments on knowledge-intensive tasks show that R3AG outperforms both the best individual retrievers and state-of-the-art static routing methods. |
Narrative-of-Thought: Improving Temporal Reasoning of Large Language Models via Recounted Narratives (2024.findings-emnlp)
Copied to clipboard
| Challenge: | Large language models (LLMs) have demonstrated impressive performance in many reasoning tasks, but temporal reasoning remains challenging due to its intrinsic complexity. |
| Approach: | They propose a new prompting technique tailored for temporal reasoning, Narrative-of-Thought (NoT), that first converts the events set to a Python class, then prompts a small model to generate a temporal narrative. |
| Outcome: | The proposed technique achieves the highest F1 on Schema-11 evaluation set, while securing an overall F1 of par with GPT-3.5/4. |
See Detail Say Clear: Towards Brain CT Report Generation via Pathological Clue-driven Representation Learning (2024.findings-emnlp)
Copied to clipboard
| Challenge: | Brain CT report generation is important to aid physicians in diagnosing cranial diseases. |
| Approach: | They propose a Pathological Clue-driven Representation Learning model to build cross-modal representations based on pathological clues and adapt them for text generation. |
| Outcome: | The proposed method outperforms previous methods and achieves SoTA performance. |
Zero-Shot Detection of LLM-Generated Text using Token Cohesiveness (2024.emnlp-main)
Copied to clipboard
| Challenge: | Existing zero-shot detection paradigms that use token cohesiveness are not available for large language models. |
| Approach: | They propose a generic dual-channel detection paradigm that uses token cohesiveness as a plug-and-play module to improve existing zero-shot detectors. |
| Outcome: | The proposed model is able to detect human-like text in black-box environments. |
PositionID: LLMs can Control Lengths, Copy and Paste with Explicit Positional Awareness (2024.findings-emnlp)
Copied to clipboard
| Challenge: | Large Language Models (LLMs) have impressive capabilities across various domains, including role-playing, creative writing, mathematical reasoning, and coding. |
| Approach: | They propose two methods to improve the model’s adherence to length constraints and copy-paste accuracy without compromising response quality. |
| Outcome: | The proposed methods improve the model’s adherence to length constraints and copy-paste accuracy without compromising response quality. |
Evaluating and Enhancing the Robustness of Code Pre-trained Models through Structure-Aware Adversarial Samples Generation (2023.findings-emnlp)
Copied to clipboard
| Challenge: | Pre-trained code models have made significant strides in the field of neural code intelligence, but they are susceptible to adversarial attacks that subtly modify the input sequence and can impair generalization. |
| Approach: | They propose a set of novel robustness evaluation methods based on the intrinsic structure of the code to explore the impact of imperceptible perturbation. |
| Outcome: | The proposed methods have demonstrated their effectiveness across a wide range of models and tasks, and are able to predict the performance of perturbed models. |
FRAME: Boosting LLMs with A Four-Quadrant Multi-Stage Pretraining Strategy (2025.findings-acl)
Copied to clipboard
Xuemiao Zhang, Feiyu Duan, Xu Liangyu, Yongwei Zhou, Sirui Wang, Rongxiang Weng, Jingang Wang, Xunliang Cai
| Challenge: | Multi-stage pretraining methods lack quantitative criteria for data partitioning and instead rely on intuitive heuristics. |
| Approach: | They propose a Four-quadRAnt Multi-stage prEtraining strategy that partitions data into four quadrants to achieve significant loss reductions four times. |
| Outcome: | The proposed strategy achieves 16.8% improvement over random across MMLU and CMMLU for the 3B model. |
FlowRAG: Synergizing Explicit Reasoning via Frequency-Aware Multi-Granularity Graph Flow (2026.findings-acl)
Copied to clipboard
| Challenge: | Existing methods for Graph-based retrieval-augmented generation rely on implicit semantic relevance propagation. |
| Approach: | They propose a semantic-aware retrieval framework that improves both semantic recall and explicit reasoning. |
| Outcome: | Extensive experiments show that FlowRAG improves both semantic recall and explicit reasoning. |
Dolphin: Moving Towards Closed-loop Auto-research through Thinking, Practice, and Feedback (2025.acl-long)
Copied to clipboard
Jiakang Yuan, Xiangchao Yan, Bo Zhang, Tao Chen, Botian Shi, Wanli Ouyang, Yu Qiao, Lei Bai, Bowen Zhou
| Challenge: | Recent studies show that AI-assisted research methods can improve research efficiency . a closed-loop framework is used to enhance the automation level of scientific research . |
| Approach: | They propose a closed-loop LLM-driven framework to enhance the automation level of scientific research. |
| Outcome: | The proposed framework improves the efficiency of scientific research by improving data analysis, accelerating computation, and fostering novel idea generation. |
JoPA: Explaining Large Language Model’s Generation via Joint Prompt Attribution (2025.acl-long)
Copied to clipboard
| Challenge: | Existing attempts to explain the entire language generation often treat input prompt texts independently, ignoring their combinatorial effects on the follow-up generation. |
| Approach: | They propose a framework for explaining how a few prompt texts collaboratively influences the LLM's complete generation. |
| Outcome: | The proposed explanations demonstrate faithfulness and efficiency of the proposed framework. |
TechniqueRAG: Retrieval Augmented Generation for Adversarial Technique Annotation in Cyber Threat Intelligence Text (2025.findings-acl)
Copied to clipboard
| Challenge: | Existing methods for identifying adversarial techniques in security texts face a trade-off: generic models with limited domain precision or resource-intensive pipelines. |
| Approach: | They propose a domain-specific retrieval-augmented generation framework that integrates off-the-shelf retrievers, instruction-tuned LLMs, and minimal text–technique pairs. |
| Outcome: | The proposed framework improves retrieval quality and domain specificity without extensive optimizations. |
InsideOut: Measuring and Mitigating Insider–Outsider Bias in Interview Script Generation (2026.acl-long)
Copied to clipboard
| Challenge: | Recent research has raised concerns about culture-related fairness issues in LLM-generated content. |
| Approach: | They propose to use 4,000 generation prompts and three evaluation metrics to quantify LLMs' **insider-outsider bias** . |
| Outcome: | The proposed method reduces bias in Llama model by 89.70% and mitigates bias on Qwen by 82.54% on cultural alignment gap metric. |
s3: You Don’t Need That Much Data to Train a Search Agent via RL (2025.emnlp-main)
Copied to clipboard
| Challenge: | Existing approaches to optimize retrieval using search-only metrics ignore downstream utility and fine-tune entire LLM to jointly reason and retrieve limit retrieval utility and compatibility with frozen or proprietary models. |
| Approach: | They propose a lightweight, model-agnostic framework that decouples the searcher from the generator and trains the search user using a Gain Beyond RAG reward. |
| Outcome: | The proposed framework outperforms baselines trained on over 70 more data with 2.4k training samples. |
Advancing Collaborative Debates with Role Differentiation through Multi-Agent Reinforcement Learning (2025.acl-long)
Copied to clipboard
| Challenge: | Multi-agent collaborative tasks exhibit exceptional capabilities in natural language applications and generation. |
| Approach: | They propose a multi-LLM Cooperation framework with automatic role assignment capabilities that allows multiple agents to embed roles in turn-based speaking. |
| Outcome: | The proposed framework improves collaboration and expertise among agents and teams by enabling them to share roles and develop complementary strengths from the optimization level. |
Probing Multimodal Large Language Models for Global and Local Semantic Representations (2024.lrec-main)
Copied to clipboard
| Challenge: | Existing studies have focused on the ability of MLLMs to generate single tokens one by one, while lacking studies about how their representation vectors can encode global multimodal information. |
| Approach: | They propose to use image-caption corpus to train Multimodal Large Language Models (MLLMs) . they find that the topmost layers encode more global semantic information . |
| Outcome: | The proposed models can encode more global semantic information, rather than the topmost layers, and perform better on visual-language entailment tasks. |
Neural Chain-of-Thought Search: Searching the Optimal Reasoning Path to Enhance Large Language Models (2026.findings-acl)
Copied to clipboard
| Challenge: | Recent research indicates that Large Reasoning Models suffer from a strategic bottleneck at reasoning path planning. |
| Approach: | They propose a framework that reformulates reasoning as a dynamic search for the optimal thinking strategy. |
| Outcome: | The proposed framework improves accuracy and computational cost while reducing generation length by over 22%. |
Humanity’s Last Code Exam: Can Advanced LLMs Conquer Human’s Hardest Code Competition? (2025.findings-emnlp)
Copied to clipboard
Xiangyang Li, Xiaopeng Li, Kuicai Dong, null Zhangquanhu, Rongju Ruan, Xinyi Dai, Yasheng Wang, Ruiming Tang
| Challenge: | o4-mini(high) and Gemini-2.5 Pro achieve pass@1 rates of only 15.9% and 11.4%, respectively. |
| Approach: | They propose a harmonized online–offline sandbox that guarantees fully reproducible evaluation. |
| Outcome: | The proposed test reflects the advanced reasoning and code generation ability of large language models. |
DcLM: Output Length Control of Large Language Models via Dynamic Length Markers (2026.findings-acl)
Copied to clipboard
| Challenge: | Large language models (LLMs) have limited awareness of output length, making it difficult to satisfy precise length requirements. |
| Approach: | They propose a model-agnostic approach that introduces dynamic length markers to guide length-controllable outputs. |
| Outcome: | The proposed method significantly reduces length deviation across multiple datasets. |
LORE: Continual Logit Rewriting Fosters Faithful Generation (2025.findings-emnlp)
Copied to clipboard
| Challenge: | Using aspect-oriented summarization as a case study, we propose **LOgit REwriting**, a new controlled generation paradigm which can be faithful to external knowledge and to the LLM’s intentions. |
| Approach: | They propose a controlled generation paradigm which can be faithful to external knowledge and to the LLM's intentions. |
| Outcome: | The proposed paradigm can be faithful to external knowledge and to the LLM's intentions while balancing that with accuracy. |
Do LLMs Align Human Values Regarding Social Biases? Judging and Explaining Social Biases with LLMs (2025.findings-emnlp)
Copied to clipboard
| Challenge: | Large language models can lead to undesired consequences when misaligned with human values . previous studies have shown misalignment of LLMs with human value using expert-designed or agent-based emulated bias scenarios . |
| Approach: | They investigate whether large language models (LLMs) are misaligned with human values . they find no significant differences in understanding of HVSB between LLMs . |
| Outcome: | The results show that large language models do not have lower misalignment rates and attack success rates . the study also shows that smaller language models have the ability to explain HVSB . |
RefreshKV: Updating Small KV Cache During Long-form Generation (2025.acl-long)
Copied to clipboard
| Challenge: | Existing methods for generating long sequences of tokens are expensive and require memory and computation resources. |
| Approach: | They propose a method that alternates between full context attention and attention over a subset of input tokens during generation. |
| Outcome: | The proposed method achieves comparable speedup to eviction-based methods while improving performance for various long-form generation tasks. |
Sprout: Green Generative AI with Carbon-Efficient LLM Inference (2024.emnlp-main)
Copied to clipboard
| Challenge: | Sprout reduces the carbon footprint of inference in large language models by over 40% in real-world evaluations. |
| Approach: | Sprout introduces "generation directives" to guide autoregressive generation process . et al. cites Llama model and global electricity grid data as examples . |
| Outcome: | Sprout reduces the carbon footprint of generative AI models by over 40% in real-world evaluations using the Llama model and global electricity grid data. |
ConfSpec: Efficient Step-Level Speculative Reasoning via Confidence-Gated Verification (2026.acl-long)
Copied to clipboard
| Challenge: | Existing approaches to chain-of-thought reasoning incur high inference latency due to long generation traces. |
| Approach: | They propose a confidence-gated cascaded verification framework that reduces the trade-off between generation and verification. |
| Outcome: | The proposed framework achieves 2.24 speedups while matching target-model accuracy. |
DIESEL: A Lightweight Inference-Time Safety Enhancement for Language Models (2025.findings-acl)
Copied to clipboard
| Challenge: | Large language models generate outputs that are not aligned with human values, such as toxic content, malicious use cases, and vulnerabilities to adversarial jailbreak attacks. |
| Approach: | They propose a lightweight inference-guidance technique that can be seamlessly integrated into any autoregressive LLM to semantically filter undesirable content during generation. |
| Outcome: | The proposed technique can be integrated into any autoregressive LLM to semantically filter undesirable content during generation. |
Empowering Math Problem Generation and Reasoning for Large Language Model via Synthetic Data based Continual Learning Framework (2025.emnlp-main)
Copied to clipboard
| Challenge: | Existing learning frameworks for large language models (LLMs) for math problem generation are limited and lack quality data. |
| Approach: | They propose a synthetic data based continual learning framework to improve LLMs ability for MPG and math reasoning. |
| Outcome: | The proposed framework improves performance on large language models and math reasoning using supervised fine-tuning, data synthesis and direct preference optimization. |
PodAgent: A Comprehensive Framework for Podcast Generation (2025.findings-acl)
Copied to clipboard
| Challenge: | Existing automatic audio generation methods struggle to generate podcast-like audio programs effectively. |
| Approach: | They propose a framework for creating podcast-like audio programs that generates informative topic-discussion content by designing a multi-agent collaboration system, builds a voice pool and uses LLM-enhanced speech synthesis to generate expressive conversational speech. |
| Outcome: | The proposed framework surpasses direct GPT-4 generation in topic-discussion dialogue content, and produces more expressive conversational speech. |
PURE: Post-hoc Unlocking and REfinement for Discrete Diffusion Decoding (2026.findings-acl)
Copied to clipboard
| Challenge: | Masked diffusion language models (MDLMs) are limited by a monotonic unmasking policy, where committed tokens cannot be revised. |
| Approach: | They propose a training-free inference algorithm for two-phase decoding that unlocks unstable regions through deterministic window masking and stochastic leftward relaxation. |
| Outcome: | The proposed algorithm significantly improves accuracy on reasoning benchmarks on GSM8K. |
MedAdapter: Efficient Test-Time Adaptation of Large Language Models Towards Medical Reasoning (2024.emnlp-main)
Copied to clipboard
| Challenge: | Large language models (LLMs) have improved generation and reasoning capabilities compared to traditional BERT-sized models due to massive number of parameters and extensive pre-training on vast textual corpora. |
| Approach: | They propose a unified post-hoc adapter for test-time adaptation of large language models . they propose to fine-tune only a small BERT-sized adapter to rank candidate LLMs . |
| Outcome: | The proposed adapter improves performance on four biomedical tasks without requiring computational resources or sharing data with third parties. |
Syntactic Control of Language Models by Posterior Inference (2025.findings-acl)
Copied to clipboard
| Challenge: | Syntactic control of generated text is crucial for many domain-specific applications of language models, where structural constraints, such as formality, grammatical correctness, or adherence to a given template, can significantly affect usability and readability. |
| Approach: | They propose to use posterior inference to enforce target constituency structure by sampling from a proposal distribution with a syntactic tagger to ensure that each generated token aligns with the desired syntakic structure. |
| Outcome: | The proposed method increases the F1 score from 12.31 (GPT2-large) and 35.33 (Llama3-8B) to about 93 in both cases without compromising the language model’s fluency. |
MAGNET: Augmenting Generative Decoders with Representation Learning and Infilling Capabilities (2025.acl-long)
Copied to clipboard
| Challenge: | Decoder-only large language models are increasingly being adapted for bidirectional modeling . however, their reliance on causal attention restricts their effectiveness in tasks that require understanding of bidirectional context. |
| Approach: | They propose a method to adapt decoder-only large language models to generate robust representations and infill missing text spans. |
| Outcome: | The proposed method surpasses strong decoders on token-level and sentence-level representation learning tasks and generates contextually appropriate text infills without excessive repetition of words or phrases. |
Hidden States as Early Signals: Step-level Trace Evaluation and Pruning for Efficient Test-Time Scaling (2026.findings-acl)
Copied to clipboard
| Challenge: | Existing approaches to speed up parallel scaling have relied on similarity-based or confidence-based pruning, but these signals do not reliably indicate trace quality. |
| Approach: | They propose a pruning framework that evaluates reasoning steps using hidden states and dynamically prunes unpromising traces during generation. |
| Outcome: | The proposed framework reduces end-to-end inference latency by 45%–70% on average compared to self-consistency while improving reasoning accuracy. |
Uncertainty-Aware Contrastive Decoding (2025.findings-acl)
Copied to clipboard
| Challenge: | Large language models excel in a wide range of tasks, but generating factually accurate outputs remains a challenge. |
| Approach: | They propose a method that dynamically adjusts model contributions at each decoding step based on uncertainty. |
| Outcome: | The proposed method significantly improves factual accuracy and reliability over existing methods. |
Exploring In-context Example Generation for Machine Translation (2025.findings-acl)
Copied to clipboard
| Challenge: | Large language models (LLMs) have demonstrated strong performance across various tasks with just a few examples. |
| Approach: | They propose a method that generates in-context example pairs without external resources. |
| Outcome: | The proposed method builds upon two prior criteria, relevance and diversity, which have been highlighted as key factors for in-context example selection. |
SACL: Understanding and Combating Textual Bias in Code Retrieval with Semantic-Augmented Reranking and Localization (2025.findings-emnlp)
Copied to clipboard
| Challenge: | a recent study shows that code retrievers exhibit a strong bias towards well-documented code . |
| Approach: | They propose a framework that augments textual information with semantic information to mask specific features while preserving code functionality. |
| Outcome: | The proposed framework enhances textual information and reduces bias by augmenting code or structural knowledge with semantic information. |
Think Better, Not Longer: Token-Level Marginal Utility for Efficient Reasoning in Large Reasoning Models (2026.acl-long)
Copied to clipboard
| Challenge: | Large reasoning models (LRMs) generate explicit Chain-of-Thought rationales, but often suffer from "overthinking". |
| Approach: | They propose a unified training framework to synthesize concise reasoning chains by identifying tokens that reduce the model’s likelihood of the correct answer. |
| Outcome: | Experiments on deepSeek-R1-Distill-Qwen backbones show that MUTO yields better efficiency-accuracy Pareto frontier. |
Diversity Explains Inference Scaling Laws: Through a Case Study of Minimum Bayes Risk Decoding (2025.acl-long)
Copied to clipboard
| Challenge: | Existing studies show that MBR decoding improves model generation performance . however, the theoretical underpinnings of these results remain uncertain . |
| Approach: | They propose a theoretical interpretation of MBR decoding from the perspective of bias–diversity decomposition. |
| Outcome: | The proposed method improves the quality estimation of hypotheses by decomposing bias and diversity into two main factors. |
RubricBench: Aligning Model-Generated Rubrics with Human Standards (2026.acl-long)
Copied to clipboard
Junyi Zhou, Qiyuan Zhang, Yufei Wang, Fuyuan Lyu, Yidong Ming, Can Xu, Qingfeng Sun, Kai Zheng, Peng Kang, Xue Liu, Chen Ma
| Challenge: | Existing benchmarks lack discriminative complexity and ground-truth rubric annotations required for rigorous evaluation. |
| Approach: | They propose a curated benchmark with 1,147 pairwise comparisons to assess the reliability of rubric-based evaluation. |
| Outcome: | The proposed benchmarks show that they support diverse domains, exhibit discriminative ability, provide high-quality annotations, and include human-authored rubrics. |
Fairness Evaluation and Inference Level Mitigation in LLMs (2026.findings-acl)
Copied to clipboard
| Challenge: | Large language models display undesirable behaviors embedded in their internal representations, undermining fairness, inconsistency drift, and the propagation of unwanted patterns during extended dialogues. |
| Approach: | They propose a pruning-based framework that detects context-aware neuron activations and applies adaptive masking to modulate their influence during generation. |
| Outcome: | The proposed framework detects context-aware neuron activations and applies adaptive masking to modulate their influence during generation. |
To Diff or Not to Diff? Structure-Aware and Adaptive Output Formats for Efficient LLM-based Code Editing (2026.findings-acl)
Copied to clipboard
| Challenge: | Large Language Models (LLMs) are increasingly used for code editing, yet the full-code generation paradigm suffers from severe efficiency bottlenecks. |
| Approach: | They propose to use a structure-aware diff format to train LLMs to choose the most token-efficient format between a given diff format and full code. |
| Outcome: | The proposed approach matches the most token-efficient format with full-code generation while reducing latency and cost by over 30% on long-code editing tasks. |
PRISM: Probing Reasoning, Instruction, and Source Memory in LLM Hallucinations (2026.acl-long)
Copied to clipboard
Yuhe Wu, Guangyu Wang, Yuran Chen, Jiatong Zhang, Yutong Zhang, Yujie Chen, Jiaming Shang, Guang Zhang, Zhuang Liu
| Challenge: | Existing benchmarks for hallucination evaluation rely on mixed queries and posterior evaluation, which quantifies hallucinosity severity but offers limited insight into where and why they occur. |
| Approach: | They propose a controlled benchmark that disentangles hallucinations into four dimensions: knowledge missing, knowledge errors, reasoning errors, and instruction-following errors. |
| Outcome: | The proposed model disentangles hallucinations into four dimensions: knowledge missing, knowledge errors, reasoning errors, and instruction-following errors. |
Unlocking Human-Like Visible Logic: How Logic Diagrams Boost Logic Reasoning in Large Language Models? (2026.findings-acl)
Copied to clipboard
| Challenge: | Recent advances in large language models (LLMs) have demonstrated their remarkable capabilities in natural language understanding and generation, but they struggle with formal logical reasoning. |
| Approach: | They propose to incorporate visual logic diagrams into LLMs’ reasoning workflows to enhance their performance on formal logic tasks. |
| Outcome: | The proposed model improves on syllogistic and conditional reasoning with programmatically generated Venn, Euler, and Linear diagrams. |
ZoomRAG: Hierarchical Random-walk Zooming across Multi-scale Information Graphs for Fast and Accurate RAG (2026.findings-acl)
Copied to clipboard
Xianming Hu, Jingyang Chen, Bin Tang, Yihe Liu, Yihong Huang, Hongbo Zhao, Nuoyi Chen, Jie Zhang, Ping Li, Kai Zhang
| Challenge: | retrieval-augmented generation (RAG) is a powerful tool for NLP applications . but it is challenging to encode large knowledge bases as compact offline structures . |
| Approach: | They propose a coarse-to-fine hierarchical graph inference method that uses random walks to retrieve information from a corpus of documents. |
| Outcome: | The proposed method reduces offline indexing costs and accelerates retrieval. |
IntentCoding: Amplifying User Intent in Code Generation (2026.findings-acl)
Copied to clipboard
| Challenge: | IntentCoding captures the influence of user intent by masking out the intent, and integrates seamlessly with existing decoding procedures. |
| Approach: | They propose a decoding strategy that captures the influence of user intent by masking out the intent and applies a multi-strength ensemble mechanism to amplify the effect of user intention during generation. |
| Outcome: | The proposed model significantly improves both constraint satisfaction and functional correctness compared to greedy decoding approaches. |
Controlled Generation for Private Synthetic Text (2025.emnlp-main)
Copied to clipboard
| Challenge: | Text anonymization is essential for developing and deploying AI in high stakes domains . tools for redacting directly identifying content are unlikely to guarantee 100% recall . |
| Approach: | They propose a method for privacy-preserving synthetic text generation that leverages HIPS theory and de-identification principles. |
| Outcome: | The proposed method achieves a strong balance between privacy protection and utility on legal and clinical datasets. |
PaT: Planning-after-Trial for Efficient Test-Time Code Generation (2026.acl-long)
Copied to clipboard
| Challenge: | Existing methods for scaling test-time computation are rigid and inefficient . a heterogeneous configuration achieves performance comparable to a large homogeneously model . |
| Approach: | They propose an adaptive planning policy that invokes a planner only upon verification failure. |
| Outcome: | The proposed model achieves comparable performance to a large homogeneous model while reducing inference cost by approximately 69% across multiple benchmarks and model families. |
Efficient Real-time Refinement of Language Model Text Generation (2025.emnlp-main)
Copied to clipboard
| Challenge: | Large language models (LLMs) generate factually incorrect answers, a challenge that remains . Streaming-VR enables on-the-fly verification and correction of tokens as they are generated . |
| Approach: | They propose a method that enables on-the-fly verification and correction of LLM tokens as they are generated. |
| Outcome: | The proposed method improves factual accuracy and improves refinement efficiency compared to prior methods. |
CCD: Mitigating Hallucinations in Radiology MLLMs via Clinical Contrastive Decoding (2026.findings-acl)
Copied to clipboard
| Challenge: | Multimodal large language models generate medical hallucinations due to over-sensitivity to clinical sections. |
| Approach: | They propose a framework that integrates structured clinical signals from task-specific radiology expert models. |
| Outcome: | The proposed framework improves overall performance on radiology report generation (RRG) on the MIMIC-CXR dataset, it yields up to 17% improvement in RadGraph-F1. |
Masked Text-to-Audio Flow-Matching and Reward Feedback Optimization (2026.findings-acl)
Copied to clipboard
Rongjie Huang, Dongchao Yang, Wenxiang Guo, Huadai Liu, Xize Cheng, Zehan Wang, Zhou Zhao, Xixin Wu, Helen M. Meng
| Challenge: | Experimental results show that Flow-matching generative models can scale training by increasing data, computational resources, and model size. |
| Approach: | They propose a flow-matching transformer with masked generative modeling for scaling text-to-audio inference-time prediction. |
| Outcome: | The proposed model scales inference-time computations by masking generation and re-predicting them through iterative decoding. |
Incomplete In-context Learning (2026.acl-long)
Copied to clipboard
Wenqiang Wang, Wen Yujia, Yan Xiao, Zhifeng Chen, Yangshijie Zhang, Peng Chen, Mingbo Yang, Xiaochun Cao
| Challenge: | Existing in-context learning assumes the retrieval dataset contains demonstrations for all output label spaces. |
| Approach: | They propose a framework with train-free and train-based variants to address IICL . they propose to integrate a dataset with labeled demonstrations for each output space . |
| Outcome: | The proposed framework outperforms existing methods under incomplete retrieval datasets and even outperformed ICL with complete labels. |
A BERTology View of LLM Orchestrations: Token- and Layer-Selective Probes for Efficient Single-Pass Classification (2026.acl-long)
Copied to clipboard
| Challenge: | Modern LLM deployments are rarely a single model in isolation. |
| Approach: | They propose a model that reuses computation already paid for by the serving LLM . they instantiate a template with pooling, a scoring-attention gate, and a downcast multi-head self-attention probe . |
| Outcome: | The proposed model improves safety and sentiment benchmarks on dense and mixture-of-experts architectures while preserving near-serving latency. |
GraphSynth: Resolving the Diversity-Reliability Trade-off with Probabilistic Factor Graphs (2026.acl-long)
Copied to clipboard
| Challenge: | Large language models are a scaleable solution for the generation of synthetic data . however, the utility of such data is capped by a critical tension between diversity and factual reliability. |
| Approach: | They propose a framework which leverages a probabilistic factor graph modeling the universe of attributes. |
| Outcome: | The proposed framework outperforms state-of-the-art models with a high structural integrity and a boost in performance on downstream tasks. |
AdaFuse: Adaptive Ensemble Decoding for Large Language Models (2026.acl-long)
Copied to clipboard
Chengming Cui, Tianxin Wei, Ziyi Chen, Ruizhong Qiu, Zhichen Zeng, Zhining Liu, Xuying Ning, Duo Zhou, Jingrui He
| Challenge: | Existing ensemble approaches to large language models lack flexibility for mid-generation adaptation. |
| Approach: | They propose an adaptive ensemble decoding framework that dynamically selects semantically appropriate fusion units during generation. |
| Outcome: | The proposed framework outperforms existing ensemble frameworks on open-domain QA, arithmetic reasoning, and machine translation tasks. |
Multimodal Dual-Path Decoding for Medical Report Generation (2026.findings-acl)
Copied to clipboard
| Challenge: | Current methods for radiology report generation rely on encoder-decoder based frameworks that fail to integrate multimodal clinical evidence with domain-specific knowledge. |
| Approach: | They propose a multimodal dual-path framework that synergistically integrates large vision-language models and large language models for radiology report generation. |
| Outcome: | The proposed framework improves on the public MIMIC-CXR benchmark and shows that it is superior to state-of-the-art models. |
TripTide: A Benchmark for Adaptive Travel Planning under Disruptions (2026.findings-acl)
Copied to clipboard
Priyanshu Karmakar, Soumyabrata Chaudhuri, Shubhojit Mallick, Manish Gupta, Abhik Jana, Shreya Ghosh
| Challenge: | Recent work has shown the promise of Large Language Models (LLMs) for personalized, constraint-aware travel itinerary generation, but real-world travel often involves disruptions such as transit cancellations, weather-related closures, or overbooked attractions. |
| Approach: | They propose a benchmark to evaluate the ability of Large Language Models (LLMs) to revise travel itineraries under realistic disruptions. |
| Outcome: | The proposed benchmark evaluates the ability of Large Language Models (LLMs) to revise travel itineraries under real-world disruption scenarios. |
SiLP: Enhancing Non-Dominant Language Capabilities with a Selective Bidirectional Language Projection Framework (2026.acl-long)
Copied to clipboard
| Challenge: | Existing methods to improve performance of large language models rely on additional training objectives or language-specific parameters. |
| Approach: | They propose a bidirectional language projection framework that enables efficient multilingual alignment and language shift using the intrinsic parameters. |
| Outcome: | The proposed framework improves performance of non-dominant languages and improves internal representations. |
Locate and Explain: Joint Multimodal Emotion Cause Extraction and Summarization in Conversation (2026.acl-long)
Copied to clipboard
| Challenge: | Existing studies focus on utterance-level emotion cause extraction and multimodal emotion cause generation, resulting in subjective and inconsistent annotations. |
| Approach: | They propose a task that extracts emotion cause utterances and generates cause summaries . they propose utterrance-level emotion cause extraction and multimodal emotion cause generation tasks . |
| Outcome: | The proposed task extracts emotion cause utterances and generates cause summaries . the proposed task establishes strong benchmark results for the proposed project . |
PPA-Plan: Proactive Pitfall Avoidance for Reliable Planning in Long-Context LLM Reasoning (2026.acl-long)
Copied to clipboard
| Challenge: | Large language models struggle with reasoning over long contexts where relevant information is sparsely distributed. |
| Approach: | They propose a plan-and-execute framework that decomposes long-context tasks into an explicit planning stage followed by step-by-step step-through planning. |
| Outcome: | Experiments on long-context QA benchmarks show that PPA-Plan outperforms plan-and-execute methods and direct prompting. |
GRAD: Generalizing RAG Adaptation with Decoding (2026.acl-long)
Copied to clipboard
| Challenge: | Using GRAD, we can steer Retrieval-augmented generation objectives without retraining large language models. |
| Approach: | They propose an adaptive decoding-time framework that keeps the base generator fixed and composes small, objective-specific guidance at inference. |
| Outcome: | The proposed framework improves accuracy with favorable latency across public benchmarks and private settings with no in-domain labels while reliably activating helpful objectives and suppressing harmful ones, adaptively to tasks. |
Scaling Evaluation-Time Compute with Reasoning Models as Evaluators (2026.findings-acl)
Copied to clipboard
Seungone Kim, Ian Wu, Jinu Lee, Xiang Yue, Seongyun Lee, Minkyeong Moon, Carolin Lawrence, Kiril Gashteovski, Julia Hockenmaier, Graham Neubig, Sean Welleck
| Challenge: | Language model (LM) evaluators that generate chain-of-thought reasoning are widely used for the assessment of LM responses. |
| Approach: | They investigate whether increasing LMs' "thinking" time through scaling test-time compute can improve an LM's evaluation capability. |
| Outcome: | The proposed reasoning models improve evaluation performance monotonically with the number of reasoning tokens generated, mirroring trends seen in LM reasoning. |
Rethinking Retrieval-Augmented Generation as a Cooperative Decision-Making Problem (2026.findings-acl)
Copied to clipboard
| Challenge: | Existing RAG systems rely on ranking-centric, asymmetric dependency paradigms to generate results. |
| Approach: | They propose a framework that treats the reranker and the generator as peer decision-makers rather than being connected through an asymmetric dependency pipeline. |
| Outcome: | The proposed framework treats the reranker and the generator as peer decision-makers rather than being connected through an asymmetric dependency pipeline. |
Self-Guided Alignment: Adaptive Preference Sensing for Multi-Objective Generation (2026.acl-long)
Copied to clipboard
| Challenge: | Existing approaches to align LLMs with diverse human values rely on ground-truth scores . existing approaches implicitly approximate an average-user preference, thereby failing to capture heterogeneity of human values or accommodate conflicting user needs. |
| Approach: | They propose a framework that transforms passive reward dependency into an intrinsic adaptive sensing capability. |
| Outcome: | The proposed framework outperforms state-of-the-art models in multiple model scales and improves preference alignment. |
SELECting over Tokens: Curating Pre-training Data at Scale via Token Classification (2026.acl-long)
Copied to clipboard
Xin Tong, Weidong Zhang, Jiaang Li, Haibin Chen, Shilei Liu, Langming Liu, Kangtao Lv, Yujin Yuan, Wenbo Su, Bo Zheng
| Challenge: | Existing pipelines rely on expert-crafted heuristic rules, which lack content-aware, fine-grained noise detection. |
| Approach: | They propose a framework that reframes data refinement as a highly efficient token classification task. |
| Outcome: | The proposed framework outperforms existing pipelines on benchmarks and is 2.5x faster at inference. |