Papers by Xie Chen

199 papers
String Editing Based Chinese Grammatical Error Diagnosis (2022.coling-1)

Copied to clipboard

Challenge: Chinese Grammatical Error Diagnosis (CGED) suffers from numerous types of grammatical errors and insufficiency of training data.
Approach: They propose a string editing based CGED model that uses a unified workflow to handle various types of grammatical errors.
Outcome: The proposed model outperforms existing models on Chinese datasets in many aspects.
Agentic Knowledgeable Self-awareness (2025.acl-long)

Copied to clipboard

Challenge: Large Language Models (LLMs) have achieved considerable performance across various agentic planning tasks.
Approach: They propose a data-centric approach that applies agents with knowledgeable self-awareness like humans to a heuristic situation judgement criterion to mark special tokens on their self-explored trajectories for collecting training data.
Outcome: The proposed paradigm outperforms baseline models on various tasks with minimal external knowledge.
CharacterBox: Evaluating the Role-Playing Capabilities of LLMs in Text-Based Virtual Worlds (2025.naacl-long)

Copied to clipboard

Challenge: Evaluating role-playing capabilities in large language models is challenging due to complex dynamics involved in role-playering.
Approach: They propose a simulation sandbox that generates situational fine-grained character behavior trajectories to enhance LLM performance.
Outcome: The proposed model generates situational fine-grained character behavior trajectories to enhance performance.
Enhancing Speech-to-Speech Dialogue Modeling with End-to-End Retrieval-Augmented Generation (2025.findings-emnlp)

Copied to clipboard

Challenge: End-to-end speech-to speech (S2S) dialogue systems face key challenges in incorporating external knowledge into their models.
Approach: They propose a framework that directly retrieves relevant textual knowledge from speech queries.
Outcome: The proposed framework improves the performance of end-to-end speech-tospeech dialogue systems while achieving higher retrieval efficiency.
TwiUSD: A Benchmark Dataset and Structure-Aware LLM Framework for User Stance Detection (2026.acl-long)

Copied to clipboard

Challenge: Existing benchmarks for political user-level stance detection rely on noisy heuristics or distant supervision.
Approach: They propose a large-scale, expert-annotated benchmark for political user-level stance detection with explicit social network structure that integrates user content and followee signals.
Outcome: The proposed framework outperforms baselines in terms of quality and reliability.
Context-Interactive Pre-Training for Document Machine Translation (2021.naacl-main)

Copied to clipboard

Challenge: Document machine translation typically suffers from a lack of document-level bilingual data.
Approach: They propose a document machine translation model that incorporates contextual information into the training signals by capturing cross-sentence dependency within the target document and cross sentence translation to make better use of contextual information.
Outcome: The proposed model outperforms baselines on three benchmark datasets and significantly outperformed previous approaches.
FineLAP: Taming Heterogeneous Supervision for Fine-grained Language-Audio Pretraining (2026.acl-long)

Copied to clipboard

Challenge: Existing audio-language models excel at clip-level understanding but struggle with frame-level tasks.
Approach: They propose a novel training paradigm that advances both clip- and frame-level alignment in CLAP with heterogeneous data.
Outcome: The proposed training paradigm improves both clip- and frame-level alignment in CLAP with heterogeneous data.
Automatic, Meta and Human Evaluation for Multimodal Summarization with Multimodal Output (2024.naacl-long)

Copied to clipboard

Challenge: Multimodal summarization with multimodal output (MSMO) has attracted increasing research interest . evaluation is an emerging yet underexplored research topic .
Approach: They propose a framework that studies three research questions of MSMO evaluation . they propose an automatic evaluation metric and a meta-evaluation benchmark dataset .
Outcome: The proposed evaluation metric and human-annotated meta-evaluation benchmark are used to assess the quality of evaluation metrics and show the framework is effective.
SAC: Neural Speech Codec with Semantic-Acoustic Dual-Stream Quantization (2026.acl-long)

Copied to clipboard

Challenge: Existing speech codecs struggle to balance high-quality reconstruction with semantically rich representations, limiting their effectiveness in both generative and understanding tasks.
Approach: They propose a neural speech codec with semantic-acoustic dual-stream quantization that disentangles semantic and acousian modeling into two dedicated streams.
Outcome: The proposed codec outperforms state-of-the-art speech tokenizers in auto-propagating text-to-speech models.
Named Entity Recognition via Noise Aware Training Mechanism with Data Filter (2021.findings-acl)

Copied to clipboard

Challenge: Existing methods for named entity recognition (NER) do not distinguish noisy from hard samples.
Approach: They propose a noise-aware-with-filter method to help model identify noisy samples . they propose 'incomplete trust' loss function which boosts L CRF with a robust term .
Outcome: The proposed method outperforms the existing methods on six real-world Chinese and English NER datasets.
Data Quality Enhancement on the Basis of Diversity with Large Language Models for Text Classification: Uncovered, Difficult, and Noisy (2025.coling-main)

Copied to clipboard

Challenge: Existing methods for text classification based on large language models are difficult to apply directly to solve.
Approach: They propose a data quality enhancement method to improve LLMs' performance in classification tasks by using a greedy algorithm to select data and then performing fine-tuning.
Outcome: The proposed method improves the performance of large language models in text classification tasks and significantly improves training efficiency, saving nearly half of the training time.
Multi-target Backdoor Attacks for Code Pre-trained Models (2023.acl-long)

Copied to clipboard

Challenge: Existing work for backdoor attacks on neural code models insert triggers into task-specific data for code-related downstream tasks, limiting the scope of attacks.
Approach: They propose task-agnostic backdoor attacks for code pre-trained models . they use two learning strategies to implant backdoors into code understanding and generation models - Poisoned Seq2Seq learning and token representation learning .
Outcome: The proposed model is pre-trained with two learning strategies to support the multi-target attack of downstream code understanding and generation tasks.
MeanAudio: Fast and Faithful Text-to-Audio Generation with Mean Flows (2026.acl-long)

Copied to clipboard

Challenge: Recent advances in Text-to-Audio Generation (TTA) systems suffer from slow inference speed, authors report . authors demonstrate that MeanAudia achieves state-of-the-art performance in single-step audio generation .
Approach: They propose a text-to-audio generator capable of rendering realistic sound with only one function evaluation.
Outcome: The proposed system achieves state-of-the-art performance in single-step audio generation.
Tailoring Vaccine Messaging with Common-Ground Opinions (2024.findings-naacl)

Copied to clipboard

Challenge: Vaccine interventions aim to answer concerns expressed about vaccination.
Approach: They propose a dataset to evaluate how well responses are tailored to a common-ground opinion . they find that GPT-4-Turbo performs significantly better than others .
Outcome: The proposed dataset outperforms fine tuned LLMs on the task of tailoring vaccine responses to common-ground opinions.
F5-TTS: A Fairytaler that Fakes Fluent and Faithful Speech with Flow Matching (2025.acl-long)

Copied to clipboard

Challenge: Recent research in Text-to-Speech (TTS) has experienced great advancement . current models can synthesize speech for any given text and mimic the speaker of audio prompt.
Approach: They propose a fully non-autoregressive text-to-speech system based on flow matching with Diffusion Transformer (DiT) without complex designs such as duration model, text encoder, and phoneme alignment, the text input is simply padded with filler tokens to the same length as input speech, and then denoising is performed for speech generation.
Outcome: The proposed system achieves an inference RTF of 0.15, which is greatly improved compared to state-of-the-art diffusion-based models.
On the Vulnerability of Safety Alignment in Open-Access LLMs (2024.findings-acl)

Copied to clipboard

Challenge: Large language models (LLMs) are susceptible to malicious exploitation, but are often rejected and limited harmfulness is limited.
Approach: They propose two types of reverse alignment techniques: reverse supervised fine-tuning (RSFT) and reverse preference optimization (RPO).
Outcome: The proposed methods can significantly enhance the success rate and harmfulness of jailbreak attacks, but they face high rejection rates and limited harmfulness.
AgentCourt: Simulating Court with Adversarial Evolvable Lawyer Agents (2025.findings-acl)

Copied to clipboard

Challenge: Existing legal language models struggle with dynamic courtroom interactions, resulting in overfitting to standardized legal tasks.
Approach: They propose a new adversarial evolutionary approach for agents that performs dynamic knowledge learning and evolution through structured adversarials in a simulated courtroom program.
Outcome: The proposed approach outperforms existing LLM-based models in three critical dimensions: cognitive agility, professional knowledge, and logical rigor.
Forging Multiple Training Objectives for Pre-trained Language Models via Meta-Learning (2022.findings-emnlp)

Copied to clipboard

Challenge: Empirical studies show that learning multiple training objectives in a single model makes the learned language representation barely converge to the desired optimum.
Approach: They propose a meta-learning-based adaptive sampler which learns latent sampling pattern on arbitrary pre-training objectives.
Outcome: Empirical studies show that learning multiple objectives in a single model makes it difficult to achieve the desired optimum.
MAVEN-ARG: Completing the Puzzle of All-in-One Event Understanding Dataset with Event Argument Annotation (2024.acl-long)

Copied to clipboard

Challenge: Existing datasets for event understanding have limited coverage due to complexity of tasks.
Approach: They propose a dataset that augments MAVEN datasets with event argument annotations . they propose 98,591 events and 290,613 arguments obtained with laborious human annotation .
Outcome: The proposed dataset is the first all-in-one dataset supporting event detection, event argument extraction, and event relation extraction.
Can Persona-Prompted LLMs Emulate Subgroup Values? An Empirical Analysis of Generalisability and Fairness in Cultural Alignment (2026.acl-long)

Copied to clipboard

Challenge: Current alignment paradigms treat "human values" as a monolithic entity, ignoring the fact that many societies are a mosaic of diverse subgroups with distinct and sometimes conflicting values, preferences, and norms.
Approach: They examine whether Large Language Models can emulate distinct cultural values of subgroups . they use a global value survey to examine the value landscape of a multicultural society .
Outcome: The proposed model improves on unseen, out-of-distribution subgroups by 17.4% . the model widens the disparity between subgroup groups when measured by distance-aware metrics.
Unlocking LLMs’ Self-Improvement Capacity with Autonomous Learning for Domain Adaptation (2025.findings-acl)

Copied to clipboard

Challenge: Existing models that use self-supervised and instruction fine-tuning can be trained using unlabeled corpora.
Approach: They propose to use unlabeled target corpora to adapt large language models to new domains . they propose to employ self-supervised pre-training and instruction fine-tuning methods .
Outcome: The proposed model can adapt to new domains using only a large amount of unlabeled target corpora.
MUZO: Leveraging Multiple Queries and Momentum for Zeroth-Order Fine-Tuning of Large Language Models (2025.emnlp-main)

Copied to clipboard

Challenge: Existing methods for fine-tuning large language models incur memory overhead due to the need for activation storage for back-propagation (BP).
Approach: They propose a method that estimates gradients through finite differences without activation storage for back-propagation.
Outcome: The proposed method demonstrates superior performance in fine-tuning various LLMs.
Towards Reliable Large Audio Language Model (2025.findings-acl)

Copied to clipboard

Challenge: Recent advances in large audio language models (LALMs) have demonstrated impressive results and promising prospects in universal understanding and reasoning across speech, music, and general sound.
Approach: They propose to use training-free and training-based methods to enhance LALM reliability to different extents.
Outcome: The proposed methods improve the reliability of large audio language models to different extents.
GTA: Supervised-Guided Reinforcement Learning for Text Classification with Large Language Models (2025.findings-emnlp)

Copied to clipboard

Challenge: Reinforcement learning fine-tuning methods suffer from inefficient exploration and slow convergence . supervised fine- tuning methods have limited performance ceiling and less solid theoretical foundation .
Approach: They propose a Guess-Think-Answer framework that combines supervised and supervised learning in a unified training paradigm.
Outcome: The proposed framework outperforms both standalone SFT and RL training models on three text classification benchmarks.
Decomposition for Enhancing Attention: Improving LLM-based Text-to-SQL through Workflow Paradigm (2024.findings-acl)

Copied to clipboard

Challenge: In-context learning of large-language models has achieved remarkable success in the field of natural language processing . however, the single-step chain-of-thought prompting approach faces challenges such as attention diffusion and inadequate performance in complex tasks like text-to-SQL.
Approach: They propose a workflow paradigm method to enhance the attention and problem-solving scope of large-language models through decomposition.
Outcome: The proposed method outperforms existing methods on three datasets and improves the upper limit of LLM-based approaches.
Demonstrating ViviDoc: Generating Interactive Documents through Human-Agent Collaboration (2026.acl-demo)

Copied to clipboard

Challenge: Recent LLM-based agents can automate content creation, but naively applying them yields uncontrollable and unverifiable outputs.
Approach: They propose a human-agent collaborative system that generates interactive educational documents from a single topic input.
Outcome: The proposed system generates documents comparable in quality to human-authored ones.
CRAB: Cross-environment Agent Benchmark for Multimodal Language Model Agents (2025.findings-acl)

Copied to clipboard

Challenge: Existing benchmarks for MLM agents in interactive environments are limited by their focus on a single environment, lack of detailed and generalized evaluation methods, and the complexity of constructing tasks and evaluators.
Approach: They propose a cross-environment agent benchmark framework that integrates graph-based evaluation and task generation methods.
Outcome: The proposed framework supports multiple devices and can be easily extended to any environment with a Python interface.
InstructCoder: Instruction Tuning Large Language Models for Code Editing (2024.acl-srw)

Copied to clipboard

Challenge: InstructCoder is the first instruction-tuning dataset designed to adapt LLMs for general-purpose code editing.
Approach: They propose to use Large Language Models to edit code based on user instructions . they use a dataset to adapt LLMs to general-purpose code editing .
Outcome: The proposed model can significantly improve code editing performance compared to proprietary models . the proposed model is based on a human-written execution-based benchmark .
DecoupleSearch: Decouple Planning and Search via Hierarchical Reward Modeling (2025.emnlp-main)

Copied to clipboard

Challenge: Retrieval-Augmented Generation (RAG) systems have emerged as a pivotal methodology for enhancing Large Language Models (LLMs).
Approach: They propose a framework that decouples planning and search processes using dual value models, enabling independent optimization of plan reasoning and search grounding.
Outcome: The proposed framework decouples planning and search processes using dual value models, enabling independent optimization of plan reasoning and search grounding.
Few-shot Classification with Hypersphere Modeling of Prototypes (2023.findings-acl)

Copied to clipboard

Challenge: Existing methods for fewshot learning use embeddings in space, but they lack expressivity and are difficult to perform statistically.
Approach: They propose a method where class information is represented by hyperspheres with dynamic sizes with two sets of learnable parameters: the hypersphere’s center and the radius.
Outcome: The proposed method is much more expressive than embeddings and performs better than statistical modeling.
Towards Fine-Grained and Multi-Granular Contrastive Language-Speech Pre-training (2026.acl-long)

Copied to clipboard

Challenge: Existing models for fine-grained speaking styles are limited in terms of accuracy, coverage, and naturalness.
Approach: They propose a model that pre-trains with coarse captions and annotates with a pipeline that grounds captions in audio.
Outcome: The proposed model outperforms existing models with fine-grained style annotations . it integrates global and fine-granular supervision, enabling unified representations based on the proposed model .
VLFeedback: A Large-Scale AI Feedback Dataset for Large Vision-Language Models Alignment (2024.emnlp-main)

Copied to clipboard

Challenge: Large vision-language models (LVLMs) are evolving rapidly and require data with human supervision to achieve better alignment.
Approach: They introduce VLFeedback, the first large-scale vision-language feedback dataset . they train Silkie, an LVLM fine-tuned via direct preference optimization .
Outcome: The proposed model outperforms its base model in helpfulness, visual faithfulness, and safety metrics and exhibits enhanced resilience against red-teaming attacks.
Exploring Lottery Prompts for Pre-trained Language Models (2023.acl-long)

Copied to clipboard

Challenge: Existing approaches to optimize pre-trained language models are expensive and slow to scale.
Approach: They propose to search for instance-level lottery prompts and generalize them to unseen data . they validate the assumption that for every instance, there is almost always a lottery prompt that induces the correct prediction from the PLM .
Outcome: The proposed method can achieve comparable results with other gradient-free and optimization-free baselines.
GALA: Geometric Data Selection with Strategic Prospecting for Large Language Model Self-training (2026.findings-acl)

Copied to clipboard

Challenge: Existing approaches to self-training are based on reject sampling and lack quality reasoning paths.
Approach: They propose a framework for self-training using a generate-and-filter paradigm . they propose to identify diverse and informative samples from redundant data and exploit them more strategically.
Outcome: The proposed framework exploits informative samples from redundant data and improves reasoning trajectory prospecting.
INTERS: Unlocking the Power of Large Language Models in Search with Instruction Tuning (2024.acl-long)

Copied to clipboard

Challenge: Large language models (LLMs) have demonstrated impressive capabilities in various natural language processing tasks, but their application to information retrieval tasks is still challenging due to the infrequent occurrence of many IR-specific concepts in natural language.
Approach: They propose to use instruction tuning to enhance LLMs' proficiency in IR tasks by combining a dataset with manually written templates to analyze the effects of instruction design, template diversity, few-shot demonstrations, and the volume of instructions.
Outcome: The proposed model can be used to perform query understanding, document understanding, and query-document relationship understanding tasks.
Benchmarking Large Language Models Under Data Contamination: A Survey from Static to Dynamic Evaluation (2025.emnlp-main)

Copied to clipboard

Challenge: In the era of evaluating large language models, data contamination is an increasingly prominent concern . static benchmarking has been used for evaluation, but there are limitations of *dynamic* benchmarks .
Approach: They propose a series of optimal design principles for *dynamic* benchmarking and analyze the limitations of existing *static* benchmarks.
Outcome: The proposed benchmarks highlight a critical gap in the evaluation of LLMs.
DeepSeekMoE: Towards Ultimate Expert Specialization in Mixture-of-Experts Language Models (2024.acl-long)

Copied to clipboard

Challenge: Mixture-of-Experts (MoE) architectures face challenges in ensuring expert specialization . despite the promising performance, scaling language models to an extremely large scale is associated with exceedingly high computational costs.
Approach: They propose an architecture that allows for ultimate expert specialization by segmenting experts into mN ones and activating mK from them.
Outcome: The proposed architecture achieves comparable performance with GShard with 2B parameters and computation.
OpenT2T: An Open-Source Toolkit for Table-to-Text Generation (2024.emnlp-demo)

Copied to clipboard

Challenge: Existing methods for table-to-text generation are limited and benchmarked on a limited number of datasets.
Approach: They propose to use open-source tools to reproduce existing large language models for performance comparison and expedite the development of new models.
Outcome: The proposed toolkit compares existing large language models on 9 table-to-text generation datasets and maintains a leaderboard to provide insights for future work.
PsyDT: Using LLMs to Construct the Digital Twin of Psychological Counselor with Personalized Counseling Style for Psychological Counseling (2025.acl-long)

Copied to clipboard

Challenge: Existing mental health LLMs do not consider the fact that different psychological counselors exhibit different personal styles.
Approach: They propose a framework that uses LLMs to construct the digital twin of psychological counselor with personalized counseling style.
Outcome: The proposed framework can synthesize multi-turn dialogues that closely resemble real-world counseling cases and demonstrate better performance compared to baselines.
FinChain: A Symbolic Benchmark for Verifiable Chain-of-Thought Financial Reasoning (2026.acl-long)

Copied to clipboard

Challenge: Existing benchmarks emphasize final numerical answers while neglecting intermediate reasoning steps.
Approach: They propose a symbolic benchmark for verifiable Chain-of-Thought evaluation in finance . FINCHAIN spans 58 topics across 12 financial domains and three difficulty levels .
Outcome: The proposed benchmark aims to bridge symbolic reasoning and factual verification.
AgentCPM-GUI: Building Mobile-Use Agents with Reinforcement Fine-Tuning (2025.emnlp-demos)

Copied to clipboard

Challenge: Large language model agents have enabled GUI-based automation, but their deployment is limited by noisy data, poor generalization, and lack of support for non-English GUIs.
Approach: They propose an 8B-parameter GUI agent built for robust and efficient on-device GUI interaction.
Outcome: The proposed GUI agent achieves promising performance on five public benchmarks and proposed Chinese benchmark CAGUI.
Few-NERD: A Few-shot Named Entity Recognition Dataset (2021.acl-long)

Copied to clipboard

Challenge: Existing approaches to few-shot named entity recognition (NER) focus on coarse-grained entities with few examples, while most unseen entities are fine-grounded.
Approach: They present a human-annotated few-shot named entity recognition dataset . they construct benchmark tasks to assess the generalization capability of models .
Outcome: The proposed model is the first few-shot NER dataset and the largest human-crafted NER data set.
Revealing the Barriers of Language Agents in Planning (2025.naacl-long)

Copied to clipboard

Challenge: Existing studies show language agents lack human-level planning abilities . limitations and mechanisms to address them remain insufficiently understood .
Approach: They apply a feature attribution study to identify key factors hindering agent planning . they identify the limited role of constraints and diminishing influence of questions .
Outcome: The proposed model achieves 15.6% on a real-world planning benchmark.
Controllable Preference Optimization: Toward Controllable Multi-Objective Alignment (2024.emnlp-main)

Copied to clipboard

Challenge: Existing algorithms for achieving optimal alignment are mostly unidirectional . a recent study suggests that large language models can be ground with evident preferences .
Approach: They propose to ground large language models with evident preferences . they propose to use controllable preference optimization to specify different objectives .
Outcome: The proposed models can provide responses that match various preferences among the ”3H” desiderata.
In-Context Former: Lightning-fast Compressing Context for Large Language Model (2024.findings-emnlp)

Copied to clipboard

Challenge: Existing methods to reduce inference costs of transformer-based large language models entail quadratic complexity . et al., 2017): transformer-derived large language model performance is a major challenge.
Approach: They propose a method that compresses long contexts into short soft prompts . they use the self-attention mechanism of the large model to extract and condense information .
Outcome: The proposed method reduces compression costs by 68 to 112 times while achieving 90% of baseline performance.
GSID: Generative Semantic Indexing for E-Commerce Product Understanding (2025.emnlp-industry)

Copied to clipboard

Challenge: Structured product information is a major bottleneck for the efficiency of e-commerce platforms.
Approach: They propose a data-driven approach to generate product structured representations using product metadata.
Outcome: Extensive experiments show that GSID can generate better product representations on real-world e-commerce platforms.
FedED: Federated Learning via Ensemble Distillation for Medical Relation Extraction (2020.emnlp-main)

Copied to clipboard

Challenge: Existing relation extraction methods require centralizing training data from different medical platforms while holding the privacy-sensitive data puts patients' privacy at risk.
Approach: They propose a federated relation extraction model that trains a central model without sharing or exchange of private local data.
Outcome: The proposed model trains a central model without uploading local parameters, and it performs well on three publicly available datasets.
Multi-Agent Collaboration via Cross-Team Orchestration (2025.findings-acl)

Copied to clipboard

Challenge: Large Language Models (LLMs) have significantly impacted various domains, especially through organized LLM-driven autonomous agents.
Approach: They propose a framework that enables orchestrated teams to jointly propose various task-oriented solutions and interact with their insights in a self-independence while cross-team collaboration environment for superior solutions generation.
Outcome: Experiments show that the framework can generate better software quality compared to state-of-the-art frameworks.
From Selection to Generation: A Survey of LLM-based Active Learning (2025.acl-long)

Copied to clipboard

Challenge: Large Language Models (LLMs) have been used for selection and training of data for active learning.
Approach: They propose an intuitive taxonomy that categorizes LLM-based active learning techniques and discuss the transformative roles they can play in the active learning loop.
Outcome: The proposed model can generate entirely new data instances and provide more cost-effective annotations with fewer labeled data instances.
To Copy Rather Than Memorize: A Vertical Learning Paradigm for Knowledge Graph Completion (2023.acl-long)

Copied to clipboard

Challenge: Existing methods for embedding knowledge graphs implicitly memorize relation rules to infer missing links, but they are difficult to memorize due to the inherent deficiencies of such implicit memorization strategy.
Approach: They propose a vertical learning paradigm that allows to explicitly copy target information from related factual triples for more accurate prediction.
Outcome: The proposed model improves generalization ability and makes distant link prediction significantly easier.
Classic4Children: Adapting Chinese Literary Classics for Children with Large Language Model (2025.findings-naacl)

Copied to clipboard

Challenge: Recent large language models (LLMs) overlook children’s reading preferences, which poses challenges in CLA.
Approach: They propose a method that augments large language models with children's reading preferences for adaptation by obtaining characters' personalities and narrative structure as additional information for fine-grained instruction tuning.
Outcome: The proposed method significantly improves performance in automatic and human evaluation.
Mitigating Boundary Ambiguity and Inherent Bias for Text Classification in the Era of Large Language Models (2024.findings-acl)

Copied to clipboard

Challenge: a new text classification framework for large language models addresses the problem of boundary ambiguity and inherent biases in LLMs.
Approach: They propose a two-stage classification framework for large language models to mitigate bottlenecks . their approach uses pairwise comparisons to efficiently narrow down options .
Outcome: The proposed framework reduces the number of options and improves on four datasets.
MAGI: Multi-Agent Guided Interview for Psychiatric Assessment (2025.findings-acl)

Copied to clipboard

Challenge: Existing large language models (LLMs) do not align with psychiatric diagnostic protocols.
Approach: They propose a framework that transforms the Mini International Neuropsychiatric Interview into automatic computational workflows through coordinated multi-agent collaboration.
Outcome: The proposed framework transforms the gold-standard Mini International Neuropsychiatric Interview (MINI) into automatic computational workflows through coordinated multi-agent collaboration.
Geo-Encoder: A Chunk-Argument Bi-Encoder Framework for Chinese Geographic Re-Ranking (2024.eacl-long)

Copied to clipboard

Challenge: Chinese geographic re-ranking task aims to find the most relevant addresses among retrieved candidates.
Approach: They propose a framework to integrate Chinese geographic semantics into re-ranking pipelines.
Outcome: The proposed framework improves on two Chinese benchmark datasets.
GUI-explorer: Autonomous Exploration and Mining of Transition-aware Knowledge for GUI Agent (2025.acl-long)

Copied to clipboard

Challenge: GUI automation is a key challenge in dynamic environments.
Approach: They propose a training-free GUI agent that integrates two mechanisms to explore trajectories in GUIs.
Outcome: The proposed GUI-explorer shows significant improvements over existing agents.
MMAC: A Multilingual, Multimodal Alignment Framework for Cultural Grounding Evaluation (2026.acl-long)

Copied to clipboard

Challenge: Existing models lack cultural alignment across modalities and languages . a new framework to assess cultural awareness across linguistics and languages is needed .
Approach: They propose a framework that integrates tri-modally aligned cultural benchmarks and a five-dimensional evaluation protocol to assess cross-country awareness disparities.
Outcome: The proposed framework assesses cultural awareness disparities across modalities and languages . it is the first dataset aligned at the input level across text, image, and speech .
Calibrating Language Models with Adaptive Temperature Scaling (2024.emnlp-main)

Copied to clipboard

Challenge: Large language models' confidence scores are degraded after fine-tuning with reinforcement learning from human feedback.
Approach: They propose a post-hoc calibration method that predicts a temperature scaling parameter for each token prediction.
Outcome: Adaptive temperature scaling improves calibration by over 10% compared to prior methods . RLHF fine-tuning improves model accuracy, but degradation is not significant .
TaxPraBen: A Scalable Benchmark for Structured Evaluation of LLMs in Chinese Real-World Tax Practice (2026.acl-long)

Copied to clipboard

Challenge: Large Language Models excel in general domains but lack real-world practical capabilities.
Approach: They propose a benchmark for Chinese taxation practice that combines 10 traditional application tasks with 3 pioneering real-world scenarios.
Outcome: The proposed benchmark combines 10 traditional tasks with 3 pioneering real-world scenarios.
TrendSim: Simulating Trending Topics in Social Media Under Poisoning Attacks with LLM-based Multi-agent System (2025.findings-naacl)

Copied to clipboard

Challenge: Trending topics bring in a new channel for poisoning attacks, resulting in negative impacts on society.
Approach: They propose an LLM-based multi-agent system to simulate trending topics in social media . they propose a time-aware interaction mechanism, centralized message dissemination, and an interactive system .
Outcome: The proposed system simulates trending topics under poisoning attacks on social media platforms.
Reinforcement Learning with Token-level Feedback for Controllable Text Generation (2024.findings-naacl)

Copied to clipboard

Challenge: Existing methods for controllable text generation are guided by coarse-grained feedback, which may lead to suboptimal performance owing to semantic twists or progressions within sentences.
Approach: They propose a reinforcement learning algorithm which formulates TOken-LEvel rewards for controllable text generation and employs a "first-quantize-then-noise" paradigm to enhance the robustness of the RL algorithm.
Outcome: The proposed algorithm can achieve superior performance on single-attribute and multi-attract control tasks.
PlanningArena: A Modular Benchmark for Multidimensional Evaluation of Planning and Tool Learning (2025.acl-long)

Copied to clipboard

Challenge: Recent studies have shown that LLMs can be significantly improved by integrating external tools.
Approach: They propose a framework that integrates external tools into large language models to evaluate their ability to generate action plans.
Outcome: The proposed framework evaluates the ability of large language models to generate action plans and generate action plan templates.
emotion2vec: Self-Supervised Pre-Training for Speech Emotion Representation (2024.findings-acl)

Copied to clipboard

Challenge: Existing models for speech emotion recognition are not suitable for emotional tasks.
Approach: They propose a universal speech emotion representation model that is pre-trained on open-source emotion data.
Outcome: euphoria2vec outperforms state-of-the-art models and emotion specialist models . it shows consistent improvements among 10 different languages of speech emotion recognition datasets .
Memp: Exploring Agent Procedural Memory (2026.findings-acl)

Copied to clipboard

Challenge: Large Language Models (LLMs) based agents suffer from brittle procedural memory that is manually engineered or entangled in static parameters.
Approach: They propose a procedural-memory repository that distills past agent trajectories into fine-grained, step-by-step instructions and higher-level, script-like abstractions.
Outcome: The proposed repository can be used to improve agents' performance on travelplanner and Alfworld.
Beyond Natural Language: LLMs Leveraging Alternative Formats for Enhanced Reasoning and Communication (2024.findings-emnlp)

Copied to clipboard

Challenge: Natural language (NL) has long been the predominant format for human cognition and communication, but its utility in LLMs has not been thoroughly examined.
Approach: They propose to allow LLMs to choose the most suitable format before reasoning or communicating, and to automate the selection process.
Outcome: The proposed format improves reasoning efficiency and reduces token usage while maintaining communicative effectiveness.
Making LLMs Better Many-to-Many Speech-to-Text Translators with Curriculum Learning (2025.acl-long)

Copied to clipboard

Challenge: Existing studies on English-centric translation tasks have focused on multimodal large language models, but the exploration of many-to-many translation is limited by the scarcity of parallel data.
Approach: They propose a three-stage curriculum learning strategy that leverages the machine translation capabilities of large language models and adapts them to S2TT tasks.
Outcome: The proposed strategy achieves state-of-the-art average performance in 1514 language pairs, requiring fewer than 10 hours of speech data per language to achieve competitive results.
SLAM-Omni: Timbre-Controllable Voice Interaction System with Single-Stage Training (2025.findings-acl)

Copied to clipboard

Challenge: a new spoken dialogue system with single-stage training is demonstrating its low latency and high quality . SLAM-Omni achieves zero-shot timbre control by modeling spoken language with semantic tokens .
Approach: They propose a timbre-controllable, end-to-end voice interaction system with single-stage training.
Outcome: The proposed system outperforms previous models on 4 GPUs with limited data.
LongLeader: A Comprehensive Leaderboard for Large Language Models in Long-context Scenarios (2025.naacl-long)

Copied to clipboard

Challenge: LongLeader aims to assess different LLMs' long-context comprehension abilities . long-constext comprehension is a key bottleneck for many use cases .
Approach: They propose a leaderboard to assess different LLMs' long-context comprehension abilities . they offer open-source access to the benchmarks and maintain a dedicated website .
Outcome: The proposed model assesses different LLMs on selected benchmarks and provides open-source access to the benchmarks.
SWE-Fixer: Training Open-Source LLMs for Effective and Efficient GitHub Issue Resolution (2025.findings-acl)

Copied to clipboard

Challenge: Large Language Models excel in code generation benchmarks, but these benchmarks focus on single-file scenarios with constrained context scope.
Approach: They propose an open-source framework to effectively resolve GitHub issues using a code file retrieval module and a model-based code editing module.
Outcome: The proposed approach achieves state-of-the-art performance on two GitHub benchmarks.
StreamVoice: Streamable Context-Aware Language Modeling for Real-time Zero-Shot Voice Conversion (2024.acl-long)

Copied to clipboard

Challenge: Existing LM-based VC models require offline conversion from source semantics to acoustic features, limiting their deployment to real-time applications.
Approach: They propose a streaming LM-based model for zero-shot voice conversion that uses a fully causal context-aware LM with a temporal-independent acoustic predictor to facilitate real-time conversion given arbitrary speaker prompts and source speech.
Outcome: The proposed model achieves comparable performance to non-streaming VC systems while maintaining a fully causal context-aware LM with a temporal-independent acoustic predictor.
KBM: Delineating Knowledge Boundary for Adaptive Retrieval in Large Language Models (2025.findings-emnlp)

Copied to clipboard

Challenge: Retrieval-augmented generation (RAG) is employed to tackle these challenges . a Knowledge Boundary Model (KBM) is used to express the known/unknown of a given question .
Approach: They propose a Knowledge Boundary Model to express the known/unknown of a given question . they find that not all questions need to trigger RAG to improve performance .
Outcome: The proposed model reduces time and computational costs by retrieving parts of unknown knowledge . the proposed model can express the known/unknown of a given question and determine whether a RAG needs to be triggered .
Modeling Historical Relevant and Local Frequency Context for Representation-Based Temporal Knowledge Graph Forecasting (2024.findings-emnlp)

Copied to clipboard

Challenge: Existing representation-based approaches neglect candidate-specific temporal context, resulting in serious information loss or homogeneous prediction.
Approach: They propose a temporal representation learning model that incorporates temporal contexts of candidates and models temporal contextual information from historiCal Relevant context and locAl Frequency contexT.
Outcome: The proposed model can leverage temporal contextual information to achieve differential predictions on six benchmark datasets.
Same Claim, Different Judgment: Benchmarking Scenario-Induced Bias in Multilingual Financial Misinformation Detection (2026.findings-acl)

Copied to clipboard

Challenge: Existing research on LLM biases has focused on direct questioning or general-purpose settings . pronounced behavioral biase despite their growing deployment in financial analysis, forecasting, and decision support.
Approach: They propose a benchmark to evaluate behavioral biases of large language models in MFMD . they use a multilingual financial misinformation dataset to integrate these with misinformation claims .
Outcome: The proposed benchmark evaluates behavioral biases of large language models across economic scenarios.
VulLibGen: Generating Names of Vulnerability-Affected Packages via a Large Language Model (2024.acl-long)

Copied to clipboard

Challenge: Existing work on affected package identification is limited by large language models . a recent study shows that 84% third-party packages contain security vulnerabilities .
Approach: They propose a method to use LLM to generate the affected package . they propose supervised fine-tuning, retrieval augmented generation and a local search algorithm .
Outcome: The proposed method has an average precision of 0.806 for identifying vulnerable packages in four most popular ecosystems in GitHub Advisory.
From Redundancy to Relevance: Information Flow in LVLMs Across Reasoning Tasks (2025.naacl-long)

Copied to clipboard

Challenge: Large visionlanguage models (LVLMs) are a powerful visual-language reasoning tool.
Approach: They propose to integrate attention analysis with LLaVA-CAM to determine interactions between visual representations.
Outcome: The proposed approach can be used to determine interactions between visual representations.
LLM-Enhanced Query Generation and Retrieval Preservation for Task-Oriented Dialogue (2025.findings-acl)

Copied to clipboard

Challenge: Existing knowledge retrieval methods for task-oriented dialogues are limited by data scarcity and lack of data to annotate.
Approach: They propose an LLM-enhanced model of query-guided knowledge retrieval for task-oriented dialogue . they propose to select the most relevant knowledge from retrieved top-K records and incorporate them as prompts to guide a generator in response generation.
Outcome: The proposed model outperforms state-of-the-art in three benchmarks on three standard benchmarks.
ZhuJiu: A Multi-dimensional, Multi-faceted Chinese Benchmark for Large Language Models (2023.emnlp-demo)

Copied to clipboard

Challenge: Various types of LLMs have recently been rapidly developing, such as Llama2 and ChatGLM2 .
Approach: They propose a benchmark that comprehensively evaluates LLMs across 7 ability dimensions covering 51 tasks.
Outcome: The proposed benchmarks are comprehensive and systematic, with a high level of accuracy and authority.
CADReview: Automatically Reviewing CAD Programs with Error Detection and Correction (2025.acl-long)

Copied to clipboard

Challenge: Computer-aided design (CAD) is crucial in prototyping 3D objects through geometric instructions.
Approach: They propose a CAD review task to automatically detect and correct potential errors . they propose CAD program repairer framework to provide helpful feedback on error correction .
Outcome: The proposed framework outperforms existing MLLMs in detecting errors and providing feedback on error correction.
Fusing Highly Specialized Language Models for Comprehensive Expertise (2025.acl-long)

Copied to clipboard

Challenge: Existing models that focus on language, programming code, and mathematical symbols are not able to achieve mastery of all three domains simultaneously.
Approach: They propose to fuse highly-specialized models that are already sufficiently trained on different domains to achieve a highly-specific model.
Outcome: The proposed model could achieve mastery of the three crucial domains simultaneously.
OmniThink: Expanding Knowledge Boundaries in Machine Writing through Thinking (2025.emnlp-main)

Copied to clipboard

Challenge: Recent advances in Large Language Models (LLMs) have demonstrated remarkable progress in machine writing such as open domain long-form generation.
Approach: They propose a slow-thinking machine writing framework that emulates the human-like process of iterative expansion and reflection to improve the knowledge density of generated articles.
Outcome: The proposed framework improves the knowledge density of generated articles without compromising metrics such as coherence and depth.
GraphCheck: Breaking Long-Term Text Barriers with Extracted Knowledge Graph-Powered Fact-Checking (2025.acl-long)

Copied to clipboard

Challenge: Existing fact-checking methods that use large language models often generate subtle factual errors.
Approach: They propose a fact-checking framework that uses extracted knowledge graphs to enhance text representation.
Outcome: GraphCheck outperforms existing specialized fact-checkers on seven benchmarks spanning general and medical domains . Graph Neural Networks process extracted knowledge graphs as a soft prompt, enabling efficient fact- checking in a single inference call.
Making Parameter-efficient Tuning More Efficient: A Unified Framework for Classification Tasks (2022.coling-1)

Copied to clipboard

Challenge: Large pre-trained language models (PLMs) have demonstrated superior performance in industrial applications.
Approach: They propose a framework that re-uses existing parameter-efficient methods with a unified classifier.
Outcome: The proposed framework improves the efficiency of existing parameter-efficient methods with a unified classifier.
A Reinforced Generation of Adversarial Examples for Neural Machine Translation (2020.acl-main)

Copied to clipboard

Challenge: Neural machine translation systems fail on less decent inputs, which may harm the credibility of these systems.
Approach: They propose a paradigm that generates adversarial examples using reinforcement learning to expose pitfalls for a given performance metric.
Outcome: The proposed paradigm produces stable attacks with meaning-preserving adversarial examples.
Industry Scale Semi-Supervised Learning for Natural Language Understanding (2021.naacl-industry)

Copied to clipboard

Challenge: Obtaining human annotation is expensive and time-consuming process.
Approach: They propose a semi-supervised learning pipeline which leverages millions of unlabeled examples to improve natural language understanding tasks.
Outcome: The proposed pipeline can be used to improve natural language understanding tasks.
Tree-Structured Topic Modeling with Nonparametric Neural Variational Inference (2021.acl-long)

Copied to clipboard

Challenge: Existing methods for topic modeling learn topics with a flat structure . however, such methods have data scalability issues .
Approach: They propose to use nonparametric neural variational inference to extract a tree-structured topic model with reasonable structure, low redundancy, and adaptable widths.
Outcome: The proposed model extracts a tree-structured topic hierarchy with reasonable structure, low redundancy, and adaptable widths.
RaaS: Reasoning-Aware Attention Sparsity for Efficient LLM Reasoning (2025.findings-acl)

Copied to clipboard

Challenge: Large Language Models (LLMs) have demonstrated strong capabilities across various domains, but their large-scale deployment faces a major obstacle: the high computational cost of long-sequence inference.
Approach: They propose an algorithm that retains key-value vectors until they are no longer needed to solve reasoning tasks.
Outcome: The proposed algorithm achieves high accuracy with O(L) time but O(N) memory complexities.
Prompt Optimization via Adversarial In-Context Learning (2024.acl-long)

Copied to clipboard

Challenge: Existing methods to optimize prompts for in-context learning are based on adversarial learning and are computationally efficient and extensible to other LLMs and tasks.
Approach: They propose a method to optimize prompts for in-context learning by a generator and a discriminator.
Outcome: The proposed method improves state-of-the-art prompt optimization techniques on 13 generation and classification tasks including summarization, arithmetic reasoning, machine translation, data-to-text generation, and the MMLU and big-bench hard benchmarks.
Neural Mixed Counting Models for Dispersed Topic Discovery (2020.acl-main)

Copied to clipboard

Challenge: Existing methods for inference of parameter parameters are time-consuming and difficult to use.
Approach: They propose two efficient neural mixed counting models that use the negative binomial distribution as the prior for dispersed topic discovery.
Outcome: The proposed models outperform state-of-the-art models in terms of perplexity and topic coherence on real-world datasets.
FinCARDS: Card-Based Analyst Reranking for Financial Document Question Answering (2026.findings-acl)

Copied to clipboard

Challenge: Existing reranking frameworks optimize semantic relevance, leading to unstable rankings and opaque decisions on long documents.
Approach: They propose a structured reranking framework that reframes financial evidence selection as constraint satisfaction under a finance-aware schema.
Outcome: FINCARDS improves early-rank retrieval over lexical and LLM-based reranking baselines while reducing ranking variance.
Multi-task Learning for Paraphrase Generation With Keyword and Part-of-Speech Reconstruction (2022.findings-acl)

Copied to clipboard

Challenge: PGKPR is a deep learning approach to generate paraphrases using key semantics of the source sentence.
Approach: They propose a model with keyword and part-of-speech reconstruction for paraphrase generation using deep learning.
Outcome: The proposed model outperforms comparative models on two commonly-used datasets.
DeepKE: A Deep Learning Based Knowledge Extraction Toolkit for Knowledge Base Population (2022.emnlp-demos)

Copied to clipboard

Challenge: Existing knowledge extraction tools are not complete due to emerging entities and relations in real-world applications.
Approach: They propose an open-source knowledge extraction toolkit DeepKE that supports low-resource, document-level and multimodal scenarios in the knowledge base population.
Outcome: The proposed toolkit supports low-resource, document-level and multimodal scenarios in the knowledge base population.
Inner Thinking Transformer: Leveraging Dynamic Depth Scaling to Foster Adaptive Internal Thinking (2025.acl-long)

Copied to clipboard

Challenge: Large language models face inherent performance bottlenecks under parameter constraints . challenging tokens induce abrupt gradient spikes across layers, exposing stress points .
Approach: They propose an inner thinking transformer that reimagines layer computations as implicit thinking steps.
Outcome: Empirical results show that ITT outperforms Transformer/Loop variants in 11 benchmarks.
CGIM: A Cycle Guided Interactive Learning Model for Consistency Identification in Task-oriented Dialogue (2022.coling-1)

Copied to clipboard

Challenge: Consistency identification in task-oriented dialog usually consists of three subtasks . a proposed model for consistency identification in dialog is based on an explicit interaction paradigm .
Approach: They propose a cycle guided interactive learning model that makes information exchange explicit from all the three tasks.
Outcome: The proposed model achieves state-of-the-art performance pushing the overall score to 56.3% (5.0% point absolute improvement)
FinSafetyBench: Evaluating LLM Safety in Real-World Financial Scenarios (2026.findings-acl)

Copied to clipboard

Challenge: Existing large language models (LLMs) are prone to misuse and misinformation, posing serious compliance risks.
Approach: They propose a bilingual red-teaming benchmark to test an LLM’s refusal of requests that violate financial compliance.
Outcome: The proposed benchmark is based on real-world financial crime cases and ethical violations and includes 14 subcategories covering financial crimes and ethical breaches.
Sentient Agent as a Judge: Evaluating Higher-Order Social Cognition in Large Language Models (2026.findings-acl)

Copied to clipboard

Challenge: Large language models (LLMs) have evolved from statistical sequence predictors to sophisticated autonomous agents capable of reasoning, planning, and sustaining multi-turn conversa-tions.
Approach: They propose a system that instantiates a "Sentient Agent" that simulates human-like emotional changes and inner thoughts to provide a more realistic evaluation of the model in multi-turn conversations.
Outcome: The proposed framework measures the agent's higher-order social cognition in multi-turn conversations.
DGLF: A Dual Graph-based Learning Framework for Multi-modal Sarcasm Detection (2024.emnlp-main)

Copied to clipboard

Challenge: Existing methods for multimodal sarcasm detection neglect high-order relationships and underestimate high-frequency messages.
Approach: They propose a Dual Graph-based Learning Framework to capture inter-modal inconsistencies . they propose combining a hypergraph and a vanilla graph to achieve enhanced propagation .
Outcome: The proposed model outperforms existing state-of-the-art methods on two benchmark datasets.
CADMate: Generating CAD Assembly Plan with Geometric Chain-of-Thought and Spatial Physical Rewards (2026.acl-long)

Copied to clipboard

Challenge: Computer-aided design (CAD) is crucial in prototyping complex 3D objects . designers manually define assembly sequences for individual CAD parts .
Approach: They propose a framework for computer-aided design that predicts actions for CAD parts . they use a reference design image and disassembled parts to generate 6-DoF transformations .
Outcome: The proposed framework outperforms existing MLLMs in the design of CAD assemblies.
GigaSpeech 2: An Evolving, Large-Scale and Multi-domain ASR Corpus for Low-Resource Languages with Automated Crawling, Transcription and Refinement (2025.acl-long)

Copied to clipboard

Challenge: GigaSpeech 2 is a large-scale, multi-domain, multilingual speech recognition corpus for low-resource languages.
Approach: They propose a large-scale, multi-domain, multilingual speech recognition corpus for low-resource languages and an automated pipeline for data crawling, transcription, and label refinement.
Outcome: The proposed corpus reduces the word error rate for Thai, Indonesian, and Vietnamese on a realistic YouTube test set by 25% to 40% compared to Whisper large-v3.
Red-Teaming NSFW Image Classifiers as Text-to-Image Safeguards (2026.findings-acl)

Copied to clipboard

Challenge: Not Safe for Work (NSFW) image classifiers play a critical role in safeguarding text-to-image systems.
Approach: They propose an automated red-teaming framework that leverages a set of generative AI tools to uncover NSFW image failures.
Outcome: The proposed framework uncovers and interprets failure modes and enables it to be applied to real-world T2I and T2V systems.
Mitigating Judgment Preference Bias in Large Language Models through Group-Based Polling (2026.findings-acl)

Copied to clipboard

Challenge: Large Language Models (LLMs) are used as automatic evaluators to provide accurate and reliable assessments.
Approach: They propose a framework that integrates LLM-based judgment models into a multi-agent system and simulates the interactive client-server polling mechanism.
Outcome: The proposed framework outperforms supervised models trained on annotated judgment data while requiring no human-labeled annotations.
DiffusEmp: A Diffusion Model-Based Framework with Multi-Grained Control for Empathetic Response Generation (2023.acl-long)

Copied to clipboard

Challenge: Existing methods to generate empathetic responses are monotonous and generic, resulting in shallow empathy and few connections to the context.
Approach: They propose to use explicit control to guide the empathy expression and a framework DiffusEmp to unify the utilization of dialogue context and attribute-oriented control signals.
Outcome: The proposed framework outperforms baselines on EmpatheticDialogue in terms of controllability, informativeness, diversity, and diversity without the loss of context-relatedness.
Towards Realistic Low-resource Relation Extraction: A Benchmark with Empirical Baseline Study (2022.findings-emnlp)

Copied to clipboard

Challenge: Existing approaches to extract relational facts from text are limited in their ability to learn from limited labeled data.
Approach: They propose to use prompt-based methods with few-shot labeled data to evaluate performance . data augmentation technologies and self-training are also proposed to generate more labeles in-domain data.
Outcome: The proposed methods perform well in low-resource settings with 8 relation extraction datasets.
GOBench: Stage-Wise Diagnostics and the Visual Paradox in Multimodal Graph Optimization (2026.findings-acl)

Copied to clipboard

Challenge: Existing benchmarks fail to represent multimodal problem specifications, score outcomes only and cannot localize where failures occur along the modeling pipeline.
Approach: They propose a Graph Optimization benchmark that aligns multiple modalities with solver-derived oracles and a diagnostic protocol that evaluates intermediate artifacts as well as end results.
Outcome: Graph Optimization benchmark (GOBench) evaluates intermediate artifacts as well as end results . vision reliably increases inference cost, while reliability impact is regime-dependent . current benchmarks fail to represent multimodal problem specifications, fail to localize failures .
MedDialog: Large-scale Medical Dialogue Datasets (2020.emnlp-main)

Copied to clipboard

Challenge: telemedicine is a medical practice that provides patient care remotely using video conferencing tools.
Approach: They build large-scale medical dialogue datasets to facilitate research . they pretrain several models on the Chinese MedDialog dataset and compare their performance .
Outcome: The proposed datasets show that models trained on MedDialog can generate doctor-like medical dialogues.
FinReporting: An Agentic Workflow for Localized Reporting of Cross-Jurisdiction Financial Disclosure (2026.acl-demo)

Copied to clipboard

Challenge: FinReporting is an agentic workflow for localized cross-jurisdiction financial reporting . existing approaches assume a single-market setting and overlook structural differences across jurisdictions .
Approach: They propose a workflow that decomposes financial reporting into auditable stages . they use Large Language Models to extract and summarize corporate disclosures .
Outcome: The proposed system decomposes reporting into auditable stages . it improves consistency and reliability under heterogeneous reporting regimes.
ReStyle-TTS: Relative and Continuous Style Control for Zero-Shot Speech Synthesis (2026.findings-acl)

Copied to clipboard

Challenge: Recent controllable zero-shot text-to-speech systems can synthesize speech for unseen speakers from a short reference audio clip, but they also inherit the speaking style present in the reference.
Approach: They propose a framework that enables continuous and reference-relative style control in zero-shot text-to-speech systems by combining style-specific LoRAs with Orthogonal LoRA Fusion.
Outcome: The proposed framework reduces the model's dependence on reference style while preserving text fidelity while maintaining intelligibility and speaker timbre.
MoVa: Towards Generalizable Classification of Human Morals and Values (2025.emnlp-main)

Copied to clipboard

Challenge: Identifying human morals and values embedded in language is essential to empirical studies of communication.
Approach: They propose a framework for generalizable classification of human morals and values . they recommend a classification strategy that scores all related concepts simultaneously .
Outcome: The proposed method outperforms fine-tuned models across domains and frameworks.
UCL-Bench: A Chinese User-Centric Legal Benchmark for Large Language Models (2025.findings-naacl)

Copied to clipboard

Challenge: Existing legal benchmarks focusing on knowledge and logic evaluate LLMs on various tasks in legal domain, but few have explored the practical application of LLM by actual users.
Approach: They propose a Chinese user-centric legal benchmark that aims to assess the practical application of LLMs by real users.
Outcome: The proposed model outperforms existing models on various tasks in legal domain but does not outperfect ChatGPT.
MLLM-Bench: Evaluating Multimodal LLMs with Per-sample Criteria (2025.naacl-long)

Copied to clipboard

Challenge: Existing evaluation methodologies for multimodal large language models are limited in evaluating objective queries without considering real-world user experiences.
Approach: They propose to evaluate multimodal large language models with per-sample criteria using potent MLLM as the judge.
Outcome: The proposed evaluation paradigm shows that it can be used to evaluate multimodal large language models with per-sample criteria.
LLM-Based Dialogue Labeling for Multiturn Adaptive RAG (2025.emnlp-industry)

Copied to clipboard

Challenge: Retrieval-Augmented Generation (RAG) models integrate large language models with external knowledge retrieval . however, building multi-turn RAG-based chatbots for real-world customer service requires additional complexities.
Approach: They propose methods to automatically generate labels for adaptive retrieval components using real customer-agent dialogue data.
Outcome: The proposed method generates labels for components using real customer-agent dialogue data.
EDU-CIRCUIT-HW: Evaluating Multimodal Large Language Models on Real-World University-Level STEM Student Handwritten Solutions (2026.findings-acl)

Copied to clipboard

Challenge: Multimodal Large Language Models (MLLMs) are a promising tool for traditional education but lack authentic and domain-specific benchmarks to accurately interpret student handwritten solutions.
Approach: They propose to use MLLMs to interpret unconstrained STEM student handwritten solutions with intertwined mathematical formulas, diagrams, and textual reasoning to bridge this gap.
Outcome: The proposed model can detect and rectify recognition errors with minimal human intervention on unseen student solutions.
Knowledge-Guided Cross-Topic Visual Question Generation (2024.lrec-main)

Copied to clipboard

Challenge: Existing methods for visual question generation use answers or question types as constraints to generate questions.
Approach: They propose a knowledge-guided cross-topic visual question generation task to generate unseen topics in cross-section scenarios.
Outcome: The proposed model outperforms baselines and can generate unseen topic-related questions in cross-topic scenarios.
SimRAG: Self-Improving Retrieval-Augmented Generation for Adapting Large Language Models to Specialized Domains (2025.naacl-long)

Copied to clipboard

Challenge: Retrieval-augmented generation (RAG) enhances the question answering abilities of large language models (LLMs) however, adapting general-purpose RAG systems to specialized fields poses unique challenges due to distribution shifts and limited access to domain-specific data.
Approach: They propose a method that equips large language models with joint capabilities of question answering and question generation for domain adaptation.
Outcome: Experiments on 11 datasets across three different domains verify the efficacy of SimRAG over baselines by 1.2%–8.6%.
IGenBench: Benchmarking the Reliability of Text-to-Infographic Generation (2026.acl-long)

Copied to clipboard

Challenge: Generated infographics may appear correct at first glance but contain easily overlooked issues, such as distorted data encoding or incorrect textual content.
Approach: They propose to evaluate reliability of text-to-infographic generation using IGenBench . they employ multimodal large language models to verify each question .
Outcome: The proposed framework decomposes reliability verification into atomic yes/no questions based on a taxonomy of 10 question types.
MPPO: Multi Pair-wise Preference Optimization for LLMs with Arbitrary Negative Samples (2025.coling-main)

Copied to clipboard

Challenge: Existing preference optimization methods such as DPO and KTO are inherently derived from PPO, requiring a reference model that adds GPU memory resources and relies heavily on abundant preference data.
Approach: They propose an algorithm that leverages the average likelihood of model responses to fit the reward function and maximizes the utilization of preference data.
Outcome: The proposed algorithm outperforms DPO, ORPO, and SimPO on MT-Bench and Arena-Hard.
MMCLIP: Cross-Modal Attention Masked Modelling for Medical Language-Image Pre-Training (2026.acl-long)

Copied to clipboard

Challenge: Existing vision-and-language pretraining methods face challenges in reconstructing pathological features due to limited data.
Approach: They propose a method that uses masked modeling to enhance visual and linguistic learning.
Outcome: MMCLIP integrates unpaired data through disease-kind prompts to achieve state-of-the-art performance in zero-shot and fine-tuning across five benchmarks.
Boosting Inference Efficiency: Unleashing the Power of Parameter-Shared Pre-trained Language Models (2023.findings-emnlp)

Copied to clipboard

Challenge: Parameter-shared pre-trained language models (PLMs) have emerged as a successful approach in resource-constrained environments.
Approach: They propose a method to enhance the inference efficiency of parameter-shared PLMs by pre-training models that can achieve even greater acceleration.
Outcome: The proposed method improves inference efficiency on autoregressive and autoencoding models.
Reasoning While Asking: Transforming Reasoning Large Language Models from Passive Solvers to Proactive Inquirers (2026.acl-long)

Copied to clipboard

Challenge: Existing reasoning-oriented LLMs lack a blind self-thinking paradigm . current models fail to recognize when their reasoning is underinformed or based on ambiguous user instructions .
Approach: They propose a new reasoning paradigm that transforms LLMs into proactive inquirers that interleave reasoning with clarification.
Outcome: The proposed model outperforms baseline models on mathematical reasoning, code generation, and document editing.
Detecting Knowledge Boundary of Vision Large Language Models by Sampling-Based Inference (2025.emnlp-main)

Copied to clipboard

Challenge: Existing methods to detect the knowledge boundary of Vision Large Language Models (VLLMs) are expensive and require indiscriminate retrieval to address questions that require real-time information or are knowledge-intensive.
Approach: They propose a method that fine-tunes a VLLM on an automatically constructed dataset for boundary identification.
Outcome: The proposed method reduces indiscriminate retrieval while maintaining or improving the performance of a VLLM on an automatically constructed dataset.
Tailor: A Soft-Prompt-Based Approach to Attribute-Based Controlled Text Generation (2023.acl-long)

Copied to clipboard

Challenge: Existing work focuses on generating sentences satisfying pre-specified attributes such as topic and sentiment, yet suffers from increases in storage and inference time.
Approach: They propose a method that uses a pre-trained continuous vector to generate a fixed pre-trainable language model to satisfy a specified attribute.
Outcome: The proposed model can achieve improvements on eleven attribute-specific generation tasks with 0.08% extra training parameters.
ViDoRAG: Visual Document Retrieval-Augmented Generation via Dynamic Iterative Reasoning Agents (2025.emnlp-main)

Copied to clipboard

Challenge: Existing benchmarks focus on image-based question answering (QA) but ignore the fundamental challenges of efficient retrieval, comprehension, and reasoning within dense visual documents.
Approach: They propose a novel multi-agent RAG framework tailored for complex reasoning across visual documents that employs a Gaussian Mixture Model (GMM)-based hybrid strategy to handle multi-modal retrieval.
Outcome: The proposed framework outperforms existing methods by over 10% on the competitive ViDoSeek benchmark.
Multi-Value-Product Retrieval-Augmented Generation for Industrial Product Attribute Value Identification (2025.emnlp-industry)

Copied to clipboard

Challenge: Existing methods for product attribute value identification suffer from cascading errors and lack of generalization capability.
Approach: They propose a multi-level retrieval scheme that uses products and attribute values as distinct hierarchical levels in PAVI domain.
Outcome: The proposed method performs better than the state-of-the-art methods on a real-world industrial dataset.
An Analysis and Mitigation of the Reversal Curse (2024.emnlp-main)

Copied to clipboard

Challenge: Recent research observes a phenomenon in large language models called the "reversal curse" when dealing with two entities, LLMs excel in handling sequences in the form of "aRb" but when asked "who is Mary Lee Pfeiffer's son?" the LLM exhibits considerable confusion and fails to provide a as the answer .
Approach: They conduct the first-ever study of how the reversal curse happens in large language models . they find that LLMs excel in handling sequences in the form of "aRb" but struggle to provide a satisfactory answer when asked "who is Mary Lee Pfeiffer's son?"
Outcome: The proposed study shows that the reversal curse can stem from specific training objectives . the study also shows that a reverse query can be difficult to understand .
𝒮2IT: Stepwise Syntax Integration Tuning for Large Language Models in Aspect Sentiment Quad Prediction (2025.findings-naacl)

Copied to clipboard

Challenge: Aspect Sentiment Quad Prediction (ASQP) is an extractive task that focuses on predicting tuples of sentiment-related elements from a given text.
Approach: They propose a stepwise syntax integration tuning framework that integrates syntactic structure knowledge into LLMs through a multi-step tuning process.
Outcome: The proposed framework integrates syntactic structure knowledge into large language models . it decomposes the quadruple generation task into two stages . the proposed framework significantly improves state-of-the-art performance across multiple datasets .
Beyond Prompt Engineering: A Systematic Analysis of Prompt Lexical Sensitivity and Its Impacts on Quality (2026.findings-acl)

Copied to clipboard

Challenge: Existing studies on prompt engineering have focused on optimizing models for performance under stylistic perturbations.
Approach: They conduct the first analysis of n-gram token-level mechanisms . they find that higher average performance is inherently associated with lower variance and greater stability.
Outcome: The proposed model reduces the variance of the generated code by 40% . the proposed model is based on a large-scale dataset of 132,000 prompt variants .
Retrieve-Plan-Generation: An Iterative Planning and Answering Framework for Knowledge-Intensive LLM Generation (2024.emnlp-main)

Copied to clipboard

Challenge: Large language models (LLMs) often produce factual errors due to limited internal knowledge.
Approach: They propose a retrieval-augmented generation framework that generates plan tokens to guide subsequent generation.
Outcome: The proposed framework improves the accuracy of large language models with external knowledge sources.
Towards Universal Dialogue State Tracking (D18-1)

Copied to clipboard

Challenge: Existing approaches to dialogue state tracking are difficult to scale to large dialogue domains.
Approach: They propose a universal dialogue state tracker that is independent of the number of values and shares parameters across all slots.
Outcome: The proposed system significantly outperforms state-of-the-art approaches on two datasets.
A Word is Worth A Thousand Dollars: Adversarial Attack on Tweets Fools Stock Prediction (2022.naacl-main)

Copied to clipboard

Challenge: Existing models are vulnerable to adversarial attacks, but their vulnerability is underexplored.
Approach: They propose to concatenate a perturbed but semantically similar tweet into a model that fools stock prediction models.
Outcome: The proposed method achieves consistent success rates and causes significant monetary loss in trading simulation by simply concatenating a perturbed but semantically similar tweet.
Towards Robustness of Text-to-SQL Models against Synonym Substitution (2021.acl-long)

Copied to clipboard

Challenge: Existing text-to-SQL models rely on lexical matching between words in NL questions and tokens in table schemas, which may break the schema linking mechanism.
Approach: They propose a human-curated dataset for text-to-SQL translation . they replace schema-related words with manually selected synonyms .
Outcome: The proposed model outperforms its counterparts without the defense.
The Security Threat of Compressed Projectors in Large Vision-Language Models (2025.findings-emnlp)

Copied to clipboard

Challenge: Mainstream VLPs have significant security implications, but their security implications have not been thoroughly examined.
Approach: a study evaluates the security of visual language projectors by comparing them to uncompressed projector.
Outcome: The evaluation reveals significant differences in security profiles between compressed and uncompressed projectors.
Adaptive Textual Label Noise Learning based on Pre-trained Models (2023.findings-emnlp)

Copied to clipboard

Challenge: Existing approaches to learning with noisy labels are limited due to the time and labor costs involved.
Approach: They propose an adaptive warm-up and hybrid training frameworks to learn with noisy labels based on pre-trained models.
Outcome: The proposed approach performs comparable or even surpasses state-of-the-art methods in various noise scenarios, including scenarios with the mixture of multiple types of noise.
MMLU-ProX: A Multilingual Benchmark for Advanced Large Language Model Evaluation (2025.emnlp-main)

Copied to clipboard

Challenge: Existing large language model evaluation benchmarks focus on English, while current multilingual tasks lack parallel questions that specifically assess cross-lingual reasoning abilities.
Approach: They propose a comprehensive benchmark covering 29 languages, built on an English benchmark.
Outcome: The MMLU-ProX is a comprehensive benchmark covering 29 languages, built on an English benchmark.
Experiential Co-Learning of Software-Developing Agents (2024.acl-long)

Copied to clipboard

Challenge: Recent advances in large language models (LLMs) have brought significant changes to various domains, especially through autonomous agents.
Approach: They propose a framework that lets agents learn shortcuts from their past tasks and use them for future task execution.
Outcome: The proposed framework enables agents to tackle unseen software-developing tasks more effectively.
ViLBench: A Suite for Vision-Language Process Reward Modeling (2025.emnlp-main)

Copied to clipboard

Challenge: Despite its advantages, evaluation on PRMs remains less explored, especially in the multimodal domain.
Approach: They propose to benchmark vision large language models as output reward models and process reward models as process-supervised reward models.
Outcome: The proposed model outperforms both ORM and PRM on vision-language benchmarks and achieves an average improvement of 3.3% over standard CoT and up to 2.5% over its untrained counterpart on ViLBench.
Automatic Song Translation for Tonal Languages (2022.findings-acl)

Copied to clipboard

Challenge: Existing automatic song translation systems for tonal languages do not match the number of notes and beat the original rhythm of the song.
Approach: They propose three criteria for effective AST: preserving meaning, singability and intelligibility.
Outcome: The proposed system balances semantics and singability with human evaluations.
League of LLMs: A Benchmark-Free Paradigm for Mutual Evaluation of Large Language Models (2026.acl-long)

Copied to clipboard

Challenge: Large language models (LLMs) have shown exceptional capabilities across a wide range of tasks, but reliable evaluation remains a challenge due to data contamination, opaque operation, and subjective preferences.
Approach: They propose a benchmark-free evaluation paradigm that organizes multiple LLMs into a self-governed league for multi-round mutual evaluation.
Outcome: Experiments on eight mainstream LLMs in mathematics and programming show that the proposed model can distinguish capabilities while maintaining high internal ranking stability.
Domain-Specific Data Generation Framework for RAG Adaptation (2026.findings-acl)

Copied to clipboard

Challenge: Retrieval-Augmented Generation (RAG) combines the language understanding and reasoning capabilities of large language models (LLMs) with external retrieval to produce domain-grounded responses.
Approach: They propose a scalable and modular data-centric framework for generating domain-grounded question–answer–context triples tailored to diverse RAG adaptation strategies.
Outcome: The proposed framework generates domain-grounded question–answer–context triples for multiple RAG adaptation strategies.
LLaSE-G1: Incentivizing Generalization Capability for LLaMA-based Speech Enhancement (2025.acl-long)

Copied to clipboard

Challenge: Recent advances in language models have demonstrated strong capabilities in semantic understanding and contextual modeling.
Approach: They propose a LLaMA-based language model that incentivizes generalization capabilities for speech enhancement.
Outcome: The proposed language model outperforms prior task-specific discriminative and generative models in acoustic enhancement tasks.
Towards Fine-grained Audio Captioning with Multimodal Contextual Fusion (2026.acl-long)

Copied to clipboard

Challenge: Existing methods for audio captioning lack fine-grained detail and contextual accuracy due to limited unimodal or superficial information.
Approach: They propose a two-stage automated pipeline that uses pretrained models to extract contextual cues from video . a large language model synthesizes these inputs to generate detailed and context-aware captions .
Outcome: The proposed method is scalable and generates detailed and context-aware captions on large-scale audio datasets.
Infusing Sequential Information into Conditional Masked Translation Model with Self-Review Mechanism (2020.coling-main)

Copied to clipboard

Challenge: Existing non-autoregressive models generate target words in parallel, but with a large latency due to the left-to-right dependency.
Approach: They propose to train a conditional masked translation model and refine results within several iterations to remedy a flawed translation by non-autoregressive models.
Outcome: The proposed model outperforms state-of-the-art models by over 1 BLEU while using less training computations.
On the Generation of Medical Dialogs for COVID-19 (2021.acl-short)

Copied to clipboard

Challenge: under the pandemic of COVID-19, people experiencing COVI D19-related symptoms have a pressing need to consult doctors.
Approach: They develop a medical dialog system that can provide COVID19-related consultations . they use two dialog datasets containing conversations between doctors and patients .
Outcome: The proposed system can provide COVID19-related consultations, but is too small compared with general-domain dialog datasets.
Prompt-learning for Fine-grained Entity Typing (2022.findings-emnlp)

Copied to clipboard

Challenge: Extensive experiments on fine-grained entity typing under fully supervised, few-shot, and zero-shot settings show the effectiveness of prompt-learning.
Approach: They propose a prompt-learning pipeline that stimulates versatile knowledge of pre-trained language models (PLMs) by constructing entity-oriented verbalizers and templates and conducting masked language modeling.
Outcome: The proposed approach can be applied to fine-grained entity typing in fully supervised, few-shot, and zero-shot scenarios.
Enhancing Chain-of-Thought Reasoning with Critical Representation Fine-tuning (2025.acl-long)

Copied to clipboard

Challenge: Representation Fine-tuning (ReFT) is a proposed method for improving parameter efficiency . however, it yields suboptimal performance, as fixed-position representations have uncertain impact on outputs .
Approach: They propose a method that fine-tunes critical representations in a low-rank linear subspace while freezing the base model.
Outcome: The proposed method improves accuracy of LLaMA-2-7B and ReFT by 18.2 and 3.8 on GSM8K.
Developing a Reliable, Fast, General-Purpose Hallucination Detection and Mitigation Service (2025.naacl-industry)

Copied to clipboard

Challenge: Hallucination is a problem in large language models that produce incorrect output . authors propose a reliable and high-speed production system to detect and rectify hallucinations .
Approach: They propose a high-speed production system that detects hallucinations in LLMs . they propose NER, natural language inference, span-based detection and a rewriting mechanism .
Outcome: The proposed system detects a wide range of hallucinations in LLM responses.
Let LLMs Take on the Latest Challenges! A Chinese Dynamic Question Answering Benchmark (2025.coling-main)

Copied to clipboard

Challenge: Recent work has noted that due to the extremely high cost of iterative updates of LLMs, they are often unable to answer dynamic questions well.
Approach: They propose a Chinese Dynamic QA benchmark containing question-answer pairs related to the latest dynamic questions on the Chinese Internet.
Outcome: The proposed benchmark will be one of the key data resources for improving LLMs’ Chinese question-answering ability in the future.
To Paraphrase or Not: Efficient Comment Detoxification with Unsupervised Detoxifiability Discrimination (2026.eacl-short)

Copied to clipboard

Challenge: Existing methods for detoxification of toxic comments are limited by overcorrection and data scarcity . experimental results show that DID outperforms existing methods on academic data and an industrial platform .
Approach: They propose a paradigm that adaptively conducts filtering or paraphrasing for each toxic comment based on its detoxifiability . they propose 'detoxifiabilities-aware detoxification' that can be trained to filter or paraphrase toxic comments based upon their detoxifikatability based only on detoxificable comments .
Outcome: Experimental results show that DID outperforms existing methods on academic and industrial data.
Towards Preference Following in Tool Calling Language Agents (2026.findings-acl)

Copied to clipboard

Challenge: Currently, large language model (LLM)-based agents can't follow user preferences when calling tools.
Approach: They propose a benchmark to evaluate agents' ability to identify personalized user preferences from interaction histories and to adhere to these preferences when calling tools.
Outcome: The proposed model achieves 51.16% accuracy on the APOLLO benchmark, while GPT-4o achieves only 51.13% accuracy.
TREA: Tree-Structure Reasoning Schema for Conversational Recommendation (2023.acl-long)

Copied to clipboard

Challenge: Recent reasoning-based models cannot fully figure out complex causal relationships between mentioned entities with external knowledge.
Approach: They propose a Tree structure Reasoning schEmA that constructs a multi-hierarchical scalable tree as the reasoning structure to clarify the causal relationships between mentioned entities.
Outcome: Extensive experiments on two public CRS datasets show the proposed model works.
VSCBench: Bridging the Gap in Vision-Language Model Safety Calibration (2025.findings-acl)

Copied to clipboard

Challenge: Existing safety calibration methods focus on model undersafety, where the model responds to hazardous queries, while neglecting oversafetiness, where models refuse to answer safe queries.
Approach: They propose safety calibration which addresses both undersafety and oversafetiness by comparing model responses to a novel dataset of 3,600 image-text pairs.
Outcome: The proposed methods have been used to evaluate safety calibration across image-centric and text-centric scenarios.
Evaluating the Expressive Appropriateness of Speech in Rich Contexts (2026.acl-long)

Copied to clipboard

Challenge: Existing methods for evaluating expressive speech focus on word accuracy, naturalness, signal quality, or emotional intensity at the utterance level.
Approach: They propose a framework for Evaluating Expressive Appropriateness in speech that assesses whether a speech sample aligns with the underlying communicative intent implied by its discourse-level narrative context.
Outcome: The proposed framework outperforms existing speech evaluation and analysis systems on a human-annotated test set.
Counterfactual Inference for Text Classification Debiasing (2021.acl-long)

Copied to clipboard

Challenge: Existing methods to capture unintended dataset biases are expensive and require elaborate balancing strategies.
Approach: They propose a model-agnostic text classification debiasing framework which can effectively avoid employing data manipulations or designing balancing mechanisms.
Outcome: The proposed framework can effectively avoid data manipulations or designing balancing mechanisms to capture unintended dataset biases.
Exploiting Entity BIO Tag Embeddings and Multi-task Learning for Relation Extraction with Imbalanced Data (P19-1)

Copied to clipboard

Challenge: Existing methods to perform relation extraction are feature-based or kernel-based, but the results of our study show that they can improve the performance of a baseline model with more than 10% absolute increase in F1-score.
Approach: They propose a multi-task architecture which jointly trains a model to perform relation identification with cross-entropy loss and relation classification with ranking loss.
Outcome: The proposed model outperforms the state-of-the-art models on ACE 2005 Chinese and English corpus and significantly improves the performance of a baseline model with more than 10% increase in F1-score.
Advancing Reasoning in Diffusion Language Models with Denoising Process Rewards (2026.acl-long)

Copied to clipboard

Challenge: Existing methods for improving reasoning in diffusion language models rely on outcome-based rewards that provide no direct supervision over the denoising process.
Approach: They propose a method that provides a process-level reinforcement signal over denoising trajectory of diffusion language models.
Outcome: Experiments on challenging reasoning benchmarks show that the proposed model improves reasoning stability, interpretability and overall performance.
Syntax Matters: Towards Spoken Language Understanding via Syntax-Aware Attention (2023.findings-emnlp)

Copied to clipboard

Challenge: Existing studies on SLU systems have focused on integrating syntactic information into language models.
Approach: They propose a model where attention scopes are constrained based on syntactic relationships.
Outcome: The proposed model improves on three datasets and can be integrated into other language models to further boost their performance.
Where Did It Go Wrong? Capability-Oriented Failure Attribution for Vision-and-Language Navigation Agents (2026.findings-acl)

Copied to clipboard

Challenge: Existing testing methods are system-level and provide limited insight into which capability deficiencies cause task failures.
Approach: They propose a capability-oriented testing approach that enables failure detection and attribution by seed selection and mutation.
Outcome: The proposed method detects more failure cases and pinpoints capability-level deficiencies than state-of-the-art baselines, providing more interpretable and actionable guidance for improving embodied agents.
Tool learning via Inference-time Scaling and Cycle Verifier (2025.findings-acl)

Copied to clipboard

Challenge: In inference-time scaling, Chain-of-Thought (CoT) data is scarce or even unavailable.
Approach: They propose a method which establishes an inference cycle to synthesize user queries and CoT data.
Outcome: The proposed method achieves a 75.4% pass rate and a 79.6% win rate using small models in StableToolBench.
Does Theory of Mind Improvement Really Benefit Human-AI Interactions? Empirical Findings from Interactive Evaluations (2026.findings-acl)

Copied to clipboard

Challenge: Existing benchmarks measure ToM capability improvement through story-reading, multiple-choice questions from a third-person perspective, while ignoring the first-person, dynamic nature of human-AI interactions.
Approach: They propose a new paradigm of interactive ToM evaluation with both perspective and metric shifts.
Outcome: The proposed approach improves the performance of four representative LLM enhancement techniques using real-world datasets and a user study.
Game on Tree: Visual Hallucination Mitigation via Coarse-to-Fine View Tree and Game Theory (2024.emnlp-main)

Copied to clipboard

Challenge: Large vision-language models produce unfaithful visual hallucinations, also known as visual halluinations, which hinders their application in multimodal understanding and decision-making.
Approach: They propose a plug-and-play train-free decoding algorithm for mitigating visual hallucinations . they leverage visual information to construct a coarse-to-fine visual view tree .
Outcome: The proposed algorithm reduces visual hallucinations (VH) by leveraging visual information to construct a coarse-to-fine visual view tree (CFTree)
Deep-Reporter: Deep Research for Grounded Multimodal Long-Form Generation (2026.acl-long)

Copied to clipboard

Challenge: Recent agentic search frameworks are text-centric, overlooking multimodal evidence . a pressing task is multimodal long-form generation, a new paper argues .
Approach: They propose a unified agentic framework for grounded multimodal long-form generation.
Outcome: The proposed framework is based on a unified agentic framework for grounded multimodal long-form generation.
GUI Agents: A Survey (2025.findings-acl)

Copied to clipboard

Challenge: Large Foundation Models (LFMs) have transformed the landscape of AI research and day-to-day life.
Approach: They propose a framework that delineates GUI agents' perception, reasoning, planning, and acting capabilities.
Outcome: The proposed framework delineates their perception, reasoning, planning, and acting capabilities.
Non-Parametric Domain Adaptation for End-to-End Speech Translation (2022.emnlp-main)

Copied to clipboard

Challenge: End-to-end speech translation (E2E-ST) systems have received increasing attention due to its less error propagation, lower latency and fewer parameters.
Approach: They propose a non-parametric method that leverages in-domain text translation corpus to achieve domain adaptation for E2E-ST systems.
Outcome: The proposed method outperforms the existing in-domain fine-tuning strategies on the Europarl-ST benchmark.
Sparse Progressive Distillation: Resolving Overfitting under Pretrain-and-Finetune Paradigm (2022.acl-long)

Copied to clipboard

Challenge: Conventional wisdom in pruning Transformer-based language models is that it reduces model expressiveness, but new research shows pruning increases risk of overfitting when performed at the fine-tuning phase.
Approach: They propose to reduce pruning risk under pretrain-and-finetune paradigm . they propose to use knowledge distillation to improve pruning performance .
Outcome: The proposed method outperforms the leading competitors on the GLUE benchmark.
SLIM: Subtrajectory-Level Elimination for More Effective Reasoning (2025.findings-emnlp)

Copied to clipboard

Challenge: Notable examples include OpenAI’s o1/o3/o4 series and DeepSeek-R1 .
Approach: They develop a framework to identify suboptimal subtrajectories based on human-established criteria . they also use a sampling algorithm to select data whose reasoning process is free from suboptimally subtravertories to the highest degree .
Outcome: The proposed method reduces the number of suboptimal subtrajectories by 25.9% during the inference process.
Can Large Language Models Translate Spoken-Only Languages through International Phonetic Transcription? (2025.emnlp-main)

Copied to clipboard

Challenge: Existing research on spoken-only languages has focused on low-resource languages . spoken- only languages are among the most vulnerable to extinction .
Approach: They propose a unified language understanding framework that learns to translate spoken-only languages via in-context learning.
Outcome: The proposed framework can translate spoken-only languages into high-resource languages using phonetic transcription and automatic dictionary construction and knowledge retrieval.
MIND: A Large-scale Dataset for News Recommendation (2020.acl-main)

Copied to clipboard

Challenge: Personalized news recommendation is an important technique for personalized news service.
Approach: They propose to build a large-scale news recommendation dataset from Microsoft News . they demonstrate that news recommendation relies on the quality of news content understanding .
Outcome: The proposed dataset contains 1 million users and more than 160k English news articles, each of which has rich textual content such as title, abstract and body.
QAVA: Query-Agnostic Visual Attack to Large Vision-Language Models (2025.naacl-long)

Copied to clipboard

Challenge: Currently, large vision-language models are limited in their ability to provide correct answers for multimodal tasks . however, they can still provide correct responses for multiple images associated with a single image . a query-agnostic visual attack (QAVA) provides robust adversarial examples that generate incorrect responses to unspecified and unknown questions.
Approach: They propose a query-agnostic visual attack to create adversarial examples that generate incorrect answers to unspecified and unknown questions.
Outcome: The proposed model improves performance on images when the question is unknown compared to known target questions .
Defense against Prompt Injection Attacks via Mixture of Encodings (2025.naacl-short)

Copied to clipboard

Challenge: Large Language Models (LLMs) have emerged as a dominant approach for a wide range of NLP tasks, but external content embeds malicious instructions that manipulate the LLM’s output.
Approach: They propose a mixture of encodings defense mechanism which utilizes multiple character encodes to degrade LLM performance on certain NLP tasks.
Outcome: The proposed method achieves one of the lowest attack success rates under prompt injection attacks while maintaining high performance across all NLP tasks.
URO-Bench: Towards Comprehensive Evaluation for End-to-End Spoken Dialogue Models (2025.findings-emnlp)

Copied to clipboard

Challenge: a lack of comprehensive evaluations for SDMs in speech-to-speech (S2S) scenarios is a major challenge for end-to end spoken dialogue models.
Approach: They propose to provide an extensive evaluation framework for end-to-end spoken dialogue models (SDMs) that includes both cognitive dimensions and paralinguistic cues .
Outcome: The proposed benchmark is divided into two difficulty levels: basic track and pro track, each comprising 20 test sets, evaluating the spoken dialogue model’s abilities in U**nderstanding, **R**easoning, and **O**ral conversation.
Conditional Memory via Scalable Lookup: A New Axis of Sparsity for Large Language Models (2026.acl-long)

Copied to clipboard

Challenge: Mixture-of-Experts (MoE) scales capacity via conditional computation, but lacks knowledge lookup primitive.
Approach: They propose a conditional memory instantiated via Deep Sparse Embedding (DSE) they propose 'u-shaped scaling law' that identifies optimal balance between MoE experts and DSE memory .
Outcome: The proposed model outperforms an iso-parameter and isoFLOPs MoE baseline across knowledge and reasoning benchmarks and is infrastructure-efficient.
Don’t be Contradicted with Anything! CI-ToD: Towards Benchmarking Consistency for Task-oriented Dialogue System (2021.emnlp-main)

Copied to clipboard

Challenge: Consistency Identification has been used for preventing inconsistent response generation, but few efforts have been made to task-oriented dialogue.
Approach: They propose a dataset for Consistency Identification in task-oriented dialog system.
Outcome: The proposed dataset is based on a single label and provides fine-grained labels to encourage model to know what inconsistent sources lead to it.
Revealing the Deceptiveness of Knowledge Editing: A Mechanistic Analysis of Superficial Editing (2025.acl-long)

Copied to clipboard

Challenge: Existing knowledge editing algorithms are prone to generating original knowledge . despite the fact that many models achieve near-perfect performance, superficial editing remains a challenge .
Approach: They propose to use "**superficial editing**" to describe the phenomenon . they investigate the internal mechanisms of the attention module and their corresponding left singular vectors .
Outcome: The proposed method can modify specific knowledge in a pretrained large language model while ensuring that unrelated knowledge remains unaffected.
Exploring the Choice Behavior of Large Language Models (2025.findings-acl)

Copied to clipboard

Challenge: Large Language Models (LLMs) are increasingly being adopted across various domains where they help to make choices.
Approach: They construct a virtual QA platform that includes three different experimental conditions, with four models from GPT and Llama series participating in repeated experiments.
Outcome: The proposed model includes three experimental conditions and four models from GPT and Llama series.
APEX: Learning Adaptive Priorities for Multi-Objective Alignment in Vision-Language Generation (2026.findings-acl)

Copied to clipboard

Challenge: APEX optimizes for text-to-image generation by combining learning potential, conflict penalty, and progress need.
Approach: They propose an algorithm that stabilizes heterogeneous rewards and dynamically schedules objectives . they propose a method that achieves better Pareto trade-offs across four heterogenous objectives based on P3 Adaptive Priorities .
Outcome: The proposed algorithm achieves better pareto trade-offs across four heterogeneous objectives while maintaining competitive OCR accuracy.
GL-CLeF: A Global–Local Contrastive Learning Framework for Cross-lingual Spoken Language Understanding (2022.acl-long)

Copied to clipboard

Challenge: Existing approaches to zero-shot cross-lingual spoken language understanding rely on shared parameters, which can only perform implicit alignment across languages.
Approach: They propose a global-local contrastive learning framework to achieve a fine-grained cross-lingual transfer . they employ bilingual dictionaries to construct multilingual views of the same utterance .
Outcome: Experiments on MultiATIS++ show that GL-CLeF achieves the best performance . GL is based on dictionaries and encourages representations to be more similar than negative example pairs .
Knowledge Mechanisms in Large Language Models: A Survey and Perspective (2024.findings-emnlp)

Copied to clipboard

Challenge: Using large language models, we can understand knowledge mechanisms in LLMs for learning, storage, utilization, and evolution.
Approach: They propose to analyze knowledge mechanisms in Large Language Models (LLMs) they examine utilization, evolution, and the potential dark knowledge (hypothesis) they hope to help understand knowledge in LLMs and provide insights for future research .
Outcome: The proposed model can be used to analyze the evolution of parametric knowledge in LLMs.
RaFe: Ranking Feedback Improves Query Rewriting for RAG (2024.findings-emnlp)

Copied to clipboard

Challenge: Large Language Models (LLMs) and Retrieval Augmentation Generation (RAG) techniques have evolved to enhance document retrieval by reformulating queries.
Approach: They propose a framework for training query rewriting models that leverages a reranker framework.
Outcome: The proposed framework provides ranking feedback aligned well with the rewriting objectives without needing signals from annotations and supports both online and offline training models.
CBLUE: A Chinese Biomedical Language Understanding Evaluation Benchmark (2022.acl-long)

Copied to clipboard

Challenge: a new benchmark for biomedical language understanding is being developed in Chinese . most benchmarks are limited to English, which makes it difficult to replicate success in other languages.
Approach: They propose to use Chinese biomedical language understanding evaluation benchmarks to evaluate Chinese models.
Outcome: The proposed benchmarks show that the current models perform worse than the human ceiling.
Harnessing the Power of Large Language Model for Uncertainty Aware Graph Processing (2024.lrec-main)

Copied to clipboard

Challenge: Existing methods for graph processing rely on assumptions about data relations that are inadequate when handling large and complex graph data.
Approach: They propose a large language model enhanced by an uncertainty-aware module to provide a confidence score on the generated graph data.
Outcome: The proposed approach surpasses state-of-the-art algorithms by a substantial margin on ten datasets.
iPET: An Interactive Emotional Companion Dialogue System with LLM-Powered Virtual Pet World Simulation (2025.acl-demo)

Copied to clipboard

Challenge: Existing approaches to role-playing emotional companion products lack sustained personalization and contextual adaptability, limiting their effectiveness in real-world settings.
Approach: They propose a virtual pet agent that can enhance user engagement through rich, dynamic pet behaviors and interactions tailored to individual preferences.
Outcome: The proposed system has been deployed in a real-world, non-commercial product for 200 days and has demonstrated its effectiveness in practical applications.
Rethinking Zero-shot Neural Machine Translation: From a Perspective of Latent Variables (2021.findings-emnlp)

Copied to clipboard

Challenge: Existing methods to achieve zero-shot translation suffer from spurious correlations between output language and language invariant semantics.
Approach: They propose a method that denoizes the autoencoder objective based on pivot language into traditional training objective to improve translation accuracy on zero-shot directions.
Outcome: The proposed method eliminates spurious correlations and outperforms state-of-the-art methods on two benchmark machine translation datasets.
Reasoning with Graphs: Structuring Implicit Knowledge to Enhance LLMs Reasoning (2025.findings-acl)

Copied to clipboard

Challenge: Large language models (LLMs) have demonstrated remarkable success across a wide range of tasks, however, they still face challenges in reasoning tasks that require understanding and inferring relationships between distinct pieces of information within text sequences.
Approach: They propose to construct explicit graphs from context and leverage them to enhance LLM reasoning performance on reasoning tasks.
Outcome: Extensive experiments show that the proposed method improves both logical reasoning and multi-hop question answering tasks.
SynWorld: Virtual Scenario Synthesis for Agentic Action Knowledge Refinement (2025.acl-short)

Copied to clipboard

Challenge: Using Large Language Models (LLMs)-based agents can enhance their understanding of environments and tasks.
Approach: They propose a framework that allows agents to synthesize possible scenarios with multi-step action invocation within the action space and perform Monte Carlo Tree Search exploration to refine their action knowledge in the current environment.
Outcome: The proposed framework synthesizes possible scenarios with multi-step action invocation within the action space and performs Monte Carlo Tree Search exploration to refine action knowledge in the current environment.
MCAD: Multi-teacher Cross-modal Alignment Distillation for efficient image-text retrieval (2024.findings-naacl)

Copied to clipboard

Challenge: Large-scale visual-language pretraining models have shown remarkable capabilities in understanding both vision and language.
Approach: They propose a multi-teacher cross-modality alignment distillation technique to integrate the advantages of single-stream and dual-stream models.
Outcome: The proposed model is lightweight and has only 100M running memory and 8.0ms search latency.
Natural SQL: Making SQL Easier to Infer from Natural Language Specifications (2021.findings-emnlp)

Copied to clipboard

Challenge: Existing models that do not support executable SQL generation can generate executable queries.
Approach: They propose an SQL intermediate representation called Natural SQL (NatSQL) they propose to preserve the core functionalities of SQL while simplifying the queries .
Outcome: The proposed model outperforms existing models on a text-to-SQL benchmark . it significantly improves the performance of previous models on the same dataset .
What are the Desired Characteristics of Calibration Sets? Identifying Correlates on Long Form Scientific Summarization (2023.acl-long)

Copied to clipboard

Challenge: Summarization models are trained to maximize the likelihood of a single reference (MLE) but little is known about why one setup is more effective than another .
Approach: They add a calibration step which exposes a model to its own ranked outputs to improve relevance or contrasts positive and negative sets to improve faithfulness.
Outcome: The proposed calibration step can unlock large gains in relevance or faithfulness.
Datasets and Recipes for Video Temporal Grounding via Reinforcement Learning (2025.emnlp-industry)

Copied to clipboard

Challenge: Existing methods for video temporal grounding suffer from limited temporal awareness and poor generalization.
Approach: They propose a two-stage training framework that integrates supervised fine-tuning with reinforcement learning to improve both the accuracy and robustness of VTG models.
Outcome: The proposed training framework outperforms existing models on multiple benchmarks on open-domain and challenging scenarios.
Your Stereotypical Mileage May Vary: Practical Challenges of Evaluating Biases in Multiple Languages and Cultural Contexts (2024.lrec-main)

Copied to clipboard

Challenge: Recent studies have identified a gap in the availability of tools and resources to study bias in languages other than English and social contexts outside the north of America.
Approach: They use stereotypes to build a corpus of sentence pairs that cover biases in seven cultural contexts.
Outcome: The proposed resource covers a wide range of languages and cultural settings . it favors sentences that express stereotypes in most bias categories .
Detecting RAG Extraction Attack via Dual-Path Runtime Integrity Game (2026.acl-long)

Copied to clipboard

Challenge: Retrieval-Augmented Generation (RAG) systems augment large language models with external knowledge, but introduce a critical security vulnerability: Knowledge Base Leakage.
Approach: They propose a runtime defense mechanism inspired by stack canaries in software security . canaryRAG embeds carefully designed canary tokens into retrieved chunks and reformulates RAG extraction defense as a dual-path runtime integrity game.
Outcome: The proposed system can detect and prevent RAG Knowledge Base Leakage in real time . it can be integrated into arbitrary RAG pipelines without retraining or structural modifications .
Divide-Then-Align: Honest Alignment based on the Knowledge Boundary of RAG (2025.acl-long)

Copied to clipboard

Challenge: Large language models (LLMs) augmented with retrieval systems have significantly advanced natural language processing tasks by integrating external knowledge sources.
Approach: They propose a method that conditions large language models to generate answers even in the absence of reliable knowledge.
Outcome: The proposed approach balances accuracy with appropriate abstention, enhancing the reliability and trustworthiness of retrieval-augmented systems.
Concise and Organized Perception Facilitates Reasoning in Large Language Models (2025.findings-naacl)

Copied to clipboard

Challenge: Extensive experimental results on several popular logical benchmarks (ProofWriter, PrOntoQA, PrONtoQA-OOD, and FOLIO) and mathematical benchmark (DI-GSM) show that COP significantly outperforms previous state-of-the-art methods.
Approach: They propose a reasoning approach called Concise and Organized Perception (COP) that carefully analyzes the given statements to identify the most pertinent information while eliminating redundancy efficiently.
Outcome: The proposed approach outperforms state-of-the-art methods on several popular logical benchmarks and mathematical benchmarks.
From Awareness to Adaptability: Enhancing Tool Utilization for Scientific Reasoning (2025.findings-acl)

Copied to clipboard

Challenge: Existing approaches enhance reasoning through Chain-of-Thought, Program-ofThough, and Tool-Integration.
Approach: They propose a tool-awareness training method that leverages both forward and backward data generation strategies to strengthen the model’s conscious and selective tool utilization in multi-step reasoning tasks.
Outcome: The proposed method improves the model's tool utilization capabilities, including proactivity and execution success rates.
Less Languages, Less Tokens: An Efficient Unified Logic Cross-lingual Chain-of-Thought Reasoning Framework (2026.acl-long)

Copied to clipboard

Challenge: Existing methods for cross-lingual chain-of-thought (XCoT) with self-consistency are costly due to extensive sampling of full trajectories across languages.
Approach: They propose a cross-lingual chain-of-thought framework that minimizes redundancy in token usage and latency.
Outcome: Experiments on polymath show that UL-XCoT reduces decoding token costs and latency by 50% . UL XCot also aggregates remaining high-quality reasoning paths via voting .
Gen-SQL: Efficient Text-to-SQL By Bridging Natural Language Question And Database Schema With Pseudo-Schema (2025.coling-main)

Copied to clipboard

Challenge: Recent studies have shifted paradigms and leveraged Large Language Models (LLMs) to tackle the challenging task of Text-to-SQL.
Approach: They propose a framework that leverages large language models to generate SQL queries . they exploit prior knowledge from the LLM to enhance embedding-based retriever .
Outcome: The proposed method improves embedding-based retriever and reduces cost.
TextBox: A Unified, Modularized, and Extensible Framework for Text Generation (2021.acl-demo)

Copied to clipboard

Challenge: TextBox is an open-source text generation framework that is modularized and extensible.
Approach: They propose to provide a unified, modularized, and extensible text generation framework that implements 21 text generation models on 9 benchmark datasets.
Outcome: The proposed framework implements 21 models on 9 benchmark datasets and is available under the Apache License 2.0 license.
Graph Neural News Recommendation with Unsupervised Preference Disentanglement (2020.acl-main)

Copied to clipboard

Challenge: Existing methods to learn informative user and news representations fail to consider high-order connectivity underlying the user-news interactions.
Approach: They propose a novel Graph Neural News Recommendation model with Unsupervised Preference Disentanglement which can encode high-order relationships into user and news representations by information propagation along the graph.
Outcome: The proposed model can encode high-order relationships into user and news representations by information propagation along the graph and disentangle latent preference factors by a neighborhood routing algorithm.
Escaping the Sisyphus Dilemma: Experience Replay for Robust Text-to-Optimization Modeling (2026.findings-acl)

Copied to clipboard

Challenge: Existing retrieval-augmented strategies for large language models fail to capture dynamic reasoning required to resolve execution failures.
Approach: They propose a framework that implements Experience Replay to transform transient rectification steps into persistent knowledge.
Outcome: The proposed framework improves model accuracy by 8.45% on complex tasks while reducing token consumption by 28.65% and interaction turns by 25.82%.
Improving Retrieval Augmented Open-Domain Question-Answering with Vectorized Contexts (2024.findings-acl)

Copied to clipboard

Challenge: Retrieval Augmented Generation can be used to process long contexts in Open-Domain Question-Answering tasks.
Approach: They propose a method to cover longer contexts in Open-Domain Question-Answering tasks by using a small encoder language model and cross-attention with origin inputs.
Outcome: The proposed method can cover longer contexts while keeping the computing requirements close to the baseline.
SimulS2S-LLM: Unlocking Simultaneous Inference of Speech LLMs for Speech-to-Speech Translation (2025.acl-long)

Copied to clipboard

Challenge: Simultaneous speech translation (SST) outputs translations in parallel with streaming speech input, balancing translation quality and latency.
Approach: They propose to train LLMs offline and employ a test-time policy to guide simultaneous inference by extracting boundary-aware speech prompts that allow it to be better matched with text input data.
Outcome: The proposed model trains speech LLMs offline and employs a test-time policy to guide simultaneous inference.
Non-Parametric Unsupervised Domain Adaptation for Neural Machine Translation (2021.findings-emnlp)

Copied to clipboard

Challenge: kNN-MT is a non-parametric method that uses nearest neighbor retrieval to translate out-of-domain sentences, rare words, etc.
Approach: They propose a framework that directly uses in-domain monolingual sentences to build an effective datastore for k-nearest-neighbor retrieval.
Outcome: The proposed framework improves translation accuracy with target-side monolingual data while achieving comparable performance with back-translation.

What is GenGO?

GenGO is an NLP powered publication search system. It currenctly indexes 30k+ papers from ACL Anthology, and implements multi-aspect summarization, semantic search, and more!

Information

About
Limitations