Papers by Tong Xu

92 papers
Hallucination Diversity-Aware Active Learning for Text Summarization (2024.naacl-long)

Copied to clipboard

Challenge: Existing methods for alleviating hallucinations require costly human annotations . Existing approaches focus on a specific type of hallucinism, which limits their effectiveness .
Approach: They propose a method to detect hallucinations from errors in semantic frame, discourse and content verifiability in LLM summarization using HAllucination Diversity-Aware Sampling.
Outcome: The proposed framework reduces the need for costly human annotations to correct hallucinations in LLM outputs.
HATA: Trainable and Hardware-Efficient Hash-Aware Top-k Attention for Scalable Large Model Inference (2025.findings-acl)

Copied to clipboard

Challenge: Existing top-k attention methods struggle to strike a balance between efficiency and accuracy.
Approach: They propose a top-k attention approach that integrates low-overhead techniques into the Top-k Attention process to achieve 7.2 speedup compared to vanilla full attention.
Outcome: The proposed approach achieves 7.2 speedup compared to current top-k attention methods while maintaining model accuracy.
PunMemeCN: A Benchmark to Explore Vision-Language Models’ Understanding of Chinese Pun Memes (2025.emnlp-main)

Copied to clipboard

Challenge: Pun memes combine wordplay with visual elements to create humor, irony, or other rhetorical effects.
Approach: They propose a benchmark to assess Chinese pun memes' processing capabilities across three progressive tasks: pun meme detection, sentiment analysis, and chat-driven meme response.
Outcome: The proposed model can detect pun memes, analyze sentiments, and respond to chats, while ignoring homophone wordplay.
Improving Event Detection via Open-domain Trigger Knowledge (2020.acl-main)

Copied to clipboard

Challenge: Existing methods for event detecting are prone to overfitting densely labeled trigger words due to the small scale of training data.
Approach: They propose a novel Enrichment Knowledge Distillation model to leverage external open-domain trigger knowledge to reduce in-built biases to frequent trigger words in annotations.
Outcome: The proposed model outperforms nine strong baselines and is especially effective for unseen/sparsely labeled trigger words.
Modality Adaption or Regularization? A Case Study on End-to-End Speech Translation (2023.acl-short)

Copied to clipboard

Challenge: End-to-end speech translation models have limited training data and are often inefficient due to the inconsistency of length and representation between speech and text.
Approach: They find that the "modality gap" between speech and text data is not a major problem in E2E ST . they decouple the encoder to speech encoder and text encoder, and they find that there is a 'capacity gap'
Outcome: The proposed model achieves 29.0 for en-de and 40.3 for fr on the MuST-C dataset.
Bi-Drop: Enhancing Fine-tuning Generalization via Synchronous sub-net Estimation and Optimization (2023.findings-emnlp)

Copied to clipboard

Challenge: Pretrained language models can be fine-tuned on limited training data, which can overfit and thus diminish performance.
Approach: They propose a fine-tuning strategy that selectively updates model parameters using gradients from various sub-nets dynamically generated by dropout.
Outcome: The proposed method outperforms existing methods on the GLUE benchmark and exhibits excellent generalization ability and robustness for domain transfer, data imbalance, and low-resource scenarios.
Think Wider, Detect Sharper: Reinforced Reference Coverage for Document-Level Self-Contradiction Detection (2025.emnlp-main)

Copied to clipboard

Challenge: Recent approaches to document-level contradiction detection (DSCD) only gain marginal improvement and often introduce inconsistencies across repeated responses.
Approach: They propose a method that combines supervised fine-tuning and reinforcement learning to enhance document-level contradiction detection (DSCD) they propose to use a task-specific reward function to expand the model’s reasoning scope, boosting both accuracy and consistency.
Outcome: The proposed method significantly boosts Llama 3.1-8B-Instruct’s accuracy from 38.5% to 51.1%, and consistency from 59.6% to76.2%.
TensorOpera Router: A Multi-Model Router for Efficient LLM Inference (2024.emnlp-industry)

Copied to clipboard

Challenge: Large Language Models (LLMs) have demonstrated remarkable performance across a diverse set of domain-specific tasks.
Approach: They propose a non-monolithic LLM querying system that seamlessly integrates various LLM experts into a single query interface and dynamically routes incoming queries to the most high-performant expert based on query’s requirements.
Outcome: The proposed model improves query efficiency by 40% and costs by 30% while maintaining or enhancing model performance by 10%.
Generate-on-Graph: Treat LLM as both Agent and KG for Incomplete Knowledge Graph Question Answering (2024.emnlp-main)

Copied to clipboard

Challenge: Existing methods to integrate LLMs with Knowledge Graphs (KGs) however, these methods are often incomplete to cover all the knowledge required to answer questions.
Approach: They propose to integrate LLMs with Knowledge Graphs (KGs) to address insufficient knowledge and hallucination issues in Large Language Models.
Outcome: The proposed method outperforms existing methods on two datasets.
To Answer or Not to Answer (TAONA): A Robust Textual Graph Understanding and Question Answering Approach (2025.findings-emnlp)

Copied to clipboard

Challenge: Existing studies assume that generated answers integrate all relevant information from the textual graph.
Approach: They propose a novel GraphRAG model that integrates all relevant information from the textual graph into the generated answer.
Outcome: Extensive experiments validate TAONA’s superior performance for both A-side and B-side tasks.
One QuantLLM for ALL: Fine-tuning Quantized LLMs Once for Efficient Deployments (2025.acl-long)

Copied to clipboard

Challenge: Quantization has shown promise for Large Language Models, but current methods require lengthy training to alleviate quantization loss.
Approach: They propose to decouple weights and incorporate Low-Rank adapters to reduce weight sharing . they validate the approach on LLaMA2 families and Mistral on downstream evaluation .
Outcome: The proposed approach shows high performance while reducing deployment time faced with multiple scenarios.
DetGPT: Detect What You Need via Reasoning (2023.emnlp-main)

Copied to clipboard

Challenge: Recent advances in the field of computer vision have enabled more effective and sophisticated interactions between humans and machines.
Approach: They propose a reasoning-based object detection paradigm that leverages state-of-the-art multi-modal models and open-vocabulary object detectors to perform reasoning within the context of the user’s instructions and the visual scene.
Outcome: The proposed method enables users to interact with the system using natural language instructions, allowing for a higher level of interactivity.
FastMem: Fast Memorization of Prompt Improves Context Awareness of Large Language Models (2024.findings-emnlp)

Copied to clipboard

Challenge: Large language models struggle with context awareness, leading to inaccuracies in tasks requiring faithful adherence to provided information.
Approach: They propose a method to enhance LLMs' context awareness by updating only the last Feed-Forward Network module to maximize the likelihood of the prompt before inference .
Outcome: The proposed method improves the accuracy of Llama 3-8B-Inst on the NQ-SWAP dataset from 59.1% to 71.6% and reduces the output structure failure rate of Qwen 1.5-4B-Chat from 34.9% to 25.5%.
Granular Entity Mapper: Advancing Fine-grained Multimodal Named Entity Recognition and Grounding (2024.findings-emnlp)

Copied to clipboard

Challenge: Existing methods for fine-grained content extraction are limited by long-tailed distribution of textual entity categories and performance of object detectors.
Approach: They propose a multi-granularity entity recognition module and a reranking module to integrate hierarchical information of entity categories, visual cues, and external textual resources collectively.
Outcome: The proposed framework achieves state-of-the-art on the fine-grained content extraction task.
FPE2M2: Approaching Lossless and Efficient Quantization with Native Floating Point (2025.findings-acl)

Copied to clipboard

Challenge: Auto-regressive decoding is a memory-bound job, meaning decoding performance is limited by the bandwidth rather than the computational capabilities of the GPU.
Approach: They propose a framework that supports lossless weight-only quantization inference and validate it on Qwen and LLaMA Models.
Outcome: The proposed framework achieves the highest efficiency with lossless accuracy on Qwen and LLaMA Models across various modalities.
Enhancing Speech Large Language Models with Prompt-Aware Mixture of Audio Encoders (2025.emnlp-main)

Copied to clipboard

Challenge: Existing work on integrating audio encoders with large language models (LLMs) has focused on semantic understanding tasks, but different tasks may require distinct features that emphasize either semantic or acoustic aspects.
Approach: They propose to use a prompt-aware mixture to enhance the Speech LLM that uses multiple audio encoders to extract different features based on the prompt.
Outcome: The proposed approach outperforms all single-encoder Speech LLMs on ASR, speaker number verification, and AC tasks.
MuSe: Multi-Stage Graph Reasoning via Vision-Language Models (2026.acl-long)

Copied to clipboard

Challenge: Graph Neural Networks (GNNs) and graph transformers are inadequate for tasks with limited generalization.
Approach: They propose a multi-stage graph reasoning framework based on vision-language models that incrementally samples and visualizes task-relevant subgraphs.
Outcome: The proposed framework outperforms existing benchmarks in Graph-related tasks.
Towards Order Fairness: Mitigating LLMs Order Sensitivity through Dual Group Advantage Optimization (2026.acl-long)

Copied to clipboard

Challenge: Recent studies attempt to obtain optimal or suboptimal arrangements based on statistical results or using dataset-based search, but these methods increase inference overhead while leaving the model’s inherent order bias unresolved.
Approach: They propose Dual Group Advantage Optimization (DGAO) which aims to improve model accuracy and order stability simultaneously.
Outcome: The proposed method improves model accuracy and order stability while penalizing order-sensitive or incorrect responses.
An Empirical Study of Instruction-tuning Large Language Models in Chinese (2023.findings-emnlp)

Copied to clipboard

Challenge: emergence of ChatGPT validates the potential of large language models (LLMs) in artificial general intelligence (AGI) however, the closed source of LLMs coupled with the requirement for massive computing resources has deterred researchers from reaching the LLM training stage.
Approach: They propose to use Chinese instruction-tuning LLMs as a cookbook for customizing LLM models that can better respond to Chinese instructions.
Outcome: The proposed LLM can be used to customize Chinese LLMs that can better respond to Chinese instructions.
Mitigating Hallucinations of Large Language Models in Medical Information Extraction via Contrastive Decoding (2024.findings-emnlp)

Copied to clipboard

Challenge: Medical Information Extraction (MIE) tasks are a fundamental component of medical NLP.
Approach: They propose an alternative adaptive constraint strategy to adjust the scale and scope of contrastive tokens.
Outcome: The proposed approach selectively enhances the identification and classification capabilities while minimizing the influence of other inherent abilities in LLMs.
Beyond Decoder-only: Large Language Models Can be Good Encoders for Machine Translation (2025.findings-acl)

Copied to clipboard

Challenge: Recent advances in machine translation have focused on a single pre-trained decoder . encoder-decoder architectures have received relatively little attention in NMT .
Approach: They propose a method that leverages LLMs as MT encoders and pairs them with lightweight decoders to develop universal translation models.
Outcome: The proposed method matches or surpasses baselines in terms of translation quality but achieves 75% reduction in memory footprint of the KV cache.
Revisiting Interpolation Augmentation for Speech-to-Text Generation (2024.findings-acl)

Copied to clipboard

Challenge: Existing approaches to speech-to-text generation tasks are limited by the lack of extensive labeled datasets.
Approach: They propose to use interpolation augmentation to construct virtual training samples by transforming inputs and labels to enhance generalization in other domains.
Outcome: The proposed approach significantly improves performance across diverse tasks, architectures, and data scales, offering a promising avenue for more robust S2T systems in resource-constrained settings.
In-Context Former: Lightning-fast Compressing Context for Large Language Model (2024.findings-emnlp)

Copied to clipboard

Challenge: Existing methods to reduce inference costs of transformer-based large language models entail quadratic complexity . et al., 2017): transformer-derived large language model performance is a major challenge.
Approach: They propose a method that compresses long contexts into short soft prompts . they use the self-attention mechanism of the large model to extract and condense information .
Outcome: The proposed method reduces compression costs by 68 to 112 times while achieving 90% of baseline performance.
VIGIL: Defending LLM Agents Against Tool-Stream Injection via Verify-Before-Commit (2026.acl-long)

Copied to clipboard

Challenge: Existing defenses for indirect prompt injection are limited by static protection mechanisms . existing models prioritize injected rules due to strict alignment, whereas static protections sever the feedback loop required for adaptive reasoning.
Approach: They propose a framework that shifts the paradigm from restrictive isolation to a verify-before-commit protocol.
Outcome: The proposed framework outperforms state-of-the-art dynamic defenses by reducing the attack success rate by over 22% while more thandoubling utility under attack compared to static baselines.
Bridging the Granularity Gap for Acoustic Modeling (2023.findings-acl)

Copied to clipboard

Challenge: Despite the success of speech recognition, how to encode the speech features effectively remains an open problem.
Approach: They propose a Progressive Down-Sampling technique which compresses acoustic features into coarser-grained units containing more complete semantic information, like text-level representation.
Outcome: The proposed method yields comparable or better results on the speech recognition task and inference speedups ranging from 1.20x to 1.47x.
Knowledgeable or Educated Guess? Revisiting Language Models as Knowledge Bases (2021.acl-long)

Copied to clipboard

Challenge: Recent studies show that pre-trained masked language models can be factual knowledge bases.
Approach: They conduct a rigorous study to explore the underlying predicting mechanisms of MLMs . they find that previous decent performance mainly owes to the biased prompts which overfit dataset artifacts a .
Outcome: The proposed model improves on illustrative cases and external contexts . the results question the previous findings that MLMs can be reliable factual knowledge bases .
Streamlining the Collaborative Chain of Models into A Single Forward Pass in Generation-Based Tasks (2025.findings-acl)

Copied to clipboard

Challenge: Recent advances in "Chain of Models" approach increase resource demands as each model must be deployed separately.
Approach: They propose a prompt-tuning method that enables models to share hidden states . they modify input and attention masks during training to eliminate redundant forward passes .
Outcome: Empirical results show that FTHSS matches the performance of traditional model chains while improving inference efficiency.
RAGTruth: A Hallucination Corpus for Developing Trustworthy Retrieval-Augmented Language Models (2024.acl-long)

Copied to clipboard

Challenge: Retrieval-augmented generation (RAG) is a main technique for alleviating hallucinations in large language models.
Approach: They propose to integrate RAG into large language models to analyze word-level hallucinations using a corpus of 18,000 naturally generated responses from diverse LLMs.
Outcome: The proposed model can fine tune a relatively small LLM and achieve a competitive hallucination detection performance when compared to the existing prompt-based approaches.
BERT-MK: Integrating Graph Contextualized Knowledge into Pre-trained Language Models (2020.findings-emnlp)

Copied to clipboard

Challenge: Existing knowledge representation learning methods do not use graph contextualized knowledge.
Approach: They propose to model subgraphs in a medical KG and integrate it with a pre-trained language model to do knowledge generalization.
Outcome: The proposed model achieves state-of-the-art on several medical NLP tasks . it improves on MedERNIE, and the proposed model is effective .
RADO: Reasoning Audit-Driven Optimization for Rigorous Reasoning in High-Stakes Domains (2026.acl-long)

Copied to clipboard

Challenge: Current reinforcement learning paradigms rely on outcome-based rewards, overlooking latent logical fallacies in intermediate steps.
Approach: They propose a specialized audit model augmented with external tools to identify local logical ruptures and calibrate reward signals.
Outcome: The proposed framework improves accuracy and logical rigor in high-stakes domains.
Towards Table-to-Text Generation with Pretrained Language Model: A Table Structure Understanding and Text Deliberating Approach (2022.emnlp-main)

Copied to clipboard

Challenge: Currently, the generalization issues hinder the applicability of neural table-to-text models due to the limited source tables.
Approach: They propose a table-structureaware text generation model with pretrained language model and propose TASD to bridge the gap between the structured table and text input.
Outcome: The proposed model bridges the gap between the structured table and text input and generates accurate and fluent descriptive texts on two public datasets.
Large Language Models and Causal Inference in Collaboration: A Comprehensive Survey (2025.findings-naacl)

Copied to clipboard

Challenge: Large Language Models (LLMs) have shown great potential to enhance Natural Language Processing (NLP) models in areas such as predictive accuracy, fairness, robustness, and explainability.
Approach: They evaluate or improve generative Large Language Models from a causal perspective in areas such as reasoning capacity, fairness and safety issues, explainability, and handling multimodality.
Outcome: The proposed models can be used to perform causal relationship discovery and causal effect estimation tasks.
Learning How and What to Memorize: Cognition-Inspired Two-Stage Optimization for Evolving Memory (2026.acl-long)

Copied to clipboard

Challenge: Existing memory systems rely on static, hand-crafted update rules for personalization, but sparse outcome rewards provide weak supervision, resulting in unstable long-horizon optimization.
Approach: They propose a memory guideline optimization framework that learns how memory should be organized and what information to update.
Outcome: The proposed framework learns how memory should be organized and what information to update.
Beyond Chain-of-Thought: A Survey of Chain-of-X Paradigms for LLMs (2025.coling-main)

Copied to clipboard

Challenge: Large Language Models (LLMs) have shown impressive reasoning abilities when prompted with Chain-of-Thought (CoT).
Approach: They propose to categorize Chain-of-X methods by taxonomies of nodes, i.e., the X in CoX, and application tasks, and then categorise them by taxanomies and discuss potential future directions.
Outcome: The proposed methods are categorised by taxonomies of nodes, i.e., the X in CoX, and application tasks.
Dynamic Curriculum Learning for Low-Resource Neural Machine Translation (2020.coling-main)

Copied to clipboard

Challenge: Recent work on neural machine translation (NMT) has demonstrated impressive performance improvements and became the de-facto standard.
Approach: They propose a dynamic curriculum learning method to reorder training samples in training using a Transformer-based system.
Outcome: The proposed method outperforms baselines on three low-resource machine translation benchmarks and different sized data of WMT’16 En-De.
Bypassing Neural Evaluations for Fast Audio Editing via Adaptive Trajectory Extrapolation (2026.findings-acl)

Copied to clipboard

Challenge: Recent advances in audio diffusion models have significantly improved text-to-audio editing via inversion techniques, but these models typically rely on dense, fixed-step sampling trajectories to maintain structural integrity.
Approach: They propose a model-agnostic Adaptive Trajectory Extrapolation framework that accelerates inversion-based editing process by dynamically evaluating only the most critical generative phases.
Outcome: The proposed framework achieves a 3.9 speedup with negligible loss in fidelity.
Are You Copying My Model? Protecting the Copyright of Large Language Models for EaaS via Backdoor Watermark (2023.acl-long)

Copied to clipboard

Challenge: Large language models (LLMs) have demonstrated exceptional abilities in both text understanding and generation.
Approach: They propose an Embedding Watermark method that implants backdoors on embeddings to protect copyright of large language models.
Outcome: The proposed method protects the copyright of large language models without compromising service quality while minimizing the adverse impact on the original embeddings’ utility.
Understanding Conflicts in Multi-Objective Alignment through Reward Consistency (2026.findings-acl)

Copied to clipboard

Challenge: Existing training pipelines still face alignment conflicts where optimizing for one objective degrades performance on others.
Approach: They propose a reward-based criterion that approximates alignment conflicts via reward models.
Outcome: The proposed framework improves harmlessness and helpfulness scores by 23.07% over the vanilla dataset.
QDMR-based Planning-and-Solving Prompting for Complex Reasoning Tasks (2024.lrec-main)

Copied to clipboard

Challenge: Existing Plan-and-Solve prompting methods are difficult to implement for complex questions.
Approach: They propose a plan-and-solve prompting method based on Question Decomposition Meaning Representation (QDMR) it allows LLM to generate a QDMR graph to represent problem-solving logic .
Outcome: The proposed method can represent and execute the problem-solving logic of complex questions more accurately than existing methods.
CTC-based Non-autoregressive Speech Translation (2023.acl-long)

Copied to clipboard

Challenge: End-to-end speech translation (E2E ST) and non-autoregressive (NAR) generation are promising in language and speech processing for their advantages of less error propagation and low latency.
Approach: They develop a model that uses connectionist temporal classification to predict the source and target texts.
Outcome: The proposed model achieves an average BLEU score of 29.5 with a speed-up of 5.67.
TranSFormer: Slow-Fast Transformer for Machine Translation (2023.findings-acl)

Copied to clipboard

Challenge: Prior work has focused on treating subwords as basic units in developing such systems.
Approach: They propose a slow-fast two-stream learning model that uses a “slow” branch to deal with subword sequences and a "fast" branch to cope with longer character sequences.
Outcome: The proposed model shows consistent BLEU improvements (larger than 1 BLUE point) on several machine translation benchmarks.
ImpRIF: Stronger Implicit Reasoning Leads to Better Complex Instruction Following (2026.acl-long)

Copied to clipboard

Challenge: Experiments show that enhancing implicit reasoning capabilities can significantly improve complex instruction following in large language models.
Approach: They propose a method to enhance LLMs’ understanding of implicit reasoning instructions by formalizing such instructions as verifiable reasoning graphs and fine-tuning with graph reasoning.
Outcome: The proposed method outperforms existing models on five complex instruction following benchmarks and will be open-sourced in the near future.
EverMemOS: A Self-Organizing Memory Operating System for Structured Long-Horizon Reasoning (2026.acl-long)

Copied to clipboard

Challenge: Existing memory systems for LLMs store isolated records and retrieve fragments . Existing systems store isolated data and fragments, limiting their ability to consolidate evolving experience and resolve conflicts.
Approach: They propose an engram-inspired memory operating system that implements an 'engram'-inspired lifecycle for computational memory.
Outcome: Experiments on LoCoMo, LongMemEval, and PersonaMeM-v2 show that EverMemeOS outperforms state-of-the-art methods on memory-augmented reasoning tasks.
FGraDA: A Dataset and Benchmark for Fine-Grained Domain Adaptation in Machine Translation (2022.lrec-1)

Copied to clipboard

Challenge: Recent research on domain adaptation neglects diversity in translation within a domain . current research on NMT models considers very broad target domains .
Approach: They propose a fine-grained domain adaptation task for autonomous vehicles, AI education, real-time networks, and smart phone.
Outcome: The proposed task is compared with a dataset of Chinese-English translation tasks for four sub-domains of information technology: autonomous vehicles, AI education, real-time networks, and smart phone.
PRIME: A Process-Outcome Alignment Benchmark for Verifiable Reasoning in Mathematics and Engineering (2026.acl-long)

Copied to clipboard

Challenge: Current outcome-centric verification paradigms neglect potential errors in the derivation process.
Approach: They propose a process-aware RLVR training paradigm utilizing verifiers selected via **PRIME**.
Outcome: The proposed approach outperforms the baseline verification paradigm on AIME24, AIME25, and Beyond-AIME models.
Cut the Deadwood Out: Backdoor Purification via Guided Module Substitution (2025.findings-emnlp)

Copied to clipboard

Challenge: Model NLP models are often trained on datasets from untrusted platforms, posing significant risks of data poisoning attacks.
Approach: They propose a retraining-free method that selectively replaces modules in the victim model based on a trade-off signal between utility and backdoor.
Outcome: The proposed method outperforms even the strongest defense baseline against challenging attacks like LWS.
Rethinking Multiple-Choice Questions for RLVR: Unlocking Potential via Distractor Design (2026.findings-acl)

Copied to clipboard

Challenge: Existing approaches to RLVR use multiple-choice questions as verifiable rewards . however, not all tasks provide reliable verification .
Approach: They propose a framework that actively constructs high-quality distractors to block elimination shortcuts and promote deep reasoning.
Outcome: The proposed method significantly improves reasoning capabilities of Large Language Models.
From Long Videos to Engaging Clips: A Human-Inspired Video Editing Framework with Multimodal Narrative Understanding (2025.emnlp-industry)

Copied to clipboard

Challenge: Existing methods for video editing rely on textual cues from ASR transcripts and segment selection, often neglecting rich visual context.
Approach: They propose a human-inspired automatic video editing framework that leverages multimodal narrative understanding to address these limitations.
Outcome: The proposed framework outperforms existing baselines across general and advertisement-oriented editing tasks.
Sinkhorn Distance Minimization for Knowledge Distillation (2024.lrec-main)

Copied to clipboard

Challenge: Existing knowledge distillation methods investigate divergence measures but fail to deliver effective supervision when few distribution overlap exists between teacher and student.
Approach: They propose a knowledge distillation method that exploits the Sinkhorn distance to ensure a nuanced assessment of the disparity between teacher and student distributions.
Outcome: The proposed method outperforms state-of-the-art methods on all kinds of LLMs with encoder-only, encoder decoder, and decoded architectures.
Stacked Acoustic-and-Textual Encoding: Integrating the Pre-trained Models into Speech Translation Encoders (2021.acl-long)

Copied to clipboard

Challenge: End-to-end Speech Translation (E2E ST) encoders lack global context representation, whereas MT encoder lacks it.
Approach: They propose a Stacked Acoustic-and-Textual Encoding method for speech translation . they propose an adaptor module to alleviate representation inconsistency .
Outcome: The proposed method achieves state-of-the-art BLEU scores of 18.3 and 25.2 on two ST tasks.
AMoPO: Adaptive Multi-objective Preference Optimization without Reward Models and Reference Models (2025.findings-acl)

Copied to clipboard

Challenge: Existing multi-objective preference alignment methods for large language models face limitations such as auxiliary reward/reference models and computational complexity.
Approach: They propose a framework that achieves dynamic balance across preference dimensions by using dimension-aware generation metrics as implicit rewards.
Outcome: Empirical results show that AMoPO outperforms state-of-the-art methods by 28.5% .
Visualization Recommendation with Prompt-based Reprogramming of Large Language Models (2024.acl-long)

Copied to clipboard

Challenge: Traditional visualization recommendations require extensive manual maintenance and yet fail to fully comprehend tabular data.
Approach: They propose a hierarchical table prompt-based reprogramming framework that integrates tabular data into LLMs through a strategically crafted prompt learning method.
Outcome: The proposed framework achieves state-of-the-art performance and will be made publicly available upon acceptance.
Double-Checker: Large Language Model as a Checker for Few-shot Named Entity Recognition (2024.findings-emnlp)

Copied to clipboard

Challenge: Recent studies have demonstrated remarkable performance on few-shot Named Entity Recognition tasks due to the high cost of obtaining high-quality labeled data.
Approach: They propose to decompose the task into entity span detection and entity type classification using a type-independent entity span detector and then classify the detected spans based on their types.
Outcome: The proposed method consistently yields improvements over two baseline approaches.
Premise-based Multimodal Reasoning: Conditional Inference on Joint Textual and Visual Clues (2022.acl-long)

Copied to clipboard

Challenge: Existing work in vision language cross-modal reasoning uses binary or multi-choice classification based on source image and textual query.
Approach: They propose a task where a textual premise is the background presumption on each source image.
Outcome: The proposed task is based on a dataset of 15,360 movie screenshots and human-curated premise templates from 6 pre-defined categories.
How to Make LMs Strong Node Classifiers? (2026.findings-eacl)

Copied to clipboard

Challenge: Language Models (LMs) are increasingly challenging the dominance of domain-specific models, such as Graph Neural Networks (GNNs) and Graph Transformers (GTs).
Approach: They propose a novel approach that empowers off-the-shelf LMs to achieve performance comparable to state-of-the art (SOTA) GNNs on node classification tasks without requiring any architectural modifications.
Outcome: The proposed approach outperforms existing GNNs on node classification tasks and is open-source upon publication.
VIRT: Improving Representation-based Text Matching via Virtual Interaction (2022.emnlp-main)

Copied to clipboard

Challenge: Experimental results show that representation-based text matching methods suffer from performance degradation due to the lack of interactions between the pair of texts.
Approach: They propose a virtual interaction mechanism that enables deep interaction between texts . they propose 'inteRacTion mechanism' that can be integrated into existing methods as plugins .
Outcome: The proposed method outperforms state-of-the-art models on six text matching benchmarks.
Domaino1s: Guiding LLM Reasoning for Explainable Answers in High-Stakes Domains (2025.findings-acl)

Copied to clipboard

Challenge: Existing Large Language Models (LLMs) generate brief answers without reasoning processes and explanations.
Approach: They propose supervised fine-tuning and tree search to enhance LLMs’ reasoning capabilities on domain tasks.
Outcome: The proposed model improves on stock investment recommendation and legal reasoning QA tasks.
Breakthrough from Nuance and Inconsistency: Enhancing Multimodal Sarcasm Detection with Context-Aware Self-Attention Fusion and Word Weight Calculation. (2024.lrec-main)

Copied to clipboard

Challenge: Existing methods for sarcasm detection rely on feature concatenation to fuse different modalities or model inconsistencies among modalités.
Approach: They propose to use Context-Aware Self-Attention Fusion to integrate local and momentary multimodal information into specific words to illustrate the inconsistencies between connotation and denotation.
Outcome: The proposed method achieves an accuracy of 76.9 and an F1 score of 76.1 on the MUStARD dataset, surpassing the current state-of-the-art IWAN model by 1.7 and 1.6 respectively.
Skill Discovery for Software Scripting Automation via Offline Simulations with LLMs (2026.findings-eacl)

Copied to clipboard

Challenge: Large Language Models (LLMs) can generate code from natural language queries, but runtime code generation is limited due to unverified code, security risks, longer response times, and higher computational costs.
Approach: They propose an offline simulation framework to curate a software-specific skillset by exploiting large language models and publicly available scripting guides.
Outcome: The proposed framework significantly improves automation success rates, reduces response time, and saves runtime token costs compared to traditional runtime code generation.
DocEE: A Large-Scale and Fine-grained Benchmark for Document-level Event Extraction (2022.naacl-main)

Copied to clipboard

Challenge: Existing datasets focus on sentence-level event extraction, but document-level EE is limited due to the lack of large-scale and practical training and evaluation datasets.
Approach: They propose a document-level event extraction dataset with 27,000+ events and 180,000+ arguments.
Outcome: The proposed dataset includes 27,000+ events, 180,000+ arguments and large-scale manual annotations, fine-grained argument types and application-oriented settings.
EMONA: Event-level Moral Opinions in News Articles (2024.naacl-long)

Copied to clipboard

Challenge: Recent work on news articles has focused on social media short texts, but little has explored moral sentiment within news articles.
Approach: They propose to extract event-level moral opinions from news articles using a new dataset . they use annotated event-based moral opinions to analyze news articles .
Outcome: The proposed dataset consists of 400 news articles containing over 10k sentences and 45k events, among which 9,613 events received moral foundation labels.
DocEE-zh: A Fine-grained Benchmark for Chinese Document-level Event Extraction (2024.findings-emnlp)

Copied to clipboard

Challenge: Chinese document-level event extraction is still largely unexplored.
Approach: They propose a Chinese document-level event extraction dataset with over 36,000 events and 210,000 arguments.
Outcome: The proposed dataset includes over 36,000 events and more than 210,000 arguments . it is an extension of the DocEE dataset, utilizing the same event schema and annotated by human experts.
Retrieve-Plan-Generation: An Iterative Planning and Answering Framework for Knowledge-Intensive LLM Generation (2024.emnlp-main)

Copied to clipboard

Challenge: Large language models (LLMs) often produce factual errors due to limited internal knowledge.
Approach: They propose a retrieval-augmented generation framework that generates plan tokens to guide subsequent generation.
Outcome: The proposed framework improves the accuracy of large language models with external knowledge sources.
VeraCT Scan: Retrieval-Augmented Fake News Detection with Justifiable Reasoning (2024.acl-demos)

Copied to clipboard

Challenge: generative artificial intelligence has exacerbated the challenge of distinguishing genuine news from fabricated stories.
Approach: They propose a retrieval-augmented system that extracts the core facts from a given piece of news and conducts an internet-wide search to identify corroborating or conflicting reports.
Outcome: The proposed system has demonstrated state-of-the-art accuracy in the realm of fake news detection.
SAMem: State-Aware Memory as a Fine-Grained Memory for LLM Agents in Decision-Making (2026.findings-acl)

Copied to clipboard

Challenge: Existing experiential memory approaches rely on task-level memory, but this lacks the situational alignment required for complex multi-step decision-making.
Approach: They propose a new fine-grained memory paradigm that aligns memory retrieval with the current state instead of storing and reusing globally shared experiences.
Outcome: Experiments on complex decision-making benchmarks show that the proposed state-aware memory outperforms existing experiential memory approaches and significantly improves task-solving efficiency.
MLLM-I2W: Harnessing Multimodal Large Language Model for Zero-Shot Composed Image Retrieval (2025.coling-main)

Copied to clipboard

Challenge: Existing methods for combining image retrieval are supervised and zero-shot . however, the challenge of mapping pseudo-words to images within the joint image-text embedding space is still a challenge.
Approach: They propose a novel image-text mapping network which converts description-related image information into pseudo-word markers for precise ZS-CIR.
Outcome: The proposed model improves on COCO, CIRR, and Fashion-IQ benchmarks.
Learning Architectures from an Extended Search Space for Language Modeling (2020.acl-main)

Copied to clipboard

Challenge: Neural architecture search (NAS) has advanced in recent years but most NAS systems restrict search to learning architectures of a recurrent or convolutional cell.
Approach: They propose a general approach to learn both intra-cell and inter-cell architectures . they implement their approach in a differentiable architecture search system .
Outcome: The proposed approach outperforms the baseline on PTB and WikiText data and shows good transferability to other systems.
ScaleBiO: Scalable Bilevel Optimization for LLM Data Reweighting (2025.acl-long)

Copied to clipboard

Challenge: Existing paradigms for bilevel optimization require second-order information, making it difficult to scale them up.
Approach: They propose a scalable instantiation of a bilevel optimization paradigm for large-scale LLMs by using a memory-efficient training technique.
Outcome: The proposed paradigm scales to 30B-sized LLMs on 8H100 GPUs.
Following Occam’s Razor: Dynamic Combination of Structured Knowledge for Multi-Hop Question Answering using LLMs (2025.findings-emnlp)

Copied to clipboard

Challenge: Multi-hop question answering is a challenging task that requires capturing information from multiple positions in multiple documents.
Approach: They propose a framework for integrating text-based and triple-based paradigms that incorporates structured knowledge into large-scale question answering.
Outcome: The proposed framework improves multi-hop question answering by incorporating structured knowledge into the models.
Medical Dialogue System: A Survey of Categories, Methods, Evaluation and Challenges (2024.findings-acl)

Copied to clipboard

Challenge: Existing medical dialogue systems have significant potential to simplify diagnostic procedure and reduce the cost of collecting information from patients.
Approach: They analyze 325 papers from well-known computer science, natural language processing conferences and journals to find out the major challenges of medical dialog systems.
Outcome: The proposed systems have been surveyed in the medical community but have not been evaluated from a technical perspective.
A Simple and Effective Approach to Coverage-Aware Neural Machine Translation (P18-2)

Copied to clipboard

Challenge: Neural Machine Translation (NMT) models are used to solve translation problems using long-term models.
Approach: They propose a method to seek a better balance between model confidence and length preference for Neural Machine Translation.
Outcome: The proposed model improves on Chinese-English and English-German translation tasks.
MobileWorld: Benchmarking Autonomous Mobile Agents in Agent-User Interactive and MCP-Augmented Environments (2026.acl-long)

Copied to clipboard

Challenge: AndroidWorld is the dominant mobile GUI agent evaluation benchmark, but its success rates are low . despite reproducible emulator environment, it lacks key application categories such as e-commerce and enterprise communication.
Approach: They propose a benchmark for mobile GUI agents that reflects real-world usage through long-horizon, cross-application workflows.
Outcome: The proposed framework achieves over 90% success rates, while AndroidWorld is the dominant benchmark.
Think and Recall: Layer-Level Prompting for Lifelong Model Editing (2025.emnlp-main)

Copied to clipboard

Challenge: Existing methods for lifelong model editing suffer from limitations in usability, such as requiring additional training corpora or lacking support for reversible and detachable edits.
Approach: They propose a plug-and-play method for knowledge retrieval and storage, i.e., Layer-Level Prompting, which enables seamless and efficient lifelong model editing.
Outcome: The proposed method outperforms existing methods on question answering and hallucination benchmarks across different LLMs.
AlignDistil: Token-Level Language Model Alignment as Adaptive Policy Distillation (2025.acl-long)

Copied to clipboard

Challenge: Existing methods for LLM alignment optimize tokens using a sparse, response-level reward or preference annotation.
Approach: They propose an RLHF-equivalent distillation method for token-level reward optimization that incorporates the reward learned by DPO into the RLHG objective and builds a token-based teacher distribution.
Outcome: The proposed method bridges the accuracy gap between the reward from the DPO model and the pure reward model by building a contrastive DPO reward with a normal and a reverse DPO.
Mock Worlds, Real Skills: Building Small Agentic Language Models with Synthetic Tasks, Simulated Environments, and Rubric-Based Rewards (2026.acl-long)

Copied to clipboard

Challenge: Existing agentic training data are narrow in task variety and easily solved . real-world APIs lack diversity and are unstable for large-scale reinforcement learning rollout processes.
Approach: They propose a framework that synthesizes diverse tool-use training data and simulates complete environments.
Outcome: The proposed framework synthesizes diverse tool-use training data and simulates complete environments.
To Paraphrase or Not: Efficient Comment Detoxification with Unsupervised Detoxifiability Discrimination (2026.eacl-short)

Copied to clipboard

Challenge: Existing methods for detoxification of toxic comments are limited by overcorrection and data scarcity . experimental results show that DID outperforms existing methods on academic data and an industrial platform .
Approach: They propose a paradigm that adaptively conducts filtering or paraphrasing for each toxic comment based on its detoxifiability . they propose 'detoxifiabilities-aware detoxification' that can be trained to filter or paraphrase toxic comments based upon their detoxifikatability based only on detoxificable comments .
Outcome: Experimental results show that DID outperforms existing methods on academic and industrial data.
MolSafeEval: A Benchmark for Uncovering Safety Risks in AI-Generated Molecules (2026.findings-acl)

Copied to clipboard

Challenge: generative models may produce molecules with toxic, reactive, or otherwise hazardous characteristics.
Approach: They propose a benchmark to evaluate and analyze the safety risks of molecular generation.
Outcome: The proposed benchmark aims to evaluate and analyze the safety risks of molecular generation.
Learning from Miscellaneous Other-Class Words for Few-shot Named Entity Recognition (2021.acl-long)

Copied to clipboard

Challenge: Existing methods to classify named entity mentions with fewshots fail to differentiate rich semantics in other-class words, which will aggravate overfitting under few shot scenario.
Approach: They propose a model that can automatically induce different unde- fined classes from the other class to improve few-shot Named Entity Recognition (NER) .
Outcome: The proposed model outperforms five state-of-the-art models in 1- shot and 5-shots settings on four NER bench marks.
Non-Parametric Domain Adaptation for End-to-End Speech Translation (2022.emnlp-main)

Copied to clipboard

Challenge: End-to-end speech translation (E2E-ST) systems have received increasing attention due to its less error propagation, lower latency and fewer parameters.
Approach: They propose a non-parametric method that leverages in-domain text translation corpus to achieve domain adaptation for E2E-ST systems.
Outcome: The proposed method outperforms the existing in-domain fine-tuning strategies on the Europarl-ST benchmark.
Unlocking the Effectiveness of LoRA-FP for Seamless Transfer Implantation of Fingerprints in Downstream Models (2025.findings-emnlp)

Copied to clipboard

Challenge: lightweight plug-and-play framework that encodes backdoor fingerprints into LoRA adapters .
Approach: proposed framework encodes backdoor fingerprints into LoRA adapters via constrained fine-tuning . enables seamless fingerprint transplantation through parameter fusion, eliminating full-parameter updates while maintaining integrity.
Outcome: The proposed framework achieves superior robustness against various scenarios while reducing computational overhead compared to traditional approaches.
Prune as You Generate: Online Rollout Pruning for Faster and Better RLVR (2026.acl-long)

Copied to clipboard

Challenge: Reinforcement Learning with Verifiable Rewards (RLVR) has improved reasoning capabilities of Large Language Models (LLMs).
Approach: They propose an online pruning method that prunes rollouts while steering correct ones to enhance learning signals.
Outcome: The proposed method improves average accuracy by +2.30 to +2.99 across GRPO and DAPO on Qwen-3 and LLaMA-3.2 models.
NiuTrans.LMT: Toward Inclusive and Scalable Multilingual Machine Translation with LLMs (2026.acl-long)

Copied to clipboard

Challenge: Large language models have significantly advanced Multilingual Machine Translation (MMT) yet scaling to many languages while maintaining robust performance across directions remains challenging.
Approach: They propose a strategy to reduce the number of translations in one direction . they propose auxiliary parallel sentences to promote cross-lingual transfer .
Outcome: The proposed model performs on par with or better than substantially larger baselines.
MRT: Multi-modal Short- and Long-range Temporal Convolutional Network for Time-sync Comment Video Behavior Prediction (2024.lrec-main)

Copied to clipboard

Challenge: Using time-sync comments, it is difficult to understand user behavior due to complexity of interactions between users, videos, and comments.
Approach: They propose a novel time-sync comment behavior prediction model that takes historical behavior into account and optimizes it on the basis of user preferences.
Outcome: The proposed model improves the performance of time-sync comments on visual frames and textual comments on two cats playing simultaneously.
Mixture-of-Domain-Adapters: Decoupling and Injecting Domain Knowledge to Pre-trained Language Models’ Memories (2023.acl-long)

Copied to clipboard

Challenge: Pre-trained language models demonstrate excellent abilities to understand texts in the generic domain while struggling in a specific domain.
Approach: They propose to decouple the feed-forward networks of the Transformer architecture into two parts to maintain old-domain knowledge and a mixture-of-adapters gate to inject domain-specific knowledge in parallel.
Outcome: The proposed method achieves superior performance on in-domain, out-of-domain and knowledge-intensive tasks.
Taming Pre-trained Language Models with N-gram Representations for Low-Resource Domain Adaptation (2021.acl-long)

Copied to clipboard

Challenge: Existing methods to train pre-trained models require domain-specific data and computational resources.
Approach: They propose a domain-aware N-gram Adaptor to incorporate unseen and domain-specific words into a generic pretrained model.
Outcome: The proposed model can improve on eight low-resource tasks using limited data with lower computational costs.
iPET: An Interactive Emotional Companion Dialogue System with LLM-Powered Virtual Pet World Simulation (2025.acl-demo)

Copied to clipboard

Challenge: Existing approaches to role-playing emotional companion products lack sustained personalization and contextual adaptability, limiting their effectiveness in real-world settings.
Approach: They propose a virtual pet agent that can enhance user engagement through rich, dynamic pet behaviors and interactions tailored to individual preferences.
Outcome: The proposed system has been deployed in a real-world, non-commercial product for 200 days and has demonstrated its effectiveness in practical applications.
Rethinking and Improving Multi-task Learning for End-to-end Speech Translation (2023.emnlp-main)

Copied to clipboard

Challenge: auxiliary tasks are highly consistent with end-to-end speech translation (ST) but their effectiveness has not been thoroughly studied.
Approach: They propose an improved multi-task learning approach for the ST task that bridges the modal gap by mitigating the difference in length and representation.
Outcome: The proposed approach achieves state-of-the-art on the MuST-C dataset with 20.8% of training time required by the current SOTA method.
Memory-Augmented LLM-based Multi-Agent System for Automated Feature Generation on Tabular Data (2026.acl-long)

Copied to clipboard

Challenge: Existing methods for automated feature generation rely on predefined operator libraries and do not incorporate feature semantics, limiting their ability to produce high-quality features.
Approach: They propose a Memory-Augmented LLM-based Multi-Agent System (MALMAS) that decomposes the generation process into agents with distinct responsibilities.
Outcome: The proposed method extracts informative features from raw tabular data without manual intervention and is crucial for accurate, generalizable machine learning.
Securing Multi-turn Conversational Language Models From Distributed Backdoor Attacks (2024.findings-emnlp)

Copied to clipboard

Challenge: Large language models (LLMs) have acquired the ability to handle longer context lengths and understand nuances in text, expanding their dialogue capabilities beyond a single utterance.
Approach: They propose a decoding time defense that scales linearly with the input sequence length and reduces the backdoor to as low as 0.35%.
Outcome: The proposed framework is generalizable, compatible with any trigger in an adversary’s toolbox in a plug-and-play manner.
Multi-perspective Improvement of Knowledge Graph Completion with Large Language Models (2024.lrec-main)

Copied to clipboard

Challenge: Knowledge graph completion (KGC) is a widely used method to tackle incompleteness in knowledge graphs (KGs).
Approach: They propose a general framework to compensate for the deficiency of contextualized knowledge by querying large language models from various perspectives.
Outcome: The proposed framework improves knowledge graph completion (KGC) by querying large language models from various perspectives.
Capsule Network with Interactive Attention for Aspect-Level Sentiment Classification (D19-1)

Copied to clipboard

Challenge: Existing methods for aspect-level sentiment classification are limited for dealing with overlapped features.
Approach: They propose to use capsule network to construct vector-based feature representation and cluster features by an EM routing algorithm to model semantic relationship between aspect terms and context.
Outcome: The proposed model achieves state-of-the-art on three datasets.
RLShield: Dynamic Jailbreak Detection for LLMs via Reinforced Adaptive Learning (2026.findings-acl)

Copied to clipboard

Challenge: Existing approaches to detect jailbreak prompts rely on static model components or fixed decision thresholds.
Approach: They propose a dynamic jailbreak detection framework that employs reinforcement learning for adaptive threshold selection.
Outcome: Experimental results show that the framework outperforms baselines in detection performance while maintaining high computational efficiency.

What is GenGO?

GenGO is an NLP powered publication search system. It currenctly indexes 30k+ papers from ACL Anthology, and implements multi-aspect summarization, semantic search, and more!

Information

About
Limitations