Papers by Feng Gao

73 papers
Tracing the Roots: A Multi-Agent Framework for Uncovering Data Lineage in Post-Training LLMs (2026.acl-long)

Copied to clipboard

Challenge: High-quality post-training data is the primary engine driving LLM capabilities . datasets are often treated as isolated artifacts, overlooking their true developmental context .
Approach: They propose a framework to reconstruct the evolutionary graph of dataset development using data lineage.
Outcome: The proposed framework characterizes domain-specific structural patterns in Math-oriented datasets and general-domain corpora.
DisCo_Speech: Controllable Zero-Shot Speech Generation with A Disentangled Speech Codec (2026.acl-long)

Copied to clipboard

Challenge: DisCo-Speech is a zero-shot controllable text-to-speech framework . standard codecs entangle timbre and prosody, which hinders independent control in continuation-based LMs.
Approach: They propose a disentangled speech codec and an LM-based generator to solve this problem . they propose fusion and reconstruction that merges content and prosody into unified tokens .
Outcome: DisCo-Speech achieves competitive voice cloning and superior zero-shot prosody control.
Getting More from Less: Large Language Models are Good Spontaneous Multilingual Learners (2024.emnlp-main)

Copied to clipboard

Challenge: Large Language Models (LLMs) have shown impressive language capabilities, but most of them have very unbalanced performance across different languages.
Approach: They propose to use question translation data to enhance LLMs' multilingual capabilities by using mechanistic interpretability methods.
Outcome: The proposed method improves multilingual alignment even with unannotated answers in English and a wide range of languages even with instruction-tuned LLMs.
K-order Ranking Preference Optimization for Large Language Models (2025.findings-acl)

Copied to clipboard

Challenge: Existing list-wise methods focus on optimizing list ranking consistency for LLMs to improve ranking abilities.
Approach: They propose to extend the Plackett-Luce model to accommodate top-K ranking by extending the DPO’s Plact-Lucer model to dynamically determine appropriate K for different samples.
Outcome: The proposed model can be extended to accommodate top-K ranking and improve training efficiency.
Composable Text Controls in Latent Space with ODEs (2023.emnlp-main)

Copied to clipboard

Challenge: Existing approaches to composable text operations often require plug-and-play . a single LM can perform arbitrary text operation composition in the latent space .
Approach: They propose an efficient approach for composable text operations in the latent space of text . they connect pretrained LMs to the laten space and adapt them to the space .
Outcome: The proposed approach improves on existing methods in the latent space of text.
ChatAnime: Towards User-Centered Emotional Support in LLM-based Virtual Character Chat (2026.acl-long)

Copied to clipboard

Challenge: Existing research focuses on character consistency in fictional or game-based scenarios . ESRP framework is designed to align role-playing with real-world user scenarios based on emotional needs.
Approach: They propose a framework to align role-playing with real-world user scenarios and emotional needs.
Outcome: The proposed framework aligns role-playing with real-world user scenarios and emotional needs.
Depression Detection on Social Media with Large Language Models (2025.emnlp-industry)

Copied to clipboard

Challenge: Existing methods for analyzing social media data lack a systematic integration of medical knowledge, causing a critical treatment gap.
Approach: They propose a framework that leverages Large Language Models to integrate medical knowledge into social media data.
Outcome: The proposed framework can be used to distinguish depression from transient mood changes.
Spec-VLA: Speculative Decoding for Vision-Language-Action Models with Relaxed Acceptance (2025.emnlp-main)

Copied to clipboard

Challenge: Visual Language Models (VLMs) have significant parameter size and autoregressive (AR) decoding nature impose considerable computational demands on VLA models.
Approach: They propose a framework to relax acceptance utilizing the relative distances represented by the action tokens of the VLA model.
Outcome: Empirical results show that the proposed framework improves the speed of the prediction task by 44%.
Add-One-In: Incremental Sample Selection for Large Language Models via a Choice-Based Greedy Paradigm (2025.emnlp-main)

Copied to clipboard

Challenge: Existing studies focus on individual quality and do not assess the value of training data.
Approach: They propose a choice-based sample selection framework that evaluates sample quality . they use LLMs to evaluate the value of each option during the selection process .
Outcome: The proposed model outperforms the full dataset and recent studies on a larger medical dataset.
Personalized Microblog Sentiment Classification via Adversarial Cross-lingual Multi-task Learning (D18-1)

Copied to clipboard

Challenge: Existing personalized microblog sentiment classification methods suffer from the insufficiency of discriminative tweets for personalization learning.
Approach: They propose to use user-attention-based Convolutional Neural Networks to capture individuality and opinion bias in microblog posts and a novel adversarial cross-lingual learning framework to enrich the user post representation.
Outcome: The proposed method outperforms state-of-the-art baseline algorithms with large margins on English and Chinese microblog datasets.
SKEP: Sentiment Knowledge Enhanced Pre-training for Sentiment Analysis (2020.acl-main)

Copied to clipboard

Challenge: sentiment knowledge is ignored in sentiment analysis, despite its use in pretraining.
Approach: They propose to use sentiment knowledge to learn a unified sentiment representation for multiple sentiment analysis tasks.
Outcome: The proposed method outperforms strong pre-training baseline on three kinds of sentiment tasks.
AdaTooler-V: Adaptive Tool-Use for Images and Videos (2026.findings-acl)

Copied to clipboard

Challenge: Existing models exhibit blind tool-use reasoning patterns, which significantly increases inference overhead and degrades model performance.
Approach: They propose an MLLM that performs adaptive tool-use by determining whether a visual problem truly requires tools.
Outcome: The proposed model outperforms existing methods in visual reasoning tasks.
Dual-Phase Accelerated Prompt Optimization (2024.findings-emnlp)

Copied to clipboard

Challenge: Existing methods for prompt optimization make light of the importance of high-quality initialization and the identification of effective directions.
Approach: They propose a method which uses a meta-instruction to generate high-quality initial prompts and iteratively optimize them at the sentence level.
Outcome: The proposed method achieves consistent accuracy gain over baselines with less than five optimization steps.
Unlocking Memorization in Large Language Models with Dynamic Soft Prompting (2024.emnlp-main)

Copied to clipboard

Challenge: Pretrained large language models excel in a variety of natural language processing tasks . however, they pose significant security risks due to their tendency to memorize training data .
Approach: They propose a method to estimate LLM memorization using dynamic, prefix-dependent soft prompts.
Outcome: The proposed method can achieve maximum relative improvement of 135.3% and 39.8% over baseline compared to state-of-the-art methods.
LA-UCL: LLM-Augmented Unsupervised Contrastive Learning Framework for Few-Shot Text Classification (2024.lrec-main)

Copied to clipboard

Challenge: Experimental results show that our model exceeds the baseline models due to the lack of cognitive ability.
Approach: They propose a LLM-Augmented Unsupervised Contrastive Learning Framework which introduces a cognition-enabled Large Language Model (LLM) for efficient data augmentation and presents corresponding contrastive learning strategies.
Outcome: The proposed model exceeds baseline models on six datasets.
Learning to Use Tools via Cooperative and Interactive Agents (2024.findings-emnlp)

Copied to clipboard

Challenge: Existing methods for large language models (LLMs) use one agent to iterate and execute tools, but they suffer from performance degradation when addressing practical tasks.
Approach: They propose a tool learning framework that coordinates three specialized agents for tool selection, tool execution, and action calibration separately.
Outcome: The proposed framework outperforms baseline models on three datasets with 14% higher success rate.
Beyond Decoder-only: Large Language Models Can be Good Encoders for Machine Translation (2025.findings-acl)

Copied to clipboard

Challenge: Recent advances in machine translation have focused on a single pre-trained decoder . encoder-decoder architectures have received relatively little attention in NMT .
Approach: They propose a method that leverages LLMs as MT encoders and pairs them with lightweight decoders to develop universal translation models.
Outcome: The proposed method matches or surpasses baselines in terms of translation quality but achieves 75% reduction in memory footprint of the KV cache.
Answering Ambiguous Questions through Generative Evidence Fusion and Round-Trip Prediction (2021.acl-long)

Copied to clipboard

Challenge: Open-domain question answering is a task to answer questions using passages with diverse topics.
Approach: They propose a model that aggregates evidence from multiple passages to adaptively predict a single answer or a set of question-answer pairs for ambiguous questions.
Outcome: The proposed model achieves state-of-the-art performance on AmbigQA dataset and shows competitive performance on NQ-Open and TriviaQA.
Factual Relation Discrimination for Factuality-oriented Abstractive Summarization (2023.findings-emnlp)

Copied to clipboard

Challenge: Existing factuality-oriented abstractive summarization models only consider the integration of factual information and ignore the causes of factuual errors.
Approach: They propose a factuality-oriented abstractive summarization model that can identify the causes of factual errors.
Outcome: The proposed model outperforms state-of-the-art models in factual metrics.
Masked Path Modeling for Vision-and-Language Navigation (2023.findings-emnlp)

Copied to clipboard

Challenge: A major challenge in vision-and-language navigation is the limited available training data, which hinders the models’ ability to generalize effectively.
Approach: They propose a masked path modeling objective that pretrains an agent using self-collected data for subsequent navigation tasks.
Outcome: The proposed model pretrains an agent using self-collected data for subsequent navigation tasks eliminating the need for external tools.
Think Better, Not Longer: Token-Level Marginal Utility for Efficient Reasoning in Large Reasoning Models (2026.acl-long)

Copied to clipboard

Challenge: Large reasoning models (LRMs) generate explicit Chain-of-Thought rationales, but often suffer from "overthinking".
Approach: They propose a unified training framework to synthesize concise reasoning chains by identifying tokens that reduce the model’s likelihood of the correct answer.
Outcome: Experiments on deepSeek-R1-Distill-Qwen backbones show that MUTO yields better efficiency-accuracy Pareto frontier.
PACE: Prefix-Protected and Difficulty-Aware Compression for Efficient Reasoning (2026.findings-acl)

Copied to clipboard

Challenge: Existing LRMs often suffer from "overthinking" and excessively long reasoning traces . a dual-level framework for length compression of LRM is proposed .
Approach: They propose a framework for prefix-protected and difficulty-aware compression under hierarchical supervision.
Outcome: The proposed framework reduces token usage while improving accuracy on math benchmarks.
Leveraging Unpaired Feedback for Long-Term LLM-based Recommendation Tuning (2025.findings-emnlp)

Copied to clipboard

Challenge: a recent study highlights unpaired feedback as a key challenge for long-term LLM-based recommenders . unpaired user feedback is crucial for improving LLMs in dynamic user environments, authors say .
Approach: They propose a framework that incorporates unpaired feedback into LLMs to improve long-term recommendation performance.
Outcome: The proposed framework improves long-term recommendation performance by incorporating unpaired feedback without requiring paired supervision.
D2PCM:A Multi-Turn Dialogue Dataset with Personalized Contextual Memory (2026.findings-acl)

Copied to clipboard

Challenge: Conventional interactive algorithms have predominantly treated memory as a contextual element, neglecting the nuanced cognitive processes involved in individualized memory encoding and retrieval.
Approach: They propose a multi-turn dialogue dataset with Personalized Contextual Memory to facilitate advanced research on personalized memory processing.
Outcome: The proposed datasets provide a comprehensive benchmark to facilitate advanced research on personalized memory processing.
Vision-Language Models Mistake Head Orientation for Gaze Direction: Nonverbal Conversation Cues (2026.findings-acl)

Copied to clipboard

Challenge: Where someone looks is a nonverbal communication cue that children and adults readily use.
Approach: They used 1,360 real-world photos to construct evaluation stimuli for Vision-Language Models (VLMs) they found a substantial performance gap between VLMs and humans .
Outcome: The proposed model outperforms existing models in predicting gaze direction using head orientation rather than eye appearance.
Learning to Organize a Bag of Words into Sentences with Neural Networks: An Empirical Study (2021.naacl-main)

Copied to clipboard

Challenge: Existing approaches to encode natural languages without orders are lacking.
Approach: They conduct a comprehensive analysis of the ability of neural models to organize sentences from a bag of words under three typical scenarios.
Outcome: The proposed models can reorder or reconstruct sentences from a bag of words under three typical scenarios.
CLaMP 2: Multimodal Music Information Retrieval Across 101 Languages Using Large Language Models (2025.findings-naacl)

Copied to clipboard

Challenge: Current music information retrieval systems struggle to meet linguistic diversity challenges . current systems struggle with text queries in non-English languages .
Approach: They propose a music information retrieval system that supports both ABC notation and MIDI . CLaMP 2 includes a multilingual text encoder and a multiple-modal music encoder .
Outcome: The proposed system achieves state-of-the-art results in multilingual semantic search and music classification across modalities.
DetectBench: Can Large Language Model Detect and Piece Together Implicit Evidence? (2024.findings-emnlp)

Copied to clipboard

Challenge: Existing LLMs' abilities to detect evidence in long contexts are far inferior to humans.
Approach: They propose a benchmark to assess LLMs' abilities in evidence and multi-step commonsense reasoning within a long context.
Outcome: The proposed method improves the performance of LLMs in evidence detection and commonsense reasoning.
Boundary Detection with BERT for Span-level Emotion Cause Analysis (2021.findings-acl)

Copied to clipboard

Challenge: Emotion cause analysis (ECA) is an emerging topic in natural language processing, which aims to identify the reasons behind a given emotion.
Approach: They propose to detect the precise boundaries of text spans conveying accurate emotion causes from the given context by a sequence labeling and position identification problem.
Outcome: The proposed methods outperform existing models on two benchmark datasets on the emotion cause analysis task.
CulFiT: A Fine-grained Cultural-aware LLM Training Paradigm via Multilingual Critique Data Synthesis (2025.acl-long)

Copied to clipboard

Challenge: Large Language Models exhibit a specific cultural bias, neglecting values and differences of low-resource regions.
Approach: They propose a culturally-aware training paradigm that leverages multilingual data and fine-grained reward modeling to enhance cultural sensitivity and inclusivity.
Outcome: The proposed model achieves state-of-the-art in cultural alignment and general reasoning.
Fundamental Capabilities of Large Language Models and their Applications in Domain Scenarios: A Survey (2024.acl-long)

Copied to clipboard

Challenge: Existing benchmark-based evaluations cannot accurately reflect the performance of real-world applications.
Approach: They propose a reliable strategy for domains to choose more robust LLMs for real-world applications.
Outcome: The proposed strategy addresses the challenges faced by domains to choose more robust LLMs for real-world applications.
EmoCharacter: Evaluating the Emotional Fidelity of Role-Playing Agents in Dialogues (2025.naacl-long)

Copied to clipboard

Challenge: EmoCharacter evaluates emotional fidelity of role-playing agents in dialogues . current evaluations focus on personality fidelity, tone imitation, and knowledge consistency .
Approach: They propose a benchmark to assess emotional fidelity of role-playing agents in dialogues using large language models.
Outcome: The proposed benchmark measures emotional fidelity of role-playing agents and the characters they portray.
DialogConv: A Lightweight Fully Convolutional Network for Multi-view Response Selection (2022.emnlp-main)

Copied to clipboard

Challenge: Existing retrieval-based dialogue systems suffer from slow inference or huge number of parameters.
Approach: They propose a lightweight fully convolutional architecture for response selection using convolution.
Outcome: The proposed architecture extracts matching features of context and response from 3D views.
A Novel Two-step Fine-tuning Framework for Transfer Learning in Low-Resource Neural Machine Translation (2024.findings-naacl)

Copied to clipboard

Challenge: Existing transfer learning methods for neural machine translation use a well-trained translation model to initialize a child model with corresponding datasets.
Approach: They propose a two-step fine-tuning framework for transfer learning in low-resource neural machine translation that adjusts the parent model to fit the child language by using the child source data.
Outcome: The proposed framework improves on five low-resource translations on high-resolution languages.
Omni-I2C: A Holistic Benchmark for High-Fidelity Image-to-Code Generation (2026.acl-long)

Copied to clipboard

Challenge: a benchmark is designed to evaluate the capability of Large Multimodal Models (LMMs) in converting complex, structured digital graphics into executable code.
Approach: They propose a benchmark to evaluate the capability of Large Multimodal Models to convert digital graphics into executable code.
Outcome: The proposed benchmark exposes the performance gap among leading LMMs . the benchmark features 1130 meticulously curated samples .
Large Language Models Are Cross-Lingual Knowledge-Free Reasoners (2025.naacl-long)

Copied to clipboard

Challenge: Large language models have demonstrated impressive reasoning capabilities across multiple languages, but the relationship between capabilities in different languages is less explored.
Approach: They decompose the process of reasoning tasks into two separate components: knowledge retrieval and knowledge-free reasoning.
Outcome: The proposed model can be transferred across source-target languages despite secondary impact of resource in some specific target languages, while cross-lingual knowledge retrieval significantly hinders the transfer.
Fine-Mem: Fine-Grained Feedback Alignment for Long-Horizon Memory Management (2026.acl-long)

Copied to clipboard

Challenge: Existing approaches to memory management rely on final task performance as the primary reward, resulting in severe reward sparsity and ineffective credit assignment.
Approach: They propose a framework for fine-grained feedback alignment using a Chunk-level step reward and Evidence-Anchored Reward Attribution to redistribute global rewards based on memory items utilized as evidence in reasoning.
Outcome: The proposed framework outperforms baselines and supports generalization across different model configurations and backbones.
ConvLab-3: A Flexible Dialogue System Toolkit Based on a Unified Data Format (2023.emnlp-demo)

Copied to clipboard

Challenge: Existing tools for building TOD systems often lack a user-friendly interface . a toolkit with advanced, easily integrable modules is needed to bridge this gap .
Approach: They propose a multifaceted dialogue system toolkit that integrates diverse datasets and models with a streamlined training process and in-depth evaluation tools.
Outcome: The proposed toolkit combines RL and transfer learning to support the rapid development and evaluation of robust dialogue policies.
Soft Orthogonal Low-Rank Adaptation for Knowledge Sharing in Large Language Model Continual Learning (2026.acl-long)

Copied to clipboard

Challenge: Existing methods for continual learning (CL) are designed to mitigate catastrophic forgetting while neglecting knowledge sharing across tasks.
Approach: They propose a framework that facilitates knowledge transfer while mitigating catastrophic forgetting by assigning task-specific parameter subspaces to new tasks . they then leverage attribution scores to evaluate task similarity and employ soft orthogonality between task- specific subspace .
Outcome: The proposed framework facilitates knowledge transfer while mitigating catastrophic forgetting.
‘No’ Matters: Out-of-Distribution Detection in Multimodality Multi-Turn Interactive Dialogue Download PDF (2025.findings-acl)

Copied to clipboard

Challenge: Out-of-distribution (OOD) detection is essential for multimodal learning systems . a novel scoring framework is proposed to efficiently detect OOD in multi-round long dialogues .
Approach: They propose a scoring framework that integrates visual language models with a score framework that detects OOD in two key scenarios.
Outcome: The proposed framework detects OOD in two key scenarios: mismatches between dialogue and image input pair and previously unseen labels.
IGenBench: Benchmarking the Reliability of Text-to-Infographic Generation (2026.acl-long)

Copied to clipboard

Challenge: Generated infographics may appear correct at first glance but contain easily overlooked issues, such as distorted data encoding or incorrect textual content.
Approach: They propose to evaluate reliability of text-to-infographic generation using IGenBench . they employ multimodal large language models to verify each question .
Outcome: The proposed framework decomposes reliability verification into atomic yes/no questions based on a taxonomy of 10 question types.
Do MLLMs Understand Pointing? Benchmarking and Enhancing Referential Reasoning in Egocentric Vision (2026.findings-acl)

Copied to clipboard

Challenge: Egocentric AI agents rely on pointing to resolve referential ambiguities in natural language commands.
Approach: They propose a question-answering benchmark to evaluate and enhance pointing reasoning in egocentric views.
Outcome: The proposed benchmark evaluates and enhances pointing reasoning in egocentric views.
Open-Set Living Need Prediction with Large Language Models (2025.findings-acl)

Copied to clipboard

Challenge: Existing approaches to living need prediction treat it as a closed-set classification problem, severely limiting their ability to capture diversity and complexity of living needs.
Approach: They propose a system leveraging large language models for unrestricted need prediction that leverages Maslow's hierarchy of needs to align predictions with human living needs.
Outcome: The proposed system outperforms closed-set approaches on need-based life service recall by an average of 19.37% on real-world datasets.
FRAG: A Flexible Modular Framework for Retrieval-Augmented Generation based on Knowledge Graphs (2025.findings-acl)

Copied to clipboard

Challenge: Existing methods for retrieval-augmented generation struggle with a trade-off between flexibility and retrieval quality.
Approach: They propose a flexible modular KG-RAG framework that uses query text instead of KGs . they propose to use query text to infer the structural information of reasoning paths .
Outcome: The proposed method achieves state-of-the-art performance with high efficiency and low resource consumption.
Autonomous Aspect-Image Instruction a2II: Q-Former Guided Multimodal Sentiment Classification (2024.lrec-main)

Copied to clipboard

Challenge: Existing methods to identify sentiment polarities of aspects are limited by the limited multimodal data available.
Approach: They propose to use instruction tuning paradigm to combine language and vision data to combine text and image modalities.
Outcome: The proposed model achieves state-of-the-art on benchmark datasets and in few-shot settings.
Is MultiWOZ a Solved Task? An Interactive TOD Evaluation Framework with User Simulator (2022.findings-emnlp)

Copied to clipboard

Challenge: Task-oriented dialogue systems are drawing more attention in recent studies . current evaluation methods use annotated utterances in multi-turn dialogue sessions .
Approach: They propose an interactive evaluation framework for task-oriented dialogue (TOD) they build a goal-oriented user simulator based on pre-trained models and use it to generate dialogues .
Outcome: The proposed evaluation framework achieves 98% inform and success rates in the multi-woz dataset and the proposed scores measure the response quality besides the inform and successful rates.
Thinking-Based Non-Thinking: Solving the Reward Hacking Problem in Training Hybrid Reasoning Models via Reinforcement Learning (2026.acl-long)

Copied to clipboard

Challenge: Existing work on large reasoning models (LRMs) focuses on using reinforcement learning (RL) to train hybrid reasoning models that automatically decide whether to engage in thinking or not based on the complexity of the query.
Approach: They propose to use reinforcement learning to train hybrid reasoning models that automatically decide whether to engage in thinking or not based on the complexity of the query.
Outcome: The proposed model reduces token usage by around 50%$ compared to DeepSeek-R1-Distill-Qwen-1.5B/7B and DeepScaleR-1.5b, while significantly improving accuracy.
MMLU-ProX: A Multilingual Benchmark for Advanced Large Language Model Evaluation (2025.emnlp-main)

Copied to clipboard

Challenge: Existing large language model evaluation benchmarks focus on English, while current multilingual tasks lack parallel questions that specifically assess cross-lingual reasoning abilities.
Approach: They propose a comprehensive benchmark covering 29 languages, built on an English benchmark.
Outcome: The MMLU-ProX is a comprehensive benchmark covering 29 languages, built on an English benchmark.
Beyond Scaling: Predicting Patent Approval with Domain-specific Fine-grained Claim Dependency Graph (2024.acl-long)

Copied to clipboard

Challenge: Scaling up language models has demonstrated predictable improvement and unprecedented abilities in many language tasks.
Approach: They propose a fine-grained cLAim depeNdency graph that captures the dependencies within the patent data and extends the embedding-based state-of-the-art (SOTA) they then explore prompt-based methods to harness proprietary LLMs' potential, but find the best results close to random guessing, underlining the ineffectiveness of model scaling-up.
Outcome: The proposed graph methods outperform the standard model scaling methods in the patent approval prediction task and show that they are cost-effective.
Efficient Paths and Dense Rewards: Probabilistic Flow Reasoning for Large Language Models (2026.acl-long)

Copied to clipboard

Challenge: Existing approaches to mitigate inference inefficiency and optimization difficulty are fragmented and constrained by inherent trade-offs.
Approach: They propose a framework that reconceptualizes discrete reasoning steps as a continuous probabilistic flow, quantifying the contribution of each step toward the ground-truth answer.
Outcome: The proposed framework achieves a superior balance between inference efficiency and reasoning performance on challenging benchmarks.
Emotion Trajectory-aware Retrieval for Markov-driven Emotion Anticipation in LLM-based Emotional Support Conversation (2026.findings-acl)

Copied to clipboard

Challenge: Existing strategies focus on planning the next-turn dialogue strategies, while external strategy planners focus on generating empathetic responses.
Approach: They propose a Markov-driven emotion anticipation framework with emotion trajectory-aware retrieval for LLM-based ESC, which anticipates future emotion states to guide strategy planning and achieve sustained emotional support.
Outcome: The proposed framework can anticipate future emotions and achieve sustained emotional support on two datasets with two models.
Consistency-Aware Online Multi-Objective Alignment for Related Search Query Generation (2025.acl-industry)

Copied to clipboard

Challenge: Existing methods fail to reconcile click-through rate (CTR) optimization with topic expansion.
Approach: They propose a query generation framework that aligns click-through rate and topic expansion goals through an online DPO paradigm.
Outcome: The proposed approach achieves significant CTR gains (+2.3%) and higher human-rated query quality compared to state-of-the-art methods.
Chain-of-Procedure: Hierarchical Visual-Language Reasoning for Procedural QA (2026.findings-acl)

Copied to clipboard

Challenge: Recent advances in vision-language models (VLMs) have achieved impressive results on standard image-text tasks, yet their capability in visual procedure question answering (VP-QA) remains largely unexplored.
Approach: They propose a multimodal benchmark specifically designed for visual procedural reasoning that synergizes cross-modal procedure retrieval, context-aware step decomposition, and the next step prediction.
Outcome: The proposed framework significantly outperforms baselines on visual procedure question answering (VP-QA) Experiments on six VLMs show that it performs better than baselines.
Dynamic Spatial-Temporal Aggregation for Skeleton-Aware Sign Language Recognition (2024.lrec-main)

Copied to clipboard

Challenge: Current sign language recognition methods use spatial graphs and temporal modules to capture spatial and temporal features, but their spatial graph modules are typically built on fixed graph structures.
Approach: They propose a new spatial architecture that captures input-sensitive joint relationships and a temporal module to model multi-scale temporal information to capture complex human dynamics.
Outcome: The proposed method achieves state-of-the-art accuracy on four large-scale SLR benchmarks.
ZeroGen: Efficient Zero-shot Learning via Dataset Generation (2022.emnlp-main)

Copied to clipboard

Challenge: Existing approaches to generate training data with pre-trained language models have been found effective in various scenarios.
Approach: They propose an unsupervised zero-shot learning method that generates a dataset from scratch and trains a tiny task model under supervision of the synthesized dataset.
Outcome: The proposed method is annotated-free and efficient, but can provide useful insights from the perspective of data-free model-agnostic knowledge distillation and unreferenced text generation evaluation.
APLOT: Robust Reward Modeling via Adaptive Preference Learning with Optimal Transport (2025.emnlp-main)

Copied to clipboard

Challenge: Experimental results show that RLHF improves performance of Large Language Models . BT-based RMs struggle to distinguish between similar preference responses .
Approach: They propose to enhance BT-based reward models by using an adaptive margin mechanism . they use semantic similarity and reward-predicted reward differences to adjust focus .
Outcome: Experimental results show that the proposed method outperforms existing methods in both in-distribution and OOD settings.
From Discrimination to Generation: Low-Resource Intent Detection with Language Model Instruction Tuning (2024.findings-acl)

Copied to clipboard

Challenge: Existing studies fine-tune discriminative models on specific defined intent classes, preventing them from being directly adopted to new intent domains.
Approach: They propose to use a pre-trained generative intent model to detect new intents from different domains with no parameter updates.
Outcome: The proposed model outperforms baselines that need further fine-tuning or domain-specific samples.
DPEPO: Diverse Parallel Exploration Policy Optimization for LLM-based Agents (2026.acl-long)

Copied to clipboard

Challenge: Existing approaches to large language model (LLM) agents that follow the sequential "reason-then-act" paradigm suffer from limited exploration and incomplete environmental understanding as they interact with only a single environment per step.
Approach: They propose a paradigm that enables an agent to interact with multiple environments simultaneously and share cross-trajectory experiences.
Outcome: The proposed paradigm achieves state-of-the-art (SOTA) success rates while maintaining comparable efficiency to strong sequential baselines.
Mixup Decoding for Diverse Machine Translation (2021.findings-emnlp)

Copied to clipboard

Challenge: Existing methods for generating multiple translations for source and target languages neglect the one-to-many mapping between the source and the target languages.
Approach: They propose a method to generate different translations for the input sentence by linearly interpolating it with different sentence pairs sampled from the training corpus during decoding.
Outcome: Experiments on WMT’16 en-ro, WMT'14 en de, and WMT ‘17 zh-en show that the proposed method outperforms all previous diverse machine translation methods.
GLiM: Integrating Graph Transformer and LLM for Document-Level Biomedical Relation Extraction with Incomplete Labeling (2025.findings-acl)

Copied to clipboard

Challenge: Document-level relation extraction (DocRE) solves problems of document quality . number of entities and entity-pair relations increases, causing incomplete annotations .
Approach: a framework that reduces the problem space using a graph-enhanced Transformer-based model is proposed . GLiM leverages large language models for reasoning to reduce the problem-space .
Outcome: GLiM boosts average recall and F1 scores on biomedical datasets . compared with existing models, GLim outperforms existing models on biomedicine benchmarks compared to existing models .
Simple and Effective Text Matching with Richer Alignment Features (P19-1)

Copied to clipboard

Challenge: Existing models only use a single inter-sequence alignment layer to make full use of this process.
Approach: They propose to keep three key features available for inter-sequence alignment . they conduct experiments on four well-studied benchmark datasets .
Outcome: The proposed model is able to perform on four well-studied datasets with fewer parameters and the inference speed is at least 6 times faster than similar models.
Beyond Static Profiles: Capturing the Fluidity of User Preferences in Diverse Scenarios (2026.findings-acl)

Copied to clipboard

Challenge: Existing approaches to personalize Large Language Models often default to homogeneous behaviors . preferences can shift, and conflict, depending on context, authors argue .
Approach: They propose a hierarchical taxonomy to differentiate between stable and situational preferences . they use a dataset of 10k meticulously curated preferences to test their taxonomies .
Outcome: The proposed model differentiates between stable and situational preferences based on curated user preferences . it provides a practical testbed for advancing dynamic, context-aware personalization in conversational agents.
Understanding LLMs’ Cross-Lingual Context Retrieval: How Good It Is And Where It Comes From (2025.emnlp-main)

Copied to clipboard

Challenge: Cross-lingual context retrieval is a fundamental aspect of cross-lingual alignment, but the performance and mechanism of it for large language models (LLMs) remains unclear.
Approach: They evaluate cross-lingual context retrieval of over 40 large language models . they use cross-linguistic machine reading comprehension as a representative scenario .
Outcome: The results show that open LLMs show strong cross-lingual context retrieval ability . the results also show that their oracle performances improve after training .
Defining and Evaluating Visual Language Models’ Basic Spatial Abilities: A Perspective from Psychometrics (2025.acl-long)

Copied to clipboard

Challenge: Existing studies assessing the spatial abilities of VLMs lack a solid theoretical foundation and lack measurable data.
Approach: They propose a psychometric framework defining five basic spatial abilities in Visual Language Models.
Outcome: The proposed framework defines five basic spatial abilities in Visual Language Models (VLMs) it provides a comprehensive evaluation benchmark and methodological perspective for embodied AI development .
Clear Up Confusion: Iterative Differential Generation for Fine-grained Intent Detection with Contrastive Feedback (2025.coling-main)

Copied to clipboard

Challenge: Recent studies on fine-grained intent detection have focused on collecting large-scale and high-quality samples via crowdsourcing resulting in data scarcity.
Approach: They propose an iterative differential generation framework with contrastive feedback to generate high-quality pseudo samples and accurately capture the crucial nuances in target class distribution.
Outcome: The proposed framework generates high-quality pseudo samples and captures crucial nuances in target class distribution.
Tunable LLM-based Proactive Recommendation Agent (2025.acl-long)

Copied to clipboard

Challenge: Current methods focus on catering to existing user interests, leading to polarized recommendation distributions.
Approach: They propose an LLM-based Actor-Critic Agent framework to cultivate latent interests through multi-step recommendations.
Outcome: The proposed framework optimizes long-term rewards and dynamically evolves with user feedback.
Lock on Target! Precision Unlearning via Directional Control (2025.findings-emnlp)

Copied to clipboard

Challenge: Existing methods for unlearning harmful, sensitive, or outdated knowledge suffer from two critical limitations: (1) collateral forgetting, where erasing target data inadvertently removes related but desirable knowledge, and (2) generality forgetting degrades the model’s general capabilities.
Approach: They propose a method that identifies and leverages a targeted "unlearning direction" in the model's parameter space and selectively updates along this direction.
Outcome: Experiments show that the proposed method achieves state-of-the-art unlearning precision while preserving both related knowledge and general capabilities.
Sparse Frame Grouping Network with Action Centered for Untrimmed Video Paragraph Captioning (2023.findings-emnlp)

Copied to clipboard

Challenge: Existing methods for paragraph captioning videos without event ground truths generate one sentence for each event, but without event labels, it is difficult to locate the transitions between events and minimize repetition.
Approach: They propose a module that dynamically groups event information with the help of action information for the entire video and excludes redundant frames within pre-defined clips.
Outcome: The proposed module outperforms the state-of-the-art methods on all metrics.
HumanLLM: Benchmarking and Improving LLM Anthropomorphism via Human Cognitive Patterns (2026.acl-long)

Copied to clipboard

Challenge: Large Language Models (LLMs) have demonstrated remarkable capabilities in reasoning and generation, serving as the foundation for advanced persona simulation and Role-Playing Language Agents (RPLAs).
Approach: They propose a framework that treats psychological patterns as interacting causal forces and synthesizes 113 scenarios where 2-5 patterns reinforce, conflict, or modulate each other.
Outcome: The proposed framework outperforms Qwen3-32B on multi-pattern dynamics despite 4 fewer parameters.
Thinking Alignment of Scenario-Oriented User Simulation (2026.acl-long)

Copied to clipboard

Challenge: Existing user simulators based on prompting to role-play or SFT focus on imitating textual utterances without considering multi-faceted cognitive processes that underlie human decision-making during interactions.
Approach: They construct a user-simulator dataset that augments 51k human–LLM conversations by reconstructing the user’s inner reasoning during and at the end of each dialogue.
Outcome: The proposed user simulators augment 51k human–LLM conversations by reconstructing the user’s inner reasoning both during and at the end of each dialogue.
ProGen: Progressive Zero-shot Dataset Generation via In-context Feedback (2022.findings-emnlp)

Copied to clipboard

Challenge: Recent work on dataset-generation-based zero-shot learning has shown promising results by training a task-specific model with a dataset synthesized from large pre-trained language models (PLMs).
Approach: They propose a progressive zero-shot dataset generation framework which leverages feedback from the task-specific model to guide the generation of new training data via in-context examples.
Outcome: The proposed framework achieves on-par or superior performance with only 1% synthetic dataset size, when compared to baseline methods without in-context feedback.
ES4R: Speech Encoding Based on Prepositive Affective Modeling for Empathetic Response Generation (2026.acl-long)

Copied to clipboard

Challenge: Existing speech-to-speech large language models rely on ASR transcription or use encoders to extract latent representations, weakening affective information and contextual coherence in multi-turn dialogues.
Approach: They propose a framework for speech-based empathetic response generation that captures turn-level affective states and dialogue-level emotional dynamics.
Outcome: The proposed framework outperforms baselines in automatic and human evaluations and remains robust across different Large Language Model (LLM) backbones.

What is GenGO?

GenGO is an NLP powered publication search system. It currenctly indexes 30k+ papers from ACL Anthology, and implements multi-aspect summarization, semantic search, and more!

Information

About
Limitations