Papers by Yifei Zhang

98 papers
Muse: Towards Reproducible Long-Form Song Generation with Fine-Grained Style Control (2026.findings-acl)

Copied to clipboard

Challenge: Recent commercial systems such as Suno demonstrate strong capabilities in long-form song generation, but academic research remains non-reproducible due to the lack of publicly available training data.
Approach: They propose a system for long-form song generation with fine-grained style conditioning that includes a licensed synthetic dataset and a song generation model, Muse.
Outcome: The proposed system achieves competitive performance on phoneme error rate, text–music style similarity, and audio aesthetic quality while enabling controllable segment-level generation across different musical structures.
VPTQ: Extreme Low-bit Vector Post-Training Quantization for Large Language Models (2024.emnlp-main)

Copied to clipboard

Challenge: Recent research has focused on pushing weight-only quantization to extremely low-bit due to numerical representation limitations.
Approach: They propose a vector-based quantization approach that pushes LLMs to extremely low-bit . they propose scalar-based weight quantization that reduces memory requirements and optimizes storage costs .
Outcome: The proposed method reduces model quantization perplexity by 0.01-0.34 on LLaMA-2, 0.38-0.68 on mistral-7B, 4.41-7.34, on llaMA-3 on QA tasks on average.
EcoSafeRAG: Efficient Security through Context Analysis in Retrieval-Augmented Generation (2025.findings-emnlp)

Copied to clipboard

Challenge: Existing defense methods rely on internal knowledge of the model, which conflicts with the design concept of Retrieval-Augmented Generation (RAG).
Approach: EcoSafeRAG uses sentence-level processing and bait-guided context diversity detection to identify malicious content .
Outcome: EcoSafeRAG uses sentence-level processing and bait-guided context diversity detection to identify malicious content.
TIGER: A Unified Generative Model Framework for Multimodal Dialogue Response Generation (2024.lrec-main)

Copied to clipboard

Challenge: Existing research on multimodal dialogues focuses on textual response generation and visual response selection based on the dialogue context.
Approach: They propose a generative model framework for multimodal dialogue response generation that ground the conversation on an image.
Outcome: The proposed system provides users with an enhanced conversational experience.
Decentralized Arena: Towards Democratic and Scalable Automatic Evaluation of Language Models (2026.acl-long)

Copied to clipboard

Challenge: closed-ended question-based benchmarks struggle with saturation as newer models emerge . crowd-sourced leaderboards rely on costly and slow human judges .
Approach: They propose a framework that leverages collective intelligence from all large language models to evaluate each other.
Outcome: a new framework enables a democratic, pairwise evaluation of all large language models . it achieves 97% correlation with human judgements, while significantly reducing the cost.
STICKERCONV: Generating Multimodal Empathetic Responses from Scratch (2024.acl-long)

Copied to clipboard

Challenge: Prior studies on stickers focused on sentiment analysis and recommendation systems, overlooking their vast potential in empathetic response generation.
Approach: They propose a multimodal empathetic dialogue dataset, STICKERCONV, which simulates human behavior with stickers, and propose evaluative metrics based on LLM.
Outcome: The proposed framework generates contextually relevant and emotionally resonant multimodal empathetic responses, contributing to the advancement of more nuanced and engaging e-dialog systems.
Resource-Limited Joint Multimodal Sentiment Reasoning and Classification via Chain-of-Thought Enhancement and Distillation (2026.findings-acl)

Copied to clipboard

Challenge: Current approaches for Multimodal Sentiment Analysis (MSA) rely on parameter-heavy LLMs for classification, overlooking multimodal sentiment reasoning generation in resource-limited environments.
Approach: They propose a multimodal sentiment reasoning distillation model that employs a teacher-assistant-student paradigm to address deployment constraints in resource-limited environments.
Outcome: The proposed model performs well on a resource-limited JMSRC task with only 3B parameters and shows generalization and interpretability.
From Charts to Code: A Hierarchical Benchmark for Multimodal Models (2026.acl-long)

Copied to clipboard

Challenge: Chart2Code is a new benchmark for evaluating the natural language to chart code generation capabilities of large multimodal models.
Approach: They introduce Chart2Code, a new benchmark for evaluating the natural language to chart code generation capabilities of large multimodal models.
Outcome: The proposed benchmark is the first to scale task complexity while capturing diverse scenarios.
Personalized Microblog Sentiment Classification via Adversarial Cross-lingual Multi-task Learning (D18-1)

Copied to clipboard

Challenge: Existing personalized microblog sentiment classification methods suffer from the insufficiency of discriminative tweets for personalization learning.
Approach: They propose to use user-attention-based Convolutional Neural Networks to capture individuality and opinion bias in microblog posts and a novel adversarial cross-lingual learning framework to enrich the user post representation.
Outcome: The proposed method outperforms state-of-the-art baseline algorithms with large margins on English and Chinese microblog datasets.
Reasoning as Gradient: Scaling MLE Agents Beyond Tree Search (2026.findings-acl)

Copied to clipboard

Challenge: LLM-based agents for machine learning engineering rely on tree search to rank candidates.
Approach: They propose an LLM-based agent that operationalizes gradient-based optimization.
Outcome: The proposed agent achieves a state-of-the-art 35.1% any-medal rate on MLE-Bench with a limited budget on a single GPU.
MulZDG: Multilingual Code-Switching Framework for Zero-shot Dialogue Generation (2022.coling-1)

Copied to clipboard

Challenge: Existing zero-shot dialogue generation systems rely on large-scale pre-trained language models.
Approach: They propose a multilingual learning framework for zero-shot dialogue generation that can transfer knowledge from an English corpus to a non-English corpus with zero samples.
Outcome: The proposed framework can transfer knowledge from an English corpus to a non-English corpus with zero samples.
From Detection to Understanding: Multi-Turn Reasoning for Video Misinformation Analysis (2026.acl-long)

Copied to clipboard

Challenge: Existing benchmarks focus on binary veracity judgments and do not evaluate process-level justifications for misinformation models.
Approach: They propose a video misinformation analysis benchmark that assesses reasoning in video misinterpretation.
Outcome: The proposed framework improves reasoning accuracy and explanation quality compared to existing models . it covers 12 fine-grained deception categories and progresses from perceptual attribution to intent and persuasion analysis.
Alleviating Sparsity of Open Knowledge Graphs with Ternary Contrastive Learning (2022.findings-emnlp)

Copied to clipboard

Challenge: Existing approaches to learning KG triplets ignore ternary propagation patterns and ignore zero-shot, few-shot and synonymity problems.
Approach: They propose a framework for contrastive learning based on ternary propagation patterns among head, relation and tail.
Outcome: Experiments on benchmarks show that TernaryCL is superior to state-of-the-art models.
Chain of Ideas: Revolutionizing Research Via Novel Idea Development with LLM Agents (2025.findings-emnlp)

Copied to clipboard

Challenge: Existing methods for idea generation either trivially prompt LLMs or expose LLM to extensive literature without indicating useful information.
Approach: They propose a chain-of-ideas agent that organizes literature in a chains structure . they propose evaluating idea-generation methods from different perspectives .
Outcome: The proposed agent outperforms existing methods and matches human quality in idea generation.
Knowledge-enhanced Mixed-initiative Dialogue System for Emotional Support Conversations (2023.acl-long)

Copied to clipboard

Challenge: Experimental results show the superiority of a mixed-initiative framework for emotional support conversation (ESC) ESC systems are emerging to provide prompt and convenient emotional support for helpseekers, including mental health support, counseling or motivational interviewing.
Approach: They propose a knowledge-enhanced mixed-initiative framework that retrieves actual case knowledge from a large-scale mental health knowledge graph for generating mixed-initiative responses.
Outcome: The proposed framework retrieves actual case knowledge from a large-scale mental health knowledge graph for generating mixed-initiative responses.
Locomo-Plus: Beyond-Factual Cognitive Memory Evaluation Framework for LLM Agents (2026.acl-long)

Copied to clipboard

Challenge: Existing benchmarks and evaluation protocols focus on surface-level factual recall.
Approach: They propose a benchmark for assessing cognitive memory under cue–trigger semantic disconnect.
Outcome: The proposed framework reveals failures not captured by existing benchmarks.
Train Once, and Decode As You Like (2020.coling-main)

Copied to clipboard

Challenge: Existing approaches to machine translation support autoregressive, semi-autoregressive and refinement-based non-auto-regressives.
Approach: They propose a unified approach for supporting different generation manners of machine translation including autoregressive, semi-autoregressive and refinement-based non-auto-regressives.
Outcome: The proposed approach achieves better or competitive translation performance compared with strong baseline models in all the settings.
Confront Insider Threat: Precise Anomaly Detection in Behavior Logs Based on LLM Fine-Tuning (2025.coling-main)

Copied to clipboard

Challenge: Current methods for insider threat detection suffer from low precision and information loss . a novel approach to detect insider threats is needed to improve accuracy .
Approach: They propose a precise anomaly detection solution based on Large Language Model (LLM) fine-tuning . they represent user behavior in natural language and implement a threat tracing mechanism .
Outcome: The proposed solution achieves an F1 score of 0.8941 on the CERT v6.2 dataset .
Contrastive Learning with Generated Representations for Inductive Knowledge Graph Embedding (2023.findings-acl)

Copied to clipboard

Challenge: Existing methods for inductive knowledge Graphs are limited by sparsity and implicit transfer.
Approach: They propose a Contrastive Learning framework with graph guided Variational autoencoder on Meta-KGs to capture and transfer entities.
Outcome: The proposed framework outperforms state-of-the-art methods with extensive experiments.
AnnaAgent: Dynamic Evolution Agent System with Multi-Session Memory for Realistic Seeker Simulation (2025.findings-acl)

Copied to clipboard

Challenge: Existing models of seeker simulations are limited by the cost and ethical concerns of involving real seekers in mental health research.
Approach: They propose an emotional and cognitive dynamic agent system equipped with tertiary memory to enable dynamic control of the simulator's configurations.
Outcome: The proposed system achieves more realistic seeker simulation compared to baselines.
Making Language Models Better Reasoners with Step-Aware Verifier (2023.acl-long)

Copied to clipboard

Challenge: Large language models have made impressive progress in few-shot learning but still face difficulties in reasoning tasks such as GSM8K.
Approach: They propose a new approach that uses a verifier to filter out incorrect answers based on a weighted voting scheme to improve reasoning ability of language models.
Outcome: The proposed approach improves GSM8K reasoning rate by 17.9% to 58.1%.
INTERS: Unlocking the Power of Large Language Models in Search with Instruction Tuning (2024.acl-long)

Copied to clipboard

Challenge: Large language models (LLMs) have demonstrated impressive capabilities in various natural language processing tasks, but their application to information retrieval tasks is still challenging due to the infrequent occurrence of many IR-specific concepts in natural language.
Approach: They propose to use instruction tuning to enhance LLMs' proficiency in IR tasks by combining a dataset with manually written templates to analyze the effects of instruction design, template diversity, few-shot demonstrations, and the volume of instructions.
Outcome: The proposed model can be used to perform query understanding, document understanding, and query-document relationship understanding tasks.
EmpCRL: Controllable Empathetic Response Generation via In-Context Commonsense Reasoning and Reinforcement Learning (2024.lrec-main)

Copied to clipboard

Challenge: Existing studies lack the perception of fine-grained dialogue emotion propagation, and have limitations in reasoning about the intentions of users on cognition, which affect the quality of empathetic response.
Approach: They propose to use commonsense reasoning and reinforcement learning to generate empathetic response based on in-context commonsensing and contextual reasoning to broaden cognitive boundaries.
Outcome: The proposed model outperforms state-of-the-art models in automatic and human evaluation.
AdaptiveK: Complexity-Driven Sparse Autoencoders for Interpretable Language Model Representations (2026.findings-acl)

Copied to clipboard

Challenge: Existing approaches to decomposing model activations into interpretable features fail to account for input complexity.
Approach: They propose a framework that dynamically adjusts sparsity levels based on the semantic complexity of each input.
Outcome: The proposed framework outperforms fixed-sparsity approaches on reconstruction fidelity, explained variance, cosine similarity and interpretability metrics while eliminating the burden of extensive hyperparameter tuning.
GenPT: Beyond Self-Report for Reliable LLM Psychometrics via Generative Projective Testing (2026.acl-long)

Copied to clipboard

Challenge: Large language models (LLMs) inherit contamination from training corpora, directional bias under social-desirability framing, and limited responsiveness to context beyond the item text.
Approach: They propose a paradigm that reformulates TAT, Rorschach, and SCT with newly generated stimuli and organises assessment as a three-stage pipeline.
Outcome: The proposed paradigm reformulates TAT, Rorschach, and SCT with newly generated stimuli and organises assessment as a three-stage pipeline.
Towards Interactivity and Interpretability: A Rationale-based Legal Judgment Prediction Framework (2022.emnlp-main)

Copied to clipboard

Challenge: Existing models lack interpretability due to the neglect of rationale in the prediction process.
Approach: They propose a rationale-based legal judgment prediction framework that follows the judge's real trial logic and provides good interactivity and interpretability.
Outcome: The proposed framework provides good interactivity and interpretability which enables practical use.
Doc2hash: Learning Discrete Latent variables for Documents Retrieval (N19-1)

Copied to clipboard

Challenge: Learning to hash via generative model is a powerful paradigm for fast similarity search in documents retrieval.
Approach: They propose a method that trains a generative model to generate hash codes by using continuous relaxation on priors.
Outcome: The proposed method outperforms other state-of-the-art methods in qualitative and quantitative experiments.
Data-Efficient Selection via Grammatical Complexity in Continual Pre-training of Domain-Specific LLMs (2025.emnlp-main)

Copied to clipboard

Challenge: Existing data selection strategies for continual pre-training of large language models often rely on scarce labeled data or computationally expensive LLMs.
Approach: They propose an annotation-independent data selection framework for CPT that evaluates grammatical complexity using lexical diversity and syntactic complexity.
Outcome: The proposed framework outperforms baselines on a financial dataset and surpasses full-data training by 1.7% using only 20% of the data.
TOOL-ED: Enhancing Empathetic Response Generation with the Tool Calling Capability of LLM (2025.coling-main)

Copied to clipboard

Challenge: Empathetic conversation is a crucial characteristic in daily conversations between individuals.
Approach: They propose an Emotional Knowledge Tool Calling framework which encapsulates commonsense knowledge bases as empathetic tools, enabling LLMs to integrate external knowledge flexibly.
Outcome: The proposed framework can generate empathetic responses effectively on the TOOL-ED dataset.
IPR: Intelligent Prompt Routing with User-Controlled Quality-Cost Trade-offs (2025.emnlp-industry)

Copied to clipboard

Challenge: Existing systems require users to manually select models or employ rigid routing rules that fail to capture the continuous spectrum of query complexity.
Approach: They propose a quality-constrained intelligent prompt routing framework that automatically selects optimal models based on predicted response quality and user-specified tolerance levels.
Outcome: The proposed framework achieves 43.9% cost reduction while maintaining quality parity with strongest model in the Claude family and processes requests with sub-150ms latency.
MoLAN: A Unified Modality-Aware Noise Dynamic Editing Framework for Multimodal Sentiment Analysis (2026.findings-acl)

Copied to clipboard

Challenge: Existing approaches to multimodal sentiment analysis treat entire modality as an independent unit for feature enhancement or denoising, which often suppresses redundant noise at the cost of weakening critical information.
Approach: They propose a ModaLity-aware noise dynAmic editiNg framework that performs modality-awful block partitioning by dividing features of each modality into multiple blocks.
Outcome: Experiments on five models and four datasets show that MoLAN+ achieves the state-of-the-art performance.
BadAgent: Inserting and Activating Backdoor Attacks in LLM Agents (2024.acl-long)

Copied to clipboard

Challenge: Xi et al., 2023) show that LLM-based intelligent agents are vulnerable to backdoor attacks.
Approach: They propose to build LLM-based intelligent agents using trained LLMs and fine-tune them on data for the agent task.
Outcome: The proposed methods are robust even after fine-tuning on trusted data.
Towards Provably Secure Generative AI: Reliable Consensus Sampling (2026.findings-acl)

Copied to clipboard

Challenge: Existing research on generative AI security is driven by mutually reinforcing attack and defense methodologies grounded in empirical experience.
Approach: They propose a new algorithm that uses a random sampling algorithm to control risk.
Outcome: The proposed algorithm improves robustness and utility while maintaining latency comparable to existing algorithms.
HiFT: A Hierarchical Full Parameter Fine-Tuning Strategy (2024.emnlp-main)

Copied to clipboard

Challenge: Existing approaches to fine-tuning language models use zeroth-order optimizers to conserve GPU memory.
Approach: They propose a full-parameter fine-tuning strategy which updates a subset of parameters at each training step.
Outcome: The proposed approach reduces the amount of gradients and optimizer state parameters residing in GPU memory at the same time, thereby reducing GPU memory usage.
MUR: Momentum Uncertainty guided Reasoning for Large Language Models (2026.acl-long)

Copied to clipboard

Challenge: Existing methods for optimizing reasoning quality are limited by overthinking.
Approach: They propose a method that allocates thinking budgets to critical reasoning steps by tracking and aggregating step-wise uncertainty over time.
Outcome: The proposed method reduces computation by over 45% on average while improving accuracy by 0.33–3.46%.
SemanticCamo: Jailbreaking Large Language Models through Semantic Camouflage (2025.findings-acl)

Copied to clipboard

Challenge: Large Language Models (LLMs) have made safety issues of LLMs more prominent and critical.
Approach: They propose a framework which attacks LLMs through semantic camouflage and replaces unsafe content with semantic features to conceal malicious intent .
Outcome: The proposed framework outperforms existing models in over 80% of cases and is highly effective against various defenses.
MUSE: A Multimodal Conversational Recommendation Dataset with Scenario-Grounded User Profiles (2025.findings-acl)

Copied to clipboard

Challenge: Existing research focuses solely on text, leaving a gap with practical applications.
Approach: They propose to synthesize a multimodal conversational recommendation dataset using multimodal large language models to automatically synthesized data from 7,000 conversations in the Clothing domain.
Outcome: The proposed dataset contains 83,148 utterances from 7,000 conversations centered around the Clothing domain.
Unleashing the Power of LLMs in Court View Generation by Stimulating Internal Knowledge and Incorporating External Knowledge (2024.findings-naacl)

Copied to clipboard

Challenge: Large Language Models (LLMs) have made remarkable strides in language generation, but they encounter difficulties in the knowledge-intensive legal domain.
Approach: They propose to decompose court views into different parts, stimulate internal knowledge, and incorporate external information to unleash the power of LLMs in the task.
Outcome: The proposed method generates more accurate and reliable court views on two real-world datasets LAIC2021 and CJO2022.
A Co-Attention Neural Network Model for Emotion Cause Analysis with Emotional Context Awareness (D18-1)

Copied to clipboard

Challenge: Existing methods ignore the contexts around the emotion word which can provide an emotion cause clue.
Approach: They propose a co-attention neural network model for emotion cause analysis with emotional context awareness.
Outcome: The proposed model outperforms the state-of-the-art methods.
Neural Parameter Search for Slimmer Fine-Tuned Models and Better Transfer (2025.acl-long)

Copied to clipboard

Challenge: Foundational models and their checkpoints have advanced deep learning, boosting performance across applications.
Approach: They propose a method for pruning fine-tuned models by calculating differences between them and original model.
Outcome: The proposed method can improve performance across vision, NLP, and multi-modal benchmarks.
CMMLU: Measuring massive multitask language understanding in Chinese (2024.findings-acl)

Copied to clipboard

Challenge: Existing large language models struggle to achieve an accuracy of even 60%, which is the pass mark for Chinese exams.
Approach: They propose to use CMMLU to evaluate Chinese multilingual and Chinese LLMs in a comprehensive benchmark that covers various subjects and settings.
Outcome: The proposed benchmark covers natural sciences, social sciences, engineering, and the humanities and aims to improve on existing models.
Boundary Detection with BERT for Span-level Emotion Cause Analysis (2021.findings-acl)

Copied to clipboard

Challenge: Emotion cause analysis (ECA) is an emerging topic in natural language processing, which aims to identify the reasons behind a given emotion.
Approach: They propose to detect the precise boundaries of text spans conveying accurate emotion causes from the given context by a sequence labeling and position identification problem.
Outcome: The proposed methods outperform existing models on two benchmark datasets on the emotion cause analysis task.
Identifying the Achilles’ Heel: An Iterative Method for Uncovering Factual Errors in Large Language Models (2026.findings-acl)

Copied to clipboard

Challenge: Current methods for evaluating LLMs’ veracity are limited by the need for extensive human labor, test data contamination, or limited scope, hindering efficient and effective exposure of errors.
Approach: They propose a framework that extracts fact triplets to generate diverse question types using rule-based natural language processing techniques.
Outcome: The proposed framework can trigger factual errors in up to 55% of questions in large LLMs while maintaining coverage of questions.
ELAD: Explanation-Guided Large Language Models Active Distillation (2024.findings-acl)

Copied to clipboard

Challenge: Large Language Models (LLMs) are hindered by their memory inefficiency, computational demands, and the high costs of API inferences.
Approach: They propose an Explanation-Guided LLMs Active Distillation framework that employs an active learning strategy to optimize the balance between annotation costs and model performance.
Outcome: The proposed framework significantly improves the efficiency of LLMs knowledge distillation.
MeepleLM: A Virtual Playtester Simulating Diverse Subjective Experiences (2026.acl-long)

Copied to clipboard

Challenge: Recent advances in large language models have expanded the role of board games as creative co-designers . however, current systems lack the capacity to offer constructive critique grounded in the emergent user experience .
Approach: They propose a large language model that internalizes persona-specific reasoning patterns to accurately simulate the subjective feedback of diverse player archetypes.
Outcome: The proposed model outperforms commercial models in community alignment and critique quality.
Pixel-Level Reasoning Segmentation via Multi-turn Conversations (2025.acl-long)

Copied to clipboard

Challenge: Existing visual perception systems focus on region-level segmentation in single-turn dialogues . existing systems cannot reason at the pixel level and comprehend dynamic user intent .
Approach: They propose a task that tracks evolving user intent via multi-turn interactions for fine-grained segmentation.
Outcome: The proposed method outperforms existing baselines in segmentation and reasoning metrics.
DialogConv: A Lightweight Fully Convolutional Network for Multi-view Response Selection (2022.emnlp-main)

Copied to clipboard

Challenge: Existing retrieval-based dialogue systems suffer from slow inference or huge number of parameters.
Approach: They propose a lightweight fully convolutional architecture for response selection using convolution.
Outcome: The proposed architecture extracts matching features of context and response from 3D views.
ParetoRAG: Leveraging Sentence-Context Attention for Robust and Efficient Retrieval-Augmented Generation (2025.findings-emnlp)

Copied to clipboard

Challenge: Retrieval-augmented generation systems face persistent challenges in retrieval inefficiency and the inability of LLMs to filter out irrelevant information.
Approach: They propose an unsupervised framework that optimizes RAG systems through sentence-level refinement guided by the Pareto principle.
Outcome: The proposed framework achieves dual improvements in retrieval precision and generation quality without additional training or API resources while using only 40% of the tokens compared to traditional approaches.
DR-HM: Distill-then-Reinforce Training with Cognition-Aware Data Synthesis for Harmful Meme Detection (2026.findings-acl)

Copied to clipboard

Challenge: Current methods for harmful meme detection lack the knowledge required to identify such hate . current methods lack the ability to identify cultural stereotypes and visual metaphors .
Approach: They propose a framework that decomposes meme analysis into a human-inspired reasoning process . they propose DR-HM to transfer knowledge from closed-source models while mitigating biases .
Outcome: The proposed framework outperforms existing methods on three benchmark datasets.
From Remembering to Metacognition: Do Existing Benchmarks Accurately Evaluate LLMs? (2025.findings-emnlp)

Copied to clipboard

Challenge: Existing benchmark datasets focus on low-level cognitive tasks while providing limited coverage of higher-level reasoning skills.
Approach: They analyze the cognitive depth of popular LLM benchmarks using Bloom’s Taxonomy to evaluate both the cognitive and knowledge dimensions.
Outcome: The results show that incorporating higher-level cognitive instructions into the current instruction fine-tuning process improves model performance.
Precedent-Enhanced Legal Judgment Prediction with LLM and Domain-Model Collaboration (2023.emnlp-main)

Copied to clipboard

Challenge: Recent advances in deep learning have enabled a variety of techniques to be used to solve the LJP task.
Approach: They propose a framework that leverages the strength of both LLMs and domain-specific models in the context of precedents.
Outcome: The proposed framework leverages the strength of both LLM and domain models in the context of precedents.
VortexPIA: Indirect Prompt Injection Attack against LLMs for Efficient Extraction of User Privacy (2026.findings-eacl)

Copied to clipboard

Challenge: Large language models (LLMs) have been widely deployed in Conversational AIs . however, the methods proposed in the study rely on a white-box setting .
Approach: They propose an indirect prompt injection attack that induces privacy extraction in LLMs . they use token-efficient data containing false memories to inject LLM data .
Outcome: The proposed method outperforms baselines and achieves state-of-the-art performance.
DUET: Joint Exploration of User–Item Profiles in Recommendation System (2026.findings-acl)

Copied to clipboard

Challenge: Existing LLMs are opaque and difficult to interpret, resulting in limited interpretability.
Approach: They propose an interaction-aware profile generator that jointly produces user and item profiles conditioned on both user history and item evidence.
Outcome: The proposed model outperforms baselines on three real-world datasets.
Learning to Improve Persona Consistency in Multi-party Dialogue Generation via Text Knowledge Enhancement (2022.coling-1)

Copied to clipboard

Challenge: Existing methods suffer from incomprehensive persona tags that have unique and obscure meanings to describe human’s personality.
Approach: They propose a graph convolution network model with addressee selecting mechanism that integrates personas, dialogue utterances, and external text knowledge in a unified graph.
Outcome: The proposed model outperforms baselines by large margins and improves persona consistency in the generated responses.
KC-ISA: An Implicit Sentiment Analysis Model Combining Knowledge Enhancement and Context Features (2022.coling-1)

Copied to clipboard

Challenge: Existing research results on explicit sentiment analysis are limited . implicit sentiment analysis is a process of analyzing text based on whether it contains explicit sentiment words.
Approach: They propose a model that integrates external knowledge and contextual features . they use a knowledge graph to supplement implicit sentiment expression .
Outcome: The proposed model can achieve better results on the SMP2019 implicit sentiment analysis dataset.
Can MLLMs Understand the Deep Implication Behind Chinese Images? (2025.acl-long)

Copied to clipboard

Challenge: MLLMs perform poorly on traditional culture images, indicating limitations in understanding high-level semantics and lacking a deep knowledge base of Chinese traditional culture.
Approach: They propose to use Chinese images to assess MLLMs' higher-order perception and understanding of Chinese visual content.
Outcome: The proposed model incorporates images that represent Chinese traditional culture, such as famous Chinese traditional paintings, to ensure the authenticity of the Chinese context.
Large Language Model Agents in Finance: A Survey Bridging Research, Practice, and Real-World Deployment (2025.findings-emnlp)

Copied to clipboard

Challenge: a systematic review of large language models (LLMs) is conducted to better align their capabilities with real-world demands.
Approach: They propose a functional taxonomy mapping financial domains to tasks, datasets, and institutional constraints. they catalog over 30 financial benchmarks and 20 representative models.
Outcome: The proposed model frameworks are bridging financial practice and LLM research.
CtrlNews: LLM-based Multi-Agent Controllable News Writing via Knowledge Gravitational Field (2025.findings-emnlp)

Copied to clipboard

Challenge: Current approaches to news writing rely on superficially retrieved information and oversimplified knowledge enumeration resulting in shallow, repetitive, and unordered outputs.
Approach: They propose an LLM-based multi-agent controllable news writing framework called CtrlNews . they propose a fine-grained viewpoint control mechanism to regulate bias, emotion, and exaggeration attributes.
Outcome: The proposed framework simulates expert questioning through automated role assignment and question generation followed by a three-layer hierarchical gravitational graph iteratively refined via expansion-reflection cycles.
RolePlot: A Systematic Framework for Evaluating and Enhancing the Plot-Progression Capabilities of Role-Playing Agents (2025.acl-long)

Copied to clipboard

Challenge: Existing research has focused on role-playing agents’ ability to portray specified characters, but their ability to advance the plot requires substantial improvements to deliver more engaging interaction.
Approach: They propose a role-playing framework to evaluate and enhance the plot-progression capabilities of role-players.
Outcome: The proposed framework improves RPAs’ ability to time plot developments and yields a significant increase in conversation turns and sustained higher arousal levels.
JX4MEI: Multimodal Semantically-Enhanced LLM for Joint Multimodal Emotion-Intent Explanation and Classification (2026.findings-acl)

Copied to clipboard

Challenge: Existing multimodal emotion and intent recognition tasks focus on classification, not rationale and intrinsic connections between these states.
Approach: They propose a task that requires models to jointly predict emotion and intent while generating natural language explanations for why they co-occur.
Outcome: The proposed model outperforms baseline models in prediction and explanation generation.
Sequential-NIAH: A Needle-In-A-Haystack Benchmark for Extracting Sequential Needles from Long Contexts (2025.emnlp-main)

Copied to clipboard

Challenge: Recent models have extended Corresponding Author. context lengths to millions of tokens while maintaining reasoning and comprehension capabilities.
Approach: They propose a benchmark to evaluate the ability of large language models to extract sequential information items from long contexts.
Outcome: The proposed model achieves maximum accuracy of 63.50% on six well-known LLMs.
Multimodal Sentiment Detection Based on Multi-channel Graph Neural Networks (2021.acl-long)

Copied to clipboard

Challenge: Existing studies only considered the representation of a single image-text post . Fig. 1 shows that multimodal sentiment expressions have global characteristics .
Approach: They propose a multi-channel Graph Neural Networks with Sentiment-awareness approach for image-text sentiment detection.
Outcome: The proposed approach is effective for image-text sentiment detection on three publicly available datasets.
UCFE: A User-Centric Financial Expertise Benchmark for Large Language Models (2025.findings-naacl)

Copied to clipboard

Challenge: Recent advances in large language models (LLMs) have expanded their potential applications in finance.
Approach: They propose a framework to evaluate the ability of large language models to handle financial tasks using human expert evaluations and task-specific interactions.
Outcome: The proposed framework evaluates the ability of large language models to handle complex financial tasks and combines human expert evaluations with dynamic, task-specific interactions to simulate the complexities of evolving financial scenarios.
Raw Pointer Rewriting with LLMs for Translating C to Safer Rust (2026.findings-acl)

Copied to clipboard

Challenge: C2Rust is a system programming language that enforces strict memory and type safety guarantees.
Approach: They propose a raw pointer rewriting technique that lifts raw pointers in individual functions to appropriate Rust data structures.
Outcome: The proposed technique eliminates 18.57% of local raw pointers and improves memory safety on 28 real-world C projects.
To See a World in a Spark of Neuron: Disentangling Multi-Task Interference for Training-Free Model Merging (2025.emnlp-main)

Copied to clipboard

Challenge: Existing approaches to model merging ignore the fundamental roles of neurons, connectivity and activation.
Approach: They propose a framework that relies on neuronal mechanisms to mitigate task interference . they decomposed task-specific representations into two complementary subspaces . their results offer new insights into mitigating task interference and improving knowledge fusion .
Outcome: The proposed framework reduces task interference within neurons and improves knowledge fusion.
FoodieQA: A Multimodal Dataset for Fine-Grained Understanding of Chinese Food Culture (2024.emnlp-main)

Copied to clipboard

Challenge: FoodieQA is a manually curated, fine-grained image-text dataset capturing the intricate features of food cultures across various regions in China.
Approach: They evaluate vision–language Models and large language models on unseen food images and corresponding questions.
Outcome: The proposed dataset evaluates vision–language Models and large language models on unseen food images and corresponding questions.
Ground Every Sentence: Improving Retrieval-Augmented LLMs with Interleaved Reference-Claim Generation (2025.findings-naacl)

Copied to clipboard

Challenge: Existing methods to enhance credibility and verifiability of large language models (LLMs) mainly focus on passage-level or paragraph-level references or citations, which fall short in verifikatability.
Approach: They propose a method that provides sentence-level citations in LLM-generated responses.
Outcome: The proposed method achieves 90% accuracy in long-form question-answering tasks.
Improving Role-Oriented Dialogue Summarization with Interaction-Aware Contrastive Learning (2024.lrec-main)

Copied to clipboard

Challenge: Existing methods for encoding dialogues do not capture interaction information between roles, thus ignore interaction-related key information.
Approach: They propose a contrastive learning based interaction-aware model for the role-oriented dialogue summarization namely CIAM and use it to train the decoder to learn role-level interaction.
Outcome: The proposed model captures interaction information between different roles and produces informative summaries on two public datasets.
GUITester: Enabling GUI Agents for Exploratory Defect Discovery (2026.findings-acl)

Copied to clipboard

Challenge: Exploratory GUI testing is essential for software quality but suffers from high manual costs.
Approach: They propose a framework that decouples navigation from verification via two modules . they propose 143 tasks and a GUITestBench benchmark that features 26 defects .
Outcome: The proposed framework outperforms state-of-the-art benchmarks in 143 tasks and 26 defects.
Summarize-Exemplify-Reflect: Data-driven Insight Distillation Empowers LLMs for Few-shot Tabular Classification (2025.findings-emnlp)

Copied to clipboard

Challenge: Recent studies show the promise of large language models for few-shot tabular classification but highlight challenges due to the variability in structured data.
Approach: They propose a framework that distills data into actionable insights to enable robust and effective classification by large language models.
Outcome: The proposed framework integrates rule summarization, strategic exemplification, and insight reflection through deep collaboration between LLMs and data modeling techniques.
WebSynthesis: World Model-Guided Monte Carlo Tree Search for Efficient WebAgent Trajectory Synthesis (2026.acl-long)

Copied to clipboard

Challenge: Recent advances in large language models have enabled increasingly capable web agents . however, training such agents at scale still relies on high-quality interaction trajectories that are difficult to obtain at scale.
Approach: They propose a framework for scalable trajectory synthesis that simulates state transitions without network dependencies and integrates Monte Carlo Tree Search to enable reversible exploration over the simulated state space.
Outcome: Experiments on WebArena, WebVoyager, and Mind2Web-Online show that agents trained exclusively on synthesized trajectories outperform those trained on real-world data.
PlaM: Training-Free Plateau-Guided Model Merging for Better Visual Grounding in MLLMs (2026.findings-acl)

Copied to clipboard

Challenge: Multimodal instruction fine-tuning degrades textual reasoning capability, undermining multimodal performance.
Approach: They propose a plateau-guided model merging method that selectively injects base language model parameters into MLLMs to mitigate this degradation.
Outcome: The proposed framework reduces multimodal instruction fine-tuning degradation by incorporating a plateau-guided model merging method into MLLMs.
Answer-guided and Semantic Coherent Question Generation in Open-domain Conversation (D19-1)

Copied to clipboard

Challenge: Existing methods for question generation suffer from dullness and deviation problem, which can lead to deviated or dull questions.
Approach: They propose two methods to enhance semantic coherence between question and answer by using a coherent score and adversarial training to explicitly control question generation.
Outcome: The proposed methods outperform state-of-the-art baseline algorithms with large margins in raising semantic coherent questions.
CIRAG: Construction–Integration Retrieval and Adaptive Generation for Multi-hop Question Answering (2026.acl-long)

Copied to clipboard

Challenge: Existing methods for iterative retrieval-augmented generation (iRAG) suffer from greedy single-path expansion and granularity–demand mismatch .
Approach: They propose a model that constructs candidate triples and history-conditionally integrates them to distill core triples to generate the next-hop query.
Outcome: The proposed model mitigates the greedy single-path expansion and granularity–demand mismatch by preserving multiple plausible evidence chains.
From General Reward to Targeted Reward: Improving Open-ended Long-context Generation Models (2025.emnlp-main)

Copied to clipboard

Challenge: Current research on long-form context in Large Language Models (LLMs) focuses on understanding of long-contexts, but the open-ended Long Text Generation (Open-LTG) remains underexplored.
Approach: They propose a method that uses data synthesis and a reward signal to enhance model performance.
Outcome: The proposed method outperforms GPT-4-Turbo and improves performance by 20% on the Open-LTG task.
AutoSDT: Scaling Data-Driven Discovery Tasks Toward Open Co-Scientists (2025.emnlp-main)

Copied to clipboard

Challenge: AutoSDT-5K is the only automatically collected and the largest open dataset for data-driven scientific discovery.
Approach: They propose an automatic pipeline that collects high-quality coding tasks in real-world data-driven discovery workflows.
Outcome: The proposed pipeline synthesizes accurate tasks and tasks from a dataset of 5,404 tasks covering four scientific disciplines and 756 Python packages.
Language Models as Continuous Self-Evolving Data Engineers (2025.emnlp-main)

Copied to clipboard

Challenge: Large Language Models (LLMs) have demonstrated remarkable capabilities, yet their further evolution is often hampered by the scarcity of high-quality training data and the heavy reliance of traditional methods on expert-labeled data.
Approach: They propose a paradigm that enables LLMs to train themselves by generating, cleaning, reviewing and annotating data with preference information.
Outcome: The proposed model can generate, clean, review, and annotate data with preference information significantly reducing time and cost of post-training data construction.
NEAT: Neuron-Based Early Exit for Large Reasoning Models (2026.findings-acl)

Copied to clipboard

Challenge: Existing approaches to reduce overthinking require additional rollout computation or externally labeled datasets.
Approach: They propose a Neuron-based Early reAsoning exiT framework that monitors neuron-level activation dynamics to enable training-free early exits.
Outcome: The proposed framework reduces the amount of reasoning steps generated by LRMs while maintaining accuracy.
A Critical Analysis of Document Out-of-Distribution Detection (2023.findings-emnlp)

Copied to clipboard

Challenge: Existing document understanding models focus on single-modal inputs such as images or texts.
Approach: They propose to use a spatial-aware adapter to adapt transformer-based language models to document domain to exploit multi-modal information.
Outcome: The proposed model significantly improves the OOD detection performance compared to using a standard language model and to competitive baselines.
PVGRU: Generating Diverse and Relevant Dialogue Responses via Pseudo-Variational Mechanism (2023.acl-long)

Copied to clipboard

Challenge: Existing generative models for dialogue use the last hidden state to summarize the history of the dialogue.
Approach: They propose a Pseudo-Variational Gated Recurrent Unit (PVGRU) that summarises the accumulated distribution variations of subsequences and builds a model based on it.
Outcome: The proposed model can improve diversity and relevance of responses on two benchmark datasets.
TableLlama: Towards Open Large Generalist Models for Tables (2024.naacl-long)

Copied to clipboard

Challenge: Existing methods for interpreting, augmenting, and querying semi-structured tables require pretraining on tables or special model architecture design.
Approach: They construct a dataset with a variety of tables and tasks for instruction tuning and evaluating LLMs.
Outcome: The proposed model achieves comparable or better performance on 7 out of 8 in-domain tasks compared with the base model on 6 out-of-domain datasets.
From Scores to Preferences: Redefining Evaluation Paradigm for Speech Quality Reward Modeling (2026.findings-acl)

Copied to clipboard

Challenge: Experimental results show that the MOS-aware GRM significantly improves fine-grained speech quality discrimination.
Approach: They propose a MOS-aware reward model that incorporates MOS gap into reward function during reinforcement learning.
Outcome: The proposed model significantly improves fine-grained speech quality discrimination.
GraphNarrator: Generating Textual Explanations for Graph Neural Networks (2025.acl-long)

Copied to clipboard

Challenge: Graph representation learning has garnered significant attention due to its broad applications in various domains, such as recommendation systems and social network analysis.
Approach: They propose to use a generative language model to map input-output pairs to explanations reflecting the model’s decision-making process to generate a model that generates pseudo-labels that capture the model's decisions from saliency-based explanations.
Outcome: Extensive experiments show that GraphNarrator produces human-preferred explanations that are faithful, concise, and human-like.
Cat-MoD: Accelerating Multimodal Alignment via Caption Token Guided Asymmetric Mixture-of-Depths (2026.acl-long)

Copied to clipboard

Challenge: Existing query-based alignment modules enforce uniform cross-attention across all layers, leading to computational redundancy.
Approach: They propose a framework that allows for asynchronous query-based alignment with large-scale visual features.
Outcome: The proposed framework matches or surpasses baseline performance while reducing alignment FLOPs by approximately 37% during training and inference.
OneRec-Think: In-Text Reasoning for Generative Recommendation (2026.acl-long)

Copied to clipboard

Challenge: Existing generative models lack the capacity for explicit and controllable reasoning, a key advantage of LLMs.
Approach: They propose a framework that integrates dialogue, reasoning, and personalized recommendation.
Outcome: Experiments across public benchmarks show state-of-the-art performance.
CO3: Low-resource Contrastive Co-training for Generative Conversational Query Rewrite (2024.lrec-main)

Copied to clipboard

Challenge: Recent advances in conversational IR systems have seen a resurgent interest in conversation . generative query rewrite generates reconstructed query based on the conversation history .
Approach: They propose to use unlabeled data to make further improvements using contrastive co-training paradigm.
Outcome: The proposed model is robust to noise and language style shift under few-shot and zero-shot scenarios.
Unsolvable Problem Detection: Robust Understanding Evaluation for Large Multimodal Models (2025.acl-long)

Copied to clipboard

Challenge: Multiple-choice question answering (MCQA) is widely used to assess the understanding capability of Large Multimodal Models (LMMs).
Approach: They propose a task to evaluate the robust understanding capability of Large Multimodal Models (LMMs) they introduce a benchmark to assess performance across various ability dimensions .
Outcome: The proposed model can withhold answers when encountering unsolvable problems of MCQA, proving it understands the answer.
Answer-Supervised Question Reformulation for Enhancing Conversational Machine Comprehension (D19-58)

Copied to clipboard

Challenge: Existing question reformulation models are based on supervised question labels without considering feedback information from answers.
Approach: They propose a question reformulation model that integrates conversational history information with reinforcement learning.
Outcome: The proposed model is more effective in conversational machine comprehension with reinforcement learning.
Aspect Sentiment Quad Prediction as Paraphrase Generation (2021.emnlp-main)

Copied to clipboard

Challenge: Existing studies focus on predicting the four elements in one shot, instead of predicting them all.
Approach: They propose a task to jointly detect all sentiment elements in quads for a given opinionated sentence.
Outcome: The proposed method can generate the semantics of the sentiment elements in the natural language form.
TrendFact: A Benchmark Towards Hotspot Perception in Automatic Fact-Checking (2026.acl-long)

Copied to clipboard

Challenge: Existing benchmarks lack social metadata and evaluation framework to meet this urgent evaluation needs.
Approach: They propose a benchmark capable of evaluating HPA and three fact-checking tasks.
Outcome: The proposed framework improves HPA and computational efficiency for RLM-driven systems.
FedLFC: Towards Efficient Federated Multilingual Modeling with LoRA-based Language Family Clustering (2024.findings-naacl)

Copied to clipboard

Challenge: Existing frameworks for multilingual modeling face communication costs and parameter interference conflicts.
Approach: They propose a communication-efficient federated learning framework with low-rank adaptation and language family clustering for Multilingual Modeling (MM) they maintain the weights of the base model, updating the lightweight Low-rank adapt parameters to minimize communication costs.
Outcome: The proposed model outperforms the baseline models in performance and reduces communication overhead.
Beyond Scaling: Measuring and Predicting the Upper Bound of Knowledge Retention in Language Model Pre-Training (2026.acl-long)

Copied to clipboard

Challenge: Existing methods to predict performance of large language models are lacking . authors propose a size-dependent mutual information predictor for closed-book question answering accuracy .
Approach: They propose a size-dependent mutual information predictor that integrates knowledge frequency, knowledge specificity, and model size to forecast closed-book question answering accuracy.
Outcome: The proposed method outperforms baseline models and achieves R2 > 0.7 in predicting QA accuracy without additional training.
RATION: Entropy-Driven Task-Adaptive Visual Attention Allocation Framework for Multimodal Reasoning (2026.findings-acl)

Copied to clipboard

Challenge: Prior studies have focused on strengthening multimodal reasoning by improving representation alignment or increasing computation, but these methods do not characterize the differences in visual demands across tasks.
Approach: They propose an entropy-driven task-adaptive visual attention allocation framework that uses visual attention entropic as a control signal to dynamically allocate attention according to task demands.
Outcome: The proposed framework achieves consistent performance gains across diverse reasoning tasks, datasets, and models, providing a clear direction toward more reliable multimodal reasoning.
BERT-BC: A Unified Alignment and Interaction Model over Hierarchical BERT for Response Selection (2024.lrec-main)

Copied to clipboard

Challenge: Recent performance boosting for dialogue response selection task achieved by Cross-Encoder based models is limited and the learned models have poor generalization capability in realistic scenarios.
Approach: They propose a model that combines the representation-based Bi-Encoder and interaction-based Cross-Encoding to achieve better semantic representation.
Outcome: The proposed model can achieve state-of-the-art performance on three benchmark datasets for multi-turn response selection.
Few-shot Joint Multimodal Aspect-Sentiment Analysis Based on Generative Multimodal Prompt (2023.findings-acl)

Copied to clipboard

Challenge: Existing studies require massive labeled data to train models for multimodal data analysis.
Approach: They propose a novel multimodal prompt model that captures specific aspect terms in a few-shot scenario.
Outcome: The proposed model outperforms baselines on two MABSA-related tasks on a few-shot dataset.
On the Multi-turn Instruction Following for Conversational Web Agents (2024.acl-long)

Copied to clipboard

Challenge: Large Language Models (LLMs) have demonstrated remarkable abilities in planning and executing multi-step interactions within web-based environments.
Approach: They propose a framework for conversational web navigation that uses multi-turn interactions with both the user and the environment.
Outcome: The proposed framework is based on a multi-turn Mind2Web (MT-Mind2Web) it is designed to perform multi-step interactions with web-based environments .
An Effective Post-training Embedding Binarization Approach for Fast Online Top-K Passage Matching (2022.aacl-short)

Copied to clipboard

Challenge: Existing models that learn semantic representations of passages are prone to performance degradation . embedding binarization is a promising branch of model compression .
Approach: They propose an embedding binarization approach that can be used to optimize for online inference.
Outcome: The proposed model can perform query-passage matching acceleration.
ES4R: Speech Encoding Based on Prepositive Affective Modeling for Empathetic Response Generation (2026.acl-long)

Copied to clipboard

Challenge: Existing speech-to-speech large language models rely on ASR transcription or use encoders to extract latent representations, weakening affective information and contextual coherence in multi-turn dialogues.
Approach: They propose a framework for speech-based empathetic response generation that captures turn-level affective states and dialogue-level emotional dynamics.
Outcome: The proposed framework outperforms baselines in automatic and human evaluations and remains robust across different Large Language Model (LLM) backbones.

What is GenGO?

GenGO is an NLP powered publication search system. It currenctly indexes 30k+ papers from ACL Anthology, and implements multi-aspect summarization, semantic search, and more!

Information

About
Limitations