Papers by Liu Yong

85 papers
Towards Reward Fairness in RLHF: From a Resource Allocation Perspective (2025.acl-long)

Copied to clipboard

Challenge: if rewards are imperfect, they can adversely affect the alignment of large language models (LLMs).
Approach: They propose a bias-agnostic method to address the issue of reward unfairness from a resource allocation perspective without specifically designing for each type of bias . they apply methods Fairness Regularization and Fairness Coefficient to achieve fairness in rewards.
Outcome: The proposed method achieves fairness in rewards while minimizing biases . it can be applied to verification and reinforcement learning scenarios .
ETAS: Zero-Shot Transformer Architecture Search via Network Trainability and Expressivity (2024.findings-acl)

Copied to clipboard

Challenge: Existing Transformer Architecture Search methods are limited to computer vision and natural language processing tasks.
Approach: They propose a Transformer Architecture Search proxy that measures trainability and expressivity of Transformer networks separately and integrates it into an effective regularized evolution framework to demonstrate its efficacy.
Outcome: The proposed proxy can achieve higher correlation with the true performance of Transformer networks on computer vision and natural language processing tasks.
RealSec-bench: A Benchmark for Evaluating Secure Code Generation in Real-World Repositories (2026.findings-acl)

Copied to clipboard

Challenge: Existing benchmarks for large language models fail to capture complex interplay between functionality and security.
Approach: They propose a benchmark for secure code generation constructed from real-world, high-risk Java repositories.
Outcome: The proposed benchmarks highlight the gap between functional and secure code generation in LLMs.
NL-Debugging: Exploiting Natural Language as an Intermediate Representation for Code Debugging (2025.emnlp-main)

Copied to clipboard

Challenge: Early debugging efforts focused on code-level analysis, which often fails when addressing complex programming errors.
Approach: They propose a framework that employs natural language as an intermediate representation to improve code debugging by debuggating at a natural language level.
Outcome: The proposed framework outperforms traditional debugging methods and enables a broader modification space through direct refinement guided by execution feedback.
From Isolated Scoring to Collaborative Ranking: A Comparison-Native Framework for LLM-Based Paper Evaluation (2026.findings-acl)

Copied to clipboard

Challenge: Large language models (LLMs) are currently used to evaluate scientific papers by assigning an absolute score to each paper independently.
Approach: They propose a comparison-native framework for paper evaluation that integrates comparison into both data construction and model learning.
Outcome: The proposed framework achieves an average relative improvement of 21.8% over the strong baseline DeepReview-14B, while exhibiting robust generalization to five previously unseen datasets.
Revisiting Chain-of-Thought Prompting: Zero-shot Can Be Stronger than Few-shot (2025.findings-emnlp)

Copied to clipboard

Challenge: In-Context Learning (ICL) is an essential emergent ability of Large Language Models (LLMs).
Approach: They introduce CoT to exemplars of ICL to enhance the reasoning capability . however, it remains unclear whether CoT exemplar is still beneficial for recent, stronger models in such tasks.
Outcome: The enhanced exemplars fail to improve the model’s reasoning performance, despite being constructed using answers from advanced models such as Qwen2.5-Max and DeepSeek-R1.
Beyond Demographics: Enhancing Cultural Value Survey Simulation with Multi-Stage Personality-Driven Cognitive Reasoning (2025.emnlp-main)

Copied to clipboard

Challenge: Introducing **MARK**, a framework for cultural value survey simulation . based on type dynamics theory, it improves accuracy and interpretation of models .
Approach: They propose a framework that integrates psychological theory into cultural value survey simulations.
Outcome: The proposed framework outperforms baseline models on the World Values Survey by 10% accuracy and reduces divergence between model predictions and human preferences.
Mitigating Geospatial Knowledge Hallucination in Large Language Models: Benchmarking and Dynamic Factuality Aligning (2025.findings-emnlp)

Copied to clipboard

Challenge: Large language models (LLMs) have extensive world knowledge, but often generate inaccurate geospatial knowledge.
Approach: They propose a framework for evaluation of large language models to mitigate hallucinations . they use Kahneman-Tversky Optimization to align LLMs with their reality .
Outcome: The proposed evaluation framework uncovers hallucinations in 20 advanced LLMs.
The Tug of War Within: Mitigating the Fairness-Privacy Conflicts in Large Language Models (2025.acl-long)

Copied to clipboard

Challenge: Existing methods to enhance an LLM's privacy awareness with thousands of samples decrease its fairness awareness.
Approach: They propose a training-free method to Suppress the Privacy and faIrness coupled Neurons (SPIN) which theoretically and empirically decreases the mutual information between fairness and privacy awareness.
Outcome: The proposed method reduces the mutual information between fairness and privacy awareness without compromising general capabilities.
Planning with Multi-Constraints via Collaborative Language Agents (2025.coling-main)

Copied to clipboard

Challenge: Recent advances in neural language models have sparked a new surge of intelligent agent research.
Approach: They propose a method for collaborative LLM-based multi-agent systems that simplifies complex task planning with constraints by decomposing it into a hierarchy of subordinate tasks.
Outcome: The proposed method achieves an average success rate of 42.68% on two constraint-intensive benchmarks, TravelPlanner and API-Bank.
RFS-Guard: Detecting Reasoning Hallucinations via Cross-Phase Routing Focus in Large Reasoning Models (2026.acl-long)

Copied to clipboard

Challenge: Large reasoning models (LRMs) generate intermediate reasoning traces before the final answer, yet they remain vulnerable to reasoning hallucinations such as subtle arithmetic errors.
Approach: They propose a Routing Focus Score (RFS) that measures how strongly cross-step attention routing aligns with semantic proximity derived from hidden-state cosine similarity.
Outcome: The proposed framework detects and localizes hallucinations without external tools or repeated sampling.
CtrlA: Adaptive Retrieval-Augmented Generation via Inherent Control (2025.findings-acl)

Copied to clipboard

Challenge: Existing methods focus on detecting LLM’s confidence via statistical uncertainty.
Approach: They propose to use a representation perspective to solve adaptive RAG by enabling dynamic retrieval during generation and enabling retrieval only when the query exceeds LLM's internal knowledge.
Outcome: The proposed framework is superior to existing adaptive RAG methods on a diverse set of tasks.
Does Mapo Tofu Contain Coffee? Probing LLMs for Food-related Cultural Knowledge (2025.naacl-long)

Copied to clipboard

Challenge: Recent studies have highlighted the presence of cultural biases in Large Language Models (LLMs), yet lack a robust methodology to dissect these phenomena comprehensively.
Approach: They propose a multilingual dataset centered on food-related cultural facts and variations in food practices.
Outcome: The proposed model incorporates cultural context significantly and improves its ability to access cultural knowledge.
ReasonAny: Incorporating Reasoning Capability to Any Model via Simple and Effective Model Merging (2026.acl-long)

Copied to clipboard

Challenge: Existing models with long chain-of-thought reasoning lack reasoning depth and domain-specific utility.
Approach: They propose a model merging framework that integrates reasoning with domain-specific task models.
Outcome: The proposed model merging framework outperforms state-of-the-art models while maintaining robust reasoning performance.
MAVEN-ARG: Completing the Puzzle of All-in-One Event Understanding Dataset with Event Argument Annotation (2024.acl-long)

Copied to clipboard

Challenge: Existing datasets for event understanding have limited coverage due to complexity of tasks.
Approach: They propose a dataset that augments MAVEN datasets with event argument annotations . they propose 98,591 events and 290,613 arguments obtained with laborious human annotation .
Outcome: The proposed dataset is the first all-in-one dataset supporting event detection, event argument extraction, and event relation extraction.
Revisiting and Advancing Chinese Natural Language Understanding with Accelerated Heterogeneous Knowledge Pre-training (2022.emnlp-industry)

Copied to clipboard

Challenge: Existing knowledge-enhanced pre-trained language models (KEPLMs) can capture internal knowledge, but can't understand external background knowledge.
Approach: They propose to use Chinese knowledge-enhanced pre-trained language models to improve context-aware representations via learning from structured relations in knowledge bases.
Outcome: Experiments show that Chinese knowledge-enhanced pre-trained language models outperform strong baselines over various benchmark NLP tasks and in different model sizes.
EXPLAIN: Enhancing Retrieval-Augmented Generation with Entity Summary (2025.acl-industry)

Copied to clipboard

Challenge: Existing document question answering methods reduce inference costs and input tokens.
Approach: They propose a retrieval-augmented generation method that automatically extracts useful entities and generates summaries from documents.
Outcome: The proposed method surpasses baseline retrieval-augmented generation (RAG) and long-context question answering (LC) methods achieve higher accuracy by processing entire documents, but at the cost of increased computational Corresponding authors.
Clear Up Confusion: Advancing Cross-Domain Few-Shot Relation Extraction through Relation-Aware Prompt Learning (2024.naacl-short)

Copied to clipboard

Challenge: Existing approaches to few-shot Relation Extraction (RE) are prone to confusion when applying knowledge to a target domain with entirely new types of relations.
Approach: They propose a relation-aware prompt learning method with pre-training to clear confusion by decomposing relation types through an innovative label prompt.
Outcome: The proposed method outperforms previous sota methods and yields better results on cross-domain few-shot RE tasks.
Mitigating the Alignment Tax of RLHF (2024.emnlp-main)

Copied to clipboard

Challenge: Large Language Models (LLMs) acquire a wide range of abilities during pre-training, but aligning LLMs under Reinforcement Learning with Human Feedback (RLHF) can lead to forgetting pretrained abilities, which is also known as the alignment tax.
Approach: They propose to use a model averaging technique to find the most powerful alignment-forging Pareto front among RLHF algorithms.
Outcome: The proposed method achieves the strongest alignment-forging Pareto front among competing methods.
ChildMandarin: A Comprehensive Mandarin Speech Dataset for Young Children Aged 3-5 (2025.acl-long)

Copied to clipboard

Challenge: Automatic speech recognition systems have advanced significantly with models like Whisper, Conformer, and self-supervised frameworks such as Wav2vec 2.0.
Approach: They propose to use Mandarin speech datasets to analyze pronunciation and tone of children aged 3 to 5 and evaluate their models on speaker verification (SV) They find that the datasets are more robust than those used by adult speech recognition systems and are open-source and available for all academic purposes.
Outcome: The proposed dataset includes 41.25 hours of speech with carefully crafted manual transcriptions, collected from 397 speakers across various provinces in China, with balanced gender representation.
End-to-End Beam Retrieval for Multi-Hop Question Answering (2024.naacl-long)

Copied to clipboard

Challenge: Existing beam retrieval frameworks for multi-hop question answering were customized for two-hop questions and were poorly supervised.
Approach: They propose an end-to-end beam retrieval framework for multi-hop question answering . they combine an encoder and two classification heads to optimize the retrieval process .
Outcome: The proposed framework improves on MuSiQue-Ans and surpasses all previous retrievers on HotpotQA and achieves 99.9% precision on 2WikiMultiHopQA.
Reward Mixology: Crafting Hybrid Signals for Reinforcement Learning Driven In-Context Learning (2025.findings-emnlp)

Copied to clipboard

Challenge: Existing methods for in-context learning (ICL) performance rely on quality and ordering of demonstrations.
Approach: They propose a method that models iterative demonstration selection as a Markov Decision Process and craft hybrid reward signals.
Outcome: The proposed method combines outcome-based accuracy signals with process-oriented signals like stepwise influence and label entropy improvement.
EARL: Informative Knowledge-Grounded Conversation Generation with Entity-Agnostic Representation Learning (2021.emnlp-main)

Copied to clipboard

Challenge: Existing knowledge-grounded conversation models lack knowledge that occurs in training data, resulting in incomplete knowledge generation.
Approach: They propose an Entity-Agnostic Representation Learning method to introduce knowledge graphs to informative conversation generation using context of conversations and relational structure of knowledge graph.
Outcome: The proposed model generates more informative, coherent, and natural responses than baseline models.
VIGIL: Defending LLM Agents Against Tool-Stream Injection via Verify-Before-Commit (2026.acl-long)

Copied to clipboard

Challenge: Existing defenses for indirect prompt injection are limited by static protection mechanisms . existing models prioritize injected rules due to strict alignment, whereas static protections sever the feedback loop required for adaptive reasoning.
Approach: They propose a framework that shifts the paradigm from restrictive isolation to a verify-before-commit protocol.
Outcome: The proposed framework outperforms state-of-the-art dynamic defenses by reducing the attack success rate by over 22% while more thandoubling utility under attack compared to static baselines.
Reducing Word Omission Errors in Neural Machine Translation: A Contrastive Learning Approach (P19-1)

Copied to clipboard

Challenge: Existing methods for reducing word omission errors in neural machine translation are prone to omit essential words on the source side.
Approach: They propose a contrastive learning approach to reduce word omission errors in NMT by omitting words.
Outcome: The proposed approach achieves better translation performance than baseline methods on Chinese-to-English, German-to English, and Russian-toEnglish translation tasks.
DIFFA-2: A Practical Diffusion Large Language Model for General Audio Understanding (2026.findings-acl)

Copied to clipboard

Challenge: Autoregressive (AR) large audio language models are expensive in data and computation . prior work shows diffusion-based LALMs can improve audio understanding under matched settings .
Approach: They propose a diffusion-based LALM that upgrades the speech encoder and employs dual semantic and acoustic adapters.
Outcome: a new model improves over existing autoregressive large language models and is competitive to strong AR models . the proposed model can make use of limited training data and improve inference efficiency . a recent study shows that diffusion-based models can improve audio understanding .
SARA: Salience-Aware Reinforced Adaptive Decoding for Large Language Models in Abstractive Summarization (2025.acl-long)

Copied to clipboard

Challenge: Existing decoding strategies neglect the explicit use of salient contextual information and rely on static hyperparameters to fix the balance between contextual and prior knowledge.
Approach: They propose a salience-aware reinforced adaptive decoding (SARA) which incorporates salient contextual information and allows the model to determine reliance on source document's context, salient context, and model's prior knowledge based on pointwise mutual information.
Outcome: The proposed model improves the quality and faithfulness of summaries across LLMs without modifying their weights.
Entity-to-Text based Data Augmentation for various Named Entity Recognition Tasks (2023.findings-acl)

Copied to clipboard

Challenge: Existing augmentation techniques manipulate words in the original text that break the semantic coherence of the text, or exploit generative models that ignore preserving entities in the text.
Approach: They propose a novel Entity-to-Text based data augmentation technique called EnTDA to add, delete, replace or swap entities in the original text.
Outcome: The proposed technique generates semantically coherent and entity preserving texts on thirteen NER tasks and two settings.
Towards Tracing Trustworthiness Dynamics: Revisiting Pre-training Period of Large Language Models (2024.findings-acl)

Copied to clipboard

Challenge: Existing studies focus on pre-trained LLMs to better understand and improve their trustworthiness.
Approach: They apply linear probing to LLMs to explore five key dimensions of trustworthiness: reliability, privacy, toxicity, fairness, and robustness.
Outcome: The proposed model can distinguish concepts in each trustworthiness dimension, suggesting that it can be trained in early pre-training.
Active Prompting with Chain-of-Thought for Large Language Models (2024.acl-long)

Copied to clipboard

Challenge: Existing methods to annotate large language models rely on a fixed set of human-annotated exemplars, which are not always the most effective for different tasks.
Approach: They propose a method to adapt large language models to different tasks with task-specific example prompts (annotated with human-designed CoT reasoning) they introduce several metrics to characterize uncertainty so as to select the most uncertain questions for annotation.
Outcome: The proposed method significantly improves performance on eight complex reasoning tasks.
Boost, Disentangle, and Customize: A Robust System2-to-System1 Pipeline for Code Generation (2025.findings-acl)

Copied to clipboard

Challenge: Existing systems 2 methods for code generation are difficult to implement due to the complex hidden reasoning process and heterogeneous data distribution.
Approach: They propose a framework that Boosts reasoning exploration via multi-agent collaboration and Disentangles heterogeneous data into specialized experts.
Outcome: The proposed framework outperforms state-of-the-art methods on APPS and CodeContest benchmarks and achieves 73.8% accuracy on hard problems.
Attribution-Based Analysis and Optimization of Modular Agentic Workflows (2026.findings-acl)

Copied to clipboard

Challenge: Large Language Models (LLMs) have driven the rise of agentic workflows . yet, how can we attribute performance gains to individual upgrades and their interactions?
Approach: They propose a game-theoretic framework that models component upgrades as players and evaluates component coalitions to compute Shapley values.
Outcome: The proposed framework provides interaction-aware attribution and recommendation for model allocation under a fixed workflow structure.
From Conversation to Evaluation: Benchmarking LLMs on Development Knowledge via SimpleDevQA (2026.findings-acl)

Copied to clipboard

Challenge: Existing Dev Knowledge QA benchmarks are limited in development knowledge scope and often not built from real user queries.
Approach: They conduct preliminary analysis of real user–LLM dialogues from WildChat to investigate the importance of Dev Knowledge QA in AI-assisted software development scenarios.
Outcome: The proposed benchmark is based on real user–LLM dialogues from WildChat.
Pay More Attention to Relation Exploration for Knowledge Base Question Answering (2023.findings-acl)

Copied to clipboard

Challenge: Existing approaches focus on entity representation and final answer reasoning, which results in limited supervision for this task.
Approach: They propose a framework that utilizes relations to enhance entity representation and introduce additional supervision.
Outcome: The proposed framework improves the F1 score on two benchmark datasets by 5.8% . it improves by 6.7% on WebQSP, better than state-of-the-art methods .
No More Stale Feedback: Co-Evolving Critics for Open-World Agent Learning (2026.acl-long)

Copied to clipboard

Challenge: Current methods for training Large Language Model agents rely on static or offline critic models, which fail to adapt as the policy evolves.
Approach: They propose a framework that integrates a critique and a policy to optimize the policy and critic through a synchronized co-evolutionary loop.
Outcome: The proposed framework yields more stable training and higher long-horizon task success across open-world environments.
Specializing Large Language Models to Simulate Survey Response Distributions for Global Populations (2025.naacl-long)

Copied to clipboard

Challenge: Prior work has focused on using large language models to simulate human behaviors . but, LLMs are known to generate erroneous, stereotypical, or overconfident answers .
Approach: They propose to specialize large language models for simulating survey response distributions by first-token probabilities.
Outcome: The proposed model outperforms other methods and zero-shot classifiers on unseen questions, countries, and a completely unseened survey.
Attention and Edge-Label Guided Graph Convolutional Networks for Named Entity Recognition (2022.emnlp-main)

Copied to clipboard

Challenge: Named entity recognition (NER) is the recognition of entities with specific meanings in the text, mainly including person, organization, location, etc.
Approach: They propose an edge-aware node joint update module and introduce a node-awful edge update module to explore hidden in structured information and solve the wrong dependency label information to some extent.
Outcome: The proposed model can exploit the structured information on the dependency tree to improve the recognition of long entities.
AutoQual: An LLM Agent for Automated Discovery of Interpretable Features for Review Quality Assessment (2025.emnlp-industry)

Copied to clipboard

Challenge: Existing methods for assessing review quality are unscalable across domains and fail to adapt to evolving content patterns.
Approach: They propose an LLM-based agent framework that automates the discovery of interpretable features.
Outcome: The proposed framework improves on a large-scale online platform with a billion-level user base.
History-Aware Hierarchical Transformer for Multi-session Open-domain Dialogue System (2022.findings-emnlp)

Copied to clipboard

Challenge: Existing open-domain dialogue systems conduct one-session conversations, but multi-session MSCs are under-investigated.
Approach: They propose a History-Aware Hierarchical Transformer for multi-session open-domain dialogue . they propose to encode history conversations into a history memory and leverage historical information to generate well-informed responses.
Outcome: The proposed model outperforms baseline models on a large-scale MSC dataset.
MemSearch-o1: Empowering Large Language Models with Reasoning-Aligned Memory Growth in Agentic Search (2026.acl-long)

Copied to clipboard

Challenge: Existing methods for memory management struggle to capture fine-grained semantic relations between queries and documents.
Approach: They propose a framework for reasoning and agentic search that grows fine-grained memory fragments from seed tokens from queries, then retraces and deep refines the memory via a contribution function.
Outcome: Experiments on eight benchmark datasets show that MemSearch-o1 significantly mitigates memory dilution and more effectively activates reasoning potential of diverse LLMs.
PychoAgent: Psychology-driven LLM Agents for Explainable Panic Prediction on Social Media during Sudden Disaster Events (2025.emnlp-main)

Copied to clipboard

Challenge: Social media's rich information content and spatiotemporal granularity provide unique opportunities for emotion prediction and management.
Approach: They propose a Psychology-driven generative Agent framework for explainable panic prediction based on emotion arousal theory.
Outcome: The proposed framework improves panic emotion prediction performance by 13% to 21% compared to baseline models.
Language Constrained Multimodal Hyper Adapter For Many-to-Many Multimodal Summarization (2025.acl-long)

Copied to clipboard

Challenge: Existing models that share parameters neglect the language-specific knowledge learning.
Approach: They propose a language-constrained multimodal hyper adapter for multimodal summarization that integrates language-specific adapters into multilingual pre-trained backbones.
Outcome: The proposed model can generate summaries based on multimodal documents such as text and visuals, allowing people to quickly locate key information from the vast multimedia con.
UniRel: Unified Representation and Interaction for Joint Relational Triple Extraction (2022.emnlp-main)

Copied to clipboard

Challenge: Existing approaches to extract rich correlations between entities and relations are not fully exploited by existing methods.
Approach: They propose to unify entities and relations by jointly encoding them within a concatenated natural language sequence and unify the modeling of interactions with a proposed Interaction Map.
Outcome: The proposed method is more efficient and efficient than existing methods and can be scaled up to 2021.
LearnAct: Few-Shot Mobile GUI Agent with a Unified Demonstration Benchmark (2026.findings-acl)

Copied to clipboard

Challenge: Mobile GUI agents show promise in automating tasks but face significant generalization challenges in long-tail scenarios.
Approach: They propose a benchmark framework for mobile GUI agents that measures the performance of GUI agents by analyzing their performance.
Outcome: The LearnGUI benchmark outperforms existing methods in offline and online evaluations and demonstrates consistent gains across model architectures.
RethinkMCTS: Refining Erroneous Thoughts in Monte Carlo Tree Search for Code Generation (2025.emnlp-main)

Copied to clipboard

Challenge: Existing tree search methods neglect the underlying reasoning process, resulting in poor search quality.
Approach: They propose a framework that systematically explores and refines the reasoning process for code generation by using a tree search engine and a reflection mechanism.
Outcome: The proposed framework outperforms existing methods in the code generation domain.
CaM-HG: Causal-Enhanced MoE and Hypergraphs Network for Incomplete Multimodal Emotion Recognition in Conversations (2026.findings-acl)

Copied to clipboard

Challenge: Existing methods that focus on statistical reconstruction often fail to bridge these gaps, effectively leaving semantic holes.
Approach: They propose a Causal-Enhanced Mixture-of-Experts and Hypergraph Network to bridge missing features . they use experts to synthesize missing features that are realistic and causally consistent .
Outcome: The proposed model synthesizes missing features that are realistic and causally consistent . it surpasses benchmarks on IEMOCAP, CMU-MOSI, and CMU MOSEI by 1.43% and 1.25% .
MMDocIR: Benchmarking Multimodal Retrieval for Long Documents (2025.emnlp-main)

Copied to clipboard

Challenge: Existing benchmarks for multimodal document retrieval are lacking for evaluating performance of systems.
Approach: They propose a benchmark that evaluates page-level and layout-level retrieval tasks . they use a rich dataset featuring 1,685 questions annotated by experts .
Outcome: The proposed benchmark outperforms existing benchmarks in page-level and layout-level retrieval tasks.
Astra: Activation-Space Tail-Eigenvector Low-Rank Adaptation of Large Language Models (2026.findings-acl)

Copied to clipboard

Challenge: Existing methods for fine-tuning pre-trained models are limited due to suboptimal activation subspaces.
Approach: They propose a method that leverages tail eigenvectors of model output activations to construct low-rank adapters.
Outcome: The proposed method outperforms existing methods across 16 benchmarks and surpasses full fine-tuning in certain scenarios.
Generalized Supervised Attention for Text Generation (2021.findings-acl)

Copied to clipboard

Challenge: Existing supervised attention methods that use human knowledge to learn better alignments are costly or infeasible.
Approach: They propose a generalized supervised attention method based on quasi alignments that are easier to obtain than ideal alignments.
Outcome: The proposed framework improves generation performance and is robust against errors in attention supervision.
SDPO: Segment-Level Direct Preference Optimization for Social Agents (2025.acl-long)

Copied to clipboard

Challenge: Direct Preference Optimization (DPO) has proven effective in aligning LLM behavior with human preferences across various tasks, but is limited in multi-turn social interactions.
Approach: They propose a method which dynamically selects key segments within interactions to optimize multi-turn agent behavior.
Outcome: The proposed methods outperform existing methods and proprietary LLMs on the SOTOPIA benchmark and show that they can improve social intelligence.
Towards Emotional Support Dialog Systems (2021.acl-long)

Copied to clipboard

Challenge: Emotional support is a crucial ability for many conversation scenarios, including social interactions, mental health support, and customer service chats.
Approach: They propose an Emotional Support Conversation task and an ESC Framework to train emotional support into dialog systems.
Outcome: The proposed framework provides an example of an Emotional Support Conversation task and shows that it is more effective than existing models.
Towards Persona-Based Empathetic Conversational Models (2020.emnlp-main)

Copied to clipboard

Challenge: Empathetic conversational models have been shown to improve user satisfaction and task outcomes in numerous domains.
Approach: They propose a task towards persona-based empathetic conversations and propose e-learning model CoBERT that can be used to train persona on emmpathetic conversations.
Outcome: The proposed model improves empathetic responding more when trained on e-mpathetic conversations than non-empathy ones.
Dynamic Multistep Reasoning based on Video Scene Graph for Video Question Answering (2022.naacl-main)

Copied to clipboard

Challenge: Existing video QA models lack the capacity for deep video understanding and flexible multistep reasoning.
Approach: They propose a video question answering model which performs dynamic multistep reasoning between questions and videos.
Outcome: The proposed model improves on three widely used video QA datasets and displays better interpretability by backtracing along with the attention mechanisms to the video scene graphs.
Contextualize Knowledge Bases with Transformer for End-to-end Task-Oriented Dialogue Systems (2021.emnlp-main)

Copied to clipboard

Challenge: Existing approaches to integrate knowledge bases into end-to-end task-oriented dialogue systems are limited in their ability to properly represent the entity of KB.
Approach: They propose a framework that dynamically perceives all relevant entities and dialogue history . it uses a Memory Mask to enforce the entity to focus on its relevant entities .
Outcome: The proposed framework can achieve superior performance over the state of the arts.
MAS-Bench: A Unified Benchmark for Shortcut-Augmented Hybrid Mobile GUI Agents (2026.acl-long)

Copied to clipboard

Challenge: Shortcuts such as APIs and deep-links have emerged as efficient complements to flexible GUI operations, but systematic evaluation of GUI–shortcut hybrid agents remains underexplored.
Approach: They propose a benchmark that evaluates GUI-shortcut hybrid agents with a specific focus on the mobile domain.
Outcome: MAS-Bench evaluates agent's ability to generate shortcuts by discovering and creating reusable, low-cost workflows.
A Word is Worth A Thousand Dollars: Adversarial Attack on Tweets Fools Stock Prediction (2022.naacl-main)

Copied to clipboard

Challenge: Existing models are vulnerable to adversarial attacks, but their vulnerability is underexplored.
Approach: They propose to concatenate a perturbed but semantically similar tweet into a model that fools stock prediction models.
Outcome: The proposed method achieves consistent success rates and causes significant monetary loss in trading simulation by simply concatenating a perturbed but semantically similar tweet.
The Agent’s First Day: Benchmarking Learning, Exploration, and Scheduling in the Workplace Scenarios (2026.findings-acl)

Copied to clipboard

Challenge: Existing research mainly focuses on performance upper bounds in static environments, overlooking stochastic real-world deployment.
Approach: They propose a dynamic evaluation environment that simulates a "trainee" agent continuously exploring a novel setting.
Outcome: The proposed model evaluates agents in a dynamic evaluation environment that simulates a "trainee" agent continuously exploring a novel setting.
E-Verify: A Paradigm Shift to Scalable Embedding-based Factuality Verification (2025.findings-emnlp)

Copied to clipboard

Challenge: Existing factuality verification methods follow a Decompose-Then-Verify paradigm, which improves granularity but suffers from poor scalability and efficiency.
Approach: They propose a Decompose-Embed-Interact paradigm that shifts factuality verification from costly text-level reasoning to efficient alignment in embedding space.
Outcome: The proposed paradigm shifts factuality verification from costly text-level reasoning to efficient alignment in embedding space .
Giving Control Back to Models: Enabling Offensive Language Detection Models to Autonomously Identify and Mitigate Biases (2024.findings-emnlp)

Copied to clipboard

Challenge: Existing models often rely on specific words to predict offensive content, compromising model fairness and potentially exacerbates biases against vulnerable and minority groups.
Approach: They propose a bias self-awareness and data self-iteration framework to help models identify and mitigate biases by integrating multiple natural language processing techniques.
Outcome: The proposed framework reduces false positive rate of models in in-distribution and out-of-difference tests, enhances model accuracy and fairness, and shows promising performance improvements on larger datasets.
CoMAE: A Multi-factor Hierarchical Framework for Empathetic Response Generation (2021.findings-acl)

Copied to clipboard

Challenge: Existing methods for empathetic response generation ignore hierarchical relationships between different factors, leading to a weak ability of empathy modeling.
Approach: They propose a multi-factor hierarchical framework for empathetic response generation which models the above three key factors in a hierarchically structured way.
Outcome: The proposed model generates more empathetic responses than previous methods.
MC-indexing: Effective Long Document Retrieval via Multi-view Content-aware Indexing (2024.findings-emnlp)

Copied to clipboard

Challenge: Existing methods for document question answering do not consider content structures, resulting chunks exclude vital information or include irrelevant content.
Approach: They propose a method that segments document into content chunks and represents each content chunk in raw-text, keywords, and summary views.
Outcome: The proposed method significantly improves recall of long document question answering datasets compared to state-of-the-art chunking schemes.
RAPID: Efficient Retrieval-Augmented Long Text Generation with Writing Planning and Information Discovery (2025.findings-acl)

Copied to clipboard

Challenge: Existing methods for knowledge-intensive long texts struggle with issues like hallucinations, topic incoherence, and significant latency.
Approach: They propose a retrieval-augmented long text generation framework with writing P**lanning and I**nformation to address these challenges.
Outcome: The proposed framework outperforms state-of-the-art methods on a freshWiki-2024 dataset.
Identifying Collective Intelligence Factor in LLM Agent Groups for Generalizable Multi-Agent System Design (2026.findings-acl)

Copied to clipboard

Challenge: Prior studies have focused on designing customized MAS for specific tasks . a critical research question remains: do LLM agent groups exhibit a form of "general intelligence"
Approach: They find a Collective Intelligence factor in human groups that captures their general capability.
Outcome: The proposed model predicts the ACI factor based on the features of LLM agent groups and can improve generalization abilities.
SPPD: Self-training with Process Preference Learning Using Dynamic Value Margin (2025.findings-emnlp)

Copied to clipboard

Challenge: Existing approaches to improve numerical and logical reasoning of Large Language Models are limited . existing approaches rely on prompt engineering and pretrained knowledge to ensure correctness .
Approach: They propose to train LLMs with process-based reasoning using a dynamic value margin . they use the Bellman optimality equation to derive a value margin for step-level preference optimization .
Outcome: The proposed method is equivalent to on-policy policy gradient methods under constrained reward functions.
E-ViC: Reasoning Beyond Text via Embodied Visual Chain for Spatial Intelligence (2026.acl-long)

Copied to clipboard

Challenge: Existing Vision-Language Models (VLMs) lack spatial reasoning, despite text-based CoTs . e-ViC reframes spatial intelligence as a verifiable, tool-using capability, argues a new study.
Approach: They propose a framework that moves reasoning beyond text into the visual domain . they ground reasoning in pixel-level interactions to enable human-like "look-and-confirm" strategies .
Outcome: The proposed framework outperforms existing Vision-Language Models with an average gain of 10.1%.
GRASP: Replace Redundant Layers with Adaptive Singular Parameters for Efficient Model Compression (2025.emnlp-main)

Copied to clipboard

Challenge: Recent studies have demonstrated that many layers are functionally redundant in large language models (LLMs), enabling model compression by removing these layers to reduce inference cost.
Approach: They propose a framework that removes redundant layers to reduce inference cost by preserving sensitivity-aware singular values.
Outcome: The proposed framework outperforms existing methods in 90% of the original model under a 20% compression ratio.
Adaptive Schema-aware Event Extraction with Retrieval-Augmented Generation (2025.findings-emnlp)

Copied to clipboard

Challenge: Event extraction is a task in natural language processing that involves identifying and extracting event information from unstructured text.
Approach: They propose a paradigm that combines schema paraphrasing with schema retrieval-augmented generation.
Outcome: The proposed paradigm retrieves paraphrased schemas and accurately generates targeted structures.
Parameter-Efficient Conversational Recommender System as a Language Processing Task (2024.eacl-long)

Copied to clipboard

Challenge: Existing methods to recommend items are categorized into attribute-based and generation-based methods.
Approach: They propose to represent items in natural language and formulate a conversational recommender system that can be optimized in a single stage without relying on non-textual metadata.
Outcome: The proposed model can be optimized in a single stage, without relying on non-textual metadata such as a knowledge graph.
Exploring the Limitations of Mamba in COPY and CoT Reasoning (2025.emnlp-main)

Copied to clipboard

Challenge: Inference overhead of Transformers increases linearly with the sequence length, posing challenges for modeling long sequences.
Approach: They analyze Mamba's expressive ability to perform COPY operations and Chain of Thought reasoning tasks using a defined sequence length.
Outcome: The proposed model can perform COPY operations and Chain of Thought reasoning tasks with a constant size while reducing computational costs.
Adaptive Tool Use in Large Language Models with Meta-Cognition Trigger (2025.acl-long)

Copied to clipboard

Challenge: Existing research expands the tool arrays of large language models (LLMs), but the necessity of using these tools is often overlooked, leading to indiscriminate tool invocation.
Approach: They propose a meta-cognition proxy proxy for LLMs self-assessment of their capabilities, reflecting the model’s awareness of its own limitations.
Outcome: The proposed strategy is fine-tuned-free and costs minimal.
Revisiting Weak-to-Strong Generalization in Theory and Practice: Reverse KL vs. Forward KL (2025.findings-acl)

Copied to clipboard

Challenge: Weak-to-strong generalization is a promising approach to guide stronger systems, but its effectiveness is constrained by the inherent imperfections of weak model supervision.
Approach: They propose a theoretically grounded approach that replaces forward KL divergence with reverse KL, which prioritizes high-confidence predictions.
Outcome: The proposed approach replaces forward KL divergence with reverse KL, reducing the influence of unreliable weak supervision.
ELBA-Bench: An Efficient Learning Backdoor Attacks Benchmark for Large Language Models (2025.acl-long)

Copied to clipboard

Challenge: Existing backdoor models are limited in coverage of attack, system integrity and backdoor alignment . ELBA-Bench provides over 1300 experiments encompassing 12 attack methods, 18 datasets, and 12 LLMs.
Approach: They propose a framework that allows attackers to inject backdoor through parameter efficient fine-tuning or without fine-uning techniques.
Outcome: ELBA-Bench provides over 1300 experiments encompassing 12 attack methods, 18 datasets, and 12 LLMs.
Fusion Makes Perfection: An Efficient Multi-Grained Matching Approach for Zero-Shot Relation Extraction (2024.naacl-short)

Copied to clipboard

Challenge: Existing methods to extract unseen relations require laborious manual annotation . a new approach uses fine-grained matching to reduce manual annotation cost .
Approach: They propose an efficient multi-grained matching approach that uses virtual entity matching to reduce manual annotation cost.
Outcome: The proposed approach outperforms the state-of-the-art methods and achieves inference efficiency and accuracy in zero-shot relation extraction tasks.
LLMC: Benchmarking Large Language Model Quantization with a Versatile Compression Toolkit (2024.emnlp-industry)

Copied to clipboard

Challenge: Existing quantization techniques have been categorized as 'simple' and 'highly efficient' however, their configurations vary from each other and cannot be fairly compared .
Approach: They propose a plug-and-play compression toolkit to explore the impact of quantization.
Outcome: The proposed toolkit explores the impact of quantization on large language models.
Do not Abstain! Identify and Solve the Uncertainty (2025.acl-long)

Copied to clipboard

Challenge: Existing solutions rely on evasive responses when confronting uncertain scenarios.
Approach: They propose a benchmark to assess LLMs' ability to recognize and address uncertainty . they generate context-aware inquiries that highlight the confusing aspect of the original query .
Outcome: Experiments with ConfuseBench show that LLMs struggle to identify root cause of uncertainty and solve it.
CoreCodeBench: Decoupling Code Intelligence via Fine-Grained Repository-Level Tasks (2026.acl-long)

Copied to clipboard

Challenge: Existing large language models for software engineering rely on coarse-grained pass rates obscuring specific cognitive bottlenecks.
Approach: They propose a repository-level benchmark that dissects coding capabilities through atomized tasks.
Outcome: The proposed framework achieves a 78.55% validity yield, surpassing the 31.7% retention rate of SWE-bench-Verified.
Towards Scalable Lightweight GUI Agents via Multi-role Orchestration (2026.findings-acl)

Copied to clipboard

Challenge: Advanced GUI agents suffer from prohibitive deployment costs on resource-constrained devices.
Approach: They propose a lightweight GUI agent with GUI-specific knowledge and task scalability . LAMO-3B supports monolithic execution and MAS-style orchestration .
Outcome: The proposed GUI agent LAMO-3B supports monolithic execution and MAS-style orchestration.
A Survey of Large Language Model-Based Search Agents (2026.acl-long)

Copied to clipboard

Challenge: Large Language Models (LLMs) have revolutionized web search, but their integration is static and cannot handle complex contexts.
Approach: They analyze existing research and analyze existing work from the perspectives of architecture, optimization, application, and evaluation.
Outcome: The proposed models can comprehend user intentions and context and execute multi-turn retrieval with dynamic planning, extending search capabilities far beyond the web.
Beyond Itinerary Planning—A Real-World Benchmark for Multi-Turn and Tool-Using Travel Tasks (2026.acl-long)

Copied to clipboard

Challenge: Existing studies on LLM performance on travel planning have shown that existing settings are limited due to limited domain coverage, insufficient modeling of users’ implicit preferences in multi-turn conversations, and a lack of evaluation of agents’ capability boundaries.
Approach: They propose a benchmark to evaluate LLMs' planning and tool-use abilities in real-world settings by collecting user queries, user preferences, and tools from real scenarios.
Outcome: The proposed benchmark evaluates agents' capabilities in real-world settings and shows that even advanced models exhibit imbalanced performance across different capabilities.
Learn to Relax with Large Language Models: Solving Constraint Optimization Problems via Bidirectional Coevolution (2026.acl-long)

Copied to clipboard

Challenge: Large Language Model (LLM)-based optimization has shown promise for autonomous problem solving, but most approaches cast LLMs as passive constraint checkers rather than proactive strategy designers.
Approach: They propose an end-to-end Automated Constraint Optimization method that tightly couples operations-research principles of constraint relaxation with LLM reasoning.
Outcome: Extensive experiments on three challenging COP benchmarks validate AutoCO’s consistent effectiveness and superior performance, especially in hard regimes where current methods degrade.
Towards Robust Neural Machine Translation (P18-1)

Copied to clipboard

Challenge: Small perturbations in the input can severely distort intermediate representations and thus impact translation quality of neural machine translation models.
Approach: They propose adversarial stability training to make encoder and decoder robust to perturbations by enabling them to behave similarly for the original input and its perturbed counterpart.
Outcome: The proposed approach improves translation quality and robustness over strong models on Chinese-English, English-German and English-French translation tasks.
DiningBench: A Hierarchical Multi-view Benchmark for Perception and Reasoning in the Dietary Domain (2026.acl-long)

Copied to clipboard

Challenge: Existing vision-language models lack fine-grained classification, single-view imagery, and inaccurate metadata.
Approach: They propose a hierarchical, multi-view benchmark to evaluate VLMs across three levels of cognitive complexity.
Outcome: The proposed benchmark evaluates vision-language models across three levels of complexity . it systematically identifies five primary failure modes . the proposed benchmarks are available on https://github.com/meituan/DiningBench.
Structured Optimal Brain Pruning for Large Language Models (2024.emnlp-main)

Copied to clipboard

Challenge: Existing pruning methods for Large Language Models rely on unstructured pruning or require special hardware to accelerate computation.
Approach: They propose a retraining-free structured pruning method called SoBP . they evaluate the effectiveness of SoBP across 14 models from 3 LLM families .
Outcome: The proposed method outperforms current state-of-the-art pruning methods on 8 datasets.
LoopTool: Closing the Data–Training Loop for Robust LLM Tool Calls (2026.acl-long)

Copied to clipboard

Challenge: Large Language Models (LLMs) are powerful tools for multi-step tasks, but static data pipelines hinder tool learning and cause noisy labels to persist.
Approach: They propose a fully automated, model-aware data evolution framework that tightly integrates data synthesis and model training.
Outcome: Experiments show that LoopTool-8B significantly surpasses its 32B data generator and achieves new state-of-the-art results on the BFCL-v3 and ACEBench benchmarks for its scale.
SpeechLLM-as-Judges: Towards General and Interpretable Speech Quality Evaluation (2026.acl-long)

Copied to clipboard

Challenge: Existing methods for evaluating the perceptual quality of synthetic speech are limited due to the complexity of perceptual quality factors and the diversity of speech generation tasks.
Approach: They propose a new paradigm for enabling large language models to conduct structured speech quality evaluation using a large-scale dataset.
Outcome: The proposed model performs well across tasks and languages.

What is GenGO?

GenGO is an NLP powered publication search system. It currenctly indexes 30k+ papers from ACL Anthology, and implements multi-aspect summarization, semantic search, and more!

Information

About
Limitations