Papers by Wenjie Wang

89 papers
WhitenedCSE: Whitening-based Contrastive Learning of Sentence Embeddings (2023.acl-long)

Copied to clipboard

Challenge: Extensive experiments on seven semantic textual similarity tasks show our method achieves consistent improvement over the contrastive learning baseline and sets new states of the art.
Approach: They propose a whitening-based contrastive learning method for sentence embedding learning which combines contrastive and shuffled group whitening.
Outcome: The proposed method achieves better alignment and uniformity on seven semantic textual similarity tasks.
Personalized Generation In Large Model Era: A Survey (2025.acl-long)

Copied to clipboard

Challenge: Recent advances in large generative models have catalyzed a paradigm shift in content generation to Personalized Generation (PGen).
Approach: They propose a multi-level taxonomy that systematically formalizes PGen's key components, core objectives, and abstract workflows.
Outcome: The proposed taxonomy bridging PGen research across multiple modalities highlights open challenges and promising directions for future exploration.
Few-shot Query-Focused Summarization with Prefix-Merging (2022.emnlp-main)

Copied to clipboard

Challenge: Query-focused summarization has been considered as an important extension for text summarizing . lack of large-scale datasets hinders its development .
Approach: They propose to integrate text summarization and question answering into a prefix-based pretraining strategy for few-shot learning in query-focused summarizing.
Outcome: The proposed prefix-based pretraining outperforms fine-tuning on query-focused summarization.
Media Source Matters More Than Content: Unveiling Political Bias in LLM-Generated Citations (2025.emnlp-main)

Copied to clipboard

Challenge: generative search engines rely on in-line citations as the key gateway to original webpages . a recent study shows that LLMs tend to cite left-leaning sources at higher rates compared to traditional retrieval systems .
Approach: They construct a dataset of news articles labeled with left- or right-leaning stances . they find that LLMs tend to cite left-leansing sources at higher rates than traditional retrieval systems .
Outcome: The proposed dataset shows that LLMs tend to cite left-leaning sources at higher rates than traditional retrieval systems.
SMiLE: Schema-augmented Multi-level Contrastive Learning for Knowledge Graph Link Prediction (2022.findings-emnlp)

Copied to clipboard

Challenge: Existing methods for linking knowledge graphs lack contextual information in entity neighborhoods, which leads to false prediction results.
Approach: They propose a Schema-augmented Multi-level contrastive LEarning framework to conduct knowledge graph link prediction using a knowledge graph schema.
Outcome: The proposed framework is based on a knowledge graph schema and is compared against state-of-the-art datasets.
DELMAN: Dynamic Defense Against Large Language Model Jailbreaking with Model Editing (2025.findings-acl)

Copied to clipboard

Challenge: Existing safety mechanisms for Large Language Models (LLMs) are inadequate to protect against jailbreak attacks, resulting in performance degradation on general tasks.
Approach: They propose a method that directly updates a minimal set of relevant parameters to neutralize harmful behaviors while preserving the model’s utility.
Outcome: The proposed model outperforms baseline methods in mitigating jailbreak attacks while preserving the model’s utility.
Attack Prompt Generation for Red Teaming and Defending Large Language Models (2023.findings-emnlp)

Copied to clipboard

Challenge: Existing studies construct attack prompts via manual or automatic methods, but these methods have limitations on cost and quality.
Approach: They propose an attack framework to instruct LLMs to mimic human-generated prompts through in-context learning and a defense framework that fine-tunes victim LLM's through iterative interactions with the attack framework.
Outcome: The proposed approach is based on experiments on different LLMs to evaluate their effectiveness against red teaming attacks.
Don’t Say No: Jailbreaking LLM by Suppressing Refusal (2025.findings-acl)

Copied to clipboard

Challenge: Large Language Models (LLMs) are vulnerable to "jailbreaking" attacks where crafted prompts manipulate them into producing toxic content.
Approach: They propose to improve the target loss objective by combining a cosine decay schedule method with refusal suppression to achieve higher success rates.
Outcome: The proposed approach outperforms baseline attacks and achieves state-of-the-art attack success rates.
Hypothetical Training for Robust Machine Reading Comprehension of Tabular Context (2023.findings-acl)

Copied to clipboard

Challenge: Counterfactual training is expensive because of the complexity of tabular data.
Approach: They propose a hypothetical training framework that uses paired examples with different hypothetical questions to supervise the direction of model gradient towards the counterfactual answer change.
Outcome: The proposed framework improves on tabular MRC datasets.
Personalized Large Language Model Assistant with Evolving Conditional Memory (2025.coling-main)

Copied to clipboard

Challenge: With the rapid development of large language models, personalized large language model assistants like ChatGPT are limited in personalized services.
Approach: They propose a plug-and-play framework that could facilitate personalized large language model assistants with evolving conditional memory.
Outcome: The proposed framework can preserve the knowledge and experience from the history dialogue with the user, which can be applied to future tailored responses that better align with the users' preferences.
PERM: Psychology-grounded Empathetic Reward Modeling for Large Language Models (2026.findings-acl)

Copied to clipboard

Challenge: Existing reward models evaluate empathy from a single perspective, overlooking bidirectional interaction nature of empathy.
Approach: They propose a reward model that evaluates empathy from a single perspective . they propose PERM to integrate a bystander perspective to monitor overall interaction quality .
Outcome: a new reward model outperforms state-of-the-art models on an emotional intelligence benchmark and an industrial daily conversation dataset.
Instruct Once, Chat Consistently in Multiple Rounds: An Efficient Tuning Framework for Dialogue (2024.acl-long)

Copied to clipboard

Challenge: Tuning language models for dialogue generation has been a prevalent paradigm for building capable dialogue agents.
Approach: They propose a multi-round interactive dialogue tuning framework that models the speaker roles of agent and user separately.
Outcome: The proposed framework performs superior to fine-tuning and improves dialogue consistency.
Personalized Text Generation with Contrastive Activation Steering (2025.acl-long)

Copied to clipboard

Challenge: Existing approaches to personalized text generation rely on retrieval-augmented generation and parameter-efficient fine-tuning.
Approach: They propose a training-free framework that disentangles and represents personalized writing style as a vector in LLM’s activation-space.
Outcome: The proposed framework achieves 8% relative improvement in personalized generation while reducing storage requirements by 1700 over PEFT method.
Med-SRAF: A Multi-Agent Framework for Medical Reasoning via Semantic Routing and Agentic Fusion (2026.findings-acl)

Copied to clipboard

Challenge: Existing RAG methods suffer from a two-part problem: semantic drift and concatenation fallacy . et al.: rapid development of Large Language Models has led to a paradigm shift in artificial intelligence .
Approach: They propose a multi-agent retrieval augmentation framework guided by medical domain knowledge to address these challenges.
Outcome: The proposed framework outperforms existing general RAG baselines on five widely used medical benchmarks.
Adversary-Aware DPO: Enhancing Safety Alignment in Vision Language Models via Adversarial Training (2025.findings-emnlp)

Copied to clipboard

Challenge: Adversary-aware DPO (ADPO) is a training framework that explicitly considers adversary.
Approach: a new framework integrates adversarial training into a pre-trained large language model to enhance safety alignment . adversary-aware DPO provides a framework that explicitly considers adversary .
Outcome: a new training framework outperforms baselines in safety alignment and general utility of large language models.
CARE: Causality Reasoning for Empathetic Responses by Conditional Graph Generation (2022.findings-emnlp)

Copied to clipboard

Challenge: Existing approaches to empathetic response generation only consider causalities between the user’s emotion and the user's experiences and neglect interdependence among causalities and reason them independently.
Approach: They propose to use a conditional variable Graph Auto-Encoder to reason all plausible causalities interdependently and simultaneously given the user’s emotion, dialogue history, and future dialogue content.
Outcome: The proposed method achieves state-of-the-art in a real-world situation.
Jointly Learning Semantic Parser and Natural Language Generator via Dual Information Maximization (P19-1)

Copied to clipboard

Challenge: Semantic parsing aims to transform natural language utterances into formal meaning representations (MRs) whereas an NL generator achieves the reverse, the two tasks are often studied separately.
Approach: They propose a method of dual information maximization to regularize the learning process by matching the joint distributions of p and q of NLs.
Outcome: The proposed method empirically maximizes the variational lower bounds of expected joint distributions of NL and MRs.
A Causal View of Entity Bias in (Large) Language Models (2023.findings-emnlp)

Copied to clipboard

Challenge: Entity bias affects pretrained (large) language models, causing them to rely on (biased) parametric knowledge to make unfaithful predictions.
Approach: They propose a structured causal model whose parameters are easier to estimate . they propose to perturb the original entity with neighboring entities .
Outcome: The proposed model reduces biasing information pertaining to the original entity while still preserving sufficient semantic information from similar entities.
UniICL: An Efficient ICL Framework Unifying Compression, Selection, and Generation (2025.acl-long)

Copied to clipboard

Challenge: Existing methods to improve reasoning abilities of Large Language Models (LLMs) have limitations due to excessive growth in context length, causing large hardware burden.
Approach: They propose a novel Unified ICL framework that unifies demonstration compression, demonstration selection, and final response generation.
Outcome: The proposed framework unifies demonstration compression, demonstration selection, and final response generation.
MolTC: Towards Molecular Relational Modeling In Language Models (2024.findings-acl)

Copied to clipboard

Challenge: Molecular Relational Learning (MRL) is a promising way to understand interactions between molecular pairs.
Approach: They propose a novel LLM-based multi-modal framework for molecular interaction modeling following Chain-of-Thought (CoT) theory which integrates graphical information of two molecules in pair.
Outcome: The proposed framework integrates graphical information of two molecules in pair.
Training Turn-by-Turn Verifiers for Dialogue Tutoring Agents: The Curious Case of LLMs as Your Coding Tutors (2025.findings-acl)

Copied to clipboard

Challenge: Existing studies have focused on coding tutoring, but their capabilities in guiding users to solve complex tasks remain underexplored.
Approach: They propose a novel agent workflow, Trace-and-Verify, which combines knowledge tracing to estimate a student’s knowledge state and turn-by-turn verification to ensure effective guidance toward task completion.
Outcome: The proposed agent workflow achieves significantly higher success rates than existing tutoring agents.
Medical Dialogue Generation via Dual Flow Modeling (2023.findings-acl)

Copied to clipboard

Challenge: Medical dialogue systems (MDS) aim to provide patients with medical services, such as diagnosis and prescription.
Approach: They propose a Dual Flow enhanced Medical (DFMed) dialogue generation framework that extracts the medical entities and doctor's dialogue acts used in the dialogue history and models their transitions with an entity-centric graph flow and a sequential act flow.
Outcome: The proposed framework exceeds baselines in both automatic and manual evaluations on two datasets.
Revisiting the Self-Consistency Challenges in Multi-Choice Question Formats for Large Language Model Evaluation (2024.lrec-main)

Copied to clipboard

Challenge: Multi-choice questions (MCQs) are a common method for assessing the world knowledge of large language models.
Approach: They propose three knowledge-equivalent question variants to assess LLMs' world knowledge . they propose option position shuffle, option label replacement, and conversion to a True/False format .
Outcome: The proposed questions are shuffle, label replacement, and True/False format.
Separating Context and Pattern: Learning Disentangled Sentence Representations for Low-Resource Extractive Summarization (2023.findings-acl)

Copied to clipboard

Challenge: Context information is one of the key factors for extractive summarization, but other factors can be used to identify sentence importance.
Approach: They propose to disentangle context and pattern factors for extractive summarization . they separate context and patterns for a better generalization ability in low-resource setting .
Outcome: The proposed model can be used in the zero-shot setting or fine-tuned in the few-shot settings.
Beyond Single Frames: Can LMMs Comprehend Implicit Narratives in Comic Strip? (2025.findings-emnlp)

Copied to clipboard

Challenge: Large Multimodal Models have demonstrated strong performance on vision-language benchmarks, yet current evaluations focus on single-image reasoning.
Approach: STRIPCIPHER is a benchmark designed to evaluate model ability on understanding implicit narratives in silent comics.
Outcome: STRIPCIPHER is a high-quality, human-annotated dataset featuring fine-grained annotations and comprehensive coverage of varying difficulty levels.
Certified Robustness to Word Substitution Attack with Differential Privacy (2021.naacl-main)

Copied to clipboard

Challenge: Recent studies have shown that adversarial examples can be easily fooled by DNNs, making the robustness and security of NLP models significantly important.
Approach: They propose a differential privacy-based algorithm to achieve certified robustness against word substitution at- tacks in text classification via differential privacy.
Outcome: The proposed model achieves higher accuracy and more than 30X efficiency improvement over existing defense algorithms.
Counterfactual Debating with Preset Stances for Hallucination Elimination of LLMs (2025.coling-main)

Copied to clipboard

Challenge: Existing solutions to alleviate hallucination have considered utilizing LLMs’ inherent reasoning abilities to alleviating hallucinism, such as self-correction and diverse sampling methods.
Approach: They propose a counterfactual multi-agent debate framework that predetermines LLMs' stances to override their inherent biases for answer inspection.
Outcome: Extensive experiments on four datasets of three tasks demonstrate the superiority of the proposed framework over existing methods.
Finding RELIEF: Shaping Reasoning Behavior without Reasoning Supervision via Belief Engineering (2026.findings-acl)

Copied to clipboard

Challenge: Existing methods for shaping large reasoning models rely on reinforcement learning or fine-tuning with gold-standard reasoning traces. Existing techniques for behavior shaping rely only on additional reward modeling.
Approach: They propose a framework that aligns a model's self-concept with a target belief blueprint and internalizes desired traits by fine-tuning on synthesized, self-reflective QA pairs that affirm the target belief.
Outcome: The proposed framework outperforms behavior-supervised and preference-based models while requiring significantly lower training costs.
Cross-modality Information Check for Detecting Jailbreaking in Multimodal Large Language Models (2024.findings-emnlp)

Copied to clipboard

Challenge: Multimodal Large Language Models (MLLMs) are susceptible to jailbreak attacks, authors say . multimodal information increases the risk of attacks, but also provides additional data .
Approach: They propose a jailbreaking detector that detects maliciously perturbed image inputs . cross-modality information detector is designed to detect cross-modal similarity between harmful queries and adversarial images.
Outcome: a new tool can detect maliciously perturbed image inputs without modification or computation cost.
MulDimIF: A Multi-Dimensional Constraint Framework for Evaluating and Improving Instruction Following in Large Language Models (2026.findings-acl)

Copied to clipboard

Challenge: Existing research has focused on constraint categories, offering little guidance for improving instruction following abilities.
Approach: They propose a multi-dimensional constraint framework that allows for instruction following . they construct 9,106 code-verifiable samples and evaluate 18 LLMs .
Outcome: The proposed framework improves instruction following performance without compromising general performance.
FastCorrect 2: Fast Error Correction on Multiple Candidates for Automatic Speech Recognition (2021.findings-emnlp)

Copied to clipboard

Challenge: Error correction is widely used in automatic speech recognition (ASR) to post-process the generated sentence.
Approach: They propose a fast correction model that takes multiple ASR candidates as input for better correction accuracy.
Outcome: The proposed model can reduce the word error rate (WER) with multiple candidates by 3.2% and 2.6%.
A Study of Implicit Ranking Unfairness in Large Language Models (2024.findings-emnlp)

Copied to clipboard

Challenge: Large language models (LLMs) have demonstrated superior ability to serve as ranking models, but they will exhibit discriminatory ranking behaviors based on users’ sensitive attributes (gender).
Approach: They propose an evaluation method to investigate the severity of implicit ranking unfairness and a pair-wise regression method to conduct fair-aware data augmentation for LLM fine-tuning.
Outcome: The proposed method outperforms existing methods in ranking fairness, achieving this with only a small reduction in accuracy.
Improving Multi-turn Emotional Support Dialogue Generation with Lookahead Strategy Planning (2022.emnlp-main)

Copied to clipboard

Challenge: Existing research on building ES conversation systems only considered single-turn interactions with users, which is over-simplified and has limited support for multi-turn systems.
Approach: They propose a multi-turn ES conversation system that uses lookahead heuristics to estimate future user feedback after using particular strategies.
Outcome: The proposed system significantly outperforms baselines in both dialogue generation and strategy planning.
Event Graph based Sentence Fusion (2021.emnlp-main)

Copied to clipboard

Challenge: Sentence fusion is a conditional generation task that merges related sentences into a coherent text.
Approach: They propose to build an event graph from the input sentences to capture related events in a structured way and use the constructed event graph to guide sentence fusion.
Outcome: The proposed method achieves state-of-the-art on two datasets . it is based on the input sentences and shows that it is effective .
Controllable LLM Reasoning via Sparse Autoencoder-Based Steering (2026.acl-long)

Copied to clipboard

Challenge: Existing methods struggle to control fine-grained reasoning strategies due to conceptual entanglement in LRMs’ hidden states.
Approach: They propose to decompose strategy-entangled hidden states into a disentangled feature space by using Sparse Autoencoders to identify the few strategy-specific features from the vast pool of SAE features.
Outcome: The proposed method outperforms existing methods by 15% in control effectiveness.
A Facial Expression-Aware Multimodal Multi-task Learning Framework for Emotion Recognition in Multi-party Conversations (2023.acl-long)

Copied to clipboard

Challenge: Recent studies have shown the importance of visual information in multi-party conversations due to the complexity of visual scenes.
Approach: They propose a framework to extract face sequences as visual features from a real speaker's utterance and a pipeline method to extract the face sequence.
Outcome: The proposed framework extracts face sequences of the real speaker of each utterance and improves emotion prediction on the MELD dataset.
Time-MQA: Time Series Multi-Task Question Answering with Context Enhancement (2025.acl-long)

Copied to clipboard

Challenge: Existing time series models focus on a narrow spectrum of tasks, such as forecasting or anomaly detection.
Approach: They propose a framework that enables natural language queries across multiple time series tasks such as numerical analytical tasks and open-ended question answering with reasoning.
Outcome: The proposed framework enables natural language queries across multiple time series tasks and allows for more advanced and intuitive interactions with temporal data.
Foresight Optimization for Strategic Reasoning in Large Language Models (2026.acl-long)

Copied to clipboard

Challenge: Existing reasoning enhancement methods do not capture foresight in LLMs.
Approach: They propose to integrate opponent modeling principles into policy optimization to enhance strategic reasoning in LLMs by integrating opponent modeling into policy.
Outcome: The proposed method outperforms existing reasoning-based LLMs in out-of-domain scenarios and shows that it significantly enhances strategic reasoning across LLM of varying sizes and origins.
Agent Trading Arena: A Study on Numerical Understanding in LLM-Based Agents (2025.findings-emnlp)

Copied to clipboard

Challenge: Existing approaches to large language models are limited to historical backtesting and static data.
Approach: a new large-language model is developed to simulate real-time trading in a virtual stock market . the agent trading arena simulates real-world bid-ask interactions and provides real-life trading scenarios .
Outcome: The Agent Trading Arena simulates real-world market conditions and directly impacts price dynamics.
Can Graph Descriptive Order Affect Solving Graph Problems with LLMs? (2025.acl-long)

Copied to clipboard

Challenge: Large language models (LLMs) have achieved significant success in reasoning tasks, including mathematical reasoning and logical deduction.
Approach: They conduct the first comprehensive analysis of how the order of graph descriptions impacts LLM performance.
Outcome: The results show that graph descriptions significantly improve LLMs’ comprehension of graph structures, and the robustness of LLM models to graph description order varies across different tasks.
ReList: A Multi-objective Reasoning Framework for Diversified Listwise Query Recommendation (2026.acl-industry)

Copied to clipboard

Challenge: Existing methods for related search have limited semantic redundancy and wasted retrieval quota . generative retrieval approaches lack explicit reasoning, relying on superficial click-through rate rewards .
Approach: They propose a framework that transforms related search into a reasoning-enhanced listwise generation task.
Outcome: Experimental results show that ReList outperforms state-of-the-art methods in query diversity and user engagement.
MIND Your Reasoning: A Meta-Cognitive Intuitive-Reflective Network for Dual-Reasoning in Multimodal Stance Detection (2026.acl-long)

Copied to clipboard

Challenge: Existing methods operate by learning to fuse modalities, leading to frequent misjudgments.
Approach: They propose a paradigm shift from *learning to fuse* to *learning the reason's process' inspired by the dual-process theory of human cognition, MIND operationalizes a self-improving loop.
Outcome: The proposed model significantly outperforms baseline models and exhibits strong generalization.
Measuring What Makes You Unique: Difference-Aware User Modeling for Enhancing LLM Personalization (2025.findings-acl)

Copied to clipboard

Challenge: Extensive experiments on real-world datasets demonstrate that DPL significantly enhances LLM personalization.
Approach: They propose a novel approach that emphasizes extracting inter-user differences to enhance LLM personalization.
Outcome: The proposed approach extracts inter-user differences to enhance LLM personalization.
A Federated Framework for LLM-based Recommendation (2025.findings-naacl)

Copied to clipboard

Challenge: Large Language Models (LLMs) have demonstrated potential in building generative recommendation systems through fine-tuning user behavior data.
Approach: They propose a federated framework for LLM-based recommendation that combines dynamic parameter aggregation and learning speed for different clients.
Outcome: The proposed framework achieves a more balanced client performance and improved overall performance in a computational and storage-efficient way while safeguarding user privacy well.
STeCa: Step-level Trajectory Calibration for LLM Agent Learning (2025.findings-acl)

Copied to clipboard

Challenge: Existing work focuses on behavior cloning from expert demonstrations or preference learning through exploratory trajectory sampling, but these methods often struggle to address long-horizon tasks where suboptimal actions accumulate step by step, causing agents to deviate from correct task trajectories.
Approach: They propose a framework for LLM-based agent learning that identifies suboptimal actions through a step-level reward comparison during exploration and constructs calibrated trajectories using LLM reflection.
Outcome: The proposed framework outperforms existing methods in long-horizon tasks where suboptimal actions accumulate step by step, causing agents to deviate from correct task trajectories.
Empowering Tabular Data Preparation with Language Models: Why and How? (2026.acl-long)

Copied to clipboard

Challenge: Tabular data preparation is a critical step in enhancing the usability of tabular data.
Approach: They analyze how LMs can be combined with other components for different tabular data preparation tasks.
Outcome: The proposed methods lack the ability to capture the relationships within tables and adapt to the tasks involved.
OpenResearcher: Unleashing AI for Accelerated Scientific Research (2024.emnlp-demo)

Copied to clipboard

Challenge: Global scientific publications are growing annually by about 4%-5% (Pinedo et al., 2024).
Approach: They introduce an AI-assisted platform that answers diverse questions from researchers using Retrieval-Augmented Generation (RAG) they develop various tools to understand queries, search from the scientific literature, filter retrieved information, provide accurate and comprehensive answers, and self-refine answers.
Outcome: OpenResearcher is built on Retrieval-Augmented Generation (RAG) to integrate Large Language Models (LLMs) with up-to-date, domain-specific knowledge.
Length Controlled Generation for Black-box LLMs (2025.acl-long)

Copied to clipboard

Challenge: Existing length control methods involve fine-tuning the parameters of LLMs, which is inefficient and suboptimal for practical use.
Approach: They propose an iterative sampling framework that regulates LLMs to generate length-constrained text without modifying the underlying parameters.
Outcome: The proposed method achieves 100% success rates on Llama3.1 tasks with minimal additional computational overhead.
HellaSwag-Pro: A Large-Scale Bilingual Benchmark for Evaluating the Robustness of LLMs in Commonsense Reasoning (2025.findings-acl)

Copied to clipboard

Challenge: Existing studies show that large language models are robust in commonsense reasoning . however, some variations in questions can lead to incorrect responses .
Approach: They propose a large-scale bilingual benchmark consisting of 11,200 cases . they conduct extensive experiments on 41 representative LLMs .
Outcome: The proposed benchmark systematically evaluates the robustness of large language models in commonsense reasoning.
MTR-Bench: A Comprehensive Benchmark for Multi-Turn Reasoning Evaluation (2026.acl-long)

Copied to clipboard

Challenge: Recent advances in Large Language Models (LLMs) have shown promising results in complex reasoning tasks.
Approach: They propose to use a multi-turn reasoning evaluation framework to cover multi-turn interactions with the environments of large language models.
Outcome: The proposed framework covers diverse reasoning capabilities, fine-grained difficulty granularity, and necessitates multi-turn interactions with the environments.
Muffin: Mitigating Unhelpfulness in Emotional Support Conversations with Multifaceted AI Feedback (2024.findings-acl)

Copied to clipboard

Challenge: Existing studies have shown that emotional support conversation models generate unhelpful responses that can hinder their effectiveness.
Approach: They propose a model-agnostic framework called Mitigating unhelpfulness with multifaceted AI feedback for emot io nal support (Muffin) it uses a multifaceted feedback module to assess helpfulness model responses across various facets of emotional support and contrasts helpful and unhelpful responses generated by the model.
Outcome: The proposed framework reduces the likelihood of unhelpful responses by comparing helpful and unhelpfully responses generated by previous models to improve response fluency and relevance.
Self-Detoxifying Language Models via Toxification Reversal (2023.emnlp-main)

Copied to clipboard

Challenge: Existing methods to generate toxic content in pretrained language models are resource-intensive and require additional components.
Approach: They propose a method that enables the PLM itself to achieve "self-detoxification" they identify the toxification direction from the normal generation process to the one prompted with the negative prefix and then steer the generation to the reverse direction by manipulating the information movement within the attention layers.
Outcome: The proposed method can achieve comparable performance with state-of-the-art methods without any fine-tuning or extra components.
E-Verify: A Paradigm Shift to Scalable Embedding-based Factuality Verification (2025.findings-emnlp)

Copied to clipboard

Challenge: Existing factuality verification methods follow a Decompose-Then-Verify paradigm, which improves granularity but suffers from poor scalability and efficiency.
Approach: They propose a Decompose-Embed-Interact paradigm that shifts factuality verification from costly text-level reasoning to efficient alignment in embedding space.
Outcome: The proposed paradigm shifts factuality verification from costly text-level reasoning to efficient alignment in embedding space .
RiskLab: A Controlled Toolkit for Probing Emergent Risks in LLM-Based Multi-Agent Systems (2026.acl-demo)

Copied to clipboard

Challenge: Recent advances in large language model (LLM) agents have accelerated deployment of multi-agent systems for complex tasks.
Approach: They propose an open-source toolkit for instantiating, probing, and measuring emergent risks in LLM-based multi-agent systems under controlled conditions.
Outcome: The proposed toolkit is based on a structured topology–environment–protocol–agent–task quintuple enabling reproducible studies of how communication structure, coordination mechanisms, and incentives shape system-level risks.
MMAPG: A Training-Free Framework for Multimodal Multi-hop Question Answering via Adaptive Planning Graphs (2025.emnlp-main)

Copied to clipboard

Challenge: Existing multimodal question answering models rely on sequential retrieval and reasoning, but this single-path paradigm makes them vulnerable to errors due to misleading intermediate steps.
Approach: They propose a multimodal multi-hop question answering framework guided by an Adaptive Planning Graph . they propose modality-specific strategies that dynamically adapt to distinct data types .
Outcome: The proposed framework outperforms existing models that rely on training.
Evaluating Mathematical Reasoning of Large Language Models: A Focus on Error Identification and Correction (2024.findings-acl)

Copied to clipboard

Challenge: Existing evaluations focus on problem-solving from examiner perspective, overlooking a dual perspective of examiner regarding error identification and correction.
Approach: They propose to use an annotated dataset to evaluate large language models from the examiner perspective and to use diverse prompts to evaluate eleven representative LLMs.
Outcome: The proposed model outperforms all models while LLaMA-2-7B has comparable abilities to closed-source models GPT-3.5 and Gemini Pro.
Generative Cross-Modal Retrieval: Memorizing Images in Multimodal Language Models for Retrieval and Beyond (2024.acl-long)

Copied to clipboard

Challenge: Recent advances in generative language models have demonstrated their ability to memorize knowledge from documents and recall knowledge to respond to user queries effectively.
Approach: They propose to enable multimodal large language models to memorize and recall images within their parameters.
Outcome: The proposed model performs well even with large-scale image candidate sets.
Consistency-Aware Online Multi-Objective Alignment for Related Search Query Generation (2025.acl-industry)

Copied to clipboard

Challenge: Existing methods fail to reconcile click-through rate (CTR) optimization with topic expansion.
Approach: They propose a query generation framework that aligns click-through rate and topic expansion goals through an online DPO paradigm.
Outcome: The proposed approach achieves significant CTR gains (+2.3%) and higher human-rated query quality compared to state-of-the-art methods.
Towards Dynamic Theory of Mind: Evaluating LLM Adaptation to Temporal Evolution of Human States (2025.acl-long)

Copied to clipboard

Challenge: Existing benchmarks assess basic Theory of Mind abilities but neglect temporal evolution of mental states in real-world social contexts.
Approach: They propose a benchmark specifically designed to evaluate Large Language Models' ability to understand and track the temporal progression of mental states across interconnected scenarios.
Outcome: The proposed benchmarks underperform humans by 44.7% and show that they can model the dynamic nature of human mental states better than existing models.
Unlocking Efficiency in Large Language Model Inference: A Comprehensive Survey of Speculative Decoding (2024.findings-acl)

Copied to clipboard

Challenge: Large Language Models (LLMs) have a high inference latency stemming from autoregressive decoding.
Approach: They propose a novel decoding paradigm that drafts multiple tokens and verifies them in parallel . they aim to provide a catalyst for further research on Speculative Decoding .
Outcome: The proposed method drafts multiple tokens and verifies them in parallel . it can be used to accelerate inference in large language models.
Text-like Encoding of Collaborative Information in Large Language Models for Recommendation (2024.acl-long)

Copied to clipboard

Challenge: Existing methods to adapt Large Language Models for Recommendation (LLMRec) do not represent collaborative information in a text-like format, which may not align optimally with LLMs.
Approach: They propose a novel LLMRec method that integrates collaborative information through text-like encoding.
Outcome: Extensive experiments show that BinLLM integrates collaborative information better with LLMs.
Self-Improvement Towards Pareto Optimality: Mitigating Preference Conflicts in Multi-Objective Alignment (2025.findings-acl)

Copied to clipboard

Challenge: Existing approaches to optimize large language models with human preferences suffer from preference conflicts in the data.
Approach: They propose to construct Pareto-optimal responses to resolve preference conflicts by using a self-improving DPO framework that enables LLMs to self-generate and select Paret-optimized responses.
Outcome: The proposed framework achieves superior Pareto Front performance over baselines on two datasets.
Where and What: Reasoning Dynamic and Implicit Preferences in Situated Conversational Recommendation (2026.acl-long)

Copied to clipboard

Challenge: Situated conversational recommendation (SCR) uses visual scenes grounded in specific environments and natural language dialogue to deliver contextually appropriate recommendations.
Approach: They propose a framework that integrates scene transition estimation and Bayesian inverse inference to provide contextually appropriate recommendations.
Outcome: The proposed framework achieves superiority over baselines on two representative benchmarks on dynamic scene transitions and implicit user intents.
LinkPrompt: Natural and Universal Adversarial Attacks on Prompt-based Language Models (2024.naacl-long)

Copied to clipboard

Challenge: Prompt-based learning is a new language model training paradigm that adapts Pre-trained Language Models (PLMs) to downstream tasks.
Approach: They propose a prompt-based learning paradigm that adapts Pre-trained Language Models to downstream tasks . they use a gradient-based beam search algorithm to generate adversarial triggers .
Outcome: The proposed model improves performance on various natural language processing tasks by optimizing the prompt template.
The Evolution of Thought: Tracking LLM Overthinking via Reasoning Dynamics Analysis (2026.acl-long)

Copied to clipboard

Challenge: Explicit reasoning trajectories increase performance but often trigger overthinking . despite its importance, this study examines how each step of reasoning affects the final outcome .
Approach: They propose a Reasoning Completion Point Detector that detects the RCP by monitoring rank dynamics of termination tokens.
Outcome: The proposed method reduces token usage by up to 44% while preserving accuracy.
Customizing In-context Learning for Dynamic Interest Adaption in LLM-based Recommendation (2025.findings-acl)

Copied to clipboard

Challenge: Existing Large Language Model (LLM)-based recommender systems face challenges to adapt to dynamic user interests without any model-level updates.
Approach: They propose a framework that establishes recommendation-oriented in-context learning by structuring recent user interactions and current inputs into ICL formats.
Outcome: The proposed model adapts to dynamic user interests without model updates without any model updates and is available online at https://anonymous.4open.science/r/RecICL-8003.
Robust Prompt Optimization for Large Language Models Against Distribution Shifts (2023.emnlp-main)

Copied to clipboard

Challenge: Existing research has explored automatic prompt optimization methods to eliminate manual effort in identifying effective prompts for a given task.
Approach: They propose a framework for prompt optimization that can be generalized to an unlabeled target group.
Outcome: The proposed framework improves on target group and source group while generalizing to unlabeled target group.
TokenSkip: Controllable Chain-of-Thought Compression in LLMs (2025.emnlp-main)

Copied to clipboard

Challenge: Chain-of-Thought (CoT) has been proven effective in enhancing the reasoning capabilities of large language models (LLMs).
Approach: They propose a chain-of-thought (CoT) prompting approach that enables LLMs to selectively skip less important tokens, allowing for controllable CoT compression.
Outcome: Experiments show that TokenSkip reduces CoT token usage while preserving strong reasoning performance.
Seeing Isn’t Believing: Mitigating Belief Inertia via Active Intervention in Embodied Agents (2026.findings-acl)

Copied to clipboard

Challenge: Existing large language models (LLMs) have enabled agents to tackle complex embodied tasks through environmental interaction, but they still make suboptimal decisions and perform ineffective actions.
Approach: They propose an active belief intervention mechanism that generates explicit belief states . they characterize belief inertia as a key failure mode of LLM-based agents .
Outcome: The proposed method achieves significant gains in task success rates across embodied benchmarks.
Why Safeguarded Ships Run Aground? Aligned Large Language Models’ Safety Mechanisms Tend to Be Anchored in The Template Region (2025.acl-long)

Copied to clipboard

Challenge: Infilling a fixed template between the input instruction and initial model output is a common practice for existing LLMs, but it is vulnerable to inference-time jailbreak attacks.
Approach: They propose to fill a fixed template between the input instruction and initial model output and to detach safety mechanisms from the template region to mitigate the risk of inference-time jailbreak attacks.
Outcome: The proposed method is widespread across aligned LLMs and shows that it mitigates inference-time jailbreak vulnerabilities.
Counterfactual Active Learning for Out-of-Distribution Generalization (2023.acl-long)

Copied to clipboard

Challenge: Existing studies on active learning methods focus on the out-of-distribution generalization of out- of-distortion samples.
Approach: They propose a counterfactual active learning approach that empowers active learning with counterfact thinking to bridge the seen samples with unseen cases.
Outcome: The proposed approach outperforms existing active learning methods on public datasets with comparable IID performance.
Think Twice Before Trusting: Self-Detection for Large Language Models through Comprehensive Answer Reflection (2024.findings-emnlp)

Copied to clipboard

Challenge: Existing approaches to self-detection only retrospectively evaluate LLM-generated answers, leading to over-trust in incorrectly generated answers.
Approach: They propose a self-detection paradigm that considers the comprehensive answer space beyond LLM-generated answers to mitigate the over-trust in LLM generated incorrect answers.
Outcome: The proposed framework can be integrated with existing approaches for superior self-detection.
TInR: Exploring Tool-Internalized Reasoning in Large Language Models (2026.acl-long)

Copied to clipboard

Challenge: Existing methods rely on external tool documentation during reasoning, leading to tool mastery difficulty, tool size constraints, and inference inefficiency.
Approach: They propose a tool-internalized reasoning framework for unified reasoning and tool usage that integrates external tools into Large Language Models (LLMs) to address these issues, they propose 'tool-internet-based' reasoning.
Outcome: The proposed method achieves superior performance across in-domain and out-of-domain settings, highlighting its effectiveness and efficiency.
Multiview Identifiers Enhanced Generative Retrieval (2023.acl-long)

Copied to clipboard

Challenge: Current approaches use a numeric ID or text piece as the identifier, but these identifieres cannot cover a passage’s content well.
Approach: They propose a new type of identifier that is generated based on the content of a passage and could integrate contextualized information that text pieces lack.
Outcome: The proposed approach performs the best in generative retrieval on three public datasets.
Unpaired Sentiment-to-Sentiment Translation: A Cycled Reinforcement Learning Approach (P18-1)

Copied to clipboard

Challenge: Existing studies for sentiment-to-sentiment "translation" only change the underlying sentiment and fail to keep the semantic content.
Approach: They propose a cycled reinforcement learning method that combines neutralization module and emotionalization module.
Outcome: The proposed method outperforms state-of-the-art systems on Yelp and Amazon review datasets.
Parallel Test-Time Scaling for Latent Reasoning Models (2026.acl-long)

Copied to clipboard

Challenge: Parallel test-time scaling is a pivotal approach for enhancing large language models.
Approach: They propose two uncertainty-inspired stochastic strategies for parallel test-time scaling for latent reasoning models and a Latent Reward Model for aggregation.
Outcome: The proposed model scales well with compute and enables effective trajectory selection.
Agent-based Substructure Counting under Local Differential Privacy (2026.acl-long)

Copied to clipboard

Challenge: Recent studies have demonstrated the ability of Large Language Models (LLMs) to process graph problems.
Approach: They propose to decompose substructure counting into node-level tasks distributed among node agents and embed the knowledge of distributed algorithms and DP frameworks in the curator agent and privacy controller.
Outcome: Extensive experiments on 6 real-world datasets validate the effectiveness of the proposed framework for substructure counting tasks under edge local differential privacy (LDP).
Variational Autoregressive Decoder for Neural Response Generation (D18-1)

Copied to clipboard

Challenge: Existing variational Bayesian models generate responses from a single latent variable, which is not sufficient to model high variability in responses.
Approach: They propose a conditional variable auto-encoder that sequentially introduces latent variables to condition the generation of each word in the response sequence.
Outcome: Empirical results show that the proposed model improves on state-of-the-art models on Opensubtitle and Reddit datasets.
Target-oriented Proactive Dialogue Systems with Personalization: Problem Formulation and Dataset Curation (2023.emnlp-main)

Copied to clipboard

Challenge: a recent study defines a conversation target from the system side to proactively steer conversations toward predefined targets or accomplish specific system-side goals.
Approach: They propose a dataset curation framework that automatically curations a large-scale personalized dialogue dataset using a role-playing approach.
Outcome: The proposed dataset is of high quality and could contribute to exploring personalized target-oriented dialogue.
HydraRAG: Structured Cross-Source Enhanced Large Language Model Reasoning (2025.emnlp-main)

Copied to clipboard

Challenge: Current RAG system retrieves evidence from knowledge graphs and text documents but has limitations in multi-hop reasoning, multi-entity questions, and source verification.
Approach: They propose a training-free framework that unifies graph topology, document semantics, and source reliability to support deep, faithful reasoning in large language models.
Outcome: The proposed framework outperforms the current hybrid model-based model-driven system by 20.3% and 30.1% on seven benchmark datasets.
Fact-level Extractive Summarization with Hierarchical Graph Mask on BERT (2020.coling-main)

Copied to clipboard

Challenge: Existing extractive summarization models generate summaries by selecting salient sentences, but there is a gap between the human-written gold summary and oracle sentence labels.
Approach: They propose to extract fact-level semantic units for better extractive summarization by incorporating a hierarchical structure into the model and incorporate it with BERT using a Hierarchical graph mask.
Outcome: The proposed model achieves state-of-the-art on the CNN/DaliyMail dataset.
Tunable LLM-based Proactive Recommendation Agent (2025.acl-long)

Copied to clipboard

Challenge: Current methods focus on catering to existing user interests, leading to polarized recommendation distributions.
Approach: They propose an LLM-based Actor-Critic Agent framework to cultivate latent interests through multi-step recommendations.
Outcome: The proposed framework optimizes long-term rewards and dynamically evolves with user feedback.
Dialogue Planning via Brownian Bridge Stochastic Process for Goal-directed Proactive Dialogue (2023.findings-acl)

Copied to clipboard

Challenge: Goal-directed dialogue systems aim to proactively reach a pre-determined target through multi-turn conversations.
Approach: They propose a coherent dialogue planning approach that uses a stochastic process to model the temporal dynamics of dialogue paths.
Outcome: The proposed approach generates more coherent utterances and achieves the goal with a higher success rate.
AgencyBench: Benchmarking the Frontiers of Autonomous Agents in 1M-Token Real-World Contexts (2026.acl-long)

Copied to clipboard

Challenge: Existing benchmarks focus on single agentic capability, failing to capture long-horizon real-world scenarios.
Approach: They propose a benchmark that evaluates 6 agentic capabilities across 32 real-world scenarios.
Outcome: Experiments show that closed-source models outperform open-source model (48.4% vs 32.1%) integrating models with advanced scaffolds to form autonomous agents is a paradigm shift.
GOVERN: Gradient Orientation Vote Ensemble for Multi-Teacher Reinforced Distillation (2024.emnlp-industry)

Copied to clipboard

Challenge: Pre-trained language models have achieved remarkable performance in OpenQA, but for practical deployment, knowledge distillation is crucial to maintain high performance while operating under computational constraints.
Approach: They propose an algorithm to perform unsupervised knowledge distillation without the guidance of labels to achieve 99.5% of performance.
Outcome: The proposed algorithm achieves 99.5% of performance in a commercial question-answering system.
Distillation Enhanced Generative Retrieval (2024.findings-acl)

Copied to clipboard

Challenge: Generative retrieval is a promising new paradigm in text retrieval that generates identifier strings of relevant passages as the retrieval target.
Approach: They propose a framework that leverages generative language models to enhance generative retrieval by distillation.
Outcome: The proposed framework achieves state-of-the-art performance among the generative retrieval methods.
SSR-Zero: Simple Self-Rewarding Reinforcement Learning for Machine Translation (2026.findings-acl)

Copied to clipboard

Challenge: Large language models (LLMs) have demonstrated remarkable capabilities in machine translation, but most MT-specific LLMs rely heavily on external supervision during training.
Approach: They propose a reinforcement learning framework for machine translation that is reference-free and relies solely on self-judging rewards.
Outcome: The proposed framework outperforms existing LLMs and larger general LLM models on English Chinese translation benchmarks and performs competitively with leading closed-source systems.
E2CL: Exploration-based Error Correction Learning for Embodied Agents (2024.findings-emnlp)

Copied to clipboard

Challenge: Language models are exhibiting increasing capability in knowledge utilization and reasoning, but they often suffer from misalignment between their intrinsic knowledge and environmental knowledge, leading to infeasible actions.
Approach: They propose a framework that leverages exploration-induced errors and environmental feedback to enhance environment alignment for embodied agents.
Outcome: The proposed framework outperforms baseline methods and exhibits superior self-correction capabilities.
Omni-R1: Towards the Unified Generative Paradigm for Multimodal Reasoning (2026.findings-acl)

Copied to clipboard

Challenge: Early approaches focus on text-based reasoning, but they often follow a single task-specific reasoning pattern.
Approach: They propose a generative multimodal reasoning paradigm that unifies diverse reasoning skills by generating intermediate images during the reasoning process.
Outcome: The proposed model unifies diverse multimodal reasoning skills by generating intermediate images during the reasoning process.

What is GenGO?

GenGO is an NLP powered publication search system. It currenctly indexes 30k+ papers from ACL Anthology, and implements multi-aspect summarization, semantic search, and more!

Information

About
Limitations