Papers by Yuan Guo

46 papers
Detoxifying Large Language Models via the Diversity of Toxic Samples (2025.emnlp-main)

Copied to clipboard

Challenge: Existing methods for analyzing and utilizing toxic samples are limited . current methods fail to fully harness their potential .
Approach: They propose a diverse detoxification framework that leverages toxic samples' diversity . they propose MPSG strategy and SC-DPO approach to elicit personalized toxic responses .
Outcome: The proposed framework could be used to optimize large language models for user safety . it incorporates two components: MPSG strategy and SC-DPO approach .
EVA: Evolving Semantic Adversaries for Red-Teaming GUI Agents Against Environmental Injection Attacks (2026.findings-acl)

Copied to clipboard

Challenge: Existing methods for red-teaming face a trade-off between requiring target-specific knowledge and incurring prohibitive computational costs.
Approach: They propose a framework that evolves payloads exclusively on the semantic dimension via a discovery-deployment pipeline.
Outcome: Experiments show that EVA outperforms baselines in terms of attack success rate while evolving benign seeds into successful attacks within 1.18 to 1.71 iterations.
ToolSafety: A Comprehensive Dataset for Enhancing Safety in LLM-Based Agent Tool Invocations (2025.emnlp-main)

Copied to clipboard

Challenge: Current models exhibit notable vulnerabilities in maintaining safety during multi-step tool interactions and in indirect harm scenarios.
Approach: They propose a safety fine-tuning dataset to fine- tune LLMs into assistants . they propose to use synthesized trajectories and realistic, context-aware sample generation .
Outcome: The proposed model maintains safety in multi-step and indirect harm scenarios with little impact on helpfulness.
CLaMP 3: Universal Music Information Retrieval Across Unaligned Modalities and Unseen Languages (2025.findings-acl)

Copied to clipboard

Challenge: Music information retrieval (MIR) is a field that aims at developing computational tools for processing, organizing, and accessing music data.
Approach: They propose a framework that aligns music modalities with multilingual text in a shared representation space.
Outcome: Experiments show CLaMP 3 performs state-of-the-art on multiple MIR tasks . it surpasses baselines and shows excellent generalization in multimodal and multilingual contexts .
Chain of Ideas: Revolutionizing Research Via Novel Idea Development with LLM Agents (2025.findings-emnlp)

Copied to clipboard

Challenge: Existing methods for idea generation either trivially prompt LLMs or expose LLM to extensive literature without indicating useful information.
Approach: They propose a chain-of-ideas agent that organizes literature in a chains structure . they propose evaluating idea-generation methods from different perspectives .
Outcome: The proposed agent outperforms existing methods and matches human quality in idea generation.
Multilingual Universal Sentence Encoder for Semantic Retrieval (2020.acl-demos)

Copied to clipboard

Challenge: Using a multi-task trained dual-encoder, our models embed text from 16 languages into a shared semantic space.
Approach: They propose retrieval focused multilingual sentence embedding models on TensorFlow Hub.
Outcome: The models achieve state-of-the-art on monolingual and cross-lingual retrieval (SR) and retrieval question answering (ReQA) competitive performance is obtained on related tasks of translation pair bitext retrieval and retrieving question answering.
LLM-Driven Completeness and Consistency Evaluation for Cultural Heritage Data Augmentation in Cross-Modal Retrieval (2025.emnlp-main)

Copied to clipboard

Challenge: Cross-modal retrieval is essential for interpreting cultural heritage data, but its effectiveness is limited by incomplete or inconsistent textual descriptions.
Approach: They propose a data augmentation framework that enhances cross-modal retrieval performance by improving the completeness and consistency of LLM-generated descriptions.
Outcome: The proposed framework improves cross-modal retrieval performance by improving completeness and consistency of LLM-generated descriptions.
Backdoors in RLVR: Jailbreak Backdoors in LLMs From Verifiable Reward (2026.acl-long)

Copied to clipboard

Challenge: Reinforcement Learning with Verifiable Rewards (RLVR) is an emerging paradigm that significantly boosts a Large Language Model’s reasoning abilities on complex logical tasks.
Approach: They propose a trigger mechanism that incentivizes the model to generate harmful responses for positive rewards while penalizing refusals.
Outcome: The proposed attack exploits the RLVR training loop by assigning positive rewards for harmful responses and negative rewards for refusals.
Two Streams, One Sarcasm: Orthogonal Expert Tuning for Holistic Multimodal Sarcasm Understanding (2026.acl-long)

Copied to clipboard

Challenge: Existing benchmarks for multimodal satirical cognition hinder evaluation of multimodal Sarcasm Understanding . lack of a unified benchmark for holistic satire cognition hampers evaluation of MSU .
Approach: They propose a framework to decouple experts into orthogonal shared perception and private execution streams to physically block gradient interference between tasks.
Outcome: The proposed framework achieves superior performance on DocMSU-PLUS.
Controllable Preference Optimization: Toward Controllable Multi-Objective Alignment (2024.emnlp-main)

Copied to clipboard

Challenge: Existing algorithms for achieving optimal alignment are mostly unidirectional . a recent study suggests that large language models can be ground with evident preferences .
Approach: They propose to ground large language models with evident preferences . they propose to use controllable preference optimization to specify different objectives .
Outcome: The proposed models can provide responses that match various preferences among the ”3H” desiderata.
Can Federated Learning Safeguard Private Data in LLM Training? Vulnerabilities, Attacks, and Defense Evaluation (2025.findings-emnlp)

Copied to clipboard

Challenge: federated learning (FL) fine-tunes large language models with local data, but organizations are reluctant to share local data.
Approach: They propose a framework for fine-tuning large language models with local data . they propose centralized fine- tuning with local datasets is a good idea .
Outcome: The proposed framework allows clients to retain local data while sharing only model parameters for training.
Licon: A Diverse, Controllable and Challenging Linguistic Concept Learning Benchmark (2023.findings-emnlp)

Copied to clipboard

Challenge: Existing methods for Concept Learning focus on visual information, but visual information cannot present abstract concepts exactly, which struggles the introduction of novel concepts related to known concepts.
Approach: They propose a benchmark where concepts in diverse forms are defined by linguistic descriptions and an entailment-based concept learning method to model the relationship among concepts.
Outcome: The proposed benchmark is based on the existing visual concepts learning benchmarks and will be released to the public soon.
TreeReview: A Dynamic Tree of Questions Framework for Deep and Efficient LLM-based Scientific Peer Review (2025.emnlp-main)

Copied to clipboard

Challenge: Large Language Models (LLMs) have shown significant potential in assisting peer review, but current methods struggle to generate thorough and insightful reviews while maintaining efficiency.
Approach: They propose a framework that models paper review as a hierarchical and bidirectional question-answering process.
Outcome: The proposed framework outperforms baselines on full review generation and actionable feedback comments generation tasks while reducing LLM token usage by up to 80% compared to computationally intensive approaches.
DGPO: Beyond Pairwise Preferences with Directional Consistent Groupwise Optimization (2026.findings-acl)

Copied to clipboard

Challenge: Existing methods for directional consistency alignment of large language models are limited . a recent study suggests reverse supervision as a complement to forward reasoning .
Approach: They propose a framework that aggregates supervision signals at the group level and explicitly models direction-aware alignment through multi-candidate comparisons.
Outcome: The proposed framework achieves 3.2% accuracy improvement across five benchmarks and multiple datasets.
Compressing then Matching: An Efficient Pre-training Paradigm for Multimodal Embedding (2026.acl-long)

Copied to clipboard

Challenge: Recent approaches demonstrate that MLLMs can be adapted into competitive embedding models via large-scale contrastive learning.
Approach: They propose a compressed pre-training phase which serves as a warm-up stage for contrastive learning.
Outcome: The proposed model achieves state-of-the-art among MLLMs of comparable size on the MMEB, realizing optimization in both efficiency and effectiveness.
SWAM: Adaptive Sliding Window and Memory-Augmented Attention Model for Rumor Detection (2025.emnlp-main)

Copied to clipboard

Challenge: Existing methods for rumor detection on social media focus on static graphs, ignoring dynamic and incremental propagation . rumour detection on the social media platform is crucial to mitigating harmful effects of rumors.
Approach: They propose a sliding window and memory-augmented attention model for rumor detection . they use a dynamic propagation graph and memory to capture the long-term dependency .
Outcome: The proposed model is compared with the state-of-the-art models on two public datasets.
TRIGO: Benchmarking Formal Mathematical Proof Reduction for Generative Language Models (2023.emnlp-main)

Copied to clipboard

Challenge: Automated theorem proving (ATP) benchmarks focus on symbolic inference but rarely involve understanding complex number combination reasoning.
Approach: They propose a benchmark that requires a model to reduce a trigonometric expression with step-by-step proof and evaluates a generative LM’s reasoning ability on formulas and ability to manipulate, group, and factor number terms.
Outcome: The proposed benchmark evaluates a generative LM’s reasoning ability on formulas and ability to manipulate, group, and factor number terms.
Support or Refute: Analyzing the Stance of Evidence to Detect Out-of-Context Mis- and Disinformation (2023.emnlp-main)

Copied to clipboard

Challenge: Mis- and disinformation online are a major source of harms of different kinds . out-of-context information is where different pieces of information are falsely associated . past studies have attempted to defend against OOC mis- and deinformation through external evidence, but they disregard the role of different pieces with different stances.
Approach: They propose a stance extraction network that can extract stances of different pieces of evidence in a single framework.
Outcome: The proposed model outperforms the state-of-the-art models on a public large-scale dataset with a performance gain of 3.2% in accuracy.
Dr. Assistant: Enhancing Clinical Diagnostic Inquiry via Structured Diagnostic Reasoning Data and Reinforcement Learning (2026.findings-acl)

Copied to clipboard

Challenge: Clinical Decision Support Systems (CDSSs) provide reasoning and inquiry guidance for physicians, yet they face high maintenance costs and low generalization capability.
Approach: They propose a clinical diagnostic model with clinical reasoning and inquiry skills, the Dr. Assistant, and a pipeline to capture abstract reasoning logic.
Outcome: The proposed model outperforms open-source models and achieves competitive performance to closed-source model.
CLaMP 2: Multimodal Music Information Retrieval Across 101 Languages Using Large Language Models (2025.findings-naacl)

Copied to clipboard

Challenge: Current music information retrieval systems struggle to meet linguistic diversity challenges . current systems struggle with text queries in non-English languages .
Approach: They propose a music information retrieval system that supports both ABC notation and MIDI . CLaMP 2 includes a multilingual text encoder and a multiple-modal music encoder .
Outcome: The proposed system achieves state-of-the-art results in multilingual semantic search and music classification across modalities.
AoM: Detecting Aspect-oriented Information for Multimodal Aspect-Based Sentiment Analysis (2023.findings-acl)

Copied to clipboard

Challenge: Existing methods to extract aspects from text-image pairs and recognize their sentiments are noisy and coarsely establishing image-aspect alignment will interfere with aspect-relevant semantic and sentiment information.
Approach: They propose an Aspect-oriented method to detect aspect-relevant semantic and sentiment information by selecting textual tokens and image blocks that are semantically related to the aspects.
Outcome: The proposed method is superior to existing methods in the field of sentiment analysis.
PRIME: A Process-Outcome Alignment Benchmark for Verifiable Reasoning in Mathematics and Engineering (2026.acl-long)

Copied to clipboard

Challenge: Current outcome-centric verification paradigms neglect potential errors in the derivation process.
Approach: They propose a process-aware RLVR training paradigm utilizing verifiers selected via **PRIME**.
Outcome: The proposed approach outperforms the baseline verification paradigm on AIME24, AIME25, and Beyond-AIME models.
Look before You Leap: Dual Logical Verification for Knowledge-based Visual Question Generation (2024.lrec-main)

Copied to clipboard

Challenge: Existing methods for visual question generation focus on leveraging the semantics of inputs to propose questions, ignoring the logical coherence between generated questions and images.
Approach: They propose a logical verification method that checks logical structure between Q, images, answers and acquired outside knowledge by incorporating logical coherence between Q and Q twice in the whole procedure.
Outcome: The proposed method can generate diverse and insightful knowledge-based visual questions on two common datasets.
Does ChatGPT Know That It Does Not Know? Evaluating the Black-Box Calibration of ChatGPT (2024.lrec-main)

Copied to clipboard

Challenge: Recent performance of ChatGPT in downstream tasks is questionable, but does it know that it does not know?
Approach: They propose to use three types of proxy confidence to evaluate ChatGPT's black-box calibration ability.
Outcome: The proposed model exhibits a positive correlation with accuracy in TruthfulQA and a negative correlation in the ModAr dataset.
ChatMusician: Understanding and Generating Music Intrinsically with LLM (2024.findings-acl)

Copied to clipboard

Challenge: Despite LLMs' impressive capabilities in musical knowledge, music reasoning remains an unsolved task.
Approach: They propose an open-source large language model (LLM) that integrates intrinsic musical abilities into LLaMA2 and GPT-3.5.
Outcome: The proposed model can understand and generate music with a pure text tokenizer without external multi-modal neural structures or tokenizers.
Multi-View Incongruity Learning for Multimodal Sarcasm Detection (2025.coling-main)

Copied to clipboard

Challenge: Existing methods for multimodal sarcasm detection rely on spurious correlations, demonstrating poor generalizability beyond training environments.
Approach: They propose a method that integrates multimodal incongruities via contrastive learning for multimodal sarcasm detection by using three views to drive multi-view learning.
Outcome: The proposed method outperforms existing methods on benchmark datasets and shows that it is more generalizable than existing methods.
Global Attention Decoder for Chinese Spelling Error Correction (2021.findings-acl)

Copied to clipboard

Challenge: Existing methods for Chinese spelling error correction focus on local contextual information, thus misleading the user and reducing performance.
Approach: They propose a global attention decoder that learns the global relationship of correct input characters and candidates of potential error characters.
Outcome: The proposed method outperforms all competitor models by a large margin of up to 6.2% on three human-annotated datasets.
InCharacter: Evaluating Personality Fidelity in Role-Playing Agents through Psychological Interviews (2024.acl-long)

Copied to clipboard

Challenge: Existing methods focus on knowledge and linguistic patterns of characters.
Approach: They propose to evaluate character fidelity of role-playing agents with psychological scales . they propose to use psychological scale to measure personality traits of RPAs based on personality traits.
Outcome: The proposed model reproduces character fidelity with psychological scales and shows that it is effective in measuring personality traits.
VehicleWorld: A Highly Integrated Multi-Device Environment for Intelligent Vehicle Interaction (2025.findings-emnlp)

Copied to clipboard

Challenge: Traditional Function Calling (FC) approaches operate statelessly, requiring multiple exploratory calls to build environmental awareness before execution, leading to inefficiency and limited error recovery.
Approach: They propose a state-based function call approach that maintains explicit system state awareness and implements direct state transitions to achieve target conditions.
Outcome: The proposed approach outperforms traditional function calling approaches, achieving superior execution accuracy and reduced latency.
FGDGNN: Fine-Grained Dynamic Graph Neural Network for Rumor Detection on Social Media (2025.findings-acl)

Copied to clipboard

Challenge: Existing methods for detecting rumors on social media focus on coarse-grained temporal information and ignore fine-grain temporal dynamics.
Approach: They propose a fine-grained dynamic graph neural network model which incorporates fine-grain temporal information into a unified framework for rumor detection.
Outcome: The proposed model improves on three public real-world datasets.
Alpha-GPT: Human-AI Interactive Alpha Mining for Quantitative Investment (2025.emnlp-demos)

Copied to clipboard

Challenge: Traditional methods of alpha mining have inherent limitations, especially in implementing the ideas of quant researchers.
Approach: They propose a new alpha mining paradigm by introducing human-AI interaction and a prompt engineering algorithmic framework to implement this paradigm by using large language models.
Outcome: The proposed framework is based on human-AI interaction and large language models and is comparable to human participants in the WorldQuant International Quant Championship.
PolicyLLM: Towards Excellent Comprehension of Public Policy for Large Language Models (2026.findings-acl)

Copied to clipboard

Challenge: Large Language Models (LLMs) are increasingly integrated into real-world decision-making, but their ability to comprehend and reason about policy-related content remains underexplored.
Approach: They propose a bilingual benchmark evaluating policy comprehension comprising 21K cases across a broad spectrum of policy areas.
Outcome: The proposed model shows stronger performance on application-oriented policy tasks than on memorization or conceptual understanding, and yields the highest accuracy on structured reasoning tasks.
Skill Weaving: Efficient LLM Improvement via Modular Skillpacks (2026.findings-acl)

Copied to clipboard

Challenge: Large Language Models (LLMs) can specialize under fixed memory and inference budgets, but they struggle to achieve high performance across heterogeneous domains.
Approach: They propose a modular improvement framework that partitions full capabilities of a general-purpose model into domain-specific delta modules that reorganize and refine the model's internal knowledge.
Outcome: The proposed framework outperforms monolithic models on multi-task and agentic benchmarks and achieves up to 4 speedup.
LoRA-MGPO: Mitigating Double Descent in Low-Rank Adaptation via Momentum-Guided Perturbation Optimization (2025.findings-emnlp)

Copied to clipboard

Challenge: Low-Rank Adaptation (LoRA) adapts large language models by training only a small fraction of parameters, but as the rank of the low-rank matrices increases, LoRA exhibits an unstable “double descent” phenomenon, which delays convergence and impairs generalization by causing instability due to the attraction to sharp local minima.
Approach: They propose a framework that incorporates Momentum-Guided Perturbation Optimization (MGPO) MGPO stabilizes training dynamics by mitigating double descent phenomenon and guiding weight perturbations using momentum vectors from the optimizer’s state.
Outcome: The proposed framework improves performance on natural language understanding benchmarks and shows that it improves convergence and generalization.
Unveiling the Deficiencies of Pre-trained Text-and-Layout Models in Real-world Visually-rich Document Information Extraction (2026.findings-eacl)

Copied to clipboard

Challenge: PTLMs have shown remarkable success in multiple information extraction tasks . however, their performance in real-world scenarios falls short of expectations .
Approach: They propose to use an entity-centric dataset to evaluate PTLMs' performance . they find that inadequate annotations in benchmark datasets lead to spurious correlations .
Outcome: The proposed dataset disentangles the falsely-coupled segment and entity annotations that arises from the block-level annotation of FUNSD.
Modeling Layout Reading Order as Ordering Relations for Visually-rich Document Understanding (2024.emnlp-main)

Copied to clipboard

Challenge: Existing models of layout reading order do not convey the complete reading order information in the layout.
Approach: They propose to model layout reading order as ordering relations over layout elements . they propose a reading-order-relation-enhancing pipeline to improve model performance .
Outcome: The proposed model outperforms existing models on a visual-rich document dataset and on eight cross-domain VrD-IE/QA tasks without targeted optimization.
COIG-P: A High-Quality and Large-Scale Chinese Preference Dataset for Alignment with Human Values (2026.findings-eacl)

Copied to clipboard

Challenge: Existing Chinese preference datasets suffer from limited scale, restricted domain coverage, and insufficiently rigorous data validation.
Approach: They propose an LLM-based data annotation pipeline with no human intervention to annotate Chinese preference datasets.
Outcome: The proposed pipeline outperforms existing Chinese preference datasets on AlignBench and Chinese Reward Benchmark.
ComRAG: Retrieval-Augmented Generation with Dynamic Vector Stores for Real-time Community Question Answering in Industry (2025.acl-industry)

Copied to clipboard

Challenge: Existing methods for Community Question Answering (CQA) focus on static knowledge, limiting their applicability to real-world scenarios.
Approach: They propose a retrieval-augmented generation framework for real-time industrial CQA that integrates static knowledge with dynamic historical QA pairs via a centroid-based memory mechanism.
Outcome: The proposed framework outperforms baselines on three industrial CQA datasets and achieves 25.9% improvement in vector similarity, reducing latency by 8.7%–23.3%, and lowering chunk growth from 20.23% to 2.06% over iterations.
Conformal Event Prediction with Temporal Knowledge Graph (2026.findings-acl)

Copied to clipboard

Challenge: Current event prediction methods lack rigorous uncertainty quantification, which limits their reliability for decision-making.
Approach: They propose a conformal prediction framework that applies conformal predictions to event prediction to address this challenge.
Outcome: The proposed framework guarantees coverage while improving efficiency on three public datasets.
TeCES: Collaborative Geometric Knowledge Representation Framework under Evolving Fact Snapshots (2026.acl-long)

Copied to clipboard

Challenge: Existing knowledge graphs represent static facts but lack collaborative modeling of both . e.g., existing knowledge graph models lack a framework for integrating snapshots into knowledge graph.
Approach: They propose a framework for high-fidelity modeling of evolving snapshots using concept of snapshots.
Outcome: The proposed framework outperforms existing models on six benchmarks.
PrivLM-Bench: A Multi-level Privacy Evaluation Benchmark for Language Models (2024.acl-long)

Copied to clipboard

Challenge: generative large language models (LLMs) exhibit surprising capability and integrate previous tasks into a unified text generation formulation.
Approach: They propose a privacy evaluation benchmark to quantify the privacy leakage of language models.
Outcome: The proposed benchmark compares PPLMs with different privacy implementations to find out how privacy leakage is handled.
CodeEvo: Interaction-Driven Synthesis of Code-centric Data through Hybrid and Iterative Feedback (2026.acl-long)

Copied to clipboard

Challenge: Existing methods for generating instruction-code pairs rely on rigid heuristics and are labor-intensive.
Approach: They propose a dual-agent architecture that integrates a Coder and a Reviewer to orchestrate the generation trajectory.
Outcome: The proposed architecture outperforms baselines on a large-scale dataset of instruction-code pairs with stepped difficulty levels.
A Span-based Multimodal Variational Autoencoder for Semi-supervised Multimodal Named Entity Recognition (2022.emnlp-main)

Copied to clipboard

Challenge: Existing methods for named entity recognition on social media are not efficient for semi-supervised MNER because of the mismatch between the posted text and image.
Approach: They propose a novel method to fuse the text and image features for multimodal named entity recognition under semi-supervised setting by exploiting modal-specific VAEs.
Outcome: The proposed method outperforms baselines under supervised setting and improves performance with less labeled data than existing semi-supervised methods.
MMEvalPro: Calibrating Multimodal Benchmarks Towards Trustworthy and Efficient Evaluation (2025.naacl-long)

Copied to clipboard

Challenge: Large Multimodal Models (LMMs) exhibit impressive cross-modal understanding and reasoning abilities, but many benchmarks suffer from systematic biases.
Approach: They propose a benchmark to avoid Type-I errors by creating one perception question and one knowledge anchor question through a meticulous annotation process.
Outcome: The proposed benchmark avoids Type-I errors while maintaining reliability of MCQ evaluations.
NLoRA: Nyström-Initiated Low-Rank Adaptation for Large Language Models (2025.findings-emnlp)

Copied to clipboard

Challenge: Parameter-efficient fine-tuning is essential for adapting large language models (LLMs). However, LoRA suffers from slow convergence and some recent LoRA variants, such as PiSSA, rely on Singular Value Decomposition (SVD) for initialization.
Approach: They propose to introduce a small intermediate matrix between the low-rank matrices (A) and (B) and propose NyströmLoRA (NLoRA) which leverages Nyström-based initialization for SLoRA to improve its effectiveness and efficiency.
Outcome: The proposed approach improves on 5 natural language generation tasks and 8 natural language understanding tasks with minimal parameter overhead.
Controllable Memory Usage: Balancing Anchoring and Innovation in Long-Term Human–Agent Interaction (2026.acl-long)

Copied to clipboard

Challenge: Existing systems that use memory as an "all-or-nothing" approach to memory usage are often static and rely on experience-following tendencies.
Approach: They propose a framework that allows users to dynamically regulate memory reliance by adding context into the model's prompt.
Outcome: The proposed model outperforms prompting and memory masking strategies in multiple scenarios.

What is GenGO?

GenGO is an NLP powered publication search system. It currenctly indexes 30k+ papers from ACL Anthology, and implements multi-aspect summarization, semantic search, and more!

Information

About
Limitations