Papers by Guangyu Chen

10 papers
Robust Adaptation of Large Multimodal Models for Retrieval Augmented Hateful Meme Detection (2025.emnlp-main)

Copied to clipboard

Challenge: Large Multimodal Models (LMMs) have shown promise in hateful meme detection, but they face limitations like sub-optimal performance and limited out-of-domain generalization capabilities.
Approach: They propose a robust adaptation framework for hateful meme detection that enhances in-domain accuracy and cross-domain generalization while preserving the general vision-language capabilities of LMMs.
Outcome: The proposed framework outperforms larger agentic systems in detecting hateful memes under adversarial attacks while maintaining the general vision-language capabilities of LMMs.
PRISM: Probing Reasoning, Instruction, and Source Memory in LLM Hallucinations (2026.acl-long)

Copied to clipboard

Challenge: Existing benchmarks for hallucination evaluation rely on mixed queries and posterior evaluation, which quantifies hallucinosity severity but offers limited insight into where and why they occur.
Approach: They propose a controlled benchmark that disentangles hallucinations into four dimensions: knowledge missing, knowledge errors, reasoning errors, and instruction-following errors.
Outcome: The proposed model disentangles hallucinations into four dimensions: knowledge missing, knowledge errors, reasoning errors, and instruction-following errors.
TRACE: Two-Phase RL for Causal Graph Exploration and Deeper Psychological Intervention in Dynamic Counseling Scenarios (2026.findings-acl)

Copied to clipboard

Challenge: Existing models lack the ability to actively explore the underlying causes of psychological distress.
Approach: They propose a two-phase reinforcement learning framework that implements a causal-graph-driven reward scheme across two phases: an exploration phase that rewards the causal graph reconstruction following a surface-to-deep path, and an intervention phase that supports targeted restructuring of irrational beliefs.
Outcome: Extensive experiments show that TRACE outperforms existing models, enabling causal-chain-aware psychological intervention beyond surface-level empathy.
KBM: Delineating Knowledge Boundary for Adaptive Retrieval in Large Language Models (2025.findings-emnlp)

Copied to clipboard

Challenge: Retrieval-augmented generation (RAG) is employed to tackle these challenges . a Knowledge Boundary Model (KBM) is used to express the known/unknown of a given question .
Approach: They propose a Knowledge Boundary Model to express the known/unknown of a given question . they find that not all questions need to trigger RAG to improve performance .
Outcome: The proposed model reduces time and computational costs by retrieving parts of unknown knowledge . the proposed model can express the known/unknown of a given question and determine whether a RAG needs to be triggered .
System Prompt Hijacking via Permutation Triggers in LLM Supply Chains (2025.findings-acl)

Copied to clipboard

Challenge: Large language models (LLMs) are rapidly transforming the landscape of artificial intelligence due to the substantial resources required for training.
Approach: They propose a post-deployment attack that bypasses system prompts to compromise models . they introduce Precise Activation Guarding and Unit Deviation Sampling to protect against attack .
Outcome: The proposed attack bypasses system prompts, enabling unrestricted model outputs and safety violations.
Retrieval-Augmented Defense: Adaptive and Controllable Jailbreak Prevention for Large Language Models (2026.acl-long)

Copied to clipboard

Challenge: Large Language Models (LLMs) remain vulnerable to jailbreak attacks due to evolving nature and diversity of attack strategies.
Approach: They propose a framework for jailbreak detection that integrates a database of known attack examples into Retrieval-Augmented Generation to infer the underlying, malicious user query and jailbreak strategy used to attack the system.
Outcome: The proposed framework reduces the effectiveness of strong jailbreak attacks while maintaining low rejection rates for benign queries.
Direct Preference Optimization for Neural Machine Translation with Minimum Bayes Risk Decoding (2024.naacl-short)

Copied to clipboard

Challenge: Recent work shows that MBR decoding can significantly improve translation performance of Multilingual Large Language Models.
Approach: They propose a method that uses a monolingual fine-tuning set to fine- tune MLLMs to get the gains of MBR without additional computation in inference.
Outcome: The proposed method outperforms greedy decoding and beam search on multiple NMT tests.
Beyond Overlap Metrics: Rewarding Reasoning and Preferences for Faithful Multi-Role Dialogue Summarization (2026.findings-acl)

Copied to clipboard

Challenge: Existing methods for multi-role dialogue summarization favor surface-level imitation of references rather than genuine gains in faithfulness or alignment with human preferences.
Approach: They propose a framework that couples explicit cognitive-style reasoning with reward-based optimization for multi-role dialogue summarization.
Outcome: The proposed framework matches strong baselines on ROUGE and BERTScore, while in-depth analysis on SAMSum shows clear gains in factual faithfulness and model-based preference alignment.
GoViG: Goal-Conditioned Visual Navigation Instruction Generation via Multimodal Reasoning (2026.findings-acl)

Copied to clipboard

Challenge: Current methods for instruction generation depend on privileged inputs such as semantic maps, landmark annotations, and panoramic views.
Approach: They propose a task that generates coherent navigation instructions from egocentric visual observations.
Outcome: The proposed task generates coherent navigation instructions from egocentric visual data . the proposed task improves performance over state-of-the-art methods in BLEU-4 and CIDEr scores .

What is GenGO?

GenGO is an NLP powered publication search system. It currenctly indexes 30k+ papers from ACL Anthology, and implements multi-aspect summarization, semantic search, and more!

Information

About
Limitations