Papers by Xingyu Hu

8 papers
Beware of Your Po! Measuring and Mitigating AI Safety Risks in Role-Play Fine-Tuning of LLMs (2025.acl-long)

Copied to clipboard

Challenge: Existing role-play fine-tuning techniques improve role adaptability but may degrade safety performance, especially for villainous characters.
Approach: They propose safety-aware Role-Play Fine-Tuning (SaRFT) to balance role-playing capabilities and safety.
Outcome: The proposed method outperforms state-of-the-art baselines under both LoRA and full-parameter fine-tuning settings.
When Personalization Legitimizes Risks: Uncovering Safety Vulnerabilities in Personalized Dialogue Agents (2026.acl-long)

Copied to clipboard

Challenge: Existing research on personalized LLM agents focuses on the effectiveness of personalized responses.
Approach: They propose a benchmark to quantify intent legitimation in personalized interactions . they propose 'detection-reflection' method that detects intent legititimation from internal representation space .
Outcome: The proposed method reduces safety degradation by using internal representation space.
TPTU-v2: Boosting Task Planning and Tool Usage of Large Language Model-based Agents in Real-world Industry Systems (2024.emnlp-industry)

Copied to clipboard

Challenge: Large language models have demonstrated proficiency in addressing tasks that necessitate a combination of task planning and the usage of external tools.
Approach: They propose a framework to enhance the task planning and tool usage abilities of LLMs in industrial systems.
Outcome: The proposed framework enhances the task planning and tool usage abilities of LLM-based agents in industrial systems.
Chain of Strategy Optimization Makes Large Language Models Better Emotional Supporter (2025.findings-emnlp)

Copied to clipboard

Challenge: Existing supervised fine-tuning (SFT) fails to address these issues, as it trains models on single gold-standard responses without modeling nuanced strategy trade-offs.
Approach: They propose a two-stage framework that optimizes strategy selection preferences at each dialogue turn.
Outcome: The proposed framework improves strategy selection preferences at each dialogue turn.
AdaSteer: Your Aligned LLM is Inherently an Adaptive Jailbreak Defender (2025.emnlp-main)

Copied to clipboard

Challenge: Activation steering offers training-free defense but relies on fixed steering coefficients, resulting in suboptimal protection and increased false rejections of benign inputs.
Approach: They propose an adaptive activation steering method that dynamically adjusts model behavior based on input characteristics.
Outcome: The proposed method outperforms baseline methods across multiple jailbreak attacks with minimal impact on utility.
TEA-Bench: A Systematic Benchmarking of Tool-enhanced Emotional Support Dialogue Agent (2026.acl-long)

Copied to clipboard

Challenge: Existing ESC systems focus on affective support in text-only settings, ignoring how external tools can enable factual grounding and reduce hallucination in multi-turn emotional support.
Approach: They propose a benchmark for evaluating tool-augmented agents in ESC with realistic emotional scenarios and an MCP-style tool environment.
Outcome: The proposed benchmarks show that tool augmentation improves emotional support quality and reduces hallucination, but weaker models benefit only marginally.
Why Can Distillation Work with Limited Resources? A Systematic Study (2026.findings-acl)

Copied to clipboard

Challenge: Recent advances in large language models have driven reasoning performance . low-resource distillation can boost models' performance, but a framework is missing .
Approach: They conduct a controlled experiment to find out why low-resource distillation can boost model performance . they find that distillation enhances the presence of advanced cognitive behaviors .
Outcome: The proposed model shows more flexible reasoning, the authors show . they show that distillation enhances the presence of advanced cognitive behaviors .
MetaBench: A Multi-task Benchmark for Assessing LLMs in Metabolomics (2026.acl-long)

Copied to clipboard

Challenge: Large Language Models (LLMs) have demonstrated remarkable capabilities on general text, but their proficiency in specialized scientific domains remains uncharacterized.
Approach: They evaluate the capabilities of large language models in metabolomics research using MetaBench . they found that models perform well on text generation tasks, but cross-database identifier grounding remains challenging .
Outcome: The evaluation of 25 open- and closed-source LLMs reveals distinct performance patterns across metabolomics tasks.

What is GenGO?

GenGO is an NLP powered publication search system. It currenctly indexes 30k+ papers from ACL Anthology, and implements multi-aspect summarization, semantic search, and more!

Information

About
Limitations