Papers by Yirong Chen
Unveiling the Key Factors for Distilling Chain-of-Thought Reasoning (2025.findings-acl)
Copied to clipboard
Xinghao Chen, Zhijing Sun, Guo Wenjin, Miaoran Zhang, Yanjun Chen, Yirong Sun, Hui Su, Yijie Pan, Dietrich Klakow, Wenjie Li, Xiaoyu Shen
| Challenge: | Large Language Models (LLMs) excel in reasoning tasks through Chain-of-Thought prompting. |
| Approach: | They examine the factors influencing CoT distillation including granularity, format and teacher model. |
| Outcome: | The proposed model is based on four teacher models and seven student models across seven mathematical and commonsense reasoning datasets. |
PsyDT: Using LLMs to Construct the Digital Twin of Psychological Counselor with Personalized Counseling Style for Psychological Counseling (2025.acl-long)
Copied to clipboard
| Challenge: | Existing mental health LLMs do not consider the fact that different psychological counselors exhibit different personal styles. |
| Approach: | They propose a framework that uses LLMs to construct the digital twin of psychological counselor with personalized counseling style. |
| Outcome: | The proposed framework can synthesize multi-turn dialogues that closely resemble real-world counseling cases and demonstrate better performance compared to baselines. |
TreeRAG: Unleashing the Power of Hierarchical Storage for Enhanced Knowledge Retrieval in Long Documents (2025.findings-acl)
Copied to clipboard
| Challenge: | Traditional RAG frameworks struggle to retrieve all relevant knowledge points . a new approach to retrieve long documents is proposed to improve performance in NLP . |
| Approach: | They propose a tree-based approach to document knowledge retrieval that preserves hierarchical structure . treeRAG is a key technique for enhancing the text generation capabilities of Large Language Models . |
| Outcome: | The proposed approach improves recall quality and precision compared to existing methods and better performance to question-answering tasks. |
CATCH: A Novel Data Synthesis Framework for High Therapy Fidelity and Memory-Driven Planning Chain of Thought in AI Counseling (2025.findings-emnlp)
Copied to clipboard
| Challenge: | Existing studies employ a one-time generation approach to synthesize multi-turn dialogue samples, resulting in low therapy fidelity and failing to capture decision-making rationale behind each response. |
| Approach: | They propose a data synthesis framework that synthesizes multi-turn dialogue samples and incrementally generates stage-aligned counseling dialogues. |
| Outcome: | The proposed framework significantly improves therapy fidelity and logical coherence in AI counseling. |
The Accuracy Paradox in RLHF: When Better Reward Models Don’t Yield Better Language Models (2024.emnlp-main)
Copied to clipboard
| Challenge: | Reinforcement Learning from Human Feedback (RLHF) significantly enhances Natural Language Processing by aligning language models with human expectations. |
| Approach: | They propose to integrate feedback from humans into RLHF to improve language models by capturing human-like preferences. |
| Outcome: | The proposed model outperforms models trained with moderately accurate reward models on relevance, factuality, and completeness tasks. |
SoulChat: Improving LLMs’ Empathy, Listening, and Comfort Abilities through Fine-tuning with Multi-turn Empathy Conversations (2023.findings-emnlp)
Copied to clipboard
| Challenge: | Large language models (LLMs) are used in psychological counseling to provide universal advice. |
| Approach: | They constructed a multi-turn empathetic conversation dataset with 2 million samples . they found that the model's empathy ability is enhanced when finetuning . |
| Outcome: | Experiments show that large language models can be finetuned to provide empathy . but, when applied to mental health or emotional support conversation, there are three main issues . |
Fine-Grained and Multi-Dimensional Metrics for Document-Level Machine Translation (2025.naacl-srw)
Copied to clipboard
| Challenge: | Large language models excel in machine translation, but most studies focus on sentence-level translation. |
| Approach: | They propose to use LLMs as a judge paradigm to evaluate document-level translations by directly prompting them to translate entire documents in a single pass. |
| Outcome: | The proposed method improves translation quality even without document-level fine-tuning compared to translating sentences separately . |