Papers by Simin Guo
daDPO: Distribution-Aware DPO for Distilling Conversational Abilities (2025.findings-acl)
Copied to clipboard
| Challenge: | Knowledge distillation (KD) with Direct Preference Optimization (DPO) has emerged as a promising approach to enhance the conversational abilities of smaller models using a larger teacher model. |
| Approach: | They propose a framework that integrates the teacher's distributional information into DPO distillation while preserving theoretical guarantees. |
| Outcome: | The proposed framework outperforms existing methods in restoring performance for pruned models and enhancing smaller models within the same LLM family. |
More Data or Better Data? A Critical Analysis of Data Selection and Synthesis for Mathematical Reasoning (2025.emnlp-industry)
Copied to clipboard
| Challenge: | Despite various proposed data construction methods, their practical utility in real-world pipelines remains underexplored. |
| Approach: | They conduct a comprehensive analysis of open-source datasets and data synthesis techniques for mathematical reasoning under a unified pipeline designed to mirror training and deployment scenarios. |
| Outcome: | The proposed pipelines mirror training and deployment scenarios and are suitable for industrial applications. |