Papers by Xinghao Pan
Unveiling the Key Factors for Distilling Chain-of-Thought Reasoning (2025.findings-acl)
Copied to clipboard
Xinghao Chen, Zhijing Sun, Guo Wenjin, Miaoran Zhang, Yanjun Chen, Yirong Sun, Hui Su, Yijie Pan, Dietrich Klakow, Wenjie Li, Xiaoyu Shen
| Challenge: | Large Language Models (LLMs) excel in reasoning tasks through Chain-of-Thought prompting. |
| Approach: | They examine the factors influencing CoT distillation including granularity, format and teacher model. |
| Outcome: | The proposed model is based on four teacher models and seven student models across seven mathematical and commonsense reasoning datasets. |
Twitter Homophily: Network Based Prediction of User’s Occupation (P19-1)
Copied to clipboard
| Challenge: | Existing approaches to predicting Twitter users' demographic attributes exploit, select, and combine various features generated from text and network to achieve the best performance. |
| Approach: | They extend existing Twitter occupational class prediction data set and exploit social network homophily to achieve competitive performance. |
| Outcome: | The proposed method achieves better performance on a dataset with a small fraction of the training data. |