Papers by Xiangzhong Fang
Thinking with DistilQwen: A Tale of Four Distilled Reasoning and Reward Model Series (2025.emnlp-industry)
Copied to clipboard
| Challenge: | In the rapidly evolving landscape of large language models, the need for efficient reasoning models has become increasingly urgent. |
| Approach: | They extend the Qwen model family by introducing four model series specifically designed for industrial applications. |
| Outcome: | The proposed models outperform previous models in multiple benchmarks and provide scalable training and inference functionality on the Alibaba Cloud PAI platform. |
Enhancing Reasoning Abilities of Small LLMs with Cognitive Alignment (2025.emnlp-main)
Copied to clipboard
| Challenge: | Existing methods to distill chain-of-thought (CoT) results from large language reasoning models (LRMs) to small models are ineffective and require substantial amount of annotated data. |
| Approach: | They propose a Critique-Rethink-Verify system for training small language reasoning models that can be critiquized according to the cognitive capabilities of smaller models. |
| Outcome: | The proposed system outperforms other methods on challenging reasoning benchmarks. |
NER-guided Comprehensive Hierarchy-aware Prompt Tuning for Hierarchical Text Classification (2024.lrec-main)
Copied to clipboard
| Challenge: | Hierarchical text classification (HTC) is a challenging task in natural language processing due to its complex taxonomic label hierarchy. |
| Approach: | They propose to use prompts to model hierarchical text classification (HTC) they propose to introduce conditional random fields and Global Pointer to establish hierarchic dependencies . |
| Outcome: | The proposed approach achieves state-of-the-art (SoTA) performance on three public datasets. |
Reasoning with OmniThought: A Large CoT Dataset with Verbosity and Cognitive Difficulty Annotations (2026.acl-long)
Copied to clipboard
| Challenge: | Existing resources often fail to provide extensive reasoning problems with coherent CoT processes distilled from multiple teacher models. |
| Approach: | They propose a large-scale dataset featuring 2 million CoT processes generated by multiple powerful LRMs. |
| Outcome: | The proposed dataset features 2 million CoT processes and is validated by multiple powerful LRMs. |