Papers by Chengying Tu
Large-Scale Diverse Synthesis for Mid-Training (2026.findings-acl)
Copied to clipboard
| Challenge: | Existing data synthesis methods generate simplistic and homogeneous QA pairs with limited scale and diversity. |
| Approach: | They propose a framework to synthesize large-scale, diverse, and high-quality QA data for mid-training. |
| Outcome: | The proposed framework improves on 500B-token BoostQA data over pre-training benchmarks. |
LinkQA: Synthesizing Diverse QA from Multiple Seeds Strongly Linked by Knowledge Points (2026.acl-long)
Copied to clipboard
| Challenge: | Existing training data is limited in high-quality training data, limiting the ability to produce high-performance LLMs. |
| Approach: | They propose a KP-graph-based synthesis framework that extracts KPs from QA seed data and constructs a graph of KP data from multiple seeds strongly linked by KP. |
| Outcome: | The proposed framework enables flexible control over discipline and difficulty distributions while balancing KP coverage and popularity. |