Papers by Yifei Gong
CMMLU: Measuring massive multitask language understanding in Chinese (2024.findings-acl)
Copied to clipboard
| Challenge: | Existing large language models struggle to achieve an accuracy of even 60%, which is the pass mark for Chinese exams. |
| Approach: | They propose to use CMMLU to evaluate Chinese multilingual and Chinese LLMs in a comprehensive benchmark that covers various subjects and settings. |
| Outcome: | The proposed benchmark covers natural sciences, social sciences, engineering, and the humanities and aims to improve on existing models. |
TOOLCAD: Exploring Tool-Using Large Language Models in Text-to-CAD Generation with Reinforcement Learning (2026.findings-acl)
Copied to clipboard
| Challenge: | Large Language Models (LLMs) have shown remarkable advances in enabling language agents to tackle real-world tasks. |
| Approach: | They propose a tool-using agent-based CAD framework that automates text-to-CAD modeling . they propose an interactive CAD gym to roll out reasoning and tool-augmented interaction trajectories with the CAD engine . |
| Outcome: | The proposed framework can generalize across complex modeling tasks, supporting their open-source counterparts. |