Papers by Zhi Fang
IntentCoding: Amplifying User Intent in Code Generation (2026.findings-acl)
Copied to clipboard
| Challenge: | IntentCoding captures the influence of user intent by masking out the intent, and integrates seamlessly with existing decoding procedures. |
| Approach: | They propose a decoding strategy that captures the influence of user intent by masking out the intent and applies a multi-strength ensemble mechanism to amplify the effect of user intention during generation. |
| Outcome: | The proposed model significantly improves both constraint satisfaction and functional correctness compared to greedy decoding approaches. |
DevEval: A Manually-Annotated Code Generation Benchmark Aligned with Real-World Code Repositories (2024.findings-acl)
Copied to clipboard
Jia Li, Ge Li, Yunfei Zhao, Yongmin Li, Huanyu Liu, Hao Zhu, Lecheng Wang, Kaibo Liu, Zheng Fang, Lanshen Wang, Jiazheng Ding, Xuanming Zhang, Yuqi Zhu, Yihong Dong, Zhi Jin, Binhua Li, Fei Huang, Yongbin Li, Bin Gu, Mengfei Yang
| Challenge: | Existing benchmarks are poorly aligned with real-world code repositories and are insufficient to evaluate the coding abilities of Large Language Models (LLMs). |
| Approach: | They propose a repository-level benchmark named DevEval to evaluate LLMs' coding abilities in real-world code repositories. |
| Outcome: | The proposed benchmarks show that the LLMs perform better in real-world code repositories than existing benchmarks. |
Rethinking the Role of Prompting Strategies in LLM Test-Time Scaling: A Perspective of Probability Theory (2025.acl-long)
Copied to clipboard
| Challenge: | Recent studies have shown that scaling test-time compute can also effectively improve reasoning. |
| Approach: | They propose a probabilistic method to efficiently predict scaling performance and identify the best prompting strategy under large sampling times. |
| Outcome: | The proposed method significantly improves the scaling performance of majority voting on large language models. |
PATIENT-đťś“: Using Large Language Models to Simulate Patients for Training Mental Health Professionals (2024.emnlp-main)
Copied to clipboard
Ruiyi Wang, Stephanie Milani, Jamie Chiu, Jiayin Zhi, Shaun Eack, Travis Labrum, Samuel Murphy, Nev Jones, Kate Hardy, Hong Shen, Fei Fang, Zhiyu Chen
| Challenge: | Mental illness remains one of the most critical public health issues. |
| Approach: | They propose a patient simulation framework for cognitive behavior therapy training that uses large language models to act as a simulated therapy patient. |
| Outcome: | The proposed framework improves the skill acquisition and confidence of mental health trainees beyond textbooks, videos, and role-play with non-patients. |
KELE: A Multi-Agent Framework for Structured Socratic Teaching with Large Language Models (2025.findings-emnlp)
Copied to clipboard
| Challenge: | Socratic teaching places high demands on teachers’ expertise and real-time feedback capabilities, making it difficult to scale in large educational settings. |
| Approach: | They propose a multi-agent framework for structured Socratic teaching with LLMs that integrates a structured SocRule and a consultant-teacher collaborative teaching mechanism. |
| Outcome: | The proposed framework outperforms existing LLMs in natural language generation and dialogue comprehension in the classroom. |
Benchmarking Long-Context Language Models on Long Code Understanding (2025.acl-long)
Copied to clipboard
Jia Li, Xuyuan Guo, Lei Li, Kechi Zhang, Ge Li, Jia Li, Zhengwei Tao, Fang Liu, Chongyang Tao, Yuqi Zhu, Zhi Jin
| Challenge: | Currently, long-context language models are limited by the lack of a rigorous evaluation framework for long code understanding. |
| Approach: | They propose to use a long code understanding benchmark LongCodeU to evaluate LCLMs' long code comprehension ability for practical applications. |
| Outcome: | The proposed benchmarks show that current LCLMs are limited in their long code understanding ability, particularly when the long code length is greater than 32K, falling far short of their claimed 128K to 1M context windows. |
NL2Lean: Translating Natural Language into Lean 4 through Multi-Aspect Reinforcement Learning (2025.emnlp-main)
Copied to clipboard
Yue Fang, Shaohan Huang, Xin Yu, Haizhen Huang, Zihan Zhang, Weiwei Deng, Furu Wei, Feng Sun, Qi Zhang, Zhi Jin
| Challenge: | Existing formal proof assistants rely on instruction tuning and lack fine-grained structural and semantic alignment. |
| Approach: | They propose a reinforcement learning framework that enables LLMs to translate natural language into formal language such as Lean 4 . they use a model with basic translation ability to refine the model's reinforcement learning . |
| Outcome: | The proposed method outperforms baseline models on NL-to-Lean 4 tasks. |
Enhancing Transformation from Natural Language to Signal Temporal Logic Using LLMs with Diverse External Knowledge (2025.findings-acl)
Copied to clipboard
| Challenge: | Temporal Logic (STL) is a formal specification tool for cyber-physical systems . but it is difficult to transform ambiguous and complex data into STL, a paper argues . |
| Approach: | They propose a NL-STL dataset with 16,000 samples enriched with diverse patterns . they propose KGST framework to transform natural language into STL using a generate-then-refine process . |
| Outcome: | The proposed dataset outperforms baseline models in diversity and accuracy . the proposed dataset contains 16,000 samples enriched with diverse patterns . |
SEAG: Structure-Aware Event Causality Generation (2023.findings-acl)
Copied to clipboard
Zhengwei Tao, Zhi Jin, Xiaoying Bai, Haiyan Zhao, Chengfeng Dou, Yongqiang Zhao, Fang Wang, Chongyang Tao
| Challenge: | Current methods for extracting event causality are limited by the lack of cross-task dependencies and may cause error propagation. |
| Approach: | They propose an approach for Structure-Aware Event Causality Generation (SEAG) they generate the ECG structure using a pre-trained language model and perform structural discriminative training alongside auto-regressive generation. |
| Outcome: | The proposed method is effective in extracting event causality from text. |