KASER: Knowledge-Aligned Student Error Simulator for Open-Ended Coding Tasks (2026.acl-long)
Copied to clipboard
| Challenge: | coding tasks that provide detailed insights into student knowledge are challenging to train . open-ended tasks often suffer from mode collapse and fail to capture student errors . |
| Approach: | They propose a method that aligns errors with student knowledge by using a hybrid reward system. |
| Outcome: | The proposed method outperforms baselines on code and error prediction and error coverage and simulated code diversity on two real-world datasets. |
Similar Papers
Embracing Imperfection: Simulating Students with Diverse Cognitive Levels Using LLM-based Agents (2025.acl-long)
Copied to clipboard
| Challenge: | Large language models (LLMs) are becoming increasingly popular in education, enabling researchers to simulate students' learning patterns and learning patterns. |
| Approach: | They propose a training-free framework for student simulation that takes into account student cognitive diversity and realism. |
| Outcome: | The proposed model outperforms baseline models and achieves 100% improvement in simulation accuracy and realism. |
Teaching Your Models to Understand Code via Focal Preference Alignment (2025.emnlp-main)
Copied to clipboard
Jie Wu, Haoling Li, Xin Zhang, Xiao Liu, Yangyu Huang, Jianwen Luo, Yizhen Zhang, Zuchao Li, Ruihang Chu, Yujiu Yang, Scarlett Li
| Challenge: | Existing methods for supervised fine-tuning focus on unit test feedback to construct preference pairs. |
| Approach: | They propose a preference alignment framework that mimics human iterative debugging to refine Code LLMs. |
| Outcome: | Experiments show that Preference Learning improves on BigCodeBench and BigCodeBind tasks. |
From Problem-Solving to Teaching Problem-Solving: Aligning LLMs with Pedagogy using Reinforcement Learning (2025.emnlp-main)
Copied to clipboard
| Challenge: | Large language models (LLMs) are often optimized for direct question-answering, but their effectiveness is often undermined by strategically withholding answers. |
| Approach: | They propose an online reinforcement learning-based alignment framework that can quickly adapt LLMs into effective tutors using simulated student-tutor interactions. |
| Outcome: | The proposed model outperforms proprietary models like LearnLM and can be used to enhance interpretability and pedagogical quality. |
Automated Knowledge Component Generation and Interpretable Knowledge Tracing in Coding Problems (2026.findings-acl)
Copied to clipboard
Zhangqi Duan, Nigel Fernandez, Arun Balajiee Lekshmi Narayanan, Mohammad Hassany, Rafaella Sampaio de Alencar, Peter Brusilovsky, Bita Akram, Andrew Lan
| Challenge: | Existing solutions to automate KC generation and tagging for open-ended programming problems are highly labor-intensive and prone to bias and errors. |
| Approach: | They propose an automated pipeline for KC generation and tagging for open-ended programming problems using large language models. |
| Outcome: | The proposed method outperforms existing ones and outperfies human-written KCs on future student response prediction. |
McMining: Automated Discovery of Misconceptions in Student Code (2026.eacl-short)
Copied to clipboard
| Challenge: | misconceptions can lead to bugs and slow down learning of related concepts . a misconception is a belief in a false statement, such as believing that the earth is flat or that real numbers are countable. |
| Approach: | They propose a task of mining programming misconceptions from student code samples . they introduce McMining, which uses a benchmark dataset to identify misconceptions . |
| Outcome: | The proposed models are effective at finding misconceptions in student code. |
MathEDU: Feedback Generation on Problem-Solving Processes for Mathematical Learning Support (2026.eacl-long)
Copied to clipboard
| Challenge: | Existing studies have examined the reliability of Large Language Models (LLMs) in grading authentic student problem solving processes and delivering effective feedback. |
| Approach: | They propose to use a dataset to evaluate the reliability of large language models in mathematics and a teacher-written feedback system to improve student problem-solving processes. |
| Outcome: | The proposed model improves in correctness classification, error identification, and feedback generation, but generates a gap from teacher-written feedback. |
A Comprehensive Survey of Process Reward Models: Data Generation, Model Construction, and Usage (2026.acl-long)
Copied to clipboard
Congmin Zheng, Jiachen Zhu, Zhuoying Ou, Yuxiang Chen, Kangning Zhang, Rong Shan, Zeyu Zheng, Mengyue Yang, Jianghao Lin, Yong Yu, Weinan Zhang
| Challenge: | Large Language Models (LLMs) have advanced reasoning ability, yet conventional alignment remains dominated by outcome reward models that judge only final answers. |
| Approach: | They summarize applications across math, code, text, multimodal reasoning, robotics, and agents . goal is to clarify design spaces, reveal open challenges, and guide future research toward fine-grained, robust reasoning alignment. |
| Outcome: | The proposed model enables finer credit assignment, richer diagnostics, and improved robustness. |
Learning Personalized Alignment for Evaluating Open-ended Text Generation (2024.emnlp-main)
Copied to clipboard
| Challenge: | Traditional evaluation metrics rely heavily on lexical similarity with human-written references, showing poor correlation with human judgments and failing to account for alignment with the diversity of human preferences. |
| Approach: | They propose an interpretable evaluation framework that evaluates alignment with specific human preferences by providing detailed comments and fine-grained scoring. |
| Outcome: | The proposed framework outperforms GPT-4 in Kendall correlation and accuracy with zero-shot reviewers. |
Inverse Reinforcement Learning Meets Large Language Model Alignment (2025.acl-tutorials)
Copied to clipboard
| Challenge: | This tutorial will provide a comprehensive review of recent advances in LLM alignment . it will highlight the necessity of constructing neural reward models from human data . |
| Approach: | This tutorial will provide a comprehensive review of recent advances in LLM alignment through the lens of inverse reinforcement learning. |
| Outcome: | This tutorial will provide a comprehensive review of recent advances in LLM alignment through the lens of inverse reinforcement learning (IRL). |
End-to-End Bias Mitigation by Modelling Biases in Corpora (2020.acl-main)
Copied to clipboard
| Challenge: | Recent studies have shown that strong natural language understanding models are prone to relying on unwanted dataset biases without learning the underlying task. |
| Approach: | They propose two learning strategies to train neural models that are more robust to dataset biases and transfer better to out-of-domain datasets. |
| Outcome: | The proposed methods improve robustness in all settings and transfer better to out-of-domain datasets. |