Challenge: coding tasks that provide detailed insights into student knowledge are challenging to train . open-ended tasks often suffer from mode collapse and fail to capture student errors .
Approach: They propose a method that aligns errors with student knowledge by using a hybrid reward system.
Outcome: The proposed method outperforms baselines on code and error prediction and error coverage and simulated code diversity on two real-world datasets.

Similar Papers

Embracing Imperfection: Simulating Students with Diverse Cognitive Levels Using LLM-based Agents (2025.acl-long)

Copied to clipboard

Challenge: Large language models (LLMs) are becoming increasingly popular in education, enabling researchers to simulate students' learning patterns and learning patterns.
Approach: They propose a training-free framework for student simulation that takes into account student cognitive diversity and realism.
Outcome: The proposed model outperforms baseline models and achieves 100% improvement in simulation accuracy and realism.
Teaching Your Models to Understand Code via Focal Preference Alignment (2025.emnlp-main)

Copied to clipboard

Challenge: Existing methods for supervised fine-tuning focus on unit test feedback to construct preference pairs.
Approach: They propose a preference alignment framework that mimics human iterative debugging to refine Code LLMs.
Outcome: Experiments show that Preference Learning improves on BigCodeBench and BigCodeBind tasks.
From Problem-Solving to Teaching Problem-Solving: Aligning LLMs with Pedagogy using Reinforcement Learning (2025.emnlp-main)

Copied to clipboard

Challenge: Large language models (LLMs) are often optimized for direct question-answering, but their effectiveness is often undermined by strategically withholding answers.
Approach: They propose an online reinforcement learning-based alignment framework that can quickly adapt LLMs into effective tutors using simulated student-tutor interactions.
Outcome: The proposed model outperforms proprietary models like LearnLM and can be used to enhance interpretability and pedagogical quality.
Automated Knowledge Component Generation and Interpretable Knowledge Tracing in Coding Problems (2026.findings-acl)

Copied to clipboard

Challenge: Existing solutions to automate KC generation and tagging for open-ended programming problems are highly labor-intensive and prone to bias and errors.
Approach: They propose an automated pipeline for KC generation and tagging for open-ended programming problems using large language models.
Outcome: The proposed method outperforms existing ones and outperfies human-written KCs on future student response prediction.
McMining: Automated Discovery of Misconceptions in Student Code (2026.eacl-short)

Copied to clipboard

Challenge: misconceptions can lead to bugs and slow down learning of related concepts . a misconception is a belief in a false statement, such as believing that the earth is flat or that real numbers are countable.
Approach: They propose a task of mining programming misconceptions from student code samples . they introduce McMining, which uses a benchmark dataset to identify misconceptions .
Outcome: The proposed models are effective at finding misconceptions in student code.
MathEDU: Feedback Generation on Problem-Solving Processes for Mathematical Learning Support (2026.eacl-long)

Copied to clipboard

Challenge: Existing studies have examined the reliability of Large Language Models (LLMs) in grading authentic student problem solving processes and delivering effective feedback.
Approach: They propose to use a dataset to evaluate the reliability of large language models in mathematics and a teacher-written feedback system to improve student problem-solving processes.
Outcome: The proposed model improves in correctness classification, error identification, and feedback generation, but generates a gap from teacher-written feedback.
A Comprehensive Survey of Process Reward Models: Data Generation, Model Construction, and Usage (2026.acl-long)

Copied to clipboard

Challenge: Large Language Models (LLMs) have advanced reasoning ability, yet conventional alignment remains dominated by outcome reward models that judge only final answers.
Approach: They summarize applications across math, code, text, multimodal reasoning, robotics, and agents . goal is to clarify design spaces, reveal open challenges, and guide future research toward fine-grained, robust reasoning alignment.
Outcome: The proposed model enables finer credit assignment, richer diagnostics, and improved robustness.
Learning Personalized Alignment for Evaluating Open-ended Text Generation (2024.emnlp-main)

Copied to clipboard

Challenge: Traditional evaluation metrics rely heavily on lexical similarity with human-written references, showing poor correlation with human judgments and failing to account for alignment with the diversity of human preferences.
Approach: They propose an interpretable evaluation framework that evaluates alignment with specific human preferences by providing detailed comments and fine-grained scoring.
Outcome: The proposed framework outperforms GPT-4 in Kendall correlation and accuracy with zero-shot reviewers.
Inverse Reinforcement Learning Meets Large Language Model Alignment (2025.acl-tutorials)

Copied to clipboard

Challenge: This tutorial will provide a comprehensive review of recent advances in LLM alignment . it will highlight the necessity of constructing neural reward models from human data .
Approach: This tutorial will provide a comprehensive review of recent advances in LLM alignment through the lens of inverse reinforcement learning.
Outcome: This tutorial will provide a comprehensive review of recent advances in LLM alignment through the lens of inverse reinforcement learning (IRL).
End-to-End Bias Mitigation by Modelling Biases in Corpora (2020.acl-main)

Copied to clipboard

Challenge: Recent studies have shown that strong natural language understanding models are prone to relying on unwanted dataset biases without learning the underlying task.
Approach: They propose two learning strategies to train neural models that are more robust to dataset biases and transfer better to out-of-domain datasets.
Outcome: The proposed methods improve robustness in all settings and transfer better to out-of-domain datasets.

What is GenGO?

GenGO is an NLP powered publication search system. It currenctly indexes 30k+ papers from ACL Anthology, and implements multi-aspect summarization, semantic search, and more!

Information

About
Limitations