MathEDU: Feedback Generation on Problem-Solving Processes for Mathematical Learning Support (2026.eacl-long)
Copied to clipboard
| Challenge: | Existing studies have examined the reliability of Large Language Models (LLMs) in grading authentic student problem solving processes and delivering effective feedback. |
| Approach: | They propose to use a dataset to evaluate the reliability of large language models in mathematics and a teacher-written feedback system to improve student problem-solving processes. |
| Outcome: | The proposed model improves in correctness classification, error identification, and feedback generation, but generates a gap from teacher-written feedback. |
Similar Papers
Three Questions Concerning the Use of Large Language Models to Facilitate Mathematics Learning (2023.findings-emnlp)
Copied to clipboard
| Challenge: | After the pandemic, e-learning has become part of mainstream education. |
| Approach: | They propose to integrate large language models (LLMs) into educational settings to enhance students' mathematical problem-solving skills by providing adaptive feedback. |
| Outcome: | The proposed model can generate free-text rationalizations and misinterpret meanings and can also misinterprét students' answers. |
Closing the Loop: Learning to Generate Writing Feedback via Language Model Simulated Student Revisions (2024.emnlp-main)
Copied to clipboard
| Challenge: | Recent advances in language models (LMs) have made it possible to automatically generate feedback that is actionable and well-aligned with human-specified attributes. |
| Approach: | They propose a tool that PROduces Feedback via learning from LM simulated student revisions and propose to iteratively optimize the feedback generator by directly maximizing the effectiveness of students’ overall revising performance. |
| Outcome: | The proposed approach surpasses baseline methods in effectiveness of improving students’ writing and demonstrates enhanced pedagogical values, even though it was not explicitly trained for this aspect. |
Can LLMs simulate the same correct solutions to free-response math problems as real students? (2025.emnlp-main)
Copied to clipboard
| Challenge: | Existing studies have explored modeling student mistakes, but lack of understanding of how they generate correct solutions. |
| Approach: | They compare distribution of correct solutions produced by four large language models with students' responses to free-response problems. |
| Outcome: | The proposed model can generate correct solutions that represent student responses to free-response problems. |
Stepwise Verification and Remediation of Student Reasoning Errors with Large Language Model Tutors (2024.emnlp-main)
Copied to clipboard
| Challenge: | Existing models for dialog tutoring fail to detect student errors and tailor their feedback to them. |
| Approach: | They propose to build dialog tutoring models to scaffold students' problem-solving and verify student solutions by using automatic and human evaluation. |
| Outcome: | The proposed model improves the quality of the tutor response generation by detecting student errors and adjusting the feedback to the errors. |
More Insightful Feedback for Tutoring: Enhancing Generation Mechanisms and Automatic Evaluation (2024.emnlp-main)
Copied to clipboard
| Challenge: | Incorrect student answers can be valuable learning opportunities provided that the student understands where they went wrong and why. |
| Approach: | They propose to use a KL regularization term to achieve more targeted input representations and a preference optimization step to encourage student answer-adaptive feedback generation. |
| Outcome: | The proposed model outperforms existing models in 3.3 METEOR points. |
GSM-Plus: A Comprehensive Benchmark for Evaluating the Robustness of LLMs as Mathematical Problem Solvers (2024.acl-long)
Copied to clipboard
| Challenge: | Large language models (LLMs) have demonstrated impressive performance across various mathematical reasoning benchmarks. |
| Approach: | They introduce an adversarial grade school math dataset and explore whether LLMs can be more robust when questions are slightly changed. |
| Outcome: | The proposed method generates and verifies each intermediate thought based on its reasoning goal and calculation result. |
MATHWELL: Generating Educational Math Word Problems Using Teacher Annotations (2024.findings-emnlp)
Copied to clipboard
| Challenge: | Existing models and data fail to be educationally appropriate, causing teachers to write boilerplate questions and use boilerplate question sets. |
| Approach: | They propose that large language models (LLMs) can generate educational word problems by generating word problems using annotations from experts. |
| Outcome: | The proposed model generates more solvable, accurate, and appropriate word problems than public models while avoiding harmful questions. |
Navigating Noisy Feedback: Enhancing Reinforcement Learning with Error-Prone Language Models (2024.findings-emnlp)
Copied to clipboard
Muhan Lin, Shuyang Shi, Yue Guo, Behdad Chalaki, Vaishnav Tadiparthi, Ehsan Moradi Pari, Simon Stepputtis, Joseph Campbell, Katia Sycara
| Challenge: | Reward hacking is a problem in reinforcement learning where the ability to specify the desired behavior of a reward function is difficult. |
| Approach: | They propose to use feedback as a potential-based shaping function to solicit and apply feedback from large language models to improve convergence speed and policy returns. |
| Outcome: | The proposed method improves convergence speed and policy returns over baselines even with significant ranking errors and eliminates the need for complex post-processing of reward functions. |
LLM Critics Help Catch Bugs in Mathematics: Towards a Better Mathematical Verifier with Natural Language Feedback (2025.findings-acl)
Copied to clipboard
Bofei Gao, Zefan Cai, Runxin Xu, Peiyi Wang, Ce Zheng, Runji Lin, Keming Lu, Dayiheng Liu, Chang Zhou, Wen Xiao, Tianyu Liu, Baobao Chang
| Challenge: | Existing mathematical verifiers are trained with binary classification labels, which are not informative enough for the model to accurately assess the solutions. |
| Approach: | They propose a natural language feedback-enhanced verifier that can validate the correctness of response generated by policy models by constructing automatically generated training data and a two-stage training paradigm. |
| Outcome: | The proposed verifier significantly improves in verification and reinforcement learning and alleviates data-demanding problems of the reward model. |
FEAT: A Preference Feedback Dataset through a Cost-Effective Auto-Generation and Labeling Framework for English AI Tutoring (2025.acl-short)
Copied to clipboard
| Challenge: | Existing algorithms for teacher feedback generation are time-consuming and costly to generate manually. |
| Approach: | They propose a framework for generating teacher feedback using LLMs and humans . they construct three datasets that are time-consuming and costly to generate manually . results show that incorporating a small portion of DM leads to superior performance . |
| Outcome: | The proposed framework performs better on three datasets compared to human-generated feedback and LLM-generated datasets. |