| Challenge: | Current research on AES focuses on scoring the overall quality or single trait of prompt-specific essays. |
| Approach: | They propose a hierarchical multi-task trait scorer to evaluate quality of writing . they propose an inter-sequence attention mechanism to enhance information interaction . |
| Outcome: | The proposed model outperforms several strong models on ACEA and outperformed other models. |
Similar Papers
Many Hands Make Light Work: Using Essay Traits to Automatically Score Essays (2022.naacl-main)
Copied to clipboard
| Challenge: | In automatic essay grading, essay traits are important for scoring the essay holistically . a single-task learning system gives the best results for scoring essays holistically and scoring essay traits. |
| Approach: | They propose a way to score essays using a multi-task learning approach . they compare the MTL-based BiLSTM system to a single-task Learning approach based on LSTMs and BiLStms . |
| Outcome: | The proposed system gives better results for scoring essay holistically and scoring essay traits. |
Graph-Based Multi-Trait Essay Scoring (2025.emnlp-main)
Copied to clipboard
| Challenge: | Existing work on Automated Essay Scoring (AES) models essay as word sequence, but new approach uses graph-attention network approach to model essay traits. |
| Approach: | They propose a graph-attention network approach to automate essay scoring that models interactions among essay traits as a graphical graph. |
| Outcome: | The proposed approach outperforms competing approaches on the ASAP++ dataset . it allows for multiple-task scoring, allowing for more detailed feedback on essays . |
Autoregressive Score Generation for Multi-trait Essay Scoring (2024.findings-eacl)
Copied to clipboard
| Challenge: | Existing holistic approaches to score essays using pre-trained BERT-based models are inefficient, leading to inferior qualities in data-scarce traits. |
| Approach: | They propose an autoregressive prediction of multi-trait scores using pre-trained T5 models. |
| Outcome: | The proposed model shows over 5% improvement in prompts and traits compared to previous models . |
Prompt- and Trait Relation-aware Cross-prompt Essay Trait Scoring (2023.findings-acl)
Copied to clipboard
| Challenge: | Existing systems assume to grade essays on same prompt as used in training and assign only a holistic score. |
| Approach: | They propose a prompt- and trait relation-aware cross-prompt essay trait scorer that encodes prompt-awful essay representation by essay-promotion attention and utilizing the topic-coherence feature extracted by the topic model. |
| Outcome: | The proposed model shows state-of-the-art results for all prompts and traits. |
Autoregressive Multi-trait Essay Scoring via Reinforcement Learning with Scoring-aware Multiple Rewards (2024.emnlp-main)
Copied to clipboard
| Challenge: | Existing reinforcement learning (RL) applications in AES are limited to classification models despite associated performance degradation. |
| Approach: | They propose to integrate actual evaluation schemes into the training process by designing QWK-based rewards with a mean-squared error penalty for multi-trait AES. |
| Outcome: | The proposed scoring-aware multi-reward reinforcement learning integrates actual evaluation schemes into the training process. |
Rationale Behind Essay Scores: Enhancing S-LLM’s Multi-Trait Essay Scoring with Rationale Generated by LLMs (2025.findings-naacl)
Copied to clipboard
| Challenge: | Existing automated essay scoring relies on essay text without explanatory rationales for the scores. |
| Approach: | They propose a rationale-based multiple trait scoring approach that integrates large language models with a smaller large language model to generate trait-specific rationales. |
| Outcome: | The proposed approach outperforms state-of-the-art models and vanilla S-LLMs on benchmark datasets. |
T-MES: Trait-Aware Mix-of-Experts Representation Learning for Multi-trait Essay Scoring (2025.coling-main)
Copied to clipboard
| Challenge: | Existing methods for automatic essay scoring fail to learn trait representations and ignore correlations between trait scores. |
| Approach: | They propose a multi-trait essay scoring method based on Trait-Aware Mix-of-Experts Representation Learning. |
| Outcome: | The proposed method improves on existing methods and improves in computational efficiency. |
Mixture of Ordered Scoring Experts for Cross-prompt Essay Trait Scoring (2025.acl-long)
Copied to clipboard
| Challenge: | Existing approaches to automate essay scoring overlook critical information, authors say . evaluators often limit their performance to unseen topics, resulting in incomplete assessment perspectives. |
| Approach: | They propose a framework that integrates information from prompts and essays into an AES framework. |
| Outcome: | The proposed framework achieves state-of-the-art in cross-prompt scoring and multi-trait scoring on the ASAP++ dataset. |
Multi-task Learning for Automated Essay Scoring with Sentiment Analysis (2020.aacl-srw)
Copied to clipboard
| Challenge: | Automated Essay Scoring (AES) is a process that aims to alleviate the workload of graders and improve the feedback cycle in educational systems. |
| Approach: | They propose to combine two tasks, sentiment analysis and AES by utilizing multi-task learning to combine sentiment features extracted from opinion expressions. |
| Outcome: | The proposed model produces a QWK of 0.763 on the Automated StudentAssessment Prize (ASAP) benchmark. |
Analytic Automated Essay Scoring Based on Deep Neural Networks Integrating Multidimensional Item Response Theory (2022.coling-1)
Copied to clipboard
| Challenge: | Essay exams have two drawbacks in that grading them is expensive and raises questions about fairness. |
| Approach: | They propose to use a multidimensional item response theory model to improve interpretability while maintaining scoring accuracy. |
| Outcome: | The proposed model improves interpretability while maintaining accuracy while preserving cost and accuracy. |