Enhancing Writing Proficiency Classification in Developmental Education: The Quest for Accuracy (2024.lrec-main)
Copied to clipboard
| Challenge: | Existing literature raises concerns about automated assessment tools like Accuplacer’s narrow representation of the writing process. |
| Approach: | They propose to use machine-learning to annotate college essays for machine/deep learning. |
| Outcome: | The proposed method improves the classification accuracy of 100 college-intending students’ essays against human raters. |
Similar Papers
Charting the Linguistic Landscape of Developing Writers: An Annotation Scheme for Enhancing Native Language Proficiency (2024.lrec-main)
Copied to clipboard
| Challenge: | An annotation task was designed to capture orthographic, grammatical, lexical, semantic, and discursive patterns exhibited by college native English speakers participating in developmental education (DevEd) courses. |
| Approach: | They propose an annotation task to capture orthographic, grammatical, lexical, semantic, and discursive patterns exhibited by college native English speakers participating in developmental education courses. |
| Outcome: | The proposed annotation task captures orthographic, grammatical, lexical, semantic, and discursive patterns exhibited by college native English speakers participating in developmental education courses. |
Level-Up: Learning to Improve Proficiency Level of Essays (P19-3)
Copied to clipboard
| Challenge: | Many essays are submitted to tutoring services by English learners on the Web every day . few systems provide focused suggestions on how to raise the level of proficiency. |
| Approach: | They propose a method for generating suggestions on a sentence for improving proficiency . they propose identifying grammatical elements and ranking related elements to provide suggestions . |
| Outcome: | The proposed method helps english learners improve their writing and reading skills. |
AutoAugment Is What You Need: Enhancing Rule-based Augmentation Methods in Low-resource Regimes (2024.eacl-srw)
Copied to clipboard
| Challenge: | Existing methods for text data augmentation suffer from potential semantic damage due to the discrete nature of sentences. |
| Approach: | They propose to adapt AutoAugment to solve this problem by using softEDA to increase text data. |
| Outcome: | The proposed method can boost existing augmentation methods and enhance cutting-edge pretrained language models. |
Cross Encoding as Augmentation: Towards Effective Educational Text Classification (2023.findings-acl)
Copied to clipboard
Hyun Seung Lee, Seungtaek Choi, Yunsung Lee, Hyeongdon Moon, Shinhyeok Oh, Myeongho Jeong, Hyojun Go, Christian Wallraven
| Challenge: | Existing methods to improve text classification in education suffer from data scarcity . authors propose a retrieval approach that provides effective learning in educational text classification. |
| Approach: | They propose a retrieval approach that provides effective learning in educational text classification by introducing cross-encoder style texts to a bi-encoding architecture. |
| Outcome: | The proposed method is effective in multi-label scenarios and low-resource tags compared to state-of-the-art models. |
Empowering Diffusion Models on the Embedding Space for Text Generation (2024.naacl-long)
Copied to clipboard
| Challenge: | Recent work adapts diffusion models to textual data by diffusing on the embedding space. |
| Approach: | They propose an embedding diffusion model based on Transformer to solve the problem of embeddable space and denoising model. |
| Outcome: | The proposed model is more efficient than previous methods on seminal text generation tasks and is superior to existing models. |
REPROLANG 2020: Automatic Proficiency Scoring of Czech, English, German, Italian, and Spanish Learner Essays (2020.lrec-1)
Copied to clipboard
| Challenge: | a new paper aims to reproduce the work described in Vajjala & Rama (2018) . the paper focuses on features-based and neural approaches to essay scoring in Czech, German and Italian . |
| Approach: | They propose to replicate the work described in Vajjala & Rama 2018, ‘Experiments with universal CEFR classification’, as part of REPROLANG 2020. |
| Outcome: | The proposed methods perform better than feature-based models for large text datasets, though neural network modifications do bring performance closer to the best feature-driven models. |
Can Large Language Models Automatically Score Proficiency of Written Essays? (2024.lrec-main)
Copied to clipboard
| Challenge: | Automated essay scoring (AES) is one of the earliest research problems in natural language processing. |
| Approach: | They propose to use large language models to analyze and score written essays using four different prompts. |
| Outcome: | The proposed models show comparable performance on four different prompts and a slight advantage over the state-of-the-art models. |
Exploring the Limitations of Detecting Machine-Generated Text (2025.coling-main)
Copied to clipboard
| Challenge: | Recent advances in the quality of the generation of text by large language models have spurred research into identifying machine-generated text. |
| Approach: | They audit classification performance for detecting machine-generated text by evaluating on texts with varying writing styles. |
| Outcome: | The proposed methods are highly sensitive to stylistic changes and complexity, and in some cases degrade entirely to random classifiers. |
DACL: Disfluency Augmented Curriculum Learning for Fluent Text Generation (2024.lrec-main)
Copied to clipboard
| Challenge: | Disfluency-aware language models are traditionally trained on fluent, written text corpora. |
| Approach: | They propose a Disfluency Augmented Curriculum Learning approach to tackle disfluency . they use CL coupled with synthetically augmented disfluent texts of various levels . |
| Outcome: | The proposed model surpasses existing techniques in word-based precision (by up to 1%) and has shown favorable recall and F1 scores. |
EduMARS: Can Vision-Language Models Grade Like Teachers? Benchmarking Multimodal, Rubric-Based Assessment on Chinese K-12 Answers (2026.findings-acl)
Copied to clipboard
| Challenge: | Existing benchmarks for automated grading of student work fail to evaluate real student responses . existing models fail to assess real student work, especially on cognitively demanding tasks . |
| Approach: | They propose a multimodal benchmark for rubric-aligned evaluation of real Chinese K-12 student answers. |
| Outcome: | The proposed model improves performance and interpretability of existing models on EduMARS . existing models fail to perform on real-world, cognitively demanding tasks, authors say . |