Enhancing Automatic Readability Assessment with Pre-training and Soft Labels for Ordinal Regression (2022.findings-emnlp)
Copied to clipboard
| Challenge: | Existing models do not exploit ordinal nature of difficulty grades and make little effort for initialization to facilitate fine-tuning. |
| Approach: | They propose a readability assessment task that assigns a difficulty grade to a text . they use ordinal regression and pairwise relative text difficulty to train the model . |
| Outcome: | The proposed model outperforms competitive neural models and statistical classifiers on most datasets. |
Similar Papers
Prompt-based Learning for Text Readability Assessment (2023.findings-eacl)
Copied to clipboard
| Challenge: | Using a pre-trained seq2seq model, we can discern which text is more difficult from two given texts (pairwise). |
| Approach: | They propose to adapt a pre-trained seq2seq model to discern which text is more difficult from two given texts (pairwise). |
| Outcome: | The proposed model can be adapted to discern which text is more difficult from two given texts (pairwise). |
Chinese Automatic Readability Assessment Using Adaptive Pre-training and Linguistic Feature Fusion (2025.coling-main)
Copied to clipboard
| Challenge: | Existing methods for classification of reading difficulty of texts are insufficiently trained and lack of linguistic features. |
| Approach: | They propose a method that combines adaptive pre-training with feature fusion to capture different text difficulties and an interactive attention mechanism to integrate linguistic and deep features. |
| Outcome: | The proposed method achieves state-of-the-art (SOTA) performance on Chinese textbook dataset and can be applied to other languages. |
A Neural Pairwise Ranking Model for Readability Assessment (2022.findings-acl)
Copied to clipboard
| Challenge: | Automatic Readability Assessment (ARA) is traditionally treated as a classification problem in NLP research. |
| Approach: | They propose a neural ranking approach to automatic readability assessment (ARA) they propose 'neural' ranking methods that can be used to rank texts by reading level . |
| Outcome: | The proposed approach performs well in monolingual single/cross corpus testing scenarios and achieves a zero-shot cross-lingual ranking accuracy of over 80% for both French and Spanish when trained on English data. |
Trends, Limitations and Open Challenges in Automatic Readability Assessment Research (2022.lrec-1)
Copied to clipboard
| Challenge: | Readability assessment is the task of evaluating the reading difficulty of a given piece of text. |
| Approach: | They examine the common approaches used for automatic readability assessment and identify their shortcomings and some challenges for the future. |
| Outcome: | The proposed models are compared with existing models and are based on existing ones. |
The Unreasonable Effectiveness of Easy Training Data for Hard Tasks (2024.acl-long)
Copied to clipboard
| Challenge: | Existing pretrained language models perform well on hard data, but hard data is noisier and costlier to collect. |
| Approach: | They propose to use in-context learning, linear classifier heads, and QLoRA to show that pretrained language models generalize relatively well from easy to hard data. |
| Outcome: | The proposed model generalizes well from easy to hard data even better than oracle models finetuned on hard data. |
A Unified Neural Network Model for Readability Assessment with Feature Projection and Length-Balanced Loss (2022.emnlp-main)
Copied to clipboard
| Challenge: | Traditional readability assessment models employ hundreds of linguistic features, but it is less explored for readability assessments. |
| Approach: | They propose a BERT-based model with feature projection and length-balanced loss to determine the difficulty level of a given text. |
| Outcome: | The proposed model achieves significant improvements over baseline models on three English benchmark datasets and one Chinese dataset. |
Incorporating Word-level Phonemic Decoding into Readability Assessment (2024.lrec-main)
Copied to clipboard
| Challenge: | a recent study suggests that automatic readability assessment is not able to provide interpretability for teachers and educators. |
| Approach: | They propose to incorporate phonetic and orthographic features into automatic readability assessment by handcrafted feature sets. |
| Outcome: | a new feature set shows comparable performance to larger feature sets on grade-level classification in english . authors say the model improves on multiple readability datasets but lacks interpretability . |
Learning Syntactic Dense Embedding with Correlation Graph for Automatic Readability Assessment (2021.acl-long)
Copied to clipboard
| Challenge: | Existing deep learning models for automatic readability assessment discard linguistic features traditionally used for the task. |
| Approach: | They propose to incorporate linguistic features into machine learning models by learning syntactic dense embeddings based on linguistic feature extraction. |
| Outcome: | Experiments with six data sets of two proficiency levels show that the proposed model can perform better than existing models. |
Robust Machine Reading Comprehension by Learning Soft labels (2020.coling-main)
Copied to clipboard
| Challenge: | Neural models have achieved great success on the task of machine reading comprehension, which are typically trained on hard labels. |
| Approach: | They propose a robust training method for machine reading comprehension models to address label sparseness problem by using three strategies to train models on soft labels. |
| Outcome: | The proposed method improves the baseline model performance and achieves state-of-the-art performance on NewsQA and QUOREF. |
Pushing on Text Readability Assessment: A Transformer Meets Handcrafted Linguistic Features (2021.emnlp-main)
Copied to clipboard
| Challenge: | ML models with handcrafted features are linguistically explainable, expandable, and competent against the modern neural models. |
| Approach: | They propose to combine traditional ML models with ML transformers to improve readability assessment by 99% accuracy. |
| Outcome: | The proposed model achieves state-of-the-art (SOTA) accuracy on popular datasets. |