Exploring hybrid approaches to readability: experiments on the complementarity between linguistic features and transformers (2024.findings-eacl)
Copied to clipboard
| Challenge: | Linguistic features have been a key component of the automatic assessment of text readability (ARA) with the development in the ARA field, the research moved to Deep Learning (DL) |
| Approach: | They compare 6 hybrid approaches to Machine Learning and DL on 4 corpora and found they are the most robust on smaller datasets and across languages. |
| Outcome: | The proposed approaches perform better on smaller datasets and across languages and tasks. |
Similar Papers
Pushing on Text Readability Assessment: A Transformer Meets Handcrafted Linguistic Features (2021.emnlp-main)
Copied to clipboard
| Challenge: | ML models with handcrafted features are linguistically explainable, expandable, and competent against the modern neural models. |
| Approach: | They propose to combine traditional ML models with ML transformers to improve readability assessment by 99% accuracy. |
| Outcome: | The proposed model achieves state-of-the-art (SOTA) accuracy on popular datasets. |
Learning Syntactic Dense Embedding with Correlation Graph for Automatic Readability Assessment (2021.acl-long)
Copied to clipboard
| Challenge: | Existing deep learning models for automatic readability assessment discard linguistic features traditionally used for the task. |
| Approach: | They propose to incorporate linguistic features into machine learning models by learning syntactic dense embeddings based on linguistic feature extraction. |
| Outcome: | Experiments with six data sets of two proficiency levels show that the proposed model can perform better than existing models. |
Automatic Readability Assessment for Closely Related Languages (2023.findings-acl)
Copied to clipboard
| Challenge: | In recent years, the main focus of research on automatic readability assessment (ARA) has shifted towards using expensive deep learning-based methods with the primary goal of increasing models’ accuracy. |
| Approach: | They focus on how linguistic aspects such as mutual intelligibility or degree of language relatedness can improve ARA in a low-resource setting. |
| Outcome: | The inclusion of CrossNGO, a novel feature exploiting n-gram overlap, significantly improves the performance of ARA models compared to the use of off-the-shelf large multilingual language models alone. |
Deep Natural Language Feature Learning for Interpretable Prediction (2023.emnlp-main)
Copied to clipboard
| Challenge: | Using a small transformer language model, we can break down a complex task into a set of intermediary easier sub-tasks. |
| Approach: | They propose a method to break down a main task into a set of intermediary easier sub-tasks, which are formulated in natural language as binary questions related to the final target task. |
| Outcome: | The proposed method breaks down a complex task into a set of easier sub-tasks, which are formulated in natural language as binary questions related to the final target task. |
PromptARA: Improving Deep Representation in Hybrid Automatic Readability Assessment with Prompt and Orthogonal Projection (2023.findings-emnlp)
Copied to clipboard
| Challenge: | Readability assessment aims to automatically classify texts based on readers’ reading levels. |
| Approach: | They propose a hybrid automatic readability assessment model using prompts to improve deep feature representations and an orthogonal projection layer to fuse both deep and linguistic features. |
| Outcome: | The proposed model outperforms state-of-the-art models over four English and two Chinese corpora and demonstrates that it is more efficient than existing models. |
Chinese Automatic Readability Assessment Using Adaptive Pre-training and Linguistic Feature Fusion (2025.coling-main)
Copied to clipboard
| Challenge: | Existing methods for classification of reading difficulty of texts are insufficiently trained and lack of linguistic features. |
| Approach: | They propose a method that combines adaptive pre-training with feature fusion to capture different text difficulties and an interactive attention mechanism to integrate linguistic and deep features. |
| Outcome: | The proposed method achieves state-of-the-art (SOTA) performance on Chinese textbook dataset and can be applied to other languages. |
Promoting Pre-trained LM with Linguistic Features on Automatic Readability Assessment (2022.aacl-short)
Copied to clipboard
| Challenge: | Automatic readability assessment (ARA) aims at classifying the readability level of a text automatically. |
| Approach: | They propose to integrate linguistic features with pre-trained language models to improve the accuracy of ARA. |
| Outcome: | The proposed algorithm improves on the long passage characteristic of ARA using commonly used linguistic features and abundant datasets. |
Understanding Cross-Lingual Alignment—A Survey (2024.findings-acl)
Copied to clipboard
| Challenge: | Cross-lingual alignment is the meaningful similarity of representations across languages in multilingual language models. |
| Approach: | They propose a taxonomy of methods to improve cross-lingual alignment . they argue that an effective trade-off between language-neutral and language-specific information is key . |
| Outcome: | The proposed methods can be applied to encoder models and encoder-decoder-only models . they show that language-neutral and language-specific information is key . |
Can Transformers Learn n-gram Language Models? (2024.emnlp-main)
Copied to clipboard
| Challenge: | Existing work has tested transformers' ability to represent formal languages, but language models are not classifiers of strings but rather distributions over them. |
| Approach: | They relate transformers' ability to learn random n-gram language models to ngram language model (LM) they find add- smoothing outperforms transformers on the former, while transformers perform better on the latter . |
| Outcome: | The proposed models outperform classical methods designed to learn n-gram LMs, while transformers perform better on the latter. |
Incorporating Word-level Phonemic Decoding into Readability Assessment (2024.lrec-main)
Copied to clipboard
| Challenge: | a recent study suggests that automatic readability assessment is not able to provide interpretability for teachers and educators. |
| Approach: | They propose to incorporate phonetic and orthographic features into automatic readability assessment by handcrafted feature sets. |
| Outcome: | a new feature set shows comparable performance to larger feature sets on grade-level classification in english . authors say the model improves on multiple readability datasets but lacks interpretability . |