Challenge: Existing methods for classification of reading difficulty of texts are insufficiently trained and lack of linguistic features.
Approach: They propose a method that combines adaptive pre-training with feature fusion to capture different text difficulties and an interactive attention mechanism to integrate linguistic and deep features.
Outcome: The proposed method achieves state-of-the-art (SOTA) performance on Chinese textbook dataset and can be applied to other languages.

Similar Papers

Promoting Pre-trained LM with Linguistic Features on Automatic Readability Assessment (2022.aacl-short)

Copied to clipboard

Challenge: Automatic readability assessment (ARA) aims at classifying the readability level of a text automatically.
Approach: They propose to integrate linguistic features with pre-trained language models to improve the accuracy of ARA.
Outcome: The proposed algorithm improves on the long passage characteristic of ARA using commonly used linguistic features and abundant datasets.
Enhancing Automatic Readability Assessment with Pre-training and Soft Labels for Ordinal Regression (2022.findings-emnlp)

Copied to clipboard

Challenge: Existing models do not exploit ordinal nature of difficulty grades and make little effort for initialization to facilitate fine-tuning.
Approach: They propose a readability assessment task that assigns a difficulty grade to a text . they use ordinal regression and pairwise relative text difficulty to train the model .
Outcome: The proposed model outperforms competitive neural models and statistical classifiers on most datasets.
PromptARA: Improving Deep Representation in Hybrid Automatic Readability Assessment with Prompt and Orthogonal Projection (2023.findings-emnlp)

Copied to clipboard

Challenge: Readability assessment aims to automatically classify texts based on readers’ reading levels.
Approach: They propose a hybrid automatic readability assessment model using prompts to improve deep feature representations and an orthogonal projection layer to fuse both deep and linguistic features.
Outcome: The proposed model outperforms state-of-the-art models over four English and two Chinese corpora and demonstrates that it is more efficient than existing models.
Exploring hybrid approaches to readability: experiments on the complementarity between linguistic features and transformers (2024.findings-eacl)

Copied to clipboard

Challenge: Linguistic features have been a key component of the automatic assessment of text readability (ARA) with the development in the ARA field, the research moved to Deep Learning (DL)
Approach: They compare 6 hybrid approaches to Machine Learning and DL on 4 corpora and found they are the most robust on smaller datasets and across languages.
Outcome: The proposed approaches perform better on smaller datasets and across languages and tasks.
Automatic Readability Assessment for Closely Related Languages (2023.findings-acl)

Copied to clipboard

Challenge: In recent years, the main focus of research on automatic readability assessment (ARA) has shifted towards using expensive deep learning-based methods with the primary goal of increasing models’ accuracy.
Approach: They focus on how linguistic aspects such as mutual intelligibility or degree of language relatedness can improve ARA in a low-resource setting.
Outcome: The inclusion of CrossNGO, a novel feature exploiting n-gram overlap, significantly improves the performance of ARA models compared to the use of off-the-shelf large multilingual language models alone.
Pushing on Text Readability Assessment: A Transformer Meets Handcrafted Linguistic Features (2021.emnlp-main)

Copied to clipboard

Challenge: ML models with handcrafted features are linguistically explainable, expandable, and competent against the modern neural models.
Approach: They propose to combine traditional ML models with ML transformers to improve readability assessment by 99% accuracy.
Outcome: The proposed model achieves state-of-the-art (SOTA) accuracy on popular datasets.
A Neural Pairwise Ranking Model for Readability Assessment (2022.findings-acl)

Copied to clipboard

Challenge: Automatic Readability Assessment (ARA) is traditionally treated as a classification problem in NLP research.
Approach: They propose a neural ranking approach to automatic readability assessment (ARA) they propose 'neural' ranking methods that can be used to rank texts by reading level .
Outcome: The proposed approach performs well in monolingual single/cross corpus testing scenarios and achieves a zero-shot cross-lingual ranking accuracy of over 80% for both French and Spanish when trained on English data.
Learning Syntactic Dense Embedding with Correlation Graph for Automatic Readability Assessment (2021.acl-long)

Copied to clipboard

Challenge: Existing deep learning models for automatic readability assessment discard linguistic features traditionally used for the task.
Approach: They propose to incorporate linguistic features into machine learning models by learning syntactic dense embeddings based on linguistic feature extraction.
Outcome: Experiments with six data sets of two proficiency levels show that the proposed model can perform better than existing models.
Improving Semantic Matching through Dependency-Enhanced Pre-trained Model with Adaptive Fusion (2022.findings-emnlp)

Copied to clipboard

Challenge: Existing work on dependency prior structure integration into pre-trained models is still unclear.
Approach: They propose a dependency-based fusion attention paradigm which explicitly introduces dependency prior structure into pre-trained models and adaptively fuses it with semantic information.
Outcome: The proposed model achieves state-of-the-art or competitive performance on 10 public datasets, demonstrating the benefits of adaptively fusing dependency structure in semantic matching task.
Entity Enhanced BERT Pre-training for Chinese NER (2020.emnlp-main)

Copied to clipboard

Challenge: Character-level BERT pre-trained in Chinese suffers from lacking lexicon information, which shows effectiveness for Chinese NER.
Approach: They propose a semi-supervised method to integrate lexicon into pre-trained LMs in Chinese . they extract an entity lexiconal from raw text and integrate it into BERT .
Outcome: The proposed method is highly effective and achieves the best results on a news dataset and two datasets annotated by the authors.

What is GenGO?

GenGO is an NLP powered publication search system. It currenctly indexes 30k+ papers from ACL Anthology, and implements multi-aspect summarization, semantic search, and more!

Information

About
Limitations