Assessing Language Proficiency from Eye Movements in Reading (N18-1)

Copied to clipboard

Challenge: a novel approach to determine second language proficiency uses behavioral traces of eye movements during reading . over 1.5 billion people are learning English as a second language worldwide . traditional approaches to language proficiency testing have several drawbacks, including the fact that they are typically prepared manually and require extensive resources for test development .
Approach: They propose a method which uses behavioral traces of eye movements during reading to determine learners’ second language proficiency.
Outcome: The proposed approach correlates with standardized English proficiency tests and is validated by eyetracking with eye movements from other readers.

Similar Papers

Fine-Grained Prediction of Reading Comprehension from Eye Movements (2024.emnlp-main)

Copied to clipboard

Challenge: a new study attempts to assess reading comprehension from eye movements in reading . eye movements provide small improvements over a text-only baseline, the authors argue .
Approach: They propose to use eyetracking data to predict reading comprehension of a single participant . they use a battery of recent models and three new multimodal language models .
Outcome: The proposed model can predict reading comprehension of a single participant from eye movements over a paragraph.
Eye Tracking and NLP (2025.acl-tutorials)

Copied to clipboard

Challenge: tutorial combines eye tracking during reading with NLP . outlines how eye movements in reading can be leveraged for NLP methods .
Approach: The tutorial combines eye tracking during reading with NLP . it covers eye movements in reading, integrating eye movement data in NLP models .
Outcome: The tutorial outlines how eye movements in reading can be leveraged for NLP . it provides the essential background for conducting research on joint modeling of eye movements and text.
Native Language Prediction from Gaze: a Reproducibility Study (2023.acl-srw)

Copied to clipboard

Challenge: Existing studies have shown that the linguistic properties of a speaker’s native language affect the cognitive processing of other languages.
Approach: They found that the correlation between eye movements and native language similarity may be more complex than the original study found.
Outcome: The proposed model shows that the correlation between eye movements and native language similarity may be more complex than the original study.
Eye Movement Features Can Predict Human Preferences on Machine-Generated Texts (2026.acl-srw)

Copied to clipboard

Challenge: Existing studies on eye movement in text quality assessment are limited . eye-movement features are important predictors of human judgments of text quality, but are costly and inconsistent.
Approach: They propose to capture eye-movement features during screen reading of LLM-generated text using a dataset that includes eye-motion recordings, reading-time measurements, and post-reading evaluations.
Outcome: The proposed dataset shows that eye-movement features can significantly improve models over other probabilistic metrics, including negative log-likelihood (NLL).
From Human Reading to NLM Understanding: Evaluating the Role of Eye-Tracking Data in Encoder-Based Models (2025.acl-long)

Copied to clipboard

Challenge: integrating eye-tracking features into Neural Language Models does not degrade downstream task performance, enhances alignment between model attention and human attention patterns, and compresses the embedding space.
Approach: They used eye-gaze data from the Ghent Eye-Tracking Corpus to investigate how integrating knowledge of human reading behavior impacts Neural Language Models.
Outcome: The proposed approach does not degrade downstream task performance, enhances alignment between model attention and human attention patterns, and compresses the embedding space.
Reading Does Not Equal Reading: Comparing, Simulating and Exploiting Reading Behavior across Populations (2024.lrec-main)

Copied to clipboard

Challenge: Existing corpora of eye-tracking-while-reading corporata lack diversity, limiting their ability to include primarily native speakers.
Approach: They expand the eye-tracking-while-reading dataset CopCo by incorporating a new dataset of L2 readers with diverse L1 backgrounds.
Outcome: The extended CopCo corpus comprises neurotypical L1 and L1 readers with dyslexia as well as L2 readers reading the same materials.
Measuring the Impact of (Psycho-)Linguistic and Readability Features and Their Spill Over Effects on the Prediction of Eye Movement Patterns (2022.acl-long)

Copied to clipboard

Challenge: Existing work to predict gaze patterns during naturalistic reading has not been conducted on general text characteristics.
Approach: They propose to use two eye-tracking corpora of naturalistic reading and two language models to test their performance.
Outcome: The proposed models predict eye-tracking measures during naturalistic reading and language processing.
Decoding Reading Goals from Eye Movements (2025.acl-long)

Copied to clipboard

Challenge: a study examines whether readers can distinguish between two types of reading goals: information seeking and ordinary reading for comprehension.
Approach: They propose a method to distinguish between two types of reading goals: information seeking and ordinary reading for comprehension.
Outcome: The proposed model solves the reading goal-oriented task with the most accurate predictions in real time, the authors say .
Controlling Reading Ease with Gaze-Guided Text Generation (2026.eacl-long)

Copied to clipboard

Challenge: Using a gaze-based model, we generate texts with controllable reading ease.
Approach: They propose a method that predicts gaze patterns to steer language model outputs towards eliciting certain reading behaviors by predicting eye-tracking measures.
Outcome: The proposed method generates texts with controllable reading ease using eye-tracking with native and non-native speakers of English.
InteRead: An Eye Tracking Dataset of Interrupted Reading (2024.lrec-main)

Copied to clipboard

Challenge: Eye movements during reading can provide insights into cognitive processes and language comprehension, but the scarcity of reading data with interruptions hampers advances in the development of intelligent learning technologies.
Approach: They propose a dataset of eye movements during reading that includes eye movements and word frequency effects.
Outcome: The proposed dataset shows that interruptions, word length and word frequency effects significantly impact eye movements during reading.

What is GenGO?

GenGO is an NLP powered publication search system. It currenctly indexes 30k+ papers from ACL Anthology, and implements multi-aspect summarization, semantic search, and more!

Information

About
Limitations