| Challenge: | tutorial combines eye tracking during reading with NLP . outlines how eye movements in reading can be leveraged for NLP methods . |
| Approach: | The tutorial combines eye tracking during reading with NLP . it covers eye movements in reading, integrating eye movement data in NLP models . |
| Outcome: | The tutorial outlines how eye movements in reading can be leveraged for NLP . it provides the essential background for conducting research on joint modeling of eye movements and text. |
Similar Papers
From Human Reading to NLM Understanding: Evaluating the Role of Eye-Tracking Data in Encoder-Based Models (2025.acl-long)
Copied to clipboard
| Challenge: | integrating eye-tracking features into Neural Language Models does not degrade downstream task performance, enhances alignment between model attention and human attention patterns, and compresses the embedding space. |
| Approach: | They used eye-gaze data from the Ghent Eye-Tracking Corpus to investigate how integrating knowledge of human reading behavior impacts Neural Language Models. |
| Outcome: | The proposed approach does not degrade downstream task performance, enhances alignment between model attention and human attention patterns, and compresses the embedding space. |
Fine-Grained Prediction of Reading Comprehension from Eye Movements (2024.emnlp-main)
Copied to clipboard
| Challenge: | a new study attempts to assess reading comprehension from eye movements in reading . eye movements provide small improvements over a text-only baseline, the authors argue . |
| Approach: | They propose to use eyetracking data to predict reading comprehension of a single participant . they use a battery of recent models and three new multimodal language models . |
| Outcome: | The proposed model can predict reading comprehension of a single participant from eye movements over a paragraph. |
Measuring the Impact of (Psycho-)Linguistic and Readability Features and Their Spill Over Effects on the Prediction of Eye Movement Patterns (2022.acl-long)
Copied to clipboard
| Challenge: | Existing work to predict gaze patterns during naturalistic reading has not been conducted on general text characteristics. |
| Approach: | They propose to use two eye-tracking corpora of naturalistic reading and two language models to test their performance. |
| Outcome: | The proposed models predict eye-tracking measures during naturalistic reading and language processing. |
Déjà Vu? Decoding Repeated Reading from Eye Movements (2025.acl-long)
Copied to clipboard
| Challenge: | In many daily situations we read the same text more than once. |
| Approach: | They propose a strategy for enhancing feature-based and neural models by generating machine generated eye movements from a cognitive model. |
| Outcome: | The proposed model improves on the previous model and enables better characterization of the role of memory in repeated reading. |
LLM-driven Instruction Following: Progresses and Concerns (2023.emnlp-tutorial)
Copied to clipboard
| Challenge: | a tutorial on task instruction is aimed at researchers and practitioners interested in NLP generalization . labeled examples are unlikely to be available in large numbers or do not exist . |
| Approach: | This tutorial will examine the progress of natural language processing (NLP) using labeled examples. authors propose that task instructions act as a novel resource for supervision. |
| Outcome: | This tutorial aims to answer questions about instruction-driven NLP . it focuses on the use of task instructions in a low-shot scenario . |
Assessing Language Proficiency from Eye Movements in Reading (N18-1)
Copied to clipboard
| Challenge: | a novel approach to determine second language proficiency uses behavioral traces of eye movements during reading . over 1.5 billion people are learning English as a second language worldwide . traditional approaches to language proficiency testing have several drawbacks, including the fact that they are typically prepared manually and require extensive resources for test development . |
| Approach: | They propose a method which uses behavioral traces of eye movements during reading to determine learners’ second language proficiency. |
| Outcome: | The proposed approach correlates with standardized English proficiency tests and is validated by eyetracking with eye movements from other readers. |
Eye Movement Features Can Predict Human Preferences on Machine-Generated Texts (2026.acl-srw)
Copied to clipboard
| Challenge: | Existing studies on eye movement in text quality assessment are limited . eye-movement features are important predictors of human judgments of text quality, but are costly and inconsistent. |
| Approach: | They propose to capture eye-movement features during screen reading of LLM-generated text using a dataset that includes eye-motion recordings, reading-time measurements, and post-reading evaluations. |
| Outcome: | The proposed dataset shows that eye-movement features can significantly improve models over other probabilistic metrics, including negative log-likelihood (NLL). |
NLP+Vis: NLP Meets Visualization (2023.emnlp-tutorial)
Copied to clipboard
| Challenge: | This tutorial will introduce NLP+Vis with a focus on two main threads of work: NLP for Vis and Vis for NLP. |
| Approach: | tutorial will introduce NLP+Vis with a focus on two main threads of work . overview of research topics on combining NLP and Vis techniques will be covered . |
| Outcome: | The tutorial will introduce NLP+Vis with a focus on two main threads of work . it will provide an overview of research topics on combining NLP and Vis techniques . |
Beyond Paragraphs: NLP for Long Sequences (2021.naacl-tutorials)
Copied to clipboard
| Challenge: | In this tutorial, we will introduce document-level representation learning techniques . document-based learning is challenging due to the limited sequence length of many models . |
| Approach: | They will provide an overview of established long sequence NLP techniques and discuss memory-saving methods that are key to processing long sequences. |
| Outcome: | The tutorial will introduce the latest and ongoing techniques for document-level representation learning. |
Deep Learning for Natural Language Inference (N19-5)
Copied to clipboard
| Challenge: | This tutorial discusses cutting-edge research on NLI, including recent advance on dataset development, cutting- edge deep learning models, and highlights from recent research on using NLI to understand capabilities and limits of deep learning for language understanding and reasoning. |
| Approach: | This tutorial discusses cutting-edge research on NLI, including recent advance on dataset development and cutting- edge deep learning models. |
| Outcome: | This tutorial discusses cutting-edge research on NLI, including recent advance on dataset development, cutting- edge deep learning models, and highlights from recent research on using NLI to understand capabilities and limits of deep learning model for language understanding and reasoning. |