Papers by Paul Prasse
Pre-Trained Language Models Augmented with Synthetic Scanpaths for Natural Language Understanding (2023.emnlp-main)
Copied to clipboard
| Challenge: | Existing models for augmenting language models with human scanpaths have been developed, but the potential of synthetic gaze data across NLP tasks remains unexplored. |
| Approach: | They propose to combine synthetic scanpath generation with a scanpath-augmented language model, eliminating the need for human gaze data. |
| Outcome: | The proposed model outperforms the underlying language model and achieves comparable performance to a language model augmented with real human gaze data. |
ScanDL: A Diffusion Model for Generating Synthetic Scanpaths on Texts (2023.emnlp-main)
Copied to clipboard
| Challenge: | Eye movements in reading are a key part of psycholinguistic research, but the lack of eye movement data and its unavailability at application time pose a major challenge for this line of research. |
| Approach: | They propose a novel sequence-to-sequence diffusion model that generates synthetic scanpaths on texts by leveraging pre-trained word representations and jointly embedding both the stimulus text and the fixation sequence. |
| Outcome: | The proposed model outperforms state-of-the-art models in psycholinguistic analysis and is able to exhibit human-like reading behavior. |
Fine-Tuning Pre-Trained Language Models with Gaze Supervision (2024.acl-short)
Copied to clipboard
| Challenge: | Existing pre-trained language models lack a gaze module to exploit cognitive signals. |
| Approach: | They propose to integrate a gaze module into pre-trained language models at the fine-tuning stage to exploit cognitive signals. |
| Outcome: | The proposed model improves performance on the GLUE benchmark and standard fine-tuning and text augmentation baselines. |