Papers by Yaniv Romano
Segment-Based Attention Masking for GPTs (2025.acl-long)
Copied to clipboard
| Challenge: | Causal masking is a fundamental component in Generative Pre-Trained Transformers (GPT) models, playing a crucial role during training. |
| Approach: | They propose to apply causal masking to all input tokens step-by-step, mimicking the generation process. |
| Outcome: | The proposed model can process the entire user prompt at once, but it is applied to all input tokens step-by-step, mimicking the generation process. |