Papers by Xiyang Liao
PIXAR: Auto-Regressive Language Modeling in Pixel Space (2024.findings-acl)
Copied to clipboard
| Challenge: | Recent work shows the possibility of building open-vocabulary large language models that operate on pixel representations. |
| Approach: | They propose a pixel-based autoregressive LLM that performs generative tasks . they propose an adversarial pretraining stage that improves the readability and accuracy of PIXAR by 8.1 on LAMBADA and 8.5 on bAbI. |
| Outcome: | The proposed model performs free-form generative tasks while keeping the number of parameters on par with previous encoder-decoder models. |