Papers by Leon Zhou
RWKV: Reinventing RNNs for the Transformer Era (2023.findings-emnlp)
Copied to clipboard
Bo Peng, Eric Alcaide, Quentin Anthony, Alon Albalak, Samuel Arcadinho, Stella Biderman, Huanqi Cao, Xin Cheng, Michael Chung, Leon Derczynski, Xingjian Du, Matteo Grella, Kranthi Gv, Xuzheng He, Haowen Hou, Przemyslaw Kazienko, Jan Kocon, Jiaming Kong, Bartłomiej Koptyra, Hayden Lau, Jiaju Lin, Krishna Sri Ipsit Mantri, Ferdinand Mom, Atsushi Saito, Guangyu Song, Xiangru Tang, Johan Wind, Stanisław Woźniak, Zhenyuan Zhang, Qinghua Zhou, Jian Zhu, Rui-Jie Zhu
| Challenge: | recurrent neural networks struggle to match the performance of Transformers due to limitations in parallelization and scalability. |
| Approach: | They propose a model architecture that combines the efficient parallelizable training of transformers with the efficient inference of RNNs. |
| Outcome: | The proposed model performs on par with similarly sized RNNs, suggesting future work can leverage this architecture to create more efficient models. |
Human-in-the-loop Schema Induction (2023.acl-demo)
Copied to clipboard
Tianyi Zhang, Isaac Tham, Zhaoyi Hou, Jiaxuan Ren, Leon Zhou, Hainiu Xu, Li Zhang, Lara Martin, Rotem Dror, Sha Li, Heng Ji, Martha Palmer, Susan Windisch Brown, Reece Suchocki, Chris Callison-Burch
| Challenge: | Existing approaches to event-centric natural language understanding (NLU) have been limited to linear and temporal ones. |
| Approach: | They propose a human-in-the-loop schema induction system powered by GPT-3 . they show that it transfers to new domains more easily than previous approaches . |
| Outcome: | The proposed system transfers to new domains more easily than previous approaches and reduces human curation. |
Alpha-GPT: Human-AI Interactive Alpha Mining for Quantitative Investment (2025.emnlp-demos)
Copied to clipboard
| Challenge: | Traditional methods of alpha mining have inherent limitations, especially in implementing the ideas of quant researchers. |
| Approach: | They propose a new alpha mining paradigm by introducing human-AI interaction and a prompt engineering algorithmic framework to implement this paradigm by using large language models. |
| Outcome: | The proposed framework is based on human-AI interaction and large language models and is comparable to human participants in the WorldQuant International Quant Championship. |