Papers by Ruitao Leng
Scaling Laws for Linear Complexity Language Models (2024.emnlp-main)
Copied to clipboard
| Challenge: | Existing scaling laws for large language models are unclear, but they are useful for scalability. |
| Approach: | They propose scaling laws for linear complexity language models to establish a foundation for their scalability. |
| Outcome: | The proposed models demonstrate superior linguistic proficiency and knowledge retention. |