Papers by June Kim
Multilingual Open Text Release 1: Public Domain News in 44 Languages (2022.lrec-1)
Copied to clipboard
| Challenge: | a corpus of permissively licensed text is being developed in 44 languages, many of which have limited existing text resources for natural language processing. |
| Approach: | They propose to create a multilingual corpus containing text in 44 languages . they describe their process for collecting, filtering, and processing the data . |
| Outcome: | The first release of the corpus contains over 2.8 million news articles and an additional 1 million short snippets published between 2001–2022 and collected from Voice of America news websites. |
Squeezed Attention: Accelerating Long Context Length LLM Inference (2025.acl-long)
Copied to clipboard
Coleman Richard Charles Hooper, Sehoon Kim, Hiva Mohammadzadeh, Monishwaran Maheswaran, Sebastian Zhao, June Paik, Michael W. Mahoney, Kurt Keutzer, Amir Gholami
| Challenge: | Emerging Large Language Models require long input context to perform complex tasks. |
| Approach: | They propose an algorithm to reduce the complexity of attention with respect to the fixed context length. |
| Outcome: | The proposed method reduces the complexity of attention from linear to logarithmic with respect to the fixed context length. |