Papers by Stig-Arne Grönroos
MAMMOTH: Massively Multilingual Modular Open Translation @ Helsinki (2024.eacl-demo)
Copied to clipboard
Timothee Mickus, Stig-Arne Grönroos, Joseph Attieh, Michele Boggia, Ona De Gibert, Shaoxiong Ji, Niki Andreas Loppi, Alessandro Raganato, Raúl Vázquez, Jörg Tiedemann
| Challenge: | a growing trend towards modularization is limiting the size and information that can be handled in large language models. |
| Approach: | They propose a framework for training massively multilingual modular machine translation systems at scale. |
| Outcome: | The proposed framework is adapted to train multilingual models at scale on NVIDIA GPUs. |
Morfessor EM+Prune: Improved Subword Segmentation with Expectation Maximization and Pruning (2020.lrec-1)
Copied to clipboard
| Challenge: | Subword segmentation is a standard preprocessing step in many neural approaches to natural language processing. |
| Approach: | They propose to train a unigram subword model using a recursive algorithm and lexicon pruning algorithm. |
| Outcome: | The proposed method improves on the original training algorithm and improves morphological segmentation accuracy. |
Isotropy, Clusters, and Classifiers (2024.acl-short)
Copied to clipboard
| Challenge: | Existing evidence supports and challenges the use of isotropy in embedding spaces. |
| Approach: | They propose to formalize this connection mathematically and empirically and prove it's true . they argue that isotropy imposes requirements on embedding space that are not compatible with clusters . |
| Outcome: | The proposed method sheds light on previous studies focusing on anisotropy in embedding spaces. |