Papers by Dusan Varis
Sequence Length is a Domain: Length-based Overfitting in Transformer Models (2021.emnlp-main)
Copied to clipboard
| Challenge: | Current Transformer-based sequence-to-sequence architectures can suffer from overfitting during training. |
| Approach: | They propose to use Transformer-based sequence-to-sequence architectures to overcome overfitting problems when generating very long sequences. |
| Outcome: | The proposed model performs worse on very long sequences than previous approaches on string editing and translation tasks when faced with sequences of length diverging from the length distribution in training data. |
End-to-End Lexically Constrained Machine Translation for Morphologically Rich Languages (2021.acl-long)
Copied to clipboard
| Challenge: | Existing approaches to enforce word forms in translations struggle to make them agree with the rest of the output. |
| Approach: | They propose to train neural machine translation models with lemmatized constraints to infer correct word inflection. |
| Outcome: | The proposed model reduces errors in translation of constrained terms in automatic and manual evaluations on English-Czech language pairs. |
European Language Grid: A Joint Platform for the European Language Technology Community (2021.eacl-demos)
Copied to clipboard
Georg Rehm, Stelios Piperidis, Kalina Bontcheva, Jan Hajic, Victoria Arranz, Andrejs Vasiļjevs, Gerhard Backfried, Jose Manuel Gomez-Perez, Ulrich Germann, Rémi Calizzano, Nils Feldhus, Stefanie Hegele, Florian Kintzel, Katrin Marheinecke, Julian Moreno-Schneider, Dimitris Galanis, Penny Labropoulou, Miltos Deligiannis, Katerina Gkirtzou, Athanasia Kolovou, Dimitris Gkoumas, Leon Voukoutis, Ian Roberts, Jana Hamrlova, Dusan Varis, Lukas Kacena, Khalid Choukri, Valérie Mapelli, Mickaël Rigault, Julija Melnika, Miro Janosik, Katja Prinz, Andres Garcia-Silva, Cristian Berrio, Ondrej Klejch, Steve Renals
| Challenge: | Europe is a multilingual society, in which dozens of languages are spoken. |
| Approach: | They describe the European Language Grid, which is targeted to evolve into the primary platform and marketplace for LT in Europe by providing one umbrella platform for the European LT landscape. |
| Outcome: | The European Language Grid (ELG) will provide access to 1300 services for all European languages as well as thousands of data sets. |