Papers by Rudolf Rosa
Universal Dependencies According to BERT: Both More Specific and More General (2020.findings-emnlp)
Copied to clipboard
| Challenge: | Existing studies show that individual BERT heads encode particular dependency relation types, but they do not match one-to-one. |
| Approach: | They propose a method for relation identification and syntactic tree construction that can be applied with minimal supervision and generalizes well across languages. |
| Outcome: | The proposed method produces significantly more consistent dependency trees than previous work and can be applied with only a minimal amount of supervision and generalizes well across languages. |
OOVs in the Spotlight: How to Inflect Them? (2024.lrec-main)
Copied to clipboard
| Challenge: | Inflection is a process of word formation in which a base word form (lemma) is modified to express grammatical categories. |
| Approach: | They develop a retrograde model and two sequence-to-sequence models based on LSTM and Transformer. |
| Outcome: | The proposed systems outperform the existing systems on 9 out of 16 languages in the OOV evaluation. |
On the Language Neutrality of Pre-trained Multilingual Representations (2020.findings-emnlp)
Copied to clipboard
| Challenge: | Existing studies have focused on cross-linguality of contextual embeddings . however, they are only moderately language-neutral by default . |
| Approach: | They propose to use unsupervised centering and fitting an explicit projection on parallel data to achieve stronger language neutrality. |
| Outcome: | The proposed model outperforms existing models on XNLI and NER tasks. |