Papers by Léo Jacqmin
„Mann“ is to “Donna” as「国王」is to « Reine » Adapting the Analogy Task for Multilingual and Contextual Embeddings (2023.starsem-1)
Copied to clipboard
| Challenge: | a lack of comparable multilingual benchmarks and a consensual evaluation protocol for contextual models remains an open question. |
| Approach: | They propose a multilingual analogy dataset and evaluate human and contextual embedding performance. |
| Outcome: | The proposed dataset evaluates human and contextual embedding models on the analogy task. |