Papers by Jy-yong Sohn
Improving Multi-lingual Alignment Through Soft Contrastive Learning (2024.naacl-srw)
Copied to clipboard
| Challenge: | Existing methods to train multi-lingual sentence embeddings ruins the mono-lingual space. |
| Approach: | They propose a method to align multi-lingual embeddings based on similarity of sentences measured by a pre-trained mono-lingual teacher model. |
| Outcome: | The proposed method outperforms existing multi-lingual embeddings including LaBSE on five languages and on a translation pair for Tatoeba dataset. |
Utilizing Language-Image Pretraining for Efficient and Robust Bilingual Word Alignment (2022.findings-emnlp)
Copied to clipboard
Tuan Dinh, Jy-yong Sohn, Shashank Rajput, Timothy Ossowski, Yifei Ming, Junjie Hu, Dimitris Papailiopoulos, Kangwook Lee
| Challenge: | Recent studies show that unsupervised word translation is more accurate and robust without parallel corpora. |
| Approach: | They propose a method for unsupervised word translation that leverages visual observations and pretrained language-image models to align words. |
| Outcome: | The proposed method improves on the state-of-the-art language-image pretraining method for bilingual word alignment. |