Papers by Guilherme Freire
Self-Supervised Detection of Contextual Synonyms in a Multi-Class Setting: Phenotype Annotation Use Case (2021.emnlp-main)
Copied to clipboard
Jingqing Zhang, Luis Bolanos Trujillo, Tong Li, Ashwani Tanwar, Guilherme Freire, Xian Yang, Julia Ive, Vibhor Gupta, Yike Guo
| Challenge: | Contextualised word embeddings are powerful tool to detect contextual synonyms, but most of the current SOTA methods are supervised and underexploit the potential of the context. |
| Approach: | They propose a self-supervised approach which detects contextual synonyms of concepts being trained on the data created by shallow matching. |
| Outcome: | The proposed approach outperforms the previous SOTA with gains of up to 4.5 and 4.0 absolute points after fine-tuning with as little as 20% of the labelled data. |