Papers by Alexandra Benamar
Evaluating Tokenizers Impact on OOVs Representation with Transformers Models (2022.lrec-1)
Copied to clipboard
| Challenge: | Pre-trained Transformer models have proven their effectiveness in adapting to multiple NLP tasks and domains. |
| Approach: | They evaluated three categories of out-of-vocabulary words using three French domain-specific datasets on the legal, medical, and energetical domains to robustly analyze these categories. |
| Outcome: | The proposed models can create new representations for out-of-vocabulary words by adding external morpho-syntactic context rather than improving the semantic understanding of the words directly. |