Papers by Yves Bestgen
Please, Don’t Forget the Difference and the Confidence Interval when Seeking for the State-of-the-Art Status (2022.lrec-1)
Copied to clipboard
| Challenge: | comparing NLP systems by performance has become an essential question . comparing systems by performing performance criterion is criticized for allowing chance to determine superiority . |
| Approach: | They propose to use bootstrap confidence intervals instead of state-of-the-art status and statistical significance testing to compare NLP system performance. |
| Outcome: | The bootstrap confidence intervals are used to compare NLP system performance . the bootstrap test is more accurate than state-of-the-art status and statistical significance testing . |
Reproducing Monolingual, Multilingual and Cross-Lingual CEFR Predictions (2020.lrec-1)
Copied to clipboard
| Challenge: | POStag and dependency n-grams are more effective than text length and global linguistic indices for this kind of task. |
| Approach: | They propose to use POStag and dependency n-grams to predict the quality of a text written by learners of another language to categorize texts according to their CEFR level. |
| Outcome: | The proposed model is more effective than POStag and dependency n-grams in cross-lingual experiments than the previous models. |