Papers by Angelo Basile
PyRater: A Python Toolkit for Annotation Analysis (2024.lrec-main)
Copied to clipboard
| Challenge: | PyRater is an open-source Python toolkit for analysing corpora annotations. |
| Approach: | They propose to use PyRater to analyse corpora annotations. |
| Outcome: | The proposed model can be used to identify the best annotations and retrieve the gold standard. |
Zero-Shot Data Maps. Efficient Dataset Cartography Without Model Training (2023.findings-emnlp)
Copied to clipboard
| Challenge: | Existing methods to diagnose large annotated datasets require the fitting of a strong model to the dataset. |
| Approach: | They propose a new approach to compute confidence and variability over an ensemble of zero-shot models constructed with different but semantically equivalent label descriptions. |
| Outcome: | The proposed method can be used to diagnose large annotated datasets with accuracy up to 14x faster than the current method. |
You Write like You Eat: Stylistic Variation as a Predictor of Social Stratification (P19-1)
Copied to clipboard
| Challenge: | In order to test whether and to what extent variations in writing style are influenced by socio-economic status, we used user-generated restaurant reviews on social media. |
| Approach: | They propose to use user-generated restaurant reviews to test whether and to what extent variations in writing style are influenced by socio-economic status. |
| Outcome: | The proposed model is based on user-generated restaurant reviews and user-created reviews. |