Papers by Jairo Cugliari
Monitoring geometrical properties of word embeddings for detecting the emergence of new topics. (2021.emnlp-main)
Copied to clipboard
| Challenge: | a recent study shows that slow emerging topics are often detected too late . a positive correlation is linked with event-like topics while a negative correlation is a sign of emergence. |
| Approach: | They propose to monitor words representation in embedding space and use one of its geometrical properties to characterize the emergence of topics. |
| Outcome: | The proposed method outperforms state-of-the-art methods on two public datasets of press and scientific articles. |
Exploring Semantics in Pretrained Language Model Attention (2024.starsem-1)
Copied to clipboard
| Challenge: | Abstract Meaning Representations (AMRs) encode the semantics of sentences in the form of graphs. |
| Approach: | They propose to use attention heads of two LMs to detect semantic relations encoded in AMRs. |
| Outcome: | The proposed models detect semantic relations without fine tuning, using both unsupervised and supervised learning techniques. |