Papers by Adrien Guille
Exploring Semantics in Pretrained Language Model Attention (2024.starsem-1)
Copied to clipboard
| Challenge: | Abstract Meaning Representations (AMRs) encode the semantics of sentences in the form of graphs. |
| Approach: | They propose to use attention heads of two LMs to detect semantic relations encoded in AMRs. |
| Outcome: | The proposed models detect semantic relations without fine tuning, using both unsupervised and supervised learning techniques. |