Papers by Ieva Staliūnaitė
Compositional and Lexical Semantics in RoBERTa, BERT and DistilBERT: A Case Study on CoQA (2020.emnlp-main)
Copied to clipboard
| Challenge: | Existing knowledge transfer models do not exploit compositionality of language, often relying on superficial features. |
| Approach: | They propose to use a knowledge distillation technique to fine tune RoBERTa, BERT and DistilBERT models to improve their performance. |
| Outcome: | The proposed models improve on the CoQA task with linguistic knowledge and are able to represent compositional and lexical information. |
Getting to “Hearer-old”: Charting Referring Expressions Across Time (D18-1)
Copied to clipboard
| Challenge: | a study of how expressions that refer to an entity develop over time is done . we track thousands of person and organization entities over 20 years of NYT . |
| Approach: | They track thousands of person and organization entities over 20 years of the NYT . they find that referring expressions evolve over time as entities move from hearer-new to hearer old . |
| Outcome: | The proposed model improves on a majority-class baseline by 10-30% . it shows that the expressions evolve as the entity becomes accepted into common knowledge . |