Papers by Anna Langedijk
Meta-Learning for Fast Cross-Lingual Adaptation in Dependency Parsing (2022.acl-long)
Copied to clipboard
Anna Langedijk, Verna Dankers, Phillip Lippe, Sander Bos, Bryan Cardenas Guevara, Helen Yannakoudakis, Ekaterina Shutova
| Challenge: | Meta-learning can help overcome resource scarcity in cross-lingual NLP problems . pre-training of models requires large annotated training sets for the task at hand . |
| Approach: | They propose to use meta-learning to train a model to learn a parameter initialization that can adapt quickly to new languages. |
| Outcome: | The proposed model-agnostic meta-learning improves on language transfer and standard supervised learning baselines for unseen, typologically diverse, and low-resource languages in a few-shot learning setup. |
DecoderLens: Layerwise Interpretation of Encoder-Decoder Transformers (2024.findings-naacl)
Copied to clipboard
| Challenge: | Existing interpretability methods have been proposed to interpret the inner workings of Transformer models at different levels of precision and complexity. |
| Approach: | They propose a method to analyze encoder-decoder Transformers by using the decoder module Model Output encoder to cross-attend representations of intermediate encoder activations instead of using the default output. |
| Outcome: | The proposed method maps uninterpretable representations to human-interpreted sequences of words or symbols, shedding new light on the information flow in this popular but understudied class of models. |