Papers by Vladimir Solovyev
Language-Independent Representations Improve Zero-Shot Summarization (2024.naacl-short)
Copied to clipboard
| Challenge: | Pretrained models can be fine tuned on downstream generation tasks, but they can fail in zero-shot conditions. |
| Approach: | They propose query-key finetuning to decouple task-specific knowledge from pretrained models . they propose a variant that more directly enforces language-agnostic representations . |
| Outcome: | The proposed model decouples task-specific knowledge from pretrained language generation abilities. |