Papers by Deep Nayak
Multilingual Continual Learning using Attention Distillation (2025.coling-industry)
Copied to clipboard
| Challenge: | Existing models for Query-product relevance classification are not accurate across multiple languages. |
| Approach: | They propose a multilingual continual learning framework that adds adapters for each new language and incorporates a fusion layer above language-specific adapters. |
| Outcome: | The proposed approach reduces trainable parameters by 80% while outperforming SOTA CL methods on proprietary and external datasets. |