Papers by Imed Zitouni
Bag of Experts Architectures for Model Reuse in Conversational Language Understanding (N18-3)
Copied to clipboard
| Challenge: | Slot tagging is a key component of natural language understanding systems for personal digital assistants. |
| Approach: | They propose to use a bag of experts architecture to reuse domain data for slot tagging models. |
| Outcome: | Experiments with 10 domains show that the proposed models outperform baseline models by 5.06% and 12.16% when training with only 25% of the training data. |
SamToNe: Improving Contrastive Loss for Dual Encoder Retrieval Models with Same Tower Negatives (2023.findings-acl)
Copied to clipboard
| Challenge: | Dual encoders have been used for retrieval tasks and representation learning with good results. |
| Approach: | They propose an improved contrastive learning objective by adding queries or documents from the same encoder towers to the negatives. |
| Outcome: | The proposed model improves retrieval quality for both symmetric and asymmetric dual encoders by adding queries or documents from the same encoder towers to the negatives. |
Exploring Dual Encoder Architectures for Question Answering (2022.emnlp-main)
Copied to clipboard
| Challenge: | Dual encoders have been used for question-answering and information retrieval tasks with good results. |
| Approach: | They propose to use two different versions of dual encoders for QA retrieval tasks . they propose to share parameters in projection layers between two encoder towers . |
| Outcome: | The proposed architectures outperform SDE and ADE on QA retrieval tasks. |