Papers by Shangjie Li
MMNMT: Modularizing Multilingual Neural Machine Translation with Flexibly Assembled MoE and Dense Blocks (2023.emnlp-main)
Copied to clipboard
| Challenge: | Mixture-of-Experts (MoE) based sparse architectures are prone to overfitting on low-resource language translation. |
| Approach: | They propose a modularized MNMT framework that flexibly assembles dense and MoE-based sparse modules to achieve the best of both worlds. |
| Outcome: | The proposed framework outperforms existing models on low-resource language translation and zero-shot translation on benchmark datasets. |
PEIT: Bridging the Modality Gap with Pre-trained Models for End-to-End Image Translation (2023.acl-long)
Copied to clipboard
| Challenge: | Image translation is a task that translates an image containing text in the source language to the target language. |
| Approach: | They propose an end-to-end image translation framework that bridges the modality gap between visual inputs and textual inputs/outputs of machine translation (MT). |
| Outcome: | The proposed framework outperforms existing models on a large-scale image translation corpus . it significantly outperformed both cascaded and strong models on the e-commerce domain . |