Papers by Jiarui Ren
DTDES-KGE: Dual-Teacher Knowledge Distillation with Distinct Embedding Spaces for Knowledge Graph Embeddings (2025.findings-emnlp)
Copied to clipboard
| Challenge: | Existing knowledge distillation methods rely on a single teacher embedding space . existing methods overlook valuable complementary knowledge from teachers in distinct embeddable spaces. |
| Approach: | They propose a knowledge distillation framework that leverages dual teachers in embedding spaces to enhance performance. |
| Outcome: | The proposed framework significantly improves knowledge distillation performance by leveraging dual teachers in distinct embedding spaces. |
Teaching Large Language Models to Translate on Low-resource Languages with Textbook Prompting (2024.lrec-main)
Copied to clipboard
| Challenge: | Large Language Models (LLMs) have demonstrated impressive results in Machine Translation by following instructions, even without training on parallel data. |
| Approach: | They propose a Translate After LEarNing Textbook approach which aims to enhance LLMs’ ability to translate low-resource languages by learning from a textbook. |
| Outcome: | The proposed approach improves translation performance by 14.8% using 112 low-resource languages from FLORES-200 with two LLMs: ChatGPT and BLOOMZ. |