Papers by Zhaocong Li
Can LLMs Learn Uncertainty on Their Own? Expressing Uncertainty Effectively in A Self-Training Manner (2024.emnlp-main)
Copied to clipboard
| Challenge: | Large language models (LLMs) exhibit excessive, random, and uninformative uncertainty rendering them unsuitable for decision-making in human-computer interactions. |
| Approach: | They propose an uncertainty-aware instruction tuning method that aligns LLMs’ perception with the probabilistic uncertainty of the generation. |
| Outcome: | The proposed method improves LLMs' performance by 45.2%, with reasonably good out-of-domain generalization capabilities. |
Can LMs Generalize to Future Data? An Empirical Analysis on Text Summarization (2023.emnlp-main)
Copied to clipboard
| Challenge: | Existing summarization benchmarks overlap in time with pre-training corpora and fine-tuning datasets. |
| Approach: | They propose a temporal generalization benchmark that contains data samples from 2010 to 2022 to understand the temporal ability of abstractive summarization models. |
| Outcome: | The proposed benchmark analyzes data samples from 2010 to 2022 to understand the temporal generalization ability of abstractive summarization models. |
ConsistTL: Modeling Consistency in Transfer Learning for Low-Resource Neural Machine Translation (2022.emnlp-main)
Copied to clipboard
| Challenge: | Existing transfer learning methods for low-resource NMT are static, which simply transfer knowledge from a parent model to a child model once via parameter initialization. |
| Approach: | They propose a transfer learning method that can continuously transfer knowledge from the parent model during the training of the child model. |
| Outcome: | The proposed method can transfer knowledge from the parent model to the child model during the training of the child. |
Towards Demonstration-Aware Large Language Models for Machine Translation (2024.findings-acl)
Copied to clipboard
| Challenge: | Large language models for machine translation often face difficulties in leveraging demonstrations to further improve their performance. |
| Approach: | They propose a novel approach that integrates demonstration-aware training and inference strategies within the framework of tuning-based LTMs. |
| Outcome: | The proposed model integrates demonstration-aware training and inference strategies within tuning-based LTMs. |
kNN-TL: k-Nearest-Neighbor Transfer Learning for Low-Resource Neural Machine Translation (2023.acl-long)
Copied to clipboard
| Challenge: | Transfer learning is an effective technique for enhancing low-resource neural machine translation (NMT) however, these methods do not make use of the parent knowledge during the child inference, which may limit the translation performance. |
| Approach: | They propose a k-Nearest-Neighbor Transfer Learning approach which leverages the parent knowledge throughout the entire developing process of the child model. |
| Outcome: | The proposed approach outperforms strong baselines on four low-resource translation tasks. |