Papers by Xinting Liao
Mitigating Catastrophic Forgetting in Large Language Models with Self-Synthesized Rehearsal (2024.acl-long)
Copied to clipboard
Jianheng Huang, Leyang Cui, Ante Wang, Chengyi Yang, Xinting Liao, Linfeng Song, Junfeng Yao, Jinsong Su
| Challenge: | Existing methods to train LLMs on previous training data are not feasible in real-world applications because of catastrophic forgetting. |
| Approach: | They propose a framework that uses the LLM to generate synthetic instances for rehearsal and refine the instance outputs based on the synthetic inputs. |
| Outcome: | The proposed framework achieves superior or comparable performance compared to conventional rehearsal-based approaches while being more data-efficient. |
Robust Representation Learning with Reliable Pseudo-labels Generation via Self-Adaptive Optimal Transport for Short Text Clustering (2023.acl-long)
Copied to clipboard
| Challenge: | Existing approaches to short text clustering are prone to degenerate solutions and noisy data. |
| Approach: | They propose a model to improve robustness against imbalanced and noisy data . they propose self-adaptive optimal transport and class-wise contrastive learning . |
| Outcome: | The proposed model outperforms the state-of-the-art models on eight short text clustering datasets. |