Papers by Li Feifei
A Generative Pre-Trained Language Model for Channel Prediction in Wireless Communications Systems (2025.emnlp-main)
Copied to clipboard
Bo Lin, Huanming Zhang, Yuhua Jiang, Yucong Wang, Tengyu Zhang, Shaoqiang Yan, Hongyao Li, Yihong Liu, Feifei Gao
| Challenge: | Existing model-based channel prediction methods suffer from limited accuracy due to imperfect temporal modeling, while existing AI-based methods suffers from limited generalization due to inadequate training strategies. |
| Approach: | They propose a generative pre-trained language model for channel prediction based on channel correlation and train it based upon transformer decoder architecture. |
| Outcome: | The proposed model can learn various channel characteristics and perform impressive tasks across multiple dimensions. |
Multi-Stage Pre-training Enhanced by ChatGPT for Multi-Scenario Multi-Domain Dialogue Summarization (2023.findings-emnlp)
Copied to clipboard
| Challenge: | Existing methods for dialogue summarization only apply to specific scenarios and domains. |
| Approach: | They propose a pre-trained model specifically designed for multi-scenario multi-domain dialogue summarization. |
| Outcome: | The proposed model significantly outperforms state-of-the-art models on three dialogue summarization datasets from different scenarios and domains. |
TencentPretrain: A Scalable and Flexible Toolkit for Pre-training Models of Different Modalities (2023.acl-demo)
Copied to clipboard
Zhe Zhao, Yudong Li, Cheng Hou, Jing Zhao, Rong Tian, Weijie Liu, Yiren Chen, Ningyuan Sun, Haoyan Liu, Weiquan Mao, Han Guo, Weigang Gou, Taiqiang Wu, Tao Zhu, Wenhang Shi, Chen Chen, Shan Huang, Sihong Chen, Liqun Liu, Feifei Li, Xiaoshuai Chen, Xingwu Sun, Zhanhui Kang, Xiaoyong Du, Linlin Shen, Kimmo Yan
| Challenge: | Several pre-training models of different modalities are showing a rising trend of homogeneity in their model structures. |
| Approach: | They propose a toolkit that supports pre-training models of different modalities. |
| Outcome: | The proposed toolkit can match the performance of the original implementations on text, vision, and audio benchmarks. |
Domain-aware and Co-adaptive Feature Transformation for Domain Adaption Few-shot Relation Extraction (2024.lrec-main)
Copied to clipboard
| Challenge: | Existing approaches to relation extraction focus on the source domain, which makes it difficult to accurately transfer useful knowledge to the target domain. |
| Approach: | They propose a domain-aware and co-adaptive feature transformation approach to address these issues by leveraging the target domain distribution features to guide the domain-based feature transformations. |
| Outcome: | The proposed method outperforms existing models and achieves state-of-the-art performance on a benchmark dataset. |
PAD: A Robustness Enhancement Ensemble Method via Promoting Attention Diversity (2024.lrec-main)
Copied to clipboard
| Challenge: | Existing approaches to enhance robustness of deep neural networks focus on perturbation . weak robustness is a problem for many types of adversarial attacks, authors say . |
| Approach: | They propose a lightweight framework for enhancing robustness by perturbing parameters of a model and diversifying adversarial example distributions among different models. |
| Outcome: | The proposed method can improve robustness against adversarial attacks while maintaining accuracy on clean data. |
One Agent to Serve All: a Lite-Adaptive Stylized AI Assistant for Millions of Multi-Style Official Accounts (2026.findings-acl)
Copied to clipboard
| Challenge: | Existing methods for prompting in official accounts are computationally prohibitive and lack contextually grounded responses. |
| Approach: | They propose a lite-adaptive framework for stylized contextual question answering that scales to millions of official accounts. |
| Outcome: | The proposed framework can serve large volumes of official accounts with minimal overhead while maintaining stylistic diversity. |
On Support Samples of Next Word Prediction (2025.acl-long)
Copied to clipboard
| Challenge: | Language models excel in various tasks by making complex decisions, but understanding the rationale behind these decisions remains a challenge. |
| Approach: | They investigate data-centric interpretability in language models by focusing on the next-word prediction task. |
| Outcome: | The proposed model supports or deteres specific predictions, while non-support samples play a critical role in generalization and representation learning. |
MCAD: Multi-teacher Cross-modal Alignment Distillation for efficient image-text retrieval (2024.findings-naacl)
Copied to clipboard
| Challenge: | Large-scale visual-language pretraining models have shown remarkable capabilities in understanding both vision and language. |
| Approach: | They propose a multi-teacher cross-modality alignment distillation technique to integrate the advantages of single-stream and dual-stream models. |
| Outcome: | The proposed model is lightweight and has only 100M running memory and 8.0ms search latency. |