Papers by Feifan Liu
Lil: Less is Less When Applying Post-Training Sparse-Attention Algorithms in Long-Decode Stage (2026.findings-acl)
Copied to clipboard
Junhao Hu, Fangze Li, Mingtao Xu, Feifan Meng, Shiju Zhao, Tiancheng Hu, Ting Peng, Anmin Liu, Wenrui Huang, Chenxu Liu, Ziyue Hua, Tao Xie
| Challenge: | Prior work typically decomposes inference into prefill and decode stages, with the decode stage dominating total latency. |
| Approach: | They propose an algorithm that detects threshold where information loss exceeds information gain during sparse decoding to reduce token consumption by up to 90% and a marginal accuracy degradation of less than 2%. |
| Outcome: | The proposed algorithm reduces token consumption by 90% with a marginal accuracy degradation of less than 2% across reasoning-intensive benchmarks. |
ATLANTIS: Weak-to-Strong Learning via Importance Sampling (2025.acl-long)
Copied to clipboard
| Challenge: | ATLANTIS is a new technique to improve the performance of large language models. |
| Approach: | They propose a new technique to bridge the gap between the distribution of current datasets and the real-world data distribution by using importance sampling. |
| Outcome: | The proposed technique can bring consistent and significant improvements to models’ performance and can be flexibly transferred among models with different structures. |
Knowledge-augmented Financial Market Analysis and Report Generation (2024.emnlp-industry)
Copied to clipboard
| Challenge: | Existing methods to generate financial market analysis text require extensive financial knowledge and skill of financial analysts. |
| Approach: | They propose a task to generate financial market analysis reports using financial market data using a financial knowledge graph. |
| Outcome: | The proposed framework outperforms large-scale language models and retrieval-augmented baselines in the financial market analysis generation task. |
DeepGeneMD: A Joint Deep Learning Model for Extracting Gene Mutation-Disease Knowledge from PubMed Literature (D19-57)
Copied to clipboard
| Challenge: | Identifying and understanding the pathogenesis of genetic diseases is an essential task. |
| Approach: | They propose a joint deep learning model for gene mutation-disease knowledge extraction that adapts the state-of-the-art hierarchical multi-task learning framework for joint inference on named entity recognition and relation extraction. |
| Outcome: | The proposed model achieves the average score of 0.45 on recognizing gene activities and disease entities and the average F1 score of 0.3 on extracting relations, ranking 1st in the AGAC RE task. |
Well Begun is Half Done: Low-resource Preference Alignment by Weak-to-Strong Decoding (2025.findings-acl)
Copied to clipboard
| Challenge: | Low-resource methods for LLM alignment have been popular, but still face challenges in obtaining high-quality and aligned content. |
| Approach: | They propose a framework to enhance alignment ability of base models by the guidance of a small aligned model. |
| Outcome: | The proposed framework outperforms baseline methods while avoiding degradation on downstream tasks. |
Towards A Better Initial Policy Model For Scalable Long-CoT Reinforcement Learning (2025.findings-acl)
Copied to clipboard
| Challenge: | Long-CoT reasoning and reinforcement learning are demonstrating remarkable performance and scalability, however, there is a lack of systematic guidelines for obtaining a better initial policy model. |
| Approach: | They propose a systematic guideline and a novel Re-RFT method to obtain more efficient reasoning patterns from different initial models. |
| Outcome: | The proposed method surpasses DeepSeek-R1-Distill-Qwen-14B model by 4.6%, demonstrating its effectiveness and superiority. |