Papers by Shaowei Chen
From Curated Data to Scalable Models: Continual Pre-training of Dense and MoE Large Language Models for Tibetan (2026.acl-long)
Copied to clipboard
Lei Yang, Leiyu Pan, Bojian Xiong, Renren Jin, Shaowei Zhang, Yue Chen, Ling Shi, Jiang Zhou, Junru Wu, Zhen Wang, Jianxiang Peng, Juesi Xiao, Tianyu Dong, Zhuowen Han, Zhuo Chen, Yuqi Ren, Deyi Xiong
| Challenge: | Large language models have achieved remarkable success across a wide range of tasks, yet their performance remains heavily biased toward high-resource languages. |
| Approach: | They propose a pipeline for advancing Tibetan language modeling through multilingual continual pre-training with Tibetan, Chinese, and English. |
| Outcome: | The proposed model outperforms open-source and Tibetan-focused models on diverse tasks. |
CODEPROMPTZIP: Code-specific Prompt Compression for Retrieval-Augmented Generation in Coding Tasks with LMs (2026.findings-acl)
Copied to clipboard
| Challenge: | Existing prompt compression techniques for natural language lack fine-grained control over compression ratios. |
| Approach: | They propose a code-aware prompt compression framework for RAG that enables precise length control while preserving critical information. |
| Outcome: | The proposed framework outperforms baselines on three code-related tasks while maintaining the most informative tokens. |
Synchronous Double-channel Recurrent Network for Aspect-Opinion Pair Extraction (2020.acl-main)
Copied to clipboard
| Challenge: | Existing studies focus on aspect-opinion relation detection, but neglect to recognize the relations between aspects and opinion expressions. |
| Approach: | They propose a Synchronous Double-channel Recurrent Network to deal with AOPE task . they propose an opinion entity extraction unit, a relation detection unit, and a synchronization unit . |
| Outcome: | The proposed system achieves state-of-the-art in opinion entity extraction . it is based on three datasets based upon SemEval 2014 and 2015 benchmarks . |
SLICEFORMER: Static Program Slicing Using Language Models With Dataflow-Aware Pretraining and Constrained Decoding (2026.acl-long)
Copied to clipboard
| Challenge: | Static program slicing is a software engineering technique for isolating code relevant to specific variables. |
| Approach: | They propose a new approach that reformulates static program slicing as a sequence-to-sequence task using small language models such as CodeT5+. |
| Outcome: | The proposed approach improves on Java and Python program slicing benchmarks with up to 22% gain in ExactMatch. |