Papers by Jianshu She
Token Level Routing Inference System for Edge Devices (2025.acl-demo)
Copied to clipboard
| Challenge: | Large language models (LLMs) have been gaining in performance but deployment in edge devices faces significant hurdles due to their high computational complexity. |
| Approach: | They propose a collaborative decoding system that allows small models to perform on-device inference while selectively consulting a cloud-based large model for critical token generation. |
| Outcome: | The proposed system achieves 60% performance gain on CommonsenseQA using a 0.5B model on an M1 MacBook, with under 7% of tokens generation uploaded to the large model in the cloud. |
Linear Steerability in Language Models: When It Emerges and How It Evolves (2025.findings-emnlp)
Copied to clipboard
| Challenge: | a new framework for steering language models reveals how concepts become linearly separable as training progresses . |
| Approach: | They propose a framework to analyze steerability in language models by using hidden state and representation analysis. |
| Outcome: | The proposed framework reveals how steerability evolves over training . concepts become linearly separable as training progresses, the framework shows . |