Papers by Nanhan Shen
The Illusion of Specialization: Unveiling the Domain-Invariant "Standing Committee" in Mixture-of-Experts Models (2026.acl-long)
Copied to clipboard
| Challenge: | Mixture of Experts models are widely assumed to achieve domain specialization through sparse routing. |
| Approach: | They propose a framework that analyzes routing behavior at the level of expert groups rather than individual experts. |
| Outcome: | The proposed framework analyzes routing behavior at the level of expert groups rather than individual experts. |