Cache-Aware Joint Router Adaptation for Memory-Efficient MoE Inference
Paper Cache-Learning Routers: Cache-Aware Joint Router Adaptation for Memory-Constrained MoE InferenceTL;DRStarting from the observation …
20 min
2609.04895v1
With-Muse-Spark-1-3-Contributor-Free
1 page