Cache-Aware Joint Router Adaptation for Memory-Efficient MoE Inference
Paper Cache-Learning Routers: Cache-Aware Joint Router Adaptation for Memory-Constrained MoE InferenceTL;DRStarting from the observation …
20 min
2609.04895v1
2609.04895v1
1 page