LLM Systems

All posts under category "LLM Systems"

1 posts total

Sorted by date

[Paper Review] Marconi: Prefix Caching for the Era of Hybrid LLMs

[Paper Review] Marconi: Prefix Caching for the Era of Hybrid LLMs

[Paper Review] Marconi: Prefix Caching for the Era of Hybrid LLMs

Paper Link Marconi: Rethinking Prefix Caching for the Hybrid LLM Era TL;DR Marconi introduces a prefix-caching framework for hybrid LLM …

October 08, 2025

2411.19379v3 Marconi Hybrid LLM Prefix Caching Inference Optimization FLOP-aware Scheduling SSM vLLM Serving Efficiency