Posts

All posts on technology, daily life, and thoughts.

74 pages

5 / 13

Kalman Delta Networks: Uncertainty-aware Associative Memory

Linear Attention Rewritten with a Kalman Filter: Kalman Delta NetworksTL;DRThe fixed-size recurrent memory update of linear attention is …

September 12, 2026

KV Cache Long Context Efficient Inference SSM Attention Optimization Kalman Filter

X-AuT: Progressive Audio-Encoder Compression for Speech LLMs with Cross-Scale Distillation

Paper X-AuT: Pruning Audio Encoders in Speech LLMs with Behavioral Probes and Cross-Scale DistillationTL;DRX-AuT is a framework that …

September 12, 2026

Efficient Inference Large Language Models Transformer Machine Learning Knowledge Distillation Model Compression

Deadline-Aware Adaptive Prefill Chunking for Efficient Large Language Model Serving

Paper Deadline-Filling Prefill Chunks: SLOWeave — An Adaptive Chunking Scheduler for LLM Serving TL;DR — Instead of a fixed prefill chunk …

September 11, 2026

LLM Inference KV Cache Long Context Inference Acceleration Efficient Inference Transformer

Why Is Video Still So Expensive? A Survey of Inference-Efficiency Mechanisms in Video and Audiovisual LLMs

Paper Why Are Video LLMs Still So Expensive? — A Four-Stage Guide to Inference Efficiency MechanismsTL;DR — This paper classifies 125 …

September 11, 2026

Long Context KV Cache Multimodal Learning Vision-Language Model Efficient Inference Large Language Models

Miles v0.1: Production-Level Post-Training

Paper Miles v0.1: A “verified, clean, and scalable” full-stack system for frontier RL post-trainingTL;DR: Miles is a full-stack …

September 10, 2026

Reinforcement Learning Efficient Training Distributed Computing Mixture of Experts Quantization Large Language Models

Online Draft Co-Training for Speculative Decoding in Large-Scale, Long-Context RL Post-Training

Paper Two Designs That Make Speculative Decoding Practical for Large-Scale, Long-Context RL Post-TrainingTL;DR : Rollout generation …

September 10, 2026

Speculative Decoding Long Context Reinforcement Learning Distributed Computing Efficient Training Inference Acceleration