All posts on technology, daily life, and thoughts.
![[Paper Review] Transformers are SSMs: Generalized Models and Efficient Algorithms Through Structured State Space Duality](https://icml.cc/media/PosterPDFs/ICML%202024/32613.png)
Paper Link Structured State Space Duality: Unifying SSMs and Attention with Mamba-2 for 2–8× AccelerationTL;DRStructured State-Space Duality …
![[Paper Review] Inference-Time Hyper-Scaling with KV Cache Compression](https://cdn-thumbnails.huggingface.co/social-thumbnails/papers/2506.05345/gradient.png)
Link to Paper Dynamic Memory Sparsification (DMS): Making LLM Hyper-Scaling a Reality with 8× KV Cache CompressionOne-Line Summary …
![[Paper Review] Llama-Nemotron: Efficient Reasoning Models](https://cdn-thumbnails.huggingface.co/social-thumbnails/collections/nvidia/llama-nemotron-67d92346030a2691293f200b.png)
Paper Link Hydragen: The Secret Weapon for Decoding Large Batches with Shared Prefixes up to 32× FasterTL;DRBy decomposing the prefix and …
![[Paper Review] KIMI K2: OPEN AGENTIC INTELLIGENCE](https://github.com/MoonshotAI/Kimi-K2/raw/main/figures/kimi-logo.png){kind=logo}
Paper Link Kimi K2: An Open-Source LLM’s Leap Toward Agentic IntelligenceTL;DRWith a 3-stage pipeline consisting of MuonClip pretraining + …
Paper Link Qwen 3: The Evolution of a Giant MoE Language Model with Adjustable Reasoning DepthTL;DR (in one line)Qwen 3 couples a …
In a previous post, “Is K-Beauty at a Crossroads for a New Leap?,” I discussed the paradigm shift and new opportunities facing …