Benchmark Evaluation

3 pages

How Lossless Is Lossless Speculative Decoding? The Role of Numerical Precision in Orthrus

Paper Is “Lossless” Speculative Decoding Really Lossless? — The Numerical-Precision Trap Exposed by Reproducing OrthrusTL;DR — …

September 16, 2026

Speculative Decoding Numerical Precision Quantization LLM Inference Efficient Inference Benchmark Evaluation

[Paper Review] Qwen 3 Technical Report

[Paper Review] Qwen 3 Technical Report

Paper Link Qwen 3: The Evolution of a Giant MoE Language Model with Adjustable Reasoning DepthTL;DR (in one line)Qwen 3 couples a …

Mixture of Experts Long Context Chain-of-Thought Benchmark Evaluation OpenSourceModel

[Paper Review] Peri-LN: Revisiting Normalization Layer in the Transformer Architecture

Paper Link Peri-LayerNorm: A Third Option Beyond Post-LN and Pre-LNTL;DRBy simply adding another LayerNorm right after the residual …

Large Language Models FP16 Training Empirical Evaluation Gradient Explosion Benchmark Evaluation