Executive Summary
On April 24, 2026, DeepSeek released V4, its fourth-generation large language model, representing a significant leap in efficient AI architecture design. The model introduces a hybrid attention mechanism combining Chunked Shared Attention (CSA) and Hash-based Chunked Attention (HCA), a novel Mixture-of-Experts configuration with 384 experts, and aggressive KV cache compression that enables 1 million token context windows on commodity hardware.
V4-Pro Parameters
1.6T
49B active
V4-Flash Parameters
284B
13B active
Context Window
1M
Pro + Flash
V4-Pro Price
$1.74
/M input · $6.94/M output
V4-Flash Price
$0.14
/M input · $0.55/M output
Release
Apr 24
Open weights · 2026
Key Innovations
CSA/HCA Hybrid Attention
mHC Residual Connection
Muon Optimizer
384 MoE Experts (6+1 active)
TileLang Kernel DSL
GRPO Post-Training
FP4 Quantization
Multi-Latent Attention (MLA)