NVIDIA BlueField-4
NVIDIA's fourth-generation **Data Processing Unit (DPU)**, announced in 2026 as the substrate for a new class of **AI-native storage infrastructure**. The BlueField-4 hosts storage-management software directly on the DPU itself — allowing data placement, context retrieval, and access policy enforcement to happen at the pod level rather than at the application or filesystem layer. In architectures like VAST's AI OS, the DPU becomes the enforcement point for placement, access, and validation, with zero-copy KV-cache streaming and elimination of "east-west" coordination traffic between storage and compute. The result is a **Tier 3.5 storage layer** sitting between Tier 3 local SSDs and Tier 4 cold S3 buckets — the **Inference Context Memory Storage (ICMS) / Context Memory eXtension (CMX)** tier.
Definition
NVIDIA's fourth-generation **Data Processing Unit (DPU)**, announced in 2026 as the substrate for a new class of **AI-native storage infrastructure**. The BlueField-4 hosts storage-management software directly on the DPU itself — allowing data placement, context retrieval, and access policy enforcement to happen at the pod level rather than at the application or filesystem layer. In architectures like VAST's AI OS, the DPU becomes the enforcement point for placement, access, and validation, with zero-copy KV-cache streaming and elimination of "east-west" coordination traffic between storage and compute. The result is a **Tier 3.5 storage layer** sitting between Tier 3 local SSDs and Tier 4 cold S3 buckets — the **Inference Context Memory Storage (ICMS) / Context Memory eXtension (CMX)** tier.
Standard SSDs and object stores have long-tail latencies unsuitable for real-time token generation. Traditional architectures put a CPU between GPU and storage; the BlueField-4 collapses that path by placing storage logic on the DPU, so the GPU and storage layer coordinate directly without CPU mediation. The strategic shift: storage becomes **inference-aware** — proactively prefetching token sequences and agentic state from S3-backed flash arrays before the GPU explicitly requests them.
ICMS / CMX tier deployments, zero-copy KV-cache streaming, inference-aware object placement, agentic-state caching at pod-locality, S3-RDMA acceleration for training-data loaders, sovereign AI infrastructure (DPU-enforced policy boundary).
Recent developments
BlueField-4 announced — 6× compute of BlueField-3, supports AI factories 4× larger. Combines NVIDIA Grace CPU + ConnectX-9 networking for 800 Gb/s throughput. Positioned as "the processor powering the operating system of AI factories." Per NVIDIA — BlueField-4: AI Factory Processor.
BlueField-4 STX storage architecture launched at GTC 2026 (March 16). Modular reference architecture for accelerated storage targeting the data-access bottleneck for agentic AI inference. STX delivers up to 5× token throughput, 4× energy efficiency, 2× page-ingestion speed vs CPU-based storage. Per Tom's Hardware — NVIDIA BlueField-4 STX for Agentic AI and SiliconANGLE — BlueField-4 STX Reference Architecture for AI Storage.
Partners ship STX systems in H2 2026; early availability via NVIDIA Vera Rubin platforms. BlueField-4 early-access deployments ride alongside NVIDIA's Vera Rubin platform rollout; partner systems (DDN, VAST, Cloudian, etc.) begin shipping STX in the second half of 2026. Per SDxCentral — Nvidia next-gen DPU for gigascale AI infrastructure.
DDN announced first AI-factory storage built on BlueField-4. DDN's launch positions BlueField-4 as the substrate for the next generation of AI-factory storage systems; the DPU is the enforcement point for placement + policy + access. Per DDN — DDN Powers Next-Gen AI Factories with NVIDIA BlueField-4.
Native DOCA microservices: multi-tenant networking + AI runtime security + cloud elasticity. DPU-resident microservices offload networking, storage, and security functions from CPUs — freeing host cycles for the workload while moving the policy boundary into hardware. Per TechBytes — NVIDIA BlueField-4 DPU: AI Infrastructure Security Analysis.
Powers CMX (Context Memory eXtension) platform. NVIDIA published the CMX (Context Memory Storage) reference for the next AI frontier — BlueField-4 hosts the context-memory storage substrate that sits between Tier 3 SSD + Tier 4 cold S3, with zero-copy KV-cache streaming. Per NVIDIA Technical Blog — BlueField-4-Powered CMX Context Memory Storage Platform.
WEKA NeuralMesh operationalizes shared KV cache over BlueField-4. WEKA's Augmented Memory Grid runs the storage data path on BlueField-4's STX processor over the 800 Gb/s scale-in network, claiming 320 GB/s read / 150 GB/s write and an effective ~1,000× extension of usable GPU KV-cache capacity — the "Inference Context Memory Storage" pattern (NVIDIA's own CMX naming is still settling). Vendor-published. Per WEKA — NeuralMesh on BlueField-4 and WEKA — demystifying BlueField-4 + ICMS. Sources: NVIDIA — BlueField-4: AI Factory Processor announcement · NVIDIA — BlueField-4-Powered CMX Platform · SiliconANGLE — BlueField-4 STX Reference Architecture · Tom's Hardware — BlueField-4 STX for Agentic AI · DDN — Next-Gen AI Factories with BlueField-4
Connections 10
Outbound 7
enables1accelerates1implements1solves1