NIXL (NVIDIA Inference Transfer Library)

NVIDIA's library coordinating the highly orchestrated data movement between storage tiers, GPUs, and inference engines. NIXL provides the runtime-level glue that connects GPU-resident KV-cache pools to S3-backed durable storage and to peer GPUs across the cluster fabric. Designed to work with NVIDIA's GPUDirect Storage (GDS), cuObject for S3 transfers, and the BlueField-4 DPU substrate — NIXL is the software layer that makes inference-aware data movement an automatic property rather than a per-application engineering effort.

Modern inference at scale requires data movement that's deeply choreographed — KV-cache fragments need to migrate between GPUs as decode load shifts, agent state needs to spill from GPU to CXL to NVMe to S3 as context windows grow, and the inference engine needs to make these decisions in microseconds. NIXL formalizes the choreography so each inference engine doesn't have to reinvent it.

Inference-engine-to-storage coordination, automatic KV-cache spilling across tiers, GPU-to-GPU KV-cache transfer for disaggregated serving, S3-RDMA-accelerated training-data loading, coordinated agentic-state checkpointing across the inference stack.