Technology

DeepSeek 3FS

**Fire-Flyer File System** — DeepSeek's high-performance distributed file system purpose-built for AI training and inference, **open-sourced February 2025** at [github.com/deepseek-ai/3fs](https://github.com/deepseek-ai/3fs). Architecturally it's a kernel/userspace hybrid using **NVMe SSDs + RDMA** for the data plane, **CRAQ** (Chain Replication with Apportioned Queries) for strong consistency without a leader bottleneck, and **FoundationDB** for metadata. Published benchmarks: **6.6 TB/s aggregate read throughput** on a 180-node DeepSeek production cluster. Also supports a **KV cache mode** for inference, positioning the same substrate as a cost-effective alternative to DRAM caching for KV-store-heavy LLM serving.

7 connections 3 posts

Definition

What it is

**Fire-Flyer File System** — DeepSeek's high-performance distributed file system purpose-built for AI training and inference, **open-sourced February 2025** at [github.com/deepseek-ai/3fs](https://github.com/deepseek-ai/3fs). Architecturally it's a kernel/userspace hybrid using **NVMe SSDs + RDMA** for the data plane, **CRAQ** (Chain Replication with Apportioned Queries) for strong consistency without a leader bottleneck, and **FoundationDB** for metadata. Published benchmarks: **6.6 TB/s aggregate read throughput** on a 180-node DeepSeek production cluster. Also supports a **KV cache mode** for inference, positioning the same substrate as a cost-effective alternative to DRAM caching for KV-store-heavy LLM serving.

Why it exists

AWS S3 Files (April 2026) closed the POSIX gap for AWS, and JuiceFS does it self-hostable, but DeepSeek's training scale needed something tuned at the protocol layer for **GPU-direct + RDMA** — neither S3-compatible APIs nor traditional HDFS could keep up. 3FS is the storage half of the same vertical bet that produced DeepSeek-V3 + R1: the assumption that **storage architecture is now part of the LLM training problem**, not an independent layer.

Primary use cases

Distributed file system for foundation-model training (datasets, checkpoints, activations), inference-side KV cache for memory-augmented serving, GPU-direct data pipelines requiring sustained TB/s aggregate throughput, AI substrate for clusters where S3-compatible APIs add latency the workload can't tolerate.

Recent developments

Latest signals
  • Cluster-wide 3FS saturates 400 Gbps storage NIC bandwidth — no internal DRAM cache. Per the arxiv paper Breaking the Storage Bandwidth Bottleneck in Agentic LLM Inference (arXiv:2602.21548v2), cluster-wide 3FS has no internal DRAM cache and can saturate the 400 Gbps storage NIC bandwidth under sustained AI-inference workloads. The paper compares 3FS as a storage backend for SGL(MC) and other agentic-inference frameworks; the headline finding is that 3FS's design (NVMe + RDMA, no DRAM hop, CRAQ for consistency) directly maps to what the inference path needs and can keep storage as a non-blocking resource even at extreme GPU concurrency.

  • Official benchmark detail beyond the headline 6.6 TB/s figure: a GraySort run moved 110.5 TiB in 30m14s (3.66 TiB/min), and KV-cache mode peaked at 40 GiB/s, on a cluster of 500+ clients / 180 storage nodes / dual 200Gbps InfiniBand per node / 16×14TiB NVMe per node. Per deepseek-ai/3fs (GitHub).

  • DeepSeek frames 3FS's cost/power case explicitly against NVIDIA DGX-A100: roughly 80% of DGX-A100 performance at about 50% of the price and 60% of the power draw (a second source puts it at ~83%/~60%/~60%) — and separately, 6.6 TB/s vs Ceph's 1.1 TB/s on the same workload. Per Yahoo — DeepSeek brings disruption to AI-optimized parallel file systems and DeepSeek's Open-Sourced Fire-Flyer (3FS). (tertiary)

  • An independent reality-check on the benchmarks finds the official numbers use only about half of the cluster's available device bandwidth (~6.6 TB/s average, ~8 TB/s peak, against theoretical device capacity) — worth noting as a counterweight to the headline throughput claims. Per A Reality Check on DeepSeek's Distributed File System Benchmarks. (tertiary, independent analysis)

  • 3FS trades features for throughput: no data caching layer, and no encryption, compression, quotas, or snapshots — a direct architectural contrast with JuiceFS, which is already the site's alternative_to comparison. Per DeepSeek 3FS vs. JuiceFS. (tertiary) Sources: Breaking the Storage Bandwidth Bottleneck in Agentic LLM Inference (arXiv:2602.21548v2) · deepseek-ai/3fs (GitHub)

Connections 7

Outbound 6
Inbound 1

Featured in