DeepSeek 3FS
**Fire-Flyer File System** — DeepSeek's high-performance distributed file system purpose-built for AI training and inference, **open-sourced February 2025** at [github.com/deepseek-ai/3fs](https://github.com/deepseek-ai/3fs). Architecturally it's a kernel/userspace hybrid using **NVMe SSDs + RDMA** for the data plane, **CRAQ** (Chain Replication with Apportioned Queries) for strong consistency without a leader bottleneck, and **FoundationDB** for metadata. Published benchmarks: **6.6 TB/s aggregate read throughput** on a 180-node DeepSeek production cluster. Also supports a **KV cache mode** for inference, positioning the same substrate as a cost-effective alternative to DRAM caching for KV-store-heavy LLM serving.
Definition
**Fire-Flyer File System** — DeepSeek's high-performance distributed file system purpose-built for AI training and inference, **open-sourced February 2025** at [github.com/deepseek-ai/3fs](https://github.com/deepseek-ai/3fs). Architecturally it's a kernel/userspace hybrid using **NVMe SSDs + RDMA** for the data plane, **CRAQ** (Chain Replication with Apportioned Queries) for strong consistency without a leader bottleneck, and **FoundationDB** for metadata. Published benchmarks: **6.6 TB/s aggregate read throughput** on a 180-node DeepSeek production cluster. Also supports a **KV cache mode** for inference, positioning the same substrate as a cost-effective alternative to DRAM caching for KV-store-heavy LLM serving.
AWS S3 Files (April 2026) closed the POSIX gap for AWS, and JuiceFS does it self-hostable, but DeepSeek's training scale needed something tuned at the protocol layer for **GPU-direct + RDMA** — neither S3-compatible APIs nor traditional HDFS could keep up. 3FS is the storage half of the same vertical bet that produced DeepSeek-V3 + R1: the assumption that **storage architecture is now part of the LLM training problem**, not an independent layer.
Distributed file system for foundation-model training (datasets, checkpoints, activations), inference-side KV cache for memory-augmented serving, GPU-direct data pipelines requiring sustained TB/s aggregate throughput, AI substrate for clusters where S3-compatible APIs add latency the workload can't tolerate.
Recent developments
Cluster-wide 3FS saturates 400 Gbps storage NIC bandwidth — no internal DRAM cache. Per the arxiv paper Breaking the Storage Bandwidth Bottleneck in Agentic LLM Inference (arXiv:2602.21548v2), cluster-wide 3FS has no internal DRAM cache and can saturate the 400 Gbps storage NIC bandwidth under sustained AI-inference workloads. The paper compares 3FS as a storage backend for SGL(MC) and other agentic-inference frameworks; the headline finding is that 3FS's design (NVMe + RDMA, no DRAM hop, CRAQ for consistency) directly maps to what the inference path needs and can keep storage as a non-blocking resource even at extreme GPU concurrency.
Official benchmark detail beyond the headline 6.6 TB/s figure: a GraySort run moved 110.5 TiB in 30m14s (3.66 TiB/min), and KV-cache mode peaked at 40 GiB/s, on a cluster of 500+ clients / 180 storage nodes / dual 200Gbps InfiniBand per node / 16×14TiB NVMe per node. Per deepseek-ai/3fs (GitHub).
DeepSeek frames 3FS's cost/power case explicitly against NVIDIA DGX-A100: roughly 80% of DGX-A100 performance at about 50% of the price and 60% of the power draw (a second source puts it at ~83%/~60%/~60%) — and separately, 6.6 TB/s vs Ceph's 1.1 TB/s on the same workload. Per Yahoo — DeepSeek brings disruption to AI-optimized parallel file systems and DeepSeek's Open-Sourced Fire-Flyer (3FS). (tertiary)
An independent reality-check on the benchmarks finds the official numbers use only about half of the cluster's available device bandwidth (~6.6 TB/s average, ~8 TB/s peak, against theoretical device capacity) — worth noting as a counterweight to the headline throughput claims. Per A Reality Check on DeepSeek's Distributed File System Benchmarks. (tertiary, independent analysis)
3FS trades features for throughput: no data caching layer, and no encryption, compression, quotas, or snapshots — a direct architectural contrast with JuiceFS, which is already the site's
alternative_tocomparison. Per DeepSeek 3FS vs. JuiceFS. (tertiary) Sources: Breaking the Storage Bandwidth Bottleneck in Agentic LLM Inference (arXiv:2602.21548v2) · deepseek-ai/3fs (GitHub)
Connections 7
Outbound 6
scoped_to1alternative_to2solves1Inbound 1
accelerates1