Guide 29

Zero-Egress Architecture — Multi-Cloud Without the Bandwidth Tax

Problem Framing

Egress fees dominate storage TCO for high-bandwidth workloads: multi-cloud AI training, edge inference, CDN origins, and cross-region analytics. AWS charges $0.09/GB for data leaving S3, meaning a workload that reads 100 TB/month pays $9,000/month in egress alone — more than the storage cost. Zero-egress providers (Cloudflare R2, Backblaze B2) have demonstrated that eliminating transfer fees is architecturally viable without sacrificing eleven-nines durability, enabling active-active multi-cloud designs that were previously cost-prohibitive.

Relevant Nodes

  • Topics: S3, Object Storage
  • Technologies: Cloudflare R2, Backblaze B2
  • Architectures: Separation of Storage and Compute
  • Pain Points: Egress Cost, Vendor Lock-In, Zero-Egress Economics, Performance-per-Dollar, Request Pricing Models

Decision Path

  1. Audit current egress spend. Pull AWS Cost Explorer data filtered to S3 data transfer charges. Break down by bucket, prefix, and destination (internet, cross-region, CloudFront). Many organizations underestimate egress because it is buried in data transfer line items rather than storage line items.

  2. Identify egress-heavy workloads. Categorize workloads by egress volume:

    • CDN origins: Media, static assets, and software distribution generate sustained high-volume reads.
    • Multi-cloud analytics: Querying S3 data from non-AWS compute (GCP Dataproc, Azure Synapse) pays full egress.
    • AI training: Distributed training across regions or providers transfers training data repeatedly.
    • API-served data: Applications that serve S3-stored data directly to clients incur per-response egress.
  3. Evaluate R2 vs. B2 for your access patterns. Both eliminate egress fees but differ in request pricing and performance characteristics:

    • Cloudflare R2: zero egress, S3-compatible API, integrated with Cloudflare Workers and CDN. Higher per-request cost than S3. Best for CDN origin and edge-served workloads.
    • Backblaze B2: zero egress (to Cloudflare via Bandwidth Alliance), S3-compatible API, lower storage cost than S3 Standard. Best for archival, backup, and bulk read workloads.
    • Both lack S3 features like Object Lock Compliance Mode, S3 Select, and S3 Inventory. Evaluate feature requirements before migrating.
  4. Design read-routing architecture. Use a routing layer (DNS-based or application-level) that directs reads to the lowest-cost storage tier:

    • Hot reads from R2 or B2 (zero egress).
    • Write primary to AWS S3 (for durability and feature set).
    • Replicate asynchronously from S3 to R2/B2 using cross-cloud sync (rclone, or provider-native replication).
  5. Maintain primary durability on a hyperscaler. Zero-egress providers are cost-optimized but may not match AWS S3's operational maturity for critical data. Use S3 as the system of record and replicate to zero-egress tiers for read-heavy workloads. This preserves durability guarantees while eliminating egress costs for reads.

  6. Benchmark sustained throughput. Zero-egress providers may have different performance profiles than AWS S3 under sustained high-concurrency workloads. Test with your actual read patterns, object sizes, and concurrency levels.

    • R2 performance is tied to Cloudflare's edge network — latency varies by geographic location.
    • B2 throughput depends on datacenter proximity and connection type.
  7. Model total cost including API request fees. Zero-egress providers offset lost egress revenue with higher per-request pricing. For workloads with many small GETs (e.g., serving millions of small objects), request costs on R2 may exceed the egress savings. Build a cost model that includes storage, requests, and egress for each provider.

What Changed Over Time

  • AWS S3 egress pricing ($0.09/GB) was established when cloud storage was primarily used for backup and archival with infrequent reads. As workloads shifted to active analytics and AI, egress became the dominant cost component.
  • Cloudflare R2 (2022) launched with zero egress fees and full S3 API compatibility, forcing a market conversation about whether egress fees were technically justified.
  • Backblaze B2 partnered with Cloudflare via the Bandwidth Alliance, enabling zero-cost egress through the Cloudflare network.
  • AWS responded with selective egress reductions (free CloudFront-to-S3, free egress for the first 100 GB/month) but has not eliminated egress pricing.
  • The zero-egress market segment has proven commercially sustainable, validating the architectural premise that egress fees are a business model choice, not a technical requirement.

Sources