Architecture

Medallion Architecture

A layered data quality pattern — Bronze (raw), Silver (cleansed), Gold (business-ready) — with each layer stored on object storage.

8 connections 3 resources

Summary

What it is

A layered data quality pattern — Bronze (raw), Silver (cleansed), Gold (business-ready) — with each layer stored on object storage.

Where it fits

Medallion is the most widely adopted data quality pattern within lakehouses. It organizes S3 data into progressive quality tiers, giving each tier a clear contract and making it safe for different consumers to read at different quality levels.

Misconceptions / Traps
  • Three layers is a convention, not a rule. Some organizations use two layers; others add more. The pattern is about progressive refinement, not a fixed number of tiers.
  • Medallion does not solve the small files problem — it can worsen it. Each layer transformation may produce many small output files, especially with streaming Silver→Gold pipelines.
Key Connections
  • is_a Lakehouse Architecture — a specialization of the lakehouse pattern
  • constrained_by Legacy Ingestion Bottlenecks, Small Files Problem
  • AWS S3 used_by Medallion Architecture — each layer resides on S3
  • Apache Spark, Apache Flink used_by Medallion Architecture — compute engines for tier transformations
  • scoped_to Lakehouse, Data Lake

Definition

What it is

A layered data quality pattern that organizes data into three tiers — Bronze (raw), Silver (cleansed/conformed), Gold (aggregated/business-ready) — with each layer stored on object storage.

Why it exists

Raw data arriving in S3 is messy, inconsistent, and not query-ready. The Medallion pattern provides a structured progression from raw ingestion to business-quality data, with clear contracts at each tier.

Primary use cases

Data lake quality management, incremental data refinement, separation of raw ingestion from analytics-ready data.

Connections 8

Outbound 5
scoped_to2
LakehouseData Lake
is_a1
Lakehouse Architecture
constrained_by2
Legacy Ingestion BottlenecksSmall Files Problem
Inbound 3
used_by3
AWS S3Apache SparkApache Flink

Resources 3

DocsHigh
www.databricks.com/glossary/medallion-architecture

Databricks' official glossary definition of the bronze/silver/gold data quality layering pattern they popularized.

DocsHigh
learn.microsoft.com/en-us/azure/databricks/lakehouse/medalli...

Microsoft's Azure Databricks documentation explaining the medallion lakehouse architecture and its multi-hop data refinement approach.

DocsHigh
learn.microsoft.com/en-us/fabric/onelake/onelake-medallion-l...

Microsoft Fabric's official guidance on implementing medallion architecture in OneLake, showing cross-platform adoption of the pattern.