Technology

Unity Catalog

An open-source, multi-format data catalog by Databricks (Linux Foundation), supporting Iceberg, Delta Lake, Hudi, and unstructured data with built-in access control and lineage.

7 connections 3 resources

Summary

What it is

An open-source, multi-format data catalog by Databricks (Linux Foundation), supporting Iceberg, Delta Lake, Hudi, and unstructured data with built-in access control and lineage.

Where it fits

Unity Catalog bridges the Databricks ecosystem with the broader open lakehouse world. For organizations with significant Delta Lake investments that also need Iceberg interoperability, Unity provides a single catalog that spans both formats without requiring XTable or UniForm.

Misconceptions / Traps
  • Open-source Unity Catalog is not identical to the managed Databricks Unity Catalog. Feature parity varies; some governance features are Databricks-only.
  • Multi-format support does not mean seamless interoperability. Each format still has its own metadata semantics; Unity provides unified access, not automatic translation.
Key Connections
  • implements Iceberg REST Catalog Spec — standard REST API for engine-neutral access
  • enables Delta Lake, Apache Iceberg — multi-format catalog support
  • solves Vendor Lock-In — open alternative to proprietary Databricks catalog

Definition

What it is

An open-source, multi-format data catalog originally developed by Databricks and donated to the Linux Foundation. Supports Iceberg, Delta Lake, Hudi, and unstructured data with built-in access control and lineage.

Why it exists

The lakehouse ecosystem needs a catalog that is not tied to a single table format or vendor. Unity Catalog provides a unified governance layer for Delta Lake users who also need Iceberg interoperability, and for organizations standardizing on open catalog APIs.

Primary use cases

Multi-format catalog for Delta and Iceberg tables on S3, unified access control across storage and compute, data lineage tracking.

Connections 7

Outbound 6
Inbound 1

Resources 3