Architecture

Catalog-Centric Control Plane

The pattern where the table catalog — not any single engine — becomes the lakehouse control surface, owning credential vending, authorization/policy, federation, scan planning, and agent access via MCP.

9 connections 4 resources 1 post

Summary

What it is

The pattern where the table catalog — not any single engine — becomes the lakehouse control surface, owning credential vending, authorization/policy, federation, scan planning, and agent access via MCP.

Where it fits

The 2026 convergence point for Apache Polaris, Unity Catalog, and Apache Gravitino. When many engines and AI agents share the same Iceberg tables, governance moves out of the engine and into the catalog so one boundary scopes both human and agent access.

Misconceptions / Traps
  • "Control plane" is not a product — it's the role the catalog grows into. Different catalogs implement different slices (Polaris: pluggable authz + Ranger; Gravitino: scan-planning offload; UC: managed MCP servers).
  • Agent access through MCP is governed by the catalog boundary only if you wire agents through the managed MCP server, not around it.
Key Connections
  • implements Iceberg REST Catalog Spec — the substrate the control plane is built on
  • augments Model Context Protocol (MCP) — the agent-facing access path
  • solves Vendor Lock-In, Tool Discovery Governance Gap — neutral governance for engines and agents

Definition

What it is

An architectural pattern in which the table catalog — not any single query engine — becomes the control surface of the lakehouse. The catalog absorbs responsibilities that used to live in engines or side systems: short-lived credential vending, authorization and policy enforcement, cross-vendor federation, scan/query planning, and — increasingly — agent access via the Model Context Protocol.

Why it exists

When Spark, Trino, DuckDB, Snowflake, ClickHouse, and a fleet of AI agents all read and write the same Iceberg tables on object storage, governance cannot live inside any one engine. Centralizing it in the catalog gives a single, vendor-neutral place to mint credentials, enforce row/column policy, and grant or deny access — to both humans and agents — regardless of which engine or model is asking.

Primary use cases

Multi-engine lakehouse governance, short-lived credential vending in place of long-lived keys, cross-catalog / cross-cloud federation, engine-side scan-planning offload, scoping AI-agent access to governed data through MCP.

Recent developments

Latest signals

Connections 9

Outbound 6
Inbound 3

Resources 4

Featured in