Skip to content
Data Platform Infrastructure

What This Repo Owns

data-platform-core-infra owns the Terraform, FSD, Kubernetes, IAM, Lake Formation, and observability infrastructure used by Data Platform services.

Owns

  • Data Platform EKS cluster definitions managed by FSD.
  • Environment dataops account-level Terraform roots.
  • Lakehouse S3, Glue, Lake Formation, and Snowflake integration infrastructure.
  • Kyuubi, Polaris, Airflow 3, Spark Query History, StarRocks, ClickHouse, and related service infrastructure.
  • Grafana dashboard JSON and sync helpers that live in this repository.
  • CI/CD workflows for applying this repository’s Terraform and FSD roots.

Does Not Own

  • Application code in Snowpack, Lakehouse, or Data Lineage repositories.
  • DevOps-owned FSD internals and shared platform conventions.
  • Grafana server deployment and global Grafana IAM source role management.
  • Snowflake account administration outside the catalog integrations and databases declared here.

Checked Against

  • origin/main repository layout.
  • docs/superpowers/specs/2026-06-01-data-platform-docs-site-design.md.
  • Later implementation records under implementations/ for DL-388, DL-419, and DL-474.