Skip to content

Existing Docs

Root-level docs/*.md and docs/*.html files remain in the repository during the Starlight transition. Use the Starlight pages first for the current env-dataops operating model; use the older docs below as deeper reference material after checking their freshness notes.

FileUse ForFreshness Note
data-platform-auth-and-data-flow.htmlvisual auth, data, and deployment flowsUseful, but this Starlight site now has the current narrative entry points.
kyuubi-clusters.mdKyuubi warehouse tuning and cost attribution contextContains legacy test-dataops-era URLs; verify with terraform/kyuubi/env/<env>.
polaris-catalog-architecture.mdPolaris architecture backgroundContains older test-dataops examples; verify with terraform/polaris/env/<env>.
spark-cost-tracking.mdcost tables and attribution modelStill useful; verify current env coverage against terraform/kyuubi/env/<env>.
iceberg-monitoring-architecture.mdIceberg table health monitoringStill useful; all env enablement is recorded under DL-474.
snowflake-catalog-integration.mdSnowflake Glue and Polaris catalog detailsUseful, but naming examples may predate LH_GLUE_<ENV> and LH_POLARIS_<ENV>.
snowpack-pyiceberg-health.mdSnowpack health integrationCross-repo behavior; check Snowpack before making changes.
Deployment-Docs.mdolder deployment notesTreat as legacy until checked against current workflows.
quickstart.mdolder quickstart notesTreat as legacy until checked against current workflows.
runbook.mdoperational snippetsUseful, but verify account and host names before use.
mwaa-iam-role-deployment.mdMWAA role deploymentSeparate from env-dataops EKS runtime services.
README_S3_RENAMING.mdS3 rename notesHistorical reference.

Freshness Rule

When an older doc disagrees with current code, prefer the current code, then the newest implementation record. Later implementation records can intentionally override earlier design docs.

Checked Against

  • Root-level docs/ inventory on origin/main.
  • implementations/2026-05-26-dl-388-terraform-cutover-progress.md.
  • implementations/2026-05-28-dl-474-iceberg-table-health-all-envs-progress.md.