Skip to content

Runtime Validation

Use runtime validation after infrastructure applies, backend migrations, and service rollouts.

Kyuubi

  • Run SELECT 1 through the target endpoint.
  • Run SHOW NAMESPACES IN lakehouse_<env>.
  • For cross-env access, run read-only counts against known smoke tables in remote catalogs.
  • For negative checks, verify unsupported remote writes fail at Lake Formation or S3.

Polaris And Snowflake

  • Confirm Polaris public catalog config returns unauthenticated HTTP 401.
  • Confirm Snowflake LH_GLUE_<ENV> and LH_POLARIS_<ENV> exist where expected.
  • Query an initialized Iceberg table through both Glue-direct and Polaris-backed Snowflake databases.
  • Check SYSTEM$CATALOG_LINK_STATUS when Snowflake table initialization is suspect.

Spark Query History

  • Ensure Kyuubi has produced at least one Spark event log.
  • Run or wait for the spark-cost-tracking aggregation job.
  • Check /api/health.
  • Check /queries?limit=5 and /costs?days=7.

Airflow 3

  • Confirm all Airflow deployments are ready.
  • Confirm ExternalSecrets are SecretSynced=True.
  • Check /api/v2/monitor/health.
  • Confirm git-sync expectations before merging DAG changes in external repositories.

Checked Against

  • implementations/2026-05-18-dl-419-stage-dataops-runtime-progress.md.
  • implementations/2026-05-21-dl-419-prod-dataops-runtime-progress.md.
  • implementations/2026-05-28-dl-474-iceberg-table-health-all-envs-progress.md.