Runtime Validation
Use runtime validation after infrastructure applies, backend migrations, and service rollouts.
Kyuubi
- Run
SELECT 1through the target endpoint. - Run
SHOW NAMESPACES IN lakehouse_<env>. - For cross-env access, run read-only counts against known smoke tables in remote catalogs.
- For negative checks, verify unsupported remote writes fail at Lake Formation or S3.
Polaris And Snowflake
- Confirm Polaris public catalog config returns unauthenticated HTTP
401. - Confirm Snowflake
LH_GLUE_<ENV>andLH_POLARIS_<ENV>exist where expected. - Query an initialized Iceberg table through both Glue-direct and Polaris-backed Snowflake databases.
- Check
SYSTEM$CATALOG_LINK_STATUSwhen Snowflake table initialization is suspect.
Spark Query History
- Ensure Kyuubi has produced at least one Spark event log.
- Run or wait for the spark-cost-tracking aggregation job.
- Check
/api/health. - Check
/queries?limit=5and/costs?days=7.
Airflow 3
- Confirm all Airflow deployments are ready.
- Confirm ExternalSecrets are
SecretSynced=True. - Check
/api/v2/monitor/health. - Confirm git-sync expectations before merging DAG changes in external repositories.
Checked Against
implementations/2026-05-18-dl-419-stage-dataops-runtime-progress.md.implementations/2026-05-21-dl-419-prod-dataops-runtime-progress.md.implementations/2026-05-28-dl-474-iceberg-table-health-all-envs-progress.md.