Validate required/unit-constrained UC fields early in bundle validate by radakam · Pull Request #5818 · databricks/cli

radakam · 2026-07-03T10:56:48Z

Changes

bundle validate (and therefore plan/deploy) now reports two UC fields that the SDK models as optional but the backend treats differently:

sql_warehouses.*.name — error sql_warehouse name is required (backend-confirmed as required; whitespace-only names are also rejected, matching the backend's name.trim.nonEmpty).
grants[*].principal — warning grant principal is required, on every securable that supports grants (catalogs, schemas, volumes, external_locations, registered_models, vector_search_indexes). Kept as a warning since the backend contract is unconfirmed.

Implemented in the existing validate:required mutator (runs in phases.Initialize(), covering validate/plan/deploy), following the existing dashboard bespoke-validation precedent. Validation diagnostics are sorted deterministically so multiple messages have stable ordering.

Why

These fields are modeled as loosely-typed/optional (json:"...,omitempty"), so bundle validate and bundle plan pass while the deploy is rejected by the backend with late, low-context 400s. Discovered via fuzz testing; affects both the Terraform and direct engines. Reporting the offending field by name at validate time is much more actionable.

Tests

New acceptance tests under acceptance/bundle/validate/:
- sql_warehouse_required_name/ (both engines; covers a missing name and a whitespace-only name)
- grants_required_principal/ (verifies a missing principal warns while a valid grant passes)
Refreshed the empty_resources golden files that surface the sql_warehouse name is required error.

eng-dev-ecosystem-bot · 2026-07-03T11:17:59Z

Integration test report

Commit: 1ed565c

Run: 29480720282

	Env	🔄flaky	💚RECOVERED	🙈SKIP	✅pass	🙈skip	Time
💚	aws linux		4	4	227	1105	4:42
🔄	aws windows	2	4	4	227	1103	10:36
💚	aws-ucws linux		4	4	316	1021	5:32
💚	aws-ucws windows		4	4	318	1019	7:33
💚	azure linux		4	4	227	1104	4:36
🔄	azure windows	2	2	4	229	1102	7:58
💚	azure-ucws linux		4	4	318	1018	5:52
💚	azure-ucws windows		4	4	320	1016	7:43
💚	gcp linux		4	4	226	1106	4:36
💚	gcp windows		4	4	228	1104	6:56

10 interesting tests: 4 SKIP, 4 flaky, 2 RECOVERED

	Test Name	aws linux	aws windows	aws-ucws linux	aws-ucws windows	azure linux	azure windows	azure-ucws linux	azure-ucws windows	gcp linux	gcp windows
💚	TestAccept	💚R	💚R	💚R	💚R	💚R	💚R	💚R	💚R	💚R	💚R
🙈	TestAccept/bundle/invariant/no_drift	🙈S	🙈S	🙈S	🙈S	🙈S	🙈S	🙈S	🙈S	🙈S	🙈S
🙈	TestAccept/bundle/resources/vector_search_endpoints/drift/recreated_same_name	🙈S	🙈S	🙈S	🙈S	🙈S	🙈S	🙈S	🙈S	🙈S	🙈S
🙈	TestAccept/bundle/resources/vector_search_indexes/recreate/embedding_dimension	🙈S	🙈S	🙈S	🙈S	🙈S	🙈S	🙈S	🙈S	🙈S	🙈S
🔄	TestAccept/selftest/record_cloud/pipeline-crud/DATABRICKS_BUNDLE_ENGINE=direct	✅p	🔄f	✅p	✅p	✅p	✅p	✅p	✅p	✅p	✅p
🔄	TestAccept/selftest/record_cloud/pipeline-crud/DATABRICKS_BUNDLE_ENGINE=terraform	✅p	🔄f	✅p	✅p	✅p	✅p	✅p	✅p	✅p	✅p
🙈	TestAccept/ssh/connection	🙈S	🙈S	🙈S	🙈S	🙈S	🙈S	🙈S	🙈S	🙈S	🙈S
💚	TestFetchRepositoryInfoAPI_FromRepo	💚R	💚R	💚R	💚R	💚R	💚R	💚R	💚R	💚R	💚R
🔄	TestFetchRepositoryInfoAPI_FromRepo/root	💚R	💚R	💚R	💚R	💚R	🔄f	💚R	💚R	💚R	💚R
🔄	TestFetchRepositoryInfoAPI_FromRepo/subdir	💚R	💚R	💚R	💚R	💚R	🔄f	💚R	💚R	💚R	💚R

Top 9 slowest tests (at least 2 minutes):

duration	env	testname
6:30	gcp windows	TestAccept
6:26	aws-ucws windows	TestAccept
6:24	azure-ucws windows	TestAccept
6:16	azure windows	TestAccept
3:02	aws linux	TestAccept
2:58	azure linux	TestAccept
2:55	gcp linux	TestAccept
2:53	aws-ucws linux	TestAccept
2:47	azure-ucws linux	TestAccept

Reject missing sql_warehouse name, missing grant principal, and out-of-range catalog/schema custom_max_retention_hours at validate/plan time instead of letting them pass and fail later at deploy with low-context backend errors. DECO-27550

The retention range (0 or 168-720 hours) is a backend policy value that could change server-side; hardcoding it in the CLI risks rejecting configs the backend would accept. Keep only the stable presence checks (sql_warehouse name, grant principal).

Iterate b.Config.Resources.SqlWarehouses directly instead of dyn, matching the adjacent dashboards validation. Addresses review feedback.

Iterate the six grant-bearing resource types directly instead of dyn, and drop the now-unused isMissingOrEmptyString helper. Addresses review feedback.

…retention-units

shreyas-goenka

Looks good to me. Just one minor comment.

Revert the static per-resource-type grant principal validation back to the dyn-based walk over resources.*.*.grants[*], so any resource with a grants field is validated without enumerating types. Rename warnForMissingBackendFields to warnForMissingGrantPrincipals for clarity.

eng-dev-ecosystem-bot · 2026-07-16T10:44:14Z

Integration test report

Commit: c8c397f

Run: 29483946832

	Env	❌FAIL	🟨KNOWN	🔄flaky	💚RECOVERED	🙈SKIP	✅pass	🙈skip	Time
❌	aws linux	6	1	2	3	4	518	1034	45:37
❌	aws windows	6	1	2	3	4	475	1047	66:16
🔄	aws-ucws linux			4	6	2	999	843	99:53
💚	aws-ucws windows				6	2	945	861	114:48
💚	azure linux				4	4	520	1035	39:05
🔄	azure windows			3	3	4	475	1048	52:02
❌	azure-ucws linux	47	2		4	2	851	878	101:36
❌	azure-ucws windows	25	1		5	2	815	896	109:03
💚	gcp linux				4	4	511	1040	43:43
❌	gcp windows	26	1		3	4	447	1048	56:29

114 interesting tests: 100 FAIL, 6 flaky, 4 RECOVERED, 2 KNOWN, 2 SKIP

	Test Name	aws linux	aws windows	aws-ucws linux	aws-ucws windows	azure linux	azure windows	azure-ucws linux	azure-ucws windows	gcp linux	gcp windows
🟨	TestAccept	🟨K	🟨K	💚R	💚R	💚R	🔄f	🟨K	🟨K	💚R	🟨K
❌	TestAccept/bundle/deployment/bind/job/generate-and-bind	✅p	✅p	✅p	✅p	✅p	✅p	✅p	✅p	✅p	❌F
❌	TestAccept/bundle/deployment/bind/job/generate-and-bind/DATABRICKS_BUNDLE_ENGINE=direct	✅p	✅p	✅p	✅p	✅p	✅p	✅p	✅p	✅p	❌F
❌	TestAccept/bundle/deployment/bind/job/generate-and-bind/DATABRICKS_BUNDLE_ENGINE=terraform	✅p	✅p	✅p	✅p	✅p	✅p	✅p	✅p	✅p	❌F
❌	TestAccept/bundle/deployment/bind/job/job-abort-bind	✅p	✅p	✅p	✅p	✅p	✅p	✅p	✅p	✅p	❌F
❌	TestAccept/bundle/deployment/bind/job/job-abort-bind/DATABRICKS_BUNDLE_ENGINE=direct	✅p	✅p	✅p	✅p	✅p	✅p	✅p	✅p	✅p	❌F
❌	TestAccept/bundle/deployment/bind/job/job-abort-bind/DATABRICKS_BUNDLE_ENGINE=terraform	✅p	✅p	✅p	✅p	✅p	✅p	✅p	✅p	✅p	❌F
❌	TestAccept/bundle/deployment/bind/job/job-spark-python-task	✅p	✅p	✅p	✅p	✅p	✅p	✅p	✅p	✅p	❌F
❌	TestAccept/bundle/deployment/bind/job/job-spark-python-task/DATABRICKS_BUNDLE_ENGINE=direct	✅p	✅p	✅p	✅p	✅p	✅p	✅p	✅p	✅p	❌F
❌	TestAccept/bundle/deployment/bind/job/job-spark-python-task/DATABRICKS_BUNDLE_ENGINE=terraform	✅p	✅p	✅p	✅p	✅p	✅p	✅p	✅p	✅p	❌F
🔄	TestAccept/bundle/deployment/bind/registered-model	🙈s	🙈s	🔄f	✅p	🙈s	🙈s	✅p	✅p	🙈s	🙈s
🔄	TestAccept/bundle/deployment/bind/registered-model/DATABRICKS_BUNDLE_ENGINE=terraform			🔄f	✅p			✅p	✅p
🔄	TestAccept/bundle/deployment/bind/schema	🙈s	🙈s	🔄f	✅p	🙈s	🙈s	✅p	✅p	🙈s	🙈s
🔄	TestAccept/bundle/deployment/bind/schema/DATABRICKS_BUNDLE_ENGINE=terraform			🔄f	✅p			✅p	✅p
🟨	TestAccept/bundle/invariant/no_drift	🙈S	🙈S	💚R	💚R	🙈S	🙈S	🟨K	💚R	🙈S	🙈S
❌	TestAccept/bundle/invariant/no_drift/DATABRICKS_BUNDLE_ENGINE=direct/INPUT_CONFIG=app.yml.tmpl/READPLAN=			✅p	✅p			❌F	✅p
❌	TestAccept/bundle/invariant/no_drift/DATABRICKS_BUNDLE_ENGINE=direct/INPUT_CONFIG=job_with_task.yml.tmpl/READPLAN=			✅p	✅p			❌F	✅p
❌	TestAccept/bundle/invariant/no_drift/DATABRICKS_BUNDLE_ENGINE=direct/INPUT_CONFIG=pipeline.yml.tmpl/READPLAN=			✅p	✅p			❌F	✅p
❌	TestAccept/bundle/invariant/no_drift/DATABRICKS_BUNDLE_ENGINE=direct/INPUT_CONFIG=pipeline.yml.tmpl/READPLAN=1			✅p	✅p			❌F	✅p
❌	TestAccept/bundle/invariant/no_drift/DATABRICKS_BUNDLE_ENGINE=direct/INPUT_CONFIG=pipeline_apply_policy_default_values.yml.tmpl/READPLAN=			✅p	✅p			❌F	✅p
❌	TestAccept/bundle/invariant/no_drift/DATABRICKS_BUNDLE_ENGINE=direct/INPUT_CONFIG=pipeline_apply_policy_default_values.yml.tmpl/READPLAN=1			✅p	✅p			❌F	✅p
❌	TestAccept/bundle/invariant/no_drift/DATABRICKS_BUNDLE_ENGINE=direct/INPUT_CONFIG=pipeline_config_dots.yml.tmpl/READPLAN=			✅p	✅p			❌F	✅p
❌	TestAccept/bundle/invariant/no_drift/DATABRICKS_BUNDLE_ENGINE=direct/INPUT_CONFIG=pipeline_config_dots.yml.tmpl/READPLAN=1			✅p	✅p			❌F	✅p
❌	TestAccept/bundle/invariant/no_drift/DATABRICKS_BUNDLE_ENGINE=direct/INPUT_CONFIG=registered_model.yml.tmpl/READPLAN=			✅p	✅p			❌F	✅p
❌	TestAccept/bundle/invariant/no_drift/DATABRICKS_BUNDLE_ENGINE=direct/INPUT_CONFIG=registered_model.yml.tmpl/READPLAN=1			✅p	✅p			❌F	✅p
❌	TestAccept/bundle/invariant/no_drift/DATABRICKS_BUNDLE_ENGINE=direct/INPUT_CONFIG=schema.yml.tmpl/READPLAN=			✅p	✅p			❌F	✅p
❌	TestAccept/bundle/invariant/no_drift/DATABRICKS_BUNDLE_ENGINE=direct/INPUT_CONFIG=schema.yml.tmpl/READPLAN=1			✅p	✅p			❌F	✅p
❌	TestAccept/bundle/invariant/no_drift/DATABRICKS_BUNDLE_ENGINE=direct/INPUT_CONFIG=schema_grant_ref.yml.tmpl/READPLAN=			✅p	✅p			❌F	✅p
❌	TestAccept/bundle/invariant/no_drift/DATABRICKS_BUNDLE_ENGINE=direct/INPUT_CONFIG=schema_grant_ref.yml.tmpl/READPLAN=1			✅p	✅p			❌F	✅p
❌	TestAccept/bundle/invariant/no_drift/DATABRICKS_BUNDLE_ENGINE=direct/INPUT_CONFIG=schema_uppercase_name.yml.tmpl/READPLAN=			✅p	✅p			❌F	✅p
❌	TestAccept/bundle/invariant/no_drift/DATABRICKS_BUNDLE_ENGINE=direct/INPUT_CONFIG=schema_uppercase_name.yml.tmpl/READPLAN=1			✅p	✅p			❌F	✅p
❌	TestAccept/bundle/invariant/no_drift/DATABRICKS_BUNDLE_ENGINE=direct/INPUT_CONFIG=secret_scope.yml.tmpl/READPLAN=			✅p	✅p			❌F	✅p
❌	TestAccept/bundle/invariant/no_drift/DATABRICKS_BUNDLE_ENGINE=direct/INPUT_CONFIG=secret_scope.yml.tmpl/READPLAN=1			✅p	✅p			❌F	✅p
❌	TestAccept/bundle/invariant/no_drift/DATABRICKS_BUNDLE_ENGINE=direct/INPUT_CONFIG=secret_scope_default_backend_type.yml.tmpl/READPLAN=			✅p	✅p			❌F	✅p
❌	TestAccept/bundle/invariant/no_drift/DATABRICKS_BUNDLE_ENGINE=direct/INPUT_CONFIG=secret_scope_default_backend_type.yml.tmpl/READPLAN=1			✅p	✅p			❌F	✅p
❌	TestAccept/bundle/invariant/no_drift/DATABRICKS_BUNDLE_ENGINE=direct/INPUT_CONFIG=sql_warehouse.yml.tmpl/READPLAN=			✅p	✅p			❌F	✅p
❌	TestAccept/bundle/invariant/no_drift/DATABRICKS_BUNDLE_ENGINE=direct/INPUT_CONFIG=sql_warehouse.yml.tmpl/READPLAN=1			✅p	✅p			❌F	✅p
❌	TestAccept/bundle/invariant/no_drift/DATABRICKS_BUNDLE_ENGINE=direct/INPUT_CONFIG=synced_database_table.yml.tmpl/READPLAN=			✅p	✅p			❌F	✅p
❌	TestAccept/bundle/invariant/no_drift/DATABRICKS_BUNDLE_ENGINE=direct/INPUT_CONFIG=synced_database_table.yml.tmpl/READPLAN=1			✅p	✅p			❌F	✅p
❌	TestAccept/bundle/invariant/no_drift/DATABRICKS_BUNDLE_ENGINE=direct/INPUT_CONFIG=vector_search_endpoint.yml.tmpl/READPLAN=			✅p	✅p			❌F	✅p
❌	TestAccept/bundle/invariant/no_drift/DATABRICKS_BUNDLE_ENGINE=direct/INPUT_CONFIG=vector_search_endpoint.yml.tmpl/READPLAN=1			✅p	✅p			❌F	✅p
❌	TestAccept/bundle/invariant/no_drift/DATABRICKS_BUNDLE_ENGINE=direct/INPUT_CONFIG=volume.yml.tmpl/READPLAN=			✅p	✅p			❌F	✅p
❌	TestAccept/bundle/invariant/no_drift/DATABRICKS_BUNDLE_ENGINE=direct/INPUT_CONFIG=volume.yml.tmpl/READPLAN=1			✅p	✅p			❌F	✅p
❌	TestAccept/bundle/invariant/no_drift/DATABRICKS_BUNDLE_ENGINE=direct/INPUT_CONFIG=volume_path_job_ref.yml.tmpl/READPLAN=			✅p	✅p			❌F	✅p
❌	TestAccept/bundle/invariant/no_drift/DATABRICKS_BUNDLE_ENGINE=direct/INPUT_CONFIG=volume_path_job_ref.yml.tmpl/READPLAN=1			✅p	✅p			❌F	✅p
❌	TestAccept/bundle/invariant/no_drift/DATABRICKS_BUNDLE_ENGINE=direct/INPUT_CONFIG=volume_uppercase_name.yml.tmpl/READPLAN=			✅p	✅p			❌F	✅p
❌	TestAccept/bundle/invariant/no_drift/DATABRICKS_BUNDLE_ENGINE=direct/INPUT_CONFIG=volume_uppercase_name.yml.tmpl/READPLAN=1			✅p	✅p			❌F	✅p
❌	TestAccept/bundle/local_state_staleness	✅p	✅p	✅p	✅p	✅p	✅p	❌F	✅p	✅p	✅p
❌	TestAccept/bundle/local_state_staleness/DATABRICKS_BUNDLE_ENGINE=direct	✅p	✅p	✅p	✅p	✅p	✅p	❌F	✅p	✅p	✅p
❌	TestAccept/bundle/local_state_staleness/DATABRICKS_BUNDLE_ENGINE=terraform	✅p	✅p	✅p	✅p	✅p	✅p	❌F	✅p	✅p	✅p
❌	TestAccept/bundle/python/mutator-permissions-owner-5682	🙈s	🙈s	✅p	✅p	🙈s	🙈s	❌F	✅p	🙈s	🙈s
❌	TestAccept/bundle/python/mutator-permissions-owner-5682/DATABRICKS_BUNDLE_ENGINE=direct/PYDAB_VERSION=0.266.0			✅p	✅p			❌F	✅p
❌	TestAccept/bundle/python/mutator-permissions-owner-5682/DATABRICKS_BUNDLE_ENGINE=direct/PYDAB_VERSION=current			✅p	✅p			❌F	✅p
❌	TestAccept/bundle/python/mutator-permissions-owner-5682/DATABRICKS_BUNDLE_ENGINE=terraform/PYDAB_VERSION=current			✅p	✅p			❌F	✅p
❌	TestAccept/bundle/resources/alerts/basic	✅p	✅p	✅p	✅p	✅p	✅p	❌F	✅p	✅p	✅p
❌	TestAccept/bundle/resources/alerts/basic/DATABRICKS_BUNDLE_ENGINE=direct	✅p	✅p	✅p	✅p	✅p	✅p	❌F	✅p	✅p	✅p
❌	TestAccept/bundle/resources/apps/inline_config	✅p	✅p	✅p	✅p	✅p	✅p	❌F	✅p	✅p	✅p
❌	TestAccept/bundle/resources/apps/inline_config/DATABRICKS_BUNDLE_ENGINE=direct	✅p	✅p	✅p	✅p	✅p	✅p	❌F	✅p	✅p	✅p
❌	TestAccept/bundle/resources/apps/lifecycle-started	✅p	✅p	✅p	✅p	✅p	✅p	❌F	✅p	✅p	✅p
❌	TestAccept/bundle/resources/apps/lifecycle-started-omitted	✅p	✅p	✅p	✅p	✅p	✅p	✅p	✅p	✅p	❌F
❌	TestAccept/bundle/resources/apps/lifecycle-started-omitted/DATABRICKS_BUNDLE_ENGINE=direct	✅p	✅p	✅p	✅p	✅p	✅p	✅p	✅p	✅p	❌F
❌	TestAccept/bundle/resources/apps/lifecycle-started/DATABRICKS_BUNDLE_ENGINE=direct	✅p	✅p	✅p	✅p	✅p	✅p	❌F	✅p	✅p	✅p
❌	TestAccept/bundle/resources/dashboards/change-name	🔄f	🔄f	✅p	✅p	✅p	✅p	❌F	❌F	✅p	✅p
❌	TestAccept/bundle/resources/dashboards/change-name/DATABRICKS_BUNDLE_ENGINE=direct	✅p	🔄f	✅p	✅p	✅p	✅p	✅p	❌F	✅p	✅p
❌	TestAccept/bundle/resources/dashboards/change-name/DATABRICKS_BUNDLE_ENGINE=terraform	🔄f	✅p	✅p	✅p	✅p	✅p	❌F	✅p	✅p	✅p
🔄	TestAccept/bundle/resources/dashboards/change-serialized-dashboard	✅p	✅p	✅p	✅p	✅p	🔄f	✅p	✅p	✅p	✅p
🔄	TestAccept/bundle/resources/dashboards/change-serialized-dashboard/DATABRICKS_BUNDLE_ENGINE=direct	✅p	✅p	✅p	✅p	✅p	🔄f	✅p	✅p	✅p	✅p
❌	TestAccept/bundle/resources/dashboards/generate_inplace	✅p	✅p	✅p	✅p	✅p	✅p	✅p	❌F	✅p	✅p
❌	TestAccept/bundle/resources/dashboards/generate_inplace/DATABRICKS_BUNDLE_ENGINE=direct	✅p	✅p	✅p	✅p	✅p	✅p	✅p	❌F	✅p	✅p
❌	TestAccept/bundle/resources/dashboards/generate_inplace/DATABRICKS_BUNDLE_ENGINE=terraform	✅p	✅p	✅p	✅p	✅p	✅p	✅p	❌F	✅p	✅p
❌	TestAccept/bundle/resources/dashboards/simple	✅p	✅p	✅p	✅p	✅p	✅p	✅p	❌F	✅p	✅p
❌	TestAccept/bundle/resources/dashboards/simple/DATABRICKS_BUNDLE_ENGINE=direct	✅p	✅p	✅p	✅p	✅p	✅p	✅p	❌F	✅p	✅p
❌	TestAccept/bundle/resources/dashboards/simple/DATABRICKS_BUNDLE_ENGINE=terraform	✅p	✅p	✅p	✅p	✅p	✅p	✅p	❌F	✅p	✅p
❌	TestAccept/bundle/resources/permissions/jobs/destroy_without_mgmtperms/with_permissions	❌F	❌F	✅p	✅p	🙈s	🙈s	🙈s	🙈s	🙈s	🙈s
❌	TestAccept/bundle/resources/permissions/jobs/destroy_without_mgmtperms/with_permissions/DATABRICKS_BUNDLE_ENGINE=direct	❌F	❌F	✅p	✅p
❌	TestAccept/bundle/resources/permissions/jobs/destroy_without_mgmtperms/with_permissions/DATABRICKS_BUNDLE_ENGINE=terraform	❌F	❌F	✅p	✅p
❌	TestAccept/bundle/resources/permissions/jobs/destroy_without_mgmtperms/without_permissions	❌F	❌F	✅p	✅p	🙈s	🙈s	🙈s	🙈s	🙈s	🙈s
❌	TestAccept/bundle/resources/permissions/jobs/destroy_without_mgmtperms/without_permissions/DATABRICKS_BUNDLE_ENGINE=direct	❌F	❌F	✅p	✅p
❌	TestAccept/bundle/resources/permissions/jobs/destroy_without_mgmtperms/without_permissions/DATABRICKS_BUNDLE_ENGINE=terraform	❌F	❌F	✅p	✅p
❌	TestAccept/bundle/resources/quality_monitors/change_output_schema_name	🙈s	🙈s	✅p	✅p	🙈s	🙈s	✅p	❌F	🙈s	🙈s
❌	TestAccept/bundle/resources/quality_monitors/change_output_schema_name/DATABRICKS_BUNDLE_ENGINE=direct			✅p	✅p			✅p	❌F
❌	TestAccept/bundle/resources/quality_monitors/change_output_schema_name/DATABRICKS_BUNDLE_ENGINE=terraform			✅p	✅p			✅p	❌F
💚	TestAccept/bundle/resources/vector_search_endpoints/drift/recreated_same_name	🙈S	🙈S	💚R	💚R	🙈S	🙈S	💚R	💚R	🙈S	🙈S
🙈	TestAccept/bundle/resources/vector_search_indexes/recreate/embedding_dimension	🙈S	🙈S	🙈S	🙈S	🙈S	🙈S	🙈S	🙈S	🙈S	🙈S
❌	TestAccept/bundle/templates/default-python/combinations/classic	✅p	✅p	✅p	✅p	✅p	✅p	✅p	❌F	✅p	❌F
❌	TestAccept/bundle/templates/default-python/combinations/classic/DATABRICKS_BUNDLE_ENGINE=direct/DLT=no/NBOOK=no/PY=no/READPLAN=	✅p	✅p	✅p	✅p	✅p	✅p	✅p	❌F	✅p	✅p
❌	TestAccept/bundle/templates/default-python/combinations/classic/DATABRICKS_BUNDLE_ENGINE=direct/DLT=no/NBOOK=no/PY=no/READPLAN=1	✅p	✅p	✅p	✅p	✅p	✅p	✅p	❌F	✅p	✅p
❌	TestAccept/bundle/templates/default-python/combinations/classic/DATABRICKS_BUNDLE_ENGINE=direct/DLT=no/NBOOK=no/PY=yes/READPLAN=	✅p	✅p	✅p	✅p	✅p	✅p	✅p	❌F	✅p	✅p
❌	TestAccept/bundle/templates/default-python/combinations/classic/DATABRICKS_BUNDLE_ENGINE=direct/DLT=no/NBOOK=no/PY=yes/READPLAN=1	✅p	✅p	✅p	✅p	✅p	✅p	✅p	❌F	✅p	✅p
❌	TestAccept/bundle/templates/default-python/combinations/classic/DATABRICKS_BUNDLE_ENGINE=direct/DLT=no/NBOOK=yes/PY=no/READPLAN=	✅p	✅p	✅p	✅p	✅p	✅p	✅p	❌F	✅p	✅p
❌	TestAccept/bundle/templates/default-python/combinations/classic/DATABRICKS_BUNDLE_ENGINE=direct/DLT=no/NBOOK=yes/PY=no/READPLAN=1	✅p	✅p	✅p	✅p	✅p	✅p	✅p	❌F	✅p	✅p
❌	TestAccept/bundle/templates/default-python/combinations/classic/DATABRICKS_BUNDLE_ENGINE=direct/DLT=no/NBOOK=yes/PY=yes/READPLAN=	✅p	✅p	✅p	✅p	✅p	✅p	✅p	❌F	✅p	✅p
❌	TestAccept/bundle/templates/default-python/combinations/classic/DATABRICKS_BUNDLE_ENGINE=direct/DLT=no/NBOOK=yes/PY=yes/READPLAN=1	✅p	✅p	✅p	✅p	✅p	✅p	✅p	❌F	✅p	✅p
❌	TestAccept/bundle/templates/default-python/combinations/classic/DATABRICKS_BUNDLE_ENGINE=direct/DLT=yes/NBOOK=no/PY=no/READPLAN=	✅p	✅p	✅p	✅p	✅p	✅p	✅p	❌F	✅p	✅p
❌	TestAccept/bundle/templates/default-python/combinations/classic/DATABRICKS_BUNDLE_ENGINE=direct/DLT=yes/NBOOK=no/PY=no/READPLAN=1	✅p	✅p	✅p	✅p	✅p	✅p	✅p	❌F	✅p	✅p
❌	TestAccept/bundle/templates/default-python/combinations/classic/DATABRICKS_BUNDLE_ENGINE=direct/DLT=yes/NBOOK=no/PY=yes/READPLAN=1	✅p	✅p	✅p	✅p	✅p	✅p	✅p	❌F	✅p	✅p
❌	TestAccept/bundle/templates/default-python/combinations/classic/DATABRICKS_BUNDLE_ENGINE=direct/DLT=yes/NBOOK=yes/PY=yes/READPLAN=	✅p	✅p	✅p	✅p	✅p	✅p	✅p	✅p	✅p	❌F
❌	TestAccept/bundle/templates/default-python/combinations/classic/DATABRICKS_BUNDLE_ENGINE=direct/DLT=yes/NBOOK=yes/PY=yes/READPLAN=1	✅p	✅p	✅p	✅p	✅p	✅p	✅p	✅p	✅p	❌F
❌	TestAccept/bundle/templates/default-python/combinations/classic/DATABRICKS_BUNDLE_ENGINE=terraform/DLT=no/NBOOK=no/PY=no/READPLAN=	✅p	✅p	✅p	✅p	✅p	✅p	✅p	✅p	✅p	❌F
❌	TestAccept/bundle/templates/default-python/combinations/classic/DATABRICKS_BUNDLE_ENGINE=terraform/DLT=no/NBOOK=yes/PY=no/READPLAN=	✅p	✅p	✅p	✅p	✅p	✅p	✅p	✅p	✅p	❌F
❌	TestAccept/bundle/templates/default-python/combinations/classic/DATABRICKS_BUNDLE_ENGINE=terraform/DLT=no/NBOOK=yes/PY=yes/READPLAN=	✅p	✅p	✅p	✅p	✅p	✅p	✅p	✅p	✅p	❌F
❌	TestAccept/bundle/templates/default-python/combinations/classic/DATABRICKS_BUNDLE_ENGINE=terraform/DLT=yes/NBOOK=no/PY=no/READPLAN=	✅p	✅p	✅p	✅p	✅p	✅p	✅p	✅p	✅p	❌F
❌	TestAccept/bundle/templates/default-python/combinations/classic/DATABRICKS_BUNDLE_ENGINE=terraform/DLT=yes/NBOOK=no/PY=yes/READPLAN=	✅p	✅p	✅p	✅p	✅p	✅p	✅p	❌F	✅p	❌F
❌	TestAccept/bundle/templates/default-python/combinations/classic/DATABRICKS_BUNDLE_ENGINE=terraform/DLT=yes/NBOOK=yes/PY=no/READPLAN=	✅p	✅p	✅p	✅p	✅p	✅p	✅p	❌F	✅p	❌F
❌	TestAccept/bundle/templates/default-python/combinations/serverless	✅p	✅p	✅p	✅p	✅p	✅p	✅p	✅p	✅p	❌F
❌	TestAccept/bundle/templates/default-python/combinations/serverless/DATABRICKS_BUNDLE_ENGINE=direct/DLT=yes/NBOOK=no/PY=yes/READPLAN=	🙈s	🙈s	✅p	✅p	🙈s	🙈s	✅p	✅p	🙈s	❌F
❌	TestAccept/bundle/templates/default-python/combinations/serverless/DATABRICKS_BUNDLE_ENGINE=direct/DLT=yes/NBOOK=no/PY=yes/READPLAN=1	🙈s	🙈s	✅p	✅p	🙈s	🙈s	✅p	✅p	🙈s	❌F
❌	TestAccept/bundle/templates/default-python/combinations/serverless/DATABRICKS_BUNDLE_ENGINE=direct/DLT=yes/NBOOK=yes/PY=no/READPLAN=	🙈s	🙈s	✅p	✅p	🙈s	🙈s	✅p	✅p	🙈s	❌F
❌	TestAccept/bundle/templates/default-python/combinations/serverless/DATABRICKS_BUNDLE_ENGINE=direct/DLT=yes/NBOOK=yes/PY=no/READPLAN=1	🙈s	🙈s	✅p	✅p	🙈s	🙈s	✅p	✅p	🙈s	❌F
❌	TestAccept/bundle/templates/default-python/combinations/serverless/DATABRICKS_BUNDLE_ENGINE=terraform/DLT=yes/NBOOK=yes/PY=yes/READPLAN=	🙈s	🙈s	✅p	✅p	🙈s	🙈s	✅p	✅p	🙈s	❌F
🙈	TestAccept/ssh/connection	🙈S	🙈S	🙈S	🙈S	🙈S	🙈S	🙈S	🙈S	🙈S	🙈S
💚	TestFetchRepositoryInfoAPI_FromRepo	💚R	💚R	💚R	💚R	💚R	💚R	💚R	💚R	💚R	💚R
💚	TestFetchRepositoryInfoAPI_FromRepo/root	💚R	💚R	💚R	💚R	💚R	💚R	💚R	💚R	💚R	💚R
💚	TestFetchRepositoryInfoAPI_FromRepo/subdir	💚R	💚R	💚R	💚R	💚R	💚R	💚R	💚R	💚R	💚R

Top 50 slowest tests (at least 2 minutes):

duration	env	testname
17:34	aws windows	TestAccept/bundle/resources/clusters/lifecycle-started/DATABRICKS_BUNDLE_ENGINE=direct
12:39	gcp linux	TestAccept/bundle/resources/apps/lifecycle-started/DATABRICKS_BUNDLE_ENGINE=direct
12:32	gcp windows	TestAccept/bundle/resources/apps/lifecycle-started/DATABRICKS_BUNDLE_ENGINE=direct
11:48	aws-ucws linux	TestAccept/bundle/resources/clusters/lifecycle-started/DATABRICKS_BUNDLE_ENGINE=direct
11:34	aws windows	TestAccept/bundle/resources/clusters/lifecycle-started-toggle/DATABRICKS_BUNDLE_ENGINE=direct
11:20	aws-ucws linux	TestAccept/bundle/config-remote-sync/multiple_resources/DATABRICKS_BUNDLE_ENGINE=terraform
9:54	aws-ucws linux	TestAccept/bundle/resources/clusters/lifecycle-started-toggle/DATABRICKS_BUNDLE_ENGINE=direct
8:19	aws-ucws windows	TestAccept/bundle/resources/apps/lifecycle-started/DATABRICKS_BUNDLE_ENGINE=direct
8:15	aws windows	TestAccept/bundle/resources/clusters/resize-terminated-fallback/DATABRICKS_BUNDLE_ENGINE=direct
8:14	aws linux	TestAccept/bundle/resources/apps/lifecycle-started/DATABRICKS_BUNDLE_ENGINE=direct
8:06	aws-ucws linux	TestAccept/bundle/resources/apps/lifecycle-started/DATABRICKS_BUNDLE_ENGINE=direct
8:04	aws windows	TestAccept/bundle/resources/apps/lifecycle-started/DATABRICKS_BUNDLE_ENGINE=direct
7:45	azure windows	TestAccept/bundle/resources/apps/lifecycle-started/DATABRICKS_BUNDLE_ENGINE=direct
7:41	aws linux	TestAccept/bundle/resources/clusters/deploy/update-after-create/DATABRICKS_BUNDLE_ENGINE=direct
7:35	azure linux	TestAccept/bundle/resources/apps/lifecycle-started/DATABRICKS_BUNDLE_ENGINE=direct
7:35	aws linux	TestAccept/bundle/resources/clusters/lifecycle-started/DATABRICKS_BUNDLE_ENGINE=direct
7:33	aws-ucws windows	TestAccept/bundle/resources/clusters/lifecycle-started/DATABRICKS_BUNDLE_ENGINE=direct
7:27	azure-ucws linux	TestAccept/bundle/config-remote-sync/multiple_resources/DATABRICKS_BUNDLE_ENGINE=terraform
7:26	azure linux	TestAccept/bundle/resources/clusters/lifecycle-started/DATABRICKS_BUNDLE_ENGINE=direct
7:18	gcp windows	TestAccept/bundle/resources/clusters/lifecycle-started/DATABRICKS_BUNDLE_ENGINE=direct
7:08	azure-ucws windows	TestAccept/bundle/resources/apps/lifecycle-started/DATABRICKS_BUNDLE_ENGINE=direct
7:01	aws windows	TestAccept/bundle/resources/clusters/deploy/simple/DATABRICKS_BUNDLE_ENGINE=direct
6:58	azure-ucws windows	TestAccept/bundle/deploy/spark-jar-task/DATABRICKS_BUNDLE_ENGINE=terraform
6:54	gcp linux	TestAccept/bundle/resources/clusters/deploy/local_ssd_count/DATABRICKS_BUNDLE_ENGINE=direct
6:54	gcp linux	TestAccept/bundle/resources/clusters/lifecycle-started/DATABRICKS_BUNDLE_ENGINE=direct
6:50	gcp windows	TestAccept/bundle/resources/clusters/deploy/local_ssd_count/DATABRICKS_BUNDLE_ENGINE=direct
6:47	aws-ucws linux	TestAccept/bundle/resources/clusters/resize-terminated-fallback/DATABRICKS_BUNDLE_ENGINE=direct
6:26	azure-ucws linux	TestAccept/bundle/invariant/no_drift/DATABRICKS_BUNDLE_ENGINE=direct/INPUT_CONFIG=cluster.yml.tmpl/READPLAN=
6:19	aws-ucws linux	TestAccept/bundle/resources/clusters/deploy/update-after-create/DATABRICKS_BUNDLE_ENGINE=terraform
6:15	aws linux	TestAccept/bundle/resources/clusters/lifecycle-started-toggle/DATABRICKS_BUNDLE_ENGINE=direct
6:10	aws-ucws windows	TestAccept
5:59	azure-ucws windows	TestAccept/bundle/deploy/spark-jar-task/DATABRICKS_BUNDLE_ENGINE=direct
5:40	gcp linux	TestAccept/bundle/resources/clusters/lifecycle-started-toggle/DATABRICKS_BUNDLE_ENGINE=direct
5:35	aws-ucws windows	TestAccept/bundle/resources/clusters/lifecycle-started-toggle/DATABRICKS_BUNDLE_ENGINE=direct
5:32	gcp windows	TestAccept/bundle/resources/clusters/lifecycle-started-toggle/DATABRICKS_BUNDLE_ENGINE=direct
5:26	azure linux	TestAccept/bundle/resources/clusters/deploy/update-after-create/DATABRICKS_BUNDLE_ENGINE=direct
5:09	aws windows	TestAccept/bundle/deploy/spark-jar-task/DATABRICKS_BUNDLE_ENGINE=direct
5:06	azure-ucws windows	TestAccept/bundle/resources/clusters/lifecycle-started/DATABRICKS_BUNDLE_ENGINE=direct
5:04	gcp linux	TestAccept/bundle/deploy/spark-jar-task/DATABRICKS_BUNDLE_ENGINE=terraform
4:59	azure-ucws linux	TestAccept/bundle/resources/clusters/lifecycle-started/DATABRICKS_BUNDLE_ENGINE=direct
4:58	aws-ucws windows	TestAccept/bundle/deploy/spark-jar-task/DATABRICKS_BUNDLE_ENGINE=terraform
4:57	azure windows	TestAccept/bundle/resources/clusters/lifecycle-started/DATABRICKS_BUNDLE_ENGINE=direct
4:56	aws windows	TestAccept/bundle/deploy/spark-jar-task/DATABRICKS_BUNDLE_ENGINE=terraform
4:52	gcp windows	TestAccept/bundle/resources/apps/lifecycle-started-toggle/DATABRICKS_BUNDLE_ENGINE=direct
4:47	aws linux	TestAccept/bundle/deploy/spark-jar-task/DATABRICKS_BUNDLE_ENGINE=terraform
4:41	gcp windows	TestAccept/bundle/resources/apps/inline_config/DATABRICKS_BUNDLE_ENGINE=terraform
4:39	azure-ucws linux	TestAccept/bundle/deploy/spark-jar-task/DATABRICKS_BUNDLE_ENGINE=terraform
4:37	azure-ucws linux	TestAccept/bundle/deploy/spark-jar-task/DATABRICKS_BUNDLE_ENGINE=direct
4:34	aws-ucws linux	TestAccept/bundle/deploy/spark-jar-task/DATABRICKS_BUNDLE_ENGINE=terraform
4:32	aws linux	TestAccept/bundle/deploy/spark-jar-task/DATABRICKS_BUNDLE_ENGINE=direct

## Release v1.9.0 ### CLI * `databricks auth profiles` no longer stalls on an unreachable workspace and instead fails validation after 5 seconds per host ([#5928](#5928)). * Fixed `databricks fs rm -r` failing on UC Volumes backed by GCS when a directory becomes empty during recursive deletion ([#5958](#5958)). * You can now ask questions about your data directly from the CLI with `databricks genie ask "..."`. Genie answers natural-language questions ("what were total sales last month?", "which tables are in the sales catalog?"), runs the query inside Databricks, and renders the answer in the terminal. This promotes the former `databricks experimental genie ask` command; the experimental alias still works but is deprecated and will be removed in a future release ([#6010](#6010)). ### Bundles * `bundle validate` now reports a clear error when a `sql_warehouse` is missing a `name` (including whitespace-only names), and a warning when a grant is missing a `principal` ([#5818](#5818)). * Bundle templates now scaffold an `AGENTS.md` that points coding agents at Databricks AI Tools, alongside a minimal `CLAUDE.md` that includes it via `@AGENTS.md` ([#5996](#5996)). * `bundle generate job` can now download workspace files referenced by `spark_python_task`, rewriting them to a relative path like it already does for notebooks. This is opt-in via the `--download-spark-python-files` flag ([#5799](#5799)). * Simplified the `default-minimal` bundle template and added an alias `databricks bundle init empty` ([#5899](#5899)). * Add support for the `instance_pools` resource type in Declarative Automation Bundles. Instance pools are only supported in direct deployment mode. * Do not emit "unknown field" warnings for YAML anchors grouped in a list or map, matching the existing suppression for standalone anchors ([#5975](#5975)). * Provide an actionable error message if databricks.yml is missing or DATABRICKS_BUNDLE_ROOT is invalid ([#5953](#5953)). ### Dependency Updates * Bump `github.com/databricks/databricks-sdk-go` from v0.154.0 to v0.160.0 ([#5982](#5982)). * Bump Terraform provider from v1.121.0 to v1.122.0 ([#5977](#5977)).

## Changes Promote the `grant principal is required` diagnostic from a warning to a hard validation error, so `bundle validate`/`plan`/`deploy` fail up front when a `grants[*]` entry has no `principal`. ## Why databricks#5818 added this as a warning only because the backend contract was unconfirmed. It's now confirmed: on the direct engine the securable is created and *then* the grants PATCH fails with `400 INVALID_PARAMETER_VALUE — at least one of 'principal' or 'principal_id' must be set`, leaving a partially-applied deployment. `principal` is the only way to name a grantee in a bundle (the config struct has no `principal_id`), so a missing one is always invalid. Erroring at validation stops the deploy before anything is created. ## Tests Updated `acceptance/bundle/validate/grants_required_principal` to assert the error and that `bundle deploy` aborts with zero Unity Catalog requests (no partial deploy).

radakam temporarily deployed to test-trigger-is July 3, 2026 10:57 — with GitHub Actions Inactive

radakam temporarily deployed to test-trigger-is July 3, 2026 11:27 — with GitHub Actions Inactive

radakam marked this pull request as ready for review July 3, 2026 11:29

radakam temporarily deployed to test-trigger-is July 3, 2026 11:42 — with GitHub Actions Inactive

radakam force-pushed the cli-fix-bundle-validate-required-fields-and-retention-units branch from cfbbb09 to 998cbdfCompare July 6, 2026 13:54

radakam had a problem deploying to test-trigger-is July 6, 2026 13:54 — with GitHub Actions Failure

radakam temporarily deployed to test-trigger-is July 6, 2026 13:54 — with GitHub Actions Inactive

radakam force-pushed the cli-fix-bundle-validate-required-fields-and-retention-units branch from 998cbdf to 6eb36c8Compare July 7, 2026 07:00

radakam temporarily deployed to test-trigger-is July 7, 2026 07:00 — with GitHub Actions Inactive

radakam force-pushed the cli-fix-bundle-validate-required-fields-and-retention-units branch from 6eb36c8 to 81814b5Compare July 7, 2026 13:42

radakam temporarily deployed to test-trigger-is July 7, 2026 13:43 — with GitHub Actions Inactive

radakam had a problem deploying to test-trigger-is July 13, 2026 13:14 — with GitHub Actions Failure

radakam temporarily deployed to test-trigger-is July 13, 2026 13:14 — with GitHub Actions Inactive

radakam added 5 commits July 13, 2026 13:15

Remove internal ticket references and trim validation comments
acb3cbe

Update acceptance output after comment line shift
efff320

changelog: move entry to .nextchanges fragment
556d8e5

radakam force-pushed the cli-fix-bundle-validate-required-fields-and-retention-units branch from d10fb7a to 556d8e5Compare July 13, 2026 13:22

radakam temporarily deployed to test-trigger-is July 13, 2026 13:26 — with GitHub Actions Inactive

Regenerate out.test.toml for new validate tests
d8b016f

radakam temporarily deployed to test-trigger-is July 13, 2026 13:30 — with GitHub Actions Inactive

radakam had a problem deploying to test-trigger-is July 13, 2026 13:30 — with GitHub Actions Failure

shreyas-goenka reviewed Jul 15, 2026
View reviewed changes

Comment threadbundle/config/validate/required.go Outdated

Use static field access for sql_warehouse name check
0d19bdc
Iterate b.Config.Resources.SqlWarehouses directly instead of dyn, matching the adjacent dashboards validation. Addresses review feedback.

radakam temporarily deployed to test-trigger-is July 15, 2026 09:21 — with GitHub Actions Inactive

shreyas-goenka reviewed Jul 15, 2026
View reviewed changes

Comment threadbundle/config/validate/required.go

shreyas-goenka reviewed Jul 15, 2026
View reviewed changes

Comment threadbundle/config/validate/required.go

Use static field access for grant principal check
ef87108
Iterate the six grant-bearing resource types directly instead of dyn, and drop the now-unused isMissingOrEmptyString helper. Addresses review feedback.

radakam temporarily deployed to test-trigger-is July 15, 2026 10:45 — with GitHub Actions Inactive

Trim validation comments to remove redundancy
f41a1f0

radakam temporarily deployed to test-trigger-is July 15, 2026 10:55 — with GitHub Actions Inactive

Merge branch 'main' into cli-fix-bundle-validate-required-fields-and-…
08027c0
…retention-units

radakam temporarily deployed to test-trigger-is July 15, 2026 11:09 — with GitHub Actions Inactive

radakam requested a review from shreyas-goenka July 15, 2026 12:32

shreyas-goenka reviewed Jul 15, 2026
View reviewed changes

Comment threadbundle/config/validate/required.go Outdated

shreyas-goenka approved these changes Jul 16, 2026
View reviewed changes

radakam enabled auto-merge July 16, 2026 07:46

radakam added this pull request to the merge queue Jul 16, 2026

Merged via the queue into main with commit c8c397fJul 16, 2026
28 checks passed

radakam deleted the cli-fix-bundle-validate-required-fields-and-retention-units branch July 16, 2026 08:33

radakam mentioned this pull request Jul 23, 2026
acc: mutate-based invariant fuzzing for bundle configs #5686
Open

rugpanov mentioned this pull request Jul 23, 2026
Update Databricks CLI to v1.9.0 databricks/databricks-vscode#2035
Merged

radakam mentioned this pull request Jul 23, 2026
Reject grants missing a principal at validation #6041
Merged

Navigation Menu

Uh oh!

Validate required/unit-constrained UC fields early in bundle validate - #5818

Validate required/unit-constrained UC fields early in bundle validate#5818
radakam merged 15 commits into
mainfrom
cli-fix-bundle-validate-required-fields-and-retention-units

radakam commented Jul 3, 2026•
edited
Loading

Uh oh!

eng-dev-ecosystem-bot commented Jul 3, 2026•
edited
Loading

Uh oh!

Uh oh!

Uh oh!

Uh oh!

shreyas-goenka left a comment

Uh oh!

Uh oh!

Uh oh!

eng-dev-ecosystem-bot commented Jul 16, 2026

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

3 participants

Uh oh!

Conversation

radakam commented Jul 3, 2026• edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Changes

Why

Tests

Uh oh!

eng-dev-ecosystem-bot commented Jul 3, 2026• edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Integration test report

Uh oh!

Uh oh!

Uh oh!

Uh oh!

shreyas-goenka left a comment

Choose a reason for hiding this comment

Uh oh!

Uh oh!

Uh oh!

eng-dev-ecosystem-bot commented Jul 16, 2026

Integration test report

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

3 participants

radakam commented Jul 3, 2026•
edited
Loading

eng-dev-ecosystem-bot commented Jul 3, 2026•
edited
Loading