Normalize TF provider version in test fixtures by janniklasrose · Pull Request #5863 · databricks/cli

janniklasrose · 2026-07-08T13:45:19Z

Changes

Replace databricks-tf-provider version with [DBTF_VERSION] in tests. Not named [TF_VERSION] due to conflict with plain tf (terraform/1.55.0)

Why

Prevent churn during TF bump

Follow-up to #5857

Tests

CI

eng-dev-ecosystem-bot · 2026-07-08T14:07:03Z

Integration test report

Commit: 75e91e0

Run: 28955333345

	Env	🔄flaky	💚RECOVERED	🙈SKIP	✅pass	🙈skip	Time
💚	aws linux		4	4	230	1069	4:32
💚	aws windows		4	4	232	1067	4:06
💚	aws-ucws linux		4	4	314	987	8:05
💚	aws-ucws windows		4	4	316	985	5:33
💚	azure linux		4	4	230	1068	4:27
💚	azure windows		4	4	232	1066	4:23
🔄	azure-ucws linux	2	2	4	316	984	10:40
🔄	azure-ucws windows	2	4	4	316	982	7:46
💚	gcp linux		4	4	229	1070	3:56
💚	gcp windows		4	4	231	1068	3:51

10 interesting tests: 4 SKIP, 4 flaky, 2 RECOVERED

	Test Name	aws linux	aws windows	aws-ucws linux	aws-ucws windows	azure linux	azure windows	azure-ucws linux	azure-ucws windows	gcp linux	gcp windows
💚	TestAccept	💚R	💚R	💚R	💚R	💚R	💚R	💚R	💚R	💚R	💚R
🙈	TestAccept/bundle/invariant/no_drift	🙈S	🙈S	🙈S	🙈S	🙈S	🙈S	🙈S	🙈S	🙈S	🙈S
🙈	TestAccept/bundle/resources/vector_search_endpoints/drift/recreated_same_name	🙈S	🙈S	🙈S	🙈S	🙈S	🙈S	🙈S	🙈S	🙈S	🙈S
🙈	TestAccept/bundle/resources/vector_search_indexes/recreate/embedding_dimension	🙈S	🙈S	🙈S	🙈S	🙈S	🙈S	🙈S	🙈S	🙈S	🙈S
🙈	TestAccept/ssh/connection	🙈S	🙈S	🙈S	🙈S	🙈S	🙈S	🙈S	🙈S	🙈S	🙈S
🔄	TestSyncFullFileSync	✅p	✅p	✅p	✅p	✅p	✅p	✅p	🔄f	✅p	✅p
🔄	TestSyncIncrementalFileSync	✅p	✅p	✅p	✅p	✅p	✅p	✅p	🔄f	✅p	✅p
💚	TestFetchRepositoryInfoAPI_FromRepo	💚R	💚R	💚R	💚R	💚R	💚R	💚R	💚R	💚R	💚R
🔄	TestFetchRepositoryInfoAPI_FromRepo/root	💚R	💚R	💚R	💚R	💚R	💚R	🔄f	💚R	💚R	💚R
🔄	TestFetchRepositoryInfoAPI_FromRepo/subdir	💚R	💚R	💚R	💚R	💚R	💚R	🔄f	💚R	💚R	💚R

Top 7 slowest tests (at least 2 minutes):

duration	env	testname
3:10	azure windows	TestAccept
3:03	gcp windows	TestAccept
3:02	aws windows	TestAccept
2:53	aws-ucws windows	TestAccept
2:52	azure-ucws windows	TestAccept
2:05	azure-ucws windows	TestAccept/bundle/deploy/mlops-stacks/DATABRICKS_BUNDLE_ENGINE=terraform
2:03	aws-ucws linux	TestAccept/bundle/deploy/mlops-stacks/DATABRICKS_BUNDLE_ENGINE=terraform

…version-in-test-fixtures # Conflicts: # acceptance/bundle/migrate/runas/out.create_requests.json # acceptance/bundle/state/state_present/output.txt # acceptance/bundle/user_agent/output.txt # acceptance/bundle/user_agent/simple/out.requests.deploy.terraform.json # acceptance/bundle/user_agent/simple/out.requests.destroy.terraform.json # acceptance/bundle/user_agent/simple/out.requests.plan.terraform.json # acceptance/bundle/user_agent/simple/out.requests.plan2.terraform.json

…ze-tf-version-in-test-fixtures

eng-dev-ecosystem-bot · 2026-07-08T20:30:51Z

Integration test report

Commit: 05a57d9

Run: 28959365441

	Env	❌FAIL	🟨KNOWN	🔄flaky	💚RECOVERED	🙈SKIP	✅pass	🙈skip	Time
💚	aws linux				4	4	529	998	47:04
🔄	aws windows			4	4	4	482	1011	58:09
❌	aws-ucws linux	9	1	6	5	2	973	813	192:09
❌	aws-ucws windows	11	1	6	5	2	913	831	221:34
💚	azure linux				4	4	523	999	39:29
🔄	azure windows			3	3	4	478	1012	51:31
🔄	azure-ucws linux			7	3	2	890	844	180:41
🔄	azure-ucws windows			8	4	2	830	862	172:45
💚	gcp linux				4	4	514	1004	42:10
🔄	gcp windows			3	3	4	469	1017	53:54

36 interesting tests: 19 flaky, 11 FAIL, 3 RECOVERED, 2 SKIP, 1 KNOWN

	Test Name	aws linux	aws windows	aws-ucws linux	aws-ucws windows	azure linux	azure windows	azure-ucws linux	azure-ucws windows	gcp linux	gcp windows
🟨	TestAccept	💚R	💚R	🟨K	🟨K	💚R	🔄f	🔄f	💚R	💚R	🔄f
🔄	TestAccept/bundle/generate/pipeline_and_deploy	✅p	🔄f	✅p	🔄f	✅p	✅p	✅p	✅p	✅p	✅p
🔄	TestAccept/bundle/generate/pipeline_and_deploy/DATABRICKS_BUNDLE_ENGINE=direct	✅p	✅p	✅p	🔄f	✅p	✅p	✅p	🔄f	✅p	✅p
🔄	TestAccept/bundle/generate/pipeline_and_deploy/DATABRICKS_BUNDLE_ENGINE=terraform	✅p	🔄f	✅p	✅p	✅p	✅p	✅p	🔄f	✅p	✅p
🔄	TestAccept/bundle/generate/python_job_and_deploy	✅p	🔄f	✅p	🔄f	✅p	🔄f	✅p	🔄f	✅p	🔄f
🔄	TestAccept/bundle/generate/python_job_and_deploy/DATABRICKS_BUNDLE_ENGINE=direct	✅p	🔄f	✅p	✅p	✅p	✅p	✅p	✅p	✅p	🔄f
🔄	TestAccept/bundle/generate/python_job_and_deploy/DATABRICKS_BUNDLE_ENGINE=terraform	✅p	✅p	✅p	🔄f	✅p	🔄f	✅p	🔄f	✅p	✅p
💚	TestAccept/bundle/invariant/no_drift	🙈S	🙈S	💚R	💚R	🙈S	🙈S	💚R	💚R	🙈S	🙈S
🔄	TestAccept/bundle/invariant/no_drift/DATABRICKS_BUNDLE_ENGINE=direct/INPUT_CONFIG=cluster.yml.tmpl/READPLAN=			🔄f	✅p			✅p	✅p
🔄	TestAccept/bundle/invariant/no_drift/DATABRICKS_BUNDLE_ENGINE=direct/INPUT_CONFIG=cluster.yml.tmpl/READPLAN=1			🔄f	✅p			✅p	✅p
🔄	TestAccept/bundle/resources/apps/lifecycle-started	✅p	✅p	✅p	✅p	✅p	✅p	🔄f	✅p	✅p	✅p
🔄	TestAccept/bundle/resources/apps/lifecycle-started-toggle	✅p	✅p	✅p	✅p	✅p	✅p	🔄f	✅p	✅p	✅p
🔄	TestAccept/bundle/resources/apps/lifecycle-started-toggle/DATABRICKS_BUNDLE_ENGINE=direct	✅p	✅p	✅p	✅p	✅p	✅p	🔄f	✅p	✅p	✅p
🔄	TestAccept/bundle/resources/apps/lifecycle-started/DATABRICKS_BUNDLE_ENGINE=direct	✅p	✅p	✅p	✅p	✅p	✅p	🔄f	✅p	✅p	✅p
❌	TestAccept/bundle/resources/clusters/lifecycle-started-toggle	✅p	✅p	✅p	❌F	✅p	✅p	✅p	✅p	✅p	✅p
❌	TestAccept/bundle/resources/clusters/lifecycle-started-toggle/DATABRICKS_BUNDLE_ENGINE=direct	✅p	✅p	✅p	❌F	✅p	✅p	✅p	✅p	✅p	✅p
🔄	TestAccept/bundle/resources/dashboards/change-name	✅p	✅p	🔄f	🔄f	✅p	✅p	✅p	✅p	✅p	✅p
🔄	TestAccept/bundle/resources/dashboards/change-name/DATABRICKS_BUNDLE_ENGINE=direct	✅p	✅p	✅p	🔄f	✅p	✅p	✅p	🔄f	✅p	✅p
🔄	TestAccept/bundle/resources/dashboards/change-name/DATABRICKS_BUNDLE_ENGINE=terraform	✅p	✅p	🔄f	✅p	✅p	✅p	✅p	🔄f	✅p	✅p
❌	TestAccept/bundle/resources/postgres_endpoints/basic	🙈s	🙈s	❌F	❌F	🙈s	🙈s	🙈s	🙈s	🙈s	🙈s
❌	TestAccept/bundle/resources/postgres_endpoints/basic/DATABRICKS_BUNDLE_ENGINE=direct			❌F	❌F
❌	TestAccept/bundle/resources/postgres_endpoints/basic/DATABRICKS_BUNDLE_ENGINE=terraform			❌F	❌F
❌	TestAccept/bundle/resources/postgres_endpoints/replace_existing	🙈s	🙈s	❌F	❌F	🙈s	🙈s	🙈s	🙈s	🙈s	🙈s
❌	TestAccept/bundle/resources/postgres_endpoints/replace_existing/DATABRICKS_BUNDLE_ENGINE=direct			❌F	❌F
❌	TestAccept/bundle/resources/postgres_endpoints/replace_existing/DATABRICKS_BUNDLE_ENGINE=terraform			❌F	❌F
❌	TestAccept/bundle/resources/postgres_endpoints/update_autoscaling	🙈s	🙈s	❌F	❌F	🙈s	🙈s	🙈s	🙈s	🙈s	🙈s
❌	TestAccept/bundle/resources/postgres_endpoints/update_autoscaling/DATABRICKS_BUNDLE_ENGINE=direct			❌F	❌F
❌	TestAccept/bundle/resources/postgres_endpoints/update_autoscaling/DATABRICKS_BUNDLE_ENGINE=terraform			❌F	❌F
🔄	TestAccept/bundle/resources/postgres_projects/update_display_name	🙈s	🙈s	🔄f	✅p	🙈s	🙈s	🙈s	🙈s	🙈s	🙈s
🔄	TestAccept/bundle/resources/postgres_projects/update_display_name/DATABRICKS_BUNDLE_ENGINE=terraform			🔄f	✅p
💚	TestAccept/bundle/resources/vector_search_endpoints/drift/recreated_same_name	🙈S	🙈S	💚R	💚R	🙈S	🙈S	💚R	💚R	🙈S	🙈S
🙈	TestAccept/bundle/resources/vector_search_indexes/recreate/embedding_dimension	🙈S	🙈S	🙈S	🙈S	🙈S	🙈S	🙈S	🙈S	🙈S	🙈S
🙈	TestAccept/ssh/connection	🙈S	🙈S	🙈S	🙈S	🙈S	🙈S	🙈S	🙈S	🙈S	🙈S
💚	TestFetchRepositoryInfoAPI_FromRepo	💚R	💚R	💚R	💚R	💚R	💚R	💚R	💚R	💚R	💚R
🔄	TestFetchRepositoryInfoAPI_FromRepo/root	💚R	💚R	💚R	💚R	💚R	💚R	🔄f	🔄f	💚R	💚R
🔄	TestFetchRepositoryInfoAPI_FromRepo/subdir	💚R	💚R	💚R	💚R	💚R	💚R	🔄f	🔄f	💚R	💚R

Top 50 slowest tests (at least 2 minutes):

duration	env	testname
17:12	aws windows	TestAccept/bundle/resources/clusters/lifecycle-started/DATABRICKS_BUNDLE_ENGINE=direct
15:57	aws linux	TestAccept/bundle/resources/clusters/lifecycle-started-toggle/DATABRICKS_BUNDLE_ENGINE=direct
15:35	aws-ucws linux	TestAccept/bundle/resources/clusters/lifecycle-started/DATABRICKS_BUNDLE_ENGINE=direct
13:12	gcp windows	TestAccept/bundle/resources/apps/lifecycle-started/DATABRICKS_BUNDLE_ENGINE=direct
13:02	gcp linux	TestAccept/bundle/resources/apps/lifecycle-started/DATABRICKS_BUNDLE_ENGINE=direct
10:21	aws-ucws linux	TestAccept/bundle/deploy/spark-jar-task/DATABRICKS_BUNDLE_ENGINE=direct
10:09	aws-ucws windows	TestAccept/bundle/resources/clusters/lifecycle-started/DATABRICKS_BUNDLE_ENGINE=direct
9:14	aws linux	TestAccept/bundle/deploy/spark-jar-task/DATABRICKS_BUNDLE_ENGINE=direct
9:08	azure-ucws windows	TestAccept/bundle/resources/apps/lifecycle-started/DATABRICKS_BUNDLE_ENGINE=direct
9:06	aws-ucws linux	TestAccept/bundle/resources/apps/lifecycle-started/DATABRICKS_BUNDLE_ENGINE=direct
9:00	aws linux	TestAccept/bundle/deploy/spark-jar-task/DATABRICKS_BUNDLE_ENGINE=terraform
9:00	azure windows	TestAccept/bundle/resources/apps/lifecycle-started/DATABRICKS_BUNDLE_ENGINE=direct
8:56	azure-ucws windows	TestAccept/bundle/deploy/spark-jar-task/DATABRICKS_BUNDLE_ENGINE=direct
8:48	aws-ucws windows	TestAccept/bundle/resources/apps/lifecycle-started/DATABRICKS_BUNDLE_ENGINE=direct
8:23	aws-ucws windows	TestAccept/bundle/invariant/no_drift/DATABRICKS_BUNDLE_ENGINE=direct/INPUT_CONFIG=cluster.yml.tmpl/READPLAN=
8:15	azure-ucws linux	TestAccept/bundle/resources/apps/lifecycle-started/DATABRICKS_BUNDLE_ENGINE=direct
8:14	aws-ucws windows	TestAccept/bundle/deploy/spark-jar-task/DATABRICKS_BUNDLE_ENGINE=terraform
8:09	gcp windows	TestAccept/bundle/resources/clusters/deploy/data_security_mode/DATABRICKS_BUNDLE_ENGINE=direct
8:07	gcp windows	TestAccept/bundle/resources/clusters/lifecycle-started/DATABRICKS_BUNDLE_ENGINE=direct
8:02	aws-ucws windows	TestAccept/bundle/invariant/no_drift/DATABRICKS_BUNDLE_ENGINE=direct/INPUT_CONFIG=cluster.yml.tmpl/READPLAN=1
7:55	aws linux	TestAccept/bundle/resources/apps/lifecycle-started/DATABRICKS_BUNDLE_ENGINE=direct
7:54	aws-ucws linux	TestAccept/bundle/deploy/spark-jar-task/DATABRICKS_BUNDLE_ENGINE=terraform
7:52	aws windows	TestAccept/bundle/resources/apps/lifecycle-started/DATABRICKS_BUNDLE_ENGINE=direct
7:51	aws linux	TestAccept/bundle/resources/clusters/lifecycle-started/DATABRICKS_BUNDLE_ENGINE=direct
7:46	aws windows	TestAccept/bundle/resources/clusters/deploy/update-after-create/DATABRICKS_BUNDLE_ENGINE=direct
7:40	gcp linux	TestAccept/bundle/resources/clusters/lifecycle-started/DATABRICKS_BUNDLE_ENGINE=direct
7:35	gcp windows	TestAccept/bundle/resources/clusters/deploy/local_ssd_count/DATABRICKS_BUNDLE_ENGINE=direct
7:32	azure-ucws windows	TestAccept/bundle/deploy/spark-jar-task/DATABRICKS_BUNDLE_ENGINE=terraform
7:29	aws-ucws windows	TestAccept/bundle/invariant/no_drift/DATABRICKS_BUNDLE_ENGINE=direct/INPUT_CONFIG=cluster_apply_policy_default_values.yml.tmpl/READPLAN=
7:18	aws-ucws windows	TestAccept/bundle/deploy/spark-jar-task/DATABRICKS_BUNDLE_ENGINE=direct
7:16	azure-ucws linux	TestAccept/bundle/resources/clusters/lifecycle-started/DATABRICKS_BUNDLE_ENGINE=direct
7:11	azure linux	TestAccept/bundle/resources/apps/lifecycle-started/DATABRICKS_BUNDLE_ENGINE=direct
7:10	aws-ucws windows	TestAccept/bundle/invariant/no_drift/DATABRICKS_BUNDLE_ENGINE=direct/INPUT_CONFIG=cluster_apply_policy_default_values.yml.tmpl/READPLAN=1
7:01	aws windows	TestAccept/bundle/resources/clusters/lifecycle-started-toggle/DATABRICKS_BUNDLE_ENGINE=direct
6:54	gcp linux	TestAccept/bundle/resources/clusters/deploy/local_ssd_count/DATABRICKS_BUNDLE_ENGINE=direct
6:44	aws-ucws linux	TestAccept/bundle/resources/clusters/lifecycle-started-toggle/DATABRICKS_BUNDLE_ENGINE=direct
6:42	azure windows	TestAccept/bundle/resources/clusters/lifecycle-started/DATABRICKS_BUNDLE_ENGINE=direct
6:34	aws-ucws linux	TestAccept/bundle/config-remote-sync/multiple_resources/DATABRICKS_BUNDLE_ENGINE=direct
6:27	azure-ucws windows	TestAccept/bundle/resources/clusters/lifecycle-started/DATABRICKS_BUNDLE_ENGINE=direct
6:24	azure-ucws windows	TestAccept/bundle/resources/clusters/lifecycle-started-toggle/DATABRICKS_BUNDLE_ENGINE=direct
6:17	azure-ucws linux	TestAccept/bundle/resources/apps/lifecycle-started-omitted/DATABRICKS_BUNDLE_ENGINE=direct
6:13	aws-ucws linux	TestAccept/bundle/resources/apps/lifecycle-started-omitted/DATABRICKS_BUNDLE_ENGINE=direct
6:09	azure-ucws windows	TestAccept/bundle/templates/default-python/combinations/serverless/DATABRICKS_BUNDLE_ENGINE=direct/DLT=no/NBOOK=yes/PY=no/READPLAN=1
6:05	gcp linux	TestAccept/bundle/resources/clusters/lifecycle-started-toggle/DATABRICKS_BUNDLE_ENGINE=direct
6:02	azure-ucws linux	TestAccept/bundle/config-remote-sync/multiple_resources/DATABRICKS_BUNDLE_ENGINE=terraform
5:57	azure-ucws windows	TestAccept/bundle/resources/experiments/basic/DATABRICKS_BUNDLE_ENGINE=terraform
5:55	azure-ucws linux	TestAccept/bundle/resources/apps/inline_config/DATABRICKS_BUNDLE_ENGINE=terraform
5:31	aws windows	TestAccept/bundle/deploy/spark-jar-task/DATABRICKS_BUNDLE_ENGINE=terraform
5:16	azure-ucws windows	TestAccept/bundle/templates/default-python/combinations/classic/DATABRICKS_BUNDLE_ENGINE=terraform/DLT=no/NBOOK=yes/PY=yes/READPLAN=
5:07	azure-ucws linux	TestAccept/bundle/resources/clusters/lifecycle-started-toggle/DATABRICKS_BUNDLE_ENGINE=direct

janniklasrose added 17 commits July 8, 2026 13:10

Bump to TF's 1.121.0 SDK version
0912502

Bump SDK
48c2f09

task generate-clijson
7d8e05a

Fix: add missing duration import in service.go.tmpl
c2f6de6

task generate
f8d9edd

Bump TF version
fc6cffd

task test-update
23614c9

Merge branch 'janniklasrose/sdk-bump' into janniklasrose/tf-bump
f2fbdbb

task generate-schema-map
fe7fd73

task generate-schema-map
c1b51a4

Merge branch 'janniklasrose/sdk-bump' into janniklasrose/tf-bump
1846fac

Fix lint (exhaustruct)
0c3c286

Merge branch 'janniklasrose/sdk-bump' into janniklasrose/tf-bump
8973444

task test-update
4551cc1

Update changelog for both sdk and tf
96f48f7

Normalize databricks-tf-provider/[DBTF_VERSION]
3698c32

Update test fixtures
f90a319

janniklasrose requested a review from pietern July 8, 2026 13:45

janniklasrose temporarily deployed to test-trigger-is July 8, 2026 13:46 — with GitHub Actions Inactive

Merge branch 'main' into janniklasrose/tf-bump
b7cc8da

Regenerate for better merge conflict resolution
5dab3b1

janniklasrose mentioned this pull request Jul 8, 2026
Bump TF to 1.121.0 #5857
Merged

janniklasrose temporarily deployed to test-trigger-is July 8, 2026 14:23 — with GitHub Actions Inactive

pietern approved these changes Jul 8, 2026
View reviewed changes

Comment threadlibs/testdiff/replacement.go Outdated
Comment threadlibs/testdiff/replacement.go Outdated

Base automatically changed from janniklasrose/tf-bump to mainJuly 8, 2026 15:10

Rename
d144406

Merge remote-tracking branch 'origin/main' into janniklasrose/normali…
a662e00
…ze-tf-version-in-test-fixtures

janniklasrose temporarily deployed to test-trigger-is July 8, 2026 15:31 — with GitHub Actions Inactive

janniklasrose added 2 commits July 8, 2026 17:36

Revert changes from bad merge
0932946

Rename variable
75e91e0

janniklasrose temporarily deployed to test-trigger-is July 8, 2026 15:37 — with GitHub Actions Inactive

janniklasrose enabled auto-merge July 8, 2026 15:37

janniklasrose added this pull request to the merge queue Jul 8, 2026

Merged via the queue into main with commit 05a57d9Jul 8, 2026
23 checks passed

janniklasrose deleted the janniklasrose/normalize-tf-version-in-test-fixtures branch July 8, 2026 16:37

Navigation Menu

Uh oh!

Normalize TF provider version in test fixtures - #5863

Normalize TF provider version in test fixtures#5863
janniklasrose merged 24 commits into
mainfrom
janniklasrose/normalize-tf-version-in-test-fixtures

janniklasrose commented Jul 8, 2026

Uh oh!

eng-dev-ecosystem-bot commented Jul 8, 2026•
edited
Loading

Uh oh!

Uh oh!

Uh oh!

Uh oh!

eng-dev-ecosystem-bot commented Jul 8, 2026

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

3 participants

Uh oh!

Conversation

janniklasrose commented Jul 8, 2026

Changes

Why

Tests

Uh oh!

eng-dev-ecosystem-bot commented Jul 8, 2026• edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Integration test report

Uh oh!

Uh oh!

Uh oh!

Uh oh!

eng-dev-ecosystem-bot commented Jul 8, 2026

Integration test report

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

3 participants

eng-dev-ecosystem-bot commented Jul 8, 2026•
edited
Loading