Disable non-serverless integration_whl tests on direct by denik · Pull Request #3185 · databricks/cli

denik · 2025-07-07T09:12:29Z

It was enabled prematurely in #3162

It was enabled prematurely in databricks/terraform-provider-databricks#3162

eng-dev-ecosystem-bot · 2025-07-07T09:34:20Z

	Env	✅‌pass	❌‌FAIL	💥‌PANIC	🔄‌flaky	🙈‌skip	🤯‌MISS	🪲‌BUG
❌‌	aws linux	273	12	1		365	22	8
❌‌	aws windows	276	9	2		364	22	8
❌‌	aws-ucws linux	411	9			263		12
❌‌	aws-ucws windows	412	9			262		12
❌‌	azure linux	304	1			365		12
❌‌	azure windows	293	13			364		12
❌‌	azure-ucws linux	411	11			260		12
❌‌	azure-ucws windows	412	11			259		12
🪲‌	gcp linux	302			2	369		10
❌‌	gcp windows	297	6			368		10

69 failing tests:

Test Name	aws linux	aws windows	aws-ucws linux	aws-ucws windows	azure linux	azure windows	azure-ucws linux	azure-ucws windows	gcp linux	gcp windows
TestAccept	🤯‌MISS	🤯‌MISS	🪲‌BUG	🪲‌BUG	🪲‌BUG	🪲‌BUG	🪲‌BUG	🪲‌BUG	🪲‌BUG	🪲‌BUG
TestAccept/bundle/deploy/files/no-snapshot-sync	🤯‌MISS	🤯‌MISS	✅‌pass	✅‌pass	✅‌pass	❌‌FAIL	✅‌pass	✅‌pass	✅‌pass	✅‌pass
TestAccept/bundle/deploy/files/no-snapshot-sync/DATABRICKS_CLI_DEPLOYMENT=direct-exp	🤯‌MISS	🤯‌MISS	✅‌pass	✅‌pass	✅‌pass	❌‌FAIL	✅‌pass	✅‌pass	✅‌pass	✅‌pass
TestAccept/bundle/deploy/files/no-snapshot-sync/DATABRICKS_CLI_DEPLOYMENT=terraform	🤯‌MISS	🤯‌MISS	✅‌pass	✅‌pass	✅‌pass	❌‌FAIL	✅‌pass	✅‌pass	✅‌pass	✅‌pass
TestAccept/bundle/deploy/jobs/check-metadata	🤯‌MISS	🤯‌MISS	✅‌pass	✅‌pass	✅‌pass	❌‌FAIL	✅‌pass	✅‌pass	✅‌pass	✅‌pass
TestAccept/bundle/deploy/jobs/check-metadata/DATABRICKS_CLI_DEPLOYMENT=direct-exp	🤯‌MISS	🤯‌MISS	✅‌pass	✅‌pass	✅‌pass	❌‌FAIL	✅‌pass	✅‌pass	✅‌pass	✅‌pass
TestAccept/bundle/deploy/jobs/check-metadata/DATABRICKS_CLI_DEPLOYMENT=terraform	🤯‌MISS	💥‌PANIC	✅‌pass	✅‌pass	✅‌pass	❌‌FAIL	✅‌pass	✅‌pass	✅‌pass	✅‌pass
TestAccept/bundle/deploy/jobs/fail-on-active-runs	🤯‌MISS	🤯‌MISS	✅‌pass	✅‌pass	✅‌pass	❌‌FAIL	✅‌pass	✅‌pass	✅‌pass	✅‌pass
TestAccept/bundle/deploy/jobs/fail-on-active-runs/DATABRICKS_CLI_DEPLOYMENT=direct-exp	🤯‌MISS	🤯‌MISS	✅‌pass	✅‌pass	✅‌pass	❌‌FAIL	✅‌pass	✅‌pass	✅‌pass	✅‌pass
TestAccept/bundle/deploy/jobs/fail-on-active-runs/DATABRICKS_CLI_DEPLOYMENT=terraform	🤯‌MISS	🤯‌MISS	✅‌pass	✅‌pass	✅‌pass	❌‌FAIL	✅‌pass	✅‌pass	✅‌pass	✅‌pass
TestAccept/bundle/deploy/jobs/shared-root-path	🤯‌MISS	🤯‌MISS	✅‌pass	✅‌pass	✅‌pass	✅‌pass	✅‌pass	✅‌pass	✅‌pass	✅‌pass
TestAccept/bundle/deploy/jobs/shared-root-path/DATABRICKS_CLI_DEPLOYMENT=direct-exp	🤯‌MISS	🤯‌MISS	✅‌pass	✅‌pass	✅‌pass	✅‌pass	✅‌pass	✅‌pass	✅‌pass	✅‌pass
TestAccept/bundle/deploy/jobs/shared-root-path/DATABRICKS_CLI_DEPLOYMENT=terraform	🤯‌MISS	🤯‌MISS	✅‌pass	✅‌pass	✅‌pass	✅‌pass	✅‌pass	✅‌pass	✅‌pass	✅‌pass
TestAccept/bundle/deploy/pipeline/auto-approve	🤯‌MISS	✅‌pass	✅‌pass	✅‌pass	✅‌pass	✅‌pass	✅‌pass	✅‌pass	✅‌pass	✅‌pass
TestAccept/bundle/deploy/pipeline/auto-approve/DATABRICKS_CLI_DEPLOYMENT=direct-exp	🤯‌MISS	✅‌pass	✅‌pass	✅‌pass	✅‌pass	✅‌pass	✅‌pass	✅‌pass	✅‌pass	✅‌pass
TestAccept/bundle/deploy/pipeline/auto-approve/DATABRICKS_CLI_DEPLOYMENT=terraform	🤯‌MISS	✅‌pass	✅‌pass	✅‌pass	✅‌pass	✅‌pass	✅‌pass	✅‌pass	✅‌pass	✅‌pass
TestAccept/bundle/integration_whl/base	🪲‌BUG	🪲‌BUG	🪲‌BUG	🪲‌BUG	🪲‌BUG	🪲‌BUG	🪲‌BUG	🪲‌BUG	🪲‌BUG	🪲‌BUG
TestAccept/bundle/integration_whl/custom_params	🪲‌BUG	🪲‌BUG	🪲‌BUG	🪲‌BUG	🪲‌BUG	🪲‌BUG	🪲‌BUG	🪲‌BUG	🪲‌BUG	🪲‌BUG
TestAccept/bundle/integration_whl/interactive_cluster	🪲‌BUG	🪲‌BUG	🪲‌BUG	🪲‌BUG	🪲‌BUG	🪲‌BUG	🪲‌BUG	🪲‌BUG	🪲‌BUG	🪲‌BUG
TestAccept/bundle/integration_whl/interactive_cluster_dynamic_version	🤯‌MISS	🤯‌MISS	🪲‌BUG	🪲‌BUG	🪲‌BUG	🪲‌BUG	🪲‌BUG	🪲‌BUG	🪲‌BUG	🪲‌BUG
TestAccept/bundle/integration_whl/interactive_cluster_dynamic_version/DATABRICKS_CLI_DEPLOYMENT=terraform/DATA_SECURITY_MODE=SINGLE_USER	💥‌PANIC	🤯‌MISS	🪲‌BUG	🪲‌BUG	🪲‌BUG	🪲‌BUG	🪲‌BUG	🪲‌BUG	🪲‌BUG	🪲‌BUG
TestAccept/bundle/integration_whl/interactive_cluster_dynamic_version/DATABRICKS_CLI_DEPLOYMENT=terraform/DATA_SECURITY_MODE=USER_ISOLATION	🤯‌MISS	🤯‌MISS	🪲‌BUG	🪲‌BUG	🪲‌BUG	🪲‌BUG	🪲‌BUG	🪲‌BUG	🪲‌BUG	🪲‌BUG
TestAccept/bundle/integration_whl/interactive_single_user	🪲‌BUG	🪲‌BUG	🪲‌BUG	🪲‌BUG	🪲‌BUG	🪲‌BUG	🪲‌BUG	🪲‌BUG	🪲‌BUG	🪲‌BUG
TestAccept/bundle/integration_whl/serverless	🙈‌skip	🙈‌skip	❌‌FAIL	❌‌FAIL	🙈‌skip	🙈‌skip	❌‌FAIL	❌‌FAIL	🙈‌skip	🙈‌skip
TestAccept/bundle/integration_whl/serverless/DATABRICKS_CLI_DEPLOYMENT=direct-exp			❌‌FAIL	❌‌FAIL			❌‌FAIL	❌‌FAIL
TestAccept/bundle/integration_whl/serverless/DATABRICKS_CLI_DEPLOYMENT=terraform			❌‌FAIL	❌‌FAIL			❌‌FAIL	❌‌FAIL
TestAccept/bundle/integration_whl/serverless_custom_params	🙈‌skip	🙈‌skip	❌‌FAIL	❌‌FAIL	🙈‌skip	🙈‌skip	❌‌FAIL	❌‌FAIL	🙈‌skip	🙈‌skip
TestAccept/bundle/integration_whl/serverless_custom_params/DATABRICKS_CLI_DEPLOYMENT=direct-exp			❌‌FAIL	❌‌FAIL			❌‌FAIL	❌‌FAIL
TestAccept/bundle/integration_whl/serverless_custom_params/DATABRICKS_CLI_DEPLOYMENT=terraform			❌‌FAIL	❌‌FAIL			❌‌FAIL	❌‌FAIL
TestAccept/bundle/integration_whl/serverless_dynamic_version	🙈‌skip	🙈‌skip	❌‌FAIL	❌‌FAIL	🙈‌skip	🙈‌skip	❌‌FAIL	❌‌FAIL	🙈‌skip	🙈‌skip
TestAccept/bundle/integration_whl/serverless_dynamic_version/DATABRICKS_CLI_DEPLOYMENT=direct-exp			❌‌FAIL	❌‌FAIL			❌‌FAIL	❌‌FAIL
TestAccept/bundle/integration_whl/serverless_dynamic_version/DATABRICKS_CLI_DEPLOYMENT=terraform			❌‌FAIL	❌‌FAIL			❌‌FAIL	❌‌FAIL
TestAccept/bundle/integration_whl/wrapper	🪲‌BUG	🪲‌BUG	🪲‌BUG	🪲‌BUG	🪲‌BUG	🪲‌BUG	🪲‌BUG	🪲‌BUG	🙈‌skip	🙈‌skip
TestAccept/bundle/integration_whl/wrapper_custom_params	🪲‌BUG	🪲‌BUG	🪲‌BUG	🪲‌BUG	🪲‌BUG	🪲‌BUG	🪲‌BUG	🪲‌BUG	🙈‌skip	🙈‌skip
TestAccept/bundle/local_state_staleness	🤯‌MISS	🤯‌MISS	✅‌pass	✅‌pass	✅‌pass	❌‌FAIL	✅‌pass	✅‌pass	✅‌pass	✅‌pass
TestAccept/bundle/local_state_staleness/DATABRICKS_CLI_DEPLOYMENT=direct-exp	🤯‌MISS	🤯‌MISS	✅‌pass	✅‌pass	✅‌pass	❌‌FAIL	✅‌pass	✅‌pass	✅‌pass	✅‌pass
TestAccept/bundle/local_state_staleness/DATABRICKS_CLI_DEPLOYMENT=terraform	🤯‌MISS	✅‌pass	✅‌pass	✅‌pass	✅‌pass	✅‌pass	✅‌pass	✅‌pass	✅‌pass	✅‌pass
TestAccept/bundle/resources/clusters/run/spark_python_task	🪲‌BUG	🪲‌BUG	🪲‌BUG	🪲‌BUG	🪲‌BUG	🪲‌BUG	🪲‌BUG	🪲‌BUG	🪲‌BUG	🪲‌BUG
TestAccept/bundle/resources/pipelines	❌‌FAIL	❌‌FAIL	✅‌pass	✅‌pass	✅‌pass	✅‌pass	✅‌pass	✅‌pass	✅‌pass	✅‌pass
TestAccept/bundle/resources/pipelines/DATABRICKS_CLI_DEPLOYMENT=direct-exp	❌‌FAIL	❌‌FAIL	✅‌pass	✅‌pass	✅‌pass	✅‌pass	✅‌pass	✅‌pass	✅‌pass	✅‌pass
TestAccept/bundle/resources/pipelines/DATABRICKS_CLI_DEPLOYMENT=terraform	❌‌FAIL	✅‌pass	✅‌pass	✅‌pass	✅‌pass	✅‌pass	✅‌pass	✅‌pass	✅‌pass	✅‌pass
TestAccept/bundle/run/app-with-job	🪲‌BUG	🪲‌BUG	🪲‌BUG	🪲‌BUG	🪲‌BUG	🪲‌BUG	🪲‌BUG	🪲‌BUG	🪲‌BUG	🪲‌BUG
TestAccept/bundle/templates/default-python/combinations/classic	✅‌pass	✅‌pass	✅‌pass	✅‌pass	✅‌pass	✅‌pass	❌‌FAIL	❌‌FAIL	✅‌pass	❌‌FAIL
TestAccept/bundle/templates/default-python/combinations/classic/DATABRICKS_CLI_DEPLOYMENT=direct-exp/DLT=yes/NBOOK=no/PY=no	✅‌pass	✅‌pass	✅‌pass	✅‌pass	✅‌pass	✅‌pass	✅‌pass	✅‌pass	✅‌pass	❌‌FAIL
TestAccept/bundle/templates/default-python/combinations/classic/DATABRICKS_CLI_DEPLOYMENT=direct-exp/DLT=yes/NBOOK=no/PY=yes	✅‌pass	✅‌pass	✅‌pass	✅‌pass	✅‌pass	✅‌pass	✅‌pass	✅‌pass	✅‌pass	❌‌FAIL
TestAccept/bundle/templates/default-python/combinations/classic/DATABRICKS_CLI_DEPLOYMENT=direct-exp/DLT=yes/NBOOK=yes/PY=no	✅‌pass	✅‌pass	✅‌pass	✅‌pass	✅‌pass	✅‌pass	✅‌pass	✅‌pass	✅‌pass	❌‌FAIL
TestAccept/bundle/templates/default-python/combinations/classic/DATABRICKS_CLI_DEPLOYMENT=terraform/DLT=no/NBOOK=yes/PY=no	✅‌pass	✅‌pass	✅‌pass	✅‌pass	✅‌pass	✅‌pass	❌‌FAIL	✅‌pass	✅‌pass	✅‌pass
TestAccept/bundle/templates/default-python/combinations/classic/DATABRICKS_CLI_DEPLOYMENT=terraform/DLT=yes/NBOOK=yes/PY=yes	✅‌pass	✅‌pass	✅‌pass	✅‌pass	✅‌pass	✅‌pass	✅‌pass	❌‌FAIL	✅‌pass	✅‌pass
TestAccept/selftest/record_cloud/workspace-file-io	✅‌pass	❌‌FAIL	✅‌pass	✅‌pass	✅‌pass	✅‌pass	✅‌pass	✅‌pass	✅‌pass	✅‌pass
TestAccept/selftest/record_cloud/workspace-file-io/DATABRICKS_CLI_DEPLOYMENT=direct-exp	✅‌pass	❌‌FAIL	✅‌pass	✅‌pass	✅‌pass	✅‌pass	✅‌pass	✅‌pass	✅‌pass	✅‌pass
TestAccept/terraform	✅‌pass	✅‌pass	✅‌pass	✅‌pass	❌‌FAIL	✅‌pass	✅‌pass	✅‌pass	✅‌pass	✅‌pass
TestFetchRepositoryInfoAPI_FromRepo	❌‌FAIL	❌‌FAIL	✅‌pass	✅‌pass	✅‌pass	✅‌pass	✅‌pass	✅‌pass	✅‌pass	❌‌FAIL
TestFilerWorkspaceNotebook	✅‌pass	✅‌pass	✅‌pass	✅‌pass	✅‌pass	❌‌FAIL	✅‌pass	✅‌pass	✅‌pass	✅‌pass
TestFilerWorkspaceNotebook/pythonJupyterNb.ipynb	✅‌pass	✅‌pass	✅‌pass	✅‌pass	✅‌pass	❌‌FAIL	✅‌pass	✅‌pass	✅‌pass	✅‌pass
TestInprocessMode	🤯‌MISS	🤯‌MISS	🙈‌skip	🙈‌skip	🙈‌skip	🙈‌skip	🙈‌skip	🙈‌skip	🙈‌skip	🙈‌skip
TestLock	✅‌pass	❌‌FAIL	✅‌pass	✅‌pass	✅‌pass	✅‌pass	✅‌pass	✅‌pass	🔄‌flaky	✅‌pass
TestReposCreateWithProvider	❌‌FAIL	❌‌FAIL	✅‌pass	✅‌pass	✅‌pass	✅‌pass	✅‌pass	✅‌pass	✅‌pass	✅‌pass
TestReposCreateWithoutProvider	❌‌FAIL	❌‌FAIL	✅‌pass	✅‌pass	✅‌pass	✅‌pass	✅‌pass	✅‌pass	✅‌pass	✅‌pass
TestReposDeleteByID	❌‌FAIL	✅‌pass	✅‌pass	✅‌pass	✅‌pass	✅‌pass	✅‌pass	✅‌pass	🔄‌flaky	✅‌pass
TestReposDeleteByPath	❌‌FAIL	❌‌FAIL	✅‌pass	✅‌pass	✅‌pass	✅‌pass	✅‌pass	✅‌pass	✅‌pass	✅‌pass
TestReposGet	❌‌FAIL	✅‌pass	✅‌pass	✅‌pass	✅‌pass	✅‌pass	✅‌pass	✅‌pass	✅‌pass	✅‌pass
TestSyncEnsureRemotePathIsUsableIfRepoDoesntExist	✅‌pass	🤯‌MISS	✅‌pass	✅‌pass	✅‌pass	✅‌pass	✅‌pass	✅‌pass	✅‌pass	✅‌pass
TestSyncEnsureRemotePathIsUsableIfRepoExists	✅‌pass	🤯‌MISS	✅‌pass	✅‌pass	✅‌pass	✅‌pass	✅‌pass	✅‌pass	✅‌pass	❌‌FAIL
TestSyncEnsureRemotePathIsUsableInWorkspace	✅‌pass	🤯‌MISS	✅‌pass	✅‌pass	✅‌pass	✅‌pass	✅‌pass	✅‌pass	✅‌pass	✅‌pass
TestSyncFullFileSync	❌‌FAIL	✅‌pass	✅‌pass	✅‌pass	✅‌pass	✅‌pass	✅‌pass	✅‌pass	✅‌pass	✅‌pass
TestSyncIncrementalFileSync	❌‌FAIL	✅‌pass	✅‌pass	✅‌pass	✅‌pass	✅‌pass	✅‌pass	✅‌pass	✅‌pass	✅‌pass
TestSyncIncrementalSyncFileToPythonNotebook	✅‌pass	💥‌PANIC	✅‌pass	✅‌pass	✅‌pass	✅‌pass	✅‌pass	✅‌pass	✅‌pass	✅‌pass
TestSyncIncrementalSyncPythonNotebookDelete	✅‌pass	🤯‌MISS	✅‌pass	✅‌pass	✅‌pass	✅‌pass	✅‌pass	✅‌pass	✅‌pass	✅‌pass
TestSyncNestedFolderDoesntFailOnNonEmptyDirectory	❌‌FAIL	✅‌pass	✅‌pass	✅‌pass	✅‌pass	✅‌pass	✅‌pass	✅‌pass	✅‌pass	✅‌pass

andrewnester

I think you also need to update related out.test.toml. These tests are run on CloudSlow only so the config change did not fail on PR

This reverts commit eab069b.

It was enabled prematurely in #3162

Disable non-serverless integration_whl tests on direct
86e8736
It was enabled prematurely in databricks/terraform-provider-databricks#3162

denik requested review from andrewnester, anton-107, pietern and shreyas-goenka as code owners July 7, 2025 09:12

denik temporarily deployed to test-trigger-is July 7, 2025 09:12 — with GitHub Actions Inactive

andrewnester reviewed Jul 7, 2025
View reviewed changes

update out.test.toml
18e2009

denik temporarily deployed to test-trigger-is July 7, 2025 12:37 — with GitHub Actions Inactive

denik requested a review from andrewnester July 7, 2025 12:42

andrewnester approved these changes Jul 7, 2025
View reviewed changes

tmp enable CloudSlow tests
eab069b

denik temporarily deployed to test-trigger-is July 7, 2025 12:55 — with GitHub Actions Inactive

Revert "tmp enable CloudSlow tests"
3ad9171
This reverts commit eab069b.

denik temporarily deployed to test-trigger-is July 7, 2025 13:03 — with GitHub Actions Inactive

denik merged commit b8a7737 into mainJul 7, 2025
12 of 13 checks passed

denik deleted the denik/acc-disable-integration_whl-direct branch July 7, 2025 13:05

denik added a commit that referenced this pull request May 20, 2026
Disable non-serverless integration_whl tests on direct (#3185)
355937e
It was enabled prematurely in #3162

Navigation Menu

Uh oh!

Disable non-serverless integration_whl tests on direct - #3185

Disable non-serverless integration_whl tests on direct#3185
denik merged 4 commits into
mainfrom
denik/acc-disable-integration_whl-direct

denik commented Jul 7, 2025•
edited
Loading

Uh oh!

eng-dev-ecosystem-bot commented Jul 7, 2025•
edited
Loading

Uh oh!

andrewnester left a comment

Uh oh!

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

3 participants

Uh oh!

Conversation

denik commented Jul 7, 2025• edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

eng-dev-ecosystem-bot commented Jul 7, 2025• edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

andrewnester left a comment

Choose a reason for hiding this comment

Uh oh!

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

3 participants

denik commented Jul 7, 2025•
edited
Loading

eng-dev-ecosystem-bot commented Jul 7, 2025•
edited
Loading