Uh oh!
There was an error while loading. Please reload this page.
direct: Support bind/unbind - #4279
Merged
Merged
Conversation
Collaborator
Commit: 244d468
19 interesting tests: 10 KNOWN, 7 RECOVERED, 1 SKIP, 1 flaky
Top 43 slowest tests (at least 2 minutes):
|
denikforce-pushed
the
denik/bind-unbind-direct
branch
from
January 14, 2026 15:05
1033a38 to
7bd6fabComparedenik
marked this pull request as ready for review
January 14, 2026 15:37
denik
requested review from
andrewnester, anton-107, pietern and shreyas-goenka
as code ownersJanuary 14, 2026 15:37
| func jsonDump(v any) string { | ||
| b, err := json.Marshal(v) | ||
| if err != nil { | ||
| return fmt.Sprintf("value=%v marshall error=%s", v, err) |
Contributor
There was a problem hiding this comment.
This should throw an internal error, not be limited to a stdout.
ContributorAuthor
There was a problem hiding this comment.
I changed it to warning. There error here is unlikely, hard to address by users and most likely does not affect operation. The whole rendering of changes can be considered optional.
Contributor
There was a problem hiding this comment.
It should still return an error though here. If there's an internal error, that gives users a call to action to report to us.
The risk is someone deploying directly deploying with the --auto-approve flag after running bind.
ContributorAuthor
There was a problem hiding this comment.
We ask the users whether to proceed and there's always a risk associated with --auto-approve.
| ### CLI | ||
| ### Bundles | ||
| * engine/direct: Support bind & unbind. ([#4279](https://github.com/databricks/cli/pull/4279)) |
Contributor
There was a problem hiding this comment.
Changelog entry could be a bit more readbale
Suggested change
| *engine/direct: Support bind & unbind. ([#4279](https://github.com/databricks/cli/pull/4279)) | |
| *Add support for bind and unbind when using the direct deployment engine ([#4279](https://github.com/databricks/cli/pull/4279)) |
ContributorAuthor
There was a problem hiding this comment.
I use "engine/direct: " prefix in other entries, easier to scan for all changes.
| @@ -0,0 +1,4 @@ | |||
| { | |||
| "name": "/Workspace/Users/[USERNAME]/test-experiment[UNIQUE_NAME]", | |||
Contributor
There was a problem hiding this comment.
What's the reason for this diff?
Contributor
There was a problem hiding this comment.
Tried it out. The backend removes the /Workspace prefix. Does this also occur on cloud? Based on my testing both TF and DABs create the experiment with the /Workspace prefix included:
From TF:
2026-01-14T18:21:58.341+0100 [DEBUG] provider.terraform-provider-databricks_v1.97.0: POST /api/2.0/mlflow/experiments/create
> {
> "name": "/Workspace/Users/shreyas.goenka@databricks.com/test-experiment"
> }
< HTTP/2.0 200 OK
< {
< "experiment_id": "1168670625037178"
< }: @module=databricks tf_mux_provider=tf5to6server.v5tov6Server @caller=/home/runner/work/terraform-provider-databricks/terraform-provider-databricks/logger/logger.go:38 tf_provider_addr=registry.terraform.io/databricks/databricks tf_req_id=07161d19-0a80-7fd3-31d5-26418985a129 tf_rpc=ConfigureProvider timestamp="2026-01-14T18:21:58.340+0100"
2026-01-14T18:21:58.555+0100 [DEBUG] provider.terraform-provider-databricks_v1.97.0: GET /api/2.0/mlflow/experiments/get?experiment_id=1168670625037178
< HTTP/2.0 200 OK
< {
< "experiment": {
< "artifact_location": "dbfs:/databricks/mlflow-tracking/1168670625037178",
< "creation_time": 1768411318324,
< "experiment_id": "1168670625037178",
< "last_update_time": 1768411318324,
< "lifecycle_stage": "active",
< "name": "/Users/shreyas.goenka@databricks.com/test-experiment",
< "tags": [
< {
< "key": "mlflow.ownerId",
< "value": "7315180364335929"
< },
< {
< "key": "mlflow.experiment.sourceName",
< "value": "/Users/shreyas.goenka@databricks.com/test-experiment"
< },
< {
< "key": "mlflow.ownerId",
< "value": "7315180364335929"
< },
< {
< "key": "mlflow.ownerEmail",
< "value": "shreyas.goenka@databricks.com"
< },
< {
< "key": "mlflow.experimentType",
< "value": "MLFLOW_EXPERIMENT"
< }
< ]
< }
< }
From DABs:
{
"experiment": {
"artifact_location":"dbfs:/databricks/mlflow-tracking/1168670625040732",
"creation_time":1768411490689,
"experiment_id":"1168670625040732",
"last_update_time":1768411490689,
"lifecycle_stage":"active",
"name":"/Users/shreyas.goenka@databricks.com/test-experiment-bundle",
"tags": [
{
"key":"mlflow.ownerId",
"value":"7315180364335929"
},
{
"key":"mlflow.experiment.sourceName",
"value":"/Users/shreyas.goenka@databricks.com/test-experiment-bundle"
},
{
"key":"mlflow.ownerId",
"value":"7315180364335929"
},
{
"key":"mlflow.ownerEmail",
"value":"shreyas.goenka@databricks.com"
},
{
"key":"mlflow.experimentType",
"value":"MLFLOW_EXPERIMENT"
}
]
}
}
ContributorAuthor
There was a problem hiding this comment.
The real backend does remove the prefix. I'll disable this test on Cloud for now.
| "queue": { | ||
| "enabled":true | ||
| }, | ||
| "run_as": { |
Contributor
There was a problem hiding this comment.
suggestion: You can set run_as in the test and then keep the test output same for direct and TF. I presume this is happening because of a default on the TF side?
ContributorAuthor
There was a problem hiding this comment.
I'm hesitant to tweak configs to remove these differences, it's good to be aware of them.
| "enabled":true | ||
| }, | ||
| "run_as": { | ||
| "user_name":"[USERNAME]" |
Contributor
There was a problem hiding this comment.
Same as the previous one, up to you though.
| Ignore = [".databricks"] | ||
| # Pipelines is marked for update, not recreation on direct. | ||
| EnvMatrix.DATABRICKS_BUNDLE_ENGINE = ["terraform"] |
Contributor
There was a problem hiding this comment.
Why is it not a recreate on direct as well? In TF this is the reason given:
~ catalog = "old_catalog" -> "main" # forces replacement
This should hold true for direct as well.
ContributorAuthor
There was a problem hiding this comment.
The test used incorrect configuration (on cloud, it gives Error: Spec contains both storage: old_storage and catalog: old_catalog, only one of storage or catalog can be specified.).
I've enabled this test on cloud, fixed the configuration and now it works on direct as well.
update secret_scopes tests add sort_acls_json update secret_acls.go support groups creation support groups - cont script clean up bind/unbidn direct: Remove unnecessary error wrapping We already have "reading config" prefix at caller side. Noticed this error message: Error: reading config: reading config: unsupported resource type: quality_monitors exclude quality_monitors add auto-approve check add volume_id to testserver wip fix add nolint check if already managed update update WIP WIP
denikforce-pushed
the
denik/bind-unbind-direct
branch
from
January 15, 2026 09:50
8e80b7a to
6aee674Comparedenikforce-pushed
the
denik/bind-unbind-direct
branch
from
January 15, 2026 10:12
6aee674 to
60dade4Compareshreyas-goenka
approved these changes
Jan 15, 2026
eng-dev-ecosystem-bot
commented
Jan 15, 2026
Collaborator
Commit: cc6f143
26 interesting tests: 10 KNOWN, 8 RECOVERED, 7 flaky, 1 SKIP
Top 50 slowest tests (at least 2 minutes):
|
deco-sdk-taggingBot
added a commit
that referenced
this pull request
Jan 21, 2026
## Release v0.284.0 ### Bundles * Pass additional Azure DevOps `SYSTEM_*` environment variables to Terraform for OIDC authentication: `SYSTEM_COLLECTIONURI`, `SYSTEM_DEFINITIONID`, `SYSTEM_HOSTTYPE`, `SYSTEM_JOBID`, `SYSTEM_TEAMPROJECT` ([#4318](#4318)) * Add support for valueFrom property (similar to app.yaml) inside Apps config field in bundle configuration ([#4297](#4297)) * engine/direct: Support bind & unbind. ([#4279](#4279)) * engine/direct: Ignore changes between nulls and empty slices/maps (([#4313](#4313))) * engine/direct: Ignore changes between nulls and empty structs (([#4338](#4338))) * On terraform `bundle plan -o json` will no longer include plan_version key, it's intended for direct engine only (([#4314](#4314)))
denik added a commit
that referenced
this pull request
May 20, 2026
## Why Closes#4061 ## Tests Existing tests all pass. bind/experiments test shows difference in final result, this is unrelated to bind and issue with experiments resource.
denik pushed a commit
that referenced
this pull request
May 20, 2026
## Release v0.284.0 ### Bundles * Pass additional Azure DevOps `SYSTEM_*` environment variables to Terraform for OIDC authentication: `SYSTEM_COLLECTIONURI`, `SYSTEM_DEFINITIONID`, `SYSTEM_HOSTTYPE`, `SYSTEM_JOBID`, `SYSTEM_TEAMPROJECT` ([#4318](#4318)) * Add support for valueFrom property (similar to app.yaml) inside Apps config field in bundle configuration ([#4297](#4297)) * engine/direct: Support bind & unbind. ([#4279](#4279)) * engine/direct: Ignore changes between nulls and empty slices/maps (([#4313](#4313))) * engine/direct: Ignore changes between nulls and empty structs (([#4338](#4338))) * On terraform `bundle plan -o json` will no longer include plan_version key, it's intended for direct engine only (([#4314](#4314)))
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for freeto join this conversation on GitHub.
Already have an account?
Sign in to comment
3 participants
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Why
Closes#4061
Tests
Existing tests all pass.
bind/experiments test shows difference in final result, this is unrelated to bind and issue with experiments resource.