Skip to content

acc: Added test for new Lakeflow pipeline deployment - #3578

Merged
andrewnester merged 2 commits into
mainfrom
feat/deploy-lakeflow-pipelines
Sep 9, 2025
Merged

acc: Added test for new Lakeflow pipeline deployment#3578
andrewnester merged 2 commits into
mainfrom
feat/deploy-lakeflow-pipelines

Conversation

@andrewnester

Copy link
Copy Markdown
Contributor

Changes

Added test for new Lakeflow pipeline deployment

Why

To confirm that new Lakeflow pipelines are deployed correctly

@@ -0,0 +1,5 @@
Local = true
Cloud = false

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Curious, what makes this pipeline "lakeflow pipeline"?

And should we test it against cloud?

Copy link
Copy Markdown
ContributorAuthor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Using root_path and libraries globhttps://docs.databricks.com/api/workspace/pipelines/create#root_path

Testing against cloud makes sense, will add it

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Using root_path and libraries glob https://docs.databricks.com/api/workspace/pipelines/create#root_path

Thanks, I'd add this info as a comment to databricks.yml

@eng-dev-ecosystem-bot

eng-dev-ecosystem-bot commented Sep 9, 2025

Copy link
Copy Markdown
Collaborator

Run: 17583111990

Env✅​pass🔄​flaky🙈​skip
✅​aws linux311523
✅​aws windows312522
✅​aws-ucws linux423421
✅​aws-ucws windows424420
✅​azure linux311522
🔄​azure windows3111521
✅​azure-ucws linux423420
✅​azure-ucws windows424419
✅​gcp linux310524
🔄​gcp windows3083523
Test Nameazure windowsgcp windows
TestAccept✅​pass🔄​flaky
TestAccept/bundle/deploy/files/no-snapshot-sync✅​pass🔄​flaky
TestAccept/bundle/deploy/files/no-snapshot-sync/DATABRICKS_CLI_DEPLOYMENT=terraform✅​pass🔄​flaky
TestFetchRepositoryInfoAPI_FromRepo🔄​flaky✅​pass

@andrewnester
andrewnester added this pull request to the merge queueSep 9, 2025
github-merge-queueBot pushed a commit that referenced this pull request Sep 9, 2025
## Changes
Added test for new Lakeflow pipeline deployment
## Why
To confirm that new Lakeflow pipelines are deployed correctly
<!-- If your PR needs to be included in the release notes for next
release,
add a separate entry in NEXT_CHANGELOG.md as part of your PR. -->
Merged via the queue into main with commit 9429f2aSep 9, 2025
13 checks passed
@andrewnester
andrewnester deleted the feat/deploy-lakeflow-pipelines branch September 9, 2025 13:54
github-merge-queueBot pushed a commit that referenced this pull request Sep 17, 2025
## Changes
Added new Lakeflow Pipelines support for `bundle generate`
## Why
Now if the pipeline refers to `root_path` we download the whole content
of it and rewrite any related `libraries.glob` paths pointing to the
same remote paths to the local ones
## Tests
Added an acceptance test
Confirmed that they can be deployed here:
#3578
<!-- If your PR needs to be included in the release notes for next
release,
add a separate entry in NEXT_CHANGELOG.md as part of your PR. -->
denik pushed a commit that referenced this pull request May 20, 2026
## Changes
Added test for new Lakeflow pipeline deployment
## Why
To confirm that new Lakeflow pipelines are deployed correctly
<!-- If your PR needs to be included in the release notes for next
release,
add a separate entry in NEXT_CHANGELOG.md as part of your PR. -->
denik pushed a commit that referenced this pull request May 20, 2026
## Changes
Added new Lakeflow Pipelines support for `bundle generate`
## Why
Now if the pipeline refers to `root_path` we download the whole content
of it and rewrite any related `libraries.glob` paths pointing to the
same remote paths to the local ones
## Tests
Added an acceptance test
Confirmed that they can be deployed here:
#3578
<!-- If your PR needs to be included in the release notes for next
release,
add a separate entry in NEXT_CHANGELOG.md as part of your PR. -->
Sign up for freeto join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

4 participants

@andrewnester@eng-dev-ecosystem-bot@denik@shreyas-goenka