Skip to content

Remove unnecessary GET call in pipeline runner - #1850

Merged
shreyas-goenka merged 4 commits into
mainfrom
remove-uncessary-get
Dec 31, 2024
Merged

Remove unnecessary GET call in pipeline runner#1850
shreyas-goenka merged 4 commits into
mainfrom
remove-uncessary-get

Conversation

@shreyas-goenka

@shreyas-goenkashreyas-goenka commented Oct 21, 2024

Copy link
Copy Markdown
Contributor

Changes

This GET API call is unnecessary and serves no purpose. Let's remove it. Noticed this when I was adding a unit test for the pipeline runner here: #1849

Tests

Manually.

Case 1: The pipeline does not exist

Before:

➜ my_project git:(master) ✗ databricks bundle run my_project_pipeline -p dogfood
Error: User shreyas.goenka@databricks.com does not have View permissions on pipeline 9941901a-e48b-4d04-b6ba-e0072ad126bg.

After:

➜ my_project git:(master) ✗ cli bundle run my_project_pipeline -p dogfood
Error: User shreyas.goenka@databricks.com does not have Run permissions on pipeline 9941901a-e48b-4d04-b6ba-e0072ad126bg.

Case 2: Pipeline exists

Before:

➜ my_project git:(master) ✗ databricks bundle run my_project_pipeline -p dogfood --restart
Update URL: https://e2-dogfood.staging.cloud.databricks.com/#joblist/pipelines/9941901a-e48b-4d04-b6ba-e0072ad126bf/updates/0f988d62-9ec7-49f1-b429-5572ece3a9aa
2024-11-18T15:30:36.054Z update_progress INFO "Update 0f988d is WAITING_FOR_RESOURCES."

After:

➜ my_project git:(master) ✗ cli bundle run my_project_pipeline -p dogfood --restart
Update URL: https://e2-dogfood.staging.cloud.databricks.com/#joblist/pipelines/9941901a-e48b-4d04-b6ba-e0072ad126bf/updates/87b43350-6186-4a9b-9d0e-38da2ecf33ae
2024-11-18T15:28:27.144Z update_progress INFO "Update 87b433 is WAITING_FOR_RESOURCES."

@pietern

Copy link
Copy Markdown
Contributor

@shreyas-goenka Do you want to proceed with this?

@shreyas-goenkashreyas-goenka changed the title Remove unnecessary API call in pipeline runnerRemove unnecessary GET call in pipeline runnerNov 18, 2024
@eng-dev-ecosystem-bot

Copy link
Copy Markdown
Collaborator

Test Details: go/deco-tests/11895733199

@shreyas-goenka
shreyas-goenka marked this pull request as ready for review November 18, 2024 15:35
@github-actions

Copy link
Copy Markdown
Contributor

If integration tests don't run automatically, an authorized user can run them manually by following the instructions below:

Trigger:
go/deco-tests-run/cli

Inputs:

  • PR number: 1850
  • Commit SHA: c296299ad29b2a74a4b8d542d5da4d3f5927ddea

Checks will be approved automatically on success.

@shreyas-goenka
shreyas-goenka added this pull request to the merge queueDec 31, 2024
Merged via the queue into main with commit 511db52Dec 31, 2024
@shreyas-goenka
shreyas-goenka deleted the remove-uncessary-get branch December 31, 2024 09:58
denik pushed a commit that referenced this pull request May 20, 2026
## Changes
This GET API call is unnecessary and serves no purpose. Let's remove it.
Noticed this when I was adding a unit test for the pipeline runner here:
#1849
## Tests
Manually. ### Case 1: The pipeline does not exist
Before:
```
➜ my_project git:(master) ✗ databricks bundle run my_project_pipeline -p dogfood
Error: User shreyas.goenka@databricks.com does not have View permissions on pipeline 9941901a-e48b-4d04-b6ba-e0072ad126bg.
```
After:
```
➜ my_project git:(master) ✗ cli bundle run my_project_pipeline -p dogfood
Error: User shreyas.goenka@databricks.com does not have Run permissions on pipeline 9941901a-e48b-4d04-b6ba-e0072ad126bg.
```
### Case 2: Pipeline exists
Before:
```
➜ my_project git:(master) ✗ databricks bundle run my_project_pipeline -p dogfood --restart
Update URL: https://e2-dogfood.staging.cloud.databricks.com/#joblist/pipelines/9941901a-e48b-4d04-b6ba-e0072ad126bf/updates/0f988d62-9ec7-49f1-b429-5572ece3a9aa
2024-11-18T15:30:36.054Z update_progress INFO "Update 0f988d is WAITING_FOR_RESOURCES."
```
After:
```
➜ my_project git:(master) ✗ cli bundle run my_project_pipeline -p dogfood --restart
Update URL: https://e2-dogfood.staging.cloud.databricks.com/#joblist/pipelines/9941901a-e48b-4d04-b6ba-e0072ad126bf/updates/87b43350-6186-4a9b-9d0e-38da2ecf33ae
2024-11-18T15:28:27.144Z update_progress INFO "Update 87b433 is WAITING_FOR_RESOURCES."
```
Sign up for freeto join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

5 participants

@shreyas-goenka@pietern@eng-dev-ecosystem-bot@denik@andrewnester