Skip to content

Report all empty resources present in error diagnostic - #1685

Merged
shreyas-goenka merged 7 commits into
mainfrom
multi-location-undefined
Aug 20, 2024
Merged

Report all empty resources present in error diagnostic#1685
shreyas-goenka merged 7 commits into
mainfrom
multi-location-undefined

Conversation

@shreyas-goenka

Copy link
Copy Markdown
Contributor

Changes

This PR addressed post-merge feedback from #1673.

Tests

Unit tests, and manually.

Error: experiment undefined-experiment is not defined
at resources.experiments.undefined-experiment
in databricks.yml:11:26
Error: job undefined-job is not defined
at resources.jobs.undefined-job
in databricks.yml:6:19
Error: pipeline undefined-pipeline is not defined
at resources.pipelines.undefined-pipeline
in databricks.yml:14:24
Name: undefined-job
Target: default
Found 3 errors

assert.Len(t, b.Config.Resources.Pipelines, 1)

p := b.Config.Resources.Pipelines["nyc_taxi_pipeline"]
l := b.Config.GetLocation("resources.pipelines.nyc_taxi_pipeline")

Copy link
Copy Markdown
ContributorAuthor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Discussed offline with @pietern. We are removing these assertions to keep the unit tests symmetric with the ones in job_and_pipeline_test.go

@shreyas-goenka
shreyas-goenka marked this pull request as ready for review August 15, 2024 15:59
@shreyas-goenka
shreyas-goenka marked this pull request as draft August 15, 2024 16:02
@shreyas-goenka
shreyas-goenka marked this pull request as ready for review August 15, 2024 18:21

@pieternpietern left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thanks!

@shreyas-goenka
shreyas-goenka added this pull request to the merge queueAug 20, 2024
Merged via the queue into main with commit 242d4b5Aug 20, 2024
@shreyas-goenka
shreyas-goenka deleted the multi-location-undefined branch August 20, 2024 00:28
andrewnester added a commit that referenced this pull request Aug 21, 2024
CLI:
* Added filtering flags for cluster list commands ([#1703](#1703)).
Bundles:
* Remove reference to "dbt" in the default-sql template ([#1696](#1696)).
* Pause continuous pipelines when 'mode: development' is used ([#1590](#1590)).
* Add configurable presets for name prefixes, tags, etc. ([#1490](#1490)).
* Report all empty resources present in error diagnostic ([#1685](#1685)).
* Improves detection of PyPI package names in environment dependencies ([#1699](#1699)).
* [DAB] Add support for requirements libraries in Job Tasks ([#1543](#1543)).
* Add paths field to bundle sync configuration ([#1694](#1694)).
Internal:
* Add `import` option for PyDABs ([#1693](#1693)).
* Make fileset take optional list of paths to list ([#1684](#1684)).
* Pass through paths argument to libs/sync ([#1689](#1689)).
* Correctly mark package names with versions as remote libraries ([#1697](#1697)).
* Share test initializer in common helper function ([#1695](#1695)).
* Make `pydabs/venv_path` optional ([#1687](#1687)).
* Use API mocks for duplicate path errors in workspace files extensions client ([#1690](#1690)).
* Fix prefix preset used for UC schemas ([#1704](#1704)).
github-merge-queueBot pushed a commit that referenced this pull request Aug 22, 2024
CLI:
* Added filtering flags for cluster list commands
([#1703](#1703)).
Bundles:
* Remove reference to "dbt" in the default-sql template
([#1696](#1696)).
* Pause continuous pipelines when 'mode: development' is used
([#1590](#1590)).
* Add configurable presets for name prefixes, tags, etc.
([#1490](#1490)).
* Report all empty resources present in error diagnostic
([#1685](#1685)).
* Improves detection of PyPI package names in environment dependencies
([#1699](#1699)).
* [DAB] Add support for requirements libraries in Job Tasks
([#1543](#1543)).
* Add paths field to bundle sync configuration
([#1694](#1694)).
Internal:
* Add `import` option for PyDABs
([#1693](#1693)).
* Make fileset take optional list of paths to list
([#1684](#1684)).
* Pass through paths argument to libs/sync
([#1689](#1689)).
* Correctly mark package names with versions as remote libraries
([#1697](#1697)).
* Share test initializer in common helper function
([#1695](#1695)).
* Make `pydabs/venv_path` optional
([#1687](#1687)).
* Use API mocks for duplicate path errors in workspace files extensions
client ([#1690](#1690)).
* Fix prefix preset used for UC schemas
([#1704](#1704)).
denik pushed a commit that referenced this pull request May 20, 2026
## Changes
This PR addressed post-merge feedback from
#1673.
## Tests
Unit tests, and manually.
```
Error: experiment undefined-experiment is not defined
at resources.experiments.undefined-experiment
in databricks.yml:11:26
Error: job undefined-job is not defined
at resources.jobs.undefined-job
in databricks.yml:6:19
Error: pipeline undefined-pipeline is not defined
at resources.pipelines.undefined-pipeline
in databricks.yml:14:24
Name: undefined-job
Target: default
Found 3 errors
```
denik pushed a commit that referenced this pull request May 20, 2026
CLI:
* Added filtering flags for cluster list commands
([#1703](#1703)).
Bundles:
* Remove reference to "dbt" in the default-sql template
([#1696](#1696)).
* Pause continuous pipelines when 'mode: development' is used
([#1590](#1590)).
* Add configurable presets for name prefixes, tags, etc.
([#1490](#1490)).
* Report all empty resources present in error diagnostic
([#1685](#1685)).
* Improves detection of PyPI package names in environment dependencies
([#1699](#1699)).
* [DAB] Add support for requirements libraries in Job Tasks
([#1543](#1543)).
* Add paths field to bundle sync configuration
([#1694](#1694)).
Internal:
* Add `import` option for PyDABs
([#1693](#1693)).
* Make fileset take optional list of paths to list
([#1684](#1684)).
* Pass through paths argument to libs/sync
([#1689](#1689)).
* Correctly mark package names with versions as remote libraries
([#1697](#1697)).
* Share test initializer in common helper function
([#1695](#1695)).
* Make `pydabs/venv_path` optional
([#1687](#1687)).
* Use API mocks for duplicate path errors in workspace files extensions
client ([#1690](#1690)).
* Fix prefix preset used for UC schemas
([#1704](#1704)).
Sign up for freeto join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants

@shreyas-goenka@pietern