Skip to content

[ci] convert data.rayci.yml matrix to array syntax - #62801

Merged
andrew-anyscale merged 1 commit into
masterfrom
andrew/revup/master/convert-array-data
May 6, 2026
Merged

andrew-anyscale merged 1 commit into
masterfrom
andrew/revup/master/convert-array-data

Conversation

@andrew-anyscale

@andrew-anyscale andrew-anyscale commented Apr 20, 2026

Copy link
Copy Markdown
Contributor

Convert data9build-multipy, datalbuild-multipy, and the two matrix-setup "arrow v23" test labels from matrix to array syntax. The two array test steps use ($) against datalbuild-multipy since both sides now share the python array key. Every remaining plain depends_on to data9build-multipy or datalbuild-multipy is replaced with (python=3.10) or (python=3.12) based on the python version each consuming step pins. The core.rayci.yml dask and modin test steps — which reference datalbuild-multipy cross-file — are narrowed to (python=3.12) and (python=3.10) respectively. The non-array datan/datamongo/datatfxbsl/datatfds builds are unaffected

Topic: convert-array-data
Signed-off-by: andrew andrew@anyscale.com

@andrew-anyscale

andrew-anyscale commented Apr 20, 2026

Copy link
Copy Markdown
Contributor Author

Reviews in this chain:
#62801 [ci] convert data.rayci.yml matrix to array syntax

@andrew-anyscale

andrew-anyscale commented Apr 20, 2026

Copy link
Copy Markdown
Contributor Author
# head base diff date summary
0 032a35b8 0f2e8944 diff Apr 20 16:20 PM 2 files changed, 38 insertions(+), 36 deletions(-)
1 97951fe2 59e0122e rebase Apr 22 6:28 AM 0 files changed
2 32b2c237 af9fd22e rebase Apr 22 6:28 AM 0 files changed
3 ca6c0633 238bf958 rebase Apr 22 10:18 AM 0 files changed
4 3f09d674 7cdf7184 rebase Apr 23 7:03 AM 0 files changed
5 b803dde1 f724ae4f rebase Apr 27 10:10 AM 0 files changed
6 222a1df0 8cf2eef8 rebase Apr 28 11:32 AM 0 files changed
7 fc76e656 7f9373b2 diff May 1 7:29 AM 1 file changed, 8 insertions(+), 8 deletions(-)
8 53d9fa4c 7f9373b2 diff May 1 7:35 AM 1 file changed, 1 insertion(+), 1 deletion(-)
9 b510b2eb 183c0e1d diff May 2 8:38 AM 0 files changed
10 b1faf7ee 183c0e1d diff May 2 8:47 AM 0 files changed
11 60341d35 a95f1054 diff May 5 8:54 AM 0 files changed

@gemini-code-assist gemini-code-assist Bot left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Code Review

This pull request updates the Buildkite configuration by transitioning from matrix to array definitions for multi-python builds in core.rayci.yml and data.rayci.yml. It also refines job dependencies by explicitly specifying the python version in the depends_on fields. I have no feedback to provide.

@andrew-anyscale
andrew-anyscale requested a review from a team April 21, 2026 14:14
@andrew-anyscale
andrew-anyscale force-pushed the andrew/revup/master/convert-array-data branch from 032a35b to 97951fe Compare April 22, 2026 13:28
@andrew-anyscale
andrew-anyscale force-pushed the andrew/revup/master/convert-array-core-tests branch from 59e0122 to af9fd22 Compare April 22, 2026 13:28
@andrew-anyscale
andrew-anyscale force-pushed the andrew/revup/master/convert-array-data branch 2 times, most recently from 32b2c23 to ca6c063 Compare April 22, 2026 17:18
@andrew-anyscale
andrew-anyscale force-pushed the andrew/revup/master/convert-array-core-tests branch 2 times, most recently from 238bf95 to 7cdf718 Compare April 23, 2026 14:03
@andrew-anyscale
andrew-anyscale force-pushed the andrew/revup/master/convert-array-data branch from ca6c063 to 3f09d67 Compare April 23, 2026 14:03
@andrew-anyscale
andrew-anyscale force-pushed the andrew/revup/master/convert-array-core-tests branch from 7cdf718 to f724ae4 Compare April 27, 2026 17:10
@andrew-anyscale
andrew-anyscale force-pushed the andrew/revup/master/convert-array-data branch 2 times, most recently from b803dde to 222a1df Compare April 28, 2026 18:32
@andrew-anyscale
andrew-anyscale force-pushed the andrew/revup/master/convert-array-core-tests branch from f724ae4 to 8cf2eef Compare April 28, 2026 18:32
@andrew-anyscale
andrew-anyscale force-pushed the andrew/revup/master/convert-array-data branch from 222a1df to fc76e65 Compare May 1, 2026 14:29
@andrew-anyscale
andrew-anyscale force-pushed the andrew/revup/master/convert-array-core-tests branch from 8cf2eef to 7f9373b Compare May 1, 2026 14:29
@andrew-anyscale
andrew-anyscale marked this pull request as ready for review May 1, 2026 14:29

@cursor cursor Bot left a comment

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Cursor Bugbot has reviewed your changes and found 1 potential issue.

Fix All in Cursor

❌ Bugbot Autofix is OFF. To automatically fix reported issues with cloud agents, have a team admin enable autofix in the Cursor dashboard.

Reviewed by Cursor Bugbot for commit fc76e6561aa1aa988c1dc7e8bf554476e0d60772. Configure here.

Comment thread .buildkite/data.rayci.yml
@andrew-anyscale
andrew-anyscale force-pushed the andrew/revup/master/convert-array-data branch from fc76e65 to 53d9fa4 Compare May 1, 2026 14:35
@ray-gardener ray-gardener Bot added data Ray Data-related issues devprod labels May 1, 2026
Base automatically changed from andrew/revup/master/convert-array-core-tests to master May 2, 2026 14:34
@andrew-anyscale
andrew-anyscale force-pushed the andrew/revup/master/convert-array-data branch from c177a94 to b510b2e Compare May 2, 2026 15:38
@andrew-anyscale andrew-anyscale added the go add ONLY when ready to merge, run all tests label May 2, 2026
@andrew-anyscale
andrew-anyscale force-pushed the andrew/revup/master/convert-array-data branch from b510b2e to b1faf7e Compare May 2, 2026 15:47
Convert data9build-multipy, datalbuild-multipy, and the two matrix-setup "arrow v23" test labels from matrix to array syntax. The two array test steps use ($) against datalbuild-multipy since both sides now share the python array key. Every remaining plain depends_on to data9build-multipy or datalbuild-multipy is replaced with (python=3.10) or (python=3.12) based on the python version each consuming step pins. The core.rayci.yml dask and modin test steps — which reference datalbuild-multipy cross-file — are narrowed to (python=3.12) and (python=3.10) respectively. The non-array datan/datamongo/datatfxbsl/datatfds builds are unaffected

Topic: convert-array-data
Signed-off-by: andrew <andrew@anyscale.com>
@andrew-anyscale
andrew-anyscale force-pushed the andrew/revup/master/convert-array-data branch from b1faf7e to 60341d3 Compare May 5, 2026 15:54
@andrew-anyscale
andrew-anyscale merged commit e5ed9ae into master May 6, 2026
6 checks passed
@andrew-anyscale
andrew-anyscale deleted the andrew/revup/master/convert-array-data branch May 6, 2026 17:10
Lucas61000 pushed a commit to Lucas61000/ray that referenced this pull request May 15, 2026
Convert data9build-multipy, datalbuild-multipy, and the two matrix-setup
"arrow v23" test labels from matrix to array syntax. The two array test
steps use ($) against datalbuild-multipy since both sides now share the
python array key. Every remaining plain depends_on to data9build-multipy
or datalbuild-multipy is replaced with (python=3.10) or (python=3.12)
based on the python version each consuming step pins. The core.rayci.yml
dask and modin test steps — which reference datalbuild-multipy
cross-file — are narrowed to (python=3.12) and (python=3.10)
respectively. The non-array datan/datamongo/datatfxbsl/datatfds builds
are unaffected

Topic: convert-array-data
Signed-off-by: andrew <andrew@anyscale.com>

Signed-off-by: andrew <andrew@anyscale.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

ci data Ray Data-related issues devprod go add ONLY when ready to merge, run all tests

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants