Uh oh!
There was an error while loading. Please reload this page.
ARROW-7729: [Python][CI] Pin pandas version to 0.25 in the dask integration test - #6326
ARROW-7729: [Python][CI] Pin pandas version to 0.25 in the dask integration test#6326kszucs wants to merge 2 commits into
Conversation
kszucs
commented
Jan 30, 2020
@ursabot crossbow submit test-conda-python-3.7-dask-latest test-conda-python-3.8-dask-master |
kszucs
commented
Jan 30, 2020
AMD64 Conda Crossbow Submit (#88781) builder has been succeeded. Revision: 083221c Submitted crossbow builds: ursa-labs/crossbow @ ursabot-472
|
nealrichardson
commented
Jan 30, 2020
This seems dangerous in the long-term. Is there a Jira for fixing the issue that requires the version pin (at which point we would remove this pin)? |
kszucs
commented
Jan 30, 2020
@ursabot crossbow submit test-conda-python-3.7-dask-latest test-conda-python-3.8-dask-master |
kszucs
commented
Jan 30, 2020
AMD64 Conda Crossbow Submit (#88806) builder has been succeeded. Revision: b5cb40e Submitted crossbow builds: ursa-labs/crossbow @ ursabot-473
|
kszucs
commented
Jan 30, 2020
@nealrichardson the issue is between dask and pandas, we just pin the right pandas version to test dask arrow compatibility. |
jorisvandenbossche
left a comment
There was a problem hiding this comment.
dask already released a pandas1.0 compatible release a week ago (2.10, https://github.com/dask/dask/releases), so I am surprised this was needed. What was the failure we got?
| COPY ci/scripts/install_dask.sh /arrow/ci/scripts/ | ||
| RUN /arrow/ci/scripts/install_dask.sh ${dask} | ||
| # The Spark tests currently break with pandas >= 1.0 |
…ration test Additionally test agains dask's latest release not just the master revision. Closes#6326 from kszucs/dask-pandas-pin and squashes the following commits: b5cb40e <Krisztián Szűcs> pin pandas depending on dask's version 083221c <Krisztián Szűcs> pin pandas in the dask integration test Authored-by: Krisztián Szűcs <szucs.krisztian@gmail.com> Signed-off-by: Krisztián Szűcs <szucs.krisztian@gmail.com>
Additionally test agains dask's latest release not just the master revision.