ARROW-6937: [Packaging][Python] Fix conda linux and OSX wheel nightly builds by kszucs · Pull Request #5647 · apache/arrow

kszucs · 2019-10-14T14:50:08Z

No description provided.

kszucs · 2019-10-14T14:51:31Z

@ursabot crossbow submit -g nightly

ursabot · 2019-10-14T14:51:58Z

AMD64 Conda Crossbow Submit (#70080) builder has been succeeded.

Revision: 86e77406e9841686b2b9ded2822c4a833578dd52

Submitted crossbow builds: ursa-labs/crossbow @ ursabot-248

Task	Status
centos-6
centos-7
conda-linux-gcc-py27
conda-linux-gcc-py36
conda-linux-gcc-py37
conda-osx-clang-py27
conda-osx-clang-py36
conda-osx-clang-py37
conda-win-vs2015-py36
conda-win-vs2015-py37
debian-buster
debian-stretch
docker-c_glib
docker-clang-format
docker-cpp
docker-cpp-cmake32
docker-cpp-release
docker-cpp-static-only
docker-dask-integration
docker-docs
docker-go
docker-hdfs-integration
docker-iwyu
docker-java
docker-js
docker-lint
docker-pandas-master
docker-python-2.7
docker-python-2.7-nopandas
docker-python-3.6
docker-python-3.6-nopandas
docker-python-3.7
docker-r
docker-r-conda
docker-r-sanitizer
docker-rust
docker-spark-integration
docker-turbodbc-integration
gandiva-jar-osx
gandiva-jar-trusty
homebrew-cpp
macos-r-autobrew
ubuntu-bionic
ubuntu-disco
ubuntu-xenial
wheel-manylinux1-cp27m
wheel-manylinux1-cp27mu
wheel-manylinux1-cp35m
wheel-manylinux1-cp36m
wheel-manylinux1-cp37m
wheel-manylinux2010-cp27m
wheel-manylinux2010-cp27mu
wheel-manylinux2010-cp35m
wheel-manylinux2010-cp36m
wheel-manylinux2010-cp37m
wheel-osx-cp27m
wheel-osx-cp35m
wheel-osx-cp36m
wheel-osx-cp37m
wheel-win-cp36m
wheel-win-cp37m

kszucs · 2019-10-14T15:22:00Z

@ursabot crossbow submit -g nightly

ursabot · 2019-10-14T15:22:26Z

AMD64 Conda Crossbow Submit (#70092) builder has been succeeded.

Revision: 8e97b05c61f3cec6e10595535c5f929be7edbee2

Submitted crossbow builds: ursa-labs/crossbow @ ursabot-249

Task	Status
centos-6
centos-7
conda-linux-gcc-py27
conda-linux-gcc-py36
conda-linux-gcc-py37
conda-osx-clang-py27
conda-osx-clang-py36
conda-osx-clang-py37
conda-win-vs2015-py36
conda-win-vs2015-py37
debian-buster
debian-stretch
docker-c_glib
docker-clang-format
docker-cpp
docker-cpp-cmake32
docker-cpp-release
docker-cpp-static-only
docker-dask-integration
docker-docs
docker-go
docker-hdfs-integration
docker-iwyu
docker-java
docker-js
docker-lint
docker-pandas-master
docker-python-2.7
docker-python-2.7-nopandas
docker-python-3.6
docker-python-3.6-nopandas
docker-python-3.7
docker-r
docker-r-conda
docker-r-sanitizer
docker-rust
docker-spark-integration
docker-turbodbc-integration
gandiva-jar-osx
gandiva-jar-trusty
homebrew-cpp
macos-r-autobrew
ubuntu-bionic
ubuntu-disco
ubuntu-xenial
wheel-manylinux1-cp27m
wheel-manylinux1-cp27mu
wheel-manylinux1-cp35m
wheel-manylinux1-cp36m
wheel-manylinux1-cp37m
wheel-manylinux2010-cp27m
wheel-manylinux2010-cp27mu
wheel-manylinux2010-cp35m
wheel-manylinux2010-cp36m
wheel-manylinux2010-cp37m
wheel-osx-cp27m
wheel-osx-cp35m
wheel-osx-cp36m
wheel-osx-cp37m
wheel-win-cp36m
wheel-win-cp37m

codecov-io · 2019-10-14T15:29:05Z

Codecov Report

Merging #5647 into master will decrease coverage by 7.9%.
The diff coverage is n/a.

@@ Coverage Diff @@## master #5647 +/- ##
==========================================
- Coverage 88.89% 80.98% -7.91% 
==========================================
Files 868 90 -778 Lines 107541 8874 -98667 Branches 1501 0 -1501 ==========================================
- Hits 95603 7187 -88416 + Misses 11573 1333 -10240 + Partials 365 354 -11

Impacted Files	Coverage Δ
cpp/src/arrow/array/builder_adaptive.cc
r/R/filesystem.R
r/R/list.R
cpp/src/parquet/column_page.h
cpp/src/plasma/test/external_store_tests.cc
cpp/src/arrow/array/builder_decimal.cc
r/src/symbols.cpp
.../thirdparty/flatbuffers/include/flatbuffers/base.h
r/R/record-batch-writer.R
cpp/src/arrow/compute/compute_test.cc
... and 768 more

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update 07128fa...8e97b05. Read the comment docs.

kszucs · 2019-10-16T13:44:35Z

@ursabot submit wheel-osx-cp37m

ursabot · 2019-10-16T13:44:36Z

No such command "submit".

kszucs · 2019-10-16T13:44:46Z

@ursabot crossbow submit wheel-osx-cp37m

ursabot · 2019-10-16T13:45:19Z

AMD64 Conda Crossbow Submit (#70841) builder has been succeeded.

Revision: 57ef2c07868122e3e106ea5fb341737de53f3c49

Submitted crossbow builds: ursa-labs/crossbow @ ursabot-254

Task	Status
wheel-osx-cp37m

kszucs · 2019-10-16T13:58:56Z

@ursabot crossbow submit conda-linux-gcc-py37

ursabot · 2019-10-16T14:05:56Z

AMD64 Conda Crossbow Submit (#70864) builder has been succeeded.

Revision: eedd49e2bc59806c9626f4f318d442fa55238ddb

Submitted crossbow builds: ursa-labs/crossbow @ ursabot-255

Task	Status
conda-linux-gcc-py37

kszucs · 2019-10-16T15:23:43Z

@ursabot crossbow submit wheel-osx-cp37m

ursabot · 2019-10-16T15:24:04Z

AMD64 Conda Crossbow Submit (#70882) builder has been succeeded.

Revision: 8d11bd56969b406da182d9b2289dec2864e1312a

Submitted crossbow builds: ursa-labs/crossbow @ ursabot-257

Task	Status
wheel-osx-cp37m

kszucs · 2019-10-16T15:39:11Z

@ursabot crossbow submit conda-linux-gcc-py37

ursabot · 2019-10-16T15:39:32Z

AMD64 Conda Crossbow Submit (#70883) builder has been succeeded.

Revision: 1ac7a349e0e7ae9c760172aa2ce0f975fdf9dbcf

Submitted crossbow builds: ursa-labs/crossbow @ ursabot-258

Task	Status
conda-linux-gcc-py37

kszucs · 2019-10-16T16:31:49Z

@ursabot crossbow submit conda-linux-gcc-py37

ursabot · 2019-10-16T16:33:20Z

AMD64 Conda Crossbow Submit (#70898) builder has been succeeded.

Revision: 823b51da2470633b9e3a4bb75a973958165cf497

Submitted crossbow builds: ursa-labs/crossbow @ ursabot-260

Task	Status
conda-linux-gcc-py37

kszucs · 2019-10-17T13:42:50Z

@ursabot crossbow submit conda-linux-gcc-py37

ursabot · 2019-10-17T13:43:10Z

AMD64 Conda Crossbow Submit (#71225) builder has been succeeded.

Revision: 35991d17a71765dad0a1219990a17c233abaa05b

Submitted crossbow builds: ursa-labs/crossbow @ ursabot-265

Task	Status
conda-linux-gcc-py37

kszucs · 2019-10-17T13:51:18Z

@ursabot crossbow submit wheel-osx-cp37m

ursabot · 2019-10-17T13:51:39Z

AMD64 Conda Crossbow Submit (#71237) builder has been succeeded.

Revision: 191f618d8de02fbe82f1d5fc29cee744222f1e83

Submitted crossbow builds: ursa-labs/crossbow @ ursabot-266

Task	Status
wheel-osx-cp37m

kszucs · 2019-10-17T17:08:22Z

@ursabot crossbow submit conda-linux-gcc-py37

ursabot · 2019-10-17T17:08:43Z

AMD64 Conda Crossbow Submit (#71293) builder has been succeeded.

Revision: 869e77f43590e3adbb9b1818a8010f617a68a9c9

Submitted crossbow builds: ursa-labs/crossbow @ ursabot-267

Task	Status
conda-linux-gcc-py37

kszucs · 2019-10-17T17:11:34Z

@ursabot crossbow submit wheel-osx-cp37m

ursabot · 2019-10-17T17:11:55Z

AMD64 Conda Crossbow Submit (#71294) builder has been succeeded.

Revision: 6fe5b61f178d1a0fd9e798a54fa945cc21220ab4

Submitted crossbow builds: ursa-labs/crossbow @ ursabot-268

Task	Status
wheel-osx-cp37m

kszucs · 2019-10-17T19:02:20Z

@ursabot crossbow submit -g conda -g wheel

ursabot · 2019-10-17T19:05:16Z

AMD64 Conda Crossbow Submit (#71340) builder has been succeeded.

Revision: 0597229

Submitted crossbow builds: ursa-labs/crossbow @ ursabot-270

Task	Status
conda-linux-gcc-py27
conda-linux-gcc-py36
conda-linux-gcc-py37
conda-osx-clang-py27
conda-osx-clang-py36
conda-osx-clang-py37
conda-win-vs2015-py36
conda-win-vs2015-py37
wheel-manylinux1-cp27m
wheel-manylinux1-cp27mu
wheel-manylinux1-cp35m
wheel-manylinux1-cp36m
wheel-manylinux1-cp37m
wheel-manylinux2010-cp27m
wheel-manylinux2010-cp27mu
wheel-manylinux2010-cp35m
wheel-manylinux2010-cp36m
wheel-manylinux2010-cp37m
wheel-osx-cp27m
wheel-osx-cp35m
wheel-osx-cp36m
wheel-osx-cp37m
wheel-win-cp36m
wheel-win-cp37m

kszucs · 2019-10-17T20:49:33Z

@ursabot crossbow submit wheel-win-cp37m

ursabot · 2019-10-17T20:49:54Z

AMD64 Conda Crossbow Submit (#71404) builder has been succeeded.

Revision: eae0e4f

Submitted crossbow builds: ursa-labs/crossbow @ ursabot-271

Task	Status
wheel-win-cp37m

kszucs · 2019-10-17T21:10:59Z

The OSX wheels are failing with a transient upload error, still need to fix the windows ones.

github-actions · 2019-10-18T14:03:38Z

https://issues.apache.org/jira/browse/ARROW-6937

kszucs · 2019-10-18T14:14:16Z

@ursabot crossbow submit wheel-win-cp37m

ursabot · 2019-10-18T14:14:36Z

AMD64 Conda Crossbow Submit (#71645) builder has been succeeded.

Revision: 6c7e763

Submitted crossbow builds: ursa-labs/crossbow @ ursabot-274

Task	Status
wheel-win-cp37m

kszucs · 2019-10-18T15:53:25Z

@ursabot crossbow submit wheel-win-cp37m

ursabot · 2019-10-18T16:00:01Z

AMD64 Conda Crossbow Submit (#71691) builder has been succeeded.

Revision: e0ea665

Submitted crossbow builds: ursa-labs/crossbow @ ursabot-275

Task	Status
wheel-win-cp37m

kszucs · 2019-10-18T17:30:24Z

The windows wheels are still having linking issues, but without any context it is pretty hard to investigate. Under the Appveyor artifacts we have a faulty wheel.

I'm going to merge the fix for the linux conda packages and osx wheels and handle the remaining windows wheel issue in a separate PR.

kszucs

+1

… builds Closesapache#5647 from kszucs/pin-lazy-fixtures and squashes the following commits: 5cd34f3 <Krisztián Szűcs> revert windows wheel testing e0ea665 <Krisztián Szűcs> enable flight 6c7e763 <Krisztián Szűcs> enforce artifact uploading for windows wheel eae0e4f <Krisztián Szűcs> turn off BZ2 for windows wheels 0597229 <Krisztián Szűcs> use xcode 9.3 for osx wheels 97fa57c <Krisztián Szűcs> force conda bld path 960b25f <Krisztián Szűcs> use newer xcode for building osx wheels 0fb47c8 <Krisztián Szűcs> use folder outside of arrow's directory for building artifacts 0483996 <Krisztián Szűcs> pin conda build for linux 8cb11b9 <Krisztián Szűcs> wait 30 minutes a02ad43 <Krisztián Szűcs> use different dir to build conda linux artifacts 085de0f <Krisztián Szűcs> use travis wait to for compiling openssl Authored-by: Krisztián Szűcs <szucs.krisztian@gmail.com> Signed-off-by: Krisztián Szűcs <szucs.krisztian@gmail.com>

kszucs force-pushed the pin-lazy-fixtures branch from 8e97b05 to 57ef2c0Compare October 16, 2019 13:43

kszucs force-pushed the pin-lazy-fixtures branch from 1ac7a34 to 823b51dCompare October 16, 2019 16:30

kszucs changed the title ~~[WIP][Packaging] Fixing nightly builds~~[WIP][Packaging] Fixing conda and wheel nightly buildsOct 17, 2019

kszucs mentioned this pull request Oct 17, 2019
ARROW-6905: [Packaging][OSX] Nightly builds on MacOS are failing because of brew compile timeouts #5676
Closed

kszucs mentioned this pull request Oct 17, 2019
ARROW-6920: [Packaging] Build python 3.8 wheels #5685
Closed

kszucs added 7 commits October 17, 2019 14:34

use different dir to build conda linux artifacts [skip ci]
a02ad43

wait 30 minutes [skip ci]
8cb11b9

pin conda build for linux [skip ci]
0483996

use folder outside of arrow's directory for building artifacts [skip ci]
0fb47c8

use newer xcode for building osx wheels [skip ci]
960b25f

force conda bld path [skip ci]
97fa57c

use xcode 9.3 for osx wheels [skip ci]
0597229

kszucs force-pushed the pin-lazy-fixtures branch from 6fe5b61 to 0597229Compare October 17, 2019 18:34

turn off BZ2 for windows wheels [skip ci]
eae0e4f

kszucs changed the title ~~[WIP][Packaging] Fixing conda and wheel nightly builds~~ARROW-6937: [Packaging][Python] Fix conda linux and OSX wheel nightly buildsOct 18, 2019

enforce artifact uploading for windows wheel [skip ci]
6c7e763

enable flight [skip ci]
e0ea665

revert windows wheel testing [skip ci]
5cd34f3

kszucs commented Oct 18, 2019
View reviewed changes

kszucs closed this in 5465c10Oct 18, 2019

asfimport mentioned this pull request Oct 18, 2019
[Packaging][Python] Fix conda linux and OSX wheel nightly builds #23257
Closed

Uh oh!

Conversation

kszucs commented Oct 14, 2019

Uh oh!

kszucs commented Oct 14, 2019

Uh oh!

ursabot commented Oct 14, 2019

Uh oh!

kszucs commented Oct 14, 2019

Uh oh!

ursabot commented Oct 14, 2019

Uh oh!

codecov-io commented Oct 14, 2019

Codecov Report

Uh oh!

kszucs commented Oct 16, 2019

Uh oh!

ursabot commented Oct 16, 2019

Uh oh!

kszucs commented Oct 16, 2019

Uh oh!

ursabot commented Oct 16, 2019

Uh oh!

kszucs commented Oct 16, 2019

Uh oh!

ursabot commented Oct 16, 2019

Uh oh!

kszucs commented Oct 16, 2019

Uh oh!

ursabot commented Oct 16, 2019

Uh oh!

kszucs commented Oct 16, 2019

Uh oh!

ursabot commented Oct 16, 2019

Uh oh!

kszucs commented Oct 16, 2019

Uh oh!

ursabot commented Oct 16, 2019

Uh oh!

kszucs commented Oct 17, 2019

Uh oh!

ursabot commented Oct 17, 2019

Uh oh!

kszucs commented Oct 17, 2019

Uh oh!

ursabot commented Oct 17, 2019

Uh oh!

kszucs commented Oct 17, 2019

Uh oh!

ursabot commented Oct 17, 2019

Uh oh!

kszucs commented Oct 17, 2019

Uh oh!

ursabot commented Oct 17, 2019

Uh oh!

kszucs commented Oct 17, 2019

Uh oh!

ursabot commented Oct 17, 2019

Uh oh!

kszucs commented Oct 17, 2019

Uh oh!

ursabot commented Oct 17, 2019

Uh oh!

kszucs commented Oct 17, 2019

Uh oh!

github-actionsBot commented Oct 18, 2019

Uh oh!

kszucs commented Oct 18, 2019

Uh oh!

ursabot commented Oct 18, 2019

Uh oh!

kszucs commented Oct 18, 2019

Uh oh!

ursabot commented Oct 18, 2019

Uh oh!

kszucs commented Oct 18, 2019

Uh oh!

kszucs left a comment

Choose a reason for hiding this comment

Uh oh!