Uh oh!
There was an error while loading. Please reload this page.
Bump to 0.17.1 and cherry-pick arrow/parquet related commits - #1356
Merged
Conversation
Signed-off-by: Yong Tang <yong.tang.github@outlook.com>
This PR tries to address the issue raised in 1254 where reading parquet files will results in `InvalidArgumentError: null value in column` The issue comes from the fact that parquet's ColumnReader C++ API `ReadBatch(...)` does not necessarily respect the number of rows requested and may return less instead. This PR fixes 1254. Signed-off-by: Yong Tang <yong.tang.github@outlook.com>
* Bump Apache Arrow to 2.0.0 Also bumps Apache Thrift to 0.13.0 Signed-off-by: Yong Tang <yong.tang.github@outlook.com> * Update code to match Arrow Signed-off-by: Yong Tang <yong.tang.github@outlook.com> * Bump pyarrow to 2.0.0 Signed-off-by: Yong Tang <yong.tang.github@outlook.com> * Stay with version=1 for write_feather to pass tests Signed-off-by: Yong Tang <yong.tang.github@outlook.com> * Bump flatbuffers to 1.12.0 Signed-off-by: Yong Tang <yong.tang.github@outlook.com> * Fix Windows issue Signed-off-by: Yong Tang <yong.tang.github@outlook.com> * Fix tests Signed-off-by: Yong Tang <yong.tang.github@outlook.com> * Fix Windows Signed-off-by: Yong Tang <yong.tang.github@outlook.com> * Remove -std=c++11 and leave default -std=c++14 for arrow build Signed-off-by: Yong Tang <yong.tang.github@outlook.com> * Update sha256 of libapr1 As the hash changed by the repo. Signed-off-by: Yong Tang <yong.tang.github@outlook.com>
Signed-off-by: Yong Tang <yong.tang.github@outlook.com>
This PR patchs arrow to temporarily resolve the ARROW-11518 issue. See 1281 for details Credit to diggerk. We will update arrow after the upstream PR is merged. Signed-off-by: Yong Tang <yong.tang.github@outlook.com>
yongtangforce-pushed
the
R0.17
branch
2 times, most recently
from
April 11, 2021 10:56
1390af2 to
9f71986CompareSigned-off-by: Yong Tang <yong.tang.github@outlook.com>
This PR updates pulsar download link as old link does not work anymore. Signed-off-by: Yong Tang <yong.tang.github@outlook.com>
…le system (tensorflow#1357) * Update to use https for http file system test also registers https file system The http test is failing as apache switched to use https for license page. This PR makes adjustment to fix the issue. Signed-off-by: Yong Tang <yong.tang.github@outlook.com> * Update README.md to use https Signed-off-by: Yong Tang <yong.tang.github@outlook.com>
yongtang
marked this pull request as ready for review
April 11, 2021 21:48
yongtang
commented
Apr 11, 2021
MemberAuthor
The PR is ready for review now. |
kvignesh1420
approved these changes
Apr 12, 2021
Member
There was a problem hiding this comment.
@yongtang LGTM. So the process was to:
- create a new branch named
R0.17with the commits uptov0.17.0. - apply the applicable commits to the branch.
- modify github actions to generate the whl files.
yongtang
commented
Apr 12, 2021
MemberAuthor
@kvignesh1420 Yes. In addition to the list, the following will also need to be done for the release:
I will merge this PR for now. Will see if we can update the README.md and RELEASE.md and push for a release today or tomorrow. |
kvignesh1420
commented
Apr 12, 2021
Member
@yongtang sure! |
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for freeto join this conversation on GitHub.
Already have an account?
Sign in to comment
2 participants
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
This PR bumps version to 0.17.1 and cherry-pick arrow/parquet related commits
This is part of the effort for #1313 (comment)
Signed-off-by: Yong Tang yong.tang.github@outlook.com