Apply patches to the Arrow to 16.1.0 by nikitamikhaylov · Pull Request #68 · ClickHouse/arrow

nikitamikhaylov · 2024-10-15T11:18:37Z

This PR is needed just to show the list of patches which we need to re-apply to the upstream release.

✅ Check validation of of bit offset when reading bit packed values #66
🔴 Don't throw in ~DictEncoderImpl() #63 looks like not relevant anymore. The upstream contains: GH-38117: [C++][Parquet] Change DictEncoder dtor checking to warning log apache/arrow#38118
✅ Fix possible use-of-uninitizliaed-value #47
🔴 Fix build for s390 #46 The upstream contains: GH-36856: [C++] Remove needless braces from BasicDecimal256FromLE() arguments apache/arrow#36987
✅ Allow to get number of rows in record batch #42
❓❓❓ Fix parquet endian issue for s390x #41 It seems we've never merged the PR to ClickHouse/ClickHouse which depends on this patch.
✅ Allow to get number of rows in record batch #39
✅ Better fix for #16 #26
✅ Better fix for #16 #22
✅ Allow Parquet map key to be optional #17
✅ Don't abort in ~CerrLog #16
✅ Fix 'undefined symbol: pthread_atfork' on PowerPC64 #15
✅ Fix deadlock with msan #14
🔴 Revert "Remove submodules" #13
🔴 Fix data race in ProtectAgainstFork #12 The upstream has: ARROW-15593: [C++] Make after-fork ThreadPool reinitialization thread-safe apache/arrow#12358
🔴 Remove submodules #11
✅ fix building issue introduced by https://github.com/ClickHouse-Extras… #10
✅ Add interface to get raw orc reader from adapters #9
🔴 Update Arrow to apache-arrow-4.0.1 #6
🔴 Remove submodules #5
🔴 Update Arrow to the latest release tag (2.0.0) #2
🔴 Provide method for Uri to get correct value host-with-port for Ipv6 host name #1 The upstream has: ARROW-10475: [C++][FlightRPC] handle IPv6 hosts apache/arrow#8585

Check validation of of bit offset when reading bit packed values (cherry picked from commit 5cfccd8)

Fix possible use-of-uninitizliaed-value (cherry picked from commit ba5c679)

Allow to get number of rows in record batch (cherry picked from commit 1d93838)

Add interface to get raw orc reader from adapters (cherry picked from commit ce6b7af)

fix building issue introduced by https://github.com/ClickHouse-Extras… (cherry picked from commit 20dc6ad)

github-actions · 2024-10-15T11:19:00Z

Thanks for opening a pull request!

If this is not a minor PR. Could you open an issue for this pull request on GitHub? https://github.com/apache/arrow/issues/new/choose

Opening GitHub issues ahead of time contributes to the Openness of the Apache Arrow project.

Then could you also rename the pull request title in the following format?

GH-${GITHUB_ISSUE_ID}: [${COMPONENT}] ${SUMMARY}

or

MINOR: [${COMPONENT}] ${SUMMARY}

In the case of PARQUET issues on JIRA the title also supports:

PARQUET-${JIRA_ISSUE_ID}: [${COMPONENT}] ${SUMMARY}

See also:

Fix deadlock with msan (cherry picked from commit b41ff44)

Fix 'undefined symbol: pthread_atfork' on PowerPC64 (cherry picked from commit 450a563)

Don't abort in ~CerrLog (cherry picked from commit d03245f)

Allow Parquet map key to be optional (cherry picked from commit 0d6d07f)

(cherry picked from commit 3264fdad38b2a1628f296cd574a9dd03f4928aea)

nikitamikhaylov · 2024-10-15T11:18:37Z

This PR is needed just to show the list of patches which we need to re-apply to the upstream release.

✅ Check validation of of bit offset when reading bit packed values #66
🔴 Don't throw in ~DictEncoderImpl() #63 looks like not relevant anymore. The upstream contains: GH-38117: [C++][Parquet] Change DictEncoder dtor checking to warning log apache/arrow#38118
✅ Fix possible use-of-uninitizliaed-value #47
🔴 Fix build for s390 #46 The upstream contains: GH-36856: [C++] Remove needless braces from BasicDecimal256FromLE() arguments apache/arrow#36987
✅ Allow to get number of rows in record batch #42
❓❓❓ Fix parquet endian issue for s390x #41 It seems we've never merged the PR to ClickHouse/ClickHouse which depends on this patch.
✅ Allow to get number of rows in record batch #39
✅ Better fix for #16 #26
✅ Better fix for #16 #22
✅ Allow Parquet map key to be optional #17
✅ Don't abort in ~CerrLog #16
✅ Fix 'undefined symbol: pthread_atfork' on PowerPC64 #15
✅ Fix deadlock with msan #14
🔴 Revert "Remove submodules" #13
🔴 Fix data race in ProtectAgainstFork #12 The upstream has: ARROW-15593: [C++] Make after-fork ThreadPool reinitialization thread-safe apache/arrow#12358
🔴 Remove submodules #11
✅ fix building issue introduced by https://github.com/ClickHouse-Extras… #10
✅ Add interface to get raw orc reader from adapters #9
🔴 Update Arrow to apache-arrow-4.0.1 #6
🔴 Remove submodules #5
🔴 Update Arrow to the latest release tag (2.0.0) #2
🔴 Provide method for Uri to get correct value host-with-port for Ipv6 host name #1 The upstream has: ARROW-10475: [C++][FlightRPC] handle IPv6 hosts apache/arrow#8585

Check validation of of bit offset when reading bit packed values (cherry picked from commit 5cfccd8)

Fix possible use-of-uninitizliaed-value (cherry picked from commit ba5c679)

Allow to get number of rows in record batch (cherry picked from commit 1d93838)

Add interface to get raw orc reader from adapters (cherry picked from commit ce6b7af)

fix building issue introduced by https://github.com/ClickHouse-Extras… (cherry picked from commit 20dc6ad)

github-actions · 2024-10-15T11:19:00Z

Thanks for opening a pull request!

If this is not a minor PR. Could you open an issue for this pull request on GitHub? https://github.com/apache/arrow/issues/new/choose

Opening GitHub issues ahead of time contributes to the Openness of the Apache Arrow project.

Then could you also rename the pull request title in the following format?

GH-${GITHUB_ISSUE_ID}: [${COMPONENT}] ${SUMMARY}

or

MINOR: [${COMPONENT}] ${SUMMARY}

In the case of PARQUET issues on JIRA the title also supports:

PARQUET-${JIRA_ISSUE_ID}: [${COMPONENT}] ${SUMMARY}

See also:

Fix deadlock with msan (cherry picked from commit b41ff44)

Fix 'undefined symbol: pthread_atfork' on PowerPC64 (cherry picked from commit 450a563)

Don't abort in ~CerrLog (cherry picked from commit d03245f)

Allow Parquet map key to be optional (cherry picked from commit 0d6d07f)

(cherry picked from commit 3264fdad38b2a1628f296cd574a9dd03f4928aea)

nikitamikhaylov · 2024-10-15T11:18:37Z

This PR is needed just to show the list of patches which we need to re-apply to the upstream release.

✅ Check validation of of bit offset when reading bit packed values #66
🔴 Don't throw in ~DictEncoderImpl() #63 looks like not relevant anymore. The upstream contains: GH-38117: [C++][Parquet] Change DictEncoder dtor checking to warning log apache/arrow#38118
✅ Fix possible use-of-uninitizliaed-value #47
🔴 Fix build for s390 #46 The upstream contains: GH-36856: [C++] Remove needless braces from BasicDecimal256FromLE() arguments apache/arrow#36987
✅ Allow to get number of rows in record batch #42
❓❓❓ Fix parquet endian issue for s390x #41 It seems we've never merged the PR to ClickHouse/ClickHouse which depends on this patch.
✅ Allow to get number of rows in record batch #39
✅ Better fix for #16 #26
✅ Better fix for #16 #22
✅ Allow Parquet map key to be optional #17
✅ Don't abort in ~CerrLog #16
✅ Fix 'undefined symbol: pthread_atfork' on PowerPC64 #15
✅ Fix deadlock with msan #14
🔴 Revert "Remove submodules" #13
🔴 Fix data race in ProtectAgainstFork #12 The upstream has: ARROW-15593: [C++] Make after-fork ThreadPool reinitialization thread-safe apache/arrow#12358
🔴 Remove submodules #11
✅ fix building issue introduced by https://github.com/ClickHouse-Extras… #10
✅ Add interface to get raw orc reader from adapters #9
🔴 Update Arrow to apache-arrow-4.0.1 #6
🔴 Remove submodules #5
🔴 Update Arrow to the latest release tag (2.0.0) #2
🔴 Provide method for Uri to get correct value host-with-port for Ipv6 host name #1 The upstream has: ARROW-10475: [C++][FlightRPC] handle IPv6 hosts apache/arrow#8585

Check validation of of bit offset when reading bit packed values (cherry picked from commit 5cfccd8)

Fix possible use-of-uninitizliaed-value (cherry picked from commit ba5c679)

Allow to get number of rows in record batch (cherry picked from commit 1d93838)

Add interface to get raw orc reader from adapters (cherry picked from commit ce6b7af)

fix building issue introduced by https://github.com/ClickHouse-Extras… (cherry picked from commit 20dc6ad)

github-actions · 2024-10-15T11:19:00Z

Thanks for opening a pull request!

If this is not a minor PR. Could you open an issue for this pull request on GitHub? https://github.com/apache/arrow/issues/new/choose

Opening GitHub issues ahead of time contributes to the Openness of the Apache Arrow project.

Then could you also rename the pull request title in the following format?

GH-${GITHUB_ISSUE_ID}: [${COMPONENT}] ${SUMMARY}

or

MINOR: [${COMPONENT}] ${SUMMARY}

In the case of PARQUET issues on JIRA the title also supports:

PARQUET-${JIRA_ISSUE_ID}: [${COMPONENT}] ${SUMMARY}

See also:

Fix deadlock with msan (cherry picked from commit b41ff44)

Fix 'undefined symbol: pthread_atfork' on PowerPC64 (cherry picked from commit 450a563)

Don't abort in ~CerrLog (cherry picked from commit d03245f)

Allow Parquet map key to be optional (cherry picked from commit 0d6d07f)

(cherry picked from commit 3264fdad38b2a1628f296cd574a9dd03f4928aea)

nikitamikhaylov · 2024-10-15T11:18:37Z

This PR is needed just to show the list of patches which we need to re-apply to the upstream release.

✅ Check validation of of bit offset when reading bit packed values #66
🔴 Don't throw in ~DictEncoderImpl() #63 looks like not relevant anymore. The upstream contains: GH-38117: [C++][Parquet] Change DictEncoder dtor checking to warning log apache/arrow#38118
✅ Fix possible use-of-uninitizliaed-value #47
🔴 Fix build for s390 #46 The upstream contains: GH-36856: [C++] Remove needless braces from BasicDecimal256FromLE() arguments apache/arrow#36987
✅ Allow to get number of rows in record batch #42
❓❓❓ Fix parquet endian issue for s390x #41 It seems we've never merged the PR to ClickHouse/ClickHouse which depends on this patch.
✅ Allow to get number of rows in record batch #39
✅ Better fix for #16 #26
✅ Better fix for #16 #22
✅ Allow Parquet map key to be optional #17
✅ Don't abort in ~CerrLog #16
✅ Fix 'undefined symbol: pthread_atfork' on PowerPC64 #15
✅ Fix deadlock with msan #14
🔴 Revert "Remove submodules" #13
🔴 Fix data race in ProtectAgainstFork #12 The upstream has: ARROW-15593: [C++] Make after-fork ThreadPool reinitialization thread-safe apache/arrow#12358
🔴 Remove submodules #11
✅ fix building issue introduced by https://github.com/ClickHouse-Extras… #10
✅ Add interface to get raw orc reader from adapters #9
🔴 Update Arrow to apache-arrow-4.0.1 #6
🔴 Remove submodules #5
🔴 Update Arrow to the latest release tag (2.0.0) #2
🔴 Provide method for Uri to get correct value host-with-port for Ipv6 host name #1 The upstream has: ARROW-10475: [C++][FlightRPC] handle IPv6 hosts apache/arrow#8585

Check validation of of bit offset when reading bit packed values (cherry picked from commit 5cfccd8)

Fix possible use-of-uninitizliaed-value (cherry picked from commit ba5c679)

Allow to get number of rows in record batch (cherry picked from commit 1d93838)

Add interface to get raw orc reader from adapters (cherry picked from commit ce6b7af)

fix building issue introduced by https://github.com/ClickHouse-Extras… (cherry picked from commit 20dc6ad)

github-actions · 2024-10-15T11:19:00Z

Thanks for opening a pull request!

If this is not a minor PR. Could you open an issue for this pull request on GitHub? https://github.com/apache/arrow/issues/new/choose

Opening GitHub issues ahead of time contributes to the Openness of the Apache Arrow project.

Then could you also rename the pull request title in the following format?

GH-${GITHUB_ISSUE_ID}: [${COMPONENT}] ${SUMMARY}

or

MINOR: [${COMPONENT}] ${SUMMARY}

In the case of PARQUET issues on JIRA the title also supports:

PARQUET-${JIRA_ISSUE_ID}: [${COMPONENT}] ${SUMMARY}

See also:

Fix deadlock with msan (cherry picked from commit b41ff44)

Fix 'undefined symbol: pthread_atfork' on PowerPC64 (cherry picked from commit 450a563)

Don't abort in ~CerrLog (cherry picked from commit d03245f)

Allow Parquet map key to be optional (cherry picked from commit 0d6d07f)

(cherry picked from commit 3264fdad38b2a1628f296cd574a9dd03f4928aea)

nikitamikhaylov · 2024-10-15T11:18:37Z

This PR is needed just to show the list of patches which we need to re-apply to the upstream release.

✅ Check validation of of bit offset when reading bit packed values #66
🔴 Don't throw in ~DictEncoderImpl() #63 looks like not relevant anymore. The upstream contains: GH-38117: [C++][Parquet] Change DictEncoder dtor checking to warning log apache/arrow#38118
✅ Fix possible use-of-uninitizliaed-value #47
🔴 Fix build for s390 #46 The upstream contains: GH-36856: [C++] Remove needless braces from BasicDecimal256FromLE() arguments apache/arrow#36987
✅ Allow to get number of rows in record batch #42
❓❓❓ Fix parquet endian issue for s390x #41 It seems we've never merged the PR to ClickHouse/ClickHouse which depends on this patch.
✅ Allow to get number of rows in record batch #39
✅ Better fix for #16 #26
✅ Better fix for #16 #22
✅ Allow Parquet map key to be optional #17
✅ Don't abort in ~CerrLog #16
✅ Fix 'undefined symbol: pthread_atfork' on PowerPC64 #15
✅ Fix deadlock with msan #14
🔴 Revert "Remove submodules" #13
🔴 Fix data race in ProtectAgainstFork #12 The upstream has: ARROW-15593: [C++] Make after-fork ThreadPool reinitialization thread-safe apache/arrow#12358
🔴 Remove submodules #11
✅ fix building issue introduced by https://github.com/ClickHouse-Extras… #10
✅ Add interface to get raw orc reader from adapters #9
🔴 Update Arrow to apache-arrow-4.0.1 #6
🔴 Remove submodules #5
🔴 Update Arrow to the latest release tag (2.0.0) #2
🔴 Provide method for Uri to get correct value host-with-port for Ipv6 host name #1 The upstream has: ARROW-10475: [C++][FlightRPC] handle IPv6 hosts apache/arrow#8585

Check validation of of bit offset when reading bit packed values (cherry picked from commit 5cfccd8)

Fix possible use-of-uninitizliaed-value (cherry picked from commit ba5c679)

Allow to get number of rows in record batch (cherry picked from commit 1d93838)

Add interface to get raw orc reader from adapters (cherry picked from commit ce6b7af)

fix building issue introduced by https://github.com/ClickHouse-Extras… (cherry picked from commit 20dc6ad)

github-actions · 2024-10-15T11:19:00Z

Thanks for opening a pull request!

If this is not a minor PR. Could you open an issue for this pull request on GitHub? https://github.com/apache/arrow/issues/new/choose

Opening GitHub issues ahead of time contributes to the Openness of the Apache Arrow project.

Then could you also rename the pull request title in the following format?

GH-${GITHUB_ISSUE_ID}: [${COMPONENT}] ${SUMMARY}

or

MINOR: [${COMPONENT}] ${SUMMARY}

In the case of PARQUET issues on JIRA the title also supports:

PARQUET-${JIRA_ISSUE_ID}: [${COMPONENT}] ${SUMMARY}

See also:

Fix deadlock with msan (cherry picked from commit b41ff44)

Fix 'undefined symbol: pthread_atfork' on PowerPC64 (cherry picked from commit 450a563)

Don't abort in ~CerrLog (cherry picked from commit d03245f)

Allow Parquet map key to be optional (cherry picked from commit 0d6d07f)

(cherry picked from commit 3264fdad38b2a1628f296cd574a9dd03f4928aea)

nikitamikhaylov · 2024-10-15T11:18:37Z

This PR is needed just to show the list of patches which we need to re-apply to the upstream release.

✅ Check validation of of bit offset when reading bit packed values #66
🔴 Don't throw in ~DictEncoderImpl() #63 looks like not relevant anymore. The upstream contains: GH-38117: [C++][Parquet] Change DictEncoder dtor checking to warning log apache/arrow#38118
✅ Fix possible use-of-uninitizliaed-value #47
🔴 Fix build for s390 #46 The upstream contains: GH-36856: [C++] Remove needless braces from BasicDecimal256FromLE() arguments apache/arrow#36987
✅ Allow to get number of rows in record batch #42
❓❓❓ Fix parquet endian issue for s390x #41 It seems we've never merged the PR to ClickHouse/ClickHouse which depends on this patch.
✅ Allow to get number of rows in record batch #39
✅ Better fix for #16 #26
✅ Better fix for #16 #22
✅ Allow Parquet map key to be optional #17
✅ Don't abort in ~CerrLog #16
✅ Fix 'undefined symbol: pthread_atfork' on PowerPC64 #15
✅ Fix deadlock with msan #14
🔴 Revert "Remove submodules" #13
🔴 Fix data race in ProtectAgainstFork #12 The upstream has: ARROW-15593: [C++] Make after-fork ThreadPool reinitialization thread-safe apache/arrow#12358
🔴 Remove submodules #11
✅ fix building issue introduced by https://github.com/ClickHouse-Extras… #10
✅ Add interface to get raw orc reader from adapters #9
🔴 Update Arrow to apache-arrow-4.0.1 #6
🔴 Remove submodules #5
🔴 Update Arrow to the latest release tag (2.0.0) #2
🔴 Provide method for Uri to get correct value host-with-port for Ipv6 host name #1 The upstream has: ARROW-10475: [C++][FlightRPC] handle IPv6 hosts apache/arrow#8585

Check validation of of bit offset when reading bit packed values (cherry picked from commit 5cfccd8)

Fix possible use-of-uninitizliaed-value (cherry picked from commit ba5c679)

Allow to get number of rows in record batch (cherry picked from commit 1d93838)

Add interface to get raw orc reader from adapters (cherry picked from commit ce6b7af)

fix building issue introduced by https://github.com/ClickHouse-Extras… (cherry picked from commit 20dc6ad)

github-actions · 2024-10-15T11:19:00Z

Thanks for opening a pull request!

If this is not a minor PR. Could you open an issue for this pull request on GitHub? https://github.com/apache/arrow/issues/new/choose

Opening GitHub issues ahead of time contributes to the Openness of the Apache Arrow project.

Then could you also rename the pull request title in the following format?

GH-${GITHUB_ISSUE_ID}: [${COMPONENT}] ${SUMMARY}

or

MINOR: [${COMPONENT}] ${SUMMARY}

In the case of PARQUET issues on JIRA the title also supports:

PARQUET-${JIRA_ISSUE_ID}: [${COMPONENT}] ${SUMMARY}

See also:

Fix deadlock with msan (cherry picked from commit b41ff44)

Fix 'undefined symbol: pthread_atfork' on PowerPC64 (cherry picked from commit 450a563)

Don't abort in ~CerrLog (cherry picked from commit d03245f)

Allow Parquet map key to be optional (cherry picked from commit 0d6d07f)

(cherry picked from commit 3264fdad38b2a1628f296cd574a9dd03f4928aea)

nikitamikhaylov · 2024-10-15T11:18:37Z

This PR is needed just to show the list of patches which we need to re-apply to the upstream release.

✅ Check validation of of bit offset when reading bit packed values #66
🔴 Don't throw in ~DictEncoderImpl() #63 looks like not relevant anymore. The upstream contains: GH-38117: [C++][Parquet] Change DictEncoder dtor checking to warning log apache/arrow#38118
✅ Fix possible use-of-uninitizliaed-value #47
🔴 Fix build for s390 #46 The upstream contains: GH-36856: [C++] Remove needless braces from BasicDecimal256FromLE() arguments apache/arrow#36987
✅ Allow to get number of rows in record batch #42
❓❓❓ Fix parquet endian issue for s390x #41 It seems we've never merged the PR to ClickHouse/ClickHouse which depends on this patch.
✅ Allow to get number of rows in record batch #39
✅ Better fix for #16 #26
✅ Better fix for #16 #22
✅ Allow Parquet map key to be optional #17
✅ Don't abort in ~CerrLog #16
✅ Fix 'undefined symbol: pthread_atfork' on PowerPC64 #15
✅ Fix deadlock with msan #14
🔴 Revert "Remove submodules" #13
🔴 Fix data race in ProtectAgainstFork #12 The upstream has: ARROW-15593: [C++] Make after-fork ThreadPool reinitialization thread-safe apache/arrow#12358
🔴 Remove submodules #11
✅ fix building issue introduced by https://github.com/ClickHouse-Extras… #10
✅ Add interface to get raw orc reader from adapters #9
🔴 Update Arrow to apache-arrow-4.0.1 #6
🔴 Remove submodules #5
🔴 Update Arrow to the latest release tag (2.0.0) #2
🔴 Provide method for Uri to get correct value host-with-port for Ipv6 host name #1 The upstream has: ARROW-10475: [C++][FlightRPC] handle IPv6 hosts apache/arrow#8585

Check validation of of bit offset when reading bit packed values (cherry picked from commit 5cfccd8)

Fix possible use-of-uninitizliaed-value (cherry picked from commit ba5c679)

Allow to get number of rows in record batch (cherry picked from commit 1d93838)

Add interface to get raw orc reader from adapters (cherry picked from commit ce6b7af)

fix building issue introduced by https://github.com/ClickHouse-Extras… (cherry picked from commit 20dc6ad)

github-actions · 2024-10-15T11:19:00Z

Thanks for opening a pull request!

If this is not a minor PR. Could you open an issue for this pull request on GitHub? https://github.com/apache/arrow/issues/new/choose

Opening GitHub issues ahead of time contributes to the Openness of the Apache Arrow project.

Then could you also rename the pull request title in the following format?

GH-${GITHUB_ISSUE_ID}: [${COMPONENT}] ${SUMMARY}

or

MINOR: [${COMPONENT}] ${SUMMARY}

In the case of PARQUET issues on JIRA the title also supports:

PARQUET-${JIRA_ISSUE_ID}: [${COMPONENT}] ${SUMMARY}

See also:

Fix deadlock with msan (cherry picked from commit b41ff44)

Fix 'undefined symbol: pthread_atfork' on PowerPC64 (cherry picked from commit 450a563)

Don't abort in ~CerrLog (cherry picked from commit d03245f)

Allow Parquet map key to be optional (cherry picked from commit 0d6d07f)

(cherry picked from commit 3264fdad38b2a1628f296cd574a9dd03f4928aea)

nikitamikhaylov · 2024-10-15T11:18:37Z

This PR is needed just to show the list of patches which we need to re-apply to the upstream release.

✅ Check validation of of bit offset when reading bit packed values #66
🔴 Don't throw in ~DictEncoderImpl() #63 looks like not relevant anymore. The upstream contains: GH-38117: [C++][Parquet] Change DictEncoder dtor checking to warning log apache/arrow#38118
✅ Fix possible use-of-uninitizliaed-value #47
🔴 Fix build for s390 #46 The upstream contains: GH-36856: [C++] Remove needless braces from BasicDecimal256FromLE() arguments apache/arrow#36987
✅ Allow to get number of rows in record batch #42
❓❓❓ Fix parquet endian issue for s390x #41 It seems we've never merged the PR to ClickHouse/ClickHouse which depends on this patch.
✅ Allow to get number of rows in record batch #39
✅ Better fix for #16 #26
✅ Better fix for #16 #22
✅ Allow Parquet map key to be optional #17
✅ Don't abort in ~CerrLog #16
✅ Fix 'undefined symbol: pthread_atfork' on PowerPC64 #15
✅ Fix deadlock with msan #14
🔴 Revert "Remove submodules" #13
🔴 Fix data race in ProtectAgainstFork #12 The upstream has: ARROW-15593: [C++] Make after-fork ThreadPool reinitialization thread-safe apache/arrow#12358
🔴 Remove submodules #11
✅ fix building issue introduced by https://github.com/ClickHouse-Extras… #10
✅ Add interface to get raw orc reader from adapters #9
🔴 Update Arrow to apache-arrow-4.0.1 #6
🔴 Remove submodules #5
🔴 Update Arrow to the latest release tag (2.0.0) #2
🔴 Provide method for Uri to get correct value host-with-port for Ipv6 host name #1 The upstream has: ARROW-10475: [C++][FlightRPC] handle IPv6 hosts apache/arrow#8585

Check validation of of bit offset when reading bit packed values (cherry picked from commit 5cfccd8)

Fix possible use-of-uninitizliaed-value (cherry picked from commit ba5c679)

Allow to get number of rows in record batch (cherry picked from commit 1d93838)

Add interface to get raw orc reader from adapters (cherry picked from commit ce6b7af)

fix building issue introduced by https://github.com/ClickHouse-Extras… (cherry picked from commit 20dc6ad)

github-actions · 2024-10-15T11:19:00Z

Thanks for opening a pull request!

If this is not a minor PR. Could you open an issue for this pull request on GitHub? https://github.com/apache/arrow/issues/new/choose

Opening GitHub issues ahead of time contributes to the Openness of the Apache Arrow project.

Then could you also rename the pull request title in the following format?

GH-${GITHUB_ISSUE_ID}: [${COMPONENT}] ${SUMMARY}

or

MINOR: [${COMPONENT}] ${SUMMARY}

In the case of PARQUET issues on JIRA the title also supports:

PARQUET-${JIRA_ISSUE_ID}: [${COMPONENT}] ${SUMMARY}

See also:

Fix deadlock with msan (cherry picked from commit b41ff44)

Fix 'undefined symbol: pthread_atfork' on PowerPC64 (cherry picked from commit 450a563)

Don't abort in ~CerrLog (cherry picked from commit d03245f)

Allow Parquet map key to be optional (cherry picked from commit 0d6d07f)

(cherry picked from commit 3264fdad38b2a1628f296cd574a9dd03f4928aea)

nikitamikhaylovand others added 6 commits October 15, 2024 10:33

Empty commit
57986f2

Merge pull request#66from copperybean/release-13.0.0
39e53db
Check validation of of bit offset when reading bit packed values (cherry picked from commit 5cfccd8)

Merge pull request#47from ClickHouse/fix-uninit-value-msan
45ea0d6
Fix possible use-of-uninitizliaed-value (cherry picked from commit ba5c679)

Merge pull request#39from ClickHouse/count-from-record-batch
fb031b0
Allow to get number of rows in record batch (cherry picked from commit 1d93838)

Merge pull request#9from taiyang-li/raw_orc_reader
21a89cf
Add interface to get raw orc reader from adapters (cherry picked from commit ce6b7af)

Merge pull request#10from taiyang-li/fix_pr_9
4c22e00
fix building issue introduced by https://github.com/ClickHouse-Extras… (cherry picked from commit 20dc6ad)

github-actionsBot added Component: C++ Component: Parquet awaiting review labels Oct 15, 2024

Avogar added 4 commits October 15, 2024 11:23

Merge pull request#14from ClickHouse/fix-deadlock
6664491
Fix deadlock with msan (cherry picked from commit b41ff44)

Merge pull request#15from ClickHouse/try-fix-data-race
b9e78ce
Fix 'undefined symbol: pthread_atfork' on PowerPC64 (cherry picked from commit 450a563)

Merge pull request#16from ClickHouse/remove-abort-in-logging
90f01a1
Don't abort in ~CerrLog (cherry picked from commit d03245f)

Merge pull request#17from bigo-sg/allow_map_key_optional
8b74b9c
Allow Parquet map key to be optional (cherry picked from commit 0d6d07f)

nikitamikhaylov changed the title ~~[Don't merge] Upgrade the Arrow to 16.1.0~~Apply patches to the Arrow to 16.1.0Oct 15, 2024

nikitamikhaylov mentioned this pull request Oct 15, 2024
Bump arrow to v16.1.0 and flatbuffers to v23.5.26 ClickHouse/ClickHouse#70691
Merged
21 tasks

nikitamikhaylov force-pushed the ClickHouse/r-16.1.0 branch from 20794fe to 3264fdaCompare October 16, 2024 12:58

Fix build
60896c8
(cherry picked from commit 3264fdad38b2a1628f296cd574a9dd03f4928aea)

nikitamikhaylov force-pushed the ClickHouse/r-16.1.0 branch from 3264fda to 60896c8Compare October 16, 2024 13:39

nikitamikhaylov merged commit 6e2574f into ClickHouse/release/16.1.0Oct 16, 2024

nikitamikhaylov deleted the ClickHouse/r-16.1.0 branch October 16, 2024 15:27