[enhancement](thirdparty) upgrade thirdparty libs

[xinyiZzz]

Proposed changes

protobuf 3.15.0 -> 21.11
glog 0.4.0 -> 0.6.0
lz4 1.9.3 -> 1.9.4
curl 7.79.0 -> 8.2.1
brpc 1.4.0 -> 1.6.0
zstd 1.5.2 -> 1.5.5
arrow 7.0.0 -> 13.0.0
abseil 20220623.1 -> 2023012.3
orc 1.7.2 -> 1.9.0
jemalloc for arrow 5.2.1 -> 5.3.0
xsimd 7.0.0 -> 13.0.0
opentelemetry-proto 0.19.0 -> 1.0.0
opentelemetry 1.8.3 -> 1.10.0

new:
c-ares -> 1.19.1
grpc -> 1.54.3

Further comments

If this is a relatively large or complex change, kick off the discussion at dev@doris.apache.org by explaining why you chose the solution you did and what alternatives you considered, etc...

[github-actions]

sh-checker report

To get the full details, please check in the job output.

shellcheck errors

'shellcheck ' returned error 1 finding the following syntactical issues:
----------
In thirdparty/build-thirdparty.sh line 432:
-DCMAKE_PREFIX_PATH=${TP_INSTALL_DIR} \
^---------------^ SC2086 (info): Double quote to prevent globbing and word splitting.
Did you mean: -DCMAKE_PREFIX_PATH="${TP_INSTALL_DIR}" \
In thirdparty/build-thirdparty.sh line 439:
-DCMAKE_INSTALL_PREFIX=${TP_INSTALL_DIR} ../..
^---------------^ SC2086 (info): Double quote to prevent globbing and word splitting.
Did you mean: -DCMAKE_INSTALL_PREFIX="${TP_INSTALL_DIR}" ../..
In thirdparty/build-thirdparty.sh line 935:
-DCMAKE_INSTALL_PREFIX=${TP_INSTALL_DIR} ..
^---------------^ SC2086 (info): Double quote to prevent globbing and word splitting.
Did you mean: -DCMAKE_INSTALL_PREFIX="${TP_INSTALL_DIR}" ..
In thirdparty/build-thirdparty.sh line 951:
-DCMAKE_INSTALL_PREFIX=${TP_INSTALL_DIR} \
^---------------^ SC2086 (info): Double quote to prevent globbing and word splitting.
Did you mean: -DCMAKE_INSTALL_PREFIX="${TP_INSTALL_DIR}" \
In thirdparty/build-thirdparty.sh line 953:
-Dc-ares_DIR=${TP_INSTALL_DIR} \
^---------------^ SC2086 (info): Double quote to prevent globbing and word splitting.
Did you mean: -Dc-ares_DIR="${TP_INSTALL_DIR}" \
In thirdparty/build-thirdparty.sh line 955:
-Dabsl_DIR=${TP_INSTALL_DIR} \
^---------------^ SC2086 (info): Double quote to prevent globbing and word splitting.
Did you mean: -Dabsl_DIR="${TP_INSTALL_DIR}" \
In thirdparty/build-thirdparty.sh line 957:
-DProtobuf_DIR=${TP_INSTALL_DIR} \
^---------------^ SC2086 (info): Double quote to prevent globbing and word splitting.
Did you mean: -DProtobuf_DIR="${TP_INSTALL_DIR}" \
In thirdparty/build-thirdparty.sh line 959:
-Dre2_DIR:STRING=${TP_INSTALL_DIR} \
^---------------^ SC2086 (info): Double quote to prevent globbing and word splitting.
Did you mean: -Dre2_DIR:STRING="${TP_INSTALL_DIR}" \
In thirdparty/build-thirdparty.sh line 961:
-DOPENSSL_ROOT_DIR=${TP_INSTALL_DIR} \
^---------------^ SC2086 (info): Double quote to prevent globbing and word splitting.
Did you mean: -DOPENSSL_ROOT_DIR="${TP_INSTALL_DIR}" \
In thirdparty/build-thirdparty.sh line 963:
-DZLIB_ROOT=${TP_INSTALL_DIR} \
^---------------^ SC2086 (info): Double quote to prevent globbing and word splitting.
Did you mean: -DZLIB_ROOT="${TP_INSTALL_DIR}" \
In thirdparty/build-thirdparty.sh line 971:
sed -i 's/find_dependency/find_package/g' ${TP_INSTALL_DIR}/lib64/cmake/grpc/gRPCConfig.cmake
^---------------^ SC2086 (info): Double quote to prevent globbing and word splitting.
Did you mean: sed -i 's/find_dependency/find_package/g' "${TP_INSTALL_DIR}"/lib64/cmake/grpc/gRPCConfig.cmake
For more information:
https://www.shellcheck.net/wiki/SC2086 -- Double quote to prevent globbing ...
----------
You can address the above issues in one of three ways:
1. Manually correct the issue in the offending shell script;
2. Disable specific issues by adding the comment:
# shellcheck disable=NNNN
above the line that contains the issue, where NNNN is the error code;
3. Add '-e NNNN' to the SHELLCHECK_OPTS setting in your .yml action file.

shfmt errors

'shfmt ' returned error 1 finding the following formatting issues:
----------
--- thirdparty/build-thirdparty.sh.orig
+++ thirdparty/build-thirdparty.sh
@@ -427,7 +427,7 @@
cd cmake/build
CXXFLAGS="-O2 -I${TP_INCLUDE_DIR}" \
- LDFLAGS="${ldflags}" \
+ LDFLAGS="${ldflags}" \
"${CMAKE_CMD}" -DCMAKE_BUILD_TYPE=Release \
-DCMAKE_PREFIX_PATH=${TP_INSTALL_DIR} \
-Dprotobuf_USE_EXTERNAL_GTEST=ON \
@@ -946,23 +946,23 @@
cd cmake/build
cmake -DgRPC_INSTALL=ON \
- -DgRPC_BUILD_TESTS=OFF \
- -DCMAKE_BUILD_TYPE=Release \
- -DCMAKE_INSTALL_PREFIX=${TP_INSTALL_DIR} \
- -DgRPC_CARES_PROVIDER=package \
- -Dc-ares_DIR=${TP_INSTALL_DIR} \
- -DgRPC_ABSL_PROVIDER=package \
- -Dabsl_DIR=${TP_INSTALL_DIR} \
- -DgRPC_PROTOBUF_PROVIDER=package \
- -DProtobuf_DIR=${TP_INSTALL_DIR} \
- -DgRPC_RE2_PROVIDER=package \
- -Dre2_DIR:STRING=${TP_INSTALL_DIR} \
- -DgRPC_SSL_PROVIDER=package \
- -DOPENSSL_ROOT_DIR=${TP_INSTALL_DIR} \
- -DgRPC_ZLIB_PROVIDER=package \
- -DZLIB_ROOT=${TP_INSTALL_DIR} \
- -DCMAKE_POSITION_INDEPENDENT_CODE=ON \
- ../..
+ -DgRPC_BUILD_TESTS=OFF \
+ -DCMAKE_BUILD_TYPE=Release \
+ -DCMAKE_INSTALL_PREFIX=${TP_INSTALL_DIR} \
+ -DgRPC_CARES_PROVIDER=package \
+ -Dc-ares_DIR=${TP_INSTALL_DIR} \
+ -DgRPC_ABSL_PROVIDER=package \
+ -Dabsl_DIR=${TP_INSTALL_DIR} \
+ -DgRPC_PROTOBUF_PROVIDER=package \
+ -DProtobuf_DIR=${TP_INSTALL_DIR} \
+ -DgRPC_RE2_PROVIDER=package \
+ -Dre2_DIR:STRING=${TP_INSTALL_DIR} \
+ -DgRPC_SSL_PROVIDER=package \
+ -DOPENSSL_ROOT_DIR=${TP_INSTALL_DIR} \
+ -DgRPC_ZLIB_PROVIDER=package \
+ -DZLIB_ROOT=${TP_INSTALL_DIR} \
+ -DCMAKE_POSITION_INDEPENDENT_CODE=ON \
+ ../..
make -j "${PARALLEL}"
make install
@@ -1579,8 +1579,8 @@
cd "${BUILD_DIR}"
CXXFLAGS="-O2 -I${TP_INCLUDE_DIR}" \
- LDFLAGS="-L${TP_LIB_DIR}" \
- "${CMAKE_CMD}" -G "${GENERATOR}" -DCMAKE_INSTALL_PREFIX="${TP_INSTALL_DIR}" \
+ LDFLAGS="-L${TP_LIB_DIR}" \
+ "${CMAKE_CMD}" -G "${GENERATOR}" -DCMAKE_INSTALL_PREFIX="${TP_INSTALL_DIR}" \
-DCMAKE_PREFIX_PATH="${TP_INSTALL_DIR}" \
-DBUILD_TESTING=OFF \
-DWITH_OTLP_GRPC=ON \
----------
You can reformat the above files to meet shfmt's requirements by typing:
shfmt -w filename

[github-actions]

clang-tidy review says "All clean, LGTM! 👍"

[xinyiZzz]

run buildall

[hello-stephen]

(From new machine)TeamCity pipeline, clickbench performance test result:
the sum of best hot time: 48.71 seconds
stream load tsv: 553 seconds loaded 74807831229 Bytes, about 129 MB/s
stream load json: 21 seconds loaded 2358488459 Bytes, about 107 MB/s
stream load orc: 65 seconds loaded 1101869774 Bytes, about 16 MB/s
stream load parquet: 31 seconds loaded 861443392 Bytes, about 26 MB/s
insert into select: 29.2 seconds inserted 10000000 Rows, about 342K ops/s
storage size: 17162299264 Bytes

[xinyiZzz]

run buildall

[hello-stephen]

(From new machine)TeamCity pipeline, clickbench performance test result:
the sum of best hot time: 45.7 seconds
stream load tsv: 537 seconds loaded 74807831229 Bytes, about 132 MB/s
stream load json: 20 seconds loaded 2358488459 Bytes, about 112 MB/s
stream load orc: 65 seconds loaded 1101869774 Bytes, about 16 MB/s
stream load parquet: 31 seconds loaded 861443392 Bytes, about 26 MB/s
insert into select: 29.2 seconds inserted 10000000 Rows, about 342K ops/s
storage size: 17162073019 Bytes

[xinyiZzz]

run buildall

[xinyiZzz]

run buildall

[hello-stephen]

(From new machine)TeamCity pipeline, clickbench performance test result:
the sum of best hot time: 44.97 seconds
stream load tsv: 554 seconds loaded 74807831229 Bytes, about 128 MB/s
stream load json: 20 seconds loaded 2358488459 Bytes, about 112 MB/s
stream load orc: 65 seconds loaded 1101869774 Bytes, about 16 MB/s
stream load parquet: 32 seconds loaded 861443392 Bytes, about 25 MB/s
insert into select: 29.4 seconds inserted 10000000 Rows, about 340K ops/s
storage size: 17162085456 Bytes

[adonis0147]

LGTM

[github-actions]

PR approved by at least one committer and no changes requested.

[github-actions]

PR approved by anyone and no changes requested.

[morningman]

LGTM