HDDS-15559. Add libhadoop to DYLD_LIBRARY_PATH or LD_LIBRARY_PATH by ChenSammi · Pull Request #10513 · apache/ozone

ChenSammi · 2026-06-15T07:17:21Z

What changes were proposed in this pull request?

Currently, three platform hadoop native library is supported,

linux, x86_64
linux, aarch64
Mac, arm64(aarch64)

download all three platform native library during mvn build
create libhadoop.so pointing to linux x86_64 native library file during mvn build
create libhadoop.dylib pointing to mac arm64 native library file during mvn build
at runtime, if it's linux aarch64 platform, recreate the libhadoop.so pointing to linux aarch64 native library file
add libhadoop to DYLD_LIBRARY_PATH or LD_LIBRARY_PATH, so that libhadoop can be found and loaded during Ozone service and client startup if short-circuit is enabled.

What is the link to the Apache JIRA

https://issues.apache.org/jira/browse/HDDS-15559

How was this patch tested?

Tested locally for aarch64 platform, and CI for x86_64 platform.

// use ozone docker image hadoop native library under /usr/lib

bash-5.1$ ozone debug checknative
Native library checking:
hadoop: true /usr/lib/libhadoop.so.1.0.0
ISA-L: false libhadoop was built without ISA-L support
OpenSSL: false Cannot load libcrypto.so (libcrypto.so: cannot open shared object file: No such file or directory)!
rocks-tools: false

// mvn clean package -DskipTests -Dmaven.javadoc.skip=true -Pdist -Plinux-aarch64 // on MacOS M1
// use ozone package hadoop native library under ./lib/native/

bash-5.1$ ozone debug checknative
Native library checking:
hadoop: true /opt/hadoop/lib/native/libhadoop_linux_aarch_64.so
ISA-L: false libhadoop was built without ISA-L support
OpenSSL: false Cannot load libcrypto.so (libcrypto.so: cannot open shared object file: No such file or directory)!
rocks-tools: false

ChenSammi · 2026-06-15T07:25:01Z

Clean CI https://github.com/ChenSammi/ozone/actions/runs/27526013409.

adoroszlai

Thanks @ChenSammi for working on this. This change makes the build output depend on user's environment (OS, architecture). As discussed in #10305, this decision should be made at runtime, not build time. Build output should include all available libs, so user downloading binary tarball can use it on all platforms. (We also use the same tarball for creating Ozone Docker image.)

ChenSammi · 2026-06-22T07:15:10Z

Thanks @ChenSammi for working on this. This change makes the build output depend on user's environment (OS, architecture). As discussed in #10305, this decision should be made at runtime, not build time. Build output should include all available libs, so user downloading binary tarball can use it on all platforms. (We also use the same tarball for creating Ozone Docker image.)

@adoroszlai , thanks for the review. These are the observations when I run ozone in docker in Mac M1,

the ozone docker is linux arm64. Both linux arm64 and x86_64 expects hadoop library with name "libhadoop.so", this symbolic file is created during build time. So it cannot support both arm64 and x86_64 at build time. Unless we move the symbolic creation at run time, but still need to detect the os/architecture at runtime.
The current build script, it supports auto detect os/architecture, also supports cross platform build with -P, which is needed for debug environment like mine.
I inspected the hadoop release package, it has normal bin package, and arm64 bin package, each only carries the native libraries for it's architecture. I feel this way is very clean. Is there any obvious benefit that mixing all platform native libraries together in one tarball?

adoroszlai · 2026-06-22T07:45:48Z

Is there any obvious benefit that mixing all platform native libraries together in one tarball?

Yes:

reduced time at release (one build)
reduced storage (no duplicated 500MB+ artifacts for a difference in native library less than 1MB)

ratis-thirdparty (and Ozone) binaries include Netty native libraries for all platforms.

jojochuang · 2026-07-07T22:04:08Z

There's a repeated CI failure due to downloading rocksdbjni. We're updating rocksdb to 10 not sure if that's going to solve this problem. #9813

jojochuang · 2026-07-15T06:50:42Z

My Cursor is fixing the native lib problem: https://github.com/jojochuang/ozone/commits/refs/heads/HDDS-15559/

adoroszlai · 2026-07-16T11:53:32Z

Can we please keep it as draft until CI is passing in fork?

ChenSammi · 2026-07-16T14:44:24Z

@adoroszlai @jojochuang , could you help to review the patch again?

yandrey321 · 2026-07-16T17:57:50Z

My Cursor is fixing the native lib problem: https://github.com/jojochuang/ozone/commits/refs/heads/HDDS-15559/

is it a fix for m1/arm environments?

yandrey321 · 2026-07-16T18:22:10Z

+ # Forcefully recreate it so it points to the correct target file
+ ln -sf "$TARGET_FILE" "$LINK_FILE" > /dev/null 2>&1
+ fi
+ export DYLD_LIBRARY_PATH=$OZONE_HOME/lib/native:$DYLD_LIBRARY_PATH


would this export be effective to the current build/test execution process?

This is mainly for the Mac user of final ozone bin package.

adoroszlai

Thanks @ChenSammi for getting this to work. I have some minor code comments, I will address them in follow-up.

adoroszlai · 2026-07-17T06:09:41Z

+ pushd . > /dev/null && cd lib/native
+ # If no matching file variant was found for the current environment
+ if [ -z "$TARGET_FILE" ]; then
+ echo "Error: libhadoop doesn't support platform combination ($OS_TYPE / $ARCH_TYPE)." >&2


OS_TYPE is deprecated, should use OZONE_OS_TYPE.

adoroszlai · 2026-07-17T06:10:59Z

+ if [ -z "$TARGET_FILE" ]; then
+ echo "Error: libhadoop doesn't support platform combination ($OS_TYPE / $ARCH_TYPE)." >&2
+ else
+ LINK_FILE="libhadoop.dylib"


By moving LINK_FILE definition out of if-else, the code block can be extracted to a function, to be reused for both Darwin and Linux cases.

Co-authored-by: Doroszlai, Attila <6454655+adoroszlai@users.noreply.github.com>

ChenSammi · 2026-07-20T03:02:59Z

Thanks @adoroszlai @jojochuang @yandrey321 , for the review and good suggestion.

ChenSammi requested a review from adoroszlai June 15, 2026 07:23

ChenSammi requested a review from jojochuang June 18, 2026 04:08

adoroszlai reviewed Jun 21, 2026
View reviewed changes

ChenSammi changed the title ~~HDDS-15559. Enable cross platform hadoop native library download~~HDDS-15559. Create libhadoop symbolic link at runtimeJul 15, 2026

HDDS-15559. Enable cross platform hadoop native library download
5a25633

ChenSammi force-pushed the HDDS-15559 branch from a2918d7 to 5a25633Compare July 15, 2026 11:38

rocksdb not found
5ec1bab

ChenSammi force-pushed the HDDS-15559 branch 2 times, most recently from 5554ef6 to b7c5094Compare July 16, 2026 04:04

fix docker image ln permission failure
6718c42

ChenSammi force-pushed the HDDS-15559 branch from b7c5094 to 6718c42Compare July 16, 2026 04:54

ChenSammi added 4 commits July 16, 2026 14:18

support symbolic creation during build too
8065616

try remove remove hadoop-native-lib
22d0af8

recreate symbolic file if it doesn't point to expected file
d6eacfb

add back hadoop-native-lib profile
f6c468e

ChenSammi changed the title ~~HDDS-15559. Create libhadoop symbolic link at runtime~~HDDS-15559. Fix libhadoop symbolic link at runtimeJul 16, 2026

ChenSammi changed the title ~~HDDS-15559. Fix libhadoop symbolic link at runtime~~HDDS-15559. Add libhadoop to DYLD_LIBRARY_PATH or LD_LIBRARY_PATHJul 16, 2026

yandrey321 reviewed Jul 16, 2026
View reviewed changes

adoroszlai approved these changes Jul 17, 2026
View reviewed changes

Update hadoop-ozone/dist/src/shell/ozone/ozone-functions.sh
a9a6149
Co-authored-by: Doroszlai, Attila <6454655+adoroszlai@users.noreply.github.com>

adoroszlai merged commit 2777374 into apache:HDDS-10685Jul 17, 2026
45 checks passed

Uh oh!

Conversation

ChenSammi commented Jun 15, 2026• edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

What changes were proposed in this pull request?

What is the link to the Apache JIRA

How was this patch tested?

Uh oh!

ChenSammi commented Jun 15, 2026

Uh oh!

adoroszlai left a comment

Choose a reason for hiding this comment

Uh oh!

ChenSammi commented Jun 22, 2026

Uh oh!

adoroszlai commented Jun 22, 2026• edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

jojochuang commented Jul 7, 2026

Uh oh!

jojochuang commented Jul 15, 2026

Uh oh!

adoroszlai commented Jul 16, 2026

Uh oh!

ChenSammi commented Jul 16, 2026

Uh oh!

yandrey321 commented Jul 16, 2026

Uh oh!

yandrey321Jul 16, 2026

Choose a reason for hiding this comment

Uh oh!

ChenSammiJul 17, 2026• edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Choose a reason for hiding this comment

Uh oh!

adoroszlai left a comment

Choose a reason for hiding this comment

Uh oh!

Uh oh!

adoroszlaiJul 17, 2026

Choose a reason for hiding this comment

Uh oh!

adoroszlaiJul 17, 2026

Choose a reason for hiding this comment

Uh oh!

Uh oh!

ChenSammi commented Jul 20, 2026

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

4 participants

ChenSammi commented Jun 15, 2026•
edited
Loading

adoroszlai commented Jun 22, 2026•
edited
Loading

ChenSammiJul 17, 2026•
edited
Loading