Skip to content

branch-3.1: [feat](thirdparty) Refactor HDFS dependency management: move HDFS client jars to FE and slim down BE thirdparty #57202 - #57527

Merged
morrySnow merged 2 commits into
apache:branch-3.1from
CalvinKirs:branch-3.1-57202
Nov 3, 2025
Merged

branch-3.1: [feat](thirdparty) Refactor HDFS dependency management: move HDFS client jars to FE and slim down BE thirdparty #57202#57527
morrySnow merged 2 commits into
apache:branch-3.1from
CalvinKirs:branch-3.1-57202

Conversation

@CalvinKirs

@CalvinKirsCalvinKirs commented Oct 30, 2025

Copy link
Copy Markdown
Member

…ve HDFS client jars to FE and slim down BE thirdparty (apache#57202)
apache#57202
(cherry picked from commit 4ea473c)
@Thearas

Copy link
Copy Markdown
Contributor

Thank you for your contribution to Apache Doris.
Don't know what should be done next? See How to process your PR.

Please clearly describe your PR:

  1. What problem was fixed (it's best to include specific error reporting information). How it was fixed.
  2. Which behaviors were modified. What was the previous behavior, what is it now, why was it modified, and what possible impacts might there be.
  3. What features were added. Why was this function added?
  4. Which code was refactored and why was this part of the code refactored?
  5. Which functions were optimized and what is the difference before and after the optimization?

@CalvinKirs

Copy link
Copy Markdown
MemberAuthor

run buildall

1 similar comment
@CalvinKirs

Copy link
Copy Markdown
MemberAuthor

run buildall

@hello-stephen

Copy link
Copy Markdown
Contributor

Cloud UT Coverage Report

Increment line coverage 🎉

Increment coverage report
Complete coverage report

CategoryCoverage
Function Coverage82.29% (1264/1536)
Line Coverage66.13% (22682/34299)
Region Coverage67.46% (11298/16747)
Branch Coverage57.19% (5976/10450)

@doris-robot

Copy link
Copy Markdown
ClickBench: Total hot run time: 31.44 s
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit d2985a629b05c41bf6e80a8c32b4d9f7a136849d, data reload: false
query1	0.04	0.03	0.03
query2	0.07	0.04	0.04
query3	0.24	0.08	0.08
query4	1.59	0.12	0.13
query5	0.53	0.52	0.53
query6	1.13	0.86	0.81
query7	0.03	0.02	0.02
query8	0.05	0.04	0.04
query9	0.55	0.47	0.47
query10	0.53	0.51	0.52
query11	0.16	0.11	0.11
query12	0.16	0.13	0.12
query13	0.66	0.66	0.64
query14	0.94	1.21	1.10
query15	0.90	0.90	0.90
query16	0.40	0.41	0.41
query17	1.10	1.14	1.13
query18	0.28	0.25	0.24
query19	2.11	1.98	2.03
query20	0.02	0.02	0.02
query21	15.37	0.97	0.66
query22	0.76	0.81	0.87
query23	14.86	1.35	0.63
query24	3.30	0.84	0.80
query25	0.15	0.05	0.10
query26	0.32	0.18	0.17
query27	0.05	0.05	0.05
query28	13.22	1.05	0.51
query29	12.63	4.45	3.98
query30	0.26	0.12	0.09
query31	2.83	0.67	0.45
query32	3.24	0.59	0.51
query33	3.12	3.04	3.08
query34	16.66	5.20	4.77
query35	4.62	4.76	4.83
query36	0.79	0.53	0.49
query37	0.11	0.07	0.07
query38	0.06	0.06	0.04
query39	0.04	0.03	0.03
query40	0.17	0.14	0.13
query41	0.09	0.04	0.04
query42	0.05	0.04	0.03
query43	0.05	0.05	0.04
Total cold run time: 104.24 s
Total hot run time: 31.44 s

@morrySnowmorrySnow changed the title branch-3.1:[feat](thirdparty) Refactor HDFS dependency management: move HDFS client jars to FE and slim down BE thirdparty (#57202)branch-3.1: [feat](thirdparty) Refactor HDFS dependency management: move HDFS client jars to FE and slim down BE thirdparty #57202Nov 3, 2025
@morrySnow
morrySnow merged commit 38ce7ce into apache:branch-3.1Nov 3, 2025
23 checks passed
@CalvinKirs
CalvinKirs deleted the branch-3.1-57202 branch November 4, 2025 08:13
@morrySnowmorrySnow mentioned this pull request Nov 13, 2025
Sign up for freeto join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

5 participants

@CalvinKirs@Thearas@hello-stephen@doris-robot@morrySnow