Skip to content

[chore](dep)Upgrade Shade - #58071

Merged
CalvinKirs merged 11 commits into
apache:masterfrom
CalvinKirs:master-shade-sp
Dec 1, 2025
Merged

[chore](dep)Upgrade Shade#58071
CalvinKirs merged 11 commits into
apache:masterfrom
CalvinKirs:master-shade-sp

Conversation

@CalvinKirs

@CalvinKirsCalvinKirs commented Nov 17, 2025•
edited
Loading

Copy link
Copy Markdown
Member

Upgrade Shade

make the COS and OBS modules optional

allowing us to skip them during the build with a flag such as -exclude-cos-dependencies since those modules contain unresolved supply-chain security issues upstream.

@Thearas

Thearas commented Nov 17, 2025

Copy link
Copy Markdown
Contributor

Thank you for your contribution to Apache Doris.
Don't know what should be done next? See How to process your PR.

Please clearly describe your PR:

  1. What problem was fixed (it's best to include specific error reporting information). How it was fixed.
  2. Which behaviors were modified. What was the previous behavior, what is it now, why was it modified, and what possible impacts might there be.
  3. What features were added. Why was this function added?
  4. Which code was refactored and why was this part of the code refactored?
  5. Which functions were optimized and what is the difference before and after the optimization?

@CalvinKirs

CalvinKirs commented Nov 17, 2025

Copy link
Copy Markdown
MemberAuthor

run buildall

@CalvinKirs

CalvinKirs commented Nov 17, 2025

Copy link
Copy Markdown
MemberAuthor

run buildall

1 similar comment
@CalvinKirs

CalvinKirs commented Nov 17, 2025

Copy link
Copy Markdown
MemberAuthor

run buildall

@CalvinKirs

CalvinKirs commented Nov 17, 2025

Copy link
Copy Markdown
MemberAuthor

run buildall

@CalvinKirs

CalvinKirs commented Nov 17, 2025

Copy link
Copy Markdown
MemberAuthor

run buildall

@doris-robot

doris-robot commented Nov 17, 2025

Copy link
Copy Markdown
TPC-H: Total hot run time: 34202 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit e1da8bd8a63256399dc8ba6727bfd3fe60589716, data reload: false
------ Round 1 ----------------------------------
q1	17610	5301	5031	5031
q2	2067	291	208	208
q3	10421	1264	720	720
q4	10273	932	381	381
q5	7562	2411	2322	2322
q6	186	166	132	132
q7	924	774	625	625
q8	9339	1333	1183	1183
q9	6893	5211	5173	5173
q10	6866	2225	1832	1832
q11	508	313	279	279
q12	333	362	226	226
q13	17789	3664	3030	3030
q14	232	229	220	220
q15	566	515	502	502
q16	1018	1002	947	947
q17	589	891	366	366
q18	7562	7033	7057	7033
q19	1081	953	555	555
q20	359	356	232	232
q21	3811	2549	2253	2253
q22	1038	1043	952	952
Total cold run time: 107027 ms
Total hot run time: 34202 ms
----- Round 2, with runtime_filter_mode=off -----
q1	5116	5059	5091	5059
q2	248	341	236	236
q3	2137	2649	2276	2276
q4	1328	1725	1284	1284
q5	4188	4264	4412	4264
q6	228	172	138	138
q7	2007	1950	1809	1809
q8	2642	2577	2557	2557
q9	7329	7284	7156	7156
q10	3112	3313	2830	2830
q11	572	523	514	514
q12	684	745	614	614
q13	3510	3934	3317	3317
q14	302	301	452	301
q15	594	495	496	495
q16	1060	1071	1064	1064
q17	1144	1546	1421	1421
q18	7902	7604	7446	7446
q19	865	792	823	792
q20	1915	1997	1787	1787
q21	4680	4326	4143	4143
q22	1097	1045	1002	1002
Total cold run time: 52660 ms
Total hot run time: 50505 ms

@doris-robot

doris-robot commented Nov 17, 2025

Copy link
Copy Markdown
TPC-DS: Total hot run time: 187822 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit e1da8bd8a63256399dc8ba6727bfd3fe60589716, data reload: false
query1	1058	412	429	412
query2	6565	1659	1676	1659
query3	6756	232	226	226
query4	26189	23489	22859	22859
query5	4405	634	491	491
query6	333	241	230	230
query7	4650	498	295	295
query8	294	269	255	255
query9	8656	2903	2911	2903
query10	504	363	288	288
query11	15505	14917	15172	14917
query12	177	123	110	110
query13	1675	555	448	448
query14	11120	9056	9069	9056
query15	206	186	170	170
query16	7604	658	460	460
query17	1221	736	612	612
query18	2021	446	331	331
query19	206	199	176	176
query20	136	127	125	125
query21	210	132	117	117
query22	4090	4089	3922	3922
query23	33630	32776	33275	32776
query24	8105	2386	2374	2374
query25	602	526	462	462
query26	1239	270	168	168
query27	2753	504	356	356
query28	4425	2275	2242	2242
query29	831	627	501	501
query30	293	219	199	199
query31	911	788	709	709
query32	95	82	84	82
query33	577	389	359	359
query34	808	848	533	533
query35	813	843	743	743
query36	931	968	941	941
query37	137	118	101	101
query38	3478	3499	3467	3467
query39	1469	1416	1428	1416
query40	238	138	127	127
query41	64	60	59	59
query42	132	118	113	113
query43	478	494	459	459
query44	1259	816	790	790
query45	188	181	169	169
query46	877	981	652	652
query47	1766	1811	1752	1752
query48	389	428	339	339
query49	780	530	463	463
query50	672	680	413	413
query51	3935	3990	3866	3866
query52	120	116	110	110
query53	266	275	209	209
query54	350	326	318	318
query55	96	95	96	95
query56	360	364	367	364
query57	1171	1195	1139	1139
query58	319	305	313	305
query59	2496	2643	2521	2521
query60	377	394	358	358
query61	192	189	190	189
query62	799	730	675	675
query63	236	202	204	202
query64	4542	1281	981	981
query65	4028	3929	3960	3929
query66	1140	454	364	364
query67	15256	15171	14791	14791
query68	7908	952	652	652
query69	504	365	311	311
query70	1315	1254	1289	1254
query71	433	360	340	340
query72	6154	4829	4907	4829
query73	661	595	370	370
query74	8953	9049	8932	8932
query75	3243	3226	2790	2790
query76	3322	1161	761	761
query77	521	412	342	342
query78	9505	9730	8866	8866
query79	2443	830	608	608
query80	695	581	527	527
query81	518	263	225	225
query82	226	160	135	135
query83	271	264	253	253
query84	261	121	97	97
query85	884	489	459	459
query86	385	304	292	292
query87	3748	3692	3568	3568
query88	3002	2266	2261	2261
query89	380	331	289	289
query90	1994	232	268	232
query91	169	186	133	133
query92	89	80	74	74
query93	2357	1031	687	687
query94	729	440	319	319
query95	432	348	333	333
query96	494	592	293	293
query97	2906	2987	2839	2839
query98	245	224	219	219
query99	1341	1427	1289	1289
Total cold run time: 273292 ms
Total hot run time: 187822 ms

@doris-robot

doris-robot commented Nov 17, 2025

Copy link
Copy Markdown
ClickBench: Total hot run time: 27.91 s
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit e1da8bd8a63256399dc8ba6727bfd3fe60589716, data reload: false
query1	0.05	0.05	0.04
query2	0.09	0.05	0.05
query3	0.25	0.08	0.08
query4	1.61	0.11	0.11
query5	0.27	0.25	0.26
query6	1.18	0.63	0.65
query7	0.03	0.03	0.02
query8	0.05	0.04	0.04
query9	0.58	0.52	0.51
query10	0.57	0.58	0.58
query11	0.16	0.12	0.11
query12	0.16	0.12	0.12
query13	0.63	0.61	0.59
query14	1.01	0.99	0.98
query15	0.85	0.83	0.84
query16	0.39	0.39	0.38
query17	1.03	1.00	1.04
query18	0.21	0.20	0.20
query19	1.85	1.88	1.82
query20	0.01	0.01	0.01
query21	15.44	0.20	0.13
query22	5.06	0.07	0.05
query23	15.67	0.26	0.10
query24	2.33	0.98	0.83
query25	0.08	0.06	0.06
query26	0.13	0.13	0.13
query27	0.06	0.06	0.05
query28	5.41	1.20	0.99
query29	12.64	3.87	3.19
query30	0.28	0.14	0.12
query31	2.82	0.61	0.37
query32	3.22	0.55	0.46
query33	2.98	3.07	3.06
query34	15.66	5.22	4.59
query35	4.56	4.60	4.64
query36	0.66	0.51	0.49
query37	0.10	0.07	0.06
query38	0.07	0.04	0.04
query39	0.04	0.02	0.02
query40	0.18	0.14	0.13
query41	0.08	0.03	0.03
query42	0.04	0.03	0.03
query43	0.04	0.04	0.03
Total cold run time: 98.53 s
Total hot run time: 27.91 s

@CalvinKirs

CalvinKirs commented Nov 19, 2025

Copy link
Copy Markdown
MemberAuthor

run buildall

@doris-robot

doris-robot commented Nov 19, 2025

Copy link
Copy Markdown
TPC-H: Total hot run time: 33709 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 08c5e6332c81fa8b5ac98276197ff8aa39b1fa8a, data reload: false
------ Round 1 ----------------------------------
q1	17639	5164	4882	4882
q2	2083	311	205	205
q3	10237	1264	710	710
q4	10238	967	379	379
q5	7565	2288	2423	2288
q6	181	177	140	140
q7	882	797	638	638
q8	9382	1335	1109	1109
q9	6850	5063	5036	5036
q10	6881	2179	1791	1791
q11	521	313	286	286
q12	345	365	234	234
q13	17791	3615	3018	3018
q14	227	242	220	220
q15	578	496	500	496
q16	1016	989	937	937
q17	577	851	362	362
q18	7400	7116	6952	6952
q19	1223	958	542	542
q20	360	336	223	223
q21	3632	3149	2276	2276
q22	1057	1024	985	985
Total cold run time: 106665 ms
Total hot run time: 33709 ms
----- Round 2, with runtime_filter_mode=off -----
q1	4947	4950	4948	4948
q2	247	328	224	224
q3	2118	2667	2277	2277
q4	1333	1752	1320	1320
q5	4198	4252	4499	4252
q6	215	177	128	128
q7	2061	1923	1802	1802
q8	2668	2662	2532	2532
q9	7154	7280	7146	7146
q10	3105	3221	2823	2823
q11	602	531	508	508
q12	681	773	651	651
q13	3584	4055	3223	3223
q14	293	328	280	280
q15	526	525	492	492
q16	1061	1123	1059	1059
q17	1307	1567	1352	1352
q18	7884	7770	7558	7558
q19	815	756	892	756
q20	1965	2098	2031	2031
q21	4930	4419	4243	4243
q22	1084	1067	1021	1021
Total cold run time: 52778 ms
Total hot run time: 50626 ms

@doris-robot

doris-robot commented Nov 19, 2025

Copy link
Copy Markdown
TPC-DS: Total hot run time: 188119 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 08c5e6332c81fa8b5ac98276197ff8aa39b1fa8a, data reload: false
query1	1033	442	397	397
query2	6572	1704	1647	1647
query3	6744	222	217	217
query4	26040	23258	22927	22927
query5	4418	648	503	503
query6	339	248	231	231
query7	4649	495	313	313
query8	331	248	247	247
query9	8688	2926	2967	2926
query10	483	344	313	313
query11	15851	14987	14862	14862
query12	188	124	125	124
query13	1686	575	459	459
query14	10991	9311	9233	9233
query15	200	197	174	174
query16	7459	681	507	507
query17	1264	785	664	664
query18	2046	416	318	318
query19	212	197	181	181
query20	136	128	122	122
query21	211	131	115	115
query22	3978	4107	4082	4082
query23	33701	32869	32851	32851
query24	8066	2394	2384	2384
query25	586	553	453	453
query26	1226	275	170	170
query27	2754	506	355	355
query28	4445	2236	2210	2210
query29	807	635	496	496
query30	297	231	207	207
query31	903	806	723	723
query32	98	83	83	83
query33	586	398	349	349
query34	807	854	531	531
query35	809	843	769	769
query36	957	1004	884	884
query37	133	118	99	99
query38	3657	3611	3397	3397
query39	1487	1439	1414	1414
query40	234	140	127	127
query41	62	59	62	59
query42	135	118	117	117
query43	492	487	458	458
query44	1278	808	811	808
query45	188	184	174	174
query46	880	989	648	648
query47	1762	1801	1728	1728
query48	417	436	327	327
query49	755	500	410	410
query50	646	677	407	407
query51	3910	3925	3879	3879
query52	119	118	112	112
query53	271	277	204	204
query54	352	318	299	299
query55	102	93	92	92
query56	366	355	343	343
query57	1194	1207	1097	1097
query58	295	289	282	282
query59	2519	2694	2448	2448
query60	363	396	361	361
query61	161	155	157	155
query62	797	692	666	666
query63	228	205	195	195
query64	4466	1154	890	890
query65	4020	3939	3972	3939
query66	1201	443	350	350
query67	15061	15071	14878	14878
query68	4594	948	644	644
query69	512	336	301	301
query70	1343	1242	1203	1203
query71	429	354	327	327
query72	5881	5158	5300	5158
query73	719	686	368	368
query74	8948	9075	8902	8902
query75	3365	3246	2780	2780
query76	3286	1129	761	761
query77	495	407	346	346
query78	9626	9725	8791	8791
query79	1466	854	619	619
query80	1710	579	528	528
query81	557	259	234	234
query82	427	168	132	132
query83	346	263	250	250
query84	254	112	97	97
query85	934	486	438	438
query86	391	314	298	298
query87	3686	3713	3615	3615
query88	2804	2271	2229	2229
query89	388	332	291	291
query90	1750	239	234	234
query91	164	177	138	138
query92	80	79	87	79
query93	1205	1007	694	694
query94	684	434	308	308
query95	432	357	341	341
query96	487	598	283	283
query97	2870	2962	2846	2846
query98	235	221	222	221
query99	1330	1368	1273	1273
Total cold run time: 268510 ms
Total hot run time: 188119 ms

@doris-robot

doris-robot commented Nov 19, 2025

Copy link
Copy Markdown
ClickBench: Total hot run time: 27.71 s
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 08c5e6332c81fa8b5ac98276197ff8aa39b1fa8a, data reload: false
query1	0.05	0.05	0.05
query2	0.09	0.05	0.05
query3	0.26	0.08	0.08
query4	1.60	0.12	0.11
query5	0.28	0.25	0.25
query6	1.16	0.64	0.64
query7	0.03	0.02	0.03
query8	0.05	0.04	0.04
query9	0.58	0.52	0.52
query10	0.58	0.58	0.58
query11	0.16	0.11	0.11
query12	0.15	0.12	0.12
query13	0.62	0.59	0.62
query14	0.99	1.00	1.01
query15	0.84	0.83	0.83
query16	0.38	0.40	0.38
query17	1.04	1.01	1.00
query18	0.21	0.20	0.20
query19	1.90	1.78	1.79
query20	0.01	0.03	0.01
query21	15.46	0.20	0.12
query22	5.13	0.08	0.04
query23	15.67	0.24	0.09
query24	2.40	0.91	0.75
query25	0.08	0.06	0.07
query26	0.15	0.15	0.13
query27	0.06	0.05	0.05
query28	4.72	1.19	0.95
query29	12.53	3.89	3.20
query30	0.27	0.13	0.12
query31	2.80	0.58	0.39
query32	3.25	0.54	0.48
query33	3.05	3.04	3.09
query34	15.74	5.21	4.52
query35	4.56	4.56	4.56
query36	0.69	0.50	0.49
query37	0.09	0.06	0.07
query38	0.07	0.04	0.04
query39	0.04	0.03	0.03
query40	0.17	0.14	0.14
query41	0.07	0.03	0.03
query42	0.04	0.04	0.03
query43	0.04	0.04	0.03
Total cold run time: 98.06 s
Total hot run time: 27.71 s

@CalvinKirs

CalvinKirs commented Nov 21, 2025

Copy link
Copy Markdown
MemberAuthor

run buildall

@doris-robot

doris-robot commented Nov 21, 2025

Copy link
Copy Markdown
TPC-H: Total hot run time: 35746 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 1ff242673f0ef664f9cf5922b1f8def1011cf65b, data reload: false
------ Round 1 ----------------------------------
q1	17679	5039	4908	4908
q2	2187	305	204	204
q3	10245	1271	709	709
q4	10294	933	371	371
q5	7465	2368	2385	2368
q6	181	165	137	137
q7	923	759	632	632
q8	9358	1342	1183	1183
q9	7206	5308	5362	5308
q10	7177	2178	1785	1785
q11	550	312	287	287
q12	387	357	227	227
q13	17999	3637	2995	2995
q14	231	231	209	209
q15	597	514	500	500
q16	1029	983	922	922
q17	640	860	374	374
q18	7573	7625	7775	7625
q19	1309	974	566	566
q20	373	347	235	235
q21	4315	3504	3146	3146
q22	1146	1102	1055	1055
Total cold run time: 108864 ms
Total hot run time: 35746 ms
----- Round 2, with runtime_filter_mode=off -----
q1	5219	5135	5247	5135
q2	323	384	320	320
q3	2238	2965	2429	2429
q4	1454	1789	1484	1484
q5	4458	4398	4449	4398
q6	203	187	130	130
q7	2003	1971	1803	1803
q8	2609	2670	2567	2567
q9	7761	7453	7502	7453
q10	2926	3098	2631	2631
q11	570	510	501	501
q12	639	712	579	579
q13	3250	3654	2995	2995
q14	272	285	259	259
q15	528	495	481	481
q16	1006	1050	989	989
q17	1088	1467	1371	1371
q18	7317	7197	7045	7045
q19	745	836	885	836
q20	1882	2014	1809	1809
q21	4743	4342	4575	4342
q22	1068	1042	1005	1005
Total cold run time: 52302 ms
Total hot run time: 50562 ms

@doris-robot

doris-robot commented Nov 21, 2025

Copy link
Copy Markdown
TPC-DS: Total hot run time: 187053 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 1ff242673f0ef664f9cf5922b1f8def1011cf65b, data reload: false
query1	1419	412	393	393
query2	6602	1700	1692	1692
query3	6877	218	216	216
query4	27169	23018	22769	22769
query5	4448	636	455	455
query6	334	237	216	216
query7	4648	511	299	299
query8	352	257	248	248
query9	8689	2569	2577	2569
query10	479	333	277	277
query11	15769	15202	14821	14821
query12	178	119	110	110
query13	1666	561	445	445
query14	10865	9266	9211	9211
query15	207	184	171	171
query16	7240	694	534	534
query17	1265	742	613	613
query18	2021	408	317	317
query19	210	198	172	172
query20	127	126	120	120
query21	549	128	115	115
query22	4089	3962	4146	3962
query23	33704	33040	32910	32910
query24	8514	2404	2381	2381
query25	684	536	476	476
query26	1281	283	165	165
query27	2710	503	363	363
query28	4393	2202	2173	2173
query29	874	630	511	511
query30	343	229	215	215
query31	925	827	725	725
query32	90	76	75	75
query33	611	394	344	344
query34	791	856	521	521
query35	814	862	753	753
query36	970	987	911	911
query37	175	117	87	87
query38	3585	3581	3508	3508
query39	1507	1434	1406	1406
query40	237	133	129	129
query41	71	70	68	68
query42	130	115	117	115
query43	501	508	482	482
query44	1247	776	776	776
query45	193	178	176	176
query46	902	994	633	633
query47	1740	1758	1693	1693
query48	398	423	333	333
query49	809	496	403	403
query50	657	682	411	411
query51	3886	3978	3870	3870
query52	115	114	106	106
query53	236	281	205	205
query54	379	300	285	285
query55	92	84	81	81
query56	324	332	327	327
query57	1173	1181	1116	1116
query58	301	278	281	278
query59	2537	2719	2480	2480
query60	356	368	347	347
query61	188	192	193	192
query62	785	717	667	667
query63	233	197	211	197
query64	4712	1179	868	868
query65	4016	3927	3936	3927
query66	1166	434	326	326
query67	15188	15033	14798	14798
query68	8379	956	625	625
query69	520	320	280	280
query70	1416	1297	1304	1297
query71	506	340	316	316
query72	5863	4893	4841	4841
query73	683	578	368	368
query74	8842	9280	8912	8912
query75	4000	3324	2814	2814
query76	3784	1172	737	737
query77	855	402	319	319
query78	9559	9733	8869	8869
query79	1953	840	597	597
query80	657	565	514	514
query81	552	268	230	230
query82	271	158	133	133
query83	258	266	246	246
query84	257	111	98	98
query85	885	470	436	436
query86	405	307	302	302
query87	3669	3763	3620	3620
query88	3475	2271	2289	2271
query89	395	323	293	293
query90	2025	221	218	218
query91	166	170	136	136
query92	86	69	62	62
query93	1775	999	684	684
query94	649	454	350	350
query95	417	328	309	309
query96	480	558	284	284
query97	2861	2952	2852	2852
query98	246	213	209	209
query99	1283	1389	1293	1293
Total cold run time: 276918 ms
Total hot run time: 187053 ms

@doris-robot

doris-robot commented Nov 21, 2025

Copy link
Copy Markdown
ClickBench: Total hot run time: 27.44 s
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 1ff242673f0ef664f9cf5922b1f8def1011cf65b, data reload: false
query1	0.05	0.05	0.05
query2	0.12	0.05	0.05
query3	0.29	0.08	0.08
query4	1.62	0.11	0.11
query5	0.26	0.25	0.25
query6	1.17	0.65	0.64
query7	0.03	0.02	0.02
query8	0.05	0.04	0.04
query9	0.60	0.53	0.52
query10	0.57	0.58	0.57
query11	0.18	0.11	0.11
query12	0.16	0.12	0.12
query13	0.61	0.60	0.60
query14	1.01	1.00	0.99
query15	0.85	0.82	0.83
query16	0.39	0.38	0.38
query17	1.03	0.99	1.03
query18	0.22	0.20	0.19
query19	1.88	1.76	1.84
query20	0.05	0.01	0.01
query21	15.44	0.18	0.14
query22	5.16	0.06	0.05
query23	15.71	0.24	0.10
query24	3.48	0.51	0.42
query25	0.08	0.07	0.06
query26	0.14	0.14	0.14
query27	0.09	0.05	0.05
query28	4.67	1.13	0.94
query29	12.55	3.93	3.26
query30	0.28	0.13	0.11
query31	2.82	0.57	0.39
query32	3.23	0.56	0.47
query33	3.03	3.06	3.02
query34	16.03	5.13	4.57
query35	4.57	4.58	4.62
query36	0.68	0.51	0.49
query37	0.11	0.07	0.07
query38	0.07	0.04	0.04
query39	0.05	0.03	0.03
query40	0.18	0.14	0.14
query41	0.09	0.03	0.02
query42	0.05	0.03	0.02
query43	0.04	0.04	0.03
Total cold run time: 99.69 s
Total hot run time: 27.44 s

@hello-stephen

hello-stephen commented Nov 21, 2025

Copy link
Copy Markdown
Contributor

FE UT Coverage Report

Increment line coverage `` 🎉
Increment coverage report
Complete coverage report

@CalvinKirs

CalvinKirs commented Nov 24, 2025

Copy link
Copy Markdown
MemberAuthor

run buildall

@doris-robot

doris-robot commented Nov 24, 2025

Copy link
Copy Markdown
TPC-H: Total hot run time: 34091 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit c72dffe9bae44c64bb042e59394bace933a83492, data reload: false
------ Round 1 ----------------------------------
q1	16951	4976	4924	4924
q2	2041	319	203	203
q3	9909	1298	696	696
q4	10121	937	367	367
q5	7496	2327	2369	2327
q6	181	164	133	133
q7	912	773	612	612
q8	9338	1320	1074	1074
q9	7064	5348	5398	5348
q10	6818	2214	1810	1810
q11	486	296	280	280
q12	324	355	229	229
q13	17760	3636	3073	3073
q14	229	242	211	211
q15	553	509	494	494
q16	1021	985	923	923
q17	579	872	361	361
q18	7338	7085	7044	7044
q19	1091	955	523	523
q20	337	330	221	221
q21	3719	3166	2295	2295
q22	1024	1008	943	943
Total cold run time: 105292 ms
Total hot run time: 34091 ms
----- Round 2, with runtime_filter_mode=off -----
q1	4906	4894	4884	4884
q2	322	396	317	317
q3	2105	2683	2283	2283
q4	1388	1778	1335	1335
q5	4199	4115	4466	4115
q6	219	177	138	138
q7	2073	2015	1749	1749
q8	2734	2472	2550	2472
q9	7664	7695	7654	7654
q10	3084	3219	2891	2891
q11	602	530	510	510
q12	702	755	645	645
q13	3494	3924	3361	3361
q14	288	317	273	273
q15	532	506	494	494
q16	1105	1099	1023	1023
q17	1149	1601	1387	1387
q18	7899	7680	7693	7680
q19	805	762	798	762
q20	2035	1971	1855	1855
q21	4747	4348	4235	4235
q22	1091	1043	997	997
Total cold run time: 53143 ms
Total hot run time: 51060 ms

@doris-robot

doris-robot commented Nov 24, 2025

Copy link
Copy Markdown
TPC-DS: Total hot run time: 186847 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit c72dffe9bae44c64bb042e59394bace933a83492, data reload: false
query1	1038	400	395	395
query2	6557	1684	1661	1661
query3	6764	232	220	220
query4	26384	23313	22593	22593
query5	4414	638	505	505
query6	333	248	233	233
query7	4667	491	302	302
query8	309	259	251	251
query9	8704	2635	2619	2619
query10	537	329	293	293
query11	15845	15014	14816	14816
query12	191	120	116	116
query13	1685	577	495	495
query14	10944	9097	9010	9010
query15	215	190	163	163
query16	7395	644	520	520
query17	1215	752	616	616
query18	2013	409	321	321
query19	212	196	174	174
query20	128	125	126	125
query21	213	136	117	117
query22	4187	4322	4168	4168
query23	33854	33169	33069	33069
query24	8290	2396	2359	2359
query25	582	524	469	469
query26	1237	277	167	167
query27	2746	499	359	359
query28	4244	2215	2196	2196
query29	842	633	513	513
query30	309	232	207	207
query31	946	814	697	697
query32	88	75	76	75
query33	599	385	333	333
query34	792	860	510	510
query35	803	848	770	770
query36	955	1001	907	907
query37	124	114	88	88
query38	3588	3532	3474	3474
query39	1457	1425	1424	1424
query40	230	132	122	122
query41	70	67	68	67
query42	129	116	116	116
query43	499	503	476	476
query44	1258	773	776	773
query45	186	183	177	177
query46	899	983	640	640
query47	1822	1773	1732	1732
query48	408	435	319	319
query49	801	497	413	413
query50	651	678	406	406
query51	3833	3959	3918	3918
query52	114	110	103	103
query53	244	265	195	195
query54	319	308	286	286
query55	90	88	88	88
query56	338	341	331	331
query57	1204	1208	1094	1094
query58	298	284	276	276
query59	2717	2617	2485	2485
query60	337	346	348	346
query61	155	155	161	155
query62	790	725	663	663
query63	233	195	192	192
query64	4335	1163	844	844
query65	4044	3944	3922	3922
query66	1138	431	327	327
query67	15439	15421	14914	14914
query68	8493	910	628	628
query69	480	320	284	284
query70	1335	1221	1247	1221
query71	503	327	324	324
query72	5464	4831	4819	4819
query73	717	577	360	360
query74	8914	8964	8794	8794
query75	3957	3317	2789	2789
query76	3814	1166	746	746
query77	836	395	307	307
query78	9581	9670	8873	8873
query79	1959	820	594	594
query80	636	593	494	494
query81	492	254	234	234
query82	449	160	129	129
query83	264	263	262	262
query84	254	116	91	91
query85	938	493	461	461
query86	339	309	305	305
query87	3632	3641	3527	3527
query88	3328	2226	2240	2226
query89	380	334	293	293
query90	2037	228	214	214
query91	174	178	141	141
query92	84	65	65	65
query93	1310	1044	677	677
query94	719	453	314	314
query95	410	317	319	317
query96	478	565	282	282
query97	2930	2938	2857	2857
query98	246	209	209	209
query99	1577	1380	1300	1300
Total cold run time: 274717 ms
Total hot run time: 186847 ms

@github-actions

github-actionsBot commented Nov 28, 2025

Copy link
Copy Markdown
Contributor

PR approved by at least one committer and no changes requested.

@github-actionsgithub-actionsBot added approved Indicates a PR has been approved by one committer. reviewed labels Nov 28, 2025
@github-actions

github-actionsBot commented Nov 28, 2025

Copy link
Copy Markdown
Contributor

PR approved by anyone and no changes requested.

@CalvinKirs

CalvinKirs commented Dec 1, 2025

Copy link
Copy Markdown
MemberAuthor

run buildall

@doris-robot

doris-robot commented Dec 1, 2025

Copy link
Copy Markdown
TPC-H: Total hot run time: 34300 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit fd60ff0412d33075dca673e7c38e92e4cba4b424, data reload: false
------ Round 1 ----------------------------------
q1	17788	5141	4904	4904
q2	1999	321	209	209
q3	10599	1294	739	739
q4	10258	921	361	361
q5	7568	2454	2225	2225
q6	188	170	135	135
q7	929	784	631	631
q8	9356	1344	1017	1017
q9	6859	5327	5273	5273
q10	6864	2251	1810	1810
q11	527	314	289	289
q12	349	361	225	225
q13	17770	3630	3067	3067
q14	237	237	222	222
q15	607	521	513	513
q16	900	865	818	818
q17	586	756	491	491
q18	7363	7099	7164	7099
q19	1100	948	585	585
q20	354	348	236	236
q21	3516	3037	2505	2505
q22	1003	997	946	946
Total cold run time: 106720 ms
Total hot run time: 34300 ms
----- Round 2, with runtime_filter_mode=off -----
q1	4999	4973	4965	4965
q2	335	411	323	323
q3	2145	2734	2340	2340
q4	1334	1752	1265	1265
q5	4234	4418	4514	4418
q6	215	175	133	133
q7	2054	1999	1808	1808
q8	2723	2490	2447	2447
q9	7480	7512	7388	7388
q10	3032	3266	2889	2889
q11	607	529	511	511
q12	702	786	650	650
q13	3466	3993	3184	3184
q14	291	336	306	306
q15	550	512	498	498
q16	905	1024	911	911
q17	1131	1391	1451	1391
q18	7837	7980	7461	7461
q19	841	895	805	805
q20	1982	2056	1843	1843
q21	4846	4354	4197	4197
q22	1091	1034	985	985
Total cold run time: 52800 ms
Total hot run time: 50718 ms

@doris-robot

doris-robot commented Dec 1, 2025

Copy link
Copy Markdown
TPC-DS: Total hot run time: 182052 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit fd60ff0412d33075dca673e7c38e92e4cba4b424, data reload: false
query1	1062	406	399	399
query2	6575	1180	1225	1180
query3	6771	233	227	227
query4	25088	23486	22494	22494
query5	4642	658	493	493
query6	333	242	223	223
query7	4646	510	305	305
query8	307	259	264	259
query9	8759	2585	2611	2585
query10	505	363	303	303
query11	15118	15267	15073	15073
query12	182	120	113	113
query13	1678	547	468	468
query14	9625	5983	6099	5983
query15	214	201	193	193
query16	7634	690	523	523
query17	1213	747	605	605
query18	2027	421	338	338
query19	206	199	176	176
query20	128	126	119	119
query21	223	134	115	115
query22	3956	3834	3867	3834
query23	32932	31987	31923	31923
query24	8536	2397	2433	2397
query25	602	548	458	458
query26	1253	278	166	166
query27	2720	501	339	339
query28	4359	2157	2133	2133
query29	798	620	497	497
query30	304	245	216	216
query31	798	692	615	615
query32	85	73	75	73
query33	600	370	346	346
query34	814	881	542	542
query35	809	854	732	732
query36	880	919	825	825
query37	118	107	91	91
query38	3928	3988	3937	3937
query39	1499	1392	1415	1392
query40	236	134	118	118
query41	71	63	65	63
query42	138	120	118	118
query43	438	454	428	428
query44	1291	752	749	749
query45	202	196	184	184
query46	883	990	633	633
query47	1667	1710	1645	1645
query48	394	422	336	336
query49	782	505	440	440
query50	661	685	406	406
query51	3902	3933	4009	3933
query52	120	116	107	107
query53	234	269	200	200
query54	327	305	280	280
query55	101	96	100	96
query56	346	328	347	328
query57	1131	1184	1092	1092
query58	297	279	269	269
query59	2319	2456	2299	2299
query60	349	339	334	334
query61	167	158	163	158
query62	781	720	651	651
query63	228	191	194	191
query64	4509	1221	969	969
query65	4090	3969	3988	3969
query66	1119	464	384	384
query67	15119	15115	14795	14795
query68	3783	1009	644	644
query69	525	354	326	326
query70	1146	1002	996	996
query71	437	340	339	339
query72	6021	5008	4906	4906
query73	674	566	362	362
query74	8873	8826	8815	8815
query75	3011	3008	2515	2515
query76	3319	1144	758	758
query77	517	411	318	318
query78	9380	9584	8861	8861
query79	2252	832	596	596
query80	669	581	492	492
query81	500	275	244	244
query82	192	136	108	108
query83	267	271	251	251
query84	262	116	99	99
query85	886	490	441	441
query86	383	301	283	283
query87	4026	4116	3998	3998
query88	3745	2300	2328	2300
query89	382	334	307	307
query90	1995	228	219	219
query91	176	172	142	142
query92	83	74	67	67
query93	2484	1028	655	655
query94	751	452	341	341
query95	506	421	409	409
query96	519	555	282	282
query97	2633	2715	2595	2595
query98	253	229	214	214
query99	1281	1392	1304	1304
Total cold run time: 265760 ms
Total hot run time: 182052 ms

@doris-robot

doris-robot commented Dec 1, 2025

Copy link
Copy Markdown
ClickBench: Total hot run time: 27.25 s
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit fd60ff0412d33075dca673e7c38e92e4cba4b424, data reload: false
query1	0.05	0.05	0.05
query2	0.10	0.06	0.05
query3	0.26	0.08	0.08
query4	1.61	0.11	0.10
query5	0.28	0.27	0.26
query6	1.18	0.64	0.63
query7	0.03	0.02	0.02
query8	0.05	0.04	0.05
query9	0.56	0.52	0.48
query10	0.56	0.56	0.56
query11	0.15	0.11	0.11
query12	0.15	0.12	0.11
query13	0.63	0.61	0.60
query14	0.99	0.98	1.01
query15	0.81	0.80	0.81
query16	0.42	0.42	0.40
query17	0.97	0.98	1.02
query18	0.24	0.21	0.21
query19	1.83	1.84	1.88
query20	0.01	0.01	0.01
query21	15.44	0.27	0.14
query22	4.68	0.05	0.06
query23	16.01	0.28	0.10
query24	1.67	0.28	0.51
query25	0.08	0.06	0.05
query26	0.13	0.13	0.14
query27	0.08	0.04	0.06
query28	4.87	1.24	1.02
query29	12.59	3.85	3.16
query30	0.28	0.16	0.13
query31	2.80	0.60	0.39
query32	3.23	0.54	0.46
query33	2.99	3.03	3.07
query34	16.88	5.12	4.53
query35	4.54	4.57	4.56
query36	0.65	0.51	0.50
query37	0.11	0.08	0.07
query38	0.08	0.04	0.04
query39	0.04	0.03	0.03
query40	0.16	0.15	0.14
query41	0.08	0.04	0.03
query42	0.05	0.03	0.03
query43	0.05	0.04	0.03
Total cold run time: 98.37 s
Total hot run time: 27.25 s

@CalvinKirs
CalvinKirs merged commit 31e6745 into apache:masterDec 1, 2025
27 of 28 checks passed
github-actionsBot pushed a commit that referenced this pull request Dec 1, 2025
@CalvinKirsYour Name
[chore](dep)Upgrade Shade (#58071)
2ae5340
### Upgrade Shade
### make the COS and OBS modules optional
allowing us to skip them during the build with a flag such as
-exclude-cos-dependencies since those modules contain unresolved
supply-chain security issues upstream.
@github-actionsgithub-actionsBot mentioned this pull request Dec 1, 2025
Merged
github-actionsBot pushed a commit that referenced this pull request Dec 1, 2025
@CalvinKirsYour Name
[chore](dep)Upgrade Shade (#58071)
6277401
### Upgrade Shade
### make the COS and OBS modules optional
allowing us to skip them during the build with a flag such as
-exclude-cos-dependencies since those modules contain unresolved
supply-chain security issues upstream.
@github-actionsgithub-actionsBot mentioned this pull request Dec 1, 2025
Merged
yiguolei pushed a commit that referenced this pull request Dec 2, 2025
@github-actions@CalvinKirs
branch-4.0: [chore](dep)Upgrade Shade#58071(#58581)
d02422d
Cherry-picked from #58071
Co-authored-by: Calvin Kirs <guoqiang@selectdb.com>
morrySnow pushed a commit that referenced this pull request Dec 2, 2025
@github-actions@CalvinKirs
branch-3.1: [chore](dep)Upgrade Shade#58071(#58580)
f4b99a9
Cherry-picked from #58071
Co-authored-by: Calvin Kirs <guoqiang@selectdb.com>
nagisa-kunhah pushed a commit to nagisa-kunhah/doris that referenced this pull request Dec 14, 2025
@CalvinKirs@nagisa-kunhah
[chore](dep)Upgrade Shade (apache#58071)
de43b06
### Upgrade Shade
### make the COS and OBS modules optional
allowing us to skip them during the build with a flag such as
-exclude-cos-dependencies since those modules contain unresolved
supply-chain security issues upstream.
This was referenced Aug 7, 2026
Merged
Merged
yiguolei pushed a commit that referenced this pull request Aug 12, 2026
@RoanHeNaN@claude
[improvement](build) Fully exclude OBS/COS deps via --exclude-{obs,co…
c4b7546
…s}-dependencies (#66564)
## What
Turn the existing `--exclude-obs-dependencies` and
`--exclude-cos-dependencies` build flags into a **full exclusion** of
the respective cloud provider (Huawei OBS / Tencent COS): when passed,
nothing from that provider is resolved, compiled, or bundled into the FE
binary.
## Why
The two flags were introduced in #58071 as a `scope=provided` downgrade.
That only kept the jars out of the shipped artifact — Maven **still
resolved and downloaded** them at build time. In particular
`com.huaweicloud:hadoop-huaweicloud:3.1.1-hw-46` is published **only**
on Huawei's own Maven repo (`repo.huaweicloud.com`). Environments that
cannot or must not reach it (corporate proxies blocking the host, or
compliance constraints forbidding Huawei/Tencent artifacts) still could
not build the FE, because resolution was unconditional. The flags now do
what their names imply.
## How
Active-by-default Maven profiles `obs` / `cos`, deactivated via
`-Ddisable.obs=true` / `-Ddisable.cos=true`, wrap every touch point:
- **fe-core**: the `fe-filesystem-obs` / `fe-filesystem-cos` test
couplings.
- **hadoop-deps**: the `hadoop-huaweicloud` dependency and the Huawei
OBS Maven repository.
- **fe-filesystem**: the `fe-filesystem-obs` / `fe-filesystem-cos`
modules (which transitively pull the Huawei / Tencent SDKs).
`build.sh` maps `--exclude-obs-dependencies` → `-Ddisable.obs=true` and
`--exclude-cos-dependencies` → `-Ddisable.cos=true` (replacing the old
`*.dependency.scope=provided` mapping), and drops the corresponding
provider from **both** the `-pl` reactor list **and** the filesystem
plugin packaging loop, so the reactor and the dist layout stay
consistent when a provider is excluded.
## Behaviour
- **Default builds are unchanged** — the profiles are active unless a
flag is passed.
- `sh build.sh --fe --exclude-obs-dependencies` builds the FE with no
Huawei artifact resolved and no OBS code compiled or bundled; same for
`--exclude-cos-dependencies` and Tencent COS.
## Testing
- `mvn help:active-profiles` on `fe-core`, `fe-filesystem`, and
`hadoop-deps`: `obs`/`cos` active by default, and absent with
`-Ddisable.obs=true` / `-Ddisable.cos=true`.
- Confirmed fe-core has no compile-time import of the OBS/COS provider
classes (loaded via SPI/reflection), so `compile` and `test-compile`
stay green when the profiles are off.
- `xmllint` on all changed poms and `bash -n build.sh` pass.
🤖 Generated with [Claude Code](https://claude.com/claude-code)
---------
Co-authored-by: Claude Opus 4.8 (1M context) <noreply@anthropic.com>
wyxxxcat pushed a commit to wyxxxcat/doris that referenced this pull request Aug 17, 2026
@RoanHeNaN@claude@wyxxxcat
[improvement](build) Fully exclude OBS/COS deps via --exclude-{obs,co…
4e3f760
…s}-dependencies (apache#66564)
## What
Turn the existing `--exclude-obs-dependencies` and
`--exclude-cos-dependencies` build flags into a **full exclusion** of
the respective cloud provider (Huawei OBS / Tencent COS): when passed,
nothing from that provider is resolved, compiled, or bundled into the FE
binary.
## Why
The two flags were introduced in apache#58071 as a `scope=provided` downgrade.
That only kept the jars out of the shipped artifact — Maven **still
resolved and downloaded** them at build time. In particular
`com.huaweicloud:hadoop-huaweicloud:3.1.1-hw-46` is published **only**
on Huawei's own Maven repo (`repo.huaweicloud.com`). Environments that
cannot or must not reach it (corporate proxies blocking the host, or
compliance constraints forbidding Huawei/Tencent artifacts) still could
not build the FE, because resolution was unconditional. The flags now do
what their names imply.
## How
Active-by-default Maven profiles `obs` / `cos`, deactivated via
`-Ddisable.obs=true` / `-Ddisable.cos=true`, wrap every touch point:
- **fe-core**: the `fe-filesystem-obs` / `fe-filesystem-cos` test
couplings.
- **hadoop-deps**: the `hadoop-huaweicloud` dependency and the Huawei
OBS Maven repository.
- **fe-filesystem**: the `fe-filesystem-obs` / `fe-filesystem-cos`
modules (which transitively pull the Huawei / Tencent SDKs).
`build.sh` maps `--exclude-obs-dependencies` → `-Ddisable.obs=true` and
`--exclude-cos-dependencies` → `-Ddisable.cos=true` (replacing the old
`*.dependency.scope=provided` mapping), and drops the corresponding
provider from **both** the `-pl` reactor list **and** the filesystem
plugin packaging loop, so the reactor and the dist layout stay
consistent when a provider is excluded.
## Behaviour
- **Default builds are unchanged** — the profiles are active unless a
flag is passed.
- `sh build.sh --fe --exclude-obs-dependencies` builds the FE with no
Huawei artifact resolved and no OBS code compiled or bundled; same for
`--exclude-cos-dependencies` and Tencent COS.
## Testing
- `mvn help:active-profiles` on `fe-core`, `fe-filesystem`, and
`hadoop-deps`: `obs`/`cos` active by default, and absent with
`-Ddisable.obs=true` / `-Ddisable.cos=true`.
- Confirmed fe-core has no compile-time import of the OBS/COS provider
classes (loaded via SPI/reflection), so `compile` and `test-compile`
stay green when the profiles are off.
- `xmllint` on all changed poms and `bash -n build.sh` pass.
🤖 Generated with [Claude Code](https://claude.com/claude-code)
---------
Co-authored-by: Claude Opus 4.8 (1M context) <noreply@anthropic.com>
Sign up for freeto join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

@morningmanmorningmanmorningman approved these changes
@zy-kkkzy-kkkzy-kkk approved these changes

Assignees

No one assigned

Labels

approvedIndicates a PR has been approved by one committer.dev/3.1.4-mergeddev/4.0.2-mergedreviewed

Projects

None yet

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.

8 participants

@CalvinKirs@Thearas@doris-robot@hello-stephen@morningman@zy-kkk@yiguolei@morrySnow