Skip to content

branch-3.1: [fix](hive) use the remote name when get meta from hive system. #52561 #52817 #52881 #52989 - #53030

Merged
morrySnow merged 10 commits into
apache:branch-3.1from
morningman:31_remote_name
Jul 11, 2025
Merged

branch-3.1: [fix](hive) use the remote name when get meta from hive system. #52561 #52817 #52881 #52989#53030
morrySnow merged 10 commits into
apache:branch-3.1from
morningman:31_remote_name

Conversation

@morningman

@morningmanmorningman commented Jul 10, 2025•
edited
Loading

Copy link
Copy Markdown
Contributor

@hello-stephen

hello-stephen commented Jul 10, 2025

Copy link
Copy Markdown
Contributor

Thank you for your contribution to Apache Doris.
Don't know what should be done next? See How to process your PR.

Please clearly describe your PR:

  1. What problem was fixed (it's best to include specific error reporting information). How it was fixed.
  2. Which behaviors were modified. What was the previous behavior, what is it now, why was it modified, and what possible impacts might there be.
  3. What features were added. Why was this function added?
  4. Which code was refactored and why was this part of the code refactored?
  5. Which functions were optimized and what is the difference before and after the optimization?

@morningman

morningman commented Jul 10, 2025

Copy link
Copy Markdown
ContributorAuthor

run buildall

morrySnow
morrySnow previously approved these changes Jul 10, 2025
View reviewed changes
@morrySnowmorrySnow changed the title branch-3.1: [fix](hive) use the remote name when get meta from hive system. (#52561)(#52817)(#52881)branch-3.1: [fix](hive) use the remote name when get meta from hive system. #52561 #52817 #52881Jul 10, 2025
@doris-robot

doris-robot commented Jul 10, 2025

Copy link
Copy Markdown
TPC-H: Total hot run time: 39464 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 5580ad7a79f4916e6ec9dfa28ace537b366b556f, data reload: false
------ Round 1 ----------------------------------
q1	17583	7053	6564	6564
q2	2067	177	166	166
q3	10522	1108	1113	1108
q4	10210	792	823	792
q5	7749	2842	2782	2782
q6	228	133	136	133
q7	964	621	607	607
q8	9362	1916	1966	1916
q9	6602	6392	6393	6392
q10	7037	2213	2324	2213
q11	468	266	256	256
q12	449	207	210	207
q13	17771	2954	2992	2954
q14	246	213	216	213
q15	521	462	458	458
q16	479	386	377	377
q17	983	576	540	540
q18	7197	6616	6709	6616
q19	1312	1101	939	939
q20	473	196	193	193
q21	3893	3234	3066	3066
q22	1118	976	972	972
Total cold run time: 107234 ms
Total hot run time: 39464 ms
----- Round 2, with runtime_filter_mode=off -----
q1	6608	6572	6575	6572
q2	321	233	232	232
q3	2835	2868	2889	2868
q4	2050	1745	1803	1745
q5	5755	5730	5707	5707
q6	204	126	130	126
q7	2188	1834	1792	1792
q8	3370	3495	3504	3495
q9	8724	8863	8901	8863
q10	3555	3483	3504	3483
q11	582	515	506	506
q12	781	596	600	596
q13	8350	3172	3240	3172
q14	312	274	278	274
q15	516	473	460	460
q16	497	444	437	437
q17	1815	1616	1601	1601
q18	8258	7903	7768	7768
q19	1656	1604	1551	1551
q20	2064	1803	1812	1803
q21	5282	4938	4913	4913
q22	1076	1029	1020	1020
Total cold run time: 66799 ms
Total hot run time: 58984 ms

@doris-robot

doris-robot commented Jul 10, 2025

Copy link
Copy Markdown
TPC-DS: Total hot run time: 195772 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 5580ad7a79f4916e6ec9dfa28ace537b366b556f, data reload: false
query1	1320	903	920	903
query2	6354	2006	1898	1898
query3	10827	4320	4316	4316
query4	33433	23457	23516	23457
query5	3678	466	454	454
query6	281	180	180	180
query7	3998	316	326	316
query8	283	236	229	229
query9	9329	2574	2575	2574
query10	474	261	252	252
query11	18040	15195	15253	15195
query12	163	103	102	102
query13	1568	443	423	423
query14	9089	6518	7371	6518
query15	263	196	193	193
query16	8047	496	498	496
query17	1642	625	633	625
query18	2160	325	342	325
query19	322	172	174	172
query20	124	118	122	118
query21	208	110	104	104
query22	4627	4577	4539	4539
query23	35097	34535	33564	33564
query24	11745	2895	2877	2877
query25	586	446	435	435
query26	757	175	172	172
query27	2259	358	371	358
query28	6349	2148	2187	2148
query29	699	457	458	457
query30	273	166	157	157
query31	1113	824	835	824
query32	88	61	60	60
query33	772	295	310	295
query34	939	507	539	507
query35	862	730	752	730
query36	1145	962	948	948
query37	111	64	69	64
query38	4123	3958	4007	3958
query39	1551	1488	1467	1467
query40	197	99	99	99
query41	47	47	50	47
query42	116	106	105	105
query43	523	486	474	474
query44	1301	810	815	810
query45	189	166	170	166
query46	1170	735	735	735
query47	2021	1880	1968	1880
query48	444	355	346	346
query49	891	416	397	397
query50	841	423	434	423
query51	7354	7370	7249	7249
query52	103	93	93	93
query53	261	182	187	182
query54	1251	491	486	486
query55	84	81	77	77
query56	286	258	246	246
query57	1314	1203	1192	1192
query58	231	214	230	214
query59	3202	2981	2984	2981
query60	291	266	258	258
query61	116	113	111	111
query62	879	722	707	707
query63	218	190	192	190
query64	4108	662	638	638
query65	3335	3319	3319	3319
query66	825	318	305	305
query67	16042	15460	15419	15419
query68	4623	591	595	591
query69	434	260	266	260
query70	1153	1066	1116	1066
query71	359	260	265	260
query72	6113	4030	4033	4030
query73	765	344	355	344
query74	10154	8818	9245	8818
query75	3367	2698	2669	2669
query76	2485	1024	941	941
query77	394	285	276	276
query78	10543	9504	9586	9504
query79	2361	610	617	610
query80	1148	439	424	424
query81	544	221	221	221
query82	633	87	89	87
query83	240	141	149	141
query84	236	79	81	79
query85	1679	305	308	305
query86	501	288	291	288
query87	4417	4221	4223	4221
query88	4226	2399	2398	2398
query89	429	291	291	291
query90	1916	188	188	188
query91	140	108	109	108
query92	57	51	54	51
query93	2398	562	562	562
query94	835	285	284	284
query95	366	258	258	258
query96	611	280	292	280
query97	3308	3195	3161	3161
query98	224	206	194	194
query99	1524	1309	1303	1303
Total cold run time: 300522 ms
Total hot run time: 195772 ms

@doris-robot

doris-robot commented Jul 10, 2025

Copy link
Copy Markdown
ClickBench: Total hot run time: 29.74 s
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 5580ad7a79f4916e6ec9dfa28ace537b366b556f, data reload: false
query1	0.04	0.03	0.03
query2	0.06	0.03	0.03
query3	0.24	0.06	0.07
query4	1.62	0.11	0.11
query5	0.54	0.51	0.52
query6	1.13	0.74	0.74
query7	0.02	0.02	0.02
query8	0.04	0.03	0.04
query9	0.56	0.50	0.50
query10	0.55	0.55	0.56
query11	0.14	0.10	0.11
query12	0.14	0.11	0.11
query13	0.61	0.59	0.60
query14	0.79	0.79	0.82
query15	0.84	0.82	0.82
query16	0.39	0.38	0.40
query17	0.96	1.07	1.09
query18	0.23	0.22	0.22
query19	1.90	1.76	1.76
query20	0.02	0.01	0.01
query21	15.42	0.58	0.57
query22	2.35	1.72	1.51
query23	16.83	1.00	0.76
query24	3.38	2.06	0.94
query25	0.17	0.16	0.05
query26	0.60	0.14	0.14
query27	0.05	0.05	0.03
query28	9.39	0.51	0.49
query29	12.61	3.26	3.20
query30	0.25	0.06	0.07
query31	2.86	0.40	0.38
query32	3.23	0.46	0.46
query33	2.98	2.97	3.00
query34	17.05	4.50	4.45
query35	4.49	4.52	4.53
query36	0.65	0.48	0.48
query37	0.08	0.06	0.06
query38	0.04	0.03	0.03
query39	0.04	0.02	0.02
query40	0.17	0.12	0.12
query41	0.09	0.02	0.02
query42	0.03	0.02	0.02
query43	0.04	0.03	0.04
Total cold run time: 103.62 s
Total hot run time: 29.74 s

@morningman

morningman commented Jul 10, 2025

Copy link
Copy Markdown
ContributorAuthor

run buildall

@doris-robot

doris-robot commented Jul 10, 2025

Copy link
Copy Markdown
TPC-H: Total hot run time: 39710 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit cce97fe849fe825aa3f07aee8f2626b161fbc0fd, data reload: false
------ Round 1 ----------------------------------
q1	17580	6752	6603	6603
q2	2067	206	209	206
q3	10451	1577	1163	1163
q4	10221	741	735	735
q5	7736	2787	2738	2738
q6	214	132	138	132
q7	987	625	613	613
q8	9341	1938	2046	1938
q9	6577	6428	6385	6385
q10	7044	2273	2294	2273
q11	455	267	261	261
q12	397	213	217	213
q13	17782	2959	3006	2959
q14	240	211	203	203
q15	509	474	472	472
q16	510	372	377	372
q17	995	581	555	555
q18	7259	6676	6677	6676
q19	1312	934	897	897
q20	481	207	211	207
q21	3969	3117	3222	3117
q22	1069	994	992	992
Total cold run time: 107196 ms
Total hot run time: 39710 ms
----- Round 2, with runtime_filter_mode=off -----
q1	6601	6592	6602	6592
q2	331	240	236	236
q3	2941	2857	2925	2857
q4	2074	1808	1830	1808
q5	5731	5814	5715	5715
q6	205	129	130	129
q7	2230	1785	1867	1785
q8	3352	3500	3528	3500
q9	8677	8847	8860	8847
q10	3562	3509	3547	3509
q11	589	486	481	481
q12	856	577	631	577
q13	9612	3130	3163	3130
q14	307	272	266	266
q15	495	458	469	458
q16	515	438	460	438
q17	1842	1621	1595	1595
q18	8222	7799	7809	7799
q19	1647	1618	1467	1467
q20	2052	1820	1876	1820
q21	5382	5054	4967	4967
q22	1145	1061	1037	1037
Total cold run time: 68368 ms
Total hot run time: 59013 ms

@doris-robot

doris-robot commented Jul 10, 2025

Copy link
Copy Markdown
TPC-DS: Total hot run time: 196062 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit cce97fe849fe825aa3f07aee8f2626b161fbc0fd, data reload: false
query1	1276	926	927	926
query2	6280	2006	1907	1907
query3	10894	4419	4503	4419
query4	33271	23867	23295	23295
query5	3864	440	438	438
query6	271	185	195	185
query7	3997	308	317	308
query8	303	223	228	223
query9	9570	2577	2593	2577
query10	471	260	261	260
query11	17864	14924	15237	14924
query12	165	102	109	102
query13	1552	439	425	425
query14	8569	6756	7188	6756
query15	240	194	193	193
query16	7931	507	467	467
query17	1617	603	613	603
query18	2112	321	312	312
query19	237	175	161	161
query20	132	119	115	115
query21	215	109	106	106
query22	4722	4449	4369	4369
query23	35306	33885	33914	33885
query24	11287	2898	2950	2898
query25	691	447	450	447
query26	1300	176	174	174
query27	2532	356	352	352
query28	7567	2139	2129	2129
query29	920	479	507	479
query30	275	168	155	155
query31	1051	839	837	837
query32	91	58	55	55
query33	785	317	326	317
query34	934	509	511	509
query35	870	768	730	730
query36	1098	979	932	932
query37	144	73	70	70
query38	4163	3953	3923	3923
query39	1505	1476	1447	1447
query40	210	102	101	101
query41	50	82	52	52
query42	112	98	100	98
query43	525	496	497	496
query44	1261	855	806	806
query45	184	167	170	167
query46	1172	724	726	724
query47	2019	1924	1902	1902
query48	460	353	352	352
query49	998	390	395	390
query50	853	428	449	428
query51	7423	7299	7404	7299
query52	106	92	97	92
query53	261	182	185	182
query54	1208	473	473	473
query55	81	81	81	81
query56	271	287	265	265
query57	1374	1197	1207	1197
query58	233	218	211	211
query59	3289	3135	3004	3004
query60	283	284	259	259
query61	129	112	109	109
query62	841	691	714	691
query63	222	193	187	187
query64	4932	653	618	618
query65	3386	3262	3314	3262
query66	1137	302	296	296
query67	15863	15489	15532	15489
query68	4309	603	573	573
query69	434	263	261	261
query70	1178	1088	1115	1088
query71	339	252	258	252
query72	6284	4117	4084	4084
query73	769	343	348	343
query74	9681	8918	9074	8918
query75	3356	2647	2676	2647
query76	2687	1100	1044	1044
query77	416	275	272	272
query78	10593	9606	9586	9586
query79	2420	601	604	601
query80	982	421	420	420
query81	570	230	218	218
query82	645	91	83	83
query83	243	143	140	140
query84	237	76	86	76
query85	1606	340	302	302
query86	472	307	295	295
query87	4419	4191	4221	4191
query88	4161	2372	2366	2366
query89	418	289	286	286
query90	1951	189	189	189
query91	135	109	107	107
query92	63	48	50	48
query93	2297	554	552	552
query94	807	301	293	293
query95	365	268	256	256
query96	612	276	285	276
query97	3286	3154	3176	3154
query98	236	203	198	198
query99	1567	1302	1320	1302
Total cold run time: 302493 ms
Total hot run time: 196062 ms

@doris-robot

doris-robot commented Jul 10, 2025

Copy link
Copy Markdown
ClickBench: Total hot run time: 30.39 s
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit cce97fe849fe825aa3f07aee8f2626b161fbc0fd, data reload: false
query1	0.03	0.03	0.03
query2	0.06	0.03	0.03
query3	0.24	0.06	0.07
query4	1.61	0.11	0.11
query5	0.52	0.52	0.50
query6	1.14	0.73	0.73
query7	0.02	0.02	0.02
query8	0.04	0.03	0.04
query9	0.57	0.50	0.52
query10	0.55	0.55	0.56
query11	0.15	0.11	0.10
query12	0.14	0.12	0.11
query13	0.59	0.58	0.59
query14	0.77	0.78	0.81
query15	0.83	0.83	0.82
query16	0.38	0.40	0.39
query17	1.05	1.02	1.02
query18	0.23	0.22	0.22
query19	1.89	1.85	1.77
query20	0.01	0.01	0.01
query21	15.42	0.62	0.58
query22	2.43	1.82	2.42
query23	16.91	0.91	0.85
query24	2.69	1.31	1.77
query25	0.26	0.05	0.05
query26	0.54	0.15	0.13
query27	0.07	0.05	0.04
query28	9.90	0.53	0.47
query29	12.56	3.25	3.20
query30	0.25	0.06	0.06
query31	2.86	0.38	0.38
query32	3.24	0.46	0.46
query33	2.96	2.96	3.01
query34	16.97	4.50	4.47
query35	4.57	4.49	4.56
query36	0.65	0.47	0.48
query37	0.09	0.06	0.06
query38	0.04	0.03	0.04
query39	0.04	0.02	0.03
query40	0.16	0.12	0.12
query41	0.08	0.02	0.02
query42	0.03	0.02	0.02
query43	0.04	0.02	0.02
Total cold run time: 103.58 s
Total hot run time: 30.39 s

@morningman

morningman commented Jul 10, 2025

Copy link
Copy Markdown
ContributorAuthor

run buildall

@doris-robot

doris-robot commented Jul 10, 2025

Copy link
Copy Markdown
TPC-H: Total hot run time: 39433 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 875bc1c9d7de941e796774e112576d8b4491d6b1, data reload: false
------ Round 1 ----------------------------------
q1	17595	6763	6574	6574
q2	2053	205	213	205
q3	10472	1116	1141	1116
q4	10214	753	659	659
q5	7761	2871	2694	2694
q6	217	134	134	134
q7	979	615	612	612
q8	9603	1979	1948	1948
q9	7814	6398	6412	6398
q10	7035	2256	2287	2256
q11	461	289	255	255
q12	397	202	207	202
q13	17810	2963	2989	2963
q14	234	212	203	203
q15	510	467	471	467
q16	474	378	367	367
q17	971	526	568	526
q18	7148	6679	6630	6630
q19	1325	1061	950	950
q20	489	198	198	198
q21	4075	3073	3093	3073
q22	1078	1003	1003	1003
Total cold run time: 108715 ms
Total hot run time: 39433 ms
----- Round 2, with runtime_filter_mode=off -----
q1	6616	6597	6606	6597
q2	321	226	231	226
q3	2895	2935	2913	2913
q4	2026	1858	1826	1826
q5	5683	5709	5722	5709
q6	209	126	127	126
q7	2232	1775	1792	1775
q8	3346	3489	3575	3489
q9	8713	8879	8870	8870
q10	3564	3546	3529	3529
q11	582	493	484	484
q12	814	596	624	596
q13	7138	3139	3210	3139
q14	299	286	279	279
q15	523	474	463	463
q16	469	425	442	425
q17	1844	1617	1607	1607
q18	8225	7809	7818	7809
q19	1677	1504	1467	1467
q20	2054	1814	1790	1790
q21	5189	4980	4944	4944
q22	1121	1063	1037	1037
Total cold run time: 65540 ms
Total hot run time: 59100 ms

@doris-robot

doris-robot commented Jul 10, 2025

Copy link
Copy Markdown
TPC-DS: Total hot run time: 196137 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 875bc1c9d7de941e796774e112576d8b4491d6b1, data reload: false
query1	1290	900	899	899
query2	6408	1878	1910	1878
query3	10814	4142	4105	4105
query4	33246	23821	23236	23236
query5	4190	454	466	454
query6	262	196	183	183
query7	3993	312	316	312
query8	273	224	218	218
query9	9453	2601	2597	2597
query10	485	263	253	253
query11	18308	15145	15265	15145
query12	163	104	105	104
query13	1549	427	441	427
query14	9206	7334	6750	6750
query15	241	181	208	181
query16	8021	485	503	485
query17	1651	573	573	573
query18	2126	297	322	297
query19	240	161	165	161
query20	124	114	116	114
query21	200	112	108	108
query22	4731	4348	4394	4348
query23	34570	33965	34019	33965
query24	11201	2899	2922	2899
query25	632	408	427	408
query26	1270	171	171	171
query27	2387	356	363	356
query28	7650	2192	2177	2177
query29	899	473	476	473
query30	260	161	167	161
query31	1035	838	851	838
query32	100	59	64	59
query33	772	317	321	317
query34	996	491	511	491
query35	877	761	751	751
query36	1070	969	955	955
query37	139	73	70	70
query38	4091	3929	4020	3929
query39	1529	1488	1473	1473
query40	222	108	105	105
query41	52	55	51	51
query42	112	100	109	100
query43	543	484	503	484
query44	1261	862	838	838
query45	196	173	182	173
query46	1221	743	754	743
query47	2022	1896	1948	1896
query48	454	356	353	353
query49	1004	440	411	411
query50	829	431	420	420
query51	7463	7324	7221	7221
query52	101	91	91	91
query53	264	183	185	183
query54	1282	474	493	474
query55	83	81	84	81
query56	268	254	265	254
query57	1332	1215	1218	1215
query58	240	212	229	212
query59	3215	3082	3080	3080
query60	316	276	260	260
query61	110	111	120	111
query62	850	711	718	711
query63	234	192	192	192
query64	4274	680	636	636
query65	3344	3240	3185	3185
query66	864	296	291	291
query67	16046	15675	15498	15498
query68	4539	585	578	578
query69	448	262	269	262
query70	1216	1074	1109	1074
query71	317	257	259	257
query72	6341	4060	3980	3980
query73	739	351	352	351
query74	10426	9178	9331	9178
query75	3362	2651	2659	2651
query76	2711	1061	964	964
query77	382	264	272	264
query78	10496	9627	9600	9600
query79	2427	592	604	592
query80	958	420	421	420
query81	551	223	223	223
query82	893	90	91	90
query83	251	149	142	142
query84	235	82	81	81
query85	1262	320	297	297
query86	409	294	304	294
query87	4362	4237	4255	4237
query88	4324	2398	2377	2377
query89	415	292	303	292
query90	1946	185	183	183
query91	139	107	106	106
query92	60	51	50	50
query93	2425	559	556	556
query94	855	303	297	297
query95	368	256	262	256
query96	611	280	282	280
query97	3333	3114	3234	3114
query98	222	210	204	204
query99	1489	1297	1303	1297
Total cold run time: 303166 ms
Total hot run time: 196137 ms

@doris-robot

doris-robot commented Jul 10, 2025

Copy link
Copy Markdown
ClickBench: Total hot run time: 29.92 s
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 875bc1c9d7de941e796774e112576d8b4491d6b1, data reload: false
query1	0.03	0.03	0.03
query2	0.07	0.03	0.03
query3	0.23	0.07	0.07
query4	1.62	0.10	0.10
query5	0.53	0.51	0.51
query6	1.14	0.73	0.72
query7	0.02	0.01	0.01
query8	0.04	0.03	0.03
query9	0.56	0.51	0.50
query10	0.55	0.54	0.56
query11	0.15	0.11	0.09
query12	0.14	0.11	0.11
query13	0.60	0.59	0.60
query14	0.77	0.78	0.80
query15	0.84	0.83	0.82
query16	0.39	0.39	0.39
query17	1.04	1.00	1.05
query18	0.23	0.21	0.22
query19	1.98	1.78	1.89
query20	0.01	0.01	0.01
query21	15.40	0.61	0.59
query22	2.62	1.92	1.68
query23	17.09	0.99	0.83
query24	3.27	1.21	0.91
query25	0.19	0.10	0.25
query26	0.42	0.14	0.15
query27	0.04	0.05	0.06
query28	10.16	0.52	0.50
query29	12.56	3.20	3.23
query30	0.25	0.05	0.06
query31	2.86	0.38	0.38
query32	3.25	0.47	0.46
query33	2.96	2.97	2.98
query34	17.12	4.49	4.45
query35	4.49	4.56	4.51
query36	0.67	0.47	0.47
query37	0.09	0.07	0.06
query38	0.05	0.04	0.03
query39	0.03	0.03	0.02
query40	0.16	0.12	0.12
query41	0.08	0.03	0.03
query42	0.04	0.02	0.03
query43	0.04	0.03	0.03
Total cold run time: 104.78 s
Total hot run time: 29.92 s

@morningman

morningman commented Jul 10, 2025

Copy link
Copy Markdown
ContributorAuthor

run buildall

@doris-robot

doris-robot commented Jul 10, 2025

Copy link
Copy Markdown
TPC-H: Total hot run time: 39496 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 0ddf12b9de79861ea1e119c183e5796dea55ccb7, data reload: false
------ Round 1 ----------------------------------
q1	17576	6787	6593	6593
q2	2059	186	200	186
q3	10607	1125	1135	1125
q4	10350	742	649	649
q5	7775	2817	2830	2817
q6	218	133	131	131
q7	985	609	594	594
q8	9362	1923	2030	1923
q9	6568	6407	6378	6378
q10	7028	2208	2281	2208
q11	466	257	247	247
q12	416	205	206	205
q13	17766	2989	2967	2967
q14	236	206	205	205
q15	499	474	461	461
q16	473	382	365	365
q17	960	597	640	597
q18	7277	6661	6613	6613
q19	1313	1073	935	935
q20	476	195	196	195
q21	4040	3118	3150	3118
q22	1108	984	984	984
Total cold run time: 107558 ms
Total hot run time: 39496 ms
----- Round 2, with runtime_filter_mode=off -----
q1	6577	6614	6577	6577
q2	321	228	230	228
q3	2870	2845	2867	2845
q4	2115	1779	1851	1779
q5	5652	5675	5707	5675
q6	213	127	126	126
q7	2228	1780	1799	1780
q8	3323	3495	3552	3495
q9	8722	8934	8840	8840
q10	3552	3496	3522	3496
q11	582	496	497	496
q12	803	614	597	597
q13	6737	3297	3254	3254
q14	317	289	275	275
q15	543	472	462	462
q16	504	444	449	444
q17	1864	1648	1624	1624
q18	8521	7736	7831	7736
q19	1667	1509	1613	1509
q20	2071	1890	1919	1890
q21	5053	5036	5001	5001
q22	1153	1077	1055	1055
Total cold run time: 65388 ms
Total hot run time: 59184 ms

@doris-robot

doris-robot commented Jul 10, 2025

Copy link
Copy Markdown
TPC-DS: Total hot run time: 196704 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 0ddf12b9de79861ea1e119c183e5796dea55ccb7, data reload: false
query1	1311	901	903	901
query2	6247	1963	1921	1921
query3	10901	4412	4434	4412
query4	32957	23646	23378	23378
query5	3920	467	460	460
query6	295	190	180	180
query7	3990	307	323	307
query8	301	240	233	233
query9	9544	2592	2600	2592
query10	470	254	260	254
query11	17998	15317	15091	15091
query12	154	104	105	104
query13	1539	416	411	411
query14	8960	7082	7033	7033
query15	251	195	193	193
query16	8017	480	508	480
query17	1671	576	602	576
query18	2210	322	311	311
query19	224	162	162	162
query20	125	117	124	117
query21	209	109	109	109
query22	4677	4387	4378	4378
query23	35022	34307	34335	34307
query24	11438	2965	2847	2847
query25	656	421	422	421
query26	1226	179	181	179
query27	2845	360	353	353
query28	7357	2168	2178	2168
query29	895	466	472	466
query30	270	162	162	162
query31	1034	840	849	840
query32	101	58	59	58
query33	771	303	312	303
query34	944	526	514	514
query35	885	765	739	739
query36	1089	954	944	944
query37	130	70	67	67
query38	4029	3987	3907	3907
query39	1535	1492	1490	1490
query40	195	97	97	97
query41	50	50	51	50
query42	116	105	106	105
query43	532	490	483	483
query44	1265	827	822	822
query45	188	173	172	172
query46	1167	765	747	747
query47	2017	1882	1938	1882
query48	437	347	344	344
query49	1002	396	392	392
query50	823	434	431	431
query51	7437	7182	7249	7182
query52	101	88	92	88
query53	268	180	179	179
query54	1248	480	473	473
query55	84	83	79	79
query56	274	256	254	254
query57	1325	1206	1218	1206
query58	237	207	230	207
query59	3171	3095	3039	3039
query60	283	260	265	260
query61	137	111	109	109
query62	879	696	716	696
query63	219	186	191	186
query64	4049	663	638	638
query65	3359	3265	3208	3208
query66	768	312	303	303
query67	15888	15516	15400	15400
query68	4567	581	568	568
query69	445	254	256	254
query70	1192	1062	1119	1062
query71	348	261	269	261
query72	6282	4018	3962	3962
query73	755	347	368	347
query74	10408	8995	9082	8995
query75	3363	2645	2632	2632
query76	2573	1107	1151	1107
query77	361	280	276	276
query78	10545	9606	9497	9497
query79	1522	597	590	590
query80	1172	427	430	427
query81	542	220	221	220
query82	937	91	86	86
query83	259	144	139	139
query84	224	79	82	79
query85	1331	301	296	296
query86	381	294	287	287
query87	4359	4213	4216	4213
query88	3735	2381	2373	2373
query89	420	299	294	294
query90	1889	188	190	188
query91	141	106	105	105
query92	58	50	51	50
query93	1856	561	570	561
query94	821	293	295	293
query95	376	261	259	259
query96	611	289	279	279
query97	3278	3127	3225	3127
query98	215	197	200	197
query99	1608	1319	1280	1280
Total cold run time: 300291 ms
Total hot run time: 196704 ms

@doris-robot

doris-robot commented Jul 10, 2025

Copy link
Copy Markdown
ClickBench: Total hot run time: 30.22 s
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 0ddf12b9de79861ea1e119c183e5796dea55ccb7, data reload: false
query1	0.03	0.03	0.03
query2	0.06	0.03	0.03
query3	0.23	0.07	0.07
query4	1.62	0.11	0.10
query5	0.51	0.50	0.52
query6	1.13	0.72	0.72
query7	0.02	0.01	0.01
query8	0.04	0.03	0.02
query9	0.56	0.50	0.49
query10	0.54	0.54	0.55
query11	0.14	0.10	0.10
query12	0.13	0.11	0.11
query13	0.60	0.59	0.59
query14	0.76	0.80	0.79
query15	0.84	0.82	0.82
query16	0.37	0.38	0.38
query17	1.08	1.02	1.04
query18	0.24	0.22	0.22
query19	1.97	1.84	1.82
query20	0.01	0.01	0.00
query21	15.40	0.63	0.61
query22	2.26	2.93	2.15
query23	17.12	0.94	0.91
query24	3.13	1.79	0.55
query25	0.15	0.26	0.05
query26	0.42	0.13	0.13
query27	0.05	0.05	0.05
query28	10.42	0.49	0.47
query29	12.59	3.24	3.19
query30	0.24	0.06	0.06
query31	2.83	0.40	0.39
query32	3.27	0.46	0.45
query33	2.97	3.01	3.01
query34	16.95	4.55	4.51
query35	4.55	4.55	4.54
query36	0.67	0.51	0.48
query37	0.08	0.06	0.06
query38	0.04	0.03	0.03
query39	0.03	0.02	0.02
query40	0.17	0.13	0.13
query41	0.08	0.02	0.02
query42	0.03	0.02	0.02
query43	0.04	0.03	0.03
Total cold run time: 104.37 s
Total hot run time: 30.22 s

@morningmanmorningman changed the title branch-3.1: [fix](hive) use the remote name when get meta from hive system. #52561 #52817 #52881branch-3.1: [fix](hive) use the remote name when get meta from hive system. #52561 #52817 #52881 #52989Jul 11, 2025
morningmanand others added 6 commits July 10, 2025 21:24
@morningman
fe code
c88321f
@morningman
add regression test
f275e44
@suxiaogang223@morningman
[fix](paimon) fix CacheException msg in loadSnapshot (apache#52881)
9983787
### What problem does this PR solve?
relate pr: apache#52561
Fix CacheException msg in loadSnapshot to make
test_paimon_catalog.groovy happy
@morningman
[fix](test)(jdbc) fix some external regression test cases and jdbc bug (
599290e
apache#52817)
Followup apache#52561
Also fix a bug introduced by apache#51471, which lost the function rules in
jdbc external table.
@morningman
fix format
6cf58cf
@morningman
fix ut
4796704
@morningman

morningman commented Jul 11, 2025

Copy link
Copy Markdown
ContributorAuthor

run buildall

@morningman

morningman commented Jul 11, 2025

Copy link
Copy Markdown
ContributorAuthor

run buildall

@doris-robot

doris-robot commented Jul 11, 2025

Copy link
Copy Markdown
TPC-H: Total hot run time: 39715 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit b158df1cb0f2816dea8530b720310624cd6ab559, data reload: false
------ Round 1 ----------------------------------
q1	17567	6835	6587	6587
q2	2043	183	168	168
q3	10548	1118	1140	1118
q4	10217	739	715	715
q5	7726	2885	2860	2860
q6	215	136	135	135
q7	987	622	612	612
q8	9596	1975	2015	1975
q9	8154	6389	6396	6389
q10	7011	2276	2314	2276
q11	462	257	259	257
q12	563	212	210	210
q13	17819	2976	3013	2976
q14	232	214	214	214
q15	514	475	460	460
q16	471	388	380	380
q17	1000	654	550	550
q18	7152	6750	6649	6649
q19	1325	1046	901	901
q20	509	202	203	202
q21	3921	3094	3076	3076
q22	1096	1007	1005	1005
Total cold run time: 109128 ms
Total hot run time: 39715 ms
----- Round 2, with runtime_filter_mode=off -----
q1	6664	6588	6551	6551
q2	325	241	235	235
q3	2974	3062	3005	3005
q4	2045	1791	1732	1732
q5	5701	5671	5665	5665
q6	216	125	125	125
q7	2170	1750	1791	1750
q8	3365	3520	3582	3520
q9	8865	8834	8909	8834
q10	3528	3593	3601	3593
q11	583	487	487	487
q12	807	611	598	598
q13	3860	3196	3170	3170
q14	311	269	267	267
q15	518	476	460	460
q16	486	442	434	434
q17	1838	1631	1627	1627
q18	8098	7724	7839	7724
q19	1706	1429	1624	1429
q20	2131	1865	1880	1865
q21	5258	5039	4853	4853
q22	1095	1016	1005	1005
Total cold run time: 62544 ms
Total hot run time: 58929 ms

@doris-robot

doris-robot commented Jul 11, 2025

Copy link
Copy Markdown
TPC-DS: Total hot run time: 190854 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit b158df1cb0f2816dea8530b720310624cd6ab559, data reload: false
query1	973	389	364	364
query2	6511	1994	1972	1972
query3	6702	218	227	218
query4	33836	23561	23948	23561
query5	4369	478	478	478
query6	279	202	190	190
query7	4651	315	323	315
query8	296	244	229	229
query9	9704	2608	2607	2607
query10	502	262	262	262
query11	18278	15371	15380	15371
query12	159	108	109	108
query13	1653	434	447	434
query14	9834	6699	7082	6699
query15	237	177	188	177
query16	8065	503	485	485
query17	1629	577	572	572
query18	2108	313	305	305
query19	247	171	158	158
query20	120	110	112	110
query21	212	108	109	108
query22	4590	4189	4285	4189
query23	34306	33382	33270	33270
query24	12092	2874	2884	2874
query25	721	419	429	419
query26	1874	175	170	170
query27	3019	363	345	345
query28	7808	2106	2115	2106
query29	1068	458	450	450
query30	329	164	165	164
query31	1027	797	780	780
query32	97	64	60	60
query33	797	306	317	306
query34	922	513	525	513
query35	865	718	720	718
query36	1123	967	955	955
query37	201	75	80	75
query38	4018	3819	3928	3819
query39	1501	1442	1426	1426
query40	293	106	106	106
query41	55	51	52	51
query42	118	104	105	104
query43	528	506	485	485
query44	1226	818	820	818
query45	184	174	175	174
query46	1139	766	720	720
query47	1973	1826	1848	1826
query48	431	339	354	339
query49	1338	426	427	426
query50	823	435	427	427
query51	7302	7207	7160	7160
query52	108	98	94	94
query53	262	189	193	189
query54	1275	504	468	468
query55	81	75	77	75
query56	274	258	245	245
query57	1311	1183	1125	1125
query58	248	220	217	217
query59	3178	2958	3064	2958
query60	306	273	271	271
query61	118	112	113	112
query62	918	678	676	676
query63	221	200	191	191
query64	5281	645	640	640
query65	3298	3218	3192	3192
query66	1426	323	310	310
query67	15911	15702	15621	15621
query68	4608	598	573	573
query69	448	275	258	258
query70	1121	1128	1122	1122
query71	344	265	256	256
query72	6389	4114	4012	4012
query73	759	348	374	348
query74	10464	9330	8849	8849
query75	3407	2635	2700	2635
query76	2944	1071	1174	1071
query77	406	280	266	266
query78	10510	9590	9627	9590
query79	2402	600	616	600
query80	1158	441	427	427
query81	536	223	228	223
query82	651	94	91	91
query83	220	154	152	152
query84	235	79	81	79
query85	1767	321	313	313
query86	503	308	302	302
query87	4437	4275	4253	4253
query88	4443	2393	2378	2378
query89	411	301	302	301
query90	2002	193	189	189
query91	146	106	110	106
query92	69	52	51	51
query93	1809	576	560	560
query94	913	271	284	271
query95	362	262	261	261
query96	612	282	295	282
query97	3354	3143	3142	3142
query98	221	210	199	199
query99	1525	1312	1325	1312
Total cold run time: 305525 ms
Total hot run time: 190854 ms

@doris-robot

doris-robot commented Jul 11, 2025

Copy link
Copy Markdown
ClickBench: Total hot run time: 30.45 s
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit b158df1cb0f2816dea8530b720310624cd6ab559, data reload: false
query1	0.03	0.03	0.03
query2	0.07	0.03	0.03
query3	0.24	0.06	0.06
query4	1.62	0.10	0.10
query5	0.54	0.53	0.54
query6	1.14	0.75	0.73
query7	0.02	0.02	0.01
query8	0.04	0.03	0.02
query9	0.56	0.50	0.53
query10	0.57	0.55	0.56
query11	0.14	0.10	0.11
query12	0.14	0.12	0.11
query13	0.60	0.58	0.59
query14	0.79	0.79	0.80
query15	0.84	0.84	0.82
query16	0.39	0.36	0.38
query17	1.03	0.98	1.06
query18	0.23	0.21	0.21
query19	1.97	1.90	1.78
query20	0.01	0.01	0.01
query21	15.40	0.60	0.59
query22	2.05	1.79	1.72
query23	17.08	0.95	0.88
query24	3.27	1.26	1.66
query25	0.26	0.08	0.05
query26	0.53	0.14	0.14
query27	0.05	0.04	0.05
query28	9.43	0.50	0.46
query29	12.58	3.22	3.24
query30	0.25	0.06	0.06
query31	2.86	0.38	0.40
query32	3.24	0.45	0.45
query33	2.98	3.02	3.02
query34	17.22	4.54	4.53
query35	4.57	4.60	4.57
query36	0.68	0.48	0.48
query37	0.09	0.06	0.06
query38	0.04	0.04	0.03
query39	0.03	0.02	0.03
query40	0.16	0.13	0.12
query41	0.07	0.03	0.02
query42	0.03	0.02	0.02
query43	0.04	0.03	0.03
Total cold run time: 103.88 s
Total hot run time: 30.45 s

@morrySnow
morrySnow merged commit 250e3d7 into apache:branch-3.1Jul 11, 2025
Sign up for freeto join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

@morrySnowmorrySnowmorrySnow approved these changes

Assignees

No one assigned

Labels

None yet

Projects

None yet

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.

5 participants

@morningman@hello-stephen@doris-robot@morrySnow@suxiaogang223