[Fix](MS)Handle missing endpoint in DLF-only Metastore scenario with region fallback by CalvinKirs · Pull Request #54300 · apache/doris

CalvinKirs · 2025-08-04T11:53:19Z

PR Description

This PR fixes a special case where the endpoint parameter might be missing when using DLF as the Hive Metastore (MS) without configuring any storage backend.

Background

In certain deployments, users rely solely on DLF as the metastore and do not explicitly configure object storage credentials. In these cases:

Only DLF access_key, secret_key, and region are provided.

dlf.endpoint is omitted by the user.

 create catalog if not exists pm_dlf properties (
"type" = "paimon",
"paimon.catalog.type" = "dlf",
"warehouse" = "oss://asf-doris-datalake-test/p2_regression_case",
"dlf.proxy.mode" = "DLF_ONLY",
"dlf.uid" = "1289998888",
"dlf.region" = "cn-beijing",
"dlf.catalog.id" = "asf",
"dlf.access_key" = "ABSHJJJKKKLKJHVGFGHJKLKJHGHJKJHGHJK",
"dlf.secret_key" = "UYGFHJKHGVVHBJKHVGBJKL:JHGVBJKLHVGHJHVGH"
);
switch pm_dlf;
show databases;
exception: Exception:java.sql.SQLException: errCode = 2, detailMessage = UserException: errCode = 2, detailMessage = No storage properties found for schema: oss at com.mysql.cj.jdbc.exceptions.SQLError.createSQLException(SQLError.java:129) at

The system attempts to initialize storage configuration, but fails because endpoint is required.

This issue occurs because the existing logic assumes that the storage module always receives a valid endpoint, which is not the case when DLF is used as MS only.

Fix

When dlf.endpoint is not set, and dlf.region is available, this patch automatically derives a valid default endpoint based on the region and network mode (public or VPC).

This logic is consistent with the existing behavior of DLF SDKs and avoids unnecessary configuration burden for users using DLF as MS only.

Compatibility

Backward compatible: No breaking change for users who already provide an endpoint.

Recommended best practice remains: Users are encouraged to explicitly configure both endpoint and region for clarity.

What problem does this PR solve?

Issue Number: close #xxx

Related PR: #xxx

Problem Summary:

Release note

None

Check List (For Author)

Test
- Regression test
- Unit Test
- Manual test (add detailed scripts or steps below)
- No need to test or manual test. Explain why:
  - This is a refactor/code format and no logic has been changed.
  - Previous test can cover this change.
  - No code files have been changed.
  - Other reason
Behavior changed:
- No.
- Yes.
Does this need documentation?
- No.
- Yes.

Check List (For Reviewer who merge this PR)

Confirm the release note
Confirm test cases
Confirm document
Add branch pick label

…region fallback ### PR Description This PR fixes a special case where the endpoint parameter might be missing when using DLF as the Hive Metastore (MS) without configuring any storage backend. #### Background In certain deployments, users rely solely on DLF as the metastore and do not explicitly configure object storage credentials. In these cases: Only DLF access_key, secret_key, and region are provided. dlf.endpoint is omitted by the user. The system attempts to initialize storage configuration, but fails because endpoint is required. This issue occurs because the existing logic assumes that the storage module always receives a valid endpoint, which is not the case when DLF is used as MS only. #### Fix When dlf.endpoint is not set, and dlf.region is available, this patch automatically derives a valid default endpoint based on the region and network mode (public or VPC). This logic is consistent with the existing behavior of DLF SDKs and avoids unnecessary configuration burden for users using DLF as MS only. #### Compatibility Backward compatible: No breaking change for users who already provide an endpoint. Recommended best practice remains: Users are encouraged to explicitly configure both endpoint and region for clarity.

Thearas · 2025-08-04T11:53:34Z

Thank you for your contribution to Apache Doris.
Don't know what should be done next? See How to process your PR.

Please clearly describe your PR:

What problem was fixed (it's best to include specific error reporting information). How it was fixed.
Which behaviors were modified. What was the previous behavior, what is it now, why was it modified, and what possible impacts might there be.
What features were added. Why was this function added?
Which code was refactored and why was this part of the code refactored?
Which functions were optimized and what is the difference before and after the optimization?

CalvinKirs · 2025-08-04T11:55:45Z

run buildall

CalvinKirs · 2025-08-04T12:26:56Z

run buildall

hello-stephen · 2025-08-04T13:35:56Z

FE UT Coverage Report

Increment line coverage 90.00% (27/30) 🎉
Increment coverage report
Complete coverage report

doris-robot · 2025-08-04T13:47:00Z

TPC-H: Total hot run time: 33571 ms

machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit a8673f47de8d6113b8d7dc5fb4cbdab132c821e3, data reload: false
------ Round 1 ----------------------------------
q1	17668	5273	5186	5186
q2	1920	296	185	185
q3	10626	1634	714	714
q4	10365	1066	506	506
q5	10086	2176	2309	2176
q6	217	166	131	131
q7	881	777	617	617
q8	9310	1306	1078	1078
q9	7670	5111	5127	5111
q10	6962	2374	1987	1987
q11	462	277	265	265
q12	354	365	226	226
q13	17793	3472	2966	2966
q14	225	245	222	222
q15	548	466	464	464
q16	413	432	366	366
q17	563	829	371	371
q18	7502	7083	7000	7000
q19	1529	989	534	534
q20	319	328	216	216
q21	3456	3068	2252	2252
q22	1039	1057	998	998
Total cold run time: 109908 ms
Total hot run time: 33571 ms
----- Round 2, with runtime_filter_mode=off -----
q1	5412	5347	5627	5347
q2	453	315	219	219
q3	2098	2596	2216	2216
q4	1313	1739	1290	1290
q5	4570	4227	4505	4227
q6	243	182	133	133
q7	1944	1921	1811	1811
q8	2565	2405	2558	2405
q9	7355	7197	7488	7197
q10	3161	3421	2848	2848
q11	561	548	487	487
q12	709	782	645	645
q13	3426	3709	3272	3272
q14	297	312	285	285
q15	502	451	457	451
q16	501	499	522	499
q17	1215	1492	1461	1461
q18	7984	7556	7911	7556
q19	12211	904	938	904
q20	1941	1885	1762	1762
q21	10757	4308	4221	4221
q22	1045	1007	965	965
Total cold run time: 70263 ms
Total hot run time: 50201 ms

doris-robot · 2025-08-04T13:58:44Z

TPC-DS: Total hot run time: 169809 ms

machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit a8673f47de8d6113b8d7dc5fb4cbdab132c821e3, data reload: false
============================================
query1	1017	377	398	377
query2	6520	1835	1683	1683
query3	6745	230	221	221
query4	26671	23656	22840	22840
query5	4303	605	501	501
query6	323	248	225	225
query7	4631	521	303	303
query8	278	237	223	223
query9	8584	2893	2889	2889
query10	475	339	304	304
query11	15576	15040	14721	14721
query12	189	137	135	135
query13	1660	543	417	417
query14	8649	5757	5787	5757
query15	212	187	176	176
query16	7802	653	474	474
query17	1607	800	616	616
query18	2059	439	323	323
query19	299	213	177	177
query20	168	150	142	142
query21	216	121	109	109
query22	4099	4191	4100	4100
query23	34896	34289	34750	34289
query24	8234	2397	2385	2385
query25	553	506	431	431
query26	1145	299	163	163
query27	2629	509	342	342
query28	4235	2298	2277	2277
query29	747	597	514	514
query30	295	228	204	204
query31	917	810	698	698
query32	92	79	88	79
query33	556	413	358	358
query34	815	855	528	528
query35	796	845	749	749
query36	1012	1068	916	916
query37	133	108	88	88
query38	3923	3895	3970	3895
query39	1431	1374	1379	1374
query40	233	141	132	132
query41	69	61	63	61
query42	147	123	128	123
query43	509	503	497	497
query44	1395	856	868	856
query45	211	196	184	184
query46	953	1069	673	673
query47	1812	1859	1753	1753
query48	405	454	313	313
query49	711	503	412	412
query50	679	697	414	414
query51	4218	4188	4172	4172
query52	137	133	124	124
query53	265	296	208	208
query54	663	692	550	550
query55	89	90	89	89
query56	361	356	339	339
query57	1216	1233	1137	1137
query58	329	321	335	321
query59	2680	2671	2573	2573
query60	413	402	389	389
query61	120	133	116	116
query62	822	725	664	664
query63	259	217	210	210
query64	4294	1076	769	769
query65	4170	4127	4118	4118
query66	1077	446	333	333
query67	query68	17834	908	1130	908
query69	1015	270	276	270
query70	1410	1111	1108	1108
query71	713	337	328	328
query72	9235	2352	2373	2352
query73	3294	639	350	350
query74	9151	9004	8966	8966
query75	7498	3114	2677	2677
query76	8852	1207	775	775
query77	1153	406	341	341
query78	9447	10130	9124	9124
query79	13699	603	577	577
query80	1131	543	483	483
query81	548	274	220	220
query82	366	150	115	115
query83	336	284	267	267
query84	308	94	83	83
query85	815	404	318	318
query86	342	334	292	292
query87	4158	4148	4152	4148
query88	3406	2202	2202	2202
query89	469	360	318	318
query90	2611	221	224	221
query91	141	136	110	110
query92	86	72	67	67
query93	3971	968	652	652
query94	938	398	276	276
query95	394	332	318	318
query96	503	583	280	280
query97	2710	2772	2625	2625
query98	270	258	233	233
query99	1441	1434	1272	1272
Total cold run time: 300974 ms
Total hot run time: 169809 ms

doris-robot · 2025-08-04T14:04:12Z

ClickBench: Total hot run time: 32.87 s

machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit a8673f47de8d6113b8d7dc5fb4cbdab132c821e3, data reload: false
query1	0.04	0.04	0.04
query2	0.08	0.05	0.04
query3	0.24	0.07	0.07
query4	1.63	0.11	0.11
query5	0.42	0.42	0.43
query6	1.19	0.65	0.65
query7	0.03	0.02	0.02
query8	0.05	0.04	0.03
query9	0.55	0.47	0.47
query10	0.52	0.52	0.53
query11	0.15	0.11	0.10
query12	0.15	0.10	0.11
query13	0.64	0.64	0.67
query14	0.99	1.03	1.14
query15	0.91	0.87	0.91
query16	0.39	0.39	0.39
query17	1.06	1.01	1.07
query18	0.22	0.20	0.20
query19	1.89	1.84	1.81
query20	0.02	0.01	0.02
query21	15.42	0.87	0.54
query22	0.75	1.18	0.67
query23	15.02	1.19	0.62
query24	6.95	1.00	0.69
query25	0.53	0.24	0.06
query26	0.57	0.16	0.13
query27	0.08	0.05	0.05
query28	9.65	0.82	0.44
query29	12.58	3.82	3.28
query30	3.05	2.98	2.94
query31	2.82	0.56	0.41
query32	3.23	0.57	0.50
query33	3.01	3.22	3.24
query34	16.05	5.32	4.99
query35	4.86	5.00	4.94
query36	0.73	0.52	0.51
query37	0.09	0.08	0.07
query38	0.05	0.04	0.05
query39	0.03	0.03	0.03
query40	0.17	0.14	0.14
query41	0.08	0.03	0.02
query42	0.03	0.02	0.03
query43	0.04	0.03	0.04
Total cold run time: 106.96 s
Total hot run time: 32.87 s

CalvinKirs · 2025-08-05T02:59:39Z

run buildall

doris-robot · 2025-08-05T03:18:37Z

TPC-H: Total hot run time: 34136 ms

machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 8f35754c1a4abbd52b1f5142fc6fd42397b55e4a, data reload: false
------ Round 1 ----------------------------------
q1	17621	5493	5357	5357
q2	1946	313	204	204
q3	10241	1416	708	708
q4	10231	997	538	538
q5	7545	2396	2303	2303
q6	183	166	132	132
q7	915	765	644	644
q8	9309	1293	1067	1067
q9	6784	5088	5092	5088
q10	6899	2358	1976	1976
q11	475	276	256	256
q12	361	361	227	227
q13	17797	3471	3012	3012
q14	239	243	206	206
q15	550	455	461	455
q16	421	420	383	383
q17	582	842	357	357
q18	7319	7296	7123	7123
q19	3111	989	569	569
q20	326	312	221	221
q21	3467	3078	2266	2266
q22	1093	1044	1047	1044
Total cold run time: 107415 ms
Total hot run time: 34136 ms
----- Round 2, with runtime_filter_mode=off -----
q1	5508	5340	5331	5331
q2	250	322	223	223
q3	2108	2585	2213	2213
q4	1358	1802	1333	1333
q5	4313	4402	4465	4402
q6	221	182	138	138
q7	2023	1939	1760	1760
q8	2618	2422	2450	2422
q9	7216	7333	7324	7324
q10	3216	3298	2951	2951
q11	548	502	485	485
q12	722	802	653	653
q13	3393	3736	3268	3268
q14	293	343	284	284
q15	525	443	448	443
q16	441	536	508	508
q17	1368	1510	1409	1409
q18	7857	7925	7937	7925
q19	12162	996	1059	996
q20	3307	2001	1848	1848
q21	14171	4328	4302	4302
q22	1088	1076	978	978
Total cold run time: 74706 ms
Total hot run time: 51196 ms

doris-robot · 2025-08-05T03:30:23Z

TPC-DS: Total hot run time: 170971 ms

machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 8f35754c1a4abbd52b1f5142fc6fd42397b55e4a, data reload: false
============================================
query1	1042	386	424	386
query2	6537	1814	1656	1656
query3	6750	226	222	222
query4	26753	23861	23528	23528
query5	4340	654	549	549
query6	320	272	221	221
query7	4633	520	288	288
query8	276	228	226	226
query9	8595	2999	2962	2962
query10	422	356	299	299
query11	16031	14966	14775	14775
query12	189	136	135	135
query13	1657	572	410	410
query14	8621	5950	5947	5947
query15	214	187	171	171
query16	7132	663	500	500
query17	977	771	652	652
query18	2024	471	329	329
query19	227	217	198	198
query20	158	142	137	137
query21	219	128	111	111
query22	3973	4016	3938	3938
query23	34838	34496	34497	34496
query24	8246	2474	2419	2419
query25	551	505	434	434
query26	840	290	162	162
query27	2713	525	344	344
query28	4353	2374	2348	2348
query29	761	598	567	567
query30	296	239	200	200
query31	902	812	707	707
query32	90	85	78	78
query33	562	419	376	376
query34	813	864	528	528
query35	785	816	732	732
query36	1023	1049	951	951
query37	133	112	86	86
query38	3928	3934	3916	3916
query39	1445	1381	1346	1346
query40	237	138	131	131
query41	62	57	54	54
query42	143	120	129	120
query43	514	527	481	481
query44	1428	880	884	880
query45	199	189	180	180
query46	949	1064	682	682
query47	1765	1837	1781	1781
query48	402	441	309	309
query49	682	505	417	417
query50	675	713	423	423
query51	4246	4298	4222	4222
query52	127	135	123	123
query53	261	291	218	218
query54	665	656	572	572
query55	95	89	85	85
query56	352	362	352	352
query57	1202	1210	1140	1140
query58	343	345	340	340
query59	2686	2756	2515	2515
query60	409	400	385	385
query61	124	122	124	122
query62	809	730	665	665
query63	257	233	216	216
query64	3511	1076	764	764
query65	4236	4131	4126	4126
query66	1012	463	336	336
query67	query68	17665	968	971	968
query69	1041	284	314	284
query70	1396	1134	1125	1125
query71	675	322	325	322
query72	9110	2333	2261	2261
query73	3665	689	360	360
query74	9024	8987	8490	8490
query75	7375	3134	2671	2671
query76	8559	1237	804	804
query77	1172	417	329	329
query78	9766	11567	9261	9261
query79	14850	666	568	568
query80	1687	541	503	503
query81	582	267	292	267
query82	283	152	124	124
query83	416	296	285	285
query84	305	103	85	85
query85	936	370	389	370
query86	362	309	281	281
query87	4149	4179	4075	4075
query88	3697	2231	2218	2218
query89	493	365	308	308
query90	2620	225	228	225
query91	143	138	110	110
query92	89	71	66	66
query93	3597	986	657	657
query94	1047	393	281	281
query95	405	341	318	318
query96	507	595	284	284
query97	2736	2724	2592	2592
query98	275	232	222	222
query99	1463	1426	1288	1288
Total cold run time: 300850 ms
Total hot run time: 170971 ms

doris-robot · 2025-08-05T03:35:53Z

ClickBench: Total hot run time: 32.84 s

machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 8f35754c1a4abbd52b1f5142fc6fd42397b55e4a, data reload: false
query1	0.04	0.03	0.03
query2	0.08	0.04	0.04
query3	0.24	0.07	0.08
query4	1.62	0.11	0.11
query5	0.43	0.40	0.41
query6	1.16	0.65	0.68
query7	0.03	0.02	0.02
query8	0.05	0.04	0.04
query9	0.54	0.48	0.49
query10	0.52	0.53	0.52
query11	0.16	0.10	0.10
query12	0.15	0.11	0.11
query13	0.63	0.67	0.62
query14	1.00	1.15	0.95
query15	0.94	0.90	0.87
query16	0.40	0.39	0.39
query17	1.06	1.09	1.08
query18	0.22	0.21	0.20
query19	1.94	1.97	1.90
query20	0.02	0.01	0.02
query21	15.35	0.85	0.56
query22	0.76	1.06	0.72
query23	14.98	1.14	0.64
query24	6.92	1.97	0.61
query25	0.51	0.20	0.08
query26	0.68	0.16	0.13
query27	0.05	0.06	0.05
query28	9.76	0.82	0.43
query29	12.79	3.78	3.30
query30	3.09	2.96	2.95
query31	2.83	0.57	0.39
query32	3.24	0.58	0.49
query33	3.10	3.14	3.23
query34	16.02	5.45	4.97
query35	5.02	4.94	4.96
query36	0.73	0.52	0.51
query37	0.10	0.08	0.07
query38	0.06	0.05	0.05
query39	0.03	0.02	0.02
query40	0.18	0.15	0.13
query41	0.08	0.03	0.02
query42	0.04	0.02	0.03
query43	0.04	0.03	0.04
Total cold run time: 107.59 s
Total hot run time: 32.84 s

CalvinKirs · 2025-08-05T07:35:25Z

run buildall

doris-robot · 2025-08-05T08:09:28Z

TPC-H: Total hot run time: 33631 ms

machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 6f3084092171b540146ea9112355eec664767220, data reload: false
------ Round 1 ----------------------------------
q1	17611	5299	5180	5180
q2	1907	299	183	183
q3	10326	1340	702	702
q4	10213	1038	549	549
q5	7476	2285	2323	2285
q6	182	168	136	136
q7	877	761	613	613
q8	9297	1285	1016	1016
q9	6660	5094	5047	5047
q10	6893	2346	2005	2005
q11	463	284	266	266
q12	351	370	228	228
q13	17765	3454	2965	2965
q14	225	237	212	212
q15	530	461	466	461
q16	437	432	381	381
q17	580	815	362	362
q18	7350	6989	6928	6928
q19	1320	1068	571	571
q20	335	317	215	215
q21	3424	3104	2340	2340
q22	1059	1024	986	986
Total cold run time: 105281 ms
Total hot run time: 33631 ms
----- Round 2, with runtime_filter_mode=off -----
q1	5322	5295	5228	5228
q2	240	306	215	215
q3	2064	2590	2155	2155
q4	1309	1673	1293	1293
q5	4095	4203	4490	4203
q6	227	183	142	142
q7	1946	1856	1905	1856
q8	2624	2528	2481	2481
q9	7240	7219	7269	7219
q10	3187	3279	2989	2989
q11	566	512	530	512
q12	725	758	637	637
q13	3473	3651	3273	3273
q14	291	474	296	296
q15	486	444	454	444
q16	433	475	423	423
q17	1200	1470	1338	1338
q18	8269	7593	7689	7593
q19	12004	932	918	918
q20	2042	2050	1836	1836
q21	15812	4187	4293	4187
q22	1056	1032	977	977
Total cold run time: 74611 ms
Total hot run time: 50215 ms

doris-robot · 2025-08-05T08:21:15Z

TPC-DS: Total hot run time: 170279 ms

machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 6f3084092171b540146ea9112355eec664767220, data reload: false
============================================
query1	1012	392	405	392
query2	6538	1801	1727	1727
query3	6742	233	220	220
query4	26887	23619	23230	23230
query5	4359	645	511	511
query6	334	244	233	233
query7	4638	541	302	302
query8	285	230	213	213
query9	8607	2957	2923	2923
query10	467	335	294	294
query11	15868	15580	14786	14786
query12	187	139	134	134
query13	1664	579	406	406
query14	8475	5780	5799	5780
query15	206	193	164	164
query16	7111	648	481	481
query17	990	759	603	603
query18	2010	436	329	329
query19	227	211	185	185
query20	158	148	137	137
query21	216	124	109	109
query22	3968	3949	3911	3911
query23	34492	34151	34162	34151
query24	7353	2398	2494	2398
query25	491	505	457	457
query26	717	291	165	165
query27	2385	508	375	375
query28	3023	2388	2346	2346
query29	674	617	500	500
query30	293	241	214	214
query31	876	795	687	687
query32	88	74	76	74
query33	550	417	373	373
query34	849	855	534	534
query35	787	820	763	763
query36	1024	1036	956	956
query37	138	107	91	91
query38	3942	3939	3899	3899
query39	1455	1396	1373	1373
query40	231	142	137	137
query41	62	54	54	54
query42	140	126	131	126
query43	520	529	499	499
query44	1463	893	889	889
query45	197	182	186	182
query46	975	1124	695	695
query47	1765	1806	1742	1742
query48	403	428	312	312
query49	682	527	452	452
query50	709	701	438	438
query51	4140	4186	4261	4186
query52	134	135	124	124
query53	276	295	226	226
query54	688	671	577	577
query55	93	94	92	92
query56	375	368	371	368
query57	1231	1201	1138	1138
query58	344	332	326	326
query59	2560	2652	2509	2509
query60	404	385	397	385
query61	121	154	118	118
query62	748	774	658	658
query63	265	227	216	216
query64	2379	1136	760	760
query65	4182	4126	4084	4084
query66	989	447	328	328
query67	query68	17284	872	861	861
query69	1322	320	288	288
query70	1464	1133	1130	1130
query71	713	318	338	318
query72	9170	2231	2310	2231
query73	3495	713	373	373
query74	9057	8686	8670	8670
query75	7636	3136	2703	2703
query76	8696	1240	783	783
query77	1150	536	334	334
query78	9520	11397	9279	9279
query79	15560	590	593	590
query80	2938	558	530	530
query81	539	257	230	230
query82	550	150	118	118
query83	364	300	282	282
query84	304	100	89	89
query85	941	468	333	333
query86	356	317	284	284
query87	4265	4149	4114	4114
query88	5574	2308	2280	2280
query89	516	375	324	324
query90	2496	244	239	239
query91	142	142	109	109
query92	88	73	68	68
query93	6657	975	657	657
query94	1220	404	287	287
query95	426	334	322	322
query96	525	619	290	290
query97	2686	2718	2586	2586
query98	260	233	226	226
query99	1467	1441	1304	1304
Total cold run time: 303543 ms
Total hot run time: 170279 ms

doris-robot · 2025-08-05T08:26:43Z

ClickBench: Total hot run time: 32.96 s

machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 6f3084092171b540146ea9112355eec664767220, data reload: false
query1	0.04	0.04	0.04
query2	0.08	0.04	0.05
query3	0.25	0.08	0.07
query4	1.62	0.11	0.11
query5	0.41	0.42	0.41
query6	1.18	0.66	0.65
query7	0.02	0.02	0.02
query8	0.05	0.04	0.03
query9	0.55	0.49	0.47
query10	0.52	0.52	0.54
query11	0.15	0.10	0.10
query12	0.15	0.11	0.11
query13	0.64	0.63	0.67
query14	0.94	1.09	1.16
query15	0.92	0.88	0.90
query16	0.39	0.39	0.39
query17	1.06	1.07	1.07
query18	0.21	0.20	0.21
query19	1.99	1.90	1.86
query20	0.02	0.01	0.01
query21	15.38	0.84	0.55
query22	0.77	1.21	0.66
query23	14.98	1.22	0.64
query24	6.66	0.69	0.91
query25	0.50	0.27	0.06
query26	0.44	0.17	0.13
query27	0.06	0.05	0.06
query28	9.87	0.87	0.44
query29	12.62	3.87	3.41
query30	2.99	2.98	2.91
query31	2.82	0.56	0.39
query32	3.24	0.57	0.49
query33	3.03	3.15	3.27
query34	16.15	5.30	4.88
query35	4.90	4.95	5.04
query36	0.69	0.51	0.50
query37	0.10	0.08	0.07
query38	0.06	0.05	0.04
query39	0.03	0.03	0.03
query40	0.16	0.14	0.14
query41	0.09	0.03	0.02
query42	0.03	0.03	0.03
query43	0.04	0.03	0.04
Total cold run time: 106.8 s
Total hot run time: 32.96 s

hello-stephen · 2025-08-05T08:38:48Z

FE UT Coverage Report

Increment line coverage 86.67% (39/45) 🎉
Increment coverage report
Complete coverage report

CalvinKirs · 2025-08-05T10:33:47Z

run buildall

doris-robot · 2025-08-05T11:38:14Z

TPC-H: Total hot run time: 33710 ms

machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 5a03b696dda465526683876b33eb75f4f0a1ddac, data reload: false
------ Round 1 ----------------------------------
q1	17583	5191	5144	5144
q2	1920	276	185	185
q3	10597	1294	706	706
q4	10307	986	506	506
q5	10036	2330	2374	2330
q6	249	170	132	132
q7	903	789	619	619
q8	9327	1346	1041	1041
q9	6818	5058	5084	5058
q10	6956	2369	1992	1992
q11	472	274	267	267
q12	355	383	220	220
q13	17813	3497	3007	3007
q14	233	260	227	227
q15	566	471	451	451
q16	443	423	384	384
q17	584	822	357	357
q18	7273	7100	6987	6987
q19	1738	1012	553	553
q20	325	315	213	213
q21	3389	3051	2362	2362
q22	1124	1019	969	969
Total cold run time: 109011 ms
Total hot run time: 33710 ms
----- Round 2, with runtime_filter_mode=off -----
q1	5429	5372	5326	5326
q2	239	311	214	214
q3	2148	2553	2242	2242
q4	1298	1716	1327	1327
q5	4382	4412	4482	4412
q6	222	182	134	134
q7	1958	1881	1795	1795
q8	2570	2562	2435	2435
q9	7427	7150	7335	7150
q10	3056	3414	3250	3250
q11	544	624	529	529
q12	694	764	608	608
q13	3371	3603	3311	3311
q14	329	296	277	277
q15	496	478	456	456
q16	458	492	458	458
q17	1158	1511	1427	1427
q18	7981	7614	7788	7614
q19	6939	917	977	917
q20	1985	1920	1746	1746
q21	14562	4321	4264	4264
q22	1029	1050	999	999
Total cold run time: 68275 ms
Total hot run time: 50891 ms

doris-robot · 2025-08-05T11:50:04Z

TPC-DS: Total hot run time: 171024 ms

machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 5a03b696dda465526683876b33eb75f4f0a1ddac, data reload: false
============================================
query1	1003	368	444	368
query2	6560	1752	1672	1672
query3	6742	237	223	223
query4	27144	24051	23021	23021
query5	4337	648	539	539
query6	330	252	221	221
query7	4633	530	303	303
query8	286	245	233	233
query9	8603	2956	2941	2941
query10	496	343	305	305
query11	15857	15711	15172	15172
query12	179	139	129	129
query13	1664	557	416	416
query14	8494	5865	5860	5860
query15	213	194	169	169
query16	7833	661	465	465
query17	1628	833	651	651
query18	2103	458	331	331
query19	323	227	189	189
query20	155	146	132	132
query21	228	132	114	114
query22	3962	3978	3807	3807
query23	34698	34587	34573	34573
query24	8031	2392	2425	2392
query25	543	505	443	443
query26	727	301	160	160
query27	2591	490	348	348
query28	4245	2364	2321	2321
query29	693	593	489	489
query30	295	231	200	200
query31	900	817	706	706
query32	90	79	83	79
query33	551	423	359	359
query34	814	862	536	536
query35	811	830	750	750
query36	1055	1036	943	943
query37	126	111	96	96
query38	3945	3995	4010	3995
query39	1431	1383	1361	1361
query40	237	153	137	137
query41	66	61	54	54
query42	141	123	125	123
query43	509	496	468	468
query44	1414	887	869	869
query45	201	185	182	182
query46	955	1065	681	681
query47	1790	1911	1718	1718
query48	412	440	309	309
query49	709	516	439	439
query50	660	683	412	412
query51	4156	4101	4158	4101
query52	130	132	118	118
query53	260	288	209	209
query54	656	659	577	577
query55	90	86	92	86
query56	357	376	376	376
query57	1196	1214	1124	1124
query58	335	353	329	329
query59	2703	2668	2629	2629
query60	407	410	381	381
query61	126	123	125	123
query62	815	732	670	670
query63	249	212	209	209
query64	3050	1088	814	814
query65	4248	4137	4107	4107
query66	920	456	333	333
query67	query68	16906	878	858	858
query69	1079	283	300	283
query70	1394	1133	1127	1127
query71	710	314	316	314
query72	9189	2264	2168	2168
query73	3256	692	355	355
query74	9049	8952	8587	8587
query75	7550	3125	2650	2650
query76	8842	1219	843	843
query77	1167	415	338	338
query78	9685	10870	9771	9771
query79	15101	609	586	586
query80	1933	551	493	493
query81	601	268	226	226
query82	467	147	118	118
query83	357	290	285	285
query84	289	101	87	87
query85	877	365	333	333
query86	355	328	282	282
query87	4287	4213	4081	4081
query88	5516	2265	2268	2265
query89	494	368	317	317
query90	2460	228	231	228
query91	149	140	112	112
query92	89	74	68	68
query93	6254	976	657	657
query94	1029	388	282	282
query95	423	351	318	318
query96	511	591	287	287
query97	2701	2758	2598	2598
query98	272	246	229	229
query99	1434	1337	1288	1288
Total cold run time: 305537 ms
Total hot run time: 171024 ms

doris-robot · 2025-08-05T11:55:34Z

ClickBench: Total hot run time: 33.34 s

machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 5a03b696dda465526683876b33eb75f4f0a1ddac, data reload: false
query1	0.04	0.04	0.04
query2	0.08	0.04	0.04
query3	0.24	0.07	0.08
query4	1.61	0.10	0.11
query5	0.42	0.40	0.42
query6	1.18	0.66	0.64
query7	0.03	0.02	0.02
query8	0.05	0.04	0.04
query9	0.56	0.48	0.47
query10	0.52	0.53	0.53
query11	0.16	0.10	0.10
query12	0.14	0.12	0.11
query13	0.65	0.65	0.64
query14	0.89	1.09	1.20
query15	0.94	0.89	0.89
query16	0.39	0.40	0.40
query17	1.08	1.06	1.07
query18	0.22	0.21	0.20
query19	2.07	1.78	1.90
query20	0.02	0.01	0.01
query21	15.39	0.86	0.56
query22	0.79	1.08	0.67
query23	15.02	1.23	0.63
query24	6.67	1.49	0.94
query25	0.47	0.28	0.16
query26	0.71	0.15	0.13
query27	0.06	0.06	0.05
query28	9.53	0.88	0.45
query29	12.67	3.85	3.30
query30	3.11	3.06	2.95
query31	2.81	0.58	0.40
query32	3.24	0.56	0.49
query33	3.03	3.27	3.19
query34	16.12	5.37	4.92
query35	4.89	4.99	5.02
query36	0.68	0.52	0.51
query37	0.10	0.07	0.08
query38	0.06	0.05	0.05
query39	0.04	0.03	0.03
query40	0.17	0.15	0.14
query41	0.08	0.03	0.02
query42	0.04	0.03	0.03
query43	0.04	0.03	0.03
Total cold run time: 107.01 s
Total hot run time: 33.34 s

github-actions · 2025-08-07T05:58:26Z

PR approved by at least one committer and no changes requested.

github-actions · 2025-08-07T05:58:29Z

PR approved by anyone and no changes requested.

CalvinKirs · 2025-08-08T12:11:09Z

run buildall

CalvinKirs · 2025-08-08T12:13:11Z

run buildall

doris-robot · 2025-08-08T12:45:51Z

TPC-H: Total hot run time: 33691 ms

machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit a9dcbe65506e3f47e45a8f33346c870b629dec2e, data reload: false
------ Round 1 ----------------------------------
q1	17572	5249	5223	5223
q2	1913	302	183	183
q3	10300	1342	703	703
q4	10223	987	513	513
q5	7530	2340	2285	2285
q6	178	163	133	133
q7	902	754	593	593
q8	9284	1278	1102	1102
q9	6662	5075	5082	5075
q10	6883	2326	1994	1994
q11	463	278	262	262
q12	346	355	220	220
q13	17768	3447	2987	2987
q14	229	234	221	221
q15	527	472	457	457
q16	415	420	380	380
q17	567	826	351	351
q18	7427	6952	6938	6938
q19	1913	981	564	564
q20	320	315	213	213
q21	3337	3040	2310	2310
q22	1088	1033	984	984
Total cold run time: 105847 ms
Total hot run time: 33691 ms
----- Round 2, with runtime_filter_mode=off -----
q1	5413	5286	5345	5286
q2	246	306	212	212
q3	2071	2575	2161	2161
q4	1291	1697	1314	1314
q5	4100	4228	4471	4228
q6	219	177	142	142
q7	1932	1905	1789	1789
q8	2534	2493	2483	2483
q9	7390	7407	7203	7203
q10	3248	3332	2779	2779
q11	572	501	514	501
q12	704	754	632	632
q13	3463	3617	3317	3317
q14	305	295	282	282
q15	499	464	465	464
q16	444	493	463	463
q17	1208	1367	1348	1348
q18	8092	7683	7724	7683
q19	12122	861	857	857
q20	2811	1925	1721	1721
q21	14772	4233	4316	4233
q22	1042	1040	1002	1002
Total cold run time: 74478 ms
Total hot run time: 50100 ms

doris-robot · 2025-08-08T12:57:36Z

TPC-DS: Total hot run time: 170825 ms

machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit a9dcbe65506e3f47e45a8f33346c870b629dec2e, data reload: false
============================================
query1	1003	389	424	389
query2	6831	1780	1737	1737
query3	6749	224	219	219
query4	27516	23973	23284	23284
query5	4382	645	541	541
query6	315	236	227	227
query7	4638	524	307	307
query8	276	241	244	241
query9	8549	2970	2966	2966
query10	489	346	292	292
query11	15553	14902	14711	14711
query12	184	134	135	134
query13	1671	568	436	436
query14	8669	5843	5922	5843
query15	209	185	167	167
query16	7124	676	445	445
query17	967	755	644	644
query18	1991	446	332	332
query19	223	211	189	189
query20	161	149	154	149
query21	218	125	112	112
query22	4122	3971	3934	3934
query23	34366	34236	34294	34236
query24	7352	2383	2439	2383
query25	494	505	440	440
query26	718	326	169	169
query27	2332	490	363	363
query28	2979	2338	2322	2322
query29	669	608	487	487
query30	298	230	203	203
query31	876	797	719	719
query32	88	77	78	77
query33	528	398	362	362
query34	824	831	522	522
query35	824	822	734	734
query36	1023	1042	949	949
query37	143	114	92	92
query38	4071	3885	3901	3885
query39	1427	1380	1374	1374
query40	232	139	133	133
query41	63	59	55	55
query42	140	132	128	128
query43	528	501	489	489
query44	1425	886	874	874
query45	191	194	181	181
query46	934	1050	669	669
query47	1795	1841	1759	1759
query48	404	436	317	317
query49	676	508	415	415
query50	672	692	412	412
query51	4205	4164	4122	4122
query52	134	138	122	122
query53	266	283	211	211
query54	650	656	564	564
query55	92	96	94	94
query56	356	354	406	354
query57	1211	1218	1151	1151
query58	341	329	328	328
query59	2675	2627	2536	2536
query60	402	404	413	404
query61	129	120	138	120
query62	753	736	666	666
query63	260	219	235	219
query64	2368	1122	762	762
query65	4208	4136	4122	4122
query66	998	443	329	329
query67	query68	16376	877	964	877
query69	1042	287	302	287
query70	1315	1128	1185	1128
query71	692	320	325	320
query72	9144	2340	2206	2206
query73	3136	705	355	355
query74	9038	8923	8859	8859
query75	7381	3105	2822	2822
query76	8838	1217	829	829
query77	1141	416	337	337
query78	9497	11064	9501	9501
query79	15416	608	593	593
query80	2952	589	499	499
query81	547	254	224	224
query82	509	149	119	119
query83	364	281	270	270
query84	294	103	87	87
query85	979	405	355	355
query86	362	349	291	291
query87	4227	4190	4139	4139
query88	5752	2257	2239	2239
query89	493	361	312	312
query90	2472	228	232	228
query91	143	138	110	110
query92	94	75	67	67
query93	6649	1043	657	657
query94	1327	386	285	285
query95	452	355	329	329
query96	502	591	282	282
query97	2666	2744	2572	2572
query98	252	241	220	220
query99	1444	1435	1274	1274
Total cold run time: 302456 ms
Total hot run time: 170825 ms

doris-robot · 2025-08-08T13:03:05Z

ClickBench: Total hot run time: 32.94 s

machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit a9dcbe65506e3f47e45a8f33346c870b629dec2e, data reload: false
query1	0.04	0.03	0.03
query2	0.08	0.05	0.04
query3	0.24	0.06	0.08
query4	1.60	0.10	0.10
query5	0.43	0.44	0.44
query6	1.15	0.66	0.67
query7	0.03	0.02	0.02
query8	0.05	0.03	0.04
query9	0.56	0.48	0.47
query10	0.52	0.53	0.52
query11	0.17	0.10	0.11
query12	0.14	0.10	0.10
query13	0.66	0.65	0.64
query14	0.94	1.09	1.08
query15	0.90	0.87	0.87
query16	0.40	0.38	0.39
query17	1.02	1.05	1.04
query18	0.22	0.20	0.20
query19	2.01	1.93	1.93
query20	0.02	0.01	0.02
query21	15.37	0.85	0.55
query22	0.77	1.20	0.69
query23	14.90	1.15	0.61
query24	7.59	0.57	0.72
query25	0.50	0.17	0.08
query26	0.63	0.15	0.13
query27	0.06	0.06	0.05
query28	9.92	0.84	0.44
query29	12.59	3.85	3.37
query30	3.02	3.01	2.93
query31	2.82	0.56	0.39
query32	3.24	0.56	0.49
query33	2.99	3.18	3.27
query34	16.20	5.35	4.94
query35	4.86	4.99	4.94
query36	0.71	0.52	0.50
query37	0.10	0.08	0.07
query38	0.05	0.05	0.05
query39	0.03	0.03	0.03
query40	0.18	0.14	0.13
query41	0.09	0.04	0.03
query42	0.03	0.02	0.03
query43	0.05	0.04	0.03
Total cold run time: 107.88 s
Total hot run time: 32.94 s

CalvinKirs · 2025-08-09T01:24:06Z

run buildall

doris-robot · 2025-08-09T01:57:45Z

TPC-H: Total hot run time: 33683 ms

machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit c8e929c94225151640c7e7bcdbb790ad13dfc5c0, data reload: false
------ Round 1 ----------------------------------
q1	17606	5271	5220	5220
q2	1904	285	187	187
q3	10348	1332	716	716
q4	10230	967	516	516
q5	7554	2286	2291	2286
q6	175	164	133	133
q7	889	734	612	612
q8	9285	1287	1137	1137
q9	6773	5063	5120	5063
q10	6867	2355	1979	1979
q11	471	273	278	273
q12	348	358	229	229
q13	17758	3498	3006	3006
q14	236	248	217	217
q15	534	456	463	456
q16	411	413	394	394
q17	566	816	345	345
q18	7428	6859	6985	6859
q19	1806	980	556	556
q20	329	311	220	220
q21	3383	2991	2279	2279
q22	1073	1020	1000	1000
Total cold run time: 105974 ms
Total hot run time: 33683 ms
----- Round 2, with runtime_filter_mode=off -----
q1	5376	5338	5290	5290
q2	231	315	213	213
q3	2098	2607	2236	2236
q4	1280	1704	1299	1299
q5	4083	4265	4378	4265
q6	227	199	135	135
q7	2034	1962	1673	1673
q8	2571	2576	2423	2423
q9	7527	7240	7099	7099
q10	3175	3363	2962	2962
q11	537	525	474	474
q12	700	763	627	627
q13	3491	3666	3239	3239
q14	297	314	282	282
q15	507	449	471	449
q16	456	486	431	431
q17	1154	1383	1569	1383
q18	7776	7857	7768	7768
q19	12512	947	968	947
q20	1951	1932	1738	1738
q21	14874	4346	4192	4192
q22	1079	1005	1016	1005
Total cold run time: 73936 ms
Total hot run time: 50130 ms

doris-robot · 2025-08-09T02:09:25Z

TPC-DS: Total hot run time: 160099 ms

machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit c8e929c94225151640c7e7bcdbb790ad13dfc5c0, data reload: false
catalog_page	Doris	NULL	NULL	0	0	0	NULL	0	NULL	NULL	2023-12-26 22:43:58	2023-12-26 22:44:01	NULL	utf-8	NULL	NULL reason	Doris	NULL	NULL	0	0	0	NULL	0	NULL	NULL	2023-12-26 22:43:56	2023-12-26 22:44:01	NULL	utf-8	NULL	NULL ============================================
query1	974	391	436	391
query2	6535	1777	1685	1685
query3	6740	226	224	224
query4	26742	23689	23300	23300
query5	4378	628	512	512
query6	325	241	225	225
query7	4626	525	293	293
query8	292	233	238	233
query9	8620	2958	2958	2958
query10	487	347	287	287
query11	15642	15062	14675	14675
query12	182	139	131	131
query13	1659	568	434	434
query14	8555	5899	5827	5827
query15	216	184	167	167
query16	7143	683	518	518
query17	1220	767	658	658
query18	2000	440	329	329
query19	218	211	187	187
query20	154	137	150	137
query21	221	126	113	113
query22	4004	3972	3780	3780
query23	34570	34194	34151	34151
query24	5217	2380	2404	2380
query25	509	511	458	458
query26	718	288	167	167
query27	2272	509	349	349
query28	2984	2337	2374	2337
query29	656	600	484	484
query30	288	235	196	196
query31	885	786	707	707
query32	87	80	79	79
query33	565	418	395	395
query34	782	861	524	524
query35	817	839	794	794
query36	1020	1020	938	938
query37	135	110	91	91
query38	4015	3981	3928	3928
query39	1448	1463	1378	1378
query40	231	145	135	135
query41	60	61	54	54
query42	140	123	126	123
query43	524	520	490	490
query44	1385	875	894	875
query45	196	186	184	184
query46	950	1063	675	675
query47	1799	1801	1760	1760
query48	408	420	330	330
query49	674	500	404	404
query50	674	696	408	408
query51	4151	4186	4186	4186
query52	127	132	123	123
query53	260	291	211	211
query54	655	629	549	549
query55	90	88	84	84
query56	350	353	345	345
query57	1192	1224	1127	1127
query58	332	334	329	329
query59	2688	2680	2569	2569
query60	407	396	377	377
query61	123	124	121	121
query62	756	748	671	671
query63	255	219	216	216
query64	2346	1091	747	747
query65	4262	4152	4110	4110
query66	1056	453	324	324
query67	query68	17919	616	596	596
query69	1001	317	289	289
query70	1360	1121	1117	1117
query71	728	353	317	317
query72	9143	2243	2387	2243
query73	3736	631	354	354
query74	8997	8915	8826	8826
query75	7584	3120	2672	2672
query76	8733	1218	802	802
query77	1155	455	356	356
query78	9532	11606	query79	query80	5306	500	485	485
query81	584	242	231	231
query82	1003	123	120	120
query83	471	271	283	271
query84	297	87	82	82
query85	1219	343	334	334
query86	372	303	303	303
query87	4363	4214	4148	4148
query88	10703	2209	2222	2209
query89	562	365	332	332
query90	2548	232	229	229
query91	146	141	155	141
query92	90	75	69	69
query93	8539	961	660	660
query94	1483	380	268	268
query95	436	326	328	326
query96	515	566	281	281
query97	2704	2762	2595	2595
query98	254	236	225	225
query99	1499	1359	1271	1271
Total cold run time: 287442 ms
Total hot run time: 160099 ms

doris-robot · 2025-08-09T02:14:54Z

ClickBench: Total hot run time: 33.14 s

machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit c8e929c94225151640c7e7bcdbb790ad13dfc5c0, data reload: false
query1	0.04	0.03	0.03
query2	0.08	0.04	0.05
query3	0.25	0.08	0.07
query4	1.63	0.11	0.10
query5	0.43	0.43	0.42
query6	1.16	0.67	0.67
query7	0.02	0.02	0.02
query8	0.04	0.04	0.04
query9	0.53	0.48	0.47
query10	0.53	0.53	0.52
query11	0.16	0.10	0.10
query12	0.14	0.11	0.11
query13	0.65	0.64	0.64
query14	0.92	1.10	1.19
query15	0.90	0.87	0.89
query16	0.38	0.41	0.40
query17	1.05	1.06	1.10
query18	0.22	0.20	0.20
query19	1.93	1.91	1.78
query20	0.01	0.01	0.02
query21	15.39	0.87	0.55
query22	0.79	1.03	0.61
query23	15.11	1.17	0.59
query24	7.17	1.00	1.62
query25	0.53	0.26	0.09
query26	0.45	0.15	0.12
query27	0.06	0.05	0.05
query28	10.38	0.79	0.44
query29	12.55	3.81	3.29
query30	3.01	2.97	2.93
query31	2.82	0.56	0.39
query32	3.24	0.59	0.49
query33	3.06	3.12	3.25
query34	15.84	5.32	4.98
query35	4.91	4.99	5.02
query36	0.72	0.51	0.50
query37	0.10	0.08	0.07
query38	0.06	0.05	0.04
query39	0.04	0.02	0.02
query40	0.17	0.14	0.13
query41	0.08	0.04	0.03
query42	0.04	0.03	0.03
query43	0.04	0.03	0.03
Total cold run time: 107.63 s
Total hot run time: 33.14 s

morningman · 2025-08-09T04:49:20Z

+ .require(dlfSecretKey, "dlf.secret_key is required");
 }

 public void checkAndInit() {


Suggested change
publicvoidcheckAndInit() {
privatevoidcheckAndInit() {

github-actions · 2025-08-09T04:58:00Z

PR approved by at least one committer and no changes requested.

kaka11chen

LGTM

…region fallback (#54300) #50238 ### PR Description This PR fixes a special case where the endpoint parameter might be missing when using DLF as the Hive Metastore (MS) without configuring any storage backend. #### Background In certain deployments, users rely solely on DLF as the metastore and do not explicitly configure object storage credentials. In these cases: Only DLF access_key, secret_key, and region are provided. dlf.endpoint is omitted by the user. ``` create catalog if not exists pm_dlf properties ( "type" = "paimon", "paimon.catalog.type" = "dlf", "warehouse" = "oss://asf-doris-datalake-test/p2_regression_case", "dlf.proxy.mode" = "DLF_ONLY", "dlf.uid" = "1289998888", "dlf.region" = "cn-beijing", "dlf.catalog.id" = "asf", "dlf.access_key" = "ABSHJJJKKKLKJHVGFGHJKLKJHGHJKJHGHJK", "dlf.secret_key" = "UYGFHJKHGVVHBJKHVGBJKL:JHGVBJKLHVGHJHVGH" ); switch pm_dlf; show databases; exception: Exception:java.sql.SQLException: errCode = 2, detailMessage = UserException: errCode = 2, detailMessage = No storage properties found for schema: oss at com.mysql.cj.jdbc.exceptions.SQLError.createSQLException(SQLError.java:129) at ``` The system attempts to initialize storage configuration, but fails because endpoint is required. This issue occurs because the existing logic assumes that the storage module always receives a valid endpoint, which is not the case when DLF is used as MS only. #### Fix When dlf.endpoint is not set, and dlf.region is available, this patch automatically derives a valid default endpoint based on the region and network mode (public or VPC). This logic is consistent with the existing behavior of DLF SDKs and avoids unnecessary configuration burden for users using DLF as MS only. #### Compatibility Backward compatible: No breaking change for users who already provide an endpoint. Recommended best practice remains: Users are encouraged to explicitly configure both endpoint and region for clarity.

…enario with region fallback #54300 (#54522) Cherry-picked from #54300 Co-authored-by: Calvin Kirs <guoqiang@selectdb.com>

remove unless code
a8673f4

CalvinKirs added the dev/3.1.x label Aug 4, 2025

remove unless code
8f35754

remove unless code
6f30840

remove unless code
5a03b69

morningman previously approved these changes Aug 7, 2025
View reviewed changes

github-actionsBot added the approved Indicates a PR has been approved by one committer. label Aug 7, 2025

github-actionsBot added the reviewed label Aug 7, 2025

CalvinKirs marked this pull request as draft August 7, 2025 06:12

fix
2f8c8b6

CalvinKirs dismissed morningman’s stale review via 2f8c8b6August 8, 2025 12:00

github-actionsBot removed the approved Indicates a PR has been approved by one committer. label Aug 8, 2025

fix
b0799df

fix
a9dcbe6

CalvinKirs marked this pull request as ready for review August 8, 2025 12:13

fix
c8e929c

morningman reviewed Aug 9, 2025
View reviewed changes

morningman approved these changes Aug 9, 2025
View reviewed changes

github-actionsBot added the approved Indicates a PR has been approved by one committer. label Aug 9, 2025

kaka11chen approved these changes Aug 10, 2025
View reviewed changes

morningman merged commit d9a4003 into apache:masterAug 10, 2025
27 of 30 checks passed

github-actionsBot mentioned this pull request Aug 10, 2025
branch-3.1: [Fix](MS)Handle missing endpoint in DLF-only Metastore scenario with region fallback #54300 #54522
Merged

morrySnow pushed a commit that referenced this pull request Aug 13, 2025
branch-3.1: [Fix](MS)Handle missing endpoint in DLF-only Metastore sc…
1ffec7c
…enario with region fallback #54300 (#54522) Cherry-picked from #54300 Co-authored-by: Calvin Kirs <guoqiang@selectdb.com>

morrySnow added dev/3.1.0-merged and removed dev/3.1.x labels Aug 13, 2025

Uh oh!

Conversation

CalvinKirs commented Aug 4, 2025• edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

PR Description

Background

Fix

Compatibility

What problem does this PR solve?

Release note

Check List (For Author)

Check List (For Reviewer who merge this PR)

Uh oh!

Thearas commented Aug 4, 2025

Uh oh!

CalvinKirs commented Aug 4, 2025

Uh oh!

CalvinKirs commented Aug 4, 2025

Uh oh!

hello-stephen commented Aug 4, 2025

FE UT Coverage Report

Uh oh!

doris-robot commented Aug 4, 2025

Uh oh!

doris-robot commented Aug 4, 2025

Uh oh!

doris-robot commented Aug 4, 2025

Uh oh!

CalvinKirs commented Aug 5, 2025

Uh oh!

doris-robot commented Aug 5, 2025

Uh oh!

doris-robot commented Aug 5, 2025

Uh oh!

doris-robot commented Aug 5, 2025

Uh oh!

CalvinKirs commented Aug 5, 2025

Uh oh!

doris-robot commented Aug 5, 2025

Uh oh!

doris-robot commented Aug 5, 2025

Uh oh!

doris-robot commented Aug 5, 2025

Uh oh!

hello-stephen commented Aug 5, 2025

FE UT Coverage Report

Uh oh!

CalvinKirs commented Aug 5, 2025

Uh oh!

doris-robot commented Aug 5, 2025

Uh oh!

doris-robot commented Aug 5, 2025

Uh oh!

doris-robot commented Aug 5, 2025

Uh oh!

github-actionsBot commented Aug 7, 2025

Uh oh!

github-actionsBot commented Aug 7, 2025

Uh oh!

CalvinKirs commented Aug 8, 2025

Uh oh!

CalvinKirs commented Aug 8, 2025

Uh oh!

doris-robot commented Aug 8, 2025

Uh oh!

doris-robot commented Aug 8, 2025

Uh oh!

doris-robot commented Aug 8, 2025

Uh oh!

CalvinKirs commented Aug 9, 2025

Uh oh!

doris-robot commented Aug 9, 2025

Uh oh!

doris-robot commented Aug 9, 2025

Uh oh!

doris-robot commented Aug 9, 2025

Uh oh!

morningmanAug 9, 2025

Choose a reason for hiding this comment

Uh oh!

CalvinKirs commented Aug 4, 2025•
edited
Loading