[feature](Vault) Support alter hdfs storage vault and alter vault's name - #38685

Merged

gavinchou merged 4 commits into

apache:masterfrom

ByteYue:support_rename_vault

Aug 13, 2024

ByteYue commented Aug 1, 2024•
edited by gavinchou
Loading

Contributor

Previously only s3 vault can be altered. This pr adds support of hdfs storage vault. And this pr also supports to alter vault's name.

usage example

ALTER STORAGE VAULT alter_s3_vault
PROPERTIES (
"type"="S3",
"s3.access_key" = "new_ak", -- change ak
"s3.secrete_key" = "new_ak", -- change sk
);
ALTER STORAGE VAULT alter_hdfs_vault
PROPERTIES (
"type"="hdfs",
"VAULT_NAME" = "alter_hdfs_vault_new_name", -- change vault name
"hadoop.username" = "hdfs" -- change user name
);

doris-robot commented Aug 1, 2024

Thank you for your contribution to Apache Doris.
Don't know what should be done next? See How to process your PR

Since 2024-03-18, the Document has been moved to doris-website.
See Doris Document.

github-actionsBot added doing meta-change labels

github-actionsBot commented Aug 1, 2024

Contributor

clang-tidy review says "All clean, LGTM! 👍"

ByteYue force-pushed the support_rename_vault branch from 9eabcc4 to 1bbc772Compare

August 1, 2024 08:44

github-actionsBot commented Aug 1, 2024

Contributor

clang-tidy review says "All clean, LGTM! 👍"

3 similar comments

github-actionsBot commented Aug 1, 2024

Contributor

clang-tidy review says "All clean, LGTM! 👍"

github-actionsBot commented Aug 1, 2024

Contributor

clang-tidy review says "All clean, LGTM! 👍"

github-actionsBot commented Aug 1, 2024

Contributor

clang-tidy review says "All clean, LGTM! 👍"

ByteYue commented Aug 1, 2024

ContributorAuthor

run buildall

github-actionsBot commented Aug 1, 2024

Contributor

clang-tidy review says "All clean, LGTM! 👍"

doris-robot commented Aug 1, 2024

TPC-H: Total hot run time: 42019 ms

machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 05197bca9a957d0681ad2cfedff8e690d95bee89, data reload: false
------ Round 1 ----------------------------------
q1	18085	4313	4196	4196
q2	3154	207	200	200
q3	11733	1310	1374	1310
q4	10592	871	973	871
q5	8938	3023	3002	3002
q6	216	137	137	137
q7	1053	616	607	607
q8	9451	1944	1967	1944
q9	8519	6627	6657	6627
q10	8693	3856	3861	3856
q11	426	247	251	247
q12	412	232	232	232
q13	17757	2973	2935	2935
q14	276	235	240	235
q15	535	482	489	482
q16	491	405	385	385
q17	966	895	869	869
q18	8075	7363	7298	7298
q19	1377	1211	1216	1211
q20	573	333	345	333
q21	5547	4761	4806	4761
q22	377	281	285	281
Total cold run time: 117246 ms
Total hot run time: 42019 ms
----- Round 2, with runtime_filter_mode=off -----
q1	4058	4038	4053	4038
q2	329	223	223	223
q3	2987	2985	3001	2985
q4	1906	1883	1891	1883
q5	5276	5222	5245	5222
q6	217	129	130	129
q7	2095	1645	1767	1645
q8	3183	3270	3247	3247
q9	8356	8267	8255	8255
q10	3747	3857	3859	3857
q11	537	449	457	449
q12	715	588	562	562
q13	9865	2921	2946	2921
q14	293	261	264	261
q15	516	482	473	473
q16	441	399	402	399
q17	1741	1713	1705	1705
q18	7763	7397	7151	7151
q19	1670	1685	1671	1671
q20	1941	1747	1761	1747
q21	5344	5239	5219	5219
q22	526	457	487	457
Total cold run time: 63506 ms
Total hot run time: 54499 ms

doris-robot commented Aug 1, 2024

TPC-DS: Total hot run time: 169321 ms

machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 05197bca9a957d0681ad2cfedff8e690d95bee89, data reload: false
query1	899	374	369	369
query2	6455	1750	1723	1723
query3	6679	215	230	215
query4	19729	17554	17373	17373
query5	4295	514	503	503
query6	296	160	160	160
query7	4611	293	297	293
query8	270	204	193	193
query9	8515	2366	2356	2356
query10	441	283	269	269
query11	10639	9991	9921	9921
query12	141	88	95	88
query13	1632	384	382	382
query14	9968	7391	7465	7391
query15	206	171	161	161
query16	7108	482	465	465
query17	969	578	571	571
query18	1926	292	289	289
query19	198	153	155	153
query20	96	89	87	87
query21	206	100	103	100
query22	4350	3996	3902	3902
query23	33658	32820	32835	32820
query24	10407	3057	3095	3057
query25	704	413	410	410
query26	1768	154	153	153
query27	2898	281	280	280
query28	6871	1972	1961	1961
query29	1319	433	431	431
query30	284	152	151	151
query31	925	762	767	762
query32	103	55	58	55
query33	703	324	329	324
query34	897	482	496	482
query35	857	724	738	724
query36	985	867	887	867
query37	293	82	83	82
query38	2826	2766	2752	2752
query39	876	817	810	810
query40	298	117	114	114
query41	48	48	48	48
query42	125	99	104	99
query43	468	423	425	423
query44	1181	724	725	724
query45	213	185	181	181
query46	1081	834	817	817
query47	1799	1694	1734	1694
query48	368	302	297	297
query49	1197	436	430	430
query50	884	438	441	438
query51	6753	6686	6754	6686
query52	101	101	90	90
query53	252	183	184	183
query54	659	460	463	460
query55	85	79	80	79
query56	296	266	276	266
query57	1159	1046	1042	1042
query58	295	273	301	273
query59	2775	2521	2389	2389
query60	306	294	299	294
query61	124	115	232	115
query62	919	656	674	656
query63	218	182	199	182
query64	5909	1935	1902	1902
query65	3202	3104	3093	3093
query66	1437	332	358	332
query67	15410	14909	14836	14836
query68	6794	575	585	575
query69	743	393	312	312
query70	1132	1082	1066	1066
query71	552	289	271	271
query72	8090	2688	2500	2500
query73	950	328	336	328
query74	6051	5603	5620	5603
query75	4622	2697	2722	2697
query76	5263	1255	1291	1255
query77	753	319	308	308
query78	9499	8973	8859	8859
query79	3709	532	536	532
query80	1748	509	513	509
query81	562	229	229	229
query82	781	138	136	136
query83	288	180	182	180
query84	280	78	81	78
query85	1478	316	304	304
query86	426	271	290	271
query87	3359	3078	3101	3078
query88	3848	2436	2418	2418
query89	449	307	281	281
query90	2049	191	193	191
query91	132	100	101	100
query92	63	50	49	49
query93	4804	607	624	607
query94	985	295	286	286
query95	371	269	261	261
query96	621	278	281	278
query97	3229	3059	3078	3059
query98	215	203	195	195
query99	1630	1277	1278	1277
Total cold run time: 279041 ms
Total hot run time: 169321 ms

doris-robot commented Aug 1, 2024

ClickBench: Total hot run time: 30.31 s

machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 05197bca9a957d0681ad2cfedff8e690d95bee89, data reload: false
query1	0.05	0.04	0.04
query2	0.08	0.04	0.04
query3	0.23	0.05	0.05
query4	1.69	0.07	0.07
query5	0.50	0.48	0.48
query6	1.13	0.71	0.71
query7	0.02	0.02	0.02
query8	0.05	0.04	0.04
query9	0.56	0.51	0.51
query10	0.57	0.55	0.56
query11	0.16	0.12	0.12
query12	0.15	0.13	0.12
query13	0.63	0.61	0.60
query14	0.78	0.81	0.79
query15	0.90	0.87	0.87
query16	0.36	0.35	0.35
query17	1.01	0.98	0.97
query18	0.23	0.22	0.21
query19	1.83	1.74	1.76
query20	0.01	0.02	0.01
query21	15.41	0.77	0.66
query22	3.98	7.07	1.61
query23	18.10	1.25	1.27
query24	2.25	0.22	0.22
query25	0.18	0.09	0.07
query26	0.32	0.23	0.23
query27	0.46	0.24	0.23
query28	13.16	1.00	0.96
query29	12.52	3.31	3.32
query30	0.26	0.06	0.06
query31	2.87	0.42	0.40
query32	3.24	0.49	0.50
query33	2.98	2.96	2.96
query34	15.44	4.26	4.22
query35	4.33	4.27	4.27
query36	0.68	0.47	0.48
query37	0.19	0.15	0.17
query38	0.16	0.16	0.16
query39	0.04	0.04	0.04
query40	0.16	0.13	0.14
query41	0.10	0.05	0.04
query42	0.05	0.05	0.05
query43	0.05	0.04	0.04
Total cold run time: 107.87 s
Total hot run time: 30.31 s

gavinchou requested changes

View reviewed changes

cloud/src/meta-service/meta_service_resource.cpp Outdated

fe/fe-core/src/main/java/org/apache/doris/catalog/HdfsStorageVault.java Outdated

  public static final String HDFS_PREFIX = "hdfs:";
  public static final String HDFS_FILE_PREFIX = "hdfs://";
+ public static final HashSet<String> ALTER_CHECK_PROPERTIES = new HashSet<>(Arrays.asList(

gavinchouAug 8, 2024

Contributor

for hdfs, only name and passwd can be altered

ByteYueAug 8, 2024•
edited
Loading

ContributorAuthor

What if the users tried to add more properties?

gavinchouAug 13, 2024•
edited
Loading

Contributor

forbid
comment why forbid

cloud/src/meta-service/meta_service_resource.cpp Outdated

cloud/src/meta-service/meta_service_resource.cpp Outdated

cloud/src/meta-service/meta_service_resource.cpp

cloud/src/meta-service/meta_service_resource.cpp Outdated

cloud/src/meta-service/meta_service_resource.cpp Outdated

cloud/src/meta-service/meta_service_resource.cpp

cloud/src/meta-service/meta_service_resource.cpp

github-actionsBot reviewed

View reviewed changes

github-actionsBot left a comment

Contributor

clang-tidy made some suggestions

alter s3 name

b68cba9

pass path format
case ok
resolve comment
add ut

ByteYue force-pushed the support_rename_vault branch from 2b6553a to b68cba9Compare

August 9, 2024 09:00

format

dd90d5f

github-actionsBot reviewed

View reviewed changes

github-actionsBot left a comment

Contributor

clang-tidy made some suggestions

cloud/test/meta_service_test.cpp

cloud/test/meta_service_test.cpp

ByteYue requested a review from gavinchou

August 9, 2024 09:08

github-actionsBot reviewed

View reviewed changes

github-actionsBot left a comment

Contributor

clang-tidy made some suggestions

cloud/test/meta_service_test.cpp

ByteYue commented Aug 9, 2024

ContributorAuthor

run buildall

apache deleted a comment from github-actionsBot

apache deleted a comment from github-actionsBot

gavinchou requested changes

View reviewed changes

cloud/src/meta-service/meta_service_resource.cpp

cloud/src/meta-service/meta_service_resource.cpp Outdated

doris-robot commented Aug 9, 2024

TPC-H: Total hot run time: 39858 ms

machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit dd90d5f1522fc41b2514b2ac17d1cffe4f2a2ab0, data reload: false
------ Round 1 ----------------------------------
q1	18381	4507	4313	4313
q2	2028	176	173	173
q3	10552	1202	1129	1129
q4	10156	789	821	789
q5	7518	2563	2564	2563
q6	228	143	144	143
q7	980	620	584	584
q8	9212	1905	1945	1905
q9	8759	6601	6611	6601
q10	7053	2213	2189	2189
q11	462	241	257	241
q12	412	225	217	217
q13	17773	2991	2980	2980
q14	284	247	241	241
q15	524	485	487	485
q16	503	384	386	384
q17	972	747	702	702
q18	8240	7594	7395	7395
q19	4313	1079	1072	1072
q20	648	319	345	319
q21	5359	4424	4680	4424
q22	1126	1014	1009	1009
Total cold run time: 115483 ms
Total hot run time: 39858 ms
----- Round 2, with runtime_filter_mode=off -----
q1	4470	4284	4260	4260
q2	373	271	285	271
q3	2902	2629	2778	2629
q4	2068	1736	1720	1720
q5	5647	5547	5447	5447
q6	218	135	139	135
q7	2163	1841	1816	1816
q8	3277	3433	3484	3433
q9	8913	8927	8822	8822
q10	3600	3260	3219	3219
q11	587	516	505	505
q12	823	620	664	620
q13	17184	3216	3165	3165
q14	319	278	284	278
q15	530	499	490	490
q16	498	457	433	433
q17	1826	1557	1522	1522
q18	8210	7982	7815	7815
q19	1743	1716	1630	1630
q20	2140	1866	1909	1866
q21	5713	5461	5440	5440
q22	1134	1083	1078	1078
Total cold run time: 74338 ms
Total hot run time: 56594 ms

doris-robot commented Aug 9, 2024

TPC-DS: Total hot run time: 201616 ms

machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit dd90d5f1522fc41b2514b2ac17d1cffe4f2a2ab0, data reload: false
query1	910	377	355	355
query2	6375	1903	1830	1830
query3	6651	204	213	204
query4	34140	23456	23166	23166
query5	3687	483	481	481
query6	273	165	158	158
query7	4579	287	284	284
query8	238	205	205	205
query9	8520	2476	2436	2436
query10	525	473	455	455
query11	16534	15073	14872	14872
query12	139	97	97	97
query13	1655	372	369	369
query14	10274	7810	7587	7587
query15	274	210	229	210
query16	7680	516	502	502
query17	1729	581	561	561
query18	1969	303	306	303
query19	211	153	152	152
query20	117	113	125	113
query21	218	110	104	104
query22	4749	4476	4393	4393
query23	34391	33838	33451	33451
query24	10558	2643	2586	2586
query25	596	426	400	400
query26	710	163	160	160
query27	2163	294	298	294
query28	5938	2042	2037	2037
query29	811	420	501	420
query30	266	149	149	149
query31	975	742	728	728
query32	95	55	55	55
query33	620	276	283	276
query34	858	456	465	456
query35	946	831	799	799
query36	1096	940	932	932
query37	132	79	81	79
query38	4176	4191	4157	4157
query39	1431	1349	1374	1349
query40	198	114	117	114
query41	44	45	43	43
query42	112	96	96	96
query43	496	453	469	453
query44	1058	720	726	720
query45	236	207	209	207
query46	1086	737	715	715
query47	1807	1774	1761	1761
query48	362	305	294	294
query49	831	413	423	413
query50	801	411	401	401
query51	6978	6761	6688	6688
query52	103	89	88	88
query53	252	182	178	178
query54	851	443	439	439
query55	76	73	74	73
query56	257	242	244	242
query57	1156	1091	1102	1091
query58	223	226	244	226
query59	2784	2614	2691	2614
query60	301	263	264	263
query61	94	94	94	94
query62	767	635	634	634
query63	206	183	179	179
query64	9108	2259	1753	1753
query65	3173	3129	3156	3129
query66	764	324	319	319
query67	15827	14825	14838	14825
query68	6222	539	536	536
query69	450	410	423	410
query70	1169	1136	1067	1067
query71	488	273	266	266
query72	20063	17039	16729	16729
query73	800	327	327	327
query74	9017	8717	8800	8717
query75	4636	2671	2635	2635
query76	3689	1033	945	945
query77	785	315	308	308
query78	10725	9102	8980	8980
query79	6668	512	517	512
query80	1111	494	491	491
query81	592	227	218	218
query82	777	143	139	139
query83	285	200	143	143
query84	276	76	75	75
query85	1371	270	261	261
query86	433	299	259	259
query87	4702	4586	4456	4456
query88	4863	2493	2478	2478
query89	430	285	284	284
query90	1981	188	196	188
query91	116	96	97	96
query92	61	49	49	49
query93	5687	532	527	527
query94	931	326	292	292
query95	357	255	256	255
query96	613	273	273	273
query97	3245	3085	3045	3045
query98	225	201	196	196
query99	1668	1274	1242	1242
Total cold run time: 321596 ms
Total hot run time: 201616 ms

doris-robot commented Aug 9, 2024

ClickBench: Total hot run time: 30.34 s

machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit dd90d5f1522fc41b2514b2ac17d1cffe4f2a2ab0, data reload: false
query1	0.04	0.04	0.04
query2	0.08	0.04	0.05
query3	0.23	0.05	0.05
query4	1.68	0.08	0.07
query5	0.50	0.50	0.48
query6	1.13	0.72	0.73
query7	0.02	0.02	0.01
query8	0.04	0.04	0.04
query9	0.55	0.49	0.50
query10	0.53	0.54	0.55
query11	0.16	0.12	0.12
query12	0.15	0.12	0.12
query13	0.61	0.58	0.58
query14	0.75	0.77	0.77
query15	0.85	0.82	0.81
query16	0.37	0.37	0.37
query17	0.99	1.02	1.05
query18	0.24	0.23	0.22
query19	1.88	1.69	1.68
query20	0.01	0.01	0.02
query21	15.39	0.77	0.68
query22	4.72	6.00	1.66
query23	18.25	1.42	1.18
query24	2.09	0.22	0.21
query25	0.14	0.08	0.08
query26	0.29	0.23	0.22
query27	0.45	0.22	0.22
query28	13.33	1.02	1.01
query29	12.62	3.33	3.32
query30	0.24	0.06	0.05
query31	2.88	0.39	0.38
query32	3.29	0.49	0.48
query33	2.91	2.92	2.87
query34	16.99	4.39	4.36
query35	4.43	4.43	4.40
query36	0.66	0.47	0.48
query37	0.19	0.16	0.16
query38	0.15	0.15	0.15
query39	0.05	0.03	0.04
query40	0.14	0.11	0.13
query41	0.10	0.04	0.04
query42	0.06	0.05	0.04
query43	0.04	0.04	0.04
Total cold run time: 110.22 s
Total hot run time: 30.34 s

add ut

7aa1f97

github-actionsBot commented Aug 13, 2024

Contributor

PR approved by at least one committer and no changes requested.

github-actionsBot added the approved label

github-actionsBot commented Aug 13, 2024

Contributor

PR approved by anyone and no changes requested.

github-actionsBot added the reviewed label

resolve

9fa7542

ByteYue dismissed gavinchou’s stale review via 9fa7542

August 13, 2024 03:32

ByteYue commented Aug 13, 2024

ContributorAuthor

run buildall

github-actionsBot removed the approved label

doris-robot commented Aug 13, 2024

TPC-H: Total hot run time: 39919 ms

machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 9fa75425c729f74232a88ab246ffb8215699eac7, data reload: false
------ Round 1 ----------------------------------
q1	18160	4502	4314	4314
q2	2026	184	183	183
q3	11938	1006	1066	1006
q4	10504	704	699	699
q5	7741	2849	2787	2787
q6	233	139	137	137
q7	953	594	589	589
q8	9326	2065	2072	2065
q9	8688	6565	6552	6552
q10	7010	2243	2187	2187
q11	440	255	238	238
q12	388	221	227	221
q13	17770	2974	2969	2969
q14	293	237	232	232
q15	534	486	495	486
q16	487	393	383	383
q17	972	778	759	759
q18	8068	7553	7399	7399
q19	7633	987	1164	987
q20	707	330	331	330
q21	5487	4411	4507	4411
q22	1106	998	985	985
Total cold run time: 120464 ms
Total hot run time: 39919 ms
----- Round 2, with runtime_filter_mode=off -----
q1	4481	4282	4295	4282
q2	383	257	273	257
q3	2969	2784	2846	2784
q4	2004	1725	1708	1708
q5	5601	5588	5631	5588
q6	260	139	134	134
q7	2200	1789	1774	1774
q8	3369	3451	3425	3425
q9	8802	8963	8913	8913
q10	3403	3199	3305	3199
q11	608	528	501	501
q12	831	668	638	638
q13	16050	3147	3187	3147
q14	339	311	303	303
q15	533	499	500	499
q16	498	452	437	437
q17	1818	1513	1521	1513
q18	8087	8102	7776	7776
q19	1818	1435	1639	1435
q20	3150	1900	1871	1871
q21	8018	5140	5407	5140
q22	1155	1047	1037	1037
Total cold run time: 76377 ms
Total hot run time: 56361 ms

ByteYue requested a review from gavinchou

August 13, 2024 04:59

doris-robot commented Aug 13, 2024

TPC-DS: Total hot run time: 189400 ms

machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 9fa75425c729f74232a88ab246ffb8215699eac7, data reload: false
query1	1258	875	865	865
query2	6346	1949	1958	1949
query3	10619	3971	3711	3711
query4	58947	23938	23154	23154
query5	6006	505	484	484
query6	506	173	173	173
query7	6476	306	289	289
query8	308	195	197	195
query9	9028	2399	2388	2388
query10	515	280	249	249
query11	18792	14940	15055	14940
query12	159	103	107	103
query13	1608	394	385	385
query14	12682	7151	7752	7151
query15	274	166	177	166
query16	7812	532	465	465
query17	1175	655	551	551
query18	2173	297	317	297
query19	268	153	149	149
query20	121	109	106	106
query21	216	120	101	101
query22	4459	4426	4300	4300
query23	33943	33815	33168	33168
query24	5563	2848	2903	2848
query25	527	374	387	374
query26	677	162	163	162
query27	1787	276	271	271
query28	3759	2031	2041	2031
query29	716	399	407	399
query30	271	153	144	144
query31	938	753	735	735
query32	105	52	54	52
query33	487	290	270	270
query34	848	457	472	457
query35	798	728	752	728
query36	1047	923	935	923
query37	135	79	78	78
query38	3911	3806	3840	3806
query39	1503	1374	1372	1372
query40	202	116	116	116
query41	43	43	40	40
query42	118	97	94	94
query43	505	468	458	458
query44	1057	733	738	733
query45	194	160	162	160
query46	1089	747	736	736
query47	1843	1763	1778	1763
query48	369	295	303	295
query49	755	408	421	408
query50	795	419	399	399
query51	6770	6679	6678	6678
query52	106	88	92	88
query53	252	185	185	185
query54	553	446	435	435
query55	74	72	76	72
query56	260	238	255	238
query57	1134	1034	1052	1034
query58	230	230	222	222
query59	2865	2734	2803	2734
query60	301	274	290	274
query61	121	117	113	113
query62	734	631	658	631
query63	220	184	186	184
query64	9185	2421	1712	1712
query65	3148	3158	3207	3158
query66	701	335	341	335
query67	15225	14751	14681	14681
query68	4811	556	551	551
query69	422	289	277	277
query70	1214	1097	1082	1082
query71	492	276	271	271
query72	6981	2284	1914	1914
query73	759	325	327	325
query74	9297	8772	8777	8772
query75	3392	2716	2765	2716
query76	2816	1051	889	889
query77	551	304	308	304
query78	9542	9036	9004	9004
query79	2917	533	523	523
query80	1950	490	501	490
query81	564	224	222	222
query82	745	143	140	140
query83	266	150	146	146
query84	283	77	83	77
query85	1551	276	274	274
query86	500	305	311	305
query87	4567	4259	4384	4259
query88	4697	2426	2473	2426
query89	432	292	287	287
query90	1876	205	197	197
query91	120	95	97	95
query92	65	52	51	51
query93	4774	551	541	541
query94	858	282	295	282
query95	357	255	259	255
query96	614	285	274	274
query97	3182	3060	3045	3045
query98	231	223	197	197
query99	1756	1244	1276	1244
Total cold run time: 328194 ms
Total hot run time: 189400 ms

doris-robot commented Aug 13, 2024

ClickBench: Total hot run time: 31.01 s

machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 9fa75425c729f74232a88ab246ffb8215699eac7, data reload: false
query1	0.04	0.04	0.04
query2	0.08	0.04	0.04
query3	0.22	0.05	0.05
query4	1.66	0.08	0.08
query5	0.50	0.49	0.49
query6	1.13	0.72	0.73
query7	0.02	0.02	0.01
query8	0.04	0.04	0.05
query9	0.55	0.49	0.48
query10	0.53	0.53	0.55
query11	0.16	0.12	0.11
query12	0.15	0.12	0.12
query13	0.61	0.60	0.59
query14	0.75	0.81	0.76
query15	0.86	0.82	0.81
query16	0.37	0.36	0.38
query17	1.04	1.05	1.04
query18	0.23	0.21	0.22
query19	1.90	1.64	1.73
query20	0.02	0.01	0.00
query21	15.39	0.80	0.66
query22	4.83	6.40	2.28
query23	18.33	1.36	1.33
query24	2.09	0.23	0.22
query25	0.15	0.08	0.07
query26	0.30	0.22	0.21
query27	0.46	0.22	0.22
query28	13.28	1.01	0.99
query29	12.64	3.30	3.35
query30	0.24	0.05	0.04
query31	2.88	0.40	0.38
query32	3.26	0.49	0.48
query33	3.01	2.94	3.00
query34	16.95	4.38	4.33
query35	4.39	4.38	4.37
query36	0.64	0.51	0.47
query37	0.19	0.16	0.16
query38	0.15	0.16	0.15
query39	0.05	0.03	0.04
query40	0.15	0.13	0.13
query41	0.10	0.05	0.05
query42	0.06	0.05	0.05
query43	0.04	0.03	0.04
Total cold run time: 110.44 s
Total hot run time: 31.01 s

gavinchou approved these changes

View reviewed changes

github-actionsBot commented Aug 13, 2024

Contributor

PR approved by at least one committer and no changes requested.

github-actionsBot added the approved label

bobhan1 approved these changes

View reviewed changes

gavinchou merged commit 2669edc into apache:master

gavinchou added the dev/3.0.x label

wyxxxcat pushed a commit to wyxxxcat/doris that referenced this pull request

[feature](Vault) Support alter hdfs storage vault and alter vault's n…

27cc7fa

…ame (apache#38685)
Previously only s3 vault can be altered. This pr adds support of hdfs
storage vault. And this pr also supports to alter vault's name.
usage example
```
ALTER STORAGE VAULT alter_s3_vault
PROPERTIES (
"type"="S3",
"s3.access_key" = "new_ak", -- change ak
"s3.secrete_key" = "new_ak", -- change sk
);
ALTER STORAGE VAULT alter_hdfs_vault
PROPERTIES (
"type"="hdfs",
"VAULT_NAME" = "alter_hdfs_vault_new_name", -- change vault name
"hadoop.username" = "hdfs" -- change user name
);
```

dataroaring added dev/3.0.2-merged dev/3.0.x and removed dev/3.0.x labels

dataroaring added dev/3.0.x and removed dev/3.0.2-merged labels

gavinchou pushed a commit that referenced this pull request

[feature](Vault) Support alter hdfs storage vault and alter vault's n…

5e4f83a

…ame (#38685)
Previously only s3 vault can be altered. This pr adds support of hdfs
storage vault. And this pr also supports to alter vault's name.
usage example
```
ALTER STORAGE VAULT alter_s3_vault
PROPERTIES (
"type"="S3",
"s3.access_key" = "new_ak", -- change ak
"s3.secrete_key" = "new_ak", -- change sk
);
ALTER STORAGE VAULT alter_hdfs_vault
PROPERTIES (
"type"="hdfs",
"VAULT_NAME" = "alter_hdfs_vault_new_name", -- change vault name
"hadoop.username" = "hdfs" -- change user name
);
```

gavinchou added dev/3.0.2-merged and removed dev/3.0.x labels

gavinchou mentioned this pull request

Release Note 3.0.2 #41558

Closed

HappenLee pushed a commit to HappenLee/incubator-doris that referenced this pull request

[feature](Vault) Support alter hdfs storage vault and alter vault's n…

656daf6

…ame (apache#38685)
Previously only s3 vault can be altered. This pr adds support of hdfs
storage vault. And this pr also supports to alter vault's name.
usage example
```
ALTER STORAGE VAULT alter_s3_vault
PROPERTIES (
"type"="S3",
"s3.access_key" = "new_ak", -- change ak
"s3.secrete_key" = "new_ak", -- change sk
);
ALTER STORAGE VAULT alter_hdfs_vault
PROPERTIES (
"type"="hdfs",
"VAULT_NAME" = "alter_hdfs_vault_new_name", -- change vault name
"hadoop.username" = "hdfs" -- change user name
);
```

Sign up for freeto join this conversation on GitHub. Already have an account? Sign in to comment