Skip to content

[opt](iceberg) support glue rest catalog with s3tables - #54385

Merged
morningman merged 7 commits into
apache:masterfrom
morningman:glue_rest
Aug 8, 2025
Merged

[opt](iceberg) support glue rest catalog with s3tables#54385
morningman merged 7 commits into
apache:masterfrom
morningman:glue_rest

Conversation

@morningman

@morningmanmorningman commented Aug 6, 2025•
edited
Loading

Copy link
Copy Markdown
Contributor

What problem does this PR solve?

CREATE CATALOG glue_s3 PROPERTIES (
'type' = 'iceberg',
'iceberg.catalog.type' = 'rest',
'iceberg.rest.uri' = 'https://glue.ap-east-1.amazonaws.com/iceberg',
'iceberg.rest.warehouse' = '<account_id>:s3tablescatalog/s3-table-bucket-hk-glue-test',
"iceberg.rest.sigv4-enabled" = "true",
"iceberg.rest.signing-name" = "glue",
"iceberg.rest.access-key-id" = "ak",
"iceberg.rest.secret-access-key" = "sk",
"iceberg.rest.signing-region" = "ap-east-1"
);

Release note

None

Check List (For Author)

  • Test

    • Regression test
    • Unit Test
    • Manual test (add detailed scripts or steps below)
    • No need to test or manual test. Explain why:
      • This is a refactor/code format and no logic has been changed.
      • Previous test can cover this change.
      • No code files have been changed.
      • Other reason

  • Behavior changed:

    • No.
    • Yes.

  • Does this need documentation?

Check List (For Reviewer who merge this PR)

  • Confirm the release note
  • Confirm test cases
  • Confirm document
  • Add branch pick label

@morningman
1
9f32edc
2
3
1
1
1
1
5
1
@Thearas

Thearas commented Aug 6, 2025

Copy link
Copy Markdown
Contributor

Thank you for your contribution to Apache Doris.
Don't know what should be done next? See How to process your PR.

Please clearly describe your PR:

  1. What problem was fixed (it's best to include specific error reporting information). How it was fixed.
  2. Which behaviors were modified. What was the previous behavior, what is it now, why was it modified, and what possible impacts might there be.
  3. What features were added. Why was this function added?
  4. Which code was refactored and why was this part of the code refactored?
  5. Which functions were optimized and what is the difference before and after the optimization?

CalvinKirs
CalvinKirs previously approved these changes Aug 6, 2025
View reviewed changes
@github-actionsgithub-actionsBot added the approved Indicates a PR has been approved by one committer. label Aug 6, 2025
@github-actions

github-actionsBot commented Aug 6, 2025

Copy link
Copy Markdown
Contributor

PR approved by at least one committer and no changes requested.

@github-actions

github-actionsBot commented Aug 6, 2025

Copy link
Copy Markdown
Contributor

PR approved by anyone and no changes requested.

zy-kkk
zy-kkk previously approved these changes Aug 6, 2025
View reviewed changes
@morningman
morningman dismissed stale reviews from zy-kkk and CalvinKirs via 08a1f22August 6, 2025 17:38
@github-actionsgithub-actionsBot removed the approved Indicates a PR has been approved by one committer. label Aug 6, 2025
@morningman

morningman commented Aug 6, 2025

Copy link
Copy Markdown
ContributorAuthor

run buildall

@doris-robot

doris-robot commented Aug 6, 2025

Copy link
Copy Markdown
TPC-H: Total hot run time: 33466 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 35a21fc95380e963da9c65b793cf7bd816eb8209, data reload: false
------ Round 1 ----------------------------------
q1	17616	5325	5244	5244
q2	1914	309	188	188
q3	10279	1299	686	686
q4	10218	965	494	494
q5	7516	2351	2211	2211
q6	178	167	132	132
q7	902	728	625	625
q8	9288	1265	1068	1068
q9	6678	5026	5132	5026
q10	6914	2342	2001	2001
q11	459	275	267	267
q12	348	354	217	217
q13	17770	3418	2949	2949
q14	225	234	210	210
q15	523	460	457	457
q16	416	412	375	375
q17	576	833	345	345
q18	7378	7070	6935	6935
q19	2616	974	552	552
q20	330	306	218	218
q21	3340	3032	2253	2253
q22	1048	1016	1013	1013
Total cold run time: 106532 ms
Total hot run time: 33466 ms
----- Round 2, with runtime_filter_mode=off -----
q1	5408	5311	5256	5256
q2	229	301	215	215
q3	2049	2561	2142	2142
q4	1292	1702	1383	1383
q5	4082	4286	4449	4286
q6	223	176	140	140
q7	1979	2039	1778	1778
q8	2510	2446	2362	2362
q9	7432	7112	7224	7112
q10	3077	3361	2994	2994
q11	545	508	492	492
q12	698	737	613	613
q13	3592	3672	3040	3040
q14	295	308	293	293
q15	482	462	465	462
q16	504	551	445	445
q17	1158	1400	1332	1332
q18	7922	7627	7853	7627
q19	13813	946	859	859
q20	2863	2069	1745	1745
q21	14871	4258	4212	4212
q22	1057	1059	965	965
Total cold run time: 76081 ms
Total hot run time: 49753 ms

@doris-robot

doris-robot commented Aug 6, 2025

Copy link
Copy Markdown
TPC-DS: Total hot run time: 170847 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 35a21fc95380e963da9c65b793cf7bd816eb8209, data reload: false
============================================
query1	989	387	403	387
query2	6557	1875	1681	1681
query3	6748	222	221	221
query4	27314	23748	23178	23178
query5	4417	664	510	510
query6	330	238	219	219
query7	4675	541	294	294
query8	290	243	239	239
query9	8951	3024	3049	3024
query10	483	363	303	303
query11	16134	15014	14862	14862
query12	187	135	138	135
query13	1667	556	416	416
query14	8606	5849	5759	5759
query15	212	189	179	179
query16	7142	649	481	481
query17	985	800	652	652
query18	1997	434	333	333
query19	225	212	196	196
query20	156	151	145	145
query21	220	126	116	116
query22	4017	4105	3870	3870
query23	34473	34288	34351	34288
query24	5177	2374	2398	2374
query25	494	491	437	437
query26	716	288	161	161
query27	2269	503	350	350
query28	3034	2330	2309	2309
query29	622	637	483	483
query30	303	234	204	204
query31	871	787	713	713
query32	86	77	80	77
query33	489	432	382	382
query34	845	853	513	513
query35	786	845	741	741
query36	1013	1040	952	952
query37	133	108	101	101
query38	3885	3929	3886	3886
query39	1449	1383	1368	1368
query40	242	148	145	145
query41	79	61	54	54
query42	141	116	128	116
query43	508	512	483	483
query44	1383	877	854	854
query45	202	190	183	183
query46	944	1054	665	665
query47	1797	1826	1743	1743
query48	413	433	329	329
query49	684	501	410	410
query50	661	687	409	409
query51	4137	4143	4070	4070
query52	131	126	115	115
query53	255	298	211	211
query54	644	633	555	555
query55	93	89	88	88
query56	357	358	347	347
query57	1202	1198	1141	1141
query58	337	330	334	330
query59	2620	2704	2594	2594
query60	400	386	377	377
query61	153	120	119	119
query62	764	722	637	637
query63	251	216	212	212
query64	2344	1179	771	771
query65	4256	4148	4142	4142
query66	1073	464	332	332
query67	query68	16661	877	855	855
query69	1108	289	296	289
query70	1435	1095	1117	1095
query71	718	316	320	316
query72	9139	2298	2246	2246
query73	3468	683	360	360
query74	9042	9066	8810	8810
query75	7405	3163	2680	2680
query76	8771	1217	771	771
query77	1152	399	344	344
query78	9581	11886	10040	10040
query79	15353	604	573	573
query80	2449	566	493	493
query81	584	262	224	224
query82	509	157	117	117
query83	463	287	276	276
query84	309	94	86	86
query85	885	451	343	343
query86	369	304	310	304
query87	4293	4194	4084	4084
query88	5616	2203	2232	2203
query89	495	376	310	310
query90	2535	231	227	227
query91	143	139	111	111
query92	88	72	68	68
query93	6366	993	656	656
query94	1107	398	280	280
query95	416	334	323	323
query96	514	582	287	287
query97	2709	2744	2576	2576
query98	242	225	224	224
query99	1504	1352	1305	1305
Total cold run time: 300447 ms
Total hot run time: 170847 ms

@doris-robot

doris-robot commented Aug 6, 2025

Copy link
Copy Markdown
ClickBench: Total hot run time: 32.98 s
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 35a21fc95380e963da9c65b793cf7bd816eb8209, data reload: false
query1	0.05	0.04	0.04
query2	0.07	0.04	0.04
query3	0.25	0.07	0.07
query4	1.62	0.10	0.11
query5	0.42	0.41	0.41
query6	1.16	0.64	0.65
query7	0.02	0.01	0.02
query8	0.04	0.04	0.03
query9	0.57	0.49	0.47
query10	0.52	0.52	0.53
query11	0.16	0.10	0.11
query12	0.14	0.12	0.12
query13	0.64	0.64	0.63
query14	0.89	1.07	1.07
query15	0.96	0.88	0.87
query16	0.39	0.39	0.39
query17	1.09	1.07	1.05
query18	0.22	0.21	0.21
query19	1.92	1.81	1.80
query20	0.02	0.01	0.01
query21	15.39	0.82	0.54
query22	0.74	1.13	0.73
query23	14.92	1.13	0.64
query24	6.93	1.10	0.65
query25	0.51	0.22	0.09
query26	0.61	0.16	0.13
query27	0.05	0.06	0.06
query28	9.49	0.86	0.43
query29	12.57	3.77	3.30
query30	3.03	3.00	2.95
query31	2.81	0.56	0.39
query32	3.24	0.56	0.51
query33	3.04	3.20	3.25
query34	16.15	5.43	4.94
query35	4.86	4.96	4.95
query36	0.69	0.53	0.52
query37	0.10	0.07	0.07
query38	0.06	0.05	0.04
query39	0.03	0.02	0.03
query40	0.17	0.14	0.15
query41	0.09	0.03	0.03
query42	0.03	0.03	0.03
query43	0.04	0.04	0.04
Total cold run time: 106.7 s
Total hot run time: 32.98 s

@morningman

morningman commented Aug 7, 2025

Copy link
Copy Markdown
ContributorAuthor

run buildall

@doris-robot

doris-robot commented Aug 7, 2025

Copy link
Copy Markdown
TPC-H: Total hot run time: 33477 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit c6ee5b86a072dc2aac9ce70002110019da60c1ed, data reload: false
------ Round 1 ----------------------------------
q1	17575	5313	5244	5244
q2	1957	270	186	186
q3	10290	1248	698	698
q4	10232	985	503	503
q5	7531	2311	2223	2223
q6	177	160	127	127
q7	888	761	598	598
q8	9300	1234	1054	1054
q9	6828	5045	5045	5045
q10	6917	2360	1952	1952
q11	449	276	267	267
q12	349	362	213	213
q13	17775	3443	2987	2987
q14	229	238	217	217
q15	518	467	463	463
q16	416	427	371	371
q17	557	810	366	366
q18	7665	7041	6862	6862
q19	1030	975	550	550
q20	316	310	214	214
q21	2758	3020	2352	2352
q22	1030	1045	985	985
Total cold run time: 104787 ms
Total hot run time: 33477 ms
----- Round 2, with runtime_filter_mode=off -----
q1	5346	5406	5318	5318
q2	229	312	219	219
q3	2111	2583	2219	2219
q4	1307	1744	1322	1322
q5	4093	4130	4525	4130
q6	215	172	133	133
q7	1959	1941	1856	1856
q8	2475	2545	2512	2512
q9	7301	7212	7423	7212
q10	3172	3351	2831	2831
q11	548	497	503	497
q12	711	752	616	616
q13	3601	3689	3105	3105
q14	282	302	286	286
q15	524	446	455	446
q16	451	537	466	466
q17	1264	1459	1386	1386
q18	13302	8535	7479	7479
q19	14231	970	1017	970
q20	2080	2038	1873	1873
q21	16167	4446	4302	4302
q22	1043	1034	1011	1011
Total cold run time: 82412 ms
Total hot run time: 50189 ms

@doris-robot

doris-robot commented Aug 7, 2025

Copy link
Copy Markdown
TPC-DS: Total hot run time: 170179 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit c6ee5b86a072dc2aac9ce70002110019da60c1ed, data reload: false
============================================
query1	1007	382	419	382
query2	6529	1879	1698	1698
query3	6739	221	221	221
query4	26830	23624	23440	23440
query5	4297	620	537	537
query6	336	253	240	240
query7	4643	524	296	296
query8	283	240	235	235
query9	8669	2989	2980	2980
query10	505	341	319	319
query11	15745	15300	14768	14768
query12	186	135	130	130
query13	1659	564	432	432
query14	8697	5818	5838	5818
query15	214	192	167	167
query16	7845	648	498	498
query17	1640	796	649	649
query18	2114	449	328	328
query19	299	212	185	185
query20	152	141	146	141
query21	222	126	105	105
query22	3901	4140	3821	3821
query23	34305	34256	34266	34256
query24	8025	2385	2399	2385
query25	542	507	437	437
query26	945	293	156	156
query27	2631	491	342	342
query28	4274	2331	2317	2317
query29	692	581	494	494
query30	300	235	189	189
query31	886	838	731	731
query32	90	77	80	77
query33	569	437	354	354
query34	813	835	511	511
query35	814	901	734	734
query36	1040	1017	935	935
query37	138	111	97	97
query38	3946	3963	3841	3841
query39	1457	1363	1359	1359
query40	244	142	134	134
query41	62	61	54	54
query42	143	121	124	121
query43	513	517	457	457
query44	1396	873	868	868
query45	197	190	179	179
query46	953	1066	663	663
query47	1813	1846	1781	1781
query48	399	420	310	310
query49	699	514	413	413
query50	666	682	403	403
query51	4217	4227	4131	4131
query52	134	125	114	114
query53	262	295	222	222
query54	689	646	565	565
query55	94	88	85	85
query56	364	390	344	344
query57	1193	1208	1128	1128
query58	334	335	328	328
query59	2638	2783	2521	2521
query60	407	405	397	397
query61	128	127	124	124
query62	804	775	650	650
query63	252	212	220	212
query64	3495	1104	778	778
query65	4217	4078	4100	4078
query66	1043	443	328	328
query67	query68	17979	865	874	865
query69	1112	278	282	278
query70	1454	1031	1154	1031
query71	671	319	314	314
query72	9148	2296	2204	2204
query73	4120	688	360	360
query74	9364	8969	8579	8579
query75	7304	3123	2655	2655
query76	8471	1222	797	797
query77	1165	406	330	330
query78	9572	11500	9589	9589
query79	15396	609	569	569
query80	2038	560	511	511
query81	559	258	228	228
query82	493	196	116	116
query83	368	287	271	271
query84	311	101	83	83
query85	900	377	342	342
query86	356	337	312	312
query87	4227	4193	4142	4142
query88	5549	2179	2226	2179
query89	497	363	320	320
query90	2491	230	226	226
query91	145	140	113	113
query92	98	72	66	66
query93	6378	974	654	654
query94	1105	402	283	283
query95	428	329	320	320
query96	509	585	278	278
query97	2687	2746	2674	2674
query98	253	243	223	223
query99	1508	1425	1274	1274
Total cold run time: 307991 ms
Total hot run time: 170179 ms

@doris-robot

doris-robot commented Aug 7, 2025

Copy link
Copy Markdown
ClickBench: Total hot run time: 32.95 s
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit c6ee5b86a072dc2aac9ce70002110019da60c1ed, data reload: false
query1	0.04	0.03	0.04
query2	0.08	0.04	0.04
query3	0.25	0.07	0.07
query4	1.66	0.11	0.11
query5	0.42	0.42	0.43
query6	1.16	0.65	0.65
query7	0.02	0.01	0.02
query8	0.04	0.03	0.03
query9	0.56	0.47	0.46
query10	0.52	0.53	0.53
query11	0.16	0.10	0.11
query12	0.14	0.11	0.12
query13	0.65	0.63	0.63
query14	0.90	1.22	0.96
query15	0.96	0.89	0.91
query16	0.40	0.39	0.40
query17	1.02	1.09	1.10
query18	0.22	0.20	0.21
query19	2.03	1.92	1.80
query20	0.01	0.01	0.02
query21	15.38	0.85	0.54
query22	0.76	1.26	0.73
query23	14.90	1.20	0.60
query24	6.84	0.97	0.90
query25	0.51	0.19	0.09
query26	0.65	0.16	0.13
query27	0.05	0.05	0.06
query28	9.52	0.89	0.44
query29	12.56	3.79	3.30
query30	3.03	2.96	2.98
query31	2.83	0.58	0.40
query32	3.23	0.57	0.49
query33	3.03	3.09	3.28
query34	16.14	5.46	4.90
query35	4.84	5.00	4.96
query36	0.70	0.52	0.51
query37	0.10	0.08	0.07
query38	0.06	0.05	0.04
query39	0.03	0.02	0.03
query40	0.18	0.13	0.12
query41	0.09	0.03	0.03
query42	0.04	0.03	0.02
query43	0.04	0.04	0.03
Total cold run time: 106.75 s
Total hot run time: 32.95 s

@hello-stephen

hello-stephen commented Aug 7, 2025

Copy link
Copy Markdown
Contributor

FE UT Coverage Report

Increment line coverage 88.57% (31/35) 🎉
Increment coverage report
Complete coverage report

@morningman

morningman commented Aug 7, 2025

Copy link
Copy Markdown
ContributorAuthor

run buildall

@doris-robot

doris-robot commented Aug 7, 2025

Copy link
Copy Markdown
TPC-H: Total hot run time: 33458 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 118651612ea8bbef9abf811fe26d22262b64443c, data reload: false
------ Round 1 ----------------------------------
q1	17618	5309	5211	5211
q2	1956	299	189	189
q3	10266	1438	706	706
q4	10226	1015	498	498
q5	7504	2354	2286	2286
q6	179	166	132	132
q7	885	749	616	616
q8	9301	1298	1026	1026
q9	6778	4975	5028	4975
q10	6897	2325	1961	1961
q11	459	278	263	263
q12	353	361	235	235
q13	17771	3517	2954	2954
q14	235	248	227	227
q15	548	475	466	466
q16	430	427	375	375
q17	569	808	365	365
q18	7306	6912	6907	6907
q19	2753	985	554	554
q20	335	307	208	208
q21	3346	3055	2303	2303
q22	1052	1013	1001	1001
Total cold run time: 106767 ms
Total hot run time: 33458 ms
----- Round 2, with runtime_filter_mode=off -----
q1	5502	5280	5320	5280
q2	229	301	216	216
q3	2072	2568	2163	2163
q4	1277	1711	1310	1310
q5	4114	4462	4357	4357
q6	231	182	133	133
q7	1972	1863	1750	1750
q8	2551	2451	2453	2451
q9	7593	7579	7568	7568
q10	4470	3329	2912	2912
q11	542	496	468	468
q12	664	841	626	626
q13	3369	3648	3331	3331
q14	374	309	304	304
q15	496	476	477	476
q16	468	485	437	437
q17	1216	1565	1408	1408
q18	7817	7857	7884	7857
q19	9901	911	911	911
q20	3486	1969	1763	1763
q21	13533	4245	4377	4245
q22	1080	1004	946	946
Total cold run time: 72957 ms
Total hot run time: 50912 ms

@doris-robot

doris-robot commented Aug 7, 2025

Copy link
Copy Markdown
TPC-DS: Total hot run time: 170071 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 118651612ea8bbef9abf811fe26d22262b64443c, data reload: false
============================================
query1	985	384	437	384
query2	6518	1813	1677	1677
query3	6740	228	220	220
query4	27032	24005	23309	23309
query5	4292	654	503	503
query6	320	242	240	240
query7	4634	543	295	295
query8	279	244	235	235
query9	8568	2986	2900	2900
query10	487	354	303	303
query11	15898	15261	14742	14742
query12	184	143	141	141
query13	1660	553	421	421
query14	8732	5820	5872	5820
query15	218	202	184	184
query16	7138	700	470	470
query17	968	767	643	643
query18	1990	451	324	324
query19	229	217	184	184
query20	150	146	137	137
query21	225	134	114	114
query22	3925	3951	3852	3852
query23	34362	33984	34094	33984
query24	5068	2401	2384	2384
query25	501	523	430	430
query26	721	304	165	165
query27	2243	529	396	396
query28	3123	2314	2300	2300
query29	642	609	487	487
query30	287	243	196	196
query31	881	807	715	715
query32	91	74	82	74
query33	490	436	358	358
query34	834	888	523	523
query35	800	852	770	770
query36	1020	1045	936	936
query37	141	117	91	91
query38	3922	3987	3966	3966
query39	1452	1387	1355	1355
query40	245	143	136	136
query41	61	59	55	55
query42	146	124	126	124
query43	513	519	488	488
query44	1472	865	853	853
query45	195	192	180	180
query46	991	1107	670	670
query47	1791	1788	1741	1741
query48	413	448	316	316
query49	671	524	411	411
query50	705	711	421	421
query51	4163	4166	4160	4160
query52	125	129	120	120
query53	269	302	221	221
query54	659	641	554	554
query55	88	87	89	87
query56	372	358	345	345
query57	1178	1230	1122	1122
query58	336	342	324	324
query59	2741	2690	2532	2532
query60	407	406	393	393
query61	124	126	125	125
query62	766	745	648	648
query63	263	214	218	214
query64	2390	1106	778	778
query65	4249	4102	4149	4102
query66	1044	459	334	334
query67	query68	17454	1012	1149	1012
query69	1062	275	276	275
query70	1416	1115	1065	1065
query71	725	316	312	312
query72	9244	2343	2411	2343
query73	3367	660	351	351
query74	9030	9022	8483	8483
query75	7697	3171	2688	2688
query76	8820	1301	811	811
query77	1159	420	331	331
query78	9662	10468	9535	9535
query79	15058	606	589	589
query80	967	602	498	498
query81	539	256	229	229
query82	455	163	120	120
query83	304	296	272	272
query84	307	98	83	83
query85	904	374	344	344
query86	353	338	286	286
query87	4294	4169	4124	4124
query88	5585	2228	2228	2228
query89	493	367	310	310
query90	2534	229	226	226
query91	158	139	114	114
query92	95	74	70	70
query93	6297	1022	658	658
query94	1050	424	280	280
query95	429	339	326	326
query96	515	635	285	285
query97	2669	2721	2605	2605
query98	262	237	226	226
query99	1539	1412	1310	1310
Total cold run time: 298570 ms
Total hot run time: 170071 ms

@doris-robot

doris-robot commented Aug 7, 2025

Copy link
Copy Markdown
ClickBench: Total hot run time: 33.56 s
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 118651612ea8bbef9abf811fe26d22262b64443c, data reload: false
query1	0.04	0.03	0.03
query2	0.08	0.05	0.04
query3	0.25	0.07	0.09
query4	1.60	0.10	0.11
query5	0.43	0.46	0.42
query6	1.19	0.68	0.66
query7	0.03	0.02	0.02
query8	0.05	0.04	0.04
query9	0.57	0.49	0.46
query10	0.52	0.54	0.52
query11	0.15	0.11	0.10
query12	0.15	0.11	0.12
query13	0.65	0.66	0.66
query14	0.94	1.06	1.12
query15	0.90	0.87	0.90
query16	0.38	0.40	0.39
query17	1.04	1.06	1.08
query18	0.21	0.20	0.20
query19	1.89	1.91	1.90
query20	0.02	0.02	0.01
query21	15.37	0.88	0.55
query22	0.81	1.26	0.72
query23	14.79	1.19	0.62
query24	6.75	1.54	1.10
query25	0.52	0.15	0.23
query26	0.57	0.15	0.14
query27	0.06	0.05	0.05
query28	10.34	0.83	0.44
query29	12.56	3.83	3.32
query30	3.11	3.03	2.94
query31	2.80	0.56	0.39
query32	3.24	0.57	0.50
query33	3.04	3.15	3.21
query34	16.03	5.37	4.93
query35	4.89	4.99	4.97
query36	0.69	0.51	0.52
query37	0.10	0.07	0.08
query38	0.06	0.05	0.04
query39	0.04	0.03	0.03
query40	0.17	0.14	0.14
query41	0.08	0.03	0.03
query42	0.03	0.02	0.02
query43	0.04	0.04	0.03
Total cold run time: 107.18 s
Total hot run time: 33.56 s

@hello-stephen

hello-stephen commented Aug 7, 2025

Copy link
Copy Markdown
Contributor

FE UT Coverage Report

Increment line coverage 88.57% (31/35) 🎉
Increment coverage report
Complete coverage report

zy-kkk
zy-kkk previously approved these changes Aug 7, 2025
View reviewed changes
@github-actions

github-actionsBot commented Aug 7, 2025

Copy link
Copy Markdown
Contributor

PR approved by at least one committer and no changes requested.

@github-actionsgithub-actionsBot added the approved Indicates a PR has been approved by one committer. label Aug 7, 2025
@morningman

morningman commented Aug 7, 2025

Copy link
Copy Markdown
ContributorAuthor

run buildall

@github-actionsgithub-actionsBot removed the approved Indicates a PR has been approved by one committer. label Aug 7, 2025
@doris-robot

doris-robot commented Aug 7, 2025

Copy link
Copy Markdown
TPC-H: Total hot run time: 33600 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit f35539e930bf5e0c66a5cd3cca1c3ad809aa19d4, data reload: false
------ Round 1 ----------------------------------
q1	17596	5218	5236	5218
q2	1909	285	200	200
q3	10315	1456	718	718
q4	10213	1045	501	501
q5	7500	2244	2329	2244
q6	180	165	130	130
q7	889	753	620	620
q8	9297	1258	1004	1004
q9	6825	5109	5116	5109
q10	6897	2371	1976	1976
q11	459	289	257	257
q12	351	370	230	230
q13	17800	3423	2948	2948
q14	232	246	226	226
q15	543	464	461	461
q16	435	415	377	377
q17	561	813	348	348
q18	7289	7037	7021	7021
q19	2469	971	538	538
q20	318	303	214	214
q21	3461	2435	2251	2251
q22	1063	1029	1009	1009
Total cold run time: 106602 ms
Total hot run time: 33600 ms
----- Round 2, with runtime_filter_mode=off -----
q1	5482	5333	5328	5328
q2	232	304	222	222
q3	2113	2527	2176	2176
q4	1303	1712	1327	1327
q5	4086	4333	4303	4303
q6	219	174	133	133
q7	2087	2117	1831	1831
q8	2569	2530	2464	2464
q9	7176	7421	7357	7357
q10	3105	3463	2946	2946
q11	550	504	477	477
q12	682	785	632	632
q13	3440	3715	3237	3237
q14	297	310	302	302
q15	498	476	451	451
q16	430	519	443	443
q17	1182	1461	1402	1402
q18	7866	7917	7996	7917
q19	12288	997	1086	997
q20	1961	1933	1765	1765
q21	14809	4278	4245	4245
q22	1054	1035	1008	1008
Total cold run time: 73429 ms
Total hot run time: 50963 ms

@doris-robot

doris-robot commented Aug 7, 2025

Copy link
Copy Markdown
TPC-DS: Total hot run time: 170074 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit f35539e930bf5e0c66a5cd3cca1c3ad809aa19d4, data reload: false
============================================
query1	981	381	424	381
query2	6520	1812	1691	1691
query3	6738	242	221	221
query4	26983	23937	22886	22886
query5	4344	626	508	508
query6	308	230	215	215
query7	4638	524	288	288
query8	299	233	225	225
query9	8613	2924	2911	2911
query10	477	351	294	294
query11	16045	15125	14796	14796
query12	183	132	130	130
query13	1653	542	424	424
query14	8687	5825	5959	5825
query15	213	189	160	160
query16	7123	649	476	476
query17	951	763	618	618
query18	2001	432	321	321
query19	214	212	192	192
query20	156	144	140	140
query21	221	127	111	111
query22	3923	3966	3843	3843
query23	34618	34312	34426	34312
query24	6636	2442	2480	2442
query25	513	535	472	472
query26	719	296	173	173
query27	2359	507	359	359
query28	2976	2318	2337	2318
query29	695	636	524	524
query30	289	241	192	192
query31	881	807	727	727
query32	91	81	79	79
query33	571	418	398	398
query34	813	855	527	527
query35	817	869	772	772
query36	1008	1056	952	952
query37	130	116	99	99
query38	3884	4031	3910	3910
query39	1437	1376	1449	1376
query40	243	151	139	139
query41	66	61	60	60
query42	141	163	129	129
query43	514	515	495	495
query44	1396	861	868	861
query45	199	194	187	187
query46	944	1059	668	668
query47	1768	1821	1750	1750
query48	398	422	310	310
query49	678	501	424	424
query50	665	685	405	405
query51	4183	4244	4304	4244
query52	126	134	119	119
query53	275	292	217	217
query54	656	644	553	553
query55	88	91	87	87
query56	369	368	350	350
query57	1165	1201	1132	1132
query58	335	329	341	329
query59	2650	2677	2551	2551
query60	404	398	395	395
query61	132	127	127	127
query62	763	741	630	630
query63	252	211	223	211
query64	2349	1110	793	793
query65	4285	4147	4139	4139
query66	1009	459	341	341
query67	query68	17304	861	915	861
query69	1123	275	290	275
query70	1439	1067	1096	1067
query71	709	316	315	315
query72	9203	2253	2194	2194
query73	3659	758	354	354
query74	9013	9118	8684	8684
query75	7539	3124	2662	2662
query76	8907	1211	780	780
query77	1156	411	339	339
query78	9739	9909	9470	9470
query79	14551	609	583	583
query80	2236	559	496	496
query81	578	257	233	233
query82	401	158	121	121
query83	442	291	273	273
query84	300	99	95	95
query85	988	378	345	345
query86	370	316	295	295
query87	4203	4222	4091	4091
query88	5007	2221	2262	2221
query89	508	366	336	336
query90	2603	234	240	234
query91	162	141	116	116
query92	90	72	68	68
query93	5552	977	652	652
query94	1000	401	274	274
query95	404	340	329	329
query96	499	592	285	285
query97	2696	2763	2585	2585
query98	249	229	220	220
query99	1456	1416	1287	1287
Total cold run time: 299847 ms
Total hot run time: 170074 ms

@doris-robot

doris-robot commented Aug 7, 2025

Copy link
Copy Markdown
ClickBench: Total hot run time: 33.36 s
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit f35539e930bf5e0c66a5cd3cca1c3ad809aa19d4, data reload: false
query1	0.04	0.04	0.04
query2	0.09	0.04	0.04
query3	0.24	0.08	0.09
query4	1.61	0.11	0.11
query5	0.42	0.42	0.44
query6	1.17	0.66	0.65
query7	0.03	0.02	0.02
query8	0.05	0.03	0.04
query9	0.56	0.50	0.48
query10	0.52	0.53	0.52
query11	0.16	0.10	0.10
query12	0.15	0.11	0.11
query13	0.66	0.64	0.65
query14	0.97	1.13	1.00
query15	0.94	0.88	0.92
query16	0.39	0.39	0.40
query17	1.04	1.07	1.09
query18	0.22	0.20	0.20
query19	2.06	1.90	1.82
query20	0.02	0.01	0.02
query21	15.36	0.86	0.56
query22	0.75	1.12	0.82
query23	14.83	1.17	0.64
query24	6.65	1.13	0.81
query25	0.56	0.21	0.06
query26	0.56	0.16	0.13
query27	0.06	0.06	0.06
query28	9.71	0.85	0.45
query29	12.60	3.87	3.39
query30	3.05	2.99	3.01
query31	2.83	0.57	0.40
query32	3.23	0.57	0.50
query33	3.01	3.25	3.14
query34	16.13	5.38	4.96
query35	4.94	4.97	4.99
query36	0.70	0.51	0.50
query37	0.10	0.08	0.07
query38	0.05	0.05	0.05
query39	0.03	0.02	0.02
query40	0.17	0.14	0.14
query41	0.08	0.03	0.03
query42	0.04	0.03	0.03
query43	0.04	0.04	0.03
Total cold run time: 106.82 s
Total hot run time: 33.36 s

@hello-stephen

hello-stephen commented Aug 7, 2025

Copy link
Copy Markdown
Contributor

FE UT Coverage Report

Increment line coverage 88.57% (31/35) 🎉
Increment coverage report
Complete coverage report

@github-actions

github-actionsBot commented Aug 8, 2025

Copy link
Copy Markdown
Contributor

PR approved by at least one committer and no changes requested.

@github-actionsgithub-actionsBot added the approved Indicates a PR has been approved by one committer. label Aug 8, 2025
@morningman
morningman merged commit 7689a8b into apache:masterAug 8, 2025
28 of 30 checks passed
github-actionsBot pushed a commit that referenced this pull request Aug 8, 2025
@morningmanYour Name
[opt](iceberg) support glue rest catalog with s3tables (#54385)
993cc64
### What problem does this PR solve?
```
CREATE CATALOG glue_s3 PROPERTIES (
'type' = 'iceberg',
'iceberg.catalog.type' = 'rest',
'iceberg.rest.uri' = 'https://glue.ap-east-1.amazonaws.com/iceberg',
'iceberg.rest.warehouse' = '<account_id>:s3tablescatalog/s3-table-bucket-hk-glue-test',
"iceberg.rest.sigv4-enabled" = "true",
"iceberg.rest.signing-name" = "glue",
"iceberg.rest.access-key-id" = "ak",
"iceberg.rest.secret-access-key" = "sk",
"iceberg.rest.signing-region" = "ap-east-1"
);
```
@github-actionsgithub-actionsBot mentioned this pull request Aug 8, 2025
Merged
morrySnow pushed a commit that referenced this pull request Aug 9, 2025
@github-actions@morningman
branch-3.1: [opt](iceberg) support glue rest catalog with s3tables#5…
2af4d5f
…4385 (#54513)
Cherry-picked from #54385
Co-authored-by: Mingyu Chen (Rayner) <morningman@163.com>
Sign up for freeto join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

@CalvinKirsCalvinKirsCalvinKirs approved these changes
@suxiaogang223suxiaogang223suxiaogang223 approved these changes
@zy-kkkzy-kkkzy-kkk left review comments

Assignees

No one assigned

Labels

approvedIndicates a PR has been approved by one committer.dev/3.1.0-mergedreviewed

Projects

None yet

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.

8 participants

@morningman@Thearas@doris-robot@hello-stephen@CalvinKirs@suxiaogang223@zy-kkk@morrySnow