branch-3.1:[feature](external) Support reading Hudi/Paimon/Iceberg tables after schema changes. (#51341) by hubgeter · Pull Request #53170 · apache/doris

hubgeter · 2025-07-13T17:51:37Z

What problem does this PR solve?

bp #51341 : support read hudi/paimon/iceberg schema change
bp #52964: add hudi orc reader
bp #52954 : support timestamp to bigint
bp #53055：fix paimon docker version

Release note

None

Check List (For Author)

Test
- Regression test
- Unit Test
- Manual test (add detailed scripts or steps below)
- No need to test or manual test. Explain why:
  - This is a refactor/code format and no logic has been changed.
  - Previous test can cover this change.
  - No code files have been changed.
  - Other reason
Behavior changed:
- No.
- Yes.
Does this need documentation?
- No.
- Yes.

Check List (For Reviewer who merge this PR)

Confirm the release note
Confirm test cases
Confirm document
Add branch pick label

hello-stephen · 2025-07-13T17:51:42Z

Thank you for your contribution to Apache Doris.
Don't know what should be done next? See How to process your PR.

Please clearly describe your PR:

What problem was fixed (it's best to include specific error reporting information). How it was fixed.
Which behaviors were modified. What was the previous behavior, what is it now, why was it modified, and what possible impacts might there be.
What features were added. Why was this function added?
Which code was refactored and why was this part of the code refactored?
Which functions were optimized and what is the difference before and after the optimization?

hubgeter · 2025-07-13T17:52:00Z

run buildall

hello-stephen · 2025-07-13T18:19:28Z

Cloud UT Coverage Report

Increment line coverage 🎉

Increment coverage report
Complete coverage report

Category	Coverage
Function Coverage	83.73% (1189/1420)
Line Coverage	67.96% (21032/30948)
Region Coverage	67.43% (10420/15453)
Branch Coverage	57.07% (5503/9642)

doris-robot · 2025-07-13T19:40:32Z

TPC-H: Total hot run time: 40014 ms

machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 90f19233d8b405bdc3ffa646e6d30f37c593303c, data reload: false
------ Round 1 ----------------------------------
q1	17777	6977	6659	6659
q2	2083	171	157	157
q3	10635	1275	1166	1166
q4	10448	755	826	755
q5	7743	2919	2864	2864
q6	223	140	138	138
q7	982	620	606	606
q8	9365	2036	2055	2036
q9	7063	6471	6441	6441
q10	6954	2270	2291	2270
q11	461	254	284	254
q12	422	212	207	207
q13	17800	2970	2993	2970
q14	238	216	215	215
q15	519	480	472	472
q16	463	376	374	374
q17	1007	599	565	565
q18	7321	6669	6752	6669
q19	1332	1012	977	977
q20	493	206	204	204
q21	3907	3155	3051	3051
q22	1076	989	964	964
Total cold run time: 108312 ms
Total hot run time: 40014 ms
----- Round 2, with runtime_filter_mode=off -----
q1	6618	6577	6589	6577
q2	331	234	234	234
q3	2929	2940	2977	2940
q4	2077	1864	1818	1818
q5	5720	5713	5739	5713
q6	218	131	133	131
q7	2283	1748	1783	1748
q8	3366	3528	3551	3528
q9	8712	8943	8871	8871
q10	3580	3548	3502	3502
q11	586	476	482	476
q12	797	601	599	599
q13	6606	3150	3123	3123
q14	299	282	264	264
q15	516	457	466	457
q16	495	435	438	435
q17	1864	1658	1594	1594
q18	8250	7922	7728	7728
q19	1729	1559	1502	1502
q20	2044	1810	1825	1810
q21	5182	4973	5088	4973
q22	1095	1026	1058	1026
Total cold run time: 65297 ms
Total hot run time: 59049 ms

doris-robot · 2025-07-13T19:52:51Z

TPC-DS: Total hot run time: 196469 ms

machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 90f19233d8b405bdc3ffa646e6d30f37c593303c, data reload: false
query1	1304	924	910	910
query2	6294	1948	1929	1929
query3	10807	4295	4266	4266
query4	33460	23418	23438	23418
query5	3445	467	456	456
query6	268	181	187	181
query7	3996	304	315	304
query8	290	237	227	227
query9	9564	2586	2583	2583
query10	485	266	269	266
query11	17965	15323	15315	15315
query12	167	104	104	104
query13	1556	443	419	419
query14	9483	6634	7411	6634
query15	239	180	194	180
query16	8052	482	464	464
query17	1652	593	575	575
query18	2118	320	313	313
query19	218	165	173	165
query20	127	113	118	113
query21	206	106	111	106
query22	4643	4462	4330	4330
query23	34805	34434	34329	34329
query24	11202	3023	3000	3000
query25	692	442	426	426
query26	1559	180	172	172
query27	3013	358	367	358
query28	7854	2162	2191	2162
query29	939	468	490	468
query30	266	164	159	159
query31	1023	842	861	842
query32	101	58	60	58
query33	785	313	338	313
query34	1043	503	520	503
query35	912	721	699	699
query36	1101	963	958	958
query37	135	72	72	72
query38	4050	3974	3939	3939
query39	1517	1482	1457	1457
query40	258	108	106	106
query41	51	52	50	50
query42	113	99	103	99
query43	530	485	488	485
query44	1327	835	818	818
query45	190	170	176	170
query46	1197	768	728	728
query47	2008	1885	1985	1885
query48	440	342	349	342
query49	1005	411	385	385
query50	836	425	432	425
query51	7582	7287	7225	7225
query52	107	92	95	92
query53	261	190	191	190
query54	1400	481	488	481
query55	90	81	86	81
query56	265	263	253	253
query57	1366	1215	1198	1198
query58	234	237	216	216
query59	3212	3024	3041	3024
query60	299	258	283	258
query61	117	113	113	113
query62	853	691	664	664
query63	227	191	189	189
query64	5032	672	660	660
query65	3417	3331	3265	3265
query66	1464	318	306	306
query67	16181	15436	15460	15436
query68	4670	586	572	572
query69	441	258	259	258
query70	1109	1122	1091	1091
query71	330	266	252	252
query72	6232	3960	4005	3960
query73	765	348	361	348
query74	10474	8949	9369	8949
query75	3374	2633	2674	2633
query76	2576	1110	964	964
query77	388	272	280	272
query78	10574	9534	9509	9509
query79	1940	598	603	598
query80	1157	428	432	428
query81	551	222	217	217
query82	897	87	89	87
query83	228	143	148	143
query84	233	80	79	79
query85	1373	317	289	289
query86	464	307	287	287
query87	4373	4252	4213	4213
query88	3699	2383	2339	2339
query89	422	297	294	294
query90	1893	187	188	187
query91	144	107	108	107
query92	63	51	51	51
query93	2323	561	569	561
query94	840	288	272	272
query95	364	263	264	263
query96	619	288	280	280
query97	3282	3138	3199	3138
query98	219	200	199	199
query99	1523	1312	1358	1312
Total cold run time: 304938 ms
Total hot run time: 196469 ms

doris-robot · 2025-07-13T19:58:30Z

ClickBench: Total hot run time: 31.63 s

machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 90f19233d8b405bdc3ffa646e6d30f37c593303c, data reload: false
query1	0.04	0.03	0.03
query2	0.09	0.04	0.05
query3	0.24	0.06	0.06
query4	1.64	0.08	0.08
query5	0.51	0.51	0.51
query6	1.13	0.74	0.74
query7	0.02	0.01	0.02
query8	0.08	0.05	0.04
query9	0.55	0.49	0.50
query10	0.55	0.56	0.57
query11	0.16	0.12	0.12
query12	0.15	0.13	0.12
query13	0.60	0.60	0.59
query14	0.80	0.80	0.80
query15	0.85	0.83	0.83
query16	0.38	0.36	0.38
query17	1.06	1.00	1.04
query18	0.19	0.18	0.19
query19	1.95	1.88	1.87
query20	0.02	0.01	0.02
query21	15.40	0.67	0.68
query22	3.53	6.44	2.68
query23	18.30	1.47	1.30
query24	2.16	0.22	0.23
query25	0.17	0.09	0.09
query26	0.27	0.18	0.18
query27	0.08	0.09	0.08
query28	13.30	0.60	0.56
query29	12.65	3.38	3.35
query30	0.24	0.06	0.06
query31	2.86	0.40	0.40
query32	3.22	0.48	0.47
query33	3.01	3.04	3.01
query34	16.81	4.53	4.50
query35	4.56	4.51	4.52
query36	0.67	0.50	0.48
query37	0.20	0.16	0.16
query38	0.16	0.16	0.16
query39	0.06	0.05	0.04
query40	0.16	0.13	0.13
query41	0.10	0.05	0.05
query42	0.06	0.06	0.05
query43	0.05	0.05	0.04
Total cold run time: 109.03 s
Total hot run time: 31.63 s

hubgeter · 2025-07-14T17:02:08Z

run buildall

doris-robot · 2025-07-14T17:22:59Z

Cloud UT Coverage Report

Increment line coverage 🎉

Increment coverage report
Complete coverage report

Category	Coverage
Function Coverage	81.13% (1187/1463)
Line Coverage	65.37% (20587/31494)
Region Coverage	66.85% (10442/15620)
Branch Coverage	56.63% (5516/9740)

hello-stephen · 2025-07-14T18:26:52Z

BE UT Coverage Report

Increment line coverage 36.61% (436/1191) 🎉

Increment coverage report
Complete coverage report

Category	Coverage
Function Coverage	45.24% (12532/27699)
Line Coverage	36.12% (111324/308175)
Region Coverage	35.24% (57557/163309)
Branch Coverage	32.39% (31287/96586)

doris-robot · 2025-07-14T18:29:08Z

TPC-H: Total hot run time: 39991 ms

machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit b859f2f7b7b3e89efda91a8d0de45e430fac1a96, data reload: false
------ Round 1 ----------------------------------
q1	17810	6924	6652	6652
q2	2080	168	162	162
q3	10662	1162	1229	1162
q4	10432	806	799	799
q5	7759	2849	2844	2844
q6	216	133	132	132
q7	991	637	599	599
q8	9360	1961	2049	1961
q9	6701	6382	6457	6382
q10	7045	2235	2324	2235
q11	466	259	258	258
q12	397	216	211	211
q13	17787	2993	2965	2965
q14	251	209	207	207
q15	499	478	473	473
q16	489	375	379	375
q17	991	547	540	540
q18	7689	6759	6877	6759
q19	1320	1076	944	944
q20	475	206	197	197
q21	3915	3163	3181	3163
q22	1081	997	971	971
Total cold run time: 108416 ms
Total hot run time: 39991 ms
----- Round 2, with runtime_filter_mode=off -----
q1	6656	6631	6621	6621
q2	331	229	237	229
q3	3040	2949	2966	2949
q4	2071	1826	1840	1826
q5	5755	5728	5792	5728
q6	210	129	131	129
q7	2224	1854	1842	1842
q8	3354	3585	3533	3533
q9	8820	8923	8891	8891
q10	3568	3586	3505	3505
q11	600	483	497	483
q12	835	599	597	597
q13	7991	3152	3146	3146
q14	312	272	269	269
q15	506	465	459	459
q16	472	438	435	435
q17	1842	1657	1626	1626
q18	8264	7911	7793	7793
q19	1716	1442	1566	1442
q20	2064	1825	1834	1825
q21	5336	5119	5133	5119
q22	1120	1037	1013	1013
Total cold run time: 67087 ms
Total hot run time: 59460 ms

doris-robot · 2025-07-14T18:41:26Z

TPC-DS: Total hot run time: 197099 ms

machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit b859f2f7b7b3e89efda91a8d0de45e430fac1a96, data reload: false
query1	1288	918	914	914
query2	6228	1899	1876	1876
query3	10806	4356	4513	4356
query4	33029	23594	23587	23587
query5	3511	467	448	448
query6	262	171	189	171
query7	3989	311	325	311
query8	297	233	227	227
query9	9336	2582	2571	2571
query10	490	284	249	249
query11	17989	15629	15251	15251
query12	161	106	101	101
query13	1552	423	426	423
query14	9514	7316	7781	7316
query15	264	192	190	190
query16	7457	449	527	449
query17	1695	589	616	589
query18	2079	324	324	324
query19	386	181	173	173
query20	126	120	112	112
query21	229	111	110	110
query22	4784	4342	4406	4342
query23	35072	34002	34228	34002
query24	11239	3001	2941	2941
query25	658	437	433	433
query26	1398	176	176	176
query27	2421	351	358	351
query28	7268	2192	2213	2192
query29	831	457	487	457
query30	268	159	164	159
query31	1114	838	831	831
query32	93	55	54	54
query33	770	322	336	322
query34	1005	495	523	495
query35	939	718	731	718
query36	1113	925	975	925
query37	118	70	69	69
query38	4060	3961	3954	3954
query39	1534	1481	1447	1447
query40	205	100	109	100
query41	49	50	142	50
query42	120	107	111	107
query43	540	499	471	471
query44	1308	817	827	817
query45	187	172	174	172
query46	1183	733	747	733
query47	1983	1900	1916	1900
query48	469	348	345	345
query49	912	385	439	385
query50	832	431	430	430
query51	7522	7310	7320	7310
query52	110	96	93	93
query53	271	188	184	184
query54	1377	479	477	477
query55	83	76	80	76
query56	287	248	278	248
query57	1336	1200	1225	1200
query58	233	217	224	217
query59	3106	2953	2882	2882
query60	290	269	277	269
query61	116	116	112	112
query62	885	675	683	675
query63	237	201	192	192
query64	4403	668	667	667
query65	3373	3316	3290	3290
query66	852	307	305	305
query67	15888	15538	15423	15423
query68	4405	593	581	581
query69	447	270	264	264
query70	1188	1087	1120	1087
query71	340	279	247	247
query72	6401	4029	4024	4024
query73	771	348	349	348
query74	10362	8871	9225	8871
query75	3392	2657	2694	2657
query76	2635	1045	1061	1045
query77	405	269	268	268
query78	10569	9539	9736	9539
query79	2468	607	616	607
query80	1189	441	446	441
query81	544	230	220	220
query82	776	91	90	90
query83	239	141	146	141
query84	236	81	77	77
query85	1628	312	300	300
query86	474	304	297	297
query87	4380	4218	4246	4218
query88	4324	2427	2374	2374
query89	418	304	301	301
query90	1980	187	189	187
query91	139	113	106	106
query92	61	51	52	51
query93	2359	561	555	555
query94	841	292	300	292
query95	368	263	262	262
query96	617	278	285	278
query97	3291	3213	3113	3113
query98	224	197	200	197
query99	1535	1315	1318	1315
Total cold run time: 302536 ms
Total hot run time: 197099 ms

doris-robot · 2025-07-14T18:47:04Z

ClickBench: Total hot run time: 31.82 s

machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit b859f2f7b7b3e89efda91a8d0de45e430fac1a96, data reload: false
query1	0.04	0.03	0.03
query2	0.09	0.05	0.04
query3	0.23	0.05	0.06
query4	1.64	0.09	0.08
query5	0.51	0.51	0.52
query6	1.12	0.75	0.74
query7	0.02	0.01	0.01
query8	0.06	0.04	0.05
query9	0.54	0.50	0.50
query10	0.55	0.56	0.57
query11	0.18	0.13	0.13
query12	0.16	0.13	0.13
query13	0.62	0.60	0.60
query14	0.78	0.82	0.79
query15	0.85	0.84	0.84
query16	0.39	0.38	0.39
query17	1.00	1.01	1.01
query18	0.19	0.19	0.19
query19	1.87	1.86	1.75
query20	0.01	0.01	0.01
query21	15.39	0.66	0.66
query22	3.82	6.10	2.89
query23	18.31	1.38	1.30
query24	2.19	0.23	0.23
query25	0.15	0.08	0.08
query26	0.27	0.18	0.18
query27	0.08	0.08	0.08
query28	13.33	0.61	0.58
query29	12.62	3.42	3.38
query30	0.25	0.06	0.06
query31	2.85	0.41	0.40
query32	3.22	0.49	0.49
query33	3.03	2.97	3.01
query34	17.02	4.49	4.54
query35	4.61	4.58	4.53
query36	0.68	0.49	0.50
query37	0.20	0.17	0.16
query38	0.16	0.18	0.15
query39	0.06	0.04	0.04
query40	0.16	0.13	0.13
query41	0.10	0.05	0.05
query42	0.06	0.06	0.05
query43	0.06	0.05	0.04
Total cold run time: 109.47 s
Total hot run time: 31.82 s

…schema changes. (apache#51341) Related PR: apache#49051 Problem Summary: Support reading Hudi and Paimon Iceberg tables after the internal schema of struct is changed. 1. Introduce `hive_reader` to avoid confusion between `hive` and `parquet/orc` reader 2. Before this, support for reading tables after schema changes of ordinary columns relied on changing the column name in block, so that parquet/orc reader can read specific file columns when `get_next_block`, and `hudi/iceberg/paimon reader` will mix `file column names` with `table column names` when using parquet/orc reader. This pr clarifies that all calls to `parquet/orc reader` are based on the concept of `table column names`, and then introduces `TableSchemaChangeHelper::Node` to help `parquet/orc reader` find the specific file columns to be read.

…e#52964) Related PR: apache#51341 Problem Summary: In pr apache#51341, hudiOrcReader was deleted, and this pr reintroduced it to read hudi orc table. Although I encountered this error when testing spark-hudi to read orc, the orc file was indeed generated by spark-hudi. ``` java.lang.UnsupportedOperationException: Base file format is not currently supported (ORC) at org.apache.hudi.HoodieBaseRelation.createBaseFileReader(HoodieBaseRelation.scala:574) ~[hudi-spark3.4-bundle_2.12-0.14.0-1.jar:0.14.0-1] at org.apache.hudi.BaseFileOnlyRelation.composeRDD(BaseFileOnlyRelation.scala:96) ~[hudi-spark3.4-bundle_2.12-0.14.0-1.jar:0.14.0-1] at org.apache.hudi.HoodieBaseRelation.buildScan(HoodieBaseRelation.scala:381) ~[hudi-spark3.4-bundle_2.12-0.14.0-1.jar:0.14.0-1] at org.apache.spark.sql.execution.datasources.DataSourceStrategy$.$anonfun$apply$4(DataSourceStrategy.scala:329) ~[spark-sql_2.12-3.4.2.jar:0.14.0-1] ```

… to bigint. (apache#52954) Related PR: apache#47471 Problem Summary: This pr is a supplement to apache#47471. This pr is used to support reading hive tables that convert timestamp columns to bigint columns and display them in `ms` precision. (parquet/orc hive table.)

…on version. (apache#53055) ### What problem does this PR solve? Related PR: apache#51341 Problem Summary: In PR apache#51341, the Docker Paimon was upgraded from version 0.8 to 1.0.1. Since the required JAR files are pulled from a Maven repository, some machines may not be able to access the repository. To fix this, the JAR file has been uploaded to object storage, ensuring that it can be reliably accessed across different environments.

hubgeter · 2025-07-15T08:48:40Z

run buildall

hello-stephen · 2025-07-15T09:11:01Z

Cloud UT Coverage Report

Increment line coverage 🎉

Increment coverage report
Complete coverage report

Category	Coverage
Function Coverage	81.15% (1188/1464)
Line Coverage	65.35% (20589/31507)
Region Coverage	66.84% (10442/15623)
Branch Coverage	56.58% (5511/9740)

hello-stephen · 2025-07-15T10:35:39Z

BE UT Coverage Report

Increment line coverage 38.60% (496/1285) 🎉

Increment coverage report
Complete coverage report

Category	Coverage
Function Coverage	45.24% (12537/27715)
Line Coverage	36.11% (111405/308495)
Region Coverage	35.23% (57605/163501)
Branch Coverage	32.39% (31320/96708)

doris-robot · 2025-07-15T10:57:29Z

TPC-H: Total hot run time: 40013 ms

machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit b6c5fdbd0de72a0b5eb5aedc259fe4c13e77e0a6, data reload: false
------ Round 1 ----------------------------------
q1	17678	6889	6626	6626
q2	2067	174	160	160
q3	10638	1188	1188	1188
q4	10396	747	728	728
q5	7776	2875	2831	2831
q6	214	137	139	137
q7	999	618	602	602
q8	9363	1938	1998	1938
q9	6720	6381	6415	6381
q10	7042	2310	2307	2307
q11	467	259	258	258
q12	394	224	220	220
q13	17764	2967	2966	2966
q14	245	212	214	212
q15	499	458	479	458
q16	477	383	374	374
q17	998	566	589	566
q18	7462	6749	6714	6714
q19	1382	1044	1049	1044
q20	455	201	203	201
q21	4067	3119	3132	3119
q22	1088	983	998	983
Total cold run time: 108191 ms
Total hot run time: 40013 ms
----- Round 2, with runtime_filter_mode=off -----
q1	6731	6599	6549	6549
q2	330	235	230	230
q3	2885	2955	2908	2908
q4	2072	1901	1808	1808
q5	5732	5768	5738	5738
q6	211	128	132	128
q7	2255	1802	1841	1802
q8	3358	3494	3569	3494
q9	8776	8861	8857	8857
q10	3572	3584	3498	3498
q11	595	507	496	496
q12	816	607	586	586
q13	10134	3258	3118	3118
q14	294	273	269	269
q15	501	478	460	460
q16	480	438	427	427
q17	1841	1603	1611	1603
q18	8311	7849	7669	7669
q19	1700	1664	1545	1545
q20	2043	1801	1810	1801
q21	5341	5081	5002	5002
q22	1140	1021	1046	1021
Total cold run time: 69118 ms
Total hot run time: 59009 ms

doris-robot · 2025-07-15T11:09:50Z

TPC-DS: Total hot run time: 196703 ms

machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit b6c5fdbd0de72a0b5eb5aedc259fe4c13e77e0a6, data reload: false
query1	1273	907	906	906
query2	6261	1944	1895	1895
query3	10800	4391	4135	4135
query4	33038	23753	23327	23327
query5	3670	451	442	442
query6	271	178	182	178
query7	3980	313	321	313
query8	293	240	221	221
query9	9500	2609	2592	2592
query10	477	266	259	259
query11	17950	15752	15550	15550
query12	161	105	103	103
query13	1563	410	418	410
query14	10506	7065	6583	6583
query15	242	184	201	184
query16	7882	453	505	453
query17	1624	598	596	596
query18	2208	340	320	320
query19	264	179	182	179
query20	129	125	121	121
query21	204	114	103	103
query22	4774	4445	4471	4445
query23	35778	34589	34233	34233
query24	11791	2890	2887	2887
query25	600	425	449	425
query26	1369	171	175	171
query27	2933	345	360	345
query28	7650	2189	2178	2178
query29	727	453	462	453
query30	277	168	169	168
query31	1061	799	887	799
query32	97	55	56	55
query33	792	331	313	313
query34	954	521	520	520
query35	887	708	738	708
query36	1141	963	982	963
query37	219	69	65	65
query38	4111	3894	3938	3894
query39	1529	1444	1477	1444
query40	257	104	103	103
query41	52	48	45	45
query42	115	103	102	102
query43	521	479	480	479
query44	1301	816	829	816
query45	187	180	169	169
query46	1173	736	766	736
query47	2021	1895	1964	1895
query48	471	346	360	346
query49	1234	422	391	391
query50	823	435	430	430
query51	7514	7279	7244	7244
query52	100	91	94	91
query53	260	194	185	185
query54	1256	472	467	467
query55	77	79	81	79
query56	276	256	271	256
query57	1356	1197	1246	1197
query58	230	219	213	213
query59	3243	3060	3016	3016
query60	275	256	268	256
query61	107	113	106	106
query62	868	704	707	704
query63	223	185	184	184
query64	5166	686	647	647
query65	3389	3270	3339	3270
query66	1344	298	302	298
query67	15988	15626	15740	15626
query68	4852	579	569	569
query69	436	262	262	262
query70	1205	1093	1121	1093
query71	348	263	263	263
query72	5942	3973	4017	3973
query73	760	366	361	361
query74	10397	9052	9213	9052
query75	3374	2656	2659	2656
query76	2700	977	1130	977
query77	385	273	266	266
query78	10596	9719	9556	9556
query79	1571	596	597	596
query80	1120	442	423	423
query81	548	234	217	217
query82	926	82	94	82
query83	237	142	144	142
query84	234	82	83	82
query85	1285	314	288	288
query86	382	260	295	260
query87	4364	4224	4209	4209
query88	3733	2420	2401	2401
query89	409	299	293	293
query90	1889	187	184	184
query91	143	108	104	104
query92	61	47	53	47
query93	1833	561	564	561
query94	790	304	306	304
query95	361	253	259	253
query96	611	283	280	280
query97	3298	3162	3148	3148
query98	225	200	204	200
query99	1513	1314	1340	1314
Total cold run time: 305341 ms
Total hot run time: 196703 ms

doris-robot · 2025-07-15T11:15:30Z

ClickBench: Total hot run time: 31.07 s

machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit b6c5fdbd0de72a0b5eb5aedc259fe4c13e77e0a6, data reload: false
query1	0.04	0.03	0.03
query2	0.08	0.04	0.04
query3	0.23	0.06	0.06
query4	1.65	0.08	0.09
query5	0.52	0.51	0.51
query6	1.13	0.75	0.75
query7	0.02	0.02	0.02
query8	0.06	0.05	0.05
query9	0.56	0.49	0.50
query10	0.56	0.56	0.58
query11	0.17	0.13	0.12
query12	0.16	0.14	0.13
query13	0.61	0.60	0.60
query14	0.78	0.79	0.82
query15	0.85	0.83	0.83
query16	0.37	0.38	0.37
query17	1.04	1.01	1.07
query18	0.19	0.19	0.19
query19	1.97	1.89	1.85
query20	0.02	0.01	0.02
query21	15.40	0.66	0.65
query22	3.44	7.43	1.96
query23	18.29	1.36	1.30
query24	2.16	0.24	0.23
query25	0.15	0.08	0.08
query26	0.27	0.18	0.19
query27	0.08	0.08	0.08
query28	13.24	0.62	0.57
query29	12.68	3.42	3.42
query30	0.24	0.06	0.06
query31	2.89	0.40	0.40
query32	3.23	0.49	0.48
query33	2.95	3.07	3.03
query34	16.75	4.61	4.48
query35	4.60	4.60	4.57
query36	0.67	0.51	0.47
query37	0.19	0.17	0.17
query38	0.16	0.16	0.15
query39	0.05	0.04	0.05
query40	0.15	0.12	0.12
query41	0.10	0.05	0.05
query42	0.07	0.06	0.05
query43	0.05	0.04	0.04
Total cold run time: 108.82 s
Total hot run time: 31.07 s

hubgeter requested a review from morrySnow as a code owner July 13, 2025 17:51

hubgeter added 4 commits July 15, 2025 16:18

hubgeter force-pushed the pick_full_sc branch from b859f2f to b6c5fdbCompare July 15, 2025 08:48

morningman approved these changes Jul 16, 2025
View reviewed changes

morrySnow approved these changes Jul 16, 2025
View reviewed changes

morrySnow merged commit 2b1e9fd into apache:branch-3.1Jul 16, 2025

Uh oh!

Conversation

hubgeter commented Jul 13, 2025• edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

What problem does this PR solve?

Release note

Check List (For Author)

Check List (For Reviewer who merge this PR)

Uh oh!

hello-stephen commented Jul 13, 2025

Uh oh!

hubgeter commented Jul 13, 2025

Uh oh!

hello-stephen commented Jul 13, 2025

Cloud UT Coverage Report

Uh oh!

doris-robot commented Jul 13, 2025

Uh oh!

doris-robot commented Jul 13, 2025

Uh oh!

doris-robot commented Jul 13, 2025

Uh oh!

hubgeter commented Jul 14, 2025

Uh oh!

doris-robot commented Jul 14, 2025

Cloud UT Coverage Report

Uh oh!

hello-stephen commented Jul 14, 2025

BE UT Coverage Report

Uh oh!

doris-robot commented Jul 14, 2025

Uh oh!

doris-robot commented Jul 14, 2025

Uh oh!

doris-robot commented Jul 14, 2025

Uh oh!

hubgeter commented Jul 15, 2025

Uh oh!

hello-stephen commented Jul 15, 2025

Cloud UT Coverage Report

Uh oh!

hello-stephen commented Jul 15, 2025

BE UT Coverage Report

Uh oh!

doris-robot commented Jul 15, 2025

Uh oh!

doris-robot commented Jul 15, 2025

Uh oh!

doris-robot commented Jul 15, 2025

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

5 participants

hubgeter commented Jul 13, 2025•
edited
Loading