[fix](ut) repair segcompaction ut (#38165) (#38225) by zhannngchen · Pull Request #39153 · apache/doris

zhannngchen · 2024-08-09T07:57:24Z

Proposed changes

Issue Number: close #xxx

cherry-pick #38165 and #22928

doris-robot · 2024-08-09T07:57:29Z

Thank you for your contribution to Apache Doris.
Don't know what should be done next? See How to process your PR

Since 2024-03-18, the Document has been moved to doris-website.
See Doris Document.

zhannngchen · 2024-08-09T07:57:33Z

run buildall

github-actions · 2024-08-09T08:05:01Z

clang-tidy review says "All clean, LGTM! 👍"

doris-robot · 2024-08-09T08:16:53Z

TPC-H: Total hot run time: 49634 ms

machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 5ff1d5efcf0a455b128492bd03bdb4db85463d6e, data reload: false
------ Round 1 ----------------------------------
q1	17718	4388	4328	4328
q2	2090	158	144	144
q3	10263	1918	1944	1918
q4	10130	1214	1316	1214
q5	8463	3885	3867	3867
q6	225	126	128	126
q7	2084	1601	1632	1601
q8	9483	2697	2708	2697
q9	13861	10261	10188	10188
q10	8629	3520	3539	3520
q11	410	237	253	237
q12	470	302	303	302
q13	18360	3950	3992	3950
q14	358	320	336	320
q15	516	467	472	467
q16	655	570	571	570
q17	1135	953	911	911
q18	7155	6801	6822	6801
q19	1773	1660	1661	1660
q20	543	320	290	290
q21	4416	4136	4084	4084
q22	518	447	439	439
Total cold run time: 119255 ms
Total hot run time: 49634 ms
----- Round 2, with runtime_filter_mode=off -----
q1	4307	4311	4301	4301
q2	315	221	225	221
q3	4150	4127	4105	4105
q4	2740	2750	2746	2746
q5	7178	7142	7116	7116
q6	246	120	118	118
q7	3243	2823	2754	2754
q8	4343	4443	4485	4443
q9	16880	16883	16649	16649
q10	4206	4261	4238	4238
q11	758	680	692	680
q12	1011	842	833	833
q13	6559	3727	3722	3722
q14	448	426	422	422
q15	487	471	446	446
q16	734	689	686	686
q17	3837	3806	3784	3784
q18	8783	8712	8902	8712
q19	1713	1668	1687	1668
q20	2352	2129	2133	2129
q21	8522	8487	8411	8411
q22	1064	991	1010	991
Total cold run time: 83876 ms
Total hot run time: 79175 ms

doris-robot · 2024-08-09T08:29:33Z

TPC-DS: Total hot run time: 204465 ms

machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 5ff1d5efcf0a455b128492bd03bdb4db85463d6e, data reload: false
query1	940	388	408	388
query2	6548	2919	2755	2755
query3	6924	216	212	212
query4	20140	18135	18053	18053
query5	19742	6471	6465	6465
query6	280	213	232	213
query7	4151	321	326	321
query8	415	449	418	418
query9	3061	2657	2596	2596
query10	409	311	301	301
query11	11320	10703	10677	10677
query12	135	76	76	76
query13	5616	683	676	676
query14	17264	13050	13749	13050
query15	365	246	248	246
query16	6487	295	267	267
query17	1680	1485	857	857
query18	2324	418	408	408
query19	218	157	150	150
query20	81	79	80	79
query21	192	100	95	95
query22	5237	5051	5030	5030
query23	32560	32058	31898	31898
query24	6990	6536	6606	6536
query25	543	430	420	420
query26	537	160	161	160
query27	1907	296	299	296
query28	6167	2371	2332	2332
query29	2974	2831	2701	2701
query30	245	168	167	167
query31	899	725	738	725
query32	72	60	62	60
query33	411	258	262	258
query34	844	465	470	465
query35	1106	948	922	922
query36	1307	1332	1204	1204
query37	90	61	63	61
query38	3059	2895	2930	2895
query39	1400	1322	1329	1322
query40	208	94	91	91
query41	47	45	44	44
query42	83	79	88	79
query43	725	600	721	600
query44	1142	735	734	734
query45	255	235	228	228
query46	1231	950	969	950
query47	1723	1823	1683	1683
query48	1015	707	708	707
query49	630	376	374	374
query50	883	594	603	594
query51	4803	4631	4655	4631
query52	96	87	84	84
query53	448	333	316	316
query54	2643	2442	2501	2442
query55	93	89	90	89
query56	251	226	214	214
query57	1201	1105	1121	1105
query58	212	202	226	202
query59	3987	4031	3910	3910
query60	209	209	239	209
query61	98	95	97	95
query62	809	468	570	468
query63	487	344	343	343
query64	2579	1526	1481	1481
query65	3621	3563	3534	3534
query66	815	380	374	374
query67	15874	15884	16814	15884
query68	8325	673	664	664
query69	555	356	346	346
query70	1803	1428	1535	1428
query71	395	313	319	313
query72	6548	3465	3518	3465
query73	755	331	332	331
query74	6252	5815	5797	5797
query75	4511	3680	3694	3680
query76	4758	1181	1227	1181
query77	653	273	270	270
query78	12418	12042	12470	12042
query79	10454	643	649	643
query80	1015	410	406	406
query81	501	234	233	233
query82	672	103	96	96
query83	169	137	134	134
query84	257	72	72	72
query85	867	334	339	334
query86	333	292	296	292
query87	3223	2995	3010	2995
query88	4794	2424	2408	2408
query89	393	281	303	281
query90	1925	209	208	208
query91	195	146	141	141
query92	62	51	57	51
query93	3995	561	605	561
query94	748	216	216	216
query95	1137	1057	1040	1040
query96	641	350	347	347
query97	6468	6353	6244	6244
query98	188	180	169	169
query99	2979	1040	857	857
Total cold run time: 308797 ms
Total hot run time: 204465 ms

doris-robot · 2024-08-09T08:35:02Z

ClickBench: Total hot run time: 31.11 s

machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 5ff1d5efcf0a455b128492bd03bdb4db85463d6e, data reload: false
query1	0.03	0.03	0.02
query2	0.07	0.02	0.02
query3	0.25	0.04	0.04
query4	1.79	0.06	0.07
query5	0.53	0.52	0.51
query6	1.29	0.61	0.61
query7	0.01	0.01	0.01
query8	0.03	0.02	0.02
query9	0.52	0.47	0.49
query10	0.53	0.53	0.52
query11	0.11	0.08	0.09
query12	0.12	0.09	0.10
query13	0.62	0.62	0.60
query14	0.77	0.78	0.81
query15	0.78	0.76	0.76
query16	0.38	0.35	0.35
query17	1.00	1.01	1.02
query18	0.21	0.28	0.24
query19	1.87	1.86	1.84
query20	0.02	0.01	0.01
query21	15.45	0.55	0.59
query22	1.95	2.93	1.63
query23	17.09	0.97	0.94
query24	5.55	1.95	1.59
query25	0.36	0.11	0.05
query26	0.72	0.17	0.16
query27	0.03	0.05	0.04
query28	6.27	0.77	0.80
query29	12.65	2.36	2.11
query30	0.62	0.54	0.49
query31	2.84	0.39	0.39
query32	3.38	0.49	0.50
query33	3.07	3.08	3.05
query34	15.27	4.78	4.75
query35	4.86	4.80	4.83
query36	1.05	1.02	1.01
query37	0.06	0.05	0.05
query38	0.04	0.02	0.02
query39	0.02	0.01	0.02
query40	0.16	0.15	0.14
query41	0.06	0.02	0.01
query42	0.02	0.01	0.01
query43	0.02	0.01	0.02
Total cold run time: 102.47 s
Total hot run time: 31.11 s

doris-robot · 2024-08-09T08:38:16Z

Load test result on machine: 'aliyun_ecs.c7a.8xlarge_32C64G'

Load test result on commit 5ff1d5efcf0a455b128492bd03bdb4db85463d6e with default session variables
Stream load json: 19 seconds loaded 2358488459 Bytes, about 118 MB/s
Stream load orc: 58 seconds loaded 1101869774 Bytes, about 18 MB/s
Stream load parquet: 31 seconds loaded 861443392 Bytes, about 26 MB/s
Insert into select: 21.5 seconds inserted 10000000 Rows, about 465K ops/s

zhannngchen · 2024-08-20T07:47:03Z

run buildall

zhannngchen · 2024-08-20T08:52:12Z

run buildall

zhannngchen · 2024-08-20T09:05:41Z

run buildall

doris-robot · 2024-08-20T09:47:22Z

TPC-H: Total hot run time: 50384 ms

machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 00b93e258e0139c3a6bc009c2f23252967827d23, data reload: false
------ Round 1 ----------------------------------
q1	18083	4393	4450	4393
q2	2075	196	188	188
q3	10179	1902	1957	1902
q4	10370	1291	1319	1291
q5	8573	3922	3954	3922
q6	276	143	143	143
q7	2061	1663	1645	1645
q8	9336	2779	2768	2768
q9	10689	10250	10322	10250
q10	8672	3505	3540	3505
q11	446	273	277	273
q12	499	336	327	327
q13	18396	4039	4051	4039
q14	381	349	342	342
q15	574	500	503	500
q16	721	596	596	596
q17	1149	981	1000	981
q18	7308	6840	6875	6840
q19	1756	1652	1572	1572
q20	559	340	339	339
q21	4485	4172	4134	4134
q22	530	442	434	434
Total cold run time: 117118 ms
Total hot run time: 50384 ms
----- Round 2, with runtime_filter_mode=off -----
q1	4363	4322	4329	4322
q2	365	275	263	263
q3	4197	4172	4150	4150
q4	2782	2760	2770	2760
q5	7184	7119	7176	7119
q6	254	137	135	135
q7	3252	2875	2929	2875
q8	4468	4506	4507	4506
q9	16887	16793	16851	16793
q10	4236	4313	4323	4313
q11	797	773	724	724
q12	1055	898	863	863
q13	6885	3742	3739	3739
q14	474	454	451	451
q15	545	492	514	492
q16	768	729	739	729
q17	3972	3939	3862	3862
q18	8765	8783	8773	8773
q19	1787	1747	1711	1711
q20	2413	2174	2124	2124
q21	8632	8534	8481	8481
q22	1046	950	999	950
Total cold run time: 85127 ms
Total hot run time: 80135 ms

doris-robot · 2024-08-20T10:00:21Z

TPC-DS: Total hot run time: 210093 ms

machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 00b93e258e0139c3a6bc009c2f23252967827d23, data reload: false
query1	979	419	417	417
query2	6780	2222	2469	2222
query3	6945	231	223	223
query4	20146	18225	18190	18190
query5	19923	6750	6725	6725
query6	318	256	265	256
query7	4194	330	335	330
query8	500	474	458	458
query9	3237	2827	2740	2740
query10	478	372	391	372
query11	11305	10773	10820	10773
query12	157	117	112	112
query13	5663	721	712	712
query14	17827	13688	13706	13688
query15	381	254	247	247
query16	6506	332	302	302
query17	1604	1486	937	937
query18	2345	481	489	481
query19	234	183	183	183
query20	117	112	114	112
query21	247	148	153	148
query22	5316	5014	5128	5014
query23	32657	31993	32169	31993
query24	7191	6661	6635	6635
query25	586	478	488	478
query26	562	192	195	192
query27	1841	330	325	325
query28	5991	2424	2388	2388
query29	2859	2882	2803	2803
query30	277	213	212	212
query31	1021	850	829	829
query32	100	92	92	92
query33	481	345	329	329
query34	888	521	531	521
query35	1201	972	967	967
query36	1387	1385	1203	1203
query37	122	88	91	88
query38	3079	2982	2984	2982
query39	1488	1441	1440	1440
query40	261	147	149	147
query41	159	152	151	151
query42	115	110	107	107
query43	773	605	610	605
query44	1204	790	783	783
query45	282	271	264	264
query46	1299	990	1028	990
query47	2042	1919	1918	1918
query48	1029	752	754	752
query49	851	588	589	588
query50	934	685	690	685
query51	4849	4745	4735	4735
query52	119	107	114	107
query53	503	376	380	376
query54	2734	2538	2519	2519
query55	105	103	103	103
query56	312	289	275	275
query57	1268	1181	1290	1181
query58	316	307	320	307
query59	3738	3295	3338	3295
query60	288	278	284	278
query61	158	160	160	160
query62	891	548	590	548
query63	539	396	405	396
query64	2603	1710	1504	1504
query65	3684	3613	3566	3566
query66	1257	811	805	805
query67	17531	16120	17289	16120
query68	8098	710	719	710
query69	629	409	394	394
query70	1626	1388	1533	1388
query71	456	354	379	354
query72	6559	3555	3539	3539
query73	783	371	371	371
query74	6338	5984	6002	5984
query75	4723	3737	3815	3737
query76	4643	1197	1231	1197
query77	708	418	420	418
query78	12502	11705	11644	11644
query79	8178	694	703	694
query80	2694	559	547	547
query81	565	283	277	277
query82	1513	132	129	129
query83	271	220	217	217
query84	286	98	98	98
query85	1501	404	413	404
query86	395	320	336	320
query87	3216	3131	3089	3089
query88	5470	2557	2539	2539
query89	385	331	368	331
query90	1796	262	259	259
query91	199	164	168	164
query92	90	86	85	85
query93	4347	623	578	578
query94	926	255	254	254
query95	1146	1097	1097	1097
query96	664	349	344	344
query97	6522	6448	6592	6448
query98	221	216	206	206
query99	2967	893	955	893
Total cold run time: 317194 ms
Total hot run time: 210093 ms

doris-robot · 2024-08-20T10:05:51Z

ClickBench: Total hot run time: 31.62 s

machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 00b93e258e0139c3a6bc009c2f23252967827d23, data reload: false
query1	0.02	0.03	0.02
query2	0.07	0.03	0.02
query3	0.25	0.05	0.06
query4	1.78	0.06	0.07
query5	0.54	0.52	0.53
query6	1.32	0.62	0.61
query7	0.02	0.01	0.02
query8	0.05	0.03	0.03
query9	0.54	0.49	0.48
query10	0.54	0.55	0.54
query11	0.13	0.10	0.10
query12	0.13	0.10	0.10
query13	0.64	0.62	0.62
query14	0.79	0.80	0.80
query15	0.81	0.77	0.78
query16	0.39	0.37	0.36
query17	1.02	1.01	1.05
query18	0.22	0.28	0.24
query19	1.92	1.87	1.84
query20	0.02	0.01	0.02
query21	15.47	0.58	0.55
query22	2.30	2.21	2.11
query23	17.30	1.07	0.92
query24	5.29	2.02	1.10
query25	0.40	0.06	0.06
query26	0.61	0.16	0.15
query27	0.05	0.05	0.04
query28	7.19	0.74	0.75
query29	12.61	2.27	2.13
query30	0.73	0.71	0.66
query31	2.82	0.40	0.39
query32	3.35	0.50	0.53
query33	3.12	3.04	3.10
query34	15.27	4.82	4.79
query35	4.86	4.85	4.88
query36	1.07	1.02	1.03
query37	0.07	0.06	0.06
query38	0.06	0.03	0.03
query39	0.03	0.03	0.03
query40	0.19	0.16	0.17
query41	0.09	0.03	0.03
query42	0.04	0.04	0.03
query43	0.04	0.04	0.04
Total cold run time: 104.16 s
Total hot run time: 31.62 s

doris-robot · 2024-08-20T10:43:32Z

TPC-H: Total hot run time: 49962 ms

machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 00b93e258e0139c3a6bc009c2f23252967827d23, data reload: false
------ Round 1 ----------------------------------
q1	17837	4422	4331	4331
q2	2099	199	195	195
q3	10320	1918	1912	1912
q4	10356	1268	1331	1268
q5	8840	3833	3980	3833
q6	272	141	144	141
q7	2077	1658	1641	1641
q8	9325	2760	2728	2728
q9	10654	10299	10238	10238
q10	8643	3553	3536	3536
q11	446	273	280	273
q12	499	332	335	332
q13	18392	3975	4045	3975
q14	368	361	357	357
q15	547	499	494	494
q16	702	621	593	593
q17	1135	958	977	958
q18	7410	6748	6763	6748
q19	1727	1610	1599	1599
q20	559	331	335	331
q21	4383	4051	4090	4051
q22	537	440	428	428
Total cold run time: 117128 ms
Total hot run time: 49962 ms
----- Round 2, with runtime_filter_mode=off -----
q1	4343	4339	4326	4326
q2	359	267	258	258
q3	4156	4127	4189	4127
q4	2811	2803	2814	2803
q5	7359	7232	7098	7098
q6	252	136	141	136
q7	3275	2910	2935	2910
q8	4390	4476	4474	4474
q9	16920	16817	16873	16817
q10	4276	4260	4249	4249
q11	807	704	732	704
q12	1052	864	901	864
q13	6510	3786	3779	3779
q14	465	441	450	441
q15	546	508	512	508
q16	761	707	711	707
q17	3949	3871	3856	3856
q18	8670	8724	8721	8721
q19	1755	1756	1729	1729
q20	2408	2188	2115	2115
q21	8383	8391	8504	8391
q22	1066	964	993	964
Total cold run time: 84513 ms
Total hot run time: 79977 ms

doris-robot · 2024-08-20T10:56:32Z

TPC-DS: Total hot run time: 208446 ms

machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 00b93e258e0139c3a6bc009c2f23252967827d23, data reload: false
query1	977	418	415	415
query2	6765	2316	2194	2194
query3	6942	226	221	221
query4	20076	18075	18239	18075
query5	19955	6692	6671	6671
query6	319	254	281	254
query7	4191	336	355	336
query8	521	459	457	457
query9	3234	2797	2752	2752
query10	481	376	362	362
query11	11357	10839	10890	10839
query12	156	111	108	108
query13	5687	742	746	742
query14	17565	13614	13840	13614
query15	388	257	240	240
query16	6527	325	302	302
query17	1649	1456	939	939
query18	2352	482	493	482
query19	251	189	189	189
query20	111	113	114	113
query21	248	153	143	143
query22	5394	5130	5143	5130
query23	32766	31838	31944	31838
query24	7112	6626	6632	6626
query25	582	480	481	480
query26	685	193	196	193
query27	2019	333	340	333
query28	6038	2411	2366	2366
query29	3090	2790	2828	2790
query30	282	213	205	205
query31	1020	821	884	821
query32	99	91	90	90
query33	494	349	341	341
query34	894	522	548	522
query35	1180	966	941	941
query36	1307	1330	1225	1225
query37	121	88	93	88
query38	3063	2961	3003	2961
query39	1493	1432	1432	1432
query40	356	145	151	145
query41	155	158	153	153
query42	109	119	113	113
query43	719	664	673	664
query44	1212	789	780	780
query45	281	269	267	267
query46	1278	1009	1014	1009
query47	1847	1737	1688	1688
query48	1036	736	755	736
query49	867	590	595	590
query50	938	689	703	689
query51	4822	4705	4763	4705
query52	122	105	116	105
query53	503	380	368	368
query54	2699	2546	2530	2530
query55	107	100	102	100
query56	320	295	285	285
query57	1346	1137	1186	1137
query58	312	321	314	314
query59	3688	3309	3230	3230
query60	309	276	284	276
query61	158	159	162	159
query62	956	542	570	542
query63	543	401	408	401
query64	2853	1713	1670	1670
query65	3645	3628	3627	3627
query66	1246	812	813	812
query67	15839	14813	15149	14813
query68	10667	675	712	675
query69	630	397	416	397
query70	2211	1499	1411	1411
query71	477	363	358	358
query72	6564	3519	3576	3519
query73	783	374	376	374
query74	6373	5958	5873	5873
query75	5591	3823	3819	3819
query76	7031	1216	1269	1216
query77	1344	427	421	421
query78	12704	11655	11760	11655
query79	8028	683	708	683
query80	987	547	549	547
query81	527	278	278	278
query82	849	133	124	124
query83	258	214	215	214
query84	286	98	98	98
query85	978	412	412	412
query86	374	322	319	319
query87	3236	3039	3098	3039
query88	4741	2551	2531	2531
query89	505	352	331	331
query90	2011	263	267	263
query91	191	160	166	160
query92	92	84	86	84
query93	6805	610	620	610
query94	751	251	245	245
query95	1145	1102	1088	1088
query96	666	346	353	346
query97	6496	6406	6437	6406
query98	216	210	229	210
query99	3042	1002	1006	1002
Total cold run time: 322216 ms
Total hot run time: 208446 ms

doris-robot · 2024-08-20T11:02:01Z

ClickBench: Total hot run time: 32.24 s

machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 00b93e258e0139c3a6bc009c2f23252967827d23, data reload: false
query1	0.02	0.02	0.02
query2	0.07	0.03	0.03
query3	0.26	0.05	0.05
query4	1.78	0.06	0.06
query5	0.52	0.53	0.53
query6	1.28	0.62	0.62
query7	0.01	0.01	0.02
query8	0.05	0.04	0.03
query9	0.51	0.49	0.48
query10	0.53	0.55	0.54
query11	0.13	0.09	0.10
query12	0.12	0.10	0.10
query13	0.63	0.62	0.62
query14	0.79	0.79	0.81
query15	0.78	0.78	0.76
query16	0.36	0.36	0.36
query17	0.98	0.98	1.01
query18	0.23	0.24	0.24
query19	1.90	1.85	1.89
query20	0.02	0.02	0.01
query21	15.46	0.57	0.57
query22	1.90	2.74	2.16
query23	17.31	1.08	1.02
query24	4.64	1.39	1.62
query25	0.39	0.06	0.06
query26	0.63	0.17	0.16
query27	0.04	0.06	0.05
query28	7.54	0.78	0.73
query29	12.79	2.22	2.34
query30	0.72	0.71	0.70
query31	2.82	0.40	0.39
query32	3.38	0.51	0.50
query33	3.09	3.09	3.12
query34	15.41	4.82	4.79
query35	4.85	4.84	4.85
query36	1.04	1.04	1.02
query37	0.08	0.06	0.06
query38	0.05	0.04	0.03
query39	0.04	0.03	0.03
query40	0.18	0.16	0.18
query41	0.08	0.04	0.03
query42	0.04	0.03	0.03
query43	0.04	0.04	0.04
Total cold run time: 103.49 s
Total hot run time: 32.24 s

doris-robot · 2024-08-20T11:22:01Z

TPC-H: Total hot run time: 50590 ms

machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 00b93e258e0139c3a6bc009c2f23252967827d23, data reload: false
------ Round 1 ----------------------------------
q1	17723	4376	4388	4376
q2	2098	208	193	193
q3	10157	1893	1992	1893
q4	10119	1272	1326	1272
q5	8492	3957	3968	3957
q6	276	143	141	141
q7	2101	1641	1636	1636
q8	9413	2798	2784	2784
q9	10682	10483	10236	10236
q10	8679	3585	3556	3556
q11	445	269	283	269
q12	507	333	337	333
q13	18382	4025	4019	4019
q14	382	335	353	335
q15	572	505	506	505
q16	713	605	607	605
q17	1159	1007	1027	1007
q18	7403	7011	6996	6996
q19	1757	1625	1545	1545
q20	597	354	324	324
q21	4481	4168	4224	4168
q22	534	446	440	440
Total cold run time: 116672 ms
Total hot run time: 50590 ms
----- Round 2, with runtime_filter_mode=off -----
q1	4351	4312	4402	4312
q2	363	271	262	262
q3	4184	4185	4138	4138
q4	2793	2778	2766	2766
q5	7192	7183	7152	7152
q6	261	139	136	136
q7	3284	2903	2887	2887
q8	4463	4525	4523	4523
q9	16939	16870	16810	16810
q10	4276	4296	4295	4295
q11	809	696	720	696
q12	1064	891	905	891
q13	7394	3762	3727	3727
q14	462	456	447	447
q15	546	501	513	501
q16	785	704	711	704
q17	3891	3885	3913	3885
q18	8795	8746	8674	8674
q19	1807	1766	1708	1708
q20	2387	2140	2193	2140
q21	8457	8442	8418	8418
q22	1081	959	950	950
Total cold run time: 85584 ms
Total hot run time: 80022 ms

github-actions · 2024-08-20T11:26:35Z

clang-tidy review says "All clean, LGTM! 👍"

doris-robot · 2024-08-20T11:35:02Z

TPC-DS: Total hot run time: 210210 ms

machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 00b93e258e0139c3a6bc009c2f23252967827d23, data reload: false
query1	980	417	406	406
query2	6760	2465	2170	2170
query3	6946	229	225	225
query4	20998	18424	18129	18129
query5	19925	6741	6777	6741
query6	320	269	279	269
query7	4188	339	360	339
query8	457	491	469	469
query9	3242	2822	2772	2772
query10	501	400	383	383
query11	11413	10824	10773	10773
query12	166	107	112	107
query13	5678	769	705	705
query14	18094	13806	14195	13806
query15	397	281	248	248
query16	6522	333	303	303
query17	1594	1474	939	939
query18	2338	481	476	476
query19	246	185	184	184
query20	109	117	115	115
query21	240	152	145	145
query22	5294	5150	5140	5140
query23	32792	32029	32137	32029
query24	7696	6639	6633	6633
query25	573	480	489	480
query26	745	193	188	188
query27	2076	331	335	331
query28	6104	2417	2379	2379
query29	2831	2881	2790	2790
query30	284	214	211	211
query31	996	831	851	831
query32	94	94	91	91
query33	488	355	354	354
query34	901	530	529	529
query35	1178	1031	1006	1006
query36	1351	1255	1125	1125
query37	116	93	90	90
query38	3177	2932	2985	2932
query39	1474	1432	1441	1432
query40	358	145	147	145
query41	158	160	154	154
query42	119	113	112	112
query43	684	705	726	705
query44	1212	793	796	793
query45	285	271	271	271
query46	1273	1026	1014	1014
query47	1933	1816	1895	1816
query48	1048	759	734	734
query49	858	596	607	596
query50	944	707	686	686
query51	4784	4785	4736	4736
query52	114	109	110	109
query53	514	374	377	374
query54	2724	2543	2547	2543
query55	111	101	100	100
query56	323	301	274	274
query57	1416	1244	1170	1170
query58	331	327	321	321
query59	3505	3298	3351	3298
query60	297	285	306	285
query61	163	158	159	158
query62	867	563	562	562
query63	558	395	411	395
query64	2998	1758	1632	1632
query65	3644	3598	3644	3598
query66	1216	821	817	817
query67	17648	15269	15246	15246
query68	9525	716	698	698
query69	633	432	408	408
query70	1759	1569	1521	1521
query71	462	380	366	366
query72	6823	3580	3554	3554
query73	776	372	358	358
query74	6318	6016	5879	5879
query75	5388	3785	3852	3785
query76	5894	1201	1255	1201
query77	1178	424	423	423
query78	12486	14472	12205	12205
query79	10580	719	694	694
query80	870	557	561	557
query81	537	280	277	277
query82	267	129	129	129
query83	259	221	221	221
query84	288	100	99	99
query85	914	411	412	411
query86	359	337	355	337
query87	3298	3038	3127	3038
query88	5039	2538	2538	2538
query89	407	332	352	332
query90	2515	253	265	253
query91	192	165	157	157
query92	92	85	83	83
query93	1604	565	592	565
query94	1046	252	249	249
query95	1175	1119	1110	1110
query96	652	368	343	343
query97	6568	6506	6388	6388
query98	225	226	207	207
query99	3046	905	924	905
Total cold run time: 320544 ms
Total hot run time: 210210 ms

doris-robot · 2024-08-20T11:40:33Z

ClickBench: Total hot run time: 30.97 s

machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 00b93e258e0139c3a6bc009c2f23252967827d23, data reload: false
query1	0.02	0.01	0.02
query2	0.07	0.03	0.02
query3	0.25	0.05	0.06
query4	1.76	0.08	0.08
query5	0.54	0.53	0.53
query6	1.35	0.63	0.67
query7	0.02	0.01	0.02
query8	0.04	0.03	0.03
query9	0.52	0.49	0.49
query10	0.53	0.54	0.55
query11	0.14	0.09	0.10
query12	0.12	0.10	0.10
query13	0.62	0.61	0.61
query14	0.78	0.79	0.80
query15	0.79	0.77	0.78
query16	0.36	0.37	0.39
query17	1.05	1.01	1.02
query18	0.23	0.22	0.27
query19	1.89	1.89	1.84
query20	0.01	0.01	0.01
query21	15.46	0.68	0.54
query22	2.27	2.51	1.58
query23	17.22	0.96	1.04
query24	6.89	1.90	0.67
query25	0.37	0.10	0.06
query26	0.82	0.16	0.15
query27	0.05	0.05	0.04
query28	5.68	0.75	0.78
query29	12.62	2.30	2.28
query30	0.76	0.73	0.77
query31	2.80	0.40	0.38
query32	3.37	0.52	0.50
query33	3.08	3.07	3.08
query34	15.25	4.82	4.80
query35	4.87	4.86	4.86
query36	1.10	1.02	1.02
query37	0.08	0.06	0.06
query38	0.06	0.03	0.03
query39	0.03	0.03	0.04
query40	0.18	0.17	0.17
query41	0.09	0.04	0.03
query42	0.03	0.04	0.03
query43	0.04	0.03	0.03
Total cold run time: 104.21 s
Total hot run time: 30.97 s

doris-robot · 2024-08-20T11:43:44Z

Load test result on machine: 'aliyun_ecs.c7a.8xlarge_32C64G'

Load test result on commit 00b93e258e0139c3a6bc009c2f23252967827d23 with default session variables
Stream load json: 19 seconds loaded 2358488459 Bytes, about 118 MB/s
Stream load orc: 58 seconds loaded 1101869774 Bytes, about 18 MB/s
Stream load parquet: 31 seconds loaded 861443392 Bytes, about 26 MB/s
Insert into select: 21.3 seconds inserted 10000000 Rows, about 469K ops/s

zhannngchen · 2024-08-21T07:55:20Z

run buildall

github-actions · 2024-08-21T08:03:06Z

clang-tidy review says "All clean, LGTM! 👍"

doris-robot · 2024-08-21T08:19:08Z

TeamCity be ut coverage result:
Function Coverage: 37.84% (8132/21489)
Line Coverage: 29.55% (66849/226196)
Region Coverage: 29.03% (34466/118728)
Branch Coverage: 24.91% (17726/71174)
Coverage Report: http://coverage.selectdb-in.cc/coverage/1942db9a04e309364c0e39ed83fc34653c1b05d5_1942db9a04e309364c0e39ed83fc34653c1b05d5/report/index.html

doris-robot · 2024-08-21T08:30:34Z

TPC-H: Total hot run time: 50182 ms

machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 1942db9a04e309364c0e39ed83fc34653c1b05d5, data reload: false
------ Round 1 ----------------------------------
q1	18185	4459	4383	4383
q2	2105	199	192	192
q3	10356	1925	1976	1925
q4	10358	1254	1361	1254
q5	8542	3946	4026	3946
q6	276	144	142	142
q7	2093	1656	1681	1656
q8	9592	2786	2763	2763
q9	13828	10235	10169	10169
q10	8680	3527	3501	3501
q11	440	277	275	275
q12	493	333	333	333
q13	18377	4016	4069	4016
q14	376	350	351	350
q15	553	508	520	508
q16	688	607	605	605
q17	1156	977	928	928
q18	7225	6816	6904	6816
q19	1756	1624	1553	1553
q20	559	347	326	326
q21	4444	4273	4103	4103
q22	538	449	438	438
Total cold run time: 120620 ms
Total hot run time: 50182 ms
----- Round 2, with runtime_filter_mode=off -----
q1	4338	4340	4360	4340
q2	362	269	265	265
q3	4256	4151	4156	4151
q4	2806	2785	2771	2771
q5	7236	7145	7179	7145
q6	255	138	140	138
q7	3317	2860	2918	2860
q8	4438	4533	4597	4533
q9	16976	16713	16751	16713
q10	4226	4302	4284	4284
q11	793	724	713	713
q12	1062	863	882	863
q13	6239	3742	3737	3737
q14	477	435	445	435
q15	545	502	521	502
q16	771	709	714	709
q17	3825	3841	3776	3776
q18	8783	8921	8707	8707
q19	1790	1761	1753	1753
q20	2373	2158	2143	2143
q21	8548	8522	8566	8522
q22	1066	983	993	983
Total cold run time: 84482 ms
Total hot run time: 80043 ms

doris-robot · 2024-08-21T08:43:35Z

TPC-DS: Total hot run time: 208444 ms

machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 1942db9a04e309364c0e39ed83fc34653c1b05d5, data reload: false
query1	967	423	409	409
query2	6751	2440	2300	2300
query3	6949	243	222	222
query4	20879	18188	18115	18115
query5	19938	6705	6757	6705
query6	331	249	268	249
query7	4188	322	341	322
query8	489	462	446	446
query9	3244	2788	2737	2737
query10	500	375	369	369
query11	11376	10925	10817	10817
query12	158	112	109	109
query13	5693	724	734	724
query14	18305	13914	13842	13842
query15	394	255	248	248
query16	6492	326	302	302
query17	1573	1497	937	937
query18	2313	479	496	479
query19	242	179	190	179
query20	113	112	114	112
query21	241	145	147	145
query22	5290	5001	5020	5001
query23	32746	31893	32050	31893
query24	6977	6582	6574	6574
query25	582	482	495	482
query26	650	200	191	191
query27	1911	327	329	327
query28	6096	2430	2364	2364
query29	3052	2812	2685	2685
query30	287	209	205	205
query31	1030	880	814	814
query32	100	96	83	83
query33	484	328	323	323
query34	892	519	518	518
query35	1182	1041	1004	1004
query36	1385	1189	1211	1189
query37	117	88	91	88
query38	3136	2984	2928	2928
query39	1529	1441	1439	1439
query40	262	147	150	147
query41	159	152	152	152
query42	112	111	110	110
query43	662	570	702	570
query44	1166	782	778	778
query45	279	268	267	267
query46	1273	1031	1021	1021
query47	2025	2115	1904	1904
query48	1044	741	729	729
query49	843	589	577	577
query50	948	682	685	682
query51	4888	4712	4782	4712
query52	123	100	109	100
query53	511	371	371	371
query54	2715	2539	2529	2529
query55	113	103	97	97
query56	310	312	281	281
query57	1246	1207	1215	1207
query58	321	312	298	298
query59	3449	3297	3553	3297
query60	294	270	288	270
query61	164	157	157	157
query62	894	539	511	511
query63	544	397	396	396
query64	2463	1685	1628	1628
query65	3715	3655	3595	3595
query66	1296	800	803	800
query67	16007	14917	15407	14917
query68	10236	692	692	692
query69	634	406	402	402
query70	1896	1539	1372	1372
query71	472	357	368	357
query72	6607	3525	3581	3525
query73	784	367	364	364
query74	6396	5978	5917	5917
query75	5409	3806	3843	3806
query76	6520	1232	1125	1125
query77	1219	428	410	410
query78	12735	11918	11673	11673
query79	7938	684	665	665
query80	1251	559	539	539
query81	530	277	286	277
query82	1616	125	130	125
query83	257	216	222	216
query84	293	98	97	97
query85	972	411	409	409
query86	377	337	337	337
query87	3276	3031	3052	3031
query88	4887	2541	2534	2534
query89	437	333	346	333
query90	2003	247	248	247
query91	198	160	158	158
query92	90	87	85	85
query93	6560	589	605	589
query94	742	249	257	249
query95	1150	1088	1100	1088
query96	652	330	348	330
query97	6467	6450	6428	6428
query98	221	212	208	208
query99	3024	907	877	877
Total cold run time: 322257 ms
Total hot run time: 208444 ms

doris-robot · 2024-08-21T08:49:02Z

ClickBench: Total hot run time: 30.98 s

machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 1942db9a04e309364c0e39ed83fc34653c1b05d5, data reload: false
query1	0.02	0.02	0.02
query2	0.07	0.03	0.02
query3	0.25	0.05	0.05
query4	1.76	0.08	0.08
query5	0.54	0.52	0.53
query6	1.25	0.61	0.61
query7	0.02	0.01	0.01
query8	0.04	0.03	0.03
query9	0.51	0.48	0.48
query10	0.55	0.54	0.55
query11	0.13	0.10	0.10
query12	0.13	0.10	0.10
query13	0.63	0.62	0.62
query14	0.78	0.78	0.80
query15	0.78	0.77	0.77
query16	0.40	0.37	0.37
query17	1.01	1.02	0.99
query18	0.24	0.24	0.25
query19	1.91	1.85	1.84
query20	0.02	0.01	0.02
query21	15.46	0.59	0.56
query22	1.86	1.93	1.63
query23	17.44	1.12	0.85
query24	4.23	0.83	1.30
query25	0.29	0.12	0.06
query26	0.56	0.17	0.17
query27	0.04	0.03	0.04
query28	8.91	0.74	0.71
query29	12.64	2.39	2.25
query30	0.73	0.73	0.71
query31	2.82	0.40	0.39
query32	3.37	0.51	0.51
query33	3.10	3.08	3.12
query34	15.27	4.80	4.77
query35	4.88	4.87	4.84
query36	1.07	1.04	1.03
query37	0.07	0.06	0.06
query38	0.06	0.03	0.04
query39	0.04	0.04	0.03
query40	0.18	0.16	0.18
query41	0.07	0.03	0.04
query42	0.04	0.03	0.03
query43	0.04	0.04	0.04
Total cold run time: 104.21 s
Total hot run time: 30.98 s

doris-robot · 2024-08-21T08:52:15Z

Load test result on machine: 'aliyun_ecs.c7a.8xlarge_32C64G'

Load test result on commit 1942db9a04e309364c0e39ed83fc34653c1b05d5 with default session variables
Stream load json: 20 seconds loaded 2358488459 Bytes, about 112 MB/s
Stream load orc: 58 seconds loaded 1101869774 Bytes, about 18 MB/s
Stream load parquet: 31 seconds loaded 861443392 Bytes, about 26 MB/s
Insert into select: 21.4 seconds inserted 10000000 Rows, about 467K ops/s

…he#39153) cherry-pick apache#38165 and apache#22928

[fix](ut) repair segcompaction ut (apache#38165)
d98cb1e

zhannngchen force-pushed the cp-38165-2.0 branch from 5ff1d5e to d98cb1eCompare August 20, 2024 07:46

fix compile
5b8484f

fix compile
00b93e2

[refactor](load) change segcompaction worker interface (apache#22928)
bc3bff3

fix ut
1942db9

zhannngchen merged commit 7e52a1a into apache:branch-2.0Aug 21, 2024

mongo360 pushed a commit to mongo360/doris that referenced this pull request Dec 11, 2024
[fix](ut) repair segcompaction ut (apache#38165) (apache#38225) (apac…
7f1ae42
…he#39153) cherry-pick apache#38165 and apache#22928

Uh oh!

Conversation

zhannngchen commented Aug 9, 2024• edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Proposed changes

Uh oh!

doris-robot commented Aug 9, 2024

Uh oh!

zhannngchen commented Aug 9, 2024

Uh oh!

github-actionsBot commented Aug 9, 2024

Uh oh!

doris-robot commented Aug 9, 2024

Uh oh!

doris-robot commented Aug 9, 2024

Uh oh!

doris-robot commented Aug 9, 2024

Uh oh!

doris-robot commented Aug 9, 2024

Uh oh!

zhannngchen commented Aug 20, 2024

Uh oh!

zhannngchen commented Aug 20, 2024

Uh oh!

zhannngchen commented Aug 20, 2024

Uh oh!

doris-robot commented Aug 20, 2024

Uh oh!

doris-robot commented Aug 20, 2024

Uh oh!

doris-robot commented Aug 20, 2024

Uh oh!

doris-robot commented Aug 20, 2024

Uh oh!

doris-robot commented Aug 20, 2024

Uh oh!

doris-robot commented Aug 20, 2024

Uh oh!

doris-robot commented Aug 20, 2024

Uh oh!

github-actionsBot commented Aug 20, 2024

Uh oh!

doris-robot commented Aug 20, 2024

Uh oh!

doris-robot commented Aug 20, 2024

Uh oh!

doris-robot commented Aug 20, 2024

Uh oh!

zhannngchen commented Aug 21, 2024

Uh oh!

github-actionsBot commented Aug 21, 2024

Uh oh!

doris-robot commented Aug 21, 2024

Uh oh!

doris-robot commented Aug 21, 2024

Uh oh!

doris-robot commented Aug 21, 2024

Uh oh!

doris-robot commented Aug 21, 2024

Uh oh!

doris-robot commented Aug 21, 2024

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

3 participants

zhannngchen commented Aug 9, 2024•
edited
Loading