[Fix](Compaction) Fix full clone failure when rowset missing by Yukang-Lian · Pull Request #53984 · apache/doris

Yukang-Lian · 2025-07-28T13:46:03Z

What problem does this PR solve?

Issue Number: close #xxx

Related PR: #52812

Problem Summary:

Release note

None

Check List (For Author)

Test
- Regression test
- Unit Test
- Manual test (add detailed scripts or steps below)
- No need to test or manual test. Explain why:
  - This is a refactor/code format and no logic has been changed.
  - Previous test can cover this change.
  - No code files have been changed.
  - Other reason
Behavior changed:
- No.
- Yes.
Does this need documentation?
- No.
- Yes.

Check List (For Reviewer who merge this PR)

Confirm the release note
Confirm test cases
Confirm document
Add branch pick label

hello-stephen · 2025-07-28T13:46:09Z

Thank you for your contribution to Apache Doris.
Don't know what should be done next? See How to process your PR.

Please clearly describe your PR:

What problem was fixed (it's best to include specific error reporting information). How it was fixed.
Which behaviors were modified. What was the previous behavior, what is it now, why was it modified, and what possible impacts might there be.
What features were added. Why was this function added?
Which code was refactored and why was this part of the code refactored?
Which functions were optimized and what is the difference before and after the optimization?

Yukang-Lian · 2025-07-29T06:55:18Z

run buildall

doris-robot · 2025-07-29T07:13:44Z

TPC-H: Total hot run time: 34009 ms

machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit e4b0035c42f71ba92703438fb3eef720e3beeac3, data reload: false
------ Round 1 ----------------------------------
q1	17697	5613	5594	5594
q2	1972	270	196	196
q3	10278	1308	688	688
q4	10224	978	519	519
q5	7504	2346	2288	2288
q6	178	171	135	135
q7	912	782	603	603
q8	9297	1289	1046	1046
q9	6850	5033	5088	5033
q10	6896	2344	1967	1967
q11	459	288	265	265
q12	352	364	225	225
q13	17784	3464	3019	3019
q14	235	232	221	221
q15	527	465	456	456
q16	411	430	379	379
q17	561	829	358	358
q18	7773	7091	7028	7028
q19	1213	980	525	525
q20	325	318	217	217
q21	3351	3005	2265	2265
q22	1032	1064	982	982
Total cold run time: 105831 ms
Total hot run time: 34009 ms
----- Round 2, with runtime_filter_mode=off -----
q1	5836	5789	5708	5708
q2	233	311	210	210
q3	2048	2572	2193	2193
q4	1312	1733	1318	1318
q5	4111	4509	4487	4487
q6	222	177	142	142
q7	1956	1929	1809	1809
q8	2518	2513	2541	2513
q9	7410	7301	7279	7279
q10	3242	3345	2857	2857
q11	541	607	542	542
q12	667	755	585	585
q13	3467	3646	3324	3324
q14	303	334	316	316
q15	514	458	472	458
q16	465	473	607	473
q17	1245	1544	1373	1373
q18	13881	7711	8166	7711
q19	16215	926	846	846
q20	2613	1980	1896	1896
q21	15306	4483	4265	4265
q22	1041	1042	996	996
Total cold run time: 85146 ms
Total hot run time: 51301 ms

doris-robot · 2025-07-29T07:25:36Z

TPC-DS: Total hot run time: 173404 ms

machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit e4b0035c42f71ba92703438fb3eef720e3beeac3, data reload: false
============================================
query1	1012	397	430	397
query2	6503	1764	1607	1607
query3	6747	234	230	230
query4	26998	23322	22902	22902
query5	4338	600	510	510
query6	321	242	235	235
query7	4632	521	308	308
query8	283	242	233	233
query9	8595	3215	3209	3209
query10	466	367	288	288
query11	15767	14875	14803	14803
query12	183	135	129	129
query13	1669	555	408	408
query14	9444	7648	7794	7648
query15	210	209	173	173
query16	7117	649	452	452
query17	1228	740	606	606
query18	2038	455	311	311
query19	222	207	194	194
query20	153	139	132	132
query21	217	125	110	110
query22	4085	3971	4014	3971
query23	34245	33919	33912	33912
query24	8097	2390	2404	2390
query25	576	502	446	446
query26	1245	289	160	160
query27	2709	499	355	355
query28	4366	2320	2322	2320
query29	831	608	504	504
query30	308	243	207	207
query31	882	792	720	720
query32	89	81	80	80
query33	570	421	387	387
query34	813	834	545	545
query35	808	807	783	783
query36	1105	1044	986	986
query37	133	110	96	96
query38	3971	4030	3976	3976
query39	1445	1365	1386	1365
query40	239	172	128	128
query41	70	60	56	56
query42	143	120	125	120
query43	495	516	474	474
query44	1420	890	903	890
query45	199	183	181	181
query46	945	1063	673	673
query47	1815	1832	1756	1756
query48	405	434	333	333
query49	715	546	434	434
query50	657	709	439	439
query51	5496	5557	5448	5448
query52	130	130	119	119
query53	261	292	210	210
query54	662	706	567	567
query55	96	90	90	90
query56	368	361	360	360
query57	1214	1222	1115	1115
query58	341	326	333	326
query59	2583	2605	2510	2510
query60	414	414	387	387
query61	135	125	129	125
query62	828	729	634	634
query63	259	213	219	213
query64	4458	1217	850	850
query65	4196	4099	4087	4087
query66	1153	451	343	343
query67	query68	16911	873	1278	873
query69	1039	281	295	281
query70	1422	1145	1134	1134
query71	714	320	328	320
query72	9195	2384	2169	2169
query73	3090	680	371	371
query74	8983	8997	8787	8787
query75	7449	3139	2668	2668
query76	8718	1269	774	774
query77	1162	416	363	363
query78	9564	10014	9375	9375
query79	13910	680	586	586
query80	1027	559	487	487
query81	562	256	229	229
query82	312	159	121	121
query83	342	279	269	269
query84	305	102	83	83
query85	822	371	339	339
query86	359	313	309	309
query87	4364	4311	4233	4233
query88	4114	2342	2316	2316
query89	479	357	329	329
query90	2675	224	229	224
query91	142	151	112	112
query92	84	73	68	68
query93	4339	990	654	654
query94	870	387	281	281
query95	408	342	322	322
query96	507	594	285	285
query97	2761	2756	2585	2585
query98	259	246	228	228
query99	1459	1444	1273	1273
Total cold run time: 302465 ms
Total hot run time: 173404 ms

doris-robot · 2025-07-29T07:31:03Z

ClickBench: Total hot run time: 32.5 s

machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit e4b0035c42f71ba92703438fb3eef720e3beeac3, data reload: false
query1	0.04	0.04	0.03
query2	0.08	0.04	0.04
query3	0.24	0.08	0.07
query4	1.61	0.11	0.11
query5	0.43	0.42	0.45
query6	1.15	0.72	0.69
query7	0.02	0.02	0.01
query8	0.05	0.04	0.04
query9	0.57	0.47	0.47
query10	0.52	0.53	0.51
query11	0.16	0.10	0.10
query12	0.15	0.12	0.11
query13	0.63	0.63	0.64
query14	0.92	1.21	0.91
query15	0.96	0.89	0.90
query16	0.40	0.39	0.37
query17	1.04	1.08	1.05
query18	0.22	0.21	0.20
query19	2.01	1.79	1.90
query20	0.01	0.02	0.01
query21	15.37	0.83	0.54
query22	0.75	1.17	0.64
query23	14.96	1.17	0.64
query24	7.06	1.69	0.36
query25	0.32	0.18	0.18
query26	0.78	0.17	0.14
query27	0.05	0.05	0.05
query28	8.96	0.85	0.45
query29	12.60	3.83	3.36
query30	3.10	2.94	2.92
query31	2.81	0.57	0.39
query32	3.24	0.56	0.50
query33	2.98	3.22	3.20
query34	16.05	5.36	4.91
query35	4.88	4.93	5.04
query36	0.69	0.51	0.49
query37	0.09	0.07	0.07
query38	0.06	0.05	0.04
query39	0.03	0.03	0.03
query40	0.16	0.14	0.13
query41	0.08	0.03	0.03
query42	0.04	0.03	0.02
query43	0.03	0.04	0.03
Total cold run time: 106.3 s
Total hot run time: 32.5 s

Yukang-Lian · 2025-07-29T09:10:34Z

run buildall

doris-robot · 2025-07-29T09:28:46Z

TPC-H: Total hot run time: 34097 ms

machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit f2b171a6cfbbc9698eb50cbc3f9cd99718cb2f52, data reload: false
------ Round 1 ----------------------------------
q1	17614	5753	5549	5549
q2	1923	274	183	183
q3	10317	1275	702	702
q4	10225	978	512	512
q5	7539	2256	2301	2256
q6	184	167	132	132
q7	892	762	624	624
q8	9303	1301	1048	1048
q9	6885	5029	5135	5029
q10	6921	2407	1982	1982
q11	469	291	276	276
q12	343	371	223	223
q13	17768	3507	3078	3078
q14	265	242	218	218
q15	518	485	479	479
q16	432	430	373	373
q17	581	803	386	386
q18	7679	7025	7104	7025
q19	1212	975	528	528
q20	317	319	219	219
q21	3359	3039	2313	2313
q22	1017	1058	962	962
Total cold run time: 105763 ms
Total hot run time: 34097 ms
----- Round 2, with runtime_filter_mode=off -----
q1	5748	5786	5760	5760
q2	228	305	227	227
q3	2076	2549	2185	2185
q4	1284	1715	1337	1337
q5	4203	4562	4504	4504
q6	211	174	136	136
q7	2013	1960	1845	1845
q8	2521	2597	2448	2448
q9	7372	7418	7378	7378
q10	3207	3323	3146	3146
q11	546	518	493	493
q12	665	772	608	608
q13	3284	3751	3375	3375
q14	342	316	284	284
q15	506	448	459	448
q16	489	520	472	472
q17	1108	1426	1549	1426
q18	8110	7866	7544	7544
q19	8739	952	1112	952
q20	1988	2098	1845	1845
q21	5042	4393	4276	4276
q22	1056	1027	963	963
Total cold run time: 60738 ms
Total hot run time: 51652 ms

doris-robot · 2025-07-29T09:40:45Z

TPC-DS: Total hot run time: 173645 ms

machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit f2b171a6cfbbc9698eb50cbc3f9cd99718cb2f52, data reload: false
============================================
query1	1044	396	424	396
query2	6508	1781	1646	1646
query3	6741	231	227	227
query4	27153	23807	23150	23150
query5	4364	667	550	550
query6	348	247	232	232
query7	4648	517	303	303
query8	288	242	229	229
query9	8626	3200	3176	3176
query10	496	348	285	285
query11	15538	15121	14772	14772
query12	185	141	127	127
query13	1652	553	428	428
query14	9505	7739	7822	7739
query15	225	202	178	178
query16	7946	649	458	458
query17	1651	819	661	661
query18	2115	461	339	339
query19	308	241	204	204
query20	157	146	144	144
query21	221	129	114	114
query22	4001	3999	3847	3847
query23	34162	33586	34115	33586
query24	8224	2445	2425	2425
query25	560	515	447	447
query26	1156	288	162	162
query27	2648	505	355	355
query28	4253	2322	2322	2322
query29	769	606	493	493
query30	303	233	205	205
query31	877	776	719	719
query32	87	79	77	77
query33	619	414	418	414
query34	822	850	529	529
query35	779	817	769	769
query36	1041	1062	948	948
query37	159	108	98	98
query38	4156	4075	4034	4034
query39	1450	1379	1390	1379
query40	246	150	130	130
query41	62	61	60	60
query42	144	127	131	127
query43	488	525	480	480
query44	1433	899	896	896
query45	199	185	186	185
query46	1016	1055	677	677
query47	1776	1826	1753	1753
query48	400	439	321	321
query49	704	513	423	423
query50	659	691	417	417
query51	5480	5542	5459	5459
query52	131	136	117	117
query53	268	293	213	213
query54	662	657	570	570
query55	97	90	93	90
query56	363	360	362	360
query57	1217	1227	1137	1137
query58	342	336	341	336
query59	2637	2579	2622	2579
query60	409	425	406	406
query61	127	127	121	121
query62	793	731	653	653
query63	251	218	213	213
query64	4232	1086	782	782
query65	4231	4069	4105	4069
query66	1058	442	417	417
query67	query68	17607	589	594	589
query69	1015	305	305	305
query70	1506	1141	1126	1126
query71	687	338	333	333
query72	9209	2264	2309	2264
query73	3591	635	367	367
query74	8987	8992	8831	8831
query75	7497	3127	2639	2639
query76	8616	1244	800	800
query77	1162	413	345	345
query78	9595	9923	9410	9410
query79	14272	654	572	572
query80	868	560	512	512
query81	536	267	233	233
query82	451	152	127	127
query83	323	290	278	278
query84	300	108	90	90
query85	877	446	459	446
query86	348	304	314	304
query87	4287	4309	4173	4173
query88	5459	2301	2266	2266
query89	464	373	320	320
query90	2491	230	225	225
query91	144	144	121	121
query92	90	72	72	72
query93	6040	985	652	652
query94	928	393	274	274
query95	418	345	330	330
query96	508	593	286	286
query97	2743	2716	2626	2626
query98	242	236	218	218
query99	1451	1403	1353	1353
Total cold run time: 307922 ms
Total hot run time: 173645 ms

doris-robot · 2025-07-29T09:46:14Z

ClickBench: Total hot run time: 33.28 s

machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit f2b171a6cfbbc9698eb50cbc3f9cd99718cb2f52, data reload: false
query1	0.06	0.04	0.04
query2	0.08	0.04	0.04
query3	0.25	0.07	0.07
query4	1.62	0.11	0.11
query5	0.44	0.43	0.43
query6	1.17	0.68	0.71
query7	0.02	0.02	0.02
query8	0.05	0.04	0.04
query9	0.58	0.48	0.46
query10	0.53	0.54	0.52
query11	0.16	0.10	0.10
query12	0.15	0.12	0.11
query13	0.66	0.66	0.64
query14	0.93	1.10	1.24
query15	0.91	0.90	0.91
query16	0.38	0.38	0.38
query17	1.06	1.04	1.06
query18	0.21	0.21	0.20
query19	2.07	1.94	1.91
query20	0.02	0.01	0.02
query21	15.37	0.85	0.54
query22	0.80	1.21	0.71
query23	14.84	1.22	0.63
query24	6.45	2.30	0.79
query25	0.49	0.22	0.09
query26	0.52	0.19	0.15
query27	0.05	0.05	0.06
query28	9.95	0.84	0.44
query29	12.56	3.91	3.36
query30	3.11	3.00	2.97
query31	2.84	0.58	0.41
query32	3.24	0.56	0.49
query33	3.09	3.29	3.20
query34	15.98	5.28	4.87
query35	4.83	4.96	4.92
query36	0.70	0.52	0.50
query37	0.09	0.07	0.08
query38	0.07	0.04	0.04
query39	0.04	0.03	0.03
query40	0.17	0.14	0.14
query41	0.09	0.03	0.03
query42	0.04	0.02	0.03
query43	0.04	0.04	0.03
Total cold run time: 106.71 s
Total hot run time: 33.28 s

dataroaring · 2025-07-29T14:41:59Z

run buildall

doris-robot · 2025-07-29T15:14:59Z

TPC-H: Total hot run time: 33954 ms

machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit bd86aed4d15523ed6e07775cdcd1eb8de0e5da90, data reload: false
------ Round 1 ----------------------------------
q1	17626	5606	5631	5606
q2	1918	290	192	192
q3	10326	1336	679	679
q4	10227	1091	508	508
q5	7524	2288	2238	2238
q6	181	172	128	128
q7	883	749	641	641
q8	9318	1248	1067	1067
q9	6801	5100	5072	5072
q10	6885	2335	1985	1985
q11	459	283	261	261
q12	339	358	216	216
q13	17773	3432	2974	2974
q14	257	235	224	224
q15	532	469	463	463
q16	413	433	380	380
q17	540	823	355	355
q18	7405	7102	6872	6872
q19	2214	963	528	528
q20	323	315	210	210
q21	2695	3017	2367	2367
q22	1105	1027	988	988
Total cold run time: 105744 ms
Total hot run time: 33954 ms
----- Round 2, with runtime_filter_mode=off -----
q1	5889	5746	6076	5746
q2	228	307	212	212
q3	2140	2533	2207	2207
q4	1281	1719	1289	1289
q5	4135	4445	4343	4343
q6	221	180	130	130
q7	2006	1852	1733	1733
q8	2627	2586	2401	2401
q9	7370	7387	7331	7331
q10	3169	3252	3019	3019
q11	554	510	483	483
q12	715	791	611	611
q13	3376	3730	3184	3184
q14	352	326	307	307
q15	507	455	457	455
q16	429	470	435	435
q17	1176	1436	1356	1356
q18	7951	7596	7832	7596
q19	11990	892	980	892
q20	2835	1906	1809	1809
q21	14079	4227	4218	4218
q22	1071	1033	1018	1018
Total cold run time: 74101 ms
Total hot run time: 50775 ms

doris-robot · 2025-07-29T15:26:48Z

TPC-DS: Total hot run time: 173008 ms

machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit bd86aed4d15523ed6e07775cdcd1eb8de0e5da90, data reload: false
============================================
query1	1020	400	403	400
query2	6562	1661	1702	1661
query3	6736	225	214	214
query4	27129	24102	23287	23287
query5	4681	664	517	517
query6	318	232	231	231
query7	4627	513	288	288
query8	279	238	221	221
query9	8581	3139	3152	3139
query10	479	340	296	296
query11	15781	15031	14684	14684
query12	180	133	128	128
query13	1658	565	431	431
query14	9488	7703	7725	7703
query15	205	191	174	174
query16	7129	663	472	472
query17	982	760	638	638
query18	2016	460	327	327
query19	225	228	183	183
query20	153	148	144	144
query21	215	126	113	113
query22	4111	3943	3950	3943
query23	34247	34061	34028	34028
query24	5420	2382	2462	2382
query25	505	496	449	449
query26	710	291	156	156
query27	2296	482	351	351
query28	3009	2271	2252	2252
query29	653	596	511	511
query30	286	235	205	205
query31	876	807	691	691
query32	85	75	78	75
query33	540	406	367	367
query34	813	823	510	510
query35	805	801	753	753
query36	1003	1023	938	938
query37	134	108	86	86
query38	3959	3985	3931	3931
query39	1460	1385	1538	1385
query40	238	142	132	132
query41	59	66	53	53
query42	137	119	133	119
query43	498	493	469	469
query44	1385	860	874	860
query45	204	187	186	186
query46	932	1060	661	661
query47	1832	1833	1799	1799
query48	401	429	316	316
query49	670	520	412	412
query50	636	700	410	410
query51	5556	5509	5511	5509
query52	125	134	118	118
query53	273	286	202	202
query54	667	630	569	569
query55	89	86	86	86
query56	349	360	341	341
query57	1206	1238	1154	1154
query58	331	330	330	330
query59	2564	2563	2620	2563
query60	400	394	399	394
query61	123	120	122	120
query62	753	725	665	665
query63	254	210	206	206
query64	2347	1064	774	774
query65	4223	4068	4139	4068
query66	1039	446	321	321
query67	query68	18739	875	594	594
query69	995	298	274	274
query70	1469	1124	1091	1091
query71	728	331	323	323
query72	9207	2257	2361	2257
query73	3653	627	352	352
query74	9013	8845	8843	8843
query75	7599	3132	2664	2664
query76	8942	1192	784	784
query77	1144	403	331	331
query78	9688	12037	9219	9219
query79	14072	600	598	598
query80	1707	556	479	479
query81	588	275	240	240
query82	353	150	116	116
query83	406	279	271	271
query84	308	169	83	83
query85	883	382	326	326
query86	362	320	296	296
query87	4255	4212	4174	4174
query88	3813	2237	2235	2235
query89	476	368	327	327
query90	2638	218	217	217
query91	137	139	111	111
query92	90	68	66	66
query93	4844	1067	654	654
query94	1041	395	282	282
query95	392	325	310	310
query96	497	597	284	284
query97	2695	2734	2590	2590
query98	248	233	223	223
query99	1467	1431	1293	1293
Total cold run time: 299096 ms
Total hot run time: 173008 ms

doris-robot · 2025-07-29T15:32:15Z

ClickBench: Total hot run time: 33.07 s

machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit bd86aed4d15523ed6e07775cdcd1eb8de0e5da90, data reload: false
query1	0.04	0.04	0.04
query2	0.07	0.04	0.04
query3	0.25	0.09	0.07
query4	1.61	0.10	0.10
query5	0.41	0.43	0.44
query6	1.14	0.68	0.68
query7	0.03	0.02	0.02
query8	0.05	0.03	0.04
query9	0.57	0.48	0.47
query10	0.52	0.52	0.52
query11	0.16	0.10	0.10
query12	0.14	0.11	0.11
query13	0.65	0.66	0.65
query14	1.02	1.00	1.17
query15	0.90	0.88	0.89
query16	0.39	0.38	0.37
query17	1.06	1.07	1.04
query18	0.22	0.19	0.20
query19	1.94	1.84	1.79
query20	0.02	0.01	0.02
query21	15.40	0.84	0.55
query22	0.75	1.10	0.62
query23	15.05	1.17	0.62
query24	5.96	1.57	0.97
query25	0.49	0.09	0.12
query26	0.60	0.16	0.12
query27	0.08	0.06	0.05
query28	9.15	0.84	0.44
query29	12.61	3.78	3.30
query30	3.07	2.98	2.96
query31	2.82	0.56	0.40
query32	3.24	0.58	0.51
query33	3.01	3.18	3.15
query34	16.00	5.36	4.93
query35	4.91	4.97	5.00
query36	0.69	0.52	0.50
query37	0.09	0.08	0.07
query38	0.06	0.05	0.05
query39	0.03	0.03	0.02
query40	0.17	0.14	0.13
query41	0.08	0.03	0.03
query42	0.03	0.02	0.02
query43	0.05	0.04	0.03
Total cold run time: 105.53 s
Total hot run time: 33.07 s

hello-stephen · 2025-07-29T16:21:05Z

BE UT Coverage Report

Increment line coverage 0.00% (0/7) 🎉

Increment coverage report
Complete coverage report

Category	Coverage
Function Coverage	57.76% (16059/27802)
Line Coverage	46.48% (144382/310645)
Region Coverage	35.75% (108683/303991)
Branch Coverage	38.37% (47971/125007)

hello-stephen · 2025-07-29T17:08:08Z

BE Regression && UT Coverage Report

Increment line coverage 0.00% (0/7) 🎉

Increment coverage report
Complete coverage report

Category	Coverage
Function Coverage	81.17% (22155/27295)
Line Coverage	73.90% (229274/310237)
Region Coverage	61.65% (192185/311746)
Branch Coverage	65.40% (82672/126417)

Yukang-Lian · 2025-07-30T02:13:09Z

run p0

hello-stephen · 2025-07-30T04:25:13Z

BE Regression && UT Coverage Report

Increment line coverage 0.00% (0/7) 🎉

Increment coverage report
Complete coverage report

Category	Coverage
Function Coverage	81.13% (22145/27295)
Line Coverage	73.85% (229117/310237)
Region Coverage	61.57% (191930/311746)
Branch Coverage	65.34% (82601/126417)

Yukang-Lian · 2025-07-30T06:35:03Z

run buildall

doris-robot · 2025-07-30T08:06:39Z

TPC-H: Total hot run time: 33814 ms

machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 88af1e437fbd6c8be82486804390a596876cdab5, data reload: false
------ Round 1 ----------------------------------
q1	17641	5674	5458	5458
q2	1935	279	205	205
q3	10294	1281	692	692
q4	10231	996	495	495
q5	7508	2280	2242	2242
q6	178	164	129	129
q7	946	742	637	637
q8	9305	1420	1082	1082
q9	7184	5178	5122	5122
q10	6900	2360	1984	1984
q11	465	273	265	265
q12	346	376	229	229
q13	17794	3439	2950	2950
q14	240	240	211	211
q15	546	472	467	467
q16	420	430	364	364
q17	572	842	354	354
q18	7417	7002	6847	6847
q19	1231	985	553	553
q20	321	326	215	215
q21	3423	3107	2291	2291
q22	1059	1038	1022	1022
Total cold run time: 105956 ms
Total hot run time: 33814 ms
----- Round 2, with runtime_filter_mode=off -----
q1	5909	5882	5769	5769
q2	237	306	215	215
q3	2110	2554	2202	2202
q4	1320	1727	1364	1364
q5	4253	4490	4444	4444
q6	215	182	131	131
q7	1982	1860	1800	1800
q8	2562	2557	2473	2473
q9	7230	7481	7349	7349
q10	3129	3405	2874	2874
q11	541	497	511	497
q12	699	807	610	610
q13	3442	3700	3213	3213
q14	314	322	287	287
q15	506	485	589	485
q16	467	483	446	446
q17	1136	1500	1395	1395
q18	10343	7751	7707	7707
q19	2540	950	990	950
q20	2072	2092	1887	1887
q21	13299	4268	4346	4268
q22	1061	1061	960	960
Total cold run time: 65367 ms
Total hot run time: 51326 ms

doris-robot · 2025-07-30T08:18:24Z

TPC-DS: Total hot run time: 165357 ms

machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 88af1e437fbd6c8be82486804390a596876cdab5, data reload: false
reason	Doris	NULL	NULL	0	0	0	NULL	0	NULL	NULL	2023-12-26 22:43:56	2023-12-26 22:44:01	NULL	utf-8	NULL	NULL ============================================
query1	1067	403	394	394
query2	6528	1931	1681	1681
query3	6751	218	225	218
query4	27118	23745	23449	23449
query5	4372	629	525	525
query6	342	233	220	220
query7	4617	530	290	290
query8	296	241	211	211
query9	8594	3168	3160	3160
query10	462	330	285	285
query11	15643	15027	14797	14797
query12	187	144	133	133
query13	1703	552	411	411
query14	9769	8376	8598	8376
query15	274	202	172	172
query16	8016	680	512	512
query17	1651	801	632	632
query18	2104	448	328	328
query19	294	224	193	193
query20	153	145	131	131
query21	220	135	109	109
query22	4141	4041	3874	3874
query23	34490	34471	34232	34232
query24	7991	2386	2407	2386
query25	621	506	434	434
query26	797	297	161	161
query27	2543	494	346	346
query28	4304	2267	2279	2267
query29	663	610	494	494
query30	296	231	202	202
query31	871	785	772	772
query32	88	85	81	81
query33	558	412	372	372
query34	794	822	518	518
query35	813	843	778	778
query36	1036	1051	974	974
query37	138	108	94	94
query38	3988	4064	4020	4020
query39	1457	1385	1368	1368
query40	232	144	133	133
query41	64	58	56	56
query42	141	119	127	119
query43	501	505	457	457
query44	1385	885	869	869
query45	204	187	186	186
query46	935	1053	676	676
query47	1750	1844	1735	1735
query48	395	423	309	309
query49	697	486	411	411
query50	663	681	430	430
query51	5481	5547	5493	5493
query52	129	144	117	117
query53	256	297	219	219
query54	650	648	561	561
query55	96	108	85	85
query56	355	358	348	348
query57	1183	1250	1148	1148
query58	341	321	342	321
query59	2599	2545	2506	2506
query60	410	392	383	383
query61	122	128	120	120
query62	820	723	665	665
query63	250	216	208	208
query64	3480	1110	766	766
query65	4269	4109	4115	4109
query66	1154	445	324	324
query67	query68	19305	601	587	587
query69	1018	295	282	282
query70	1477	1068	1109	1068
query71	710	331	318	318
query72	9176	2329	2377	2329
query73	4604	623	405	405
query74	9047	8858	8662	8662
query75	7619	3120	2684	2684
query76	8791	1229	783	783
query77	1173	411	329	329
query78	query79	16512	1025	1018	1018
query80	2402	484	474	474
query81	580	233	237	233
query82	468	115	110	110
query83	343	284	261	261
query84	299	93	83	83
query85	1745	409	332	332
query86	365	328	325	325
query87	4374	4218	4097	4097
query88	5439	2262	2234	2234
query89	537	348	333	333
query90	2603	235	235	235
query91	144	146	115	115
query92	91	76	71	71
query93	7027	976	660	660
query94	1162	400	295	295
query95	437	325	328	325
query96	512	593	283	283
query97	2726	2712	2599	2599
query98	249	234	223	223
query99	1559	1375	1250	1250
Total cold run time: 306806 ms
Total hot run time: 165357 ms

doris-robot · 2025-07-30T08:23:52Z

ClickBench: Total hot run time: 32.71 s

machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 88af1e437fbd6c8be82486804390a596876cdab5, data reload: false
query1	0.04	0.04	0.03
query2	0.08	0.04	0.04
query3	0.24	0.06	0.07
query4	1.63	0.11	0.11
query5	0.42	0.44	0.45
query6	1.18	0.68	0.69
query7	0.02	0.02	0.01
query8	0.05	0.04	0.04
query9	0.57	0.47	0.47
query10	0.53	0.53	0.52
query11	0.15	0.10	0.11
query12	0.15	0.11	0.11
query13	0.66	0.65	0.65
query14	0.91	1.28	0.99
query15	0.91	0.88	0.88
query16	0.39	0.39	0.37
query17	1.05	1.05	1.09
query18	0.22	0.20	0.20
query19	1.93	1.83	1.93
query20	0.01	0.01	0.01
query21	15.38	0.84	0.55
query22	0.75	1.14	0.69
query23	15.07	1.15	0.63
query24	6.44	1.91	0.42
query25	0.52	0.25	0.09
query26	0.53	0.17	0.13
query27	0.07	0.05	0.05
query28	9.57	0.87	0.44
query29	12.57	3.84	3.33
query30	3.01	2.97	2.93
query31	2.82	0.57	0.41
query32	3.23	0.56	0.51
query33	3.01	3.21	3.23
query34	16.13	5.30	4.92
query35	4.86	4.96	4.94
query36	0.71	0.53	0.50
query37	0.09	0.08	0.08
query38	0.06	0.05	0.04
query39	0.04	0.02	0.02
query40	0.17	0.15	0.14
query41	0.08	0.03	0.03
query42	0.04	0.03	0.03
query43	0.04	0.03	0.04
Total cold run time: 106.33 s
Total hot run time: 32.71 s

hello-stephen · 2025-07-30T09:30:58Z

BE UT Coverage Report

Increment line coverage 0.00% (0/7) 🎉

Increment coverage report
Complete coverage report

Category	Coverage
Function Coverage	57.77% (16059/27799)
Line Coverage	46.49% (144402/310577)
Region Coverage	35.78% (108769/304005)
Branch Coverage	38.39% (47986/124995)

hello-stephen · 2025-07-30T10:30:48Z

BE Regression && UT Coverage Report

Increment line coverage 0.00% (0/7) 🎉

Increment coverage report
Complete coverage report

Category	Coverage
Function Coverage	81.13% (22140/27290)
Line Coverage	73.82% (228978/310199)
Region Coverage	61.61% (192075/311759)
Branch Coverage	65.33% (82583/126405)

Yukang-Lian · 2025-07-30T12:29:52Z

run vault_p0

dataroaring

LGTM

github-actions · 2025-07-31T01:57:07Z

PR approved by at least one committer and no changes requested.

github-actions · 2025-07-31T01:57:10Z

PR approved by anyone and no changes requested.

Related PR: #52812

…ing #53984 (#54163) Cherry-picked from #53984 Co-authored-by: abmdocrt <lianyukang@selectdb.com>

Related PR: #52812

…ing #53984 (#54162) Cherry-picked from #53984 Co-authored-by: abmdocrt <lianyukang@selectdb.com>

Yukang-Lian force-pushed the Fix-Missing-Rowset-Version branch from e4b0035 to f2b171aCompare July 29, 2025 09:10

dataroaring force-pushed the Fix-Missing-Rowset-Version branch from f2b171a to bd86aedCompare July 29, 2025 14:41

Yukang-Lian added 2 commits July 30, 2025 14:34

1
8f5da1a

2
88af1e4

Yukang-Lian force-pushed the Fix-Missing-Rowset-Version branch from bd86aed to 88af1e4Compare July 30, 2025 06:34

dataroaring approved these changes Jul 31, 2025
View reviewed changes

github-actionsBot added the approved Indicates a PR has been approved by one committer. label Jul 31, 2025

github-actionsBot added the reviewed label Jul 31, 2025

luwei16 approved these changes Jul 31, 2025
View reviewed changes

gavinchou approved these changes Jul 31, 2025
View reviewed changes

gavinchou added dev/3.0.x dev/3.1.x labels Jul 31, 2025

gavinchou merged commit edf2c0c into apache:masterJul 31, 2025
29 of 32 checks passed

github-actionsBot pushed a commit that referenced this pull request Jul 31, 2025
[Fix](Compaction) Fix full clone failure when rowset missing (#53984)
fb61703
Related PR: #52812

github-actionsBot mentioned this pull request Jul 31, 2025
branch-3.0: [Fix](Compaction) Fix full clone failure when rowset missing #53984 #54162
Merged

github-actionsBot pushed a commit that referenced this pull request Jul 31, 2025
[Fix](Compaction) Fix full clone failure when rowset missing (#53984)
fe4462f
Related PR: #52812

github-actionsBot mentioned this pull request Jul 31, 2025
branch-3.1: [Fix](Compaction) Fix full clone failure when rowset missing #53984 #54163
Merged

morrySnow pushed a commit that referenced this pull request Aug 1, 2025
branch-3.1: [Fix](Compaction) Fix full clone failure when rowset miss…
8c8f168
…ing #53984 (#54163) Cherry-picked from #53984 Co-authored-by: abmdocrt <lianyukang@selectdb.com>

morrySnow added dev/3.1.0-merged and removed dev/3.1.x labels Aug 1, 2025

dataroaring pushed a commit that referenced this pull request Aug 1, 2025
[Fix](Compaction) Fix full clone failure when rowset missing (#53984)
1996573
Related PR: #52812

dataroaring pushed a commit that referenced this pull request Aug 1, 2025
branch-3.0: [Fix](Compaction) Fix full clone failure when rowset miss…
84be3bb
…ing #53984 (#54162) Cherry-picked from #53984 Co-authored-by: abmdocrt <lianyukang@selectdb.com>

dataroaring added p0_new dev/3.0.7-merged and removed dev/3.0.x labels Aug 1, 2025

gavinchou mentioned this pull request Aug 15, 2025
Release Note 3.0.7 #54868
Closed

Uh oh!

Conversation

Yukang-Lian commented Jul 28, 2025

What problem does this PR solve?

Release note

Check List (For Author)

Check List (For Reviewer who merge this PR)

Uh oh!

hello-stephen commented Jul 28, 2025

Uh oh!

Yukang-Lian commented Jul 29, 2025

Uh oh!

doris-robot commented Jul 29, 2025

Uh oh!

doris-robot commented Jul 29, 2025

Uh oh!

doris-robot commented Jul 29, 2025

Uh oh!

Yukang-Lian commented Jul 29, 2025

Uh oh!

doris-robot commented Jul 29, 2025

Uh oh!

doris-robot commented Jul 29, 2025

Uh oh!

doris-robot commented Jul 29, 2025

Uh oh!

dataroaring commented Jul 29, 2025

Uh oh!

doris-robot commented Jul 29, 2025

Uh oh!

doris-robot commented Jul 29, 2025

Uh oh!

doris-robot commented Jul 29, 2025

Uh oh!

hello-stephen commented Jul 29, 2025

BE UT Coverage Report

Uh oh!

hello-stephen commented Jul 29, 2025

BE Regression && UT Coverage Report

Uh oh!

Yukang-Lian commented Jul 30, 2025

Uh oh!

hello-stephen commented Jul 30, 2025

BE Regression && UT Coverage Report

Uh oh!

Yukang-Lian commented Jul 30, 2025

Uh oh!

doris-robot commented Jul 30, 2025

Uh oh!

doris-robot commented Jul 30, 2025

Uh oh!

doris-robot commented Jul 30, 2025

Uh oh!

hello-stephen commented Jul 30, 2025

BE UT Coverage Report

Uh oh!

hello-stephen commented Jul 30, 2025

BE Regression && UT Coverage Report

Uh oh!

Yukang-Lian commented Jul 30, 2025

Uh oh!

dataroaring left a comment

Choose a reason for hiding this comment

Uh oh!

github-actionsBot commented Jul 31, 2025

Uh oh!

github-actionsBot commented Jul 31, 2025

Uh oh!

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

7 participants