branch-3.1: [Fix](flexible partial update) Fix some problems in flexible partial update #41701 #53765 by bobhan1 · Pull Request #53518 · apache/doris

bobhan1 · 2025-07-18T06:01:06Z

pick #41701 and #53765

bobhan1 · 2025-07-18T06:01:23Z

run buildall

Thearas · 2025-07-18T06:01:31Z

Thank you for your contribution to Apache Doris.
Don't know what should be done next? See How to process your PR.

Please clearly describe your PR:

What problem was fixed (it's best to include specific error reporting information). How it was fixed.
Which behaviors were modified. What was the previous behavior, what is it now, why was it modified, and what possible impacts might there be.
What features were added. Why was this function added?
Which code was refactored and why was this part of the code refactored?
Which functions were optimized and what is the difference before and after the optimization?

hello-stephen · 2025-07-18T06:25:45Z

Cloud UT Coverage Report

Increment line coverage 🎉

Increment coverage report
Complete coverage report

Category	Coverage
Function Coverage	81.13% (1191/1468)
Line Coverage	65.47% (20720/31648)
Region Coverage	66.82% (10448/15635)
Branch Coverage	56.63% (5519/9746)

doris-robot · 2025-07-18T07:38:25Z

TPC-H: Total hot run time: 40246 ms

machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 08ed2e093a05903eb5fc73e1a3fc68c4f93ab4c7, data reload: false
------ Round 1 ----------------------------------
q1	17784	6854	6675	6675
q2	2075	181	187	181
q3	10593	1159	1171	1159
q4	10755	772	803	772
q5	7948	2994	2845	2845
q6	223	138	138	138
q7	1008	634	638	634
q8	9374	2125	2093	2093
q9	6683	6475	6442	6442
q10	7050	2284	2355	2284
q11	471	266	268	266
q12	398	215	211	211
q13	17795	2992	2959	2959
q14	244	205	208	205
q15	508	488	460	460
q16	484	376	367	367
q17	1016	611	525	525
q18	7365	6779	6786	6779
q19	1358	1012	1029	1012
q20	485	196	198	196
q21	4004	3237	3076	3076
q22	1072	967	974	967
Total cold run time: 108693 ms
Total hot run time: 40246 ms
----- Round 2, with runtime_filter_mode=off -----
q1	6677	6666	6586	6586
q2	325	230	226	226
q3	3059	3017	2973	2973
q4	2057	1801	1858	1801
q5	5742	5779	5732	5732
q6	221	126	128	126
q7	2171	1788	1846	1788
q8	3353	3577	3535	3535
q9	8830	8890	8901	8890
q10	3591	3526	3578	3526
q11	595	517	490	490
q12	796	597	620	597
q13	10693	3226	3137	3137
q14	311	267	271	267
q15	521	489	477	477
q16	499	435	434	434
q17	1855	1608	1604	1604
q18	8227	7556	7575	7556
q19	1695	1520	1418	1418
q20	2107	1883	1858	1858
q21	5320	5068	4981	4981
q22	1125	1015	986	986
Total cold run time: 69770 ms
Total hot run time: 58988 ms

doris-robot · 2025-07-18T07:41:31Z

BE UT Coverage Report

Increment line coverage 4.92% (33/671) 🎉

Increment coverage report
Complete coverage report

Category	Coverage
Function Coverage	45.21% (12544/27746)
Line Coverage	36.10% (111609/309168)
Region Coverage	35.18% (57737/164104)
Branch Coverage	32.36% (31392/97006)

doris-robot · 2025-07-18T07:50:31Z

TPC-DS: Total hot run time: 191318 ms

machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 08ed2e093a05903eb5fc73e1a3fc68c4f93ab4c7, data reload: false
query1	960	374	353	353
query2	6540	1964	1892	1892
query3	6705	221	219	219
query4	33843	23864	23877	23864
query5	4362	453	460	453
query6	288	185	176	176
query7	4626	321	322	321
query8	296	231	228	228
query9	9708	2580	2556	2556
query10	481	264	262	262
query11	18088	15006	15137	15006
query12	155	98	104	98
query13	1638	422	436	422
query14	10470	7074	7131	7074
query15	238	170	187	170
query16	8117	481	506	481
query17	1625	576	575	575
query18	2130	321	315	315
query19	247	155	158	155
query20	121	115	113	113
query21	207	109	107	107
query22	4354	4284	4222	4222
query23	34132	33512	33638	33512
query24	11308	2878	2929	2878
query25	707	426	426	426
query26	1474	175	182	175
query27	2865	348	346	346
query28	7804	2136	2132	2132
query29	986	450	452	450
query30	324	166	161	161
query31	1008	790	821	790
query32	99	61	59	59
query33	810	308	307	307
query34	924	511	511	511
query35	856	734	746	734
query36	1079	943	950	943
query37	128	72	73	72
query38	3947	3864	3855	3855
query39	1622	1400	1421	1400
query40	300	105	103	103
query41	53	53	52	52
query42	122	106	104	104
query43	536	474	493	474
query44	1269	806	802	802
query45	187	171	178	171
query46	1160	736	702	702
query47	1922	1849	1808	1808
query48	432	339	348	339
query49	1253	418	424	418
query50	820	432	420	420
query51	7303	7245	7175	7175
query52	107	91	92	91
query53	264	191	190	190
query54	1322	493	479	479
query55	83	83	86	83
query56	286	276	264	264
query57	1314	1187	1177	1177
query58	249	226	230	226
query59	3090	2973	2903	2903
query60	302	280	270	270
query61	140	157	183	157
query62	866	670	679	670
query63	213	189	194	189
query64	5293	639	660	639
query65	3274	3188	3167	3167
query66	1447	327	305	305
query67	15930	15624	15449	15449
query68	4724	600	588	588
query69	461	276	263	263
query70	1178	1084	1122	1084
query71	437	277	262	262
query72	6479	4254	4019	4019
query73	763	346	360	346
query74	10407	9273	9230	9230
query75	3367	2682	2629	2629
query76	2987	1050	1085	1050
query77	500	272	302	272
query78	10390	9633	9544	9544
query79	1639	617	601	601
query80	1095	432	437	432
query81	519	223	225	223
query82	939	92	87	87
query83	224	149	145	145
query84	239	82	81	81
query85	1341	313	303	303
query86	395	298	294	294
query87	4384	4164	4252	4164
query88	3910	2409	2383	2383
query89	410	294	291	291
query90	2022	195	191	191
query91	146	109	109	109
query92	64	54	55	54
query93	1305	570	566	566
query94	936	299	286	286
query95	365	261	266	261
query96	613	293	283	283
query97	3338	3174	3122	3122
query98	213	213	200	200
query99	1538	1315	1329	1315
Total cold run time: 302137 ms
Total hot run time: 191318 ms

doris-robot · 2025-07-18T07:55:57Z

ClickBench: Total hot run time: 29.25 s

machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 08ed2e093a05903eb5fc73e1a3fc68c4f93ab4c7, data reload: false
query1	0.03	0.03	0.04
query2	0.07	0.03	0.03
query3	0.24	0.06	0.07
query4	1.62	0.10	0.11
query5	0.51	0.52	0.51
query6	1.14	0.74	0.73
query7	0.02	0.02	0.02
query8	0.04	0.03	0.03
query9	0.55	0.50	0.52
query10	0.56	0.55	0.56
query11	0.15	0.10	0.10
query12	0.14	0.11	0.12
query13	0.61	0.60	0.61
query14	0.78	0.79	0.79
query15	0.84	0.84	0.82
query16	0.38	0.39	0.39
query17	1.02	1.08	1.03
query18	0.24	0.21	0.20
query19	1.84	1.78	1.78
query20	0.01	0.01	0.02
query21	15.40	0.57	0.59
query22	2.29	1.71	1.55
query23	17.01	1.08	0.66
query24	2.96	2.04	0.52
query25	0.29	0.26	0.05
query26	0.33	0.13	0.14
query27	0.05	0.03	0.05
query28	10.24	0.50	0.48
query29	12.58	3.21	3.19
query30	0.24	0.06	0.06
query31	2.85	0.41	0.40
query32	3.23	0.47	0.46
query33	3.04	3.03	3.04
query34	17.04	4.45	4.47
query35	4.51	4.56	4.50
query36	0.65	0.48	0.48
query37	0.08	0.06	0.06
query38	0.04	0.03	0.04
query39	0.04	0.02	0.02
query40	0.15	0.13	0.12
query41	0.08	0.03	0.02
query42	0.03	0.02	0.02
query43	0.04	0.03	0.03
Total cold run time: 103.96 s
Total hot run time: 29.25 s

hello-stephen · 2025-07-18T09:53:55Z

BE Regression && UT Coverage Report

Increment line coverage 4.78% (32/670) 🎉

Increment coverage report
Complete coverage report

Category	Coverage
Function Coverage	53.27% (14602/27413)
Line Coverage	43.83% (135407/308931)
Region Coverage	41.28% (78480/190137)
Branch Coverage	36.24% (39642/109398)

bobhan1 · 2025-07-21T02:21:35Z

run buildall

hello-stephen · 2025-07-21T02:40:29Z

Cloud UT Coverage Report

Increment line coverage 🎉

Increment coverage report
Complete coverage report

Category	Coverage
Function Coverage	81.13% (1191/1468)
Line Coverage	65.54% (20742/31648)
Region Coverage	66.76% (10438/15635)
Branch Coverage	56.63% (5519/9746)

doris-robot · 2025-07-21T03:33:24Z

TPC-H: Total hot run time: 40549 ms

machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 33ec9100ef3fdad0a00ba63141ba5daee2183025, data reload: false
------ Round 1 ----------------------------------
q1	17790	6943	6670	6670
q2	2090	200	186	186
q3	10568	1187	1222	1187
q4	10374	727	893	727
q5	7763	2931	2874	2874
q6	236	143	143	143
q7	1020	662	651	651
q8	9411	1997	2098	1997
q9	6737	6496	6590	6496
q10	7067	2295	2298	2295
q11	484	277	279	277
q12	426	238	239	238
q13	17823	3024	2983	2983
q14	267	226	219	219
q15	553	512	517	512
q16	506	393	399	393
q17	1007	637	585	585
q18	7434	6710	6691	6691
q19	1359	1050	1072	1050
q20	506	231	223	223
q21	3991	3165	3147	3147
q22	1126	1036	1005	1005
Total cold run time: 108538 ms
Total hot run time: 40549 ms
----- Round 2, with runtime_filter_mode=off -----
q1	6686	6604	6596	6596
q2	349	254	258	254
q3	3036	2963	2923	2923
q4	2035	1894	1763	1763
q5	5778	5753	5763	5753
q6	240	136	139	136
q7	2235	1785	1780	1780
q8	3404	3580	3504	3504
q9	8950	8787	8928	8787
q10	3623	3599	3565	3565
q11	609	515	517	515
q12	828	598	625	598
q13	13921	3154	3119	3119
q14	303	301	284	284
q15	539	512	500	500
q16	504	465	447	447
q17	1877	1622	1589	1589
q18	8182	7801	7862	7801
q19	1741	1671	1540	1540
q20	2131	1882	1873	1873
q21	5331	5133	4935	4935
q22	1128	1024	995	995
Total cold run time: 73430 ms
Total hot run time: 59257 ms

doris-robot · 2025-07-21T03:38:36Z

BE UT Coverage Report

Increment line coverage 4.78% (32/670) 🎉

Increment coverage report
Complete coverage report

Category	Coverage
Function Coverage	45.23% (12553/27754)
Line Coverage	36.11% (111683/309252)
Region Coverage	35.18% (57750/164137)
Branch Coverage	32.36% (31396/97014)

bobhan1 · 2025-07-22T08:20:30Z

run buildall

hello-stephen · 2025-07-22T08:33:40Z

Cloud UT Coverage Report

Increment line coverage 🎉

Increment coverage report
Complete coverage report

Category	Coverage
Function Coverage	81.13% (1191/1468)
Line Coverage	65.36% (20713/31691)
Region Coverage	66.75% (10455/15664)
Branch Coverage	56.45% (5517/9774)

hello-stephen · 2025-07-22T09:18:44Z

FE UT Coverage Report

Increment line coverage 100.00% (1/1) 🎉
Increment coverage report
Complete coverage report

doris-robot · 2025-07-22T09:55:48Z

TPC-H: Total hot run time: 32616 ms

machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit ae4ca33c3a002b80fd956e365038621615610dbe, data reload: false
------ Round 1 ----------------------------------
q1	17575	5496	5446	5446
q2	2060	270	159	159
q3	10602	1257	759	759
q4	10250	882	447	447
q5	8766	2401	2152	2152
q6	189	162	134	134
q7	908	759	623	623
q8	9337	1430	1157	1157
q9	5323	4961	4890	4890
q10	6780	2270	1849	1849
q11	485	284	257	257
q12	338	354	206	206
q13	17771	3621	3044	3044
q14	231	224	210	210
q15	520	471	483	471
q16	424	417	367	367
q17	614	896	364	364
q18	7047	6419	6375	6375
q19	1387	984	578	578
q20	341	350	207	207
q21	3267	2205	1924	1924
q22	1053	1026	997	997
Total cold run time: 105268 ms
Total hot run time: 32616 ms
----- Round 2, with runtime_filter_mode=off -----
q1	5627	5541	5509	5509
q2	233	324	236	236
q3	2296	2660	2327	2327
q4	1369	1782	1314	1314
q5	4441	4939	5003	4939
q6	169	165	134	134
q7	2107	1999	1807	1807
q8	2621	2811	2727	2727
q9	7250	7277	7237	7237
q10	3025	3339	2716	2716
q11	567	491	485	485
q12	652	746	603	603
q13	3449	3822	3217	3217
q14	280	291	264	264
q15	520	473	485	473
q16	441	490	439	439
q17	1230	1734	1276	1276
q18	7674	7293	7564	7293
q19	830	1125	1108	1108
q20	2011	2047	1905	1905
q21	5308	4877	4638	4638
q22	1094	1059	962	962
Total cold run time: 53194 ms
Total hot run time: 51609 ms

hello-stephen · 2025-07-22T10:02:09Z

BE UT Coverage Report

Increment line coverage 4.78% (32/670) 🎉

Increment coverage report
Complete coverage report

Category	Coverage
Function Coverage	45.26% (12571/27773)
Line Coverage	36.15% (111929/309637)
Region Coverage	35.21% (57863/164355)
Branch Coverage	32.38% (31454/97152)

doris-robot · 2025-07-22T10:08:12Z

TPC-DS: Total hot run time: 196702 ms

machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit ae4ca33c3a002b80fd956e365038621615610dbe, data reload: false
query1	1309	935	907	907
query2	6229	1959	1879	1879
query3	10975	4462	4402	4402
query4	32839	24056	23378	23378
query5	4342	601	438	438
query6	283	195	185	185
query7	4001	507	328	328
query8	304	249	237	237
query9	9437	2594	2575	2575
query10	480	341	264	264
query11	18394	15475	15159	15159
query12	164	104	103	103
query13	1555	518	420	420
query14	9645	6595	7309	6595
query15	238	204	179	179
query16	8066	653	507	507
query17	1593	778	624	624
query18	2115	421	317	317
query19	201	193	165	165
query20	120	118	123	118
query21	207	130	112	112
query22	4618	4483	4493	4483
query23	34964	34049	34446	34049
query24	7551	2758	2797	2758
query25	517	506	425	425
query26	1165	295	177	177
query27	2218	490	356	356
query28	5034	2236	2174	2174
query29	757	589	491	491
query30	250	198	169	169
query31	1007	934	794	794
query32	82	61	58	58
query33	504	379	313	313
query34	768	860	505	505
query35	812	827	720	720
query36	1015	1058	965	965
query37	102	91	72	72
query38	4050	3971	4008	3971
query39	1507	1489	1462	1462
query40	213	114	97	97
query41	54	48	52	48
query42	122	102	103	102
query43	496	501	466	466
query44	1394	832	820	820
query45	181	174	175	174
query46	899	1064	674	674
query47	1956	1979	1932	1932
query48	413	417	348	348
query49	768	497	403	403
query50	669	700	431	431
query51	7458	7426	7316	7316
query52	101	102	92	92
query53	230	266	184	184
query54	548	544	461	461
query55	86	82	85	82
query56	271	280	255	255
query57	1275	1270	1219	1219
query58	235	229	222	222
query59	3191	3195	3034	3034
query60	299	292	271	271
query61	133	126	160	126
query62	853	756	700	700
query63	232	192	192	192
query64	4488	999	653	653
query65	3382	3328	3178	3178
query66	942	397	293	293
query67	15992	15831	15840	15831
query68	8607	817	540	540
query69	499	308	263	263
query70	1188	1130	1097	1097
query71	390	288	268	268
query72	5731	3752	3908	3752
query73	632	745	358	358
query74	10526	9535	9285	9285
query75	3219	3155	2661	2661
query76	3187	1188	753	753
query77	522	344	274	274
query78	10435	10440	9516	9516
query79	3234	893	608	608
query80	730	522	447	447
query81	514	254	221	221
query82	645	119	87	87
query83	174	162	143	143
query84	251	101	74	74
query85	778	348	293	293
query86	404	328	289	289
query87	4340	4387	4264	4264
query88	4857	2399	2379	2379
query89	419	333	296	296
query90	1778	191	196	191
query91	133	137	118	118
query92	66	54	50	50
query93	2177	898	537	537
query94	706	409	313	313
query95	345	279	267	267
query96	488	609	282	282
query97	3210	3258	3134	3134
query98	217	208	212	208
query99	1532	1461	1296	1296
Total cold run time: 298233 ms
Total hot run time: 196702 ms

doris-robot · 2025-07-22T10:13:28Z

ClickBench: Total hot run time: 29.33 s

machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit ae4ca33c3a002b80fd956e365038621615610dbe, data reload: false
query1	0.03	0.04	0.03
query2	0.08	0.04	0.05
query3	0.23	0.05	0.05
query4	1.64	0.09	0.09
query5	0.50	0.51	0.50
query6	1.14	0.75	0.74
query7	0.02	0.01	0.01
query8	0.05	0.04	0.04
query9	0.55	0.50	0.48
query10	0.54	0.56	0.59
query11	0.17	0.12	0.12
query12	0.16	0.12	0.13
query13	0.66	0.61	0.59
query14	0.78	0.79	0.84
query15	0.85	0.85	0.84
query16	0.39	0.38	0.38
query17	1.08	1.06	1.08
query18	0.19	0.18	0.19
query19	1.89	1.90	1.91
query20	0.02	0.01	0.01
query21	15.38	0.95	0.68
query22	0.76	0.76	0.68
query23	14.80	1.48	0.68
query24	2.18	0.40	0.24
query25	0.14	0.10	0.09
query26	0.27	0.19	0.18
query27	0.08	0.08	0.08
query28	13.36	1.24	0.55
query29	12.64	4.01	3.34
query30	0.25	0.09	0.07
query31	2.81	0.61	0.40
query32	3.23	0.57	0.48
query33	3.00	3.04	3.05
query34	16.50	5.20	4.63
query35	4.61	4.56	4.57
query36	0.63	0.49	0.47
query37	0.20	0.17	0.17
query38	0.16	0.17	0.16
query39	0.06	0.04	0.04
query40	0.17	0.14	0.12
query41	0.09	0.05	0.05
query42	0.06	0.06	0.05
query43	0.05	0.04	0.05
Total cold run time: 102.4 s
Total hot run time: 29.33 s

…update (apache#41701) 1. Fix incorrect result when there are insert after delete for same key in one load. In flexible partial update, if there is an insert after a delete on the same key in one batch, the final result will be always delete that row in table, which is incorrect. The reason is that when doing aggregation for rows with same keys in memtable, we treat delete sign column as an ordinary column. So if there is a row with delete sign in that batch, the final aggregated row will always have a delete sign and any insert on the same key after it will be lost. In the above situation, we should keep those rows and don't merge them when doing aggregation in memtable. When flush the memtable to segment, we should first apply the semantic of delete if exists and then insert the row after it. 2. fix flexible partial update don't use row store column to read data 3. Fix flexible partial update incorrect read index when resolving conflict in publish phase 4. add some default value cases and fix on update current timestamp 5. fix publish phase alignment problem when table has sequence column and the rowset to read has multi segments. 6. add some publish alignment case when table has sequence column 7. ~revert apache#25346, we use the sequence value in flush phase as its final value and will not do alignment in publish phase if the partial update load doesn't specified sequence column.~ 8. fix auto-increment column value is wrongly updated when it's not specified. 9. Fix the problem that the value of sequence column may decrease. 10. Only read seq col and seq map col when the previous row is deleted in partial update and flexible partial update when doing alignment. 11. Fix the value of auto-increment column is not consistent between replicas.

bobhan1 · 2025-07-23T06:54:12Z

run buildall

hello-stephen · 2025-07-23T07:19:17Z

Cloud UT Coverage Report

Increment line coverage 🎉

Increment coverage report
Complete coverage report

Category	Coverage
Function Coverage	81.13% (1191/1468)
Line Coverage	65.40% (20729/31694)
Region Coverage	66.75% (10458/15668)
Branch Coverage	56.50% (5525/9778)

bobhan1 · 2025-07-23T07:22:59Z

run buildall

hello-stephen · 2025-07-23T08:45:35Z

FE UT Coverage Report

Increment line coverage 100.00% (1/1) 🎉
Increment coverage report
Complete coverage report

doris-robot · 2025-07-23T08:56:15Z

TPC-DS: Total hot run time: 197230 ms

machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 12b206b6c0ee9a684aef20d9618a393e6736aed6, data reload: false
query1	1299	968	907	907
query2	6237	1921	1840	1840
query3	10955	4633	4690	4633
query4	33045	23856	23333	23333
query5	3722	605	459	459
query6	275	218	186	186
query7	3998	492	315	315
query8	300	250	248	248
query9	9521	2585	2576	2576
query10	472	332	252	252
query11	17966	15343	15143	15143
query12	159	109	105	105
query13	1565	544	428	428
query14	10085	6871	7142	6871
query15	212	206	187	187
query16	7961	681	466	466
query17	1597	769	599	599
query18	2094	402	292	292
query19	219	199	173	173
query20	124	118	114	114
query21	206	120	105	105
query22	4673	4634	4301	4301
query23	34994	33990	34132	33990
query24	7327	2733	2723	2723
query25	469	485	397	397
query26	833	284	171	171
query27	2297	478	366	366
query28	5705	2228	2187	2187
query29	617	581	450	450
query30	256	192	169	169
query31	944	926	853	853
query32	75	61	58	58
query33	506	389	327	327
query34	752	861	544	544
query35	816	843	749	749
query36	1017	1037	949	949
query37	106	96	70	70
query38	4010	4102	3940	3940
query39	1548	1470	1462	1462
query40	211	131	113	113
query41	54	54	52	52
query42	124	118	112	112
query43	531	518	493	493
query44	1368	842	838	838
query45	187	178	171	171
query46	901	1085	697	697
query47	2010	1963	1961	1961
query48	425	452	361	361
query49	742	510	424	424
query50	687	709	450	450
query51	7384	7371	7306	7306
query52	110	106	97	97
query53	234	263	201	201
query54	559	556	481	481
query55	81	78	83	78
query56	290	294	275	275
query57	1263	1274	1217	1217
query58	236	222	221	221
query59	3104	3097	3019	3019
query60	299	300	272	272
query61	112	111	112	111
query62	796	758	687	687
query63	237	202	190	190
query64	3441	1007	654	654
query65	3358	3326	3314	3314
query66	935	408	309	309
query67	16241	15835	15621	15621
query68	7005	834	552	552
query69	501	309	271	271
query70	1150	1159	1121	1121
query71	396	293	265	265
query72	5832	3796	4010	3796
query73	635	745	351	351
query74	10430	9220	9292	9220
query75	3211	3131	2666	2666
query76	3111	1329	784	784
query77	488	369	275	275
query78	10393	10457	9705	9705
query79	3466	914	596	596
query80	752	520	444	444
query81	504	261	227	227
query82	653	119	88	88
query83	159	167	144	144
query84	243	100	81	81
query85	794	347	299	299
query86	385	317	297	297
query87	4328	4282	4233	4233
query88	4877	2412	2403	2403
query89	413	342	308	308
query90	1759	192	194	192
query91	134	134	119	119
query92	64	55	52	52
query93	2290	912	545	545
query94	690	383	309	309
query95	335	283	273	273
query96	494	609	285	285
query97	3196	3255	3150	3150
query98	231	199	200	199
query99	1564	1393	1317	1317
Total cold run time: 295360 ms
Total hot run time: 197230 ms

doris-robot · 2025-07-23T09:01:30Z

ClickBench: Total hot run time: 29.15 s

machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 12b206b6c0ee9a684aef20d9618a393e6736aed6, data reload: false
query1	0.04	0.03	0.03
query2	0.09	0.04	0.05
query3	0.24	0.06	0.06
query4	1.63	0.08	0.08
query5	0.52	0.51	0.51
query6	1.12	0.74	0.74
query7	0.03	0.02	0.02
query8	0.05	0.04	0.04
query9	0.56	0.50	0.49
query10	0.55	0.55	0.56
query11	0.16	0.12	0.12
query12	0.16	0.13	0.12
query13	0.60	0.60	0.60
query14	0.78	0.79	0.81
query15	0.85	0.83	0.83
query16	0.38	0.37	0.38
query17	1.07	1.09	1.09
query18	0.19	0.19	0.19
query19	1.95	1.83	1.90
query20	0.02	0.02	0.01
query21	15.38	0.93	0.65
query22	0.76	0.74	0.67
query23	14.85	1.53	0.68
query24	2.26	0.36	0.22
query25	0.15	0.08	0.07
query26	0.28	0.18	0.17
query27	0.08	0.07	0.08
query28	13.44	1.30	0.55
query29	12.66	4.04	3.39
query30	0.25	0.08	0.06
query31	2.83	0.60	0.39
query32	3.23	0.57	0.48
query33	3.01	2.97	2.99
query34	16.51	5.25	4.57
query35	4.61	4.58	4.66
query36	0.63	0.48	0.48
query37	0.21	0.17	0.17
query38	0.16	0.16	0.15
query39	0.05	0.04	0.04
query40	0.17	0.14	0.13
query41	0.11	0.06	0.06
query42	0.06	0.06	0.05
query43	0.06	0.05	0.04
Total cold run time: 102.74 s
Total hot run time: 29.15 s

hello-stephen · 2025-07-23T10:42:10Z

BE Regression && UT Coverage Report

Increment line coverage 4.69% (32/683) 🎉

Increment coverage report
Complete coverage report

Category	Coverage
Function Coverage	53.64% (14723/27447)
Line Coverage	44.23% (136871/309454)
Region Coverage	41.74% (79541/190558)
Branch Coverage	36.70% (40229/109616)

bobhan1 · 2025-07-23T10:45:35Z

run cloud_p0

bobhan1 · 2025-07-23T11:42:14Z

run nonConcurrent

bobhan1 · 2025-07-23T11:42:19Z

run feut

bobhan1 · 2025-07-23T11:59:34Z

run cloud_p0

hello-stephen · 2025-07-23T12:04:10Z

BE Regression && UT Coverage Report

Increment line coverage 4.69% (32/683) 🎉

Increment coverage report
Complete coverage report

Category	Coverage
Function Coverage	53.64% (14723/27447)
Line Coverage	44.23% (136871/309454)
Region Coverage	41.74% (79541/190558)
Branch Coverage	36.70% (40229/109616)

hello-stephen · 2025-07-23T13:21:07Z

BE Regression && UT Coverage Report

Increment line coverage 4.69% (32/683) 🎉

Increment coverage report
Complete coverage report

Category	Coverage
Function Coverage	53.67% (14731/27447)
Line Coverage	44.19% (136760/309454)
Region Coverage	41.68% (79422/190558)
Branch Coverage	36.61% (40126/109616)

bobhan1 · 2025-07-24T01:45:58Z

run feut

bobhan1 · 2025-07-24T01:46:04Z

run cloud_p0

bobhan1 · 2025-07-24T02:59:49Z

run buildall

hello-stephen · 2025-07-24T03:12:48Z

BE Regression && UT Coverage Report

Increment line coverage 4.69% (32/683) 🎉

Increment coverage report
Complete coverage report

Category	Coverage
Function Coverage	53.67% (14731/27447)
Line Coverage	44.19% (136760/309454)
Region Coverage	41.68% (79422/190558)
Branch Coverage	36.61% (40126/109616)

hello-stephen · 2025-07-24T03:22:24Z

Cloud UT Coverage Report

Increment line coverage 🎉

Increment coverage report
Complete coverage report

Category	Coverage
Function Coverage	81.13% (1191/1468)
Line Coverage	65.36% (20716/31694)
Region Coverage	66.70% (10450/15668)
Branch Coverage	56.46% (5521/9778)

bobhan1 · 2025-07-24T03:59:50Z

run beut

bobhan1 · 2025-07-24T03:59:57Z

run performance

doris-robot · 2025-07-24T04:48:44Z

BE UT Coverage Report

Increment line coverage 4.69% (32/683) 🎉

Increment coverage report
Complete coverage report

Category	Coverage
Function Coverage	45.26% (12573/27780)
Line Coverage	36.16% (111972/309691)
Region Coverage	35.21% (57871/164382)
Branch Coverage	32.37% (31455/97164)

hello-stephen · 2025-07-24T04:53:02Z

BE Regression && UT Coverage Report

Increment line coverage 4.69% (32/683) 🎉

Increment coverage report
Complete coverage report

Category	Coverage
Function Coverage	53.67% (14731/27447)
Line Coverage	44.19% (136760/309454)
Region Coverage	41.68% (79422/190558)
Branch Coverage	36.61% (40126/109616)

hello-stephen · 2025-07-24T05:09:45Z

BE Regression && UT Coverage Report

Increment line coverage 4.69% (32/683) 🎉

Increment coverage report
Complete coverage report

Category	Coverage
Function Coverage	53.58% (14706/27447)
Line Coverage	44.20% (136773/309454)
Region Coverage	41.64% (79342/190558)
Branch Coverage	36.62% (40137/109616)

hello-stephen · 2025-07-24T05:10:52Z

BE Regression && UT Coverage Report

Increment line coverage 4.69% (32/683) 🎉

Increment coverage report
Complete coverage report

Category	Coverage
Function Coverage	53.58% (14706/27447)
Line Coverage	44.20% (136773/309454)
Region Coverage	41.64% (79342/190558)
Branch Coverage	36.62% (40137/109616)

bobhan1 · 2025-07-24T06:12:29Z

run performance

bobhan1 · 2025-07-24T07:10:43Z

run performance

doris-robot · 2025-07-24T09:07:47Z

TPC-H: Total hot run time: 32980 ms

machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 12b206b6c0ee9a684aef20d9618a393e6736aed6, data reload: false
------ Round 1 ----------------------------------
q1	17920	5550	5455	5455
q2	2057	294	163	163
q3	10713	1330	715	715
q4	10290	875	465	465
q5	9018	2426	2181	2181
q6	189	165	133	133
q7	922	760	615	615
q8	9323	1463	1223	1223
q9	5399	4958	4965	4958
q10	6793	2279	1830	1830
q11	481	277	264	264
q12	329	352	223	223
q13	17757	3627	3025	3025
q14	226	222	210	210
q15	507	465	460	460
q16	424	450	380	380
q17	606	879	374	374
q18	7054	6482	6494	6482
q19	1207	948	574	574
q20	334	355	206	206
q21	2996	2226	2028	2028
q22	1064	1036	1016	1016
Total cold run time: 105609 ms
Total hot run time: 32980 ms
----- Round 2, with runtime_filter_mode=off -----
q1	5507	5756	5917	5756
q2	237	337	239	239
q3	2262	2593	2294	2294
q4	1395	1811	1405	1405
q5	4461	5036	5178	5036
q6	164	162	127	127
q7	2078	1911	1779	1779
q8	2586	2756	2659	2659
q9	7274	7100	7247	7100
q10	3000	3249	2797	2797
q11	571	526	508	508
q12	656	760	609	609
q13	3406	3768	3189	3189
q14	272	306	271	271
q15	519	466	470	466
q16	439	495	442	442
q17	1240	1731	1275	1275
q18	7673	7757	7380	7380
q19	793	1161	1059	1059
q20	2001	2031	1912	1912
q21	5181	4907	4555	4555
q22	1127	1083	1055	1055
Total cold run time: 52842 ms
Total hot run time: 51913 ms

doris-robot · 2025-07-24T09:19:54Z

TPC-DS: Total hot run time: 190399 ms

machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 12b206b6c0ee9a684aef20d9618a393e6736aed6, data reload: false
query1	981	408	374	374
query2	6628	1945	1956	1945
query3	6712	217	212	212
query4	34127	23674	23438	23438
query5	4397	619	470	470
query6	278	191	193	191
query7	4624	503	328	328
query8	302	252	244	244
query9	9492	2612	2593	2593
query10	485	323	259	259
query11	18150	15383	15176	15176
query12	154	111	103	103
query13	1633	546	426	426
query14	9667	6622	7722	6622
query15	264	195	184	184
query16	8177	665	495	495
query17	1799	798	598	598
query18	2327	446	333	333
query19	234	189	178	178
query20	124	123	112	112
query21	222	131	108	108
query22	4606	4671	4589	4589
query23	34841	33580	33833	33580
query24	7660	2665	2670	2665
query25	548	466	419	419
query26	1201	281	170	170
query27	2048	480	340	340
query28	5021	2187	2138	2138
query29	774	589	451	451
query30	256	193	160	160
query31	980	915	794	794
query32	86	63	55	55
query33	528	368	309	309
query34	741	845	519	519
query35	776	809	711	711
query36	1003	1022	952	952
query37	96	91	75	75
query38	3878	3849	3833	3833
query39	1499	1449	1423	1423
query40	209	118	107	107
query41	53	57	51	51
query42	123	103	105	103
query43	511	529	487	487
query44	1335	814	805	805
query45	181	176	168	168
query46	862	1029	655	655
query47	1904	1900	1840	1840
query48	419	425	336	336
query49	777	471	399	399
query50	658	674	412	412
query51	7285	7189	7114	7114
query52	100	95	93	93
query53	226	250	189	189
query54	525	544	472	472
query55	76	77	78	77
query56	277	262	255	255
query57	1240	1236	1138	1138
query58	235	226	217	217
query59	2895	3112	2992	2992
query60	284	273	257	257
query61	116	121	110	110
query62	808	708	673	673
query63	218	191	191	191
query64	4602	989	656	656
query65	3250	3174	3183	3174
query66	1046	398	310	310
query67	15959	15747	15497	15497
query68	7783	824	538	538
query69	479	299	266	266
query70	1149	1111	1113	1111
query71	542	290	258	258
query72	5182	3659	3782	3659
query73	650	753	350	350
query74	10462	9136	9258	9136
query75	3377	3177	2622	2622
query76	3234	1179	773	773
query77	752	366	283	283
query78	10340	10472	9604	9604
query79	3274	883	605	605
query80	762	541	445	445
query81	522	259	222	222
query82	681	117	86	86
query83	156	164	148	148
query84	249	97	86	86
query85	786	397	290	290
query86	402	324	286	286
query87	4276	4352	4189	4189
query88	5284	2396	2363	2363
query89	397	342	299	299
query90	1860	185	183	183
query91	140	136	111	111
query92	70	55	53	53
query93	2532	899	558	558
query94	688	410	310	310
query95	346	281	265	265
query96	489	619	296	296
query97	3243	3310	3173	3173
query98	222	213	196	196
query99	1568	1413	1285	1285
Total cold run time: 295390 ms
Total hot run time: 190399 ms

doris-robot · 2025-07-24T09:25:21Z

ClickBench: Total hot run time: 28.91 s

machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 12b206b6c0ee9a684aef20d9618a393e6736aed6, data reload: false
query1	0.04	0.03	0.03
query2	0.07	0.03	0.04
query3	0.24	0.07	0.06
query4	1.62	0.10	0.10
query5	0.52	0.51	0.52
query6	1.13	0.73	0.73
query7	0.03	0.02	0.01
query8	0.04	0.04	0.03
query9	0.57	0.51	0.50
query10	0.57	0.55	0.57
query11	0.14	0.10	0.11
query12	0.13	0.11	0.12
query13	0.65	0.59	0.59
query14	0.76	0.79	0.80
query15	0.86	0.83	0.82
query16	0.39	0.38	0.38
query17	1.02	1.05	1.04
query18	0.24	0.22	0.23
query19	1.90	1.75	1.89
query20	0.01	0.01	0.02
query21	15.37	0.95	0.56
query22	0.73	0.79	0.83
query23	14.96	1.39	0.51
query24	2.95	0.96	1.55
query25	0.26	0.11	0.10
query26	0.26	0.15	0.14
query27	0.06	0.06	0.04
query28	13.96	1.00	0.43
query29	12.62	4.03	3.27
query30	0.25	0.09	0.06
query31	2.82	0.59	0.39
query32	3.23	0.53	0.46
query33	2.97	3.03	3.06
query34	16.52	5.20	4.51
query35	4.53	4.54	4.54
query36	0.63	0.50	0.47
query37	0.09	0.06	0.05
query38	0.05	0.04	0.03
query39	0.03	0.02	0.02
query40	0.16	0.13	0.12
query41	0.09	0.03	0.02
query42	0.04	0.02	0.02
query43	0.03	0.03	0.03
Total cold run time: 103.54 s
Total hot run time: 28.91 s

bobhan1 requested a review from morrySnow as a code owner July 18, 2025 06:01

bobhan1 force-pushed the branch-3.1-pick-41701 branch from 08ed2e0 to 33ec910Compare July 21, 2025 02:21

bobhan1 force-pushed the branch-3.1-pick-41701 branch from 33ec910 to ae4ca33Compare July 22, 2025 08:20

bobhan1 added 3 commits July 23, 2025 14:53

add case
814893e

fix
6d7bd63

bobhan1 force-pushed the branch-3.1-pick-41701 branch from 505cf7b to 6d7bd63Compare July 23, 2025 06:53

fix
12b206b

morrySnow approved these changes Jul 25, 2025
View reviewed changes

morrySnow changed the title ~~branch-3.1: [Fix](flexible partial update) Fix some problems in flexible partial update (#41701)~~branch-3.1: [Fix](flexible partial update) Fix some problems in flexible partial update #41701Jul 25, 2025

morrySnow changed the title ~~branch-3.1: [Fix](flexible partial update) Fix some problems in flexible partial update #41701~~branch-3.1: [Fix](flexible partial update) Fix some problems in flexible partial update #41701 #53765Jul 25, 2025

morrySnow merged commit f85884c into apache:branch-3.1Jul 25, 2025
9 of 10 checks passed

Uh oh!

Conversation

bobhan1 commented Jul 18, 2025• edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

bobhan1 commented Jul 18, 2025

Uh oh!

Thearas commented Jul 18, 2025

Uh oh!

hello-stephen commented Jul 18, 2025

Cloud UT Coverage Report

Uh oh!

doris-robot commented Jul 18, 2025

Uh oh!

doris-robot commented Jul 18, 2025

BE UT Coverage Report

Uh oh!

doris-robot commented Jul 18, 2025

Uh oh!

doris-robot commented Jul 18, 2025

Uh oh!

hello-stephen commented Jul 18, 2025

BE Regression && UT Coverage Report

Uh oh!

bobhan1 commented Jul 21, 2025

Uh oh!

hello-stephen commented Jul 21, 2025

Cloud UT Coverage Report

Uh oh!

doris-robot commented Jul 21, 2025

Uh oh!

doris-robot commented Jul 21, 2025

BE UT Coverage Report

Uh oh!

bobhan1 commented Jul 22, 2025

Uh oh!

hello-stephen commented Jul 22, 2025

Cloud UT Coverage Report

Uh oh!

hello-stephen commented Jul 22, 2025

FE UT Coverage Report

Uh oh!

doris-robot commented Jul 22, 2025

Uh oh!

hello-stephen commented Jul 22, 2025

BE UT Coverage Report

Uh oh!

doris-robot commented Jul 22, 2025

Uh oh!

doris-robot commented Jul 22, 2025

Uh oh!

bobhan1 commented Jul 23, 2025

Uh oh!

hello-stephen commented Jul 23, 2025

Cloud UT Coverage Report

Uh oh!

bobhan1 commented Jul 23, 2025

Uh oh!

hello-stephen commented Jul 23, 2025

FE UT Coverage Report

Uh oh!

doris-robot commented Jul 23, 2025

Uh oh!

doris-robot commented Jul 23, 2025

Uh oh!

hello-stephen commented Jul 23, 2025

BE Regression && UT Coverage Report

Uh oh!

bobhan1 commented Jul 23, 2025

Uh oh!

bobhan1 commented Jul 23, 2025

Uh oh!

bobhan1 commented Jul 23, 2025

Uh oh!

bobhan1 commented Jul 23, 2025

Uh oh!

hello-stephen commented Jul 23, 2025

BE Regression && UT Coverage Report

Uh oh!

hello-stephen commented Jul 23, 2025

bobhan1 commented Jul 18, 2025•
edited
Loading