[chore](compaction) change time series threshold from 2000 to 1000 by csun5285 · Pull Request #61979 · apache/doris

csun5285 · 2026-04-01T02:39:57Z

What problem does this PR solve?

Issue Number: close #xxx

Related PR: #xxx

Problem Summary:

Release note

None

Check List (For Author)

Test
- Regression test
- Unit Test
- Manual test (add detailed scripts or steps below)
- No need to test or manual test. Explain why:
  - This is a refactor/code format and no logic has been changed.
  - Previous test can cover this change.
  - No code files have been changed.
  - Other reason
Behavior changed:
- No.
- Yes.
Does this need documentation?
- No.
- Yes.

Check List (For Reviewer who merge this PR)

Confirm the release note
Confirm test cases
Confirm document
Add branch pick label

hello-stephen · 2026-04-01T02:40:02Z

Thank you for your contribution to Apache Doris.
Don't know what should be done next? See How to process your PR.

Please clearly describe your PR:

What problem was fixed (it's best to include specific error reporting information). How it was fixed.
Which behaviors were modified. What was the previous behavior, what is it now, why was it modified, and what possible impacts might there be.
What features were added. Why was this function added?
Which code was refactored and why was this part of the code refactored?
Which functions were optimized and what is the difference before and after the optimization?

csun5285 · 2026-04-01T02:40:07Z

run buildall

hello-stephen · 2026-04-01T03:24:11Z

Cloud UT Coverage Report

Increment line coverage 🎉

Increment coverage report
Complete coverage report

Category	Coverage
Function Coverage	78.48% (1798/2291)
Line Coverage	64.15% (32265/50296)
Region Coverage	65.00% (16171/24878)
Branch Coverage	55.46% (8616/15536)

doris-robot · 2026-04-01T04:50:30Z

TPC-H: Total hot run time: 26929 ms

machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit e84448553f3a647b0b509b9e732a4dc07b167c9c, data reload: false
------ Round 1 ----------------------------------
orders	Doris	NULL	NULL	0	0	0	NULL	0	NULL	NULL	2023-12-26 18:27:23	2023-12-26 18:42:55	NULL	utf-8	NULL	NULL ============================================
q1	17625	4548	4394	4394
q2	q3	10738	789	525	525
q4	4737	366	266	266
q5	8154	1238	1019	1019
q6	220	174	146	146
q7	816	862	675	675
q8	10726	1507	1345	1345
q9	6873	4761	4738	4738
q10	6354	1950	1686	1686
q11	458	262	253	253
q12	766	594	473	473
q13	18042	2695	1982	1982
q14	231	231	218	218
q15	q16	734	740	672	672
q17	752	872	443	443
q18	5872	5407	5287	5287
q19	1116	978	615	615
q20	561	493	380	380
q21	4818	2087	1537	1537
q22	361	336	275	275
Total cold run time: 99954 ms
Total hot run time: 26929 ms
----- Round 2, with runtime_filter_mode=off -----
orders	Doris	NULL	NULL	150000000	42	6422171781	NULL	22778155	NULL	NULL	2023-12-26 18:27:23	2023-12-26 18:42:55	NULL	utf-8	NULL	NULL ============================================
q1	4736	4614	4720	4614
q2	q3	3945	4313	3803	3803
q4	886	1213	801	801
q5	4116	4401	4449	4401
q6	201	188	147	147
q7	1783	1664	1549	1549
q8	2540	2771	2610	2610
q9	7528	7367	7451	7367
q10	3781	4064	3756	3756
q11	522	428	417	417
q12	499	607	540	540
q13	2434	2807	2084	2084
q14	298	320	279	279
q15	q16	748	766	731	731
q17	1183	1378	1367	1367
q18	7353	6868	6703	6703
q19	905	919	901	901
q20	2114	2216	2078	2078
q21	4086	3608	3333	3333
q22	466	425	395	395
Total cold run time: 50124 ms
Total hot run time: 47876 ms

doris-robot · 2026-04-01T05:01:21Z

TPC-DS: Total hot run time: 169060 ms

machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit e84448553f3a647b0b509b9e732a4dc07b167c9c, data reload: false
query5	4333	662	514	514
query6	340	224	195	195
query7	4210	511	276	276
query8	381	260	241	241
query9	8731	2720	2703	2703
query10	533	389	351	351
query11	6967	5115	4876	4876
query12	181	131	129	129
query13	1282	489	352	352
query14	5770	3757	3485	3485
query14_1	2828	2824	2852	2824
query15	205	196	183	183
query16	1016	488	464	464
query17	1119	734	630	630
query18	2474	470	364	364
query19	244	224	183	183
query20	134	127	127	127
query21	218	136	110	110
query22	13182	14325	14593	14325
query23	17068	16295	16016	16016
query23_1	16355	16162	15598	15598
query24	7351	1696	1192	1192
query24_1	1242	1236	1255	1236
query25	589	465	412	412
query26	1229	263	154	154
query27	2754	492	301	301
query28	4445	1859	1837	1837
query29	819	581	473	473
query30	296	229	187	187
query31	1028	946	890	890
query32	84	74	72	72
query33	509	349	300	300
query34	891	916	514	514
query35	662	701	587	587
query36	1072	1106	1003	1003
query37	135	101	83	83
query38	2986	2899	2929	2899
query39	850	831	814	814
query39_1	784	801	790	790
query40	232	159	138	138
query41	64	98	59	59
query42	260	252	254	252
query43	237	261	225	225
query44 query45	200	188	181	181
query46	928	1036	608	608
query47	2099	2091	2084	2084
query48	306	322	235	235
query49	633	461	385	385
query50	723	291	215	215
query51	4089	4039	4073	4039
query52	265	273	268	268
query53	289	349	288	288
query54	308	269	270	269
query55	88	90	82	82
query56	323	326	315	315
query57	1914	1722	1668	1668
query58	281	271	268	268
query59	2833	2931	2723	2723
query60	344	335	316	316
query61	158	153	147	147
query62	621	596	543	543
query63	324	281	279	279
query64	4993	1285	989	989
query65 query66	1457	474	362	362
query67	24341	24319	24151	24151
query68 query69	409	325	292	292
query70	987	967	937	937
query71	349	303	301	301
query72	2857	2754	2507	2507
query73	569	566	315	315
query74	9651	9536	9405	9405
query75	2946	2791	2474	2474
query76	2293	1107	697	697
query77	357	402	312	312
query78	10973	11088	10450	10450
query79	2667	786	574	574
query80	1798	614	536	536
query81	561	263	226	226
query82	992	159	120	120
query83	331	268	244	244
query84	249	123	96	96
query85	913	509	453	453
query86	429	334	328	328
query87	3259	3109	2995	2995
query88	3644	2626	2635	2626
query89	449	376	343	343
query90	2041	199	172	172
query91	173	177	137	137
query92	80	74	72	72
query93	1179	869	507	507
query94	643	336	297	297
query95	597	341	311	311
query96	666	545	233	233
query97	2441	2488	2403	2403
query98	242	226	220	220
query99	1019	1002	850	850
Total cold run time: 253458 ms
Total hot run time: 169060 ms

hello-stephen · 2026-04-01T06:46:46Z

BE UT Coverage Report

Increment line coverage 🎉

Increment coverage report
Complete coverage report

Category	Coverage
Function Coverage	52.93% (19992/37773)
Line Coverage	36.49% (187625/514215)
Region Coverage	32.73% (145446/444411)
Branch Coverage	33.90% (63782/188127)

hello-stephen · 2026-04-01T06:51:02Z

BE Regression && UT Coverage Report

Increment line coverage 100% (0/0) 🎉

Increment coverage report
Complete coverage report

Category	Coverage
Function Coverage	71.76% (26544/36992)
Line Coverage	54.69% (280362/512671)
Region Coverage	51.68% (231811/448529)
Branch Coverage	53.22% (100423/188693)

eldenmoon

LGTM

github-actions · 2026-04-01T06:53:00Z

PR approved by at least one committer and no changes requested.

github-actions · 2026-04-01T06:53:02Z

PR approved by anyone and no changes requested.

csun5285 · 2026-04-01T07:57:13Z

run buildall

doris-robot · 2026-04-01T08:32:09Z

Cloud UT Coverage Report

Increment line coverage 🎉

Increment coverage report
Complete coverage report

Category	Coverage
Function Coverage	78.48% (1798/2291)
Line Coverage	64.16% (32272/50296)
Region Coverage	65.01% (16173/24878)
Branch Coverage	55.51% (8624/15536)

hello-stephen · 2026-04-01T09:07:06Z

FE UT Coverage Report

Increment line coverage 100% (0/0) 🎉
Increment coverage report
Complete coverage report

hello-stephen · 2026-04-01T10:42:28Z

BE Regression && UT Coverage Report

Increment line coverage 100% (0/0) 🎉

Increment coverage report
Complete coverage report

Category	Coverage
Function Coverage	71.49% (26498/37064)
Line Coverage	54.34% (278635/512721)
Region Coverage	51.24% (229822/448505)
Branch Coverage	52.73% (99449/188586)

hello-stephen · 2026-04-01T11:02:00Z

BE Regression && UT Coverage Report

Increment line coverage 100% (0/0) 🎉

Increment coverage report
Complete coverage report

Category	Coverage
Function Coverage	71.59% (26551/37088)
Line Coverage	54.48% (279848/513692)
Region Coverage	51.40% (231185/449737)
Branch Coverage	52.87% (99944/189034)

hello-stephen · 2026-04-01T11:18:10Z

BE Regression && UT Coverage Report

Increment line coverage 100% (0/0) 🎉

Increment coverage report
Complete coverage report

Category	Coverage
Function Coverage	71.60% (26554/37088)
Line Coverage	54.50% (279939/513692)
Region Coverage	51.44% (231330/449737)
Branch Coverage	52.92% (100030/189034)

doris-robot · 2026-04-01T11:34:45Z

TPC-H: Total hot run time: 29860 ms

machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit e84448553f3a647b0b509b9e732a4dc07b167c9c, data reload: false
------ Round 1 ----------------------------------
orders	Doris	NULL	NULL	0	0	0	NULL	0	NULL	NULL	2023-12-26 18:27:23	2023-12-26 18:42:55	NULL	utf-8	NULL	NULL ============================================
q1	17915	3824	3684	3684
q2	q3	10701	887	603	603
q4	4717	465	369	369
q5	7959	1353	1143	1143
q6	329	168	137	137
q7	940	977	762	762
q8	10894	1494	1387	1387
q9	6939	5330	5392	5330
q10	6365	2039	1771	1771
q11	483	293	284	284
q12	886	694	511	511
q13	18057	2794	2175	2175
q14	287	287	257	257
q15	q16	905	865	782	782
q17	1088	1018	894	894
q18	6537	5786	5584	5584
q19	1169	1340	1271	1271
q20	756	628	532	532
q21	4806	2398	2041	2041
q22	467	384	343	343
Total cold run time: 102200 ms
Total hot run time: 29860 ms
----- Round 2, with runtime_filter_mode=off -----
orders	Doris	NULL	NULL	150000000	42	6422171781	NULL	22778155	NULL	NULL	2023-12-26 18:27:23	2023-12-26 18:42:55	NULL	utf-8	NULL	NULL ============================================
q1	4596	4728	4322	4322
q2	q3	4620	4774	4144	4144
q4	2028	2106	1347	1347
q5	4929	4993	5254	4993
q6	209	169	135	135
q7	2016	1797	1677	1677
q8	3478	3086	3090	3086
q9	8330	8366	8458	8366
q10	4490	4479	4240	4240
q11	606	415	377	377
q12	662	712	489	489
q13	2693	3038	2392	2392
q14	306	306	281	281
q15	q16	799	792	695	695
q17	1284	1281	1354	1281
q18	7896	7063	7044	7044
q19	1142	1127	1121	1121
q20	2335	2264	1993	1993
q21	6248	5373	4780	4780
q22	526	485	415	415
Total cold run time: 59193 ms
Total hot run time: 53178 ms

hello-stephen · 2026-04-01T11:45:55Z

BE UT Coverage Report

Increment line coverage 🎉

Increment coverage report
Complete coverage report

Category	Coverage
Function Coverage	52.89% (20030/37869)
Line Coverage	36.48% (187973/515241)
Region Coverage	32.69% (145656/445624)
Branch Coverage	33.89% (63872/188468)

doris-robot · 2026-04-01T11:46:17Z

TPC-DS: Total hot run time: 180220 ms

machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit e84448553f3a647b0b509b9e732a4dc07b167c9c, data reload: false
query5	4335	660	521	521
query6	343	255	222	222
query7	4226	623	336	336
query8	346	259	234	234
query9	8790	3935	3933	3933
query10	521	395	365	365
query11	6661	5502	5136	5136
query12	195	137	131	131
query13	1299	606	453	453
query14	5691	5174	4794	4794
query14_1	4146	4135	4129	4129
query15	214	210	184	184
query16	1028	486	472	472
query17	1158	801	670	670
query18	2732	523	395	395
query19	261	244	194	194
query20	146	131	135	131
query21	227	156	119	119
query22	15156	14539	14562	14539
query23	17872	17405	16706	16706
query23_1	16731	16683	16566	16566
query24	7519	1728	1369	1369
query24_1	1370	1383	1341	1341
query25	589	488	449	449
query26	1259	344	182	182
query27	2626	620	354	354
query28	4400	1919	1896	1896
query29	984	655	571	571
query30	309	224	194	194
query31	1087	1043	958	958
query32	90	74	75	74
query33	548	337	288	288
query34	1193	1168	658	658
query35	768	774	652	652
query36	1241	1197	1032	1032
query37	155	100	92	92
query38	3156	3046	2988	2988
query39	914	903	861	861
query39_1	835	849	833	833
query40	236	156	135	135
query41	63	59	57	57
query42	274	267	274	267
query43	317	319	275	275
query44 query45	208	191	188	188
query46	1171	1253	787	787
query47	2321	2347	2223	2223
query48	427	407	298	298
query49	649	540	435	435
query50	744	293	233	233
query51	4387	4266	4236	4236
query52	277	280	267	267
query53	327	364	277	277
query54	324	281	266	266
query55	100	94	90	90
query56	320	339	326	326
query57	1751	1728	1737	1728
query58	304	282	281	281
query59	2893	2966	2727	2727
query60	332	336	353	336
query61	155	156	156	156
query62	667	625	572	572
query63	311	273	272	272
query64	5335	1450	1107	1107
query65 query66	1451	492	374	374
query67	24415	24239	24159	24159
query68 query69	439	365	304	304
query70	1011	985	997	985
query71	360	325	325	325
query72	2978	2691	2472	2472
query73	786	779	435	435
query74	9840	9766	9588	9588
query75	3573	3404	2999	2999
query76	2295	1164	763	763
query77	406	416	336	336
query78	11391	11389	10760	10760
query79	1501	1112	809	809
query80	835	752	673	673
query81	455	276	236	236
query82	1314	162	122	122
query83	368	292	260	260
query84	261	146	117	117
query85	877	504	454	454
query86	386	330	309	309
query87	3327	3226	3145	3145
query88	3626	2686	2693	2686
query89	484	413	372	372
query90	1982	189	189	189
query91	185	203	142	142
query92	81	76	74	74
query93	932	903	527	527
query94	535	353	263	263
query95	670	455	344	344
query96	1031	775	342	342
query97	2690	2694	2548	2548
query98	243	231	229	229
query99	1054	1069	979	979
Total cold run time: 260035 ms
Total hot run time: 180220 ms

hello-stephen · 2026-04-01T11:50:12Z

BE Regression && UT Coverage Report

Increment line coverage 100% (0/0) 🎉

Increment coverage report
Complete coverage report

Category	Coverage
Function Coverage	71.66% (26578/37088)
Line Coverage	54.63% (280607/513692)
Region Coverage	51.59% (232026/449737)
Branch Coverage	53.09% (100360/189034)

hello-stephen · 2026-04-07T03:39:09Z

BE Regression && UT Coverage Report

Increment line coverage 100% (0/0) 🎉

Increment coverage report
Complete coverage report

Category	Coverage
Function Coverage	71.66% (26578/37088)
Line Coverage	54.63% (280607/513692)
Region Coverage	51.59% (232026/449737)
Branch Coverage	53.09% (100360/189034)

eldenmoon

LGTM

github-actions · 2026-04-13T06:20:46Z

PR approved by at least one committer and no changes requested.

…61979)

…0 to 1000 #61979 (#62444) Cherry-picked from #61979 Co-authored-by: Chenyang Sun <sunchenyang@selectdb.com>

…0 to 1000 #61979 (#62443) Cherry-picked from #61979 Co-authored-by: Chenyang Sun <sunchenyang@selectdb.com>

[fix](compaction) change time series threshold from 2000 to 1000
e844485

csun5285 requested review from dataroaring, gavinchou and yiguolei as code owners April 1, 2026 02:39

eldenmoon previously approved these changes Apr 1, 2026
View reviewed changes

eldenmoon added dev/4.0.x dev/4.1.x labels Apr 1, 2026

github-actionsBot added the approved Indicates a PR has been approved by one committer. label Apr 1, 2026

github-actionsBot added the reviewed label Apr 1, 2026

csun5285 dismissed eldenmoon’s stale review via f581738April 1, 2026 07:50

github-actionsBot removed the approved Indicates a PR has been approved by one committer. label Apr 1, 2026

csun5285 force-pushed the CIR-17854-timeseries-compaction-threshold branch from f581738 to e844485Compare April 1, 2026 07:57

eldenmoon approved these changes Apr 13, 2026
View reviewed changes

github-actionsBot added the approved Indicates a PR has been approved by one committer. label Apr 13, 2026

csun5285 changed the title ~~[fix](compaction) change time series threshold from 2000 to 1000~~[chore](compaction) change time series threshold from 2000 to 1000Apr 13, 2026

yiguolei approved these changes Apr 13, 2026
View reviewed changes

eldenmoon closed this Apr 13, 2026

eldenmoon reopened this Apr 13, 2026

eldenmoon merged commit 52da1d6 into apache:masterApr 13, 2026
62 of 67 checks passed

github-actionsBot pushed a commit that referenced this pull request Apr 13, 2026
[chore](compaction) change time series threshold from 2000 to 1000 (#…
1a61f5e
…61979)

github-actionsBot mentioned this pull request Apr 13, 2026
branch-4.0: [chore](compaction) change time series threshold from 2000 to 1000 #61979 #62443
Merged

github-actionsBot pushed a commit that referenced this pull request Apr 13, 2026
[chore](compaction) change time series threshold from 2000 to 1000 (#…
d532f0d
…61979)

github-actionsBot mentioned this pull request Apr 13, 2026
branch-4.1: [chore](compaction) change time series threshold from 2000 to 1000 #61979 #62444
Merged

yiguolei pushed a commit that referenced this pull request Apr 15, 2026
branch-4.1: [chore](compaction) change time series threshold from 200…
d079be2
…0 to 1000 #61979 (#62444) Cherry-picked from #61979 Co-authored-by: Chenyang Sun <sunchenyang@selectdb.com>

yiguolei added dev/4.1.1-merged and removed dev/4.1.x labels Apr 15, 2026

yiguolei pushed a commit that referenced this pull request Apr 15, 2026
branch-4.0: [chore](compaction) change time series threshold from 200…
8e34b37
…0 to 1000 #61979 (#62443) Cherry-picked from #61979 Co-authored-by: Chenyang Sun <sunchenyang@selectdb.com>

yiguolei added dev/4.0.6-merged and removed dev/4.0.x labels Apr 15, 2026

mymeiyi mentioned this pull request Apr 21, 2026
[fix](wal) Fix WAL replay loading 0 rows due to columns being marked as missing #62658
Merged

morningman mentioned this pull request Jun 3, 2026
4.0.6 Release Notes #64065
Closed

Uh oh!

Conversation

csun5285 commented Apr 1, 2026• edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

What problem does this PR solve?

Release note

Check List (For Author)

Check List (For Reviewer who merge this PR)

Uh oh!

hello-stephen commented Apr 1, 2026

Uh oh!

csun5285 commented Apr 1, 2026

Uh oh!

hello-stephen commented Apr 1, 2026

Cloud UT Coverage Report

Uh oh!

doris-robot commented Apr 1, 2026

Uh oh!

doris-robot commented Apr 1, 2026

Uh oh!

hello-stephen commented Apr 1, 2026

BE UT Coverage Report

Uh oh!

hello-stephen commented Apr 1, 2026

BE Regression && UT Coverage Report

Uh oh!

eldenmoon left a comment

Choose a reason for hiding this comment

Uh oh!

github-actionsBot commented Apr 1, 2026

Uh oh!

github-actionsBot commented Apr 1, 2026

Uh oh!

csun5285 commented Apr 1, 2026

Uh oh!

doris-robot commented Apr 1, 2026

Cloud UT Coverage Report

Uh oh!

hello-stephen commented Apr 1, 2026

FE UT Coverage Report

Uh oh!

hello-stephen commented Apr 1, 2026

BE Regression && UT Coverage Report

Uh oh!

hello-stephen commented Apr 1, 2026

BE Regression && UT Coverage Report

Uh oh!

hello-stephen commented Apr 1, 2026

BE Regression && UT Coverage Report

Uh oh!

doris-robot commented Apr 1, 2026

Uh oh!

hello-stephen commented Apr 1, 2026

BE UT Coverage Report

Uh oh!

doris-robot commented Apr 1, 2026

Uh oh!

hello-stephen commented Apr 1, 2026

BE Regression && UT Coverage Report

Uh oh!

hello-stephen commented Apr 7, 2026

BE Regression && UT Coverage Report

Uh oh!

eldenmoon left a comment

Choose a reason for hiding this comment

Uh oh!

github-actionsBot commented Apr 13, 2026

Uh oh!

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

5 participants

csun5285 commented Apr 1, 2026•
edited
Loading