[opt](catalog) remove old properties by morningman · Pull Request #55625 · apache/doris

morningman · 2025-09-03T07:56:57Z

No description provided.

hello-stephen · 2025-09-03T07:57:05Z

Thank you for your contribution to Apache Doris.
Don't know what should be done next? See How to process your PR.

Please clearly describe your PR:

What problem was fixed (it's best to include specific error reporting information). How it was fixed.
Which behaviors were modified. What was the previous behavior, what is it now, why was it modified, and what possible impacts might there be.
What features were added. Why was this function added?
Which code was refactored and why was this part of the code refactored?
Which functions were optimized and what is the difference before and after the optimization?

morningman · 2025-09-03T17:41:47Z

run buildall

doris-robot · 2025-09-03T18:13:51Z

TPC-H: Total hot run time: 34389 ms

machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 9ac876bf6e2eeeac3929d82179c3975489c8e7b7, data reload: false
------ Round 1 ----------------------------------
q1	17648	5327	5147	5147
q2	2012	322	217	217
q3	10259	1341	738	738
q4	10233	1041	542	542
q5	7526	2456	2347	2347
q6	189	166	142	142
q7	937	768	634	634
q8	9356	1347	1166	1166
q9	6893	5190	5141	5141
q10	6941	2388	2014	2014
q11	502	311	284	284
q12	377	369	232	232
q13	17789	3653	3060	3060
q14	257	240	225	225
q15	554	496	492	492
q16	438	440	382	382
q17	621	880	377	377
q18	7479	7145	7024	7024
q19	1367	950	571	571
q20	344	342	233	233
q21	3748	3309	2422	2422
q22	1087	1026	999	999
Total cold run time: 106557 ms
Total hot run time: 34389 ms
----- Round 2, with runtime_filter_mode=off -----
q1	5353	5185	5174	5174
q2	250	334	227	227
q3	2197	2728	2267	2267
q4	1370	1760	1342	1342
q5	4224	4480	4564	4480
q6	248	180	135	135
q7	2130	1950	1853	1853
q8	2623	2744	2621	2621
q9	7436	7413	7468	7413
q10	3105	3288	2892	2892
q11	583	542	493	493
q12	675	836	636	636
q13	3636	3982	3495	3495
q14	290	303	284	284
q15	518	508	490	490
q16	457	498	433	433
q17	1167	1610	1437	1437
q18	7931	7722	7602	7602
q19	891	872	902	872
q20	2022	2040	1907	1907
q21	5045	4314	4305	4305
q22	1057	1046	991	991
Total cold run time: 53208 ms
Total hot run time: 51349 ms

doris-robot · 2025-09-03T18:25:29Z

TPC-DS: Total hot run time: 187478 ms

machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 9ac876bf6e2eeeac3929d82179c3975489c8e7b7, data reload: false
query1	1043	462	413	413
query2	6567	1779	1752	1752
query3	6756	228	221	221
query4	26684	23574	23340	23340
query5	4444	634	566	566
query6	366	266	248	248
query7	4669	528	306	306
query8	315	293	270	270
query9	8648	2915	2937	2915
query10	519	357	299	299
query11	15942	15261	15170	15170
query12	190	129	129	129
query13	1694	569	445	445
query14	9657	5896	6021	5896
query15	211	191	175	175
query16	7663	662	500	500
query17	1314	743	621	621
query18	2049	435	342	342
query19	211	198	169	169
query20	147	124	121	121
query21	217	135	116	116
query22	4007	4271	4000	4000
query23	33682	32915	33072	32915
query24	8110	2402	2490	2402
query25	574	540	467	467
query26	742	286	173	173
query27	2649	505	359	359
query28	4261	2268	2238	2238
query29	680	605	497	497
query30	294	227	195	195
query31	884	824	724	724
query32	93	82	80	80
query33	562	404	357	357
query34	799	857	522	522
query35	822	847	754	754
query36	955	1020	952	952
query37	126	115	95	95
query38	4012	4071	3996	3996
query39	1486	1456	1435	1435
query40	234	139	127	127
query41	64	65	60	60
query42	129	116	119	116
query43	539	511	469	469
query44	1350	874	868	868
query45	185	185	170	170
query46	859	1015	651	651
query47	1776	1854	1784	1784
query48	394	430	317	317
query49	708	506	449	449
query50	656	692	410	410
query51	4074	4122	4063	4063
query52	123	119	110	110
query53	254	262	203	203
query54	619	619	552	552
query55	97	91	91	91
query56	355	342	330	330
query57	1208	1232	1126	1126
query58	298	286	286	286
query59	2542	2675	2542	2542
query60	368	351	359	351
query61	174	155	156	155
query62	821	736	669	669
query63	235	204	191	191
query64	3125	1155	875	875
query65	4276	4256	4224	4224
query66	900	452	354	354
query67	15362	15085	14950	14950
query68	7928	919	580	580
query69	504	324	295	295
query70	1226	1187	1141	1141
query71	570	357	328	328
query72	6131	5299	5068	5068
query73	719	634	359	359
query74	9302	8914	8978	8914
query75	3856	3077	2660	2660
query76	3556	1153	730	730
query77	813	426	348	348
query78	9626	9789	8910	8910
query79	2398	858	595	595
query80	704	578	537	537
query81	499	251	242	242
query82	483	145	113	113
query83	256	259	244	244
query84	257	109	95	95
query85	909	474	428	428
query86	399	322	330	322
query87	4290	4265	4176	4176
query88	3639	2231	2235	2231
query89	394	326	301	301
query90	1837	240	231	231
query91	160	169	135	135
query92	88	79	72	72
query93	1941	974	649	649
query94	716	413	384	384
query95	414	339	330	330
query96	489	582	277	277
query97	2665	2751	2598	2598
query98	252	222	222	222
query99	1373	1410	1295	1295
Total cold run time: 274163 ms
Total hot run time: 187478 ms

doris-robot · 2025-09-03T18:31:11Z

ClickBench: Total hot run time: 33.05 s

machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 9ac876bf6e2eeeac3929d82179c3975489c8e7b7, data reload: false
query1	0.06	0.05	0.05
query2	0.09	0.05	0.06
query3	0.24	0.08	0.08
query4	1.60	0.12	0.11
query5	0.46	0.42	0.41
query6	1.19	0.64	0.70
query7	0.03	0.03	0.03
query8	0.06	0.05	0.05
query9	0.61	0.53	0.53
query10	0.58	0.57	0.59
query11	0.16	0.12	0.11
query12	0.15	0.13	0.12
query13	0.63	0.62	0.62
query14	0.84	0.82	0.84
query15	0.87	0.85	0.87
query16	0.39	0.41	0.40
query17	1.08	1.06	1.05
query18	0.25	0.20	0.20
query19	2.00	1.86	1.82
query20	0.02	0.01	0.02
query21	15.41	1.00	0.60
query22	0.82	1.17	0.68
query23	14.92	1.42	0.60
query24	6.98	1.08	1.23
query25	0.52	0.26	0.14
query26	0.47	0.17	0.13
query27	0.06	0.05	0.04
query28	10.29	0.99	0.47
query29	12.68	3.91	3.22
query30	3.13	3.03	3.02
query31	2.84	0.59	0.38
query32	3.26	0.55	0.52
query33	3.25	3.02	3.14
query34	16.14	5.52	4.81
query35	4.99	4.91	4.99
query36	0.73	0.52	0.51
query37	0.10	0.07	0.07
query38	0.06	0.05	0.05
query39	0.05	0.03	0.03
query40	0.18	0.15	0.15
query41	0.09	0.04	0.03
query42	0.04	0.03	0.03
query43	0.04	0.04	0.04
Total cold run time: 108.36 s
Total hot run time: 33.05 s

hello-stephen · 2025-09-03T18:47:42Z

FE UT Coverage Report

Increment line coverage 36.36% (20/55) 🎉
Increment coverage report
Complete coverage report

hello-stephen · 2025-09-03T20:29:33Z

FE Regression Coverage Report

Increment line coverage 32.73% (18/55) 🎉
Increment coverage report
Complete coverage report

morningman · 2025-09-04T06:04:35Z

run buildall

doris-robot · 2025-09-04T06:25:45Z

TPC-H: Total hot run time: 34204 ms

machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 7f4c1ade6af9f517ffbb83c9ffe163d876bfb3b8, data reload: false
------ Round 1 ----------------------------------
q1	17705	5193	5080	5080
q2	2022	377	219	219
q3	10210	1299	729	729
q4	10237	1027	529	529
q5	7548	2428	2462	2428
q6	183	173	139	139
q7	956	769	615	615
q8	9336	1341	1107	1107
q9	6946	5159	5112	5112
q10	6886	2398	2021	2021
q11	495	311	281	281
q12	352	354	244	244
q13	17772	3653	3031	3031
q14	239	251	219	219
q15	557	520	481	481
q16	430	437	372	372
q17	592	853	364	364
q18	7582	7098	7109	7098
q19	1240	959	550	550
q20	349	348	230	230
q21	3828	3202	2358	2358
q22	1089	1038	997	997
Total cold run time: 106554 ms
Total hot run time: 34204 ms
----- Round 2, with runtime_filter_mode=off -----
q1	5127	5147	5106	5106
q2	254	340	234	234
q3	2164	2651	2300	2300
q4	1357	1744	1364	1364
q5	4213	4342	4653	4342
q6	233	177	136	136
q7	2049	2008	1788	1788
q8	2688	2569	2591	2569
q9	7351	7408	7224	7224
q10	3137	3334	2870	2870
q11	652	568	518	518
q12	739	793	869	793
q13	3462	3816	3355	3355
q14	309	323	279	279
q15	521	477	473	473
q16	481	514	442	442
q17	1227	1669	1421	1421
q18	8018	7638	7670	7638
q19	801	864	899	864
q20	2065	2046	1939	1939
q21	4934	4654	4454	4454
q22	1095	1047	1013	1013
Total cold run time: 52877 ms
Total hot run time: 51122 ms

doris-robot · 2025-09-04T06:37:28Z

TPC-DS: Total hot run time: 187237 ms

machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 7f4c1ade6af9f517ffbb83c9ffe163d876bfb3b8, data reload: false
query1	1057	448	427	427
query2	6556	1739	1747	1739
query3	6760	222	228	222
query4	26140	23508	23682	23508
query5	5893	668	506	506
query6	348	254	216	216
query7	4682	529	294	294
query8	305	256	240	240
query9	8627	2943	2934	2934
query10	550	333	292	292
query11	16308	15014	14736	14736
query12	184	122	116	116
query13	1671	545	430	430
query14	9733	5826	5796	5796
query15	242	198	174	174
query16	7657	652	527	527
query17	1206	779	678	678
query18	2074	454	348	348
query19	223	212	189	189
query20	144	129	126	126
query21	217	138	119	119
query22	4169	4261	4122	4122
query23	34084	33062	32753	32753
query24	8136	2375	2432	2375
query25	575	533	459	459
query26	1257	289	168	168
query27	2708	515	355	355
query28	4442	2285	2261	2261
query29	811	602	490	490
query30	293	224	194	194
query31	912	834	737	737
query32	90	85	79	79
query33	583	402	368	368
query34	808	856	544	544
query35	826	846	750	750
query36	985	1004	884	884
query37	124	110	90	90
query38	4064	4069	4010	4010
query39	1498	1443	1396	1396
query40	230	136	129	129
query41	64	61	89	61
query42	130	117	117	117
query43	572	510	466	466
query44	1398	883	871	871
query45	182	184	180	180
query46	864	1040	667	667
query47	1790	1817	1724	1724
query48	393	422	335	335
query49	741	536	448	448
query50	657	711	402	402
query51	4175	4141	4102	4102
query52	118	114	109	109
query53	254	271	200	200
query54	611	621	541	541
query55	101	93	101	93
query56	376	330	327	327
query57	1206	1224	1160	1160
query58	297	280	283	280
query59	2591	2746	2648	2648
query60	357	356	348	348
query61	176	160	156	156
query62	809	719	675	675
query63	236	197	197	197
query64	4398	1143	847	847
query65	4307	4190	4236	4190
query66	1039	436	369	369
query67	15519	15273	15207	15207
query68	8035	949	646	646
query69	518	336	303	303
query70	1178	1140	1108	1108
query71	609	349	322	322
query72	5979	5028	5002	5002
query73	676	630	364	364
query74	8993	9258	8947	8947
query75	3382	3102	2651	2651
query76	3367	1145	738	738
query77	623	403	355	355
query78	9685	9561	8741	8741
query79	2820	843	611	611
query80	764	586	528	528
query81	569	259	218	218
query82	476	144	115	115
query83	265	262	252	252
query84	253	116	100	100
query85	844	476	430	430
query86	341	317	331	317
query87	4255	4322	4260	4260
query88	3899	2234	2252	2234
query89	402	360	299	299
query90	1868	229	231	229
query91	164	162	142	142
query92	92	73	70	70
query93	2412	1015	659	659
query94	733	436	385	385
query95	410	339	330	330
query96	496	578	276	276
query97	2661	2708	2593	2593
query98	261	220	224	220
query99	1680	1426	1291	1291
Total cold run time: 279243 ms
Total hot run time: 187237 ms

doris-robot · 2025-09-04T06:43:08Z

ClickBench: Total hot run time: 33.01 s

machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 7f4c1ade6af9f517ffbb83c9ffe163d876bfb3b8, data reload: false
query1	0.06	0.06	0.05
query2	0.10	0.06	0.05
query3	0.26	0.08	0.08
query4	1.61	0.11	0.12
query5	0.45	0.44	0.40
query6	1.16	0.64	0.63
query7	0.04	0.02	0.02
query8	0.06	0.05	0.04
query9	0.60	0.54	0.53
query10	0.59	0.58	0.57
query11	0.16	0.12	0.12
query12	0.15	0.12	0.12
query13	0.63	0.63	0.62
query14	0.80	0.82	0.85
query15	0.87	0.86	0.86
query16	0.40	0.41	0.39
query17	1.07	1.07	1.08
query18	0.22	0.21	0.20
query19	1.90	1.85	1.83
query20	0.02	0.02	0.02
query21	15.41	0.94	0.58
query22	0.77	1.15	0.68
query23	14.96	1.39	0.64
query24	6.87	1.46	1.00
query25	0.49	0.25	0.16
query26	0.57	0.15	0.14
query27	0.05	0.06	0.05
query28	9.91	0.92	0.44
query29	12.55	3.92	3.23
query30	3.12	3.03	3.01
query31	2.83	0.60	0.38
query32	3.25	0.56	0.46
query33	3.06	3.03	3.10
query34	16.23	5.45	4.84
query35	4.90	4.97	4.97
query36	0.69	0.51	0.50
query37	0.11	0.08	0.07
query38	0.07	0.05	0.04
query39	0.03	0.03	0.03
query40	0.19	0.14	0.14
query41	0.08	0.03	0.03
query42	0.03	0.03	0.03
query43	0.04	0.03	0.04
Total cold run time: 107.36 s
Total hot run time: 33.01 s

hello-stephen · 2025-09-04T07:10:28Z

FE UT Coverage Report

Increment line coverage 39.66% (23/58) 🎉
Increment coverage report
Complete coverage report

hello-stephen · 2025-09-04T08:48:01Z

FE Regression Coverage Report

Increment line coverage 44.83% (26/58) 🎉
Increment coverage report
Complete coverage report

github-actions · 2025-09-05T17:20:23Z

PR approved by anyone and no changes requested.

github-actions · 2025-09-05T22:30:20Z

PR approved by at least one committer and no changes requested.

(cherry picked from commit 71c5f35)

) cherry-pick #55625 #56163 --------- Co-authored-by: Mingyu Chen (Rayner) <morningman@163.com>

morningman added the dev/3.1.x label Sep 3, 2025

morningman added 4 commits September 3, 2025 21:57

1
b09ce5e

[opt] remove old properties
9f541aa

3
b6718b4

2
7f4c1ad

morningman force-pushed the remove_old_prop2 branch from 9ac876b to 7f4c1adCompare September 4, 2025 04:57

zgxme approved these changes Sep 5, 2025
View reviewed changes

github-actionsBot added the reviewed label Sep 5, 2025

CalvinKirs approved these changes Sep 5, 2025
View reviewed changes

github-actionsBot added the approved Indicates a PR has been approved by one committer. label Sep 5, 2025

morningman merged commit 71c5f35 into apache:masterSep 6, 2025
25 of 26 checks passed

github-actionsBot added the dev/3.1.x-conflict label Sep 6, 2025

wenzhenghu pushed a commit to wenzhenghu/doris that referenced this pull request Sep 8, 2025
[opt](catalog) remove old properties (apache#55625)
72cf7ad

CalvinKirs pushed a commit to CalvinKirs/incubator-doris that referenced this pull request Sep 26, 2025
[opt](catalog) remove old properties (apache#55625)
fa39632
(cherry picked from commit 71c5f35)

CalvinKirs mentioned this pull request Sep 26, 2025
branch-3.1: [opt](catalog) remove old properties (#55625 #56163) #56505
Merged

morningman added a commit that referenced this pull request Sep 28, 2025
branch-3.1: [opt](catalog) remove old properties (#55625#56163) (#56505
8d2288d
) cherry-pick #55625 #56163 --------- Co-authored-by: Mingyu Chen (Rayner) <morningman@163.com>

morningman added dev/3.1.2-merged and removed dev/3.1.x dev/3.1.x-conflict labels Sep 28, 2025

Uh oh!

Conversation

morningman commented Sep 3, 2025

Uh oh!

hello-stephen commented Sep 3, 2025

Uh oh!

morningman commented Sep 3, 2025

Uh oh!

doris-robot commented Sep 3, 2025

Uh oh!

doris-robot commented Sep 3, 2025

Uh oh!

doris-robot commented Sep 3, 2025

Uh oh!

hello-stephen commented Sep 3, 2025

FE UT Coverage Report

Uh oh!

hello-stephen commented Sep 3, 2025

FE Regression Coverage Report

Uh oh!

morningman commented Sep 4, 2025

Uh oh!

doris-robot commented Sep 4, 2025

Uh oh!

doris-robot commented Sep 4, 2025

Uh oh!

doris-robot commented Sep 4, 2025

Uh oh!

hello-stephen commented Sep 4, 2025

FE UT Coverage Report

Uh oh!

hello-stephen commented Sep 4, 2025

FE Regression Coverage Report

Uh oh!

github-actionsBot commented Sep 5, 2025

Uh oh!

github-actionsBot commented Sep 5, 2025

Uh oh!

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

5 participants