Skip to content

[improvement](mtmv) Support to add use_for_rewrite property when create materialized view - #40332

Merged
morrySnow merged 9 commits into
apache:masterfrom
seawinde:mv_add_enable_rewrite_field
Sep 11, 2024
Merged

[improvement](mtmv) Support to add use_for_rewrite property when create materialized view#40332
morrySnow merged 9 commits into
apache:masterfrom
seawinde:mv_add_enable_rewrite_field

Conversation

@seawinde

@seawindeseawinde commented Sep 3, 2024•
edited
Loading

Copy link
Copy Markdown
Member

Proposed changes

Add use_for_rewrite property when create mv. Default true;
If use_for_rewrite is false which means the mv would not partion in query rewrite.
Such as mv def is as following:

 CREATE MATERIALIZED VIEW mv1
BUILD IMMEDIATE REFRESH AUTO ON MANUAL
DISTRIBUTED BY RANDOM BUCKETS 2
PROPERTIES (
'replication_num'='1',
'use_for_rewrite'='false'
)
ASSELECT k1, k2, count(*) from t1 group by k1, k2;

if we run query as following, this mv would not partition in the query rewrite:

SELECT k2, count(*) from t1 group by k2;

@doris-robot

doris-robot commented Sep 3, 2024

Copy link
Copy Markdown

Thank you for your contribution to Apache Doris.
Don't know what should be done next? See How to process your PR

Since 2024-03-18, the Document has been moved to doris-website.
See Doris Document.

@seawinde

seawinde commented Sep 3, 2024

Copy link
Copy Markdown
MemberAuthor

run buildall

1 similar comment
@seawinde

seawinde commented Sep 4, 2024

Copy link
Copy Markdown
MemberAuthor

run buildall

@doris-robot

doris-robot commented Sep 4, 2024

Copy link
Copy Markdown
TPC-H: Total hot run time: 37811 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 0b5bceedeb4508e350f58ffd2e1a2d0017857a39, data reload: false
------ Round 1 ----------------------------------
q1	17643	4592	4304	4304
q2	2024	197	182	182
q3	11402	1009	1115	1009
q4	10527	715	722	715
q5	7752	2841	2830	2830
q6	233	142	142	142
q7	968	619	604	604
q8	9326	2059	2124	2059
q9	7245	6561	6506	6506
q10	7057	2201	2244	2201
q11	487	239	241	239
q12	400	216	219	216
q13	17776	3088	3089	3088
q14	279	226	238	226
q15	521	497	506	497
q16	634	503	516	503
q17	983	691	675	675
q18	7376	6806	6813	6806
q19	1395	973	937	937
q20	700	338	327	327
q21	3997	3013	2752	2752
q22	1124	993	1010	993
Total cold run time: 109849 ms
Total hot run time: 37811 ms
----- Round 2, with runtime_filter_mode=off -----
q1	4436	4350	4286	4286
q2	389	280	271	271
q3	2878	2663	2653	2653
q4	1937	1657	1650	1650
q5	5587	5666	5702	5666
q6	229	142	150	142
q7	2254	1851	1810	1810
q8	3315	3441	3435	3435
q9	8875	8899	8803	8803
q10	3553	3321	3405	3321
q11	639	509	513	509
q12	831	664	689	664
q13	12986	3324	3238	3238
q14	317	297	288	288
q15	539	497	493	493
q16	638	592	573	573
q17	1831	1527	1539	1527
q18	8163	7739	7770	7739
q19	1752	1548	1544	1544
q20	2111	1934	1902	1902
q21	5716	5388	5555	5388
q22	1209	1060	1028	1028
Total cold run time: 70185 ms
Total hot run time: 56930 ms

@doris-robot

doris-robot commented Sep 4, 2024

Copy link
Copy Markdown
TPC-DS: Total hot run time: 192352 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 0b5bceedeb4508e350f58ffd2e1a2d0017857a39, data reload: false
query1	1252	904	871	871
query2	6290	1943	1916	1916
query3	10619	3814	3713	3713
query4	59774	27546	23285	23285
query5	5416	523	503	503
query6	432	163	164	163
query7	5873	291	289	289
query8	289	199	215	199
query9	9128	2454	2458	2454
query10	503	276	262	262
query11	18289	14955	15567	14955
query12	160	96	100	96
query13	1622	391	380	380
query14	11197	7737	7492	7492
query15	227	182	180	180
query16	7649	480	495	480
query17	1166	641	595	595
query18	2051	295	303	295
query19	301	164	144	144
query20	129	118	113	113
query21	211	105	108	105
query22	4538	4335	4328	4328
query23	34228	33619	33172	33172
query24	5970	2847	2861	2847
query25	530	382	413	382
query26	696	151	150	150
query27	1810	273	277	273
query28	3824	2018	2017	2017
query29	705	439	396	396
query30	229	159	147	147
query31	940	762	753	753
query32	82	55	55	55
query33	477	288	284	284
query34	879	462	473	462
query35	858	728	736	728
query36	1072	939	910	910
query37	149	90	91	90
query38	4026	3937	3906	3906
query39	1463	1371	1533	1371
query40	199	116	111	111
query41	48	46	44	44
query42	118	105	96	96
query43	513	464	456	456
query44	1080	734	739	734
query45	193	164	160	160
query46	1082	711	738	711
query47	1913	1780	1809	1780
query48	362	300	297	297
query49	751	425	426	425
query50	816	418	403	403
query51	7038	6827	6834	6827
query52	99	91	87	87
query53	255	180	177	177
query54	572	466	464	464
query55	77	77	80	77
query56	304	266	270	266
query57	1185	1100	1070	1070
query58	236	235	244	235
query59	3106	2801	2739	2739
query60	308	278	273	273
query61	124	124	120	120
query62	778	666	667	666
query63	220	186	189	186
query64	2923	769	760	760
query65	3198	3138	3155	3138
query66	685	344	371	344
query67	15457	15328	15222	15222
query68	3046	571	576	571
query69	412	301	294	294
query70	1183	1100	1126	1100
query71	349	285	292	285
query72	6409	4077	4108	4077
query73	759	324	325	324
query74	9023	8966	8880	8880
query75	3343	2703	2705	2703
query76	1515	991	1003	991
query77	572	330	325	325
query78	9855	8988	9350	8988
query79	1089	530	521	521
query80	841	519	502	502
query81	487	235	229	229
query82	880	144	186	144
query83	173	144	154	144
query84	261	79	75	75
query85	795	293	295	293
query86	312	289	301	289
query87	4453	4228	4223	4223
query88	3055	2327	2316	2316
query89	384	285	273	273
query90	1980	187	187	187
query91	123	97	97	97
query92	62	47	50	47
query93	1143	524	518	518
query94	793	300	294	294
query95	350	252	250	250
query96	586	269	266	266
query97	3274	3106	3051	3051
query98	229	211	197	197
query99	1543	1269	1307	1269
Total cold run time: 307973 ms
Total hot run time: 192352 ms

@doris-robot

doris-robot commented Sep 4, 2024

Copy link
Copy Markdown
ClickBench: Total hot run time: 32.11 s
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 0b5bceedeb4508e350f58ffd2e1a2d0017857a39, data reload: false
query1	0.05	0.05	0.04
query2	0.08	0.04	0.04
query3	0.22	0.05	0.05
query4	1.68	0.09	0.07
query5	0.51	0.48	0.50
query6	1.14	0.73	0.73
query7	0.02	0.01	0.02
query8	0.06	0.05	0.04
query9	0.56	0.47	0.47
query10	0.55	0.55	0.55
query11	0.15	0.11	0.11
query12	0.15	0.13	0.13
query13	0.60	0.58	0.60
query14	2.02	2.05	2.04
query15	0.90	0.83	0.84
query16	0.38	0.37	0.38
query17	1.05	1.08	1.00
query18	0.21	0.20	0.21
query19	1.91	1.75	1.78
query20	0.02	0.01	0.01
query21	15.39	0.66	0.65
query22	3.82	7.75	1.92
query23	18.31	1.32	1.28
query24	2.11	0.22	0.23
query25	0.14	0.08	0.09
query26	0.27	0.19	0.19
query27	0.08	0.07	0.07
query28	13.25	1.01	1.00
query29	12.61	3.32	3.36
query30	0.24	0.06	0.05
query31	2.87	0.41	0.39
query32	3.27	0.48	0.48
query33	2.97	3.00	3.00
query34	17.16	4.41	4.40
query35	4.46	4.49	4.52
query36	0.67	0.47	0.48
query37	0.19	0.16	0.16
query38	0.16	0.15	0.15
query39	0.05	0.04	0.04
query40	0.16	0.12	0.12
query41	0.09	0.04	0.04
query42	0.06	0.05	0.04
query43	0.05	0.05	0.05
Total cold run time: 110.64 s
Total hot run time: 32.11 s

@morrySnow

morrySnow commented Sep 4, 2024

Copy link
Copy Markdown
Contributor

is_used_in_rewrite -> use_for_rewrite

@seawinde

seawinde commented Sep 4, 2024

Copy link
Copy Markdown
MemberAuthor

run buildall

@doris-robot

doris-robot commented Sep 4, 2024

Copy link
Copy Markdown
TPC-H: Total hot run time: 38457 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 44f98174ab94da3a25de3579eca37daab45aaad9, data reload: false
------ Round 1 ----------------------------------
q1	18896	5198	4310	4310
q2	2020	186	178	178
q3	11714	998	1094	998
q4	10507	757	786	757
q5	7810	2910	2872	2872
q6	241	151	145	145
q7	993	632	626	626
q8	9916	2108	2133	2108
q9	7255	6637	6714	6637
q10	7932	2308	2177	2177
q11	460	243	237	237
q12	445	225	222	222
q13	18326	3200	3171	3171
q14	284	249	248	248
q15	553	504	516	504
q16	1680	513	507	507
q17	988	637	661	637
q18	7340	6904	6796	6796
q19	1459	966	991	966
q20	672	340	336	336
q21	3911	3049	2987	2987
q22	1128	1038	1042	1038
Total cold run time: 114530 ms
Total hot run time: 38457 ms
----- Round 2, with runtime_filter_mode=off -----
q1	4371	4304	4302	4302
q2	387	272	263	263
q3	2877	2633	2633	2633
q4	1984	1744	1750	1744
q5	5706	5828	5640	5640
q6	233	133	137	133
q7	2213	1796	1815	1796
q8	3337	3539	3463	3463
q9	8922	8803	8975	8803
q10	3627	3333	3288	3288
q11	635	533	541	533
q12	862	620	605	605
q13	16172	3338	3335	3335
q14	322	277	290	277
q15	557	488	490	488
q16	636	568	584	568
q17	1846	1569	1522	1522
q18	8127	8113	7981	7981
q19	1742	1551	1542	1542
q20	2150	1897	1909	1897
q21	5860	5420	5281	5281
q22	1206	1078	1071	1071
Total cold run time: 73772 ms
Total hot run time: 57165 ms

@doris-robot

doris-robot commented Sep 4, 2024

Copy link
Copy Markdown
TPC-DS: Total hot run time: 192909 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 44f98174ab94da3a25de3579eca37daab45aaad9, data reload: false
query1	1240	891	872	872
query2	6447	1983	1868	1868
query3	10787	4089	4067	4067
query4	59470	25470	23550	23550
query5	5406	500	497	497
query6	403	174	160	160
query7	5766	299	289	289
query8	282	199	202	199
query9	9028	2509	2489	2489
query10	495	296	260	260
query11	17929	14974	15409	14974
query12	153	108	100	100
query13	1569	422	398	398
query14	11045	7439	7443	7439
query15	276	191	182	182
query16	7567	467	500	467
query17	1284	602	579	579
query18	2035	308	292	292
query19	289	148	142	142
query20	116	104	108	104
query21	214	106	102	102
query22	4504	4485	4452	4452
query23	34495	33101	33441	33101
query24	5972	2888	2824	2824
query25	527	369	392	369
query26	686	148	146	146
query27	1794	292	277	277
query28	3689	2044	2041	2041
query29	687	404	397	397
query30	273	156	158	156
query31	923	755	766	755
query32	82	51	52	51
query33	435	280	283	280
query34	868	476	477	476
query35	837	705	712	705
query36	1037	939	940	939
query37	151	90	87	87
query38	3944	3922	3862	3862
query39	1578	1404	1394	1394
query40	204	116	120	116
query41	48	47	45	45
query42	110	98	97	97
query43	503	472	464	464
query44	1091	730	740	730
query45	203	170	166	166
query46	1095	741	697	697
query47	1894	1784	1806	1784
query48	374	306	306	306
query49	782	445	457	445
query50	838	413	420	413
query51	7023	6856	6970	6856
query52	99	88	89	88
query53	247	180	177	177
query54	577	462	459	459
query55	78	76	72	72
query56	277	264	285	264
query57	1188	1072	1096	1072
query58	240	248	231	231
query59	3017	2723	2646	2646
query60	313	279	284	279
query61	124	124	125	124
query62	746	651	665	651
query63	218	185	189	185
query64	2741	750	743	743
query65	3192	3164	3175	3164
query66	696	343	354	343
query67	15445	15352	15134	15134
query68	3250	612	585	585
query69	416	306	294	294
query70	1127	1131	1112	1112
query71	375	280	291	280
query72	6489	4156	4276	4156
query73	791	325	325	325
query74	9280	8856	8879	8856
query75	3359	2703	2706	2703
query76	1421	1048	967	967
query77	578	313	301	301
query78	10166	9066	9044	9044
query79	3119	539	539	539
query80	1092	510	509	509
query81	570	234	227	227
query82	862	149	142	142
query83	174	145	147	145
query84	256	82	74	74
query85	911	284	270	270
query86	357	305	295	295
query87	4467	4187	4289	4187
query88	4427	2369	2433	2369
query89	406	281	277	277
query90	1777	190	185	185
query91	123	99	129	99
query92	67	47	50	47
query93	2647	536	531	531
query94	759	298	283	283
query95	344	251	252	251
query96	617	267	267	267
query97	3199	3046	3084	3046
query98	231	207	190	190
query99	1859	1260	1269	1260
Total cold run time: 313162 ms
Total hot run time: 192909 ms

@doris-robot

doris-robot commented Sep 4, 2024

Copy link
Copy Markdown
ClickBench: Total hot run time: 32.72 s
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 44f98174ab94da3a25de3579eca37daab45aaad9, data reload: false
query1	0.05	0.04	0.05
query2	0.07	0.04	0.03
query3	0.23	0.07	0.06
query4	1.65	0.08	0.08
query5	0.50	0.49	0.51
query6	1.12	0.72	0.71
query7	0.01	0.01	0.01
query8	0.05	0.05	0.05
query9	0.56	0.48	0.49
query10	0.56	0.55	0.54
query11	0.16	0.11	0.11
query12	0.15	0.13	0.13
query13	0.61	0.59	0.59
query14	2.02	2.06	2.13
query15	0.89	0.83	0.81
query16	0.38	0.38	0.37
query17	1.06	1.05	1.05
query18	0.22	0.20	0.21
query19	1.97	1.80	1.84
query20	0.02	0.01	0.01
query21	15.38	0.66	0.66
query22	4.03	6.75	2.46
query23	18.27	1.41	1.28
query24	2.13	0.23	0.22
query25	0.15	0.08	0.08
query26	0.27	0.18	0.17
query27	0.07	0.07	0.08
query28	13.20	1.02	1.00
query29	12.60	3.30	3.26
query30	0.24	0.06	0.05
query31	2.88	0.43	0.39
query32	3.24	0.48	0.47
query33	2.95	3.01	3.03
query34	17.01	4.43	4.50
query35	4.48	4.50	4.49
query36	0.66	0.49	0.48
query37	0.19	0.15	0.15
query38	0.16	0.15	0.14
query39	0.05	0.04	0.04
query40	0.16	0.13	0.13
query41	0.09	0.04	0.04
query42	0.05	0.05	0.05
query43	0.05	0.04	0.03
Total cold run time: 110.59 s
Total hot run time: 32.72 s

@morrySnowmorrySnow added kind/docs Categorizes issue or PR as related to documentation. dev/2.1.x labels Sep 6, 2024
@morrySnowmorrySnow changed the title [improvement](mtmv) Support to add is_used_in_rewrite property when create materialized view[improvement](mtmv) Support to add use_for_rewrite property when create materialized viewSep 6, 2024
morrySnow
morrySnow reviewed Sep 6, 2024
View reviewed changes
Comment thread.../main/java/org/apache/doris/nereids/rules/exploration/mv/InitMaterializationContextHook.java Outdated
Comment on lines +148 to +150
LOG.debug(String.format("mv doesn't part in query rewrite process because "
+ "use_for_rewrite is false, mv is %s",
materializedView.getName()));

@morrySnowmorrySnowSep 6, 2024

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

avoid use string format, use '{}' in message template to avoid new string object for every log even if not print it

@seawindeseawindeSep 6, 2024

Copy link
Copy Markdown
MemberAuthor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Have fixed it

@seawinde
seawindeforce-pushed the mv_add_enable_rewrite_field branch from 44f9817 to 7e5124bCompareSeptember 6, 2024 10:23
@seawinde

seawinde commented Sep 6, 2024

Copy link
Copy Markdown
MemberAuthor

run buildall

@doris-robot

doris-robot commented Sep 6, 2024

Copy link
Copy Markdown
TPC-H: Total hot run time: 38082 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 7e5124b1124808d57e40be454e57e3fd92afb8f8, data reload: false
------ Round 1 ----------------------------------
q1	17771	5215	4349	4349
q2	2029	195	184	184
q3	11492	964	1141	964
q4	10515	695	743	695
q5	7779	2890	2837	2837
q6	230	141	141	141
q7	966	641	597	597
q8	9309	2087	2074	2074
q9	7247	6548	6549	6548
q10	6997	2243	2241	2241
q11	449	244	245	244
q12	402	234	228	228
q13	17771	3094	3087	3087
q14	286	237	238	237
q15	534	500	469	469
q16	535	428	433	428
q17	989	638	703	638
q18	7377	6822	6907	6822
q19	1388	1054	995	995
q20	661	340	336	336
q21	4162	2996	2954	2954
q22	1093	1015	1014	1014
Total cold run time: 109982 ms
Total hot run time: 38082 ms
----- Round 2, with runtime_filter_mode=off -----
q1	4379	4243	4283	4243
q2	387	274	270	270
q3	2898	2683	2641	2641
q4	1932	1659	1714	1659
q5	5657	5660	5752	5660
q6	239	140	138	138
q7	2230	1825	1803	1803
q8	3363	3449	3527	3449
q9	8802	8828	8830	8828
q10	3622	3398	3346	3346
q11	632	501	540	501
q12	831	662	662	662
q13	15621	3214	3292	3214
q14	327	280	290	280
q15	554	480	485	480
q16	550	497	501	497
q17	1867	1550	1548	1548
q18	8233	7783	7846	7783
q19	1702	1615	1521	1521
q20	2141	1918	1907	1907
q21	5653	5353	5462	5353
q22	1107	1035	1039	1035
Total cold run time: 72727 ms
Total hot run time: 56818 ms

@doris-robot

doris-robot commented Sep 6, 2024

Copy link
Copy Markdown
TPC-DS: Total hot run time: 190022 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 7e5124b1124808d57e40be454e57e3fd92afb8f8, data reload: false
query1	1268	885	874	874
query2	6373	1911	1887	1887
query3	10640	3926	3852	3852
query4	59341	23956	23046	23046
query5	5451	510	525	510
query6	424	158	157	157
query7	5746	285	290	285
query8	350	220	217	217
query9	8633	2491	2490	2490
query10	466	272	259	259
query11	17903	15184	15094	15094
query12	159	103	101	101
query13	1515	382	368	368
query14	11026	7260	7087	7087
query15	222	183	171	171
query16	7427	485	475	475
query17	1158	578	548	548
query18	1521	306	289	289
query19	276	146	149	146
query20	137	117	110	110
query21	210	105	103	103
query22	4645	4507	4553	4507
query23	34085	33590	33274	33274
query24	5943	2839	2827	2827
query25	535	407	410	407
query26	692	154	158	154
query27	1766	278	280	278
query28	3604	2048	2011	2011
query29	659	428	417	417
query30	234	158	150	150
query31	958	767	764	764
query32	75	55	55	55
query33	480	290	295	290
query34	869	460	475	460
query35	822	717	716	716
query36	1057	920	962	920
query37	140	99	87	87
query38	4110	3796	3944	3796
query39	1559	1446	1390	1390
query40	199	115	113	113
query41	49	48	45	45
query42	113	100	96	96
query43	501	465	469	465
query44	1081	748	733	733
query45	196	166	167	166
query46	1071	718	738	718
query47	1943	1798	1814	1798
query48	365	289	304	289
query49	791	444	435	435
query50	819	408	421	408
query51	7051	6818	6842	6818
query52	101	86	94	86
query53	266	184	184	184
query54	562	457	458	457
query55	74	77	77	77
query56	274	266	265	265
query57	1181	1076	1068	1068
query58	232	238	240	238
query59	3055	2768	2727	2727
query60	299	279	275	275
query61	124	117	121	117
query62	737	626	661	626
query63	230	189	192	189
query64	2955	681	656	656
query65	3199	3117	3157	3117
query66	669	333	343	333
query67	15564	15150	15305	15150
query68	4139	574	571	571
query69	403	274	274	274
query70	1170	1146	1079	1079
query71	340	278	276	276
query72	6496	3998	2519	2519
query73	762	319	321	319
query74	9191	8806	8735	8735
query75	3366	2645	2718	2645
query76	1508	973	1037	973
query77	537	317	323	317
query78	10441	9080	9043	9043
query79	1071	546	523	523
query80	875	506	519	506
query81	547	229	233	229
query82	547	140	139	139
query83	173	145	150	145
query84	268	79	72	72
query85	845	293	278	278
query86	315	303	283	283
query87	4518	4264	4171	4171
query88	2937	2286	2265	2265
query89	397	285	286	285
query90	1846	187	184	184
query91	123	99	101	99
query92	60	51	50	50
query93	1394	536	532	532
query94	746	303	290	290
query95	393	256	259	256
query96	579	259	258	258
query97	3158	3062	3015	3015
query98	217	205	212	205
query99	1648	1265	1269	1265
Total cold run time: 307190 ms
Total hot run time: 190022 ms

@doris-robot

doris-robot commented Sep 6, 2024

Copy link
Copy Markdown
ClickBench: Total hot run time: 31.64 s
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 7e5124b1124808d57e40be454e57e3fd92afb8f8, data reload: false
query1	0.05	0.05	0.04
query2	0.08	0.04	0.05
query3	0.22	0.05	0.05
query4	1.68	0.08	0.09
query5	0.52	0.51	0.50
query6	1.13	0.72	0.73
query7	0.02	0.01	0.01
query8	0.06	0.05	0.05
query9	0.55	0.49	0.50
query10	0.54	0.56	0.53
query11	0.15	0.11	0.11
query12	0.14	0.12	0.11
query13	0.60	0.60	0.58
query14	1.36	1.42	1.39
query15	0.84	0.82	0.82
query16	0.38	0.38	0.38
query17	1.06	1.07	1.05
query18	0.21	0.20	0.19
query19	1.85	1.77	1.84
query20	0.01	0.01	0.02
query21	15.41	0.68	0.66
query22	4.24	6.43	2.12
query23	18.29	1.26	1.23
query24	2.04	0.23	0.23
query25	0.15	0.08	0.08
query26	0.27	0.18	0.18
query27	0.08	0.08	0.08
query28	13.25	1.02	1.00
query29	12.63	3.40	3.40
query30	0.24	0.06	0.06
query31	2.87	0.41	0.39
query32	3.23	0.47	0.47
query33	2.95	3.02	3.04
query34	17.11	4.35	4.42
query35	4.44	4.44	4.40
query36	0.65	0.47	0.50
query37	0.18	0.15	0.16
query38	0.16	0.15	0.15
query39	0.04	0.04	0.03
query40	0.16	0.13	0.12
query41	0.10	0.04	0.05
query42	0.06	0.05	0.05
query43	0.05	0.04	0.04
Total cold run time: 110.05 s
Total hot run time: 31.64 s

zddr
zddr approved these changes Sep 9, 2024
View reviewed changes
Comment threadfe/fe-core/src/main/java/org/apache/doris/mtmv/MTMVPropertyUtil.java
Comment thread.../main/java/org/apache/doris/nereids/rules/exploration/mv/InitMaterializationContextHook.java Outdated
@github-actions

github-actionsBot commented Sep 9, 2024

Copy link
Copy Markdown
Contributor

PR approved by anyone and no changes requested.

@seawinde

seawinde commented Sep 9, 2024

Copy link
Copy Markdown
MemberAuthor

run buildall

@doris-robot

doris-robot commented Sep 9, 2024

Copy link
Copy Markdown
TPC-H: Total hot run time: 37715 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 71e619d6003f839dcacad4a18ccc04339c1a86ca, data reload: false
------ Round 1 ----------------------------------
q1	17610	4443	4298	4298
q2	2014	189	190	189
q3	11694	965	1179	965
q4	10514	785	717	717
q5	7755	2834	2770	2770
q6	228	135	137	135
q7	973	616	602	602
q8	9352	2036	2079	2036
q9	7226	6476	6573	6476
q10	7000	2267	2196	2196
q11	446	243	244	243
q12	394	224	225	224
q13	18876	3126	3070	3070
q14	290	238	247	238
q15	538	492	473	473
q16	507	435	426	426
q17	984	656	719	656
q18	7279	6961	6824	6824
q19	1395	1063	982	982
q20	710	346	334	334
q21	4009	2864	3002	2864
q22	1112	1033	997	997
Total cold run time: 110906 ms
Total hot run time: 37715 ms
----- Round 2, with runtime_filter_mode=off -----
q1	4335	4265	4247	4247
q2	374	271	263	263
q3	2905	2652	2682	2652
q4	1981	1668	1679	1668
q5	5625	5658	5770	5658
q6	226	131	139	131
q7	2219	1842	1801	1801
q8	3303	3424	3480	3424
q9	8780	8776	8791	8776
q10	3604	3412	3394	3394
q11	595	528	521	521
q12	839	663	649	649
q13	16398	3341	3247	3247
q14	325	289	289	289
q15	547	487	515	487
q16	563	494	497	494
q17	1819	1511	1520	1511
q18	8054	7903	7962	7903
q19	1733	1575	1668	1575
q20	2199	1921	1913	1913
q21	5749	5616	5372	5372
q22	1098	1054	1086	1054
Total cold run time: 73271 ms
Total hot run time: 57029 ms

@doris-robot

doris-robot commented Sep 9, 2024

Copy link
Copy Markdown
TPC-DS: Total hot run time: 192962 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 71e619d6003f839dcacad4a18ccc04339c1a86ca, data reload: false
query1	1250	883	908	883
query2	6438	1945	1916	1916
query3	10636	3799	3852	3799
query4	58640	23960	23231	23231
query5	5335	518	532	518
query6	445	192	180	180
query7	5731	287	290	287
query8	312	221	214	214
query9	8735	2504	2511	2504
query10	471	273	264	264
query11	16056	15080	15052	15052
query12	163	102	97	97
query13	1564	399	374	374
query14	10970	7919	7505	7505
query15	211	184	187	184
query16	7442	469	458	458
query17	1147	567	589	567
query18	2060	301	294	294
query19	272	147	146	146
query20	126	110	111	110
query21	214	113	101	101
query22	4848	4680	4289	4289
query23	34229	33906	33270	33270
query24	5973	2981	2887	2887
query25	530	408	415	408
query26	651	158	153	153
query27	1746	278	277	277
query28	3924	2043	2032	2032
query29	684	427	420	420
query30	244	150	161	150
query31	927	749	774	749
query32	84	53	60	53
query33	443	308	298	298
query34	880	486	497	486
query35	828	717	737	717
query36	1068	929	941	929
query37	152	84	91	84
query38	3964	3954	3896	3896
query39	1488	1409	1376	1376
query40	204	117	118	117
query41	49	47	47	47
query42	118	98	97	97
query43	510	481	483	481
query44	1117	755	758	755
query45	197	173	175	173
query46	1095	793	778	778
query47	1899	1750	1794	1750
query48	387	299	311	299
query49	814	454	468	454
query50	834	433	419	419
query51	6993	6909	6997	6909
query52	99	87	91	87
query53	261	181	189	181
query54	588	452	457	452
query55	76	75	78	75
query56	288	278	263	263
query57	1182	1105	1096	1096
query58	227	244	238	238
query59	3051	2975	2861	2861
query60	317	287	287	287
query61	126	121	126	121
query62	752	658	658	658
query63	230	195	194	194
query64	2520	746	731	731
query65	3242	3182	3159	3159
query66	717	465	331	331
query67	15419	15227	15128	15128
query68	4484	574	555	555
query69	434	274	266	266
query70	1212	1093	1130	1093
query71	419	284	289	284
query72	6626	3984	3945	3945
query73	766	316	321	316
query74	9228	8785	8786	8785
query75	3404	2632	2665	2632
query76	1847	983	1017	983
query77	588	333	328	328
query78	9792	9285	9295	9285
query79	2165	543	548	543
query80	927	543	511	511
query81	558	232	238	232
query82	341	140	141	140
query83	233	153	150	150
query84	265	73	82	73
query85	933	334	279	279
query86	368	302	288	288
query87	4389	4266	4192	4192
query88	3428	2301	2283	2283
query89	395	291	286	286
query90	1797	187	190	187
query91	123	96	97	96
query92	61	48	48	48
query93	2095	553	541	541
query94	708	306	273	273
query95	340	257	254	254
query96	611	259	262	259
query97	3193	3078	3109	3078
query98	216	198	196	196
query99	1545	1293	1282	1282
Total cold run time: 307684 ms
Total hot run time: 192962 ms

@doris-robot

doris-robot commented Sep 9, 2024

Copy link
Copy Markdown
ClickBench: Total hot run time: 31.45 s
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 71e619d6003f839dcacad4a18ccc04339c1a86ca, data reload: false
query1	0.04	0.04	0.04
query2	0.09	0.04	0.04
query3	0.23	0.05	0.05
query4	1.66	0.08	0.09
query5	0.49	0.49	0.48
query6	1.13	0.73	0.73
query7	0.02	0.01	0.01
query8	0.05	0.04	0.05
query9	0.53	0.50	0.47
query10	0.54	0.56	0.56
query11	0.15	0.12	0.12
query12	0.15	0.12	0.12
query13	0.60	0.59	0.58
query14	1.43	1.43	1.42
query15	0.85	0.83	0.83
query16	0.38	0.36	0.36
query17	1.02	0.97	0.98
query18	0.20	0.20	0.20
query19	1.95	1.79	1.77
query20	0.01	0.01	0.01
query21	15.41	0.68	0.67
query22	4.37	7.37	2.00
query23	18.26	1.39	1.26
query24	2.18	0.24	0.21
query25	0.15	0.08	0.07
query26	0.27	0.18	0.18
query27	0.09	0.07	0.07
query28	13.18	1.02	1.00
query29	12.63	3.34	3.33
query30	0.25	0.05	0.05
query31	2.88	0.41	0.39
query32	3.25	0.48	0.48
query33	2.95	2.99	2.99
query34	16.85	4.36	4.39
query35	4.45	4.47	4.46
query36	0.66	0.48	0.49
query37	0.20	0.15	0.15
query38	0.16	0.15	0.15
query39	0.05	0.03	0.04
query40	0.16	0.13	0.12
query41	0.09	0.05	0.05
query42	0.06	0.05	0.04
query43	0.04	0.04	0.03
Total cold run time: 110.11 s
Total hot run time: 31.45 s

@seawinde

seawinde commented Sep 9, 2024

Copy link
Copy Markdown
MemberAuthor

run buildall

@doris-robot

doris-robot commented Sep 9, 2024

Copy link
Copy Markdown
TPC-H: Total hot run time: 37958 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 24c1dfe31136765bc6eb5404e5a186ea9b394de9, data reload: false
------ Round 1 ----------------------------------
q1	17612	4452	4327	4327
q2	2024	196	189	189
q3	11765	994	1170	994
q4	10517	805	652	652
q5	7728	2845	2809	2809
q6	231	142	142	142
q7	961	612	609	609
q8	9341	2045	2084	2045
q9	7110	6528	6507	6507
q10	6988	2253	2160	2160
q11	458	260	248	248
q12	401	230	236	230
q13	18954	3072	3103	3072
q14	274	234	249	234
q15	537	495	488	488
q16	529	443	428	428
q17	998	694	648	648
q18	7341	6981	6916	6916
q19	1383	1028	1102	1028
q20	675	331	337	331
q21	3896	3008	2894	2894
q22	1099	1025	1007	1007
Total cold run time: 110822 ms
Total hot run time: 37958 ms
----- Round 2, with runtime_filter_mode=off -----
q1	4350	4305	4368	4305
q2	399	273	268	268
q3	2897	2664	2714	2664
q4	1965	1686	1674	1674
q5	5670	5668	5771	5668
q6	230	133	136	133
q7	2259	1835	1768	1768
q8	3284	3410	3501	3410
q9	8792	8831	8809	8809
q10	3631	3429	3328	3328
q11	597	507	518	507
q12	831	639	665	639
q13	15557	3267	3272	3267
q14	338	299	279	279
q15	541	499	491	491
q16	553	517	495	495
q17	1855	1556	1532	1532
q18	8125	7740	7995	7740
q19	1748	1557	1668	1557
q20	2163	1919	1912	1912
q21	5777	5586	5462	5462
q22	1115	1025	1049	1025
Total cold run time: 72677 ms
Total hot run time: 56933 ms

@doris-robot

doris-robot commented Sep 9, 2024

Copy link
Copy Markdown
TPC-DS: Total hot run time: 192217 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 24c1dfe31136765bc6eb5404e5a186ea9b394de9, data reload: false
query1	1252	916	871	871
query2	6336	1953	1842	1842
query3	10650	3980	3952	3952
query4	59528	23679	23067	23067
query5	5373	510	534	510
query6	405	160	157	157
query7	5765	284	283	283
query8	322	218	229	218
query9	8791	2486	2498	2486
query10	472	270	252	252
query11	18100	15064	15174	15064
query12	162	107	106	106
query13	1531	383	391	383
query14	11051	7200	6936	6936
query15	227	184	189	184
query16	7595	537	473	473
query17	1119	588	584	584
query18	2145	335	308	308
query19	307	159	156	156
query20	127	115	114	114
query21	202	106	107	106
query22	4723	4711	4825	4711
query23	34183	33347	33548	33347
query24	5969	2841	2864	2841
query25	551	407	408	407
query26	694	151	166	151
query27	1814	278	274	274
query28	3766	2032	2007	2007
query29	720	417	420	417
query30	232	153	151	151
query31	942	769	800	769
query32	90	57	55	55
query33	497	293	291	291
query34	880	476	471	471
query35	843	739	729	729
query36	1056	942	920	920
query37	140	89	84	84
query38	3945	3856	3910	3856
query39	1463	1457	1385	1385
query40	205	117	113	113
query41	48	49	46	46
query42	115	96	96	96
query43	492	480	458	458
query44	1083	753	733	733
query45	199	169	165	165
query46	1082	761	741	741
query47	1863	1804	1794	1794
query48	367	295	290	290
query49	788	450	453	450
query50	805	408	415	408
query51	7130	6823	6831	6823
query52	100	86	85	85
query53	249	180	179	179
query54	591	451	468	451
query55	76	75	77	75
query56	289	268	273	268
query57	1226	1062	1070	1062
query58	231	251	245	245
query59	3096	2771	2812	2771
query60	303	263	282	263
query61	129	125	121	121
query62	761	660	661	660
query63	222	186	187	186
query64	3003	661	676	661
query65	3202	3140	3144	3140
query66	673	332	340	332
query67	15698	15194	15129	15129
query68	4307	574	565	565
query69	420	273	274	273
query70	1186	1115	1099	1099
query71	397	272	276	272
query72	6495	4057	3995	3995
query73	748	324	315	315
query74	9123	8854	8885	8854
query75	3368	2696	2708	2696
query76	1602	1050	998	998
query77	572	333	310	310
query78	9818	9039	9107	9039
query79	1082	525	518	518
query80	849	506	502	502
query81	475	228	228	228
query82	524	140	142	140
query83	171	149	147	147
query84	256	76	72	72
query85	807	291	317	291
query86	325	307	301	301
query87	4496	4429	4233	4233
query88	3030	2264	2271	2264
query89	394	283	282	282
query90	1846	183	186	183
query91	126	98	97	97
query92	59	50	51	50
query93	1426	533	537	533
query94	786	261	291	261
query95	336	250	248	248
query96	581	263	262	262
query97	3286	3087	3065	3065
query98	217	205	199	199
query99	1592	1262	1277	1262
Total cold run time: 308694 ms
Total hot run time: 192217 ms

@doris-robot

doris-robot commented Sep 9, 2024

Copy link
Copy Markdown
ClickBench: Total hot run time: 31.65 s
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 24c1dfe31136765bc6eb5404e5a186ea9b394de9, data reload: false
query1	0.04	0.04	0.04
query2	0.08	0.04	0.04
query3	0.23	0.05	0.04
query4	1.68	0.07	0.07
query5	0.50	0.49	0.50
query6	1.12	0.74	0.72
query7	0.02	0.02	0.01
query8	0.05	0.04	0.04
query9	0.55	0.48	0.48
query10	0.54	0.57	0.55
query11	0.16	0.11	0.12
query12	0.15	0.12	0.12
query13	0.61	0.60	0.58
query14	1.40	1.42	1.41
query15	0.85	0.82	0.85
query16	0.36	0.37	0.38
query17	1.04	0.99	1.00
query18	0.20	0.20	0.20
query19	1.90	1.84	1.78
query20	0.01	0.01	0.01
query21	15.39	0.68	0.67
query22	4.33	7.50	2.12
query23	18.29	1.51	1.38
query24	2.19	0.23	0.23
query25	0.15	0.08	0.08
query26	0.27	0.17	0.18
query27	0.07	0.08	0.08
query28	13.19	1.01	1.00
query29	12.65	3.30	3.32
query30	0.24	0.06	0.07
query31	2.89	0.40	0.39
query32	3.25	0.48	0.47
query33	3.00	3.06	2.99
query34	17.12	4.36	4.43
query35	4.44	4.42	4.47
query36	0.66	0.47	0.47
query37	0.18	0.15	0.15
query38	0.15	0.14	0.14
query39	0.04	0.04	0.04
query40	0.17	0.12	0.13
query41	0.10	0.05	0.05
query42	0.06	0.05	0.05
query43	0.04	0.05	0.04
Total cold run time: 110.36 s
Total hot run time: 31.65 s

@seawinde

seawinde commented Sep 11, 2024

Copy link
Copy Markdown
MemberAuthor

run buildall

@doris-robot

doris-robot commented Sep 11, 2024

Copy link
Copy Markdown
TPC-H: Total hot run time: 38201 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 5feb12439e5360625c6ab75edd1e1135fc7d500a, data reload: false
------ Round 1 ----------------------------------
q1	17616	4434	4331	4331
q2	2019	188	199	188
q3	11790	962	1129	962
q4	10526	756	696	696
q5	7734	2883	2863	2863
q6	226	139	135	135
q7	950	607	590	590
q8	9335	2091	2087	2087
q9	7221	6540	6582	6540
q10	6996	2231	2212	2212
q11	511	252	252	252
q12	395	229	232	229
q13	17821	3109	3037	3037
q14	289	247	255	247
q15	527	494	489	489
q16	525	423	422	422
q17	988	638	709	638
q18	7301	6940	6859	6859
q19	1383	1052	1123	1052
q20	675	332	344	332
q21	3978	3030	3110	3030
q22	1113	1033	1010	1010
Total cold run time: 109919 ms
Total hot run time: 38201 ms
----- Round 2, with runtime_filter_mode=off -----
q1	4372	4276	4301	4276
q2	383	268	257	257
q3	2876	2653	2647	2647
q4	1930	1672	1643	1643
q5	5606	5742	5724	5724
q6	226	141	137	137
q7	2278	1830	1850	1830
q8	3342	3403	3475	3403
q9	8865	8849	8948	8849
q10	3571	3403	3448	3403
q11	637	503	502	502
q12	852	636	672	636
q13	13014	3333	3290	3290
q14	357	306	303	303
q15	536	494	479	479
q16	537	492	494	492
q17	1815	1567	1520	1520
q18	8219	8056	8090	8056
q19	1925	1625	1508	1508
q20	2161	1922	1909	1909
q21	5801	5589	5466	5466
q22	1125	1012	1023	1012
Total cold run time: 70428 ms
Total hot run time: 57342 ms

@doris-robot

doris-robot commented Sep 11, 2024

Copy link
Copy Markdown
TPC-DS: Total hot run time: 198913 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 5feb12439e5360625c6ab75edd1e1135fc7d500a, data reload: false
query1	1269	876	878	876
query2	6295	1996	1906	1906
query3	10628	4197	3980	3980
query4	60239	25382	23506	23506
query5	5007	509	506	506
query6	394	162	154	154
query7	5637	312	299	299
query8	333	238	228	228
query9	7869	2542	2536	2536
query10	422	277	267	267
query11	17299	15187	15582	15187
query12	159	120	115	115
query13	1460	405	428	405
query14	10481	7281	7610	7281
query15	211	181	184	181
query16	6755	460	470	460
query17	1110	593	562	562
query18	1536	305	290	290
query19	211	155	147	147
query20	120	112	106	106
query21	222	109	103	103
query22	4704	4340	4530	4340
query23	34668	33819	33949	33819
query24	6075	2950	2962	2950
query25	486	389	411	389
query26	620	156	160	156
query27	1564	283	282	282
query28	3798	2053	2033	2033
query29	646	409	421	409
query30	234	154	156	154
query31	942	758	762	758
query32	65	51	52	51
query33	420	292	289	289
query34	889	488	469	469
query35	829	741	733	733
query36	1070	926	935	926
query37	143	87	86	86
query38	4117	3917	3929	3917
query39	1438	1446	1417	1417
query40	203	114	114	114
query41	47	49	44	44
query42	120	98	99	98
query43	528	502	474	474
query44	1161	772	752	752
query45	199	165	165	165
query46	1104	800	787	787
query47	1910	1789	1794	1789
query48	387	302	307	302
query49	784	486	452	452
query50	830	422	432	422
query51	6995	6970	6886	6886
query52	97	89	86	86
query53	262	191	180	180
query54	567	471	471	471
query55	75	74	80	74
query56	285	245	251	245
query57	1189	1093	1073	1073
query58	228	247	253	247
query59	3164	2800	2779	2779
query60	298	271	269	269
query61	101	96	99	96
query62	772	656	636	636
query63	221	187	195	187
query64	1368	682	666	666
query65	3272	3182	3164	3164
query66	601	329	344	329
query67	15826	15425	15312	15312
query68	1739	875	858	858
query69	427	342	327	327
query70	1207	1187	1135	1135
query71	344	351	337	337
query72	4628	3533	3541	3533
query73	603	583	587	583
query74	9092	8943	8822	8822
query75	3132	2949	3021	2949
query76	957	872	866	866
query77	529	399	410	399
query78	9552	9495	9847	9495
query79	912	905	886	886
query80	797	822	786	786
query81	449	262	264	262
query82	262	267	258	258
query83	196	192	190	190
query84	202	110	107	107
query85	612	393	385	385
query86	306	301	323	301
query87	4403	4331	4277	4277
query88	4254	4135	4132	4132
query89	377	365	367	365
query90	808	318	317	317
query91	147	214	132	132
query92	74	79	75	75
query93	925	911	921	911
query94	405	358	366	358
query95	428	418	423	418
query96	475	476	475	475
query97	3108	3100	3097	3097
query98	236	242	227	227
query99	1351	1278	1297	1278
Total cold run time: 295896 ms
Total hot run time: 198913 ms

@doris-robot

doris-robot commented Sep 11, 2024

Copy link
Copy Markdown
ClickBench: Total hot run time: 32.07 s
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 5feb12439e5360625c6ab75edd1e1135fc7d500a, data reload: false
query1	0.04	0.04	0.04
query2	0.08	0.04	0.04
query3	0.22	0.05	0.06
query4	1.66	0.08	0.07
query5	0.51	0.50	0.50
query6	1.13	0.73	0.74
query7	0.02	0.01	0.01
query8	0.05	0.04	0.04
query9	0.55	0.49	0.48
query10	0.54	0.56	0.54
query11	0.15	0.11	0.12
query12	0.16	0.13	0.12
query13	0.61	0.60	0.59
query14	1.41	1.42	1.37
query15	0.87	0.82	0.83
query16	0.38	0.35	0.37
query17	1.07	1.05	1.00
query18	0.22	0.20	0.21
query19	1.82	1.77	1.83
query20	0.01	0.01	0.01
query21	15.38	0.67	0.66
query22	3.55	6.38	2.53
query23	18.28	1.37	1.30
query24	2.13	0.22	0.21
query25	0.14	0.09	0.09
query26	0.28	0.17	0.17
query27	0.07	0.07	0.08
query28	13.26	1.02	1.00
query29	12.62	3.40	3.36
query30	0.24	0.06	0.06
query31	2.87	0.40	0.39
query32	3.24	0.48	0.47
query33	2.99	3.05	3.04
query34	16.90	4.38	4.43
query35	4.45	4.43	4.42
query36	0.67	0.48	0.49
query37	0.20	0.15	0.16
query38	0.16	0.15	0.15
query39	0.05	0.04	0.03
query40	0.16	0.13	0.13
query41	0.09	0.05	0.05
query42	0.06	0.05	0.05
query43	0.05	0.04	0.04
Total cold run time: 109.34 s
Total hot run time: 32.07 s

@github-actionsgithub-actionsBot added the approved Indicates a PR has been approved by one committer. label Sep 11, 2024
@github-actions

github-actionsBot commented Sep 11, 2024

Copy link
Copy Markdown
Contributor

PR approved by at least one committer and no changes requested.

@morrySnow
morrySnow merged commit cd2062a into apache:masterSep 11, 2024
seawinde added a commit to seawinde/doris that referenced this pull request Sep 14, 2024
@seawinde
[improvement](mtmv) Support to add use_for_rewrite property when crea…
c6c1e2a
…te materialized view (apache#40332)
Add `is_used_in_rewrite` property when create mv. Default true;
If `is_used_in_rewrite` is false which means the mv would not partion in
query rewrite.
Such as mv def is as following:
CREATE MATERIALIZED VIEW mv1
BUILD IMMEDIATE REFRESH AUTO ON MANUAL
DISTRIBUTED BY RANDOM BUCKETS 2
PROPERTIES (
'replication_num' = '1',
'use_for_rewrite' = 'false'
)
AS
SELECT k1, k2, count(*) from t1 group by k1, k2;
if we run query as following, this mv would not partition in the query
rewrite:
SELECT k2, count(*) from t1 group by k2;
@seawindeseawinde mentioned this pull request Sep 14, 2024
Merged
yiguolei pushed a commit that referenced this pull request Sep 15, 2024
@seawinde
[pick](mtmv)Pick some pr to 21#39998#40332#40485(#40843)
fe9f4fd
## Proposed changes
pr: #40485
commitId: 18a374f
pr: #40332
commitId: cd2062a
pr: #39998
commitId: 948fb2a
dataroaring pushed a commit that referenced this pull request Oct 9, 2024
@seawinde@dataroaring
[improvement](mtmv) Support to add use_for_rewrite property when crea…
958588e
…te materialized view (#40332)
Add `is_used_in_rewrite` property when create mv. Default true;
If `is_used_in_rewrite` is false which means the mv would not partion in
query rewrite.
Such as mv def is as following:
CREATE MATERIALIZED VIEW mv1
BUILD IMMEDIATE REFRESH AUTO ON MANUAL
DISTRIBUTED BY RANDOM BUCKETS 2
PROPERTIES (
'replication_num' = '1',
'use_for_rewrite' = 'false'
)
AS
SELECT k1, k2, count(*) from t1 group by k1, k2;
if we run query as following, this mv would not partition in the query
rewrite:
SELECT k2, count(*) from t1 group by k2;
@yiguoleiyiguolei mentioned this pull request Nov 6, 2024
Closed
@gavinchougavinchou mentioned this pull request Nov 26, 2024
Closed
@yiguoleiyiguolei mentioned this pull request Jan 19, 2025
Closed
HappenLee pushed a commit to HappenLee/incubator-doris that referenced this pull request Apr 24, 2026
@seawinde@HappenLee
[improvement](mtmv) Support to add use_for_rewrite property when crea…
e8ac138
…te materialized view (apache#40332)
Add `is_used_in_rewrite` property when create mv. Default true;
If `is_used_in_rewrite` is false which means the mv would not partion in
query rewrite.
Such as mv def is as following:
CREATE MATERIALIZED VIEW mv1
BUILD IMMEDIATE REFRESH AUTO ON MANUAL
DISTRIBUTED BY RANDOM BUCKETS 2
PROPERTIES (
'replication_num' = '1',
'use_for_rewrite' = 'false'
)
AS
SELECT k1, k2, count(*) from t1 group by k1, k2;
if we run query as following, this mv would not partition in the query
rewrite:
SELECT k2, count(*) from t1 group by k2;
Sign up for freeto join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

@zddrzddrzddr approved these changes
@morrySnowmorrySnowmorrySnow approved these changes

Assignees

No one assigned

Labels

approvedIndicates a PR has been approved by one committer.dev/2.1.7-mergeddev/3.0.3-mergedkind/docsCategorizes issue or PR as related to documentation.reviewed

Projects

None yet

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.

5 participants

@seawinde@doris-robot@morrySnow@zddr@yiguolei