Skip to content

[fix](mtmv) Fix rewrite fail when query direct external table without group by - #39041

Merged
morrySnow merged 1 commit into
apache:masterfrom
seawinde:fix_direct_query_external_table_not_hit
Aug 20, 2024
Merged

[fix](mtmv) Fix rewrite fail when query direct external table without group by#39041
morrySnow merged 1 commit into
apache:masterfrom
seawinde:fix_direct_query_external_table_not_hit

Conversation

@seawinde

@seawindeseawinde commented Aug 7, 2024

Copy link
Copy Markdown
Member

Proposed changes

this is brought by #34185
if query external table without group by, rewrite by materialized view will fail
such as mv def is

select o_custkey, o_orderdate from ${hive_catalog_name}.${hive_database}.${hive_table};

query is query external table directly as following, this would fail when try to rewrte by materialized view

select o_custkey from ${hive_catalog_name}.${hive_database}.${hive_table};

this pr fix the problem.

@doris-robot

doris-robot commented Aug 7, 2024

Copy link
Copy Markdown

Thank you for your contribution to Apache Doris.
Don't know what should be done next? See How to process your PR

Since 2024-03-18, the Document has been moved to doris-website.
See Doris Document.

@seawinde

seawinde commented Aug 7, 2024

Copy link
Copy Markdown
MemberAuthor

run buildall

@doris-robot

doris-robot commented Aug 7, 2024

Copy link
Copy Markdown
TPC-H: Total hot run time: 41859 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 425a34586854e37fec351adb4c2104fdfb43be8c, data reload: false
------ Round 1 ----------------------------------
q1	17657	4186	4124	4124
q2	2031	202	199	199
q3	10462	1327	1385	1327
q4	10161	790	970	790
q5	7673	3007	2997	2997
q6	230	141	141	141
q7	1065	612	617	612
q8	9461	1858	1984	1858
q9	8504	6632	6671	6632
q10	8782	3838	3867	3838
q11	434	248	261	248
q12	440	230	231	230
q13	17777	2952	2963	2952
q14	273	245	249	245
q15	531	493	491	491
q16	523	385	388	385
q17	987	957	937	937
q18	8088	7401	7311	7311
q19	1664	1239	1227	1227
q20	569	329	335	329
q21	5292	4753	4705	4705
q22	364	281	287	281
Total cold run time: 112968 ms
Total hot run time: 41859 ms
----- Round 2, with runtime_filter_mode=off -----
q1	4180	4095	4071	4071
q2	322	225	215	215
q3	3004	3085	3147	3085
q4	2013	2010	1966	1966
q5	5656	5543	5473	5473
q6	225	132	134	132
q7	2157	1802	1829	1802
q8	3303	3388	3374	3374
q9	8746	8721	8783	8721
q10	3981	4057	3956	3956
q11	590	471	460	460
q12	766	586	605	586
q13	16763	3094	3126	3094
q14	294	277	281	277
q15	543	490	479	479
q16	497	410	428	410
q17	1774	1744	1753	1744
q18	8374	7678	7765	7678
q19	1809	1743	1760	1743
q20	2059	1849	1835	1835
q21	5767	5358	5380	5358
q22	527	467	461	461
Total cold run time: 73350 ms
Total hot run time: 56920 ms

@doris-robot

doris-robot commented Aug 7, 2024

Copy link
Copy Markdown
TPC-DS: Total hot run time: 168970 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 425a34586854e37fec351adb4c2104fdfb43be8c, data reload: false
query1	903	379	369	369
query2	6491	1718	1772	1718
query3	6654	213	227	213
query4	19105	17508	17252	17252
query5	3616	517	516	516
query6	276	167	171	167
query7	4604	298	294	294
query8	258	198	200	198
query9	8516	2333	2310	2310
query10	430	297	268	268
query11	10531	10055	10054	10054
query12	117	96	88	88
query13	1651	374	370	370
query14	11169	6152	7450	6152
query15	210	163	162	162
query16	6712	429	460	429
query17	930	550	561	550
query18	1404	279	270	270
query19	197	143	139	139
query20	90	84	85	84
query21	206	109	104	104
query22	4614	4299	4052	4052
query23	33970	33632	33724	33632
query24	10368	3084	3057	3057
query25	666	417	412	412
query26	1669	154	155	154
query27	2992	293	283	283
query28	7523	1996	1963	1963
query29	1068	447	471	447
query30	228	155	156	155
query31	977	749	771	749
query32	105	57	58	57
query33	704	333	334	333
query34	954	503	504	503
query35	876	762	760	760
query36	1061	884	881	881
query37	255	85	82	82
query38	2933	2786	2797	2786
query39	868	827	816	816
query40	251	111	116	111
query41	45	41	42	41
query42	119	98	97	97
query43	474	435	427	427
query44	1190	731	735	731
query45	206	177	173	173
query46	1084	813	787	787
query47	1875	1747	1758	1747
query48	380	297	300	297
query49	933	465	420	420
query50	897	427	426	426
query51	6813	6728	6582	6582
query52	101	89	88	88
query53	260	180	176	176
query54	613	460	453	453
query55	73	71	75	71
query56	272	261	251	251
query57	1158	1074	1063	1063
query58	254	259	266	259
query59	2599	2500	2483	2483
query60	300	273	269	269
query61	110	92	106	92
query62	889	641	660	641
query63	218	180	182	180
query64	5766	1990	1865	1865
query65	3170	3100	3087	3087
query66	1232	326	327	326
query67	15255	14963	14775	14775
query68	4252	553	567	553
query69	552	335	300	300
query70	1085	1044	1060	1044
query71	370	275	270	270
query72	7003	2725	2488	2488
query73	753	328	330	328
query74	6040	5695	5660	5660
query75	3344	2687	2693	2687
query76	2126	1221	1289	1221
query77	411	303	313	303
query78	9480	8932	8922	8922
query79	1368	531	520	520
query80	852	500	500	500
query81	556	230	224	224
query82	562	129	139	129
query83	230	164	168	164
query84	269	80	82	80
query85	1117	313	312	312
query86	460	289	288	288
query87	3391	3178	3145	3145
query88	3814	2491	2476	2476
query89	374	287	282	282
query90	1741	192	185	185
query91	124	101	102	101
query92	57	47	54	47
query93	1941	629	618	618
query94	767	279	289	279
query95	384	268	266	266
query96	607	290	291	290
query97	3225	3088	3058	3058
query98	226	194	197	194
query99	1547	1289	1306	1289
Total cold run time: 261466 ms
Total hot run time: 168970 ms

@doris-robot

doris-robot commented Aug 7, 2024

Copy link
Copy Markdown
ClickBench: Total hot run time: 30.09 s
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 425a34586854e37fec351adb4c2104fdfb43be8c, data reload: false
query1	0.04	0.04	0.04
query2	0.08	0.03	0.04
query3	0.22	0.05	0.05
query4	1.66	0.08	0.09
query5	0.50	0.49	0.48
query6	1.13	0.72	0.72
query7	0.02	0.01	0.01
query8	0.06	0.04	0.05
query9	0.56	0.54	0.51
query10	0.58	0.57	0.57
query11	0.16	0.11	0.12
query12	0.15	0.12	0.13
query13	0.63	0.61	0.60
query14	0.78	0.79	0.80
query15	0.89	0.87	0.87
query16	0.35	0.36	0.35
query17	1.00	1.01	0.99
query18	0.23	0.21	0.22
query19	1.81	1.75	1.77
query20	0.02	0.01	0.01
query21	15.39	0.78	0.66
query22	3.96	8.06	1.25
query23	17.94	1.35	1.37
query24	2.31	0.22	0.22
query25	0.19	0.09	0.08
query26	0.32	0.21	0.21
query27	0.46	0.23	0.22
query28	13.16	0.99	0.99
query29	12.54	3.32	3.27
query30	0.26	0.07	0.05
query31	2.87	0.41	0.41
query32	3.24	0.49	0.48
query33	2.94	2.95	2.95
query34	15.45	4.23	4.24
query35	4.27	4.31	4.30
query36	0.67	0.48	0.46
query37	0.19	0.17	0.18
query38	0.15	0.16	0.16
query39	0.04	0.03	0.03
query40	0.17	0.14	0.13
query41	0.11	0.05	0.05
query42	0.05	0.05	0.05
query43	0.05	0.04	0.04
Total cold run time: 107.6 s
Total hot run time: 30.09 s

morrySnow
morrySnow previously approved these changes Aug 9, 2024
View reviewed changes
@github-actionsgithub-actionsBot added the approved Indicates a PR has been approved by one committer. label Aug 9, 2024
@github-actions

github-actionsBot commented Aug 9, 2024

Copy link
Copy Markdown
Contributor

PR approved by at least one committer and no changes requested.

@github-actions

github-actionsBot commented Aug 9, 2024

Copy link
Copy Markdown
Contributor

PR approved by anyone and no changes requested.

@seawinde
seawindeforce-pushed the fix_direct_query_external_table_not_hit branch from 425a345 to ab361f9CompareAugust 15, 2024 14:36
@seawinde

seawinde commented Aug 15, 2024

Copy link
Copy Markdown
MemberAuthor

run buildall

@doris-robot

doris-robot commented Aug 15, 2024

Copy link
Copy Markdown
TPC-H: Total hot run time: 38238 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit ab361f912de67ef3e7d50d7055a0d7dcca59d0ee, data reload: false
------ Round 1 ----------------------------------
q1	18231	4380	4339	4339
q2	2072	231	216	216
q3	11661	1116	1238	1116
q4	10520	753	758	753
q5	7805	2852	2800	2800
q6	263	155	155	155
q7	1023	664	659	659
q8	9405	2092	2137	2092
q9	6963	6547	6529	6529
q10	7080	2191	2181	2181
q11	503	273	266	266
q12	423	249	241	241
q13	17781	3013	2972	2972
q14	306	258	262	258
q15	584	498	523	498
q16	512	417	404	404
q17	1005	646	740	646
q18	7428	6859	6853	6853
q19	6973	1041	1071	1041
q20	726	382	374	374
q21	4172	3045	2806	2806
q22	1161	1039	1050	1039
Total cold run time: 116597 ms
Total hot run time: 38238 ms
----- Round 2, with runtime_filter_mode=off -----
q1	4569	4316	4270	4270
q2	395	292	302	292
q3	2869	2612	2643	2612
q4	2004	1722	1704	1704
q5	5730	5789	5719	5719
q6	236	148	161	148
q7	2230	1788	1790	1788
q8	3274	3523	3496	3496
q9	8858	8823	8805	8805
q10	3549	3390	3375	3375
q11	633	538	561	538
q12	896	657	645	645
q13	16144	3256	3201	3201
q14	333	313	294	294
q15	558	514	521	514
q16	493	457	437	437
q17	1829	1568	1546	1546
q18	8697	8265	7682	7682
q19	8248	1640	1440	1440
q20	2139	1917	1933	1917
q21	13550	5456	5407	5407
q22	1184	1098	1095	1095
Total cold run time: 88418 ms
Total hot run time: 56925 ms

@doris-robot

doris-robot commented Aug 15, 2024

Copy link
Copy Markdown
TPC-DS: Total hot run time: 196815 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit ab361f912de67ef3e7d50d7055a0d7dcca59d0ee, data reload: false
query1	1324	924	904	904
query2	6571	1975	1920	1920
query3	10759	3874	3893	3874
query4	59096	24337	23488	23488
query5	5847	725	714	714
query6	519	222	217	217
query7	6060	311	320	311
query8	448	364	364	364
query9	8888	2516	2490	2490
query10	577	322	315	315
query11	18061	15116	15613	15116
query12	192	129	124	124
query13	1603	448	455	448
query14	11366	7148	7152	7148
query15	261	205	194	194
query16	7653	560	573	560
query17	1210	609	614	609
query18	2129	343	348	343
query19	302	171	177	171
query20	152	137	140	137
query21	258	150	164	150
query22	4658	4376	4469	4376
query23	34520	33956	34016	33956
query24	5968	2986	2997	2986
query25	581	430	421	421
query26	716	187	182	182
query27	1731	308	316	308
query28	3851	2195	2188	2188
query29	737	465	470	465
query30	233	189	188	188
query31	1026	836	859	836
query32	105	81	78	78
query33	511	345	361	345
query34	916	498	499	498
query35	873	780	767	767
query36	1102	960	939	939
query37	161	110	102	102
query38	3996	3860	3882	3860
query39	1539	1479	1470	1470
query40	237	155	153	153
query41	139	136	135	135
query42	130	118	117	117
query43	546	495	529	495
query44	1123	791	808	791
query45	225	197	194	194
query46	1152	773	750	750
query47	1893	1847	1825	1825
query48	423	348	340	340
query49	914	596	579	579
query50	873	466	457	457
query51	6810	6699	6836	6699
query52	119	113	112	112
query53	304	229	222	222
query54	612	505	519	505
query55	90	93	94	93
query56	328	303	307	303
query57	1214	1147	1115	1115
query58	302	293	300	293
query59	2980	2839	2762	2762
query60	368	328	324	324
query61	154	148	178	148
query62	801	703	709	703
query63	265	233	225	225
query64	3244	1871	1906	1871
query65	3311	3176	3246	3176
query66	1015	675	671	671
query67	15395	15047	14929	14929
query68	6137	599	579	579
query69	629	317	325	317
query70	1277	1154	1156	1154
query71	591	318	337	318
query72	6836	2310	2079	2079
query73	879	359	358	358
query74	9223	8780	8918	8780
query75	4655	2760	2753	2753
query76	3691	1110	1069	1069
query77	816	454	439	439
query78	11380	9869	9168	9168
query79	7453	562	565	562
query80	1119	657	616	616
query81	630	265	270	265
query82	742	165	157	157
query83	409	217	213	213
query84	296	99	101	99
query85	800	362	367	362
query86	447	329	327	327
query87	4469	4230	4322	4230
query88	4647	2534	2538	2534
query89	488	325	335	325
query90	2145	238	237	237
query91	161	131	132	131
query92	89	75	77	75
query93	3279	557	553	553
query94	909	324	328	324
query95	397	309	315	309
query96	629	286	287	286
query97	3263	3097	3155	3097
query98	254	236	224	224
query99	1606	1334	1326	1326
Total cold run time: 331813 ms
Total hot run time: 196815 ms

@doris-robot

doris-robot commented Aug 15, 2024

Copy link
Copy Markdown
ClickBench: Total hot run time: 31.64 s
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit ab361f912de67ef3e7d50d7055a0d7dcca59d0ee, data reload: false
query1	0.05	0.05	0.04
query2	0.08	0.04	0.05
query3	0.23	0.05	0.06
query4	1.65	0.08	0.08
query5	0.50	0.50	0.48
query6	1.13	0.75	0.74
query7	0.02	0.01	0.02
query8	0.05	0.05	0.05
query9	0.56	0.49	0.49
query10	0.54	0.55	0.54
query11	0.16	0.13	0.13
query12	0.17	0.14	0.14
query13	0.62	0.61	0.58
query14	0.77	0.78	0.78
query15	0.84	0.84	0.84
query16	0.37	0.38	0.37
query17	1.03	1.06	1.04
query18	0.24	0.22	0.22
query19	1.84	1.80	1.71
query20	0.01	0.01	0.02
query21	15.39	0.84	0.65
query22	4.08	7.37	1.96
query23	18.25	1.44	1.34
query24	2.15	0.22	0.23
query25	0.16	0.09	0.08
query26	0.30	0.21	0.22
query27	0.46	0.23	0.23
query28	13.23	1.03	1.02
query29	12.67	3.50	3.51
query30	0.43	0.24	0.24
query31	2.80	0.41	0.40
query32	3.23	0.49	0.49
query33	2.97	2.96	2.95
query34	17.02	4.41	4.36
query35	4.40	4.44	4.47
query36	0.66	0.49	0.48
query37	0.22	0.17	0.17
query38	0.18	0.17	0.17
query39	0.06	0.05	0.06
query40	0.18	0.15	0.15
query41	0.12	0.07	0.06
query42	0.09	0.07	0.07
query43	0.07	0.06	0.06
Total cold run time: 109.98 s
Total hot run time: 31.64 s

@seawinde
seawindeforce-pushed the fix_direct_query_external_table_not_hit branch from ab361f9 to 0aa507aCompareAugust 16, 2024 09:46
@seawinde

seawinde commented Aug 16, 2024

Copy link
Copy Markdown
MemberAuthor

run buildall

@doris-robot

doris-robot commented Aug 16, 2024

Copy link
Copy Markdown
TPC-H: Total hot run time: 37990 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 0aa507a0d48d5efc9367f6eccecb425d0b5b5430, data reload: false
------ Round 1 ----------------------------------
q1	17868	4843	4252	4252
q2	2055	213	206	206
q3	11738	1008	1102	1008
q4	10529	694	819	694
q5	7770	2844	2804	2804
q6	260	159	162	159
q7	1013	663	652	652
q8	9603	2088	2103	2088
q9	8774	6516	6565	6516
q10	7095	2227	2176	2176
q11	479	272	271	271
q12	432	267	263	263
q13	17791	3023	3012	3012
q14	300	259	270	259
q15	560	542	532	532
q16	521	416	406	406
q17	994	684	653	653
q18	7393	6748	6698	6698
q19	6294	1081	1061	1061
q20	705	378	346	346
q21	3922	3097	2924	2924
q22	1128	1026	1010	1010
Total cold run time: 117224 ms
Total hot run time: 37990 ms
----- Round 2, with runtime_filter_mode=off -----
q1	4509	4305	4278	4278
q2	402	300	295	295
q3	2866	2587	2650	2587
q4	2009	1746	1702	1702
q5	5678	5744	5637	5637
q6	242	153	149	149
q7	2206	1781	1765	1765
q8	3270	3497	3476	3476
q9	8850	8758	8750	8750
q10	3584	3399	3352	3352
q11	628	559	538	538
q12	845	671	661	661
q13	15965	3206	3195	3195
q14	318	294	294	294
q15	574	507	507	507
q16	502	451	453	451
q17	1839	1571	1522	1522
q18	8253	7938	7848	7848
q19	9727	1682	1605	1605
q20	2273	1891	1891	1891
q21	12963	5349	5381	5349
q22	1211	1073	1046	1046
Total cold run time: 88714 ms
Total hot run time: 56898 ms

@doris-robot

doris-robot commented Aug 16, 2024

Copy link
Copy Markdown
TPC-H: Total hot run time: 38516 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 0aa507a0d48d5efc9367f6eccecb425d0b5b5430, data reload: false
------ Round 1 ----------------------------------
q1	18250	4439	4392	4392
q2	2763	215	204	204
q3	11158	1136	1156	1136
q4	10713	805	737	737
q5	8068	2913	2860	2860
q6	267	160	161	160
q7	1037	670	652	652
q8	9368	2094	2068	2068
q9	7186	6589	6552	6552
q10	7072	2317	2246	2246
q11	506	280	277	277
q12	446	265	257	257
q13	18970	3013	2973	2973
q14	297	256	248	248
q15	548	521	518	518
q16	527	403	403	403
q17	1000	637	777	637
q18	7314	6850	6806	6806
q19	4867	1038	1133	1038
q20	722	360	348	348
q21	4273	3001	2961	2961
q22	1153	1043	1045	1043
Total cold run time: 116505 ms
Total hot run time: 38516 ms
----- Round 2, with runtime_filter_mode=off -----
q1	4533	4349	4302	4302
q2	400	309	306	306
q3	2837	2612	2590	2590
q4	1896	1626	1610	1610
q5	5441	5393	5393	5393
q6	231	143	144	143
q7	2092	1722	1668	1668
q8	3244	3358	3343	3343
q9	8426	8391	8412	8391
q10	3432	3226	3207	3207
q11	613	532	533	532
q12	822	635	653	635
q13	17247	3066	3004	3004
q14	320	300	318	300
q15	573	536	533	533
q16	509	463	452	452
q17	1814	1502	1504	1502
q18	7883	7554	7525	7525
q19	1718	1616	1594	1594
q20	2076	1867	1826	1826
q21	9798	5165	5157	5157
q22	1142	1085	1051	1051
Total cold run time: 77047 ms
Total hot run time: 55064 ms

@doris-robot

doris-robot commented Aug 16, 2024

Copy link
Copy Markdown
TPC-DS: Total hot run time: 191103 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 0aa507a0d48d5efc9367f6eccecb425d0b5b5430, data reload: false
query1	954	392	395	392
query2	6736	2132	2053	2053
query3	6683	235	248	235
query4	34177	23108	23332	23108
query5	4385	741	714	714
query6	315	210	210	210
query7	4615	339	321	321
query8	483	436	439	436
query9	8616	2548	2514	2514
query10	525	354	354	354
query11	16614	15054	15073	15054
query12	202	142	137	137
query13	1711	463	459	459
query14	9544	7425	7167	7167
query15	286	193	195	193
query16	8092	525	527	525
query17	1681	609	590	590
query18	2130	362	339	339
query19	355	166	170	166
query20	146	138	140	138
query21	250	144	143	143
query22	4217	3975	3907	3907
query23	34300	33373	33543	33373
query24	11542	2906	2955	2906
query25	640	421	419	419
query26	1185	184	184	184
query27	2697	316	308	308
query28	7483	2140	2106	2106
query29	846	455	441	441
query30	341	191	186	186
query31	1049	851	827	827
query32	125	81	83	81
query33	819	344	349	344
query34	898	501	505	501
query35	888	792	777	777
query36	1129	964	965	964
query37	173	101	103	101
query38	4005	3900	3828	3828
query39	1525	1487	1481	1481
query40	241	167	158	158
query41	144	142	141	141
query42	140	115	118	115
query43	576	529	530	529
query44	1284	784	839	784
query45	224	199	197	197
query46	1140	784	791	784
query47	1907	1838	1910	1838
query48	415	338	336	336
query49	1205	589	591	589
query50	865	463	478	463
query51	6932	6688	6704	6688
query52	122	117	112	112
query53	307	229	224	224
query54	941	505	494	494
query55	91	99	89	89
query56	343	312	312	312
query57	1241	1157	1131	1131
query58	326	303	308	303
query59	3186	2831	2962	2831
query60	359	337	334	334
query61	152	145	153	145
query62	881	705	725	705
query63	266	228	226	226
query64	5346	2370	1856	1856
query65	3209	3210	3232	3210
query66	1225	689	731	689
query67	15494	14902	14976	14902
query68	6399	588	588	588
query69	708	443	336	336
query70	1241	1165	1169	1165
query71	538	316	323	316
query72	7529	2343	2088	2088
query73	829	360	360	360
query74	9145	8759	8786	8759
query75	4786	2769	2771	2769
query76	3974	1007	1058	1007
query77	892	450	502	450
query78	10010	9209	9031	9031
query79	7021	561	551	551
query80	1161	623	616	616
query81	618	270	264	264
query82	1486	163	167	163
query83	361	222	222	222
query84	285	102	100	100
query85	1546	351	353	351
query86	478	307	329	307
query87	4530	4176	4191	4176
query88	4835	2542	2513	2513
query89	489	330	330	330
query90	1918	238	230	230
query91	158	166	131	131
query92	92	77	75	75
query93	5663	564	546	546
query94	880	331	317	317
query95	388	297	291	291
query96	640	294	284	284
query97	3223	3041	3134	3041
query98	242	232	234	232
query99	1574	1327	1360	1327
Total cold run time: 314563 ms
Total hot run time: 191103 ms

@doris-robot

doris-robot commented Aug 16, 2024

Copy link
Copy Markdown
ClickBench: Total hot run time: 31.57 s
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 0aa507a0d48d5efc9367f6eccecb425d0b5b5430, data reload: false
query1	0.05	0.04	0.05
query2	0.08	0.04	0.04
query3	0.23	0.05	0.06
query4	1.66	0.09	0.08
query5	0.51	0.50	0.47
query6	1.13	0.74	0.73
query7	0.03	0.02	0.02
query8	0.05	0.05	0.05
query9	0.55	0.48	0.50
query10	0.55	0.56	0.53
query11	0.16	0.13	0.12
query12	0.16	0.14	0.13
query13	0.62	0.59	0.59
query14	0.77	0.80	0.79
query15	0.86	0.83	0.82
query16	0.38	0.38	0.37
query17	1.06	0.97	1.07
query18	0.23	0.23	0.22
query19	1.75	1.75	1.77
query20	0.02	0.01	0.01
query21	15.40	0.68	0.66
query22	3.81	7.31	2.25
query23	18.29	1.40	1.33
query24	2.12	0.24	0.22
query25	0.14	0.09	0.09
query26	0.31	0.23	0.23
query27	0.45	0.22	0.22
query28	13.25	1.05	1.03
query29	12.64	3.30	3.27
query30	0.38	0.24	0.20
query31	2.79	0.40	0.40
query32	3.27	0.49	0.48
query33	2.98	2.94	2.93
query34	16.97	4.38	4.36
query35	4.44	4.45	4.45
query36	0.67	0.50	0.48
query37	0.21	0.17	0.18
query38	0.17	0.16	0.16
query39	0.06	0.05	0.04
query40	0.18	0.15	0.15
query41	0.12	0.07	0.07
query42	0.08	0.06	0.07
query43	0.07	0.06	0.06
Total cold run time: 109.65 s
Total hot run time: 31.57 s

@morrySnow
morrySnow merged commit 3747139 into apache:masterAug 20, 2024
seawinde added a commit to seawinde/doris that referenced this pull request Aug 21, 2024
@seawinde
[fix](mtmv) Fix rewrite fail when query direct external table without…
2256298
… group by (apache#39041)
this is brought by apache#34185
if query external table without group by, rewrite by materialized view
will fail
such as mv def is
select o_custkey, o_orderdate
from ${hive_catalog_name}.${hive_database}.${hive_table};
query is query external table directly as following, this would fail
when try to rewrte by materialized view
select o_custkey
from ${hive_catalog_name}.${hive_database}.${hive_table};
this pr fix the problem.
@seawindeseawinde mentioned this pull request Aug 21, 2024
Merged
yiguolei pushed a commit that referenced this pull request Aug 22, 2024
@seawinde
[fix](mtmv) Fix some pr to 21, prs are (#39041)(#38958)(#39541) (#39678)
021982f
## Proposed changes
pr: #39041
commitId: 2256298
pr: #38958
commitId: c365cb6
pr: #39541
commitId: 89bb669
@yiguoleiyiguolei mentioned this pull request Sep 5, 2024
Closed
3 tasks
dataroaring pushed a commit that referenced this pull request Oct 9, 2024
@seawinde@dataroaring
[fix](mtmv) Fix rewrite fail when query direct external table without…
f32bdfe
… group by (#39041)
this is brought by #34185
if query external table without group by, rewrite by materialized view
will fail
such as mv def is select o_custkey, o_orderdate from ${hive_catalog_name}.${hive_database}.${hive_table};
query is query external table directly as following, this would fail
when try to rewrte by materialized view
select o_custkey from ${hive_catalog_name}.${hive_database}.${hive_table};
this pr fix the problem.
HappenLee pushed a commit to HappenLee/incubator-doris that referenced this pull request Apr 24, 2026
@seawinde@HappenLee
[fix](mtmv) Fix rewrite fail when query direct external table without…
ce70ec6
… group by (apache#39041)
this is brought by apache#34185
if query external table without group by, rewrite by materialized view
will fail
such as mv def is select o_custkey, o_orderdate from ${hive_catalog_name}.${hive_database}.${hive_table};
query is query external table directly as following, this would fail
when try to rewrte by materialized view
select o_custkey from ${hive_catalog_name}.${hive_database}.${hive_table};
this pr fix the problem.
Sign up for freeto join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

@starocean999starocean999starocean999 approved these changes
@morrySnowmorrySnowmorrySnow approved these changes

Assignees

No one assigned

Labels

approvedIndicates a PR has been approved by one committer.dev/2.1.6-mergeddev/3.0.3-mergedreviewed

Projects

None yet

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.

6 participants

@seawinde@doris-robot@starocean999@morrySnow@yiguolei@dataroaring