[fix](nereids) fix unstable mv regression cases by englefly · Pull Request #39265 · apache/doris

englefly · 2024-08-13T02:14:13Z

Proposed changes

trival project cost is changed from 1 to 0
analyze mtmv after create view to make case stable
add unknown col stats for variant nested column

Issue Number: close #xxx

doris-robot · 2024-08-13T02:14:18Z

Thank you for your contribution to Apache Doris.
Don't know what should be done next? See How to process your PR

Since 2024-03-18, the Document has been moved to doris-website.
See Doris Document.

englefly · 2024-08-13T02:14:23Z

run buildall

englefly · 2024-08-13T04:01:57Z

run buildall

doris-robot · 2024-08-13T04:29:02Z

TPC-H: Total hot run time: 40041 ms

machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit a3ed939874b8831e2da1c1840b35c2419a35ee44, data reload: false
------ Round 1 ----------------------------------
q1	17801	5031	4402	4402
q2	2033	186	182	182
q3	11526	984	1146	984
q4	10516	776	706	706
q5	7748	2847	2851	2847
q6	224	136	136	136
q7	969	594	603	594
q8	9308	2029	2065	2029
q9	8780	6577	6619	6577
q10	7019	2203	2262	2203
q11	455	253	252	252
q12	389	229	225	225
q13	18667	2971	3037	2971
q14	283	240	233	233
q15	530	486	510	486
q16	501	409	393	393
q17	994	607	742	607
q18	8155	7396	7460	7396
q19	5276	1044	927	927
q20	690	340	325	325
q21	5503	4537	4620	4537
q22	1175	1043	1029	1029
Total cold run time: 118542 ms
Total hot run time: 40041 ms
----- Round 2, with runtime_filter_mode=off -----
q1	4490	4286	4254	4254
q2	386	272	273	272
q3	2948	2809	2838	2809
q4	2019	1698	1737	1698
q5	5665	5663	5556	5556
q6	245	137	145	137
q7	2176	1737	1772	1737
q8	3304	3504	3435	3435
q9	8804	8907	8764	8764
q10	3576	3195	3246	3195
q11	619	520	495	495
q12	816	679	649	649
q13	15976	3211	3182	3182
q14	317	301	287	287
q15	534	506	483	483
q16	505	445	464	445
q17	1819	1564	1514	1514
q18	8080	8081	7797	7797
q19	3374	1745	1695	1695
q20	2075	1894	1866	1866
q21	5486	5405	5199	5199
q22	1180	1117	1059	1059
Total cold run time: 74394 ms
Total hot run time: 56528 ms

doris-robot · 2024-08-13T04:41:50Z

TPC-DS: Total hot run time: 189832 ms

machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit a3ed939874b8831e2da1c1840b35c2419a35ee44, data reload: false
query1	1266	891	853	853
query2	6437	1929	1842	1842
query3	10723	3963	3642	3642
query4	60198	26598	23143	23143
query5	5720	481	494	481
query6	493	170	163	163
query7	6423	297	299	297
query8	303	205	198	198
query9	8960	2414	2391	2391
query10	523	271	259	259
query11	16298	15075	15244	15075
query12	156	102	96	96
query13	1572	406	393	393
query14	12170	7794	7204	7204
query15	246	174	179	174
query16	7546	531	502	502
query17	1172	624	576	576
query18	1818	322	314	314
query19	292	147	149	147
query20	120	110	112	110
query21	213	105	108	105
query22	4552	4422	4544	4422
query23	34356	33286	33212	33212
query24	5568	2824	2850	2824
query25	570	409	404	404
query26	690	164	165	164
query27	1779	277	279	277
query28	3956	2025	2007	2007
query29	692	425	418	418
query30	232	162	150	150
query31	930	757	743	743
query32	90	56	56	56
query33	474	294	284	284
query34	833	465	470	465
query35	834	706	735	706
query36	1048	925	910	910
query37	139	83	83	83
query38	3955	3801	3886	3801
query39	1455	1386	1393	1386
query40	202	118	118	118
query41	47	44	46	44
query42	115	96	94	94
query43	516	483	459	459
query44	1113	740	727	727
query45	201	172	164	164
query46	1086	758	738	738
query47	1834	1745	1808	1745
query48	359	300	298	298
query49	753	429	430	429
query50	807	403	406	403
query51	6728	6713	6713	6713
query52	96	93	91	91
query53	260	185	182	182
query54	565	556	434	434
query55	77	73	78	73
query56	266	247	241	241
query57	1134	1060	1041	1041
query58	218	242	239	239
query59	2895	2658	2732	2658
query60	284	278	260	260
query61	100	96	109	96
query62	723	639	671	639
query63	211	176	189	176
query64	9013	2276	1714	1714
query65	3211	3153	3160	3153
query66	667	339	333	333
query67	15484	14782	14662	14662
query68	7975	563	559	559
query69	681	393	326	326
query70	1253	1139	1112	1112
query71	534	275	278	275
query72	7223	2283	2016	2016
query73	796	329	333	329
query74	9253	8946	8836	8836
query75	4548	2738	2718	2718
query76	4333	988	997	988
query77	744	311	302	302
query78	9999	9050	8922	8922
query79	12336	537	531	531
query80	2277	509	493	493
query81	585	231	229	229
query82	730	138	130	130
query83	305	146	149	146
query84	268	77	76	76
query85	1227	324	281	281
query86	364	295	292	292
query87	4477	4226	4247	4226
query88	4675	2404	2424	2404
query89	532	283	292	283
query90	2123	192	197	192
query91	121	95	98	95
query92	63	52	53	52
query93	6388	544	543	543
query94	756	304	284	284
query95	361	267	262	262
query96	619	273	272	272
query97	3181	3047	3003	3003
query98	244	210	195	195
query99	1590	1259	1275	1259
Total cold run time: 344328 ms
Total hot run time: 189832 ms

doris-robot · 2024-08-13T04:47:22Z

ClickBench: Total hot run time: 30.95 s

machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit a3ed939874b8831e2da1c1840b35c2419a35ee44, data reload: false
query1	0.05	0.04	0.04
query2	0.08	0.04	0.04
query3	0.23	0.06	0.05
query4	1.69	0.10	0.09
query5	0.50	0.48	0.47
query6	1.14	0.73	0.72
query7	0.02	0.02	0.01
query8	0.05	0.04	0.04
query9	0.55	0.48	0.48
query10	0.53	0.54	0.55
query11	0.15	0.12	0.12
query12	0.15	0.12	0.12
query13	0.62	0.61	0.60
query14	0.77	0.78	0.79
query15	0.85	0.83	0.81
query16	0.38	0.38	0.37
query17	0.98	1.00	0.96
query18	0.24	0.22	0.22
query19	1.79	1.71	1.75
query20	0.01	0.01	0.01
query21	15.43	0.74	0.65
query22	4.36	6.78	2.08
query23	18.27	1.28	1.25
query24	2.06	0.22	0.22
query25	0.16	0.09	0.08
query26	0.30	0.21	0.21
query27	0.45	0.22	0.23
query28	13.39	1.03	1.00
query29	12.61	3.29	3.26
query30	0.24	0.05	0.05
query31	2.92	0.40	0.40
query32	3.24	0.49	0.47
query33	2.91	3.00	2.98
query34	17.19	4.37	4.38
query35	4.45	4.46	4.46
query36	0.65	0.50	0.49
query37	0.19	0.15	0.15
query38	0.15	0.15	0.15
query39	0.04	0.03	0.04
query40	0.15	0.13	0.12
query41	0.10	0.05	0.05
query42	0.05	0.05	0.04
query43	0.05	0.04	0.04
Total cold run time: 110.14 s
Total hot run time: 30.95 s

englefly · 2024-08-13T04:54:00Z

run buildall

doris-robot · 2024-08-13T05:21:22Z

TPC-H: Total hot run time: 40073 ms

machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 26b140816f44a5aa5a4a68519f64337b65b919b0, data reload: false
------ Round 1 ----------------------------------
q1	18067	4461	4385	4385
q2	2234	187	175	175
q3	10499	1156	1084	1084
q4	10132	769	713	713
q5	7762	2839	2778	2778
q6	221	139	138	138
q7	969	631	601	601
q8	9344	2038	2002	2002
q9	8828	6534	6547	6534
q10	6999	2227	2116	2116
q11	487	244	251	244
q12	395	226	227	226
q13	18946	2992	2970	2970
q14	280	240	240	240
q15	520	489	484	484
q16	489	388	387	387
q17	959	665	673	665
q18	8086	7580	7408	7408
q19	6556	1050	1028	1028
q20	701	334	333	333
q21	5303	4544	4678	4544
q22	1114	1037	1018	1018
Total cold run time: 118891 ms
Total hot run time: 40073 ms
----- Round 2, with runtime_filter_mode=off -----
q1	4418	4239	4219	4219
q2	393	275	274	274
q3	2859	2614	2644	2614
q4	1874	1606	1580	1580
q5	5348	5348	5353	5348
q6	221	133	133	133
q7	2032	1625	1647	1625
q8	3147	3309	3305	3305
q9	8359	8393	8363	8363
q10	3376	3135	3149	3135
q11	598	487	499	487
q12	775	607	617	607
q13	17472	2952	2998	2952
q14	305	269	272	269
q15	527	475	467	467
q16	468	452	408	408
q17	1774	1507	1494	1494
q18	7693	7475	7455	7455
q19	4396	1499	1461	1461
q20	2015	1795	1768	1768
q21	5322	5106	5231	5106
q22	1098	1025	1009	1009
Total cold run time: 74470 ms
Total hot run time: 54079 ms

doris-robot · 2024-08-13T05:33:18Z

TPC-DS: Total hot run time: 183912 ms

machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 26b140816f44a5aa5a4a68519f64337b65b919b0, data reload: false
query1	916	384	364	364
query2	6449	1974	1878	1878
query3	6647	212	219	212
query4	31510	23102	22983	22983
query5	4210	483	514	483
query6	275	167	179	167
query7	4584	281	281	281
query8	234	185	192	185
query9	8742	2398	2377	2377
query10	436	278	260	260
query11	17825	14828	14899	14828
query12	140	99	95	95
query13	1632	366	361	361
query14	10177	7817	6915	6915
query15	222	168	166	166
query16	7742	483	433	433
query17	1386	557	556	556
query18	1955	282	279	279
query19	187	139	138	138
query20	111	106	102	102
query21	209	104	101	101
query22	4238	4056	3897	3897
query23	33870	32993	33273	32993
query24	12217	2890	2779	2779
query25	654	376	377	376
query26	1769	156	150	150
query27	2874	265	273	265
query28	7574	2022	2021	2021
query29	1084	430	396	396
query30	302	148	145	145
query31	951	719	747	719
query32	92	56	53	53
query33	740	272	279	272
query34	984	453	465	453
query35	904	728	718	718
query36	1106	931	913	913
query37	175	85	81	81
query38	3946	3793	3777	3777
query39	1415	1377	1384	1377
query40	277	119	114	114
query41	46	48	45	45
query42	115	91	95	91
query43	498	458	471	458
query44	1191	732	731	731
query45	193	170	164	164
query46	1119	761	748	748
query47	1879	1781	1756	1756
query48	356	324	288	288
query49	1162	426	413	413
query50	789	406	410	406
query51	6818	6788	6629	6629
query52	104	92	88	88
query53	259	185	185	185
query54	956	455	441	441
query55	79	73	73	73
query56	267	249	246	246
query57	1157	1052	1076	1052
query58	231	209	222	209
query59	2930	2753	2660	2660
query60	303	270	273	270
query61	97	111	114	111
query62	845	652	654	652
query63	212	193	182	182
query64	10669	2268	1747	1747
query65	3206	3138	3155	3138
query66	1374	333	327	327
query67	15347	14922	15024	14922
query68	4603	555	540	540
query69	403	270	264	264
query70	1125	1102	1158	1102
query71	414	278	269	269
query72	7188	2231	1990	1990
query73	756	327	328	327
query74	9048	8666	8798	8666
query75	3564	2659	2698	2659
query76	2458	926	987	926
query77	450	312	308	308
query78	11790	9383	8993	8993
query79	4338	516	529	516
query80	1236	482	496	482
query81	582	225	234	225
query82	835	142	130	130
query83	280	148	145	145
query84	271	79	83	79
query85	931	278	268	268
query86	488	282	275	275
query87	4422	4193	4190	4190
query88	4929	2424	2408	2408
query89	418	289	296	289
query90	1923	211	194	194
query91	186	93	93	93
query92	67	48	50	48
query93	4435	537	524	524
query94	871	285	281	281
query95	344	261	256	256
query96	626	275	277	275
query97	3172	3037	3037	3037
query98	229	211	200	200
query99	1677	1272	1258	1258
Total cold run time: 307022 ms
Total hot run time: 183912 ms

doris-robot · 2024-08-13T05:38:50Z

ClickBench: Total hot run time: 30.46 s

machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 26b140816f44a5aa5a4a68519f64337b65b919b0, data reload: false
query1	0.05	0.04	0.04
query2	0.08	0.04	0.04
query3	0.22	0.05	0.05
query4	1.68	0.06	0.08
query5	0.50	0.48	0.48
query6	1.13	0.73	0.72
query7	0.02	0.01	0.02
query8	0.06	0.05	0.04
query9	0.54	0.49	0.49
query10	0.54	0.55	0.53
query11	0.15	0.11	0.11
query12	0.15	0.12	0.12
query13	0.62	0.60	0.59
query14	0.74	0.79	0.77
query15	0.85	0.82	0.81
query16	0.35	0.36	0.37
query17	1.05	1.00	1.00
query18	0.22	0.22	0.22
query19	1.84	1.74	1.74
query20	0.01	0.01	0.02
query21	15.42	0.76	0.65
query22	5.06	7.05	1.70
query23	18.28	1.37	1.36
query24	2.14	0.22	0.21
query25	0.15	0.09	0.08
query26	0.31	0.21	0.21
query27	0.45	0.22	0.22
query28	13.24	1.01	0.99
query29	12.57	3.31	3.27
query30	0.24	0.04	0.04
query31	2.90	0.40	0.38
query32	3.27	0.47	0.47
query33	2.96	2.92	2.96
query34	16.98	4.33	4.36
query35	4.47	4.40	4.39
query36	0.63	0.46	0.47
query37	0.18	0.15	0.16
query38	0.15	0.15	0.16
query39	0.06	0.03	0.03
query40	0.15	0.14	0.13
query41	0.10	0.04	0.04
query42	0.06	0.05	0.05
query43	0.05	0.04	0.05
Total cold run time: 110.62 s
Total hot run time: 30.46 s

englefly · 2024-08-13T08:49:28Z

run p0

englefly · 2024-08-13T08:50:01Z

run buildall

englefly · 2024-08-13T09:18:25Z

run buildall

englefly · 2024-08-13T09:20:23Z

run buildall

doris-robot · 2024-08-13T09:40:31Z

TPC-H: Total hot run time: 39713 ms

machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 273c459f96dfe77a5e885cbbda2389ee95b1cb81, data reload: false
------ Round 1 ----------------------------------
q1	17639	4351	4290	4290
q2	2017	187	184	184
q3	11765	1386	1181	1181
q4	10827	691	726	691
q5	7744	2783	2814	2783
q6	225	140	140	140
q7	960	584	593	584
q8	9547	2024	2049	2024
q9	10270	6547	6556	6547
q10	7026	2194	2182	2182
q11	449	250	251	250
q12	391	225	224	224
q13	17755	2996	3010	2996
q14	283	237	229	229
q15	511	489	506	489
q16	488	392	376	376
q17	962	660	691	660
q18	7841	7420	7387	7387
q19	5678	999	945	945
q20	674	327	343	327
q21	5667	4564	4209	4209
q22	1115	1034	1015	1015
Total cold run time: 119834 ms
Total hot run time: 39713 ms
----- Round 2, with runtime_filter_mode=off -----
q1	4581	4242	4256	4242
q2	378	278	281	278
q3	2898	2729	2772	2729
q4	1963	1733	1691	1691
q5	5590	5595	5491	5491
q6	227	140	135	135
q7	2148	1747	1755	1747
q8	3320	3482	3445	3445
q9	8680	8832	8786	8786
q10	3486	3174	3228	3174
q11	594	527	519	519
q12	850	667	649	649
q13	17017	3182	3156	3156
q14	337	295	306	295
q15	533	496	497	496
q16	499	453	460	453
q17	1819	1508	1517	1508
q18	8159	7875	7872	7872
q19	2200	1579	1603	1579
q20	3181	1892	1886	1886
q21	10202	5031	5228	5031
q22	1158	1067	1042	1042
Total cold run time: 79820 ms
Total hot run time: 56204 ms

englefly · 2024-08-13T12:55:02Z

run buildall

doris-robot · 2024-08-13T13:24:17Z

TPC-H: Total hot run time: 39691 ms

machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 2098aaa9b78ad9e1193d8af8a49ac3182cf998ae, data reload: false
------ Round 1 ----------------------------------
q1	17920	4346	4258	4258
q2	2017	179	180	179
q3	10518	1115	1178	1115
q4	10148	721	713	713
q5	7771	2786	2770	2770
q6	223	137	142	137
q7	965	593	596	593
q8	9322	2051	2006	2006
q9	8492	6537	6456	6456
q10	7063	2188	2176	2176
q11	458	247	257	247
q12	401	223	224	223
q13	17825	2997	2984	2984
q14	273	235	233	233
q15	529	481	489	481
q16	512	391	378	378
q17	968	693	704	693
q18	8202	7523	7359	7359
q19	2281	1016	963	963
q20	652	318	316	316
q21	5273	4399	4538	4399
q22	1116	1048	1012	1012
Total cold run time: 112929 ms
Total hot run time: 39691 ms
----- Round 2, with runtime_filter_mode=off -----
q1	4360	4236	4256	4236
q2	370	278	275	275
q3	2848	2637	2619	2619
q4	1995	1803	1735	1735
q5	5637	5490	5643	5490
q6	228	134	134	134
q7	2157	1767	1772	1767
q8	3326	3428	3408	3408
q9	8759	8791	8379	8379
q10	3387	3163	3143	3143
q11	567	489	504	489
q12	763	630	616	616
q13	17453	2994	3003	2994
q14	297	280	262	262
q15	511	474	485	474
q16	475	422	409	409
q17	1762	1467	1467	1467
q18	7703	7578	7408	7408
q19	1695	1557	1465	1465
q20	2111	1820	1809	1809
q21	5049	5108	5075	5075
q22	1085	1001	1011	1001
Total cold run time: 72538 ms
Total hot run time: 54655 ms

doris-robot · 2024-08-13T13:36:30Z

TPC-DS: Total hot run time: 186026 ms

machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 2098aaa9b78ad9e1193d8af8a49ac3182cf998ae, data reload: false
query1	913	379	368	368
query2	6475	1906	1784	1784
query3	6661	206	220	206
query4	34174	23428	23121	23121
query5	4244	481	487	481
query6	299	187	163	163
query7	4589	294	291	291
query8	246	202	196	196
query9	8603	2457	2418	2418
query10	439	281	265	265
query11	17851	14954	15083	14954
query12	161	100	95	95
query13	1652	369	374	369
query14	10334	7660	7956	7660
query15	222	169	167	167
query16	7690	477	486	477
query17	1143	564	551	551
query18	1977	292	287	287
query19	212	148	147	147
query20	112	106	108	106
query21	209	101	102	101
query22	4390	4022	3978	3978
query23	33995	33436	33554	33436
query24	12433	2920	2929	2920
query25	707	395	401	395
query26	1858	163	159	159
query27	2898	275	278	275
query28	7403	2026	2044	2026
query29	1194	431	430	430
query30	319	151	153	151
query31	1013	767	735	735
query32	95	55	56	55
query33	764	295	291	291
query34	939	468	489	468
query35	870	737	726	726
query36	1124	931	919	919
query37	293	87	83	83
query38	3933	3781	3811	3781
query39	1427	1386	1371	1371
query40	273	121	121	121
query41	48	47	48	47
query42	117	99	98	98
query43	532	477	476	476
query44	1222	733	736	733
query45	204	171	168	168
query46	1195	741	760	741
query47	1853	1764	1740	1740
query48	364	290	300	290
query49	1180	440	514	440
query50	851	403	404	403
query51	6842	6802	6681	6681
query52	106	90	93	90
query53	264	192	180	180
query54	998	445	436	436
query55	76	75	74	74
query56	275	255	253	253
query57	1178	1057	1068	1057
query58	242	237	227	227
query59	2849	2547	2672	2547
query60	315	273	275	273
query61	101	93	96	93
query62	846	661	672	661
query63	220	183	184	183
query64	10744	2302	1753	1753
query65	3214	3159	3154	3154
query66	1403	337	323	323
query67	15591	15014	14928	14928
query68	4923	549	561	549
query69	656	333	283	283
query70	1199	1149	1141	1141
query71	465	281	275	275
query72	7802	2231	2029	2029
query73	827	329	331	329
query74	9290	8729	8744	8729
query75	4615	2679	2739	2679
query76	3543	1044	1083	1044
query77	768	334	318	318
query78	9829	9079	8908	8908
query79	8375	523	537	523
query80	1055	501	507	501
query81	585	221	234	221
query82	1315	142	135	135
query83	330	189	143	143
query84	268	78	76	76
query85	1409	281	267	267
query86	428	301	306	301
query87	4344	4193	4197	4193
query88	5587	2422	2396	2396
query89	499	294	282	282
query90	2034	202	198	198
query91	123	97	96	96
query92	66	51	50	50
query93	6250	531	546	531
query94	990	263	296	263
query95	347	261	257	257
query96	659	277	271	271
query97	3214	3049	3000	3000
query98	234	209	198	198
query99	1592	1305	1264	1264
Total cold run time: 320585 ms
Total hot run time: 186026 ms

doris-robot · 2024-08-13T13:42:03Z

ClickBench: Total hot run time: 31.09 s

machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 2098aaa9b78ad9e1193d8af8a49ac3182cf998ae, data reload: false
query1	0.04	0.04	0.03
query2	0.08	0.04	0.03
query3	0.22	0.05	0.06
query4	1.68	0.09	0.09
query5	0.47	0.49	0.49
query6	1.14	0.73	0.73
query7	0.01	0.01	0.02
query8	0.05	0.04	0.04
query9	0.55	0.49	0.48
query10	0.55	0.55	0.53
query11	0.15	0.11	0.12
query12	0.15	0.12	0.12
query13	0.60	0.61	0.59
query14	0.75	0.79	0.79
query15	0.90	0.82	0.83
query16	0.35	0.37	0.37
query17	1.05	1.01	0.94
query18	0.22	0.22	0.21
query19	1.88	1.73	1.77
query20	0.02	0.01	0.03
query21	15.39	0.75	0.65
query22	4.41	6.68	2.27
query23	18.28	1.38	1.34
query24	2.09	0.23	0.22
query25	0.14	0.07	0.08
query26	0.31	0.21	0.21
query27	0.46	0.22	0.23
query28	13.36	1.02	0.99
query29	12.66	3.36	3.31
query30	0.25	0.05	0.05
query31	2.89	0.40	0.39
query32	3.26	0.49	0.47
query33	2.92	2.99	2.98
query34	16.99	4.43	4.33
query35	4.42	4.44	4.36
query36	0.66	0.47	0.48
query37	0.19	0.16	0.16
query38	0.15	0.14	0.16
query39	0.05	0.03	0.04
query40	0.15	0.13	0.13
query41	0.10	0.05	0.05
query42	0.05	0.04	0.04
query43	0.05	0.04	0.05
Total cold run time: 110.09 s
Total hot run time: 31.09 s

englefly · 2024-08-14T02:59:47Z

run buildall

doris-robot · 2024-08-15T13:12:57Z

TPC-DS: Total hot run time: 190346 ms

machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 46b4dccbc5e17bc635f70ba190cca3d0fbe2a448, data reload: false
query1	1011	408	390	390
query2	6735	2085	1961	1961
query3	6675	223	242	223
query4	33868	23143	23126	23126
query5	4332	654	698	654
query6	313	213	216	213
query7	4607	335	329	329
query8	492	429	433	429
query9	8688	2519	2498	2498
query10	506	364	350	350
query11	17833	15039	14949	14949
query12	189	138	135	135
query13	1700	461	466	461
query14	9593	6925	7141	6925
query15	243	190	202	190
query16	7898	549	497	497
query17	1622	604	587	587
query18	2073	340	332	332
query19	221	168	174	168
query20	141	138	139	138
query21	252	145	143	143
query22	4390	4040	4031	4031
query23	33990	33306	35301	33306
query24	11673	2849	3000	2849
query25	551	421	420	420
query26	974	180	178	178
query27	2728	312	303	303
query28	7236	2145	2122	2122
query29	682	458	469	458
query30	333	185	184	184
query31	1050	855	829	829
query32	122	81	82	81
query33	816	336	347	336
query34	920	515	510	510
query35	875	787	761	761
query36	1117	936	933	933
query37	153	109	104	104
query38	4068	3967	3846	3846
query39	1503	1479	1482	1479
query40	310	159	156	156
query41	140	137	142	137
query42	133	119	123	119
query43	569	513	497	497
query44	1248	786	801	786
query45	226	196	203	196
query46	1131	789	789	789
query47	1917	1840	1831	1831
query48	428	336	341	336
query49	1322	592	596	592
query50	874	467	480	467
query51	6859	6740	6722	6722
query52	122	111	112	111
query53	308	227	224	224
query54	940	528	509	509
query55	93	89	92	89
query56	340	315	319	315
query57	1210	1147	1196	1147
query58	358	346	364	346
query59	3109	2896	2935	2896
query60	358	337	336	336
query61	148	149	148	148
query62	886	656	694	656
query63	256	228	232	228
query64	6118	2364	1830	1830
query65	3246	3150	3183	3150
query66	1394	671	720	671
query67	15449	14977	14841	14841
query68	6989	587	604	587
query69	739	425	340	340
query70	1261	1076	1198	1076
query71	552	320	319	319
query72	7196	2329	2000	2000
query73	855	367	362	362
query74	9362	8807	8752	8752
query75	4666	2756	2770	2756
query76	4801	1090	1045	1045
query77	902	455	459	455
query78	10175	9345	8955	8955
query79	3195	614	563	563
query80	2712	600	598	598
query81	627	261	259	259
query82	781	168	162	162
query83	363	223	224	223
query84	301	100	100	100
query85	1703	374	346	346
query86	487	322	324	322
query87	4533	4254	4251	4251
query88	4331	2515	2540	2515
query89	475	328	326	326
query90	2163	235	239	235
query91	160	129	130	129
query92	90	74	74	74
query93	4458	570	567	567
query94	1154	311	331	311
query95	399	347	299	299
query96	631	284	288	284
query97	3256	3051	3061	3051
query98	250	227	224	224
query99	1631	1307	1312	1307
Total cold run time: 312863 ms
Total hot run time: 190346 ms

doris-robot · 2024-08-15T13:18:30Z

ClickBench: Total hot run time: 31.55 s

machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 46b4dccbc5e17bc635f70ba190cca3d0fbe2a448, data reload: false
query1	0.04	0.04	0.04
query2	0.07	0.04	0.05
query3	0.23	0.06	0.05
query4	1.67	0.07	0.08
query5	0.49	0.48	0.49
query6	1.14	0.73	0.72
query7	0.03	0.02	0.01
query8	0.05	0.05	0.05
query9	0.56	0.47	0.48
query10	0.56	0.54	0.55
query11	0.16	0.13	0.13
query12	0.15	0.13	0.13
query13	0.62	0.62	0.59
query14	0.78	0.78	0.78
query15	0.87	0.83	0.83
query16	0.37	0.37	0.37
query17	1.05	1.03	0.96
query18	0.25	0.23	0.22
query19	1.83	1.67	1.71
query20	0.02	0.01	0.01
query21	15.39	0.67	0.67
query22	4.28	6.72	2.38
query23	18.26	1.37	1.21
query24	2.12	0.22	0.24
query25	0.15	0.09	0.09
query26	0.31	0.22	0.22
query27	0.46	0.24	0.23
query28	13.25	1.04	1.02
query29	12.63	3.33	3.36
query30	0.45	0.26	0.25
query31	2.81	0.43	0.40
query32	3.24	0.48	0.49
query33	2.95	2.97	2.99
query34	17.07	4.37	4.33
query35	4.47	4.41	4.41
query36	0.66	0.47	0.52
query37	0.21	0.18	0.17
query38	0.17	0.17	0.18
query39	0.07	0.06	0.05
query40	0.18	0.15	0.14
query41	0.11	0.07	0.06
query42	0.08	0.07	0.06
query43	0.06	0.06	0.06
Total cold run time: 110.32 s
Total hot run time: 31.55 s

englefly · 2024-08-16T00:05:49Z

run cloud_p0

github-actions · 2024-08-16T02:44:13Z

PR approved by at least one committer and no changes requested.

github-actions · 2024-08-16T02:44:14Z

PR approved by anyone and no changes requested.

seawinde · 2024-08-16T08:49:09Z

- sql("select sum(salary) as salary from emps;")
- contains "(emps_mv)"
- }
-


the same with above

seawinde · 2024-08-16T08:49:59Z

- }
-
- sql """set enable_stats=true;"""
-


the same with avove

## Proposed changes 1. trival project cost is changed from 1 to 0 2. analyze mtmv after create view to make case stable 3. add unknown col stats for variant nested column Issue Number: close #xxx

) fix thown npe because of conflict between #39431 and #39265

## Proposed changes This is brought by #39265 1. Some test fail because `MaterializedViewRewriteSuccessButNotChose`, because in these tests materialized view are not analyzed after create, So Add `analyze clause` when waite materialized view task finished 2. No signature of method: org.apache.doris.regression.suite.Suite.check_mv_rewrite_success(), because `check_mv_rewrite_success` is not available in Suite.groovy. Fix this by using correct method. 3. If partition row count statistics is not ready, should not check mv rewrte by CBO succesfully

This is brought by apache#39265 1. Some test fail because `MaterializedViewRewriteSuccessButNotChose`, because in these tests materialized view are not analyzed after create, So Add `analyze clause` when waite materialized view task finished 2. No signature of method: org.apache.doris.regression.suite.Suite.check_mv_rewrite_success(), because `check_mv_rewrite_success` is not available in Suite.groovy. Fix this by using correct method. 3. If partition row count statistics is not ready, should not check mv rewrte by CBO succesfully

## Proposed changes 1. trival project cost is changed from 1 to 0 2. analyze mtmv after create view to make case stable 3. add unknown col stats for variant nested column Issue Number: close #xxx

…che#39510) fix thown npe because of conflict between apache#39431 and apache#39265

## Proposed changes This is brought by apache#39265 1. Some test fail because `MaterializedViewRewriteSuccessButNotChose`, because in these tests materialized view are not analyzed after create, So Add `analyze clause` when waite materialized view task finished 2. No signature of method: org.apache.doris.regression.suite.Suite.check_mv_rewrite_success(), because `check_mv_rewrite_success` is not available in Suite.groovy. Fix this by using correct method. 3. If partition row count statistics is not ready, should not check mv rewrte by CBO succesfully

analyze mtmv after create view
073a42b

github-actionsBot added the doing label Aug 13, 2024

trival project cost 0
26b1408

englefly force-pushed the mtmv-analyze branch from a3ed939 to 26b1408Compare August 13, 2024 04:52

englefly changed the title ~~[fix](regression-case)analyze mtmv after create view~~[fix](nereids) trival project cost zeroAug 13, 2024

check mv by memo plan
4d1d593

variant stats
273c459

englefly changed the title ~~[fix](nereids) trival project cost zero~~[fix](nereids) trival project cost zero (MV cost)Aug 13, 2024

print stats fragment
2098aaa

use derive stats
3b4700f

hello-stephen approved these changes Aug 16, 2024
View reviewed changes

github-actionsBot added the approved Indicates a PR has been approved by one committer. label Aug 16, 2024

github-actionsBot added the reviewed label Aug 16, 2024

seawinde reviewed Aug 16, 2024
View reviewed changes

Comment threadregression-test/data/nereids_p0/expression/fold_constant/fold_constant_by_be.out

seawinde reviewed Aug 16, 2024
View reviewed changes

Comment threadregression-test/data/mv_p0/k1s2m3/k1s2m3.out

starocean999 approved these changes Aug 16, 2024
View reviewed changes

seawinde reviewed Aug 16, 2024
View reviewed changes

englefly merged commit 7665b88 into apache:masterAug 16, 2024

morrySnow approved these changes Aug 16, 2024
View reviewed changes

morrySnow added dev/2.1.x and removed dev/2.1.x doing labels Aug 16, 2024

dataroaring added the dev/3.0.2-merged label Aug 17, 2024

924060929 mentioned this pull request Aug 20, 2024
[fix](nereids) bug: with sql cache, cascadeContext could be null #39510
Merged

924060929 pushed a commit that referenced this pull request Aug 20, 2024
[fix](nereids) bug: with sql cache, cascadeContext could be null (#39510
9a06866
) fix thown npe because of conflict between #39431 and #39265

dataroaring pushed a commit that referenced this pull request Aug 20, 2024
[fix](nereids) bug: with sql cache, cascadeContext could be null (#39510
f04bdf3
) fix thown npe because of conflict between #39431 and #39265

seawinde mentioned this pull request Sep 23, 2024
[fix](mtmv) regression test unstable and error #41145
Merged

HappenLee pushed a commit to HappenLee/incubator-doris that referenced this pull request Apr 24, 2026
[fix](nereids) bug: with sql cache, cascadeContext could be null (apa…
4face77
…che#39510) fix thown npe because of conflict between apache#39431 and apache#39265

Uh oh!

Conversation

englefly commented Aug 13, 2024• edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Proposed changes

Uh oh!

doris-robot commented Aug 13, 2024

Uh oh!

englefly commented Aug 13, 2024

Uh oh!

englefly commented Aug 13, 2024

Uh oh!

doris-robot commented Aug 13, 2024

Uh oh!

doris-robot commented Aug 13, 2024

Uh oh!

doris-robot commented Aug 13, 2024

Uh oh!

englefly commented Aug 13, 2024

Uh oh!

doris-robot commented Aug 13, 2024

Uh oh!

doris-robot commented Aug 13, 2024

Uh oh!

doris-robot commented Aug 13, 2024

Uh oh!

englefly commented Aug 13, 2024

Uh oh!

englefly commented Aug 13, 2024

Uh oh!

englefly commented Aug 13, 2024

Uh oh!

englefly commented Aug 13, 2024

Uh oh!

doris-robot commented Aug 13, 2024

Uh oh!

englefly commented Aug 13, 2024

Uh oh!

doris-robot commented Aug 13, 2024

Uh oh!

doris-robot commented Aug 13, 2024

Uh oh!

doris-robot commented Aug 13, 2024

Uh oh!

englefly commented Aug 14, 2024

Uh oh!

doris-robot commented Aug 15, 2024

Uh oh!

doris-robot commented Aug 15, 2024

Uh oh!

englefly commented Aug 16, 2024

Uh oh!

github-actionsBot commented Aug 16, 2024

Uh oh!

github-actionsBot commented Aug 16, 2024

Uh oh!

Uh oh!

Uh oh!

seawindeAug 16, 2024

Choose a reason for hiding this comment

Uh oh!

seawindeAug 16, 2024

Choose a reason for hiding this comment

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

7 participants

englefly commented Aug 13, 2024•
edited
Loading