Skip to content

[fix](cloud) Fix async mtmv job retry when meet -230 in cloud - #47370

Merged
gavinchou merged 4 commits into
apache:masterfrom
deardeng:fix-mtmv-230
Jan 29, 2025
Merged

[fix](cloud) Fix async mtmv job retry when meet -230 in cloud#47370
gavinchou merged 4 commits into
apache:masterfrom
deardeng:fix-mtmv-230

Conversation

@deardeng

@deardengdeardeng commented Jan 23, 2025

Copy link
Copy Markdown
Contributor

What problem does this PR solve?

Issue Number: close #xxx

Related PR: #xxx

Problem Summary:

The current cloud on MTMV encountered -230, with no retries. Fix it.

Release note

None

Check List (For Author)

  • Test

    • Regression test
    • Unit Test
    • Manual test (add detailed scripts or steps below)
    • No need to test or manual test. Explain why:
      • This is a refactor/code format and no logic has been changed.
      • Previous test can cover this change.
      • No code files have been changed.
      • Other reason

  • Behavior changed:

    • No.
    • Yes.

  • Does this need documentation?

    • No.
    • Yes.

Check List (For Reviewer who merge this PR)

  • Confirm the release note
  • Confirm test cases
  • Confirm document
  • Add branch pick label

@hello-stephen

hello-stephen commented Jan 23, 2025

Copy link
Copy Markdown
Contributor

Thank you for your contribution to Apache Doris.
Don't know what should be done next? See How to process your PR.

Please clearly describe your PR:

  1. What problem was fixed (it's best to include specific error reporting information). How it was fixed.
  2. Which behaviors were modified. What was the previous behavior, what is it now, why was it modified, and what possible impacts might there be.
  3. What features were added. Why was this function added?
  4. Which code was refactored and why was this part of the code refactored?
  5. Which functions were optimized and what is the difference before and after the optimization?

@deardeng

deardeng commented Jan 23, 2025

Copy link
Copy Markdown
ContributorAuthor

run buildall

zddr
zddr reviewed Jan 23, 2025
View reviewed changes
Comment threadfe/fe-core/src/main/java/org/apache/doris/job/extensions/mtmv/MTMVTask.java
Comment threadfe/fe-core/src/main/java/org/apache/doris/job/extensions/mtmv/MTMVTask.java Outdated
Comment threadfe/fe-core/src/main/java/org/apache/doris/job/extensions/mtmv/MTMVTask.java Outdated
@doris-robot

doris-robot commented Jan 23, 2025

Copy link
Copy Markdown
TPC-H: Total hot run time: 32349 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 5571e7ab54265dae730a509992dd22df3426de2f, data reload: false
------ Round 1 ----------------------------------
q1	17603	5440	5398	5398
q2	2036	300	168	168
q3	10428	1296	749	749
q4	10206	975	528	528
q5	7504	2391	2185	2185
q6	188	164	140	140
q7	890	764	616	616
q8	9222	1366	1150	1150
q9	5415	4871	4989	4871
q10	6824	2340	1884	1884
q11	473	283	264	264
q12	341	359	218	218
q13	17764	3657	3088	3088
q14	233	227	210	210
q15	507	472	480	472
q16	614	619	592	592
q17	560	877	328	328
q18	6922	6531	6456	6456
q19	1219	950	535	535
q20	316	339	206	206
q21	2902	2251	1973	1973
q22	358	332	318	318
Total cold run time: 102525 ms
Total hot run time: 32349 ms
----- Round 2, with runtime_filter_mode=off -----
q1	5508	5529	5545	5529
q2	241	333	232	232
q3	2267	2709	2303	2303
q4	1431	1878	1402	1402
q5	4333	4796	4621	4621
q6	164	162	126	126
q7	2072	2002	1839	1839
q8	2649	2903	2724	2724
q9	7288	7167	7320	7167
q10	2949	3265	2764	2764
q11	576	511	493	493
q12	693	774	637	637
q13	3532	3944	3323	3323
q14	276	290	267	267
q15	522	493	465	465
q16	629	686	630	630
q17	1245	1738	1246	1246
q18	7723	7422	7321	7321
q19	795	1062	1111	1062
q20	1994	2038	1888	1888
q21	5795	5275	5098	5098
q22	629	612	548	548
Total cold run time: 53311 ms
Total hot run time: 51685 ms

@doris-robot

doris-robot commented Jan 23, 2025

Copy link
Copy Markdown
TPC-DS: Total hot run time: 184562 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 5571e7ab54265dae730a509992dd22df3426de2f, data reload: false
query1	994	385	378	378
query2	6518	2052	1993	1993
query3	6791	217	215	215
query4	33306	23200	22927	22927
query5	4261	598	448	448
query6	277	198	182	182
query7	4614	501	305	305
query8	305	242	228	228
query9	9481	2670	2665	2665
query10	472	317	278	278
query11	17893	15279	15061	15061
query12	150	105	102	102
query13	1670	533	409	409
query14	9489	7327	6720	6720
query15	234	188	188	188
query16	8067	620	499	499
query17	1612	735	582	582
query18	2129	405	298	298
query19	200	183	163	163
query20	119	114	110	110
query21	213	123	104	104
query22	4145	4396	4091	4091
query23	33956	33175	33101	33101
query24	6554	2251	2324	2251
query25	491	430	379	379
query26	1193	271	153	153
query27	2027	485	334	334
query28	5386	2462	2426	2426
query29	725	543	448	448
query30	232	187	159	159
query31	965	876	800	800
query32	86	59	59	59
query33	511	349	285	285
query34	750	848	511	511
query35	807	815	741	741
query36	988	1041	943	943
query37	118	106	77	77
query38	4335	4068	4043	4043
query39	1441	1383	1399	1383
query40	210	114	99	99
query41	53	52	50	50
query42	119	105	102	102
query43	522	542	494	494
query44	1345	808	821	808
query45	173	171	165	165
query46	853	1022	638	638
query47	1806	1817	1746	1746
query48	382	406	307	307
query49	782	473	385	385
query50	631	648	410	410
query51	4223	4202	4093	4093
query52	112	105	93	93
query53	228	256	185	185
query54	479	491	401	401
query55	87	81	79	79
query56	266	249	246	246
query57	1192	1170	1097	1097
query58	255	227	242	227
query59	3138	3122	2809	2809
query60	276	267	248	248
query61	119	110	115	110
query62	771	719	649	649
query63	219	188	189	188
query64	4540	988	673	673
query65	3242	3142	3215	3142
query66	1076	414	359	359
query67	15959	15506	15337	15337
query68	4316	840	547	547
query69	476	302	263	263
query70	1235	1084	1057	1057
query71	371	303	272	272
query72	5761	3858	3917	3858
query73	656	742	359	359
query74	10018	8894	9004	8894
query75	3154	3174	2662	2662
query76	3182	1142	773	773
query77	453	361	288	288
query78	10080	10092	9370	9370
query79	2401	792	617	617
query80	678	530	430	430
query81	528	273	240	240
query82	309	155	122	122
query83	176	179	156	156
query84	250	92	75	75
query85	745	356	299	299
query86	388	318	314	314
query87	4380	4506	4415	4415
query88	4296	2190	2180	2180
query89	392	337	285	285
query90	1974	192	190	190
query91	132	143	109	109
query92	66	56	56	56
query93	2707	890	537	537
query94	651	412	290	290
query95	341	272	262	262
query96	489	617	283	283
query97	2824	2862	2717	2717
query98	232	198	191	191
query99	1279	1378	1272	1272
Total cold run time: 281503 ms
Total hot run time: 184562 ms

@deardeng

deardeng commented Jan 23, 2025

Copy link
Copy Markdown
ContributorAuthor

run buildall

@doris-robot

doris-robot commented Jan 23, 2025

Copy link
Copy Markdown
TPC-H: Total hot run time: 32278 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit c0c4e423c1b9c2e2326b19d454302c4b2f69ebd5, data reload: false
------ Round 1 ----------------------------------
q1	17565	5466	5369	5369
q2	2053	313	177	177
q3	10420	1225	746	746
q4	10222	961	523	523
q5	7580	2373	2138	2138
q6	198	171	134	134
q7	915	768	606	606
q8	9231	1342	1162	1162
q9	5164	4893	4854	4854
q10	6881	2351	1871	1871
q11	499	291	260	260
q12	364	375	239	239
q13	17846	3731	3176	3176
q14	240	233	216	216
q15	537	480	468	468
q16	626	625	586	586
q17	561	860	335	335
q18	6912	6434	6434	6434
q19	1924	957	551	551
q20	325	313	197	197
q21	2836	2180	1932	1932
q22	367	334	304	304
Total cold run time: 103266 ms
Total hot run time: 32278 ms
----- Round 2, with runtime_filter_mode=off -----
q1	5622	5489	5508	5489
q2	238	328	233	233
q3	2215	2665	2378	2378
q4	1479	1823	1411	1411
q5	4348	4749	4692	4692
q6	165	160	124	124
q7	2040	1957	1882	1882
q8	2652	2867	2780	2780
q9	7338	7254	7234	7234
q10	3088	3330	2809	2809
q11	569	511	497	497
q12	634	759	556	556
q13	3501	4009	3368	3368
q14	287	304	272	272
q15	544	471	486	471
q16	676	687	661	661
q17	1230	1764	1259	1259
q18	7656	7666	7461	7461
q19	797	1072	1084	1072
q20	2023	2064	1904	1904
q21	5735	5329	5054	5054
q22	631	624	572	572
Total cold run time: 53468 ms
Total hot run time: 52179 ms

@doris-robot

doris-robot commented Jan 23, 2025

Copy link
Copy Markdown
TPC-DS: Total hot run time: 191523 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit c0c4e423c1b9c2e2326b19d454302c4b2f69ebd5, data reload: false
query1	1358	963	934	934
query2	6253	2082	2062	2062
query3	11063	4597	4596	4596
query4	61564	28781	23070	23070
query5	5500	595	456	456
query6	425	216	197	197
query7	5452	507	303	303
query8	339	256	243	243
query9	7855	2664	2656	2656
query10	441	292	249	249
query11	17382	15206	15494	15206
query12	160	116	103	103
query13	1400	542	412	412
query14	11673	6706	7594	6706
query15	208	197	203	197
query16	7371	656	457	457
query17	1183	769	586	586
query18	1908	415	331	331
query19	209	179	157	157
query20	123	114	115	114
query21	219	126	108	108
query22	4382	4787	4334	4334
query23	34343	33942	33614	33614
query24	5659	2381	2360	2360
query25	476	476	393	393
query26	648	290	156	156
query27	1548	478	331	331
query28	4074	2485	2445	2445
query29	584	560	418	418
query30	214	196	158	158
query31	982	905	828	828
query32	72	57	59	57
query33	471	351	321	321
query34	761	901	521	521
query35	793	849	755	755
query36	1025	1053	953	953
query37	124	106	77	77
query38	4389	4287	4288	4287
query39	1520	1452	1445	1445
query40	214	116	101	101
query41	57	50	48	48
query42	116	108	113	108
query43	534	528	514	514
query44	1412	879	868	868
query45	182	177	171	171
query46	879	1060	655	655
query47	1919	1894	1826	1826
query48	386	402	331	331
query49	719	504	412	412
query50	646	670	406	406
query51	4321	4312	4268	4268
query52	112	98	90	90
query53	226	251	184	184
query54	501	502	416	416
query55	92	83	77	77
query56	258	272	252	252
query57	1234	1195	1123	1123
query58	245	250	238	238
query59	3254	3276	2999	2999
query60	291	281	289	281
query61	127	117	109	109
query62	816	762	705	705
query63	234	191	193	191
query64	1293	1017	662	662
query65	3229	3202	3179	3179
query66	728	403	304	304
query67	16097	15708	15355	15355
query68	5060	810	541	541
query69	488	307	251	251
query70	1196	1172	1136	1136
query71	424	284	259	259
query72	6179	3755	3881	3755
query73	826	752	369	369
query74	10266	8876	8732	8732
query75	3333	3170	2678	2678
query76	3816	1157	756	756
query77	472	359	274	274
query78	10121	10098	9265	9265
query79	2408	792	609	609
query80	684	523	445	445
query81	507	277	238	238
query82	231	151	126	126
query83	220	163	152	152
query84	297	95	74	74
query85	742	375	294	294
query86	363	308	312	308
query87	4484	4544	4410	4410
query88	3689	2173	2162	2162
query89	387	334	290	290
query90	1648	187	198	187
query91	132	137	108	108
query92	63	58	52	52
query93	2544	870	530	530
query94	701	412	301	301
query95	329	264	254	254
query96	491	609	292	292
query97	2784	2901	2770	2770
query98	218	213	192	192
query99	1265	1412	1244	1244
Total cold run time: 310641 ms
Total hot run time: 191523 ms

@doris-robot

doris-robot commented Jan 23, 2025

Copy link
Copy Markdown
ClickBench: Total hot run time: 30.89 s
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit c0c4e423c1b9c2e2326b19d454302c4b2f69ebd5, data reload: false
query1	0.03	0.04	0.04
query2	0.07	0.03	0.03
query3	0.24	0.07	0.07
query4	1.62	0.11	0.10
query5	0.41	0.42	0.42
query6	1.15	0.67	0.65
query7	0.02	0.02	0.02
query8	0.04	0.03	0.03
query9	0.58	0.51	0.49
query10	0.57	0.57	0.54
query11	0.15	0.10	0.10
query12	0.14	0.11	0.11
query13	0.60	0.60	0.61
query14	2.72	2.71	2.75
query15	0.89	0.83	0.82
query16	0.38	0.38	0.38
query17	1.04	1.05	1.07
query18	0.22	0.20	0.21
query19	1.97	1.81	2.02
query20	0.01	0.01	0.01
query21	15.38	0.93	0.57
query22	0.75	0.81	0.70
query23	15.25	1.50	0.55
query24	2.95	1.07	1.96
query25	0.17	0.08	0.04
query26	0.20	0.15	0.14
query27	0.06	0.05	0.05
query28	14.73	1.01	0.46
query29	12.59	3.92	3.27
query30	0.25	0.08	0.06
query31	2.83	0.61	0.39
query32	3.23	0.56	0.47
query33	2.97	3.04	3.04
query34	16.60	5.19	4.57
query35	4.61	4.57	4.52
query36	0.65	0.49	0.50
query37	0.10	0.06	0.06
query38	0.05	0.04	0.04
query39	0.03	0.03	0.02
query40	0.17	0.13	0.13
query41	0.08	0.03	0.02
query42	0.04	0.02	0.02
query43	0.03	0.04	0.03
Total cold run time: 106.57 s
Total hot run time: 30.89 s

@dataroaring

dataroaring commented Jan 24, 2025

Copy link
Copy Markdown
Contributor

run buildall

@doris-robot

doris-robot commented Jan 24, 2025

Copy link
Copy Markdown
TPC-H: Total hot run time: 32098 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 010ab6c09821e6c0e2e4c9d551f4b29357f4daf9, data reload: false
------ Round 1 ----------------------------------
q1	17580	5444	5334	5334
q2	2045	307	166	166
q3	10415	1253	707	707
q4	10223	971	534	534
q5	7532	2417	2180	2180
q6	193	169	132	132
q7	893	751	614	614
q8	9233	1366	1111	1111
q9	5303	4903	4950	4903
q10	6845	2334	1886	1886
q11	475	269	258	258
q12	337	354	216	216
q13	17775	3740	3046	3046
q14	243	224	211	211
q15	533	464	455	455
q16	622	615	584	584
q17	561	877	325	325
q18	6985	6467	6443	6443
q19	1214	948	524	524
q20	316	321	195	195
q21	2843	2182	1964	1964
q22	364	331	310	310
Total cold run time: 102530 ms
Total hot run time: 32098 ms
----- Round 2, with runtime_filter_mode=off -----
q1	5480	5468	5449	5449
q2	241	332	236	236
q3	2271	2663	2352	2352
q4	1391	1886	1358	1358
q5	4332	4704	4646	4646
q6	164	155	122	122
q7	2014	1973	1797	1797
q8	2660	2822	2669	2669
q9	7351	7304	7277	7277
q10	2928	3268	2749	2749
q11	572	522	486	486
q12	687	772	602	602
q13	3526	3888	3192	3192
q14	275	295	267	267
q15	515	475	467	467
q16	629	687	643	643
q17	1197	1709	1234	1234
q18	7671	7570	7217	7217
q19	784	1166	1027	1027
q20	1988	2027	1902	1902
q21	5650	5264	4896	4896
q22	599	581	551	551
Total cold run time: 52925 ms
Total hot run time: 51139 ms

@doris-robot

doris-robot commented Jan 24, 2025

Copy link
Copy Markdown
TPC-DS: Total hot run time: 184877 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 010ab6c09821e6c0e2e4c9d551f4b29357f4daf9, data reload: false
query1	992	378	370	370
query2	6514	2154	2131	2131
query3	6810	211	220	211
query4	33452	23259	23294	23259
query5	4373	635	458	458
query6	284	202	190	190
query7	4611	496	297	297
query8	295	243	236	236
query9	9284	2607	2600	2600
query10	469	313	255	255
query11	17878	15187	14942	14942
query12	161	110	106	106
query13	1666	548	404	404
query14	9443	6970	6690	6690
query15	231	198	186	186
query16	7923	624	481	481
query17	1584	718	559	559
query18	2076	392	287	287
query19	223	174	152	152
query20	111	110	111	110
query21	211	117	99	99
query22	4377	4547	4168	4168
query23	33985	33497	33020	33020
query24	6681	2213	2276	2213
query25	488	443	378	378
query26	1180	264	152	152
query27	2043	469	328	328
query28	5160	2438	2427	2427
query29	663	564	415	415
query30	230	184	155	155
query31	953	871	798	798
query32	81	58	58	58
query33	504	350	309	309
query34	739	849	502	502
query35	797	811	733	733
query36	977	1039	929	929
query37	104	94	81	81
query38	4140	4138	4178	4138
query39	1434	1391	1382	1382
query40	209	117	98	98
query41	55	51	51	51
query42	117	101	106	101
query43	508	528	509	509
query44	1307	796	805	796
query45	176	169	163	163
query46	839	1027	642	642
query47	1845	1867	1825	1825
query48	392	403	312	312
query49	772	495	403	403
query50	627	655	384	384
query51	4178	4112	4128	4112
query52	100	109	96	96
query53	228	256	182	182
query54	482	497	409	409
query55	77	75	80	75
query56	262	260	228	228
query57	1206	1152	1070	1070
query58	246	231	237	231
query59	3157	3273	3045	3045
query60	273	268	258	258
query61	117	117	121	117
query62	785	702	649	649
query63	220	185	182	182
query64	4342	1012	699	699
query65	3234	3151	3105	3105
query66	824	407	336	336
query67	15788	15737	15473	15473
query68	2394	812	553	553
query69	395	304	268	268
query70	1244	1158	1144	1144
query71	313	290	267	267
query72	6035	3894	3866	3866
query73	644	742	379	379
query74	9854	9034	8660	8660
query75	3138	3140	2645	2645
query76	2196	1169	752	752
query77	323	384	275	275
query78	10059	10298	9254	9254
query79	1001	864	613	613
query80	1162	533	442	442
query81	520	275	237	237
query82	1053	151	144	144
query83	246	170	151	151
query84	236	91	72	72
query85	832	342	301	301
query86	384	320	307	307
query87	4512	4675	4457	4457
query88	3213	2189	2153	2153
query89	389	338	295	295
query90	1708	185	189	185
query91	143	137	110	110
query92	62	56	58	56
query93	940	843	531	531
query94	618	404	301	301
query95	338	271	255	255
query96	477	601	277	277
query97	2810	2851	2703	2703
query98	222	207	198	198
query99	1296	1400	1266	1266
Total cold run time: 274250 ms
Total hot run time: 184877 ms

@doris-robot

doris-robot commented Jan 24, 2025

Copy link
Copy Markdown
ClickBench: Total hot run time: 31.43 s
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 010ab6c09821e6c0e2e4c9d551f4b29357f4daf9, data reload: false
query1	0.04	0.03	0.03
query2	0.07	0.03	0.03
query3	0.23	0.06	0.07
query4	1.61	0.10	0.10
query5	0.40	0.41	0.43
query6	1.14	0.68	0.65
query7	0.03	0.02	0.01
query8	0.04	0.02	0.03
query9	0.58	0.50	0.51
query10	0.56	0.56	0.57
query11	0.14	0.11	0.11
query12	0.14	0.11	0.10
query13	0.61	0.60	0.60
query14	2.73	2.76	2.74
query15	0.89	0.82	0.82
query16	0.38	0.37	0.39
query17	1.04	1.03	1.08
query18	0.22	0.20	0.20
query19	1.92	2.02	1.83
query20	0.01	0.02	0.01
query21	15.40	0.92	0.56
query22	0.76	0.98	0.69
query23	15.07	1.42	0.54
query24	3.05	1.72	1.65
query25	0.16	0.18	0.15
query26	0.22	0.14	0.13
query27	0.05	0.05	0.05
query28	14.51	0.98	0.43
query29	12.61	3.91	3.25
query30	0.25	0.09	0.07
query31	2.83	0.59	0.37
query32	3.23	0.54	0.46
query33	3.00	3.02	3.05
query34	16.44	5.23	4.54
query35	4.55	4.58	4.54
query36	0.64	0.49	0.48
query37	0.09	0.06	0.06
query38	0.04	0.03	0.03
query39	0.03	0.02	0.02
query40	0.17	0.13	0.13
query41	0.09	0.03	0.03
query42	0.04	0.03	0.02
query43	0.04	0.04	0.03
Total cold run time: 106.05 s
Total hot run time: 31.43 s

gavinchou
gavinchou reviewed Jan 27, 2025
View reviewed changes
Comment threadfe/fe-core/src/main/java/org/apache/doris/job/extensions/mtmv/MTMVTask.java Outdated
gavinchou
gavinchou previously approved these changes Jan 27, 2025
View reviewed changes
@gavinchou

gavinchou commented Jan 27, 2025

Copy link
Copy Markdown
Contributor

run buildall

@github-actions

github-actionsBot commented Jan 27, 2025

Copy link
Copy Markdown
Contributor

PR approved by at least one committer and no changes requested.

@github-actionsgithub-actionsBot added the approved Indicates a PR has been approved by one committer. label Jan 27, 2025
Hastyshell
Hastyshell approved these changes Jan 27, 2025
View reviewed changes

@HastyshellHastyshell left a comment

Copy link
Copy Markdown
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

gavinchou
gavinchou reviewed Jan 27, 2025
View reviewed changes
Comment threadfe/fe-core/src/main/java/org/apache/doris/job/extensions/mtmv/MTMVTask.java Outdated
@gavinchou

gavinchou commented Jan 27, 2025

Copy link
Copy Markdown
Contributor

run buildall

@github-actionsgithub-actionsBot removed the approved Indicates a PR has been approved by one committer. label Jan 27, 2025
@doris-robot

doris-robot commented Jan 27, 2025

Copy link
Copy Markdown
TPC-H: Total hot run time: 32070 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 97d64c8aff9f579561db733e51f94a2431fce0ab, data reload: false
------ Round 1 ----------------------------------
q1	17578	5528	5401	5401
q2	2043	317	172	172
q3	10538	1278	717	717
q4	10255	974	534	534
q5	8908	2724	2136	2136
q6	201	171	132	132
q7	908	752	609	609
q8	9238	1373	1081	1081
q9	5853	4866	4924	4866
q10	6897	2311	1881	1881
q11	480	277	262	262
q12	347	364	215	215
q13	17756	3687	3144	3144
q14	223	226	208	208
q15	517	472	471	471
q16	616	615	584	584
q17	573	873	322	322
q18	7065	6536	6355	6355
q19	1471	986	538	538
q20	309	322	187	187
q21	2795	2190	1944	1944
q22	364	335	311	311
Total cold run time: 104935 ms
Total hot run time: 32070 ms
----- Round 2, with runtime_filter_mode=off -----
q1	5567	5521	5536	5521
q2	241	327	229	229
q3	2230	2664	2272	2272
q4	1412	1858	1367	1367
q5	4327	4727	4734	4727
q6	182	167	124	124
q7	2091	1961	1800	1800
q8	2646	2812	2721	2721
q9	7303	7169	7283	7169
q10	2965	3286	2803	2803
q11	588	507	493	493
q12	659	762	605	605
q13	3450	3944	3243	3243
q14	274	289	276	276
q15	524	484	474	474
q16	657	677	626	626
q17	1259	1764	1233	1233
q18	7694	7439	7242	7242
q19	805	1161	1083	1083
q20	2036	2048	1859	1859
q21	5661	5316	4966	4966
q22	598	569	550	550
Total cold run time: 53169 ms
Total hot run time: 51383 ms

@doris-robot

doris-robot commented Jan 27, 2025

Copy link
Copy Markdown
TPC-DS: Total hot run time: 183964 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 97d64c8aff9f579561db733e51f94a2431fce0ab, data reload: false
query1	968	375	365	365
query2	6536	1982	1990	1982
query3	6800	222	221	221
query4	33751	23299	22817	22817
query5	4295	604	445	445
query6	285	198	199	198
query7	4600	483	307	307
query8	275	233	216	216
query9	9427	2684	2677	2677
query10	460	299	244	244
query11	17807	15259	14921	14921
query12	153	105	102	102
query13	1639	519	404	404
query14	9024	6826	6528	6528
query15	219	196	187	187
query16	7970	599	478	478
query17	1609	722	585	585
query18	2067	406	299	299
query19	197	186	167	167
query20	116	108	107	107
query21	209	121	109	109
query22	4214	4191	4115	4115
query23	34172	33195	32980	32980
query24	6649	2272	2315	2272
query25	514	472	406	406
query26	1218	271	156	156
query27	2304	465	348	348
query28	5568	2460	2437	2437
query29	772	537	411	411
query30	232	182	159	159
query31	961	879	811	811
query32	82	64	59	59
query33	508	354	286	286
query34	754	848	506	506
query35	794	802	728	728
query36	983	1048	951	951
query37	138	101	84	84
query38	4055	4107	4032	4032
query39	1440	1429	1373	1373
query40	244	114	99	99
query41	52	51	57	51
query42	120	99	108	99
query43	506	534	481	481
query44	1323	813	806	806
query45	174	169	161	161
query46	852	1033	640	640
query47	1799	1840	1778	1778
query48	387	397	321	321
query49	786	496	405	405
query50	616	654	384	384
query51	4177	4183	4170	4170
query52	112	105	91	91
query53	226	254	183	183
query54	481	499	410	410
query55	103	81	79	79
query56	263	280	243	243
query57	1151	1140	1063	1063
query58	249	233	228	228
query59	2935	3104	2948	2948
query60	275	266	251	251
query61	116	112	119	112
query62	806	719	628	628
query63	215	196	187	187
query64	4496	1018	673	673
query65	3278	3174	3196	3174
query66	1056	405	305	305
query67	15828	15610	15490	15490
query68	3140	825	543	543
query69	421	304	266	266
query70	1222	1150	1120	1120
query71	377	287	252	252
query72	5938	3795	3839	3795
query73	650	748	366	366
query74	9821	8923	8812	8812
query75	3158	3102	2658	2658
query76	3046	1170	760	760
query77	476	374	279	279
query78	9920	9884	9217	9217
query79	2338	800	597	597
query80	671	514	428	428
query81	515	283	242	242
query82	241	150	121	121
query83	175	172	148	148
query84	289	91	70	70
query85	742	359	309	309
query86	395	294	275	275
query87	4609	4542	4386	4386
query88	3852	2186	2147	2147
query89	373	326	300	300
query90	1933	195	192	192
query91	133	141	109	109
query92	69	58	52	52
query93	2063	839	530	530
query94	651	400	293	293
query95	336	328	264	264
query96	496	606	283	283
query97	2762	2901	2744	2744
query98	216	197	222	197
query99	1304	1401	1276	1276
Total cold run time: 278723 ms
Total hot run time: 183964 ms

@doris-robot

doris-robot commented Jan 27, 2025

Copy link
Copy Markdown
ClickBench: Total hot run time: 30.14 s
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 97d64c8aff9f579561db733e51f94a2431fce0ab, data reload: false
query1	0.03	0.03	0.03
query2	0.07	0.03	0.04
query3	0.23	0.08	0.06
query4	1.61	0.10	0.11
query5	0.42	0.43	0.40
query6	1.16	0.66	0.65
query7	0.02	0.02	0.01
query8	0.03	0.03	0.03
query9	0.57	0.50	0.51
query10	0.55	0.56	0.55
query11	0.13	0.11	0.11
query12	0.14	0.11	0.11
query13	0.60	0.61	0.60
query14	2.81	2.71	2.83
query15	0.90	0.82	0.83
query16	0.37	0.38	0.37
query17	1.05	0.97	1.05
query18	0.22	0.20	0.20
query19	1.95	1.86	1.98
query20	0.01	0.01	0.01
query21	15.36	0.96	0.59
query22	0.74	1.01	0.66
query23	15.12	1.37	0.59
query24	3.07	0.59	1.12
query25	0.22	0.21	0.10
query26	0.30	0.15	0.13
query27	0.06	0.05	0.05
query28	13.55	1.02	0.42
query29	12.62	4.01	3.25
query30	0.24	0.09	0.06
query31	2.83	0.61	0.38
query32	3.23	0.54	0.45
query33	3.05	2.99	3.02
query34	16.49	5.11	4.53
query35	4.58	4.52	4.47
query36	0.66	0.49	0.47
query37	0.09	0.05	0.06
query38	0.05	0.03	0.03
query39	0.04	0.03	0.02
query40	0.18	0.13	0.12
query41	0.08	0.03	0.02
query42	0.04	0.03	0.02
query43	0.04	0.03	0.03
Total cold run time: 105.51 s
Total hot run time: 30.14 s

@github-actionsgithub-actionsBot added the approved Indicates a PR has been approved by one committer. label Jan 28, 2025
@github-actions

github-actionsBot commented Jan 28, 2025

Copy link
Copy Markdown
Contributor

PR approved by at least one committer and no changes requested.

@gavinchou
gavinchou merged commit fe17d16 into apache:masterJan 29, 2025
github-actionsBot pushed a commit that referenced this pull request Jan 29, 2025
@deardengYour Name
[fix](cloud) Fix async mtmv job retry when meet -230 in cloud (#47370)
bfb6c69
@github-actionsgithub-actionsBot mentioned this pull request Jan 29, 2025
Merged
dataroaring pushed a commit that referenced this pull request Feb 2, 2025
@github-actions@deardeng
branch-3.0: [fix](cloud) Fix async mtmv job retry when meet -230 in c…
35ed789
…loud #47370 (#47482)
Cherry-picked from #47370
Co-authored-by: deardeng <dengxin@selectdb.com>
@gavinchougavinchou mentioned this pull request Feb 18, 2025
Closed
lzyy2024 pushed a commit to lzyy2024/doris that referenced this pull request Feb 21, 2025
@deardeng@lzyy2024
[fix](cloud) Fix async mtmv job retry when meet -230 in cloud (apache…
d281938
…#47370)
hubgeter pushed a commit to hubgeter/doris that referenced this pull request Mar 12, 2025
@deardeng
[fix](cloud) Fix async mtmv job retry when meet -230 in cloud (apache…
1b07931
…#47370) (apache#3745)
koarz pushed a commit to koarz/doris that referenced this pull request Jun 4, 2025
@deardengkoarz
[fix](cloud) Fix async mtmv job retry when meet -230 in cloud (apache…
12e3963
…#47370)
Sign up for freeto join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

@zddrzddrzddr left review comments
@gavinchougavinchougavinchou approved these changes
+1 more reviewer
@HastyshellHastyshellHastyshell approved these changes
Reviewers whose approvals may not affect merge requirements

Assignees

No one assigned

Labels

approvedIndicates a PR has been approved by one committer.dev/3.0.4-mergedp0_breviewed

Projects

None yet

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.

7 participants

@deardeng@hello-stephen@doris-robot@dataroaring@gavinchou@zddr@Hastyshell