Skip to content

[test] fix arrow flight regression-test 3 - #53286

Closed
xinyiZzz wants to merge 2 commits into
apache:masterfrom
xinyiZzz:20250715_fix_aarow_flight4
Closed

[test] fix arrow flight regression-test 3#53286
xinyiZzz wants to merge 2 commits into
apache:masterfrom
xinyiZzz:20250715_fix_aarow_flight4

Conversation

@xinyiZzz

@xinyiZzzxinyiZzz commented Jul 15, 2025

Copy link
Copy Markdown
Contributor

What problem does this PR solve?

Issue Number: close #xxx

Related PR: #xxx

Problem Summary:

Release note

None

Check List (For Author)

  • Test

    • Regression test
    • Unit Test
    • Manual test (add detailed scripts or steps below)
    • No need to test or manual test. Explain why:
      • This is a refactor/code format and no logic has been changed.
      • Previous test can cover this change.
      • No code files have been changed.
      • Other reason

  • Behavior changed:

    • No.
    • Yes.

  • Does this need documentation?

    • No.
    • Yes.

Check List (For Reviewer who merge this PR)

  • Confirm the release note
  • Confirm test cases
  • Confirm document
  • Add branch pick label

@xinyiZzz

xinyiZzz commented Jul 15, 2025

Copy link
Copy Markdown
ContributorAuthor

run buildall

@Thearas

Thearas commented Jul 15, 2025

Copy link
Copy Markdown
Contributor

Thank you for your contribution to Apache Doris.
Don't know what should be done next? See How to process your PR.

Please clearly describe your PR:

  1. What problem was fixed (it's best to include specific error reporting information). How it was fixed.
  2. Which behaviors were modified. What was the previous behavior, what is it now, why was it modified, and what possible impacts might there be.
  3. What features were added. Why was this function added?
  4. Which code was refactored and why was this part of the code refactored?
  5. Which functions were optimized and what is the difference before and after the optimization?

@doris-robot

doris-robot commented Jul 15, 2025

Copy link
Copy Markdown
TPC-H: Total hot run time: 33276 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 57b2471a023b748a72e4f2c7bb6bad1153322178, data reload: false
------ Round 1 ----------------------------------
q1	17552	5278	5042	5042
q2	1931	290	180	180
q3	10484	1267	733	733
q4	10255	1009	504	504
q5	8078	2392	2353	2353
q6	179	163	128	128
q7	915	753	616	616
q8	9319	1320	1007	1007
q9	7156	5094	5042	5042
q10	6890	2383	1985	1985
q11	481	299	286	286
q12	350	341	209	209
q13	17753	3682	3174	3174
q14	231	222	213	213
q15	546	495	468	468
q16	428	429	366	366
q17	586	894	369	369
q18	7629	7224	7148	7148
q19	1246	951	568	568
q20	351	332	223	223
q21	3852	3141	2363	2363
q22	360	324	299	299
Total cold run time: 106572 ms
Total hot run time: 33276 ms
----- Round 2, with runtime_filter_mode=off -----
q1	5462	5166	5485	5166
q2	247	343	224	224
q3	2156	2734	2326	2326
q4	1407	1801	1336	1336
q5	4276	4454	4425	4425
q6	213	164	124	124
q7	2033	2020	1789	1789
q8	2646	2498	2537	2498
q9	7269	7367	7167	7167
q10	3247	3310	2859	2859
q11	580	532	487	487
q12	700	805	644	644
q13	3583	4044	3361	3361
q14	278	429	403	403
q15	524	478	476	476
q16	464	494	425	425
q17	1178	1623	1329	1329
q18	8010	7894	7659	7659
q19	844	859	948	859
q20	2067	2031	1865	1865
q21	4759	4398	4392	4392
q22	620	596	539	539
Total cold run time: 52563 ms
Total hot run time: 50353 ms

@doris-robot

doris-robot commented Jul 15, 2025

Copy link
Copy Markdown
TPC-DS: Total hot run time: 187757 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 57b2471a023b748a72e4f2c7bb6bad1153322178, data reload: false
query1	1017	377	388	377
query2	6528	1723	1629	1629
query3	6744	207	210	207
query4	26371	23882	23433	23433
query5	4350	552	438	438
query6	298	212	190	190
query7	4627	496	296	296
query8	258	210	203	203
query9	8613	2584	2595	2584
query10	434	310	256	256
query11	15423	15001	14876	14876
query12	153	105	103	103
query13	1631	525	381	381
query14	8515	6029	6122	6029
query15	204	196	168	168
query16	7138	439	265	265
query17	945	710	595	595
query18	1986	412	312	312
query19	224	190	174	174
query20	124	122	122	122
query21	210	134	112	112
query22	4213	4203	4154	4154
query23	34088	33092	33241	33092
query24	8469	2325	2320	2320
query25	550	474	399	399
query26	1240	266	146	146
query27	2750	492	333	333
query28	4342	2107	2107	2107
query29	759	548	432	432
query30	289	211	194	194
query31	932	819	747	747
query32	75	64	61	61
query33	549	321	284	284
query34	808	828	514	514
query35	599	641	551	551
query36	945	1006	905	905
query37	115	103	73	73
query38	4112	4128	4040	4040
query39	1494	1430	1405	1405
query40	209	139	101	101
query41	54	54	51	51
query42	121	107	110	107
query43	496	529	477	477
query44	1298	824	802	802
query45	174	171	167	167
query46	823	1019	616	616
query47	1782	1889	1752	1752
query48	368	409	312	312
query49	733	470	384	384
query50	635	679	415	415
query51	5465	5534	5406	5406
query52	107	108	103	103
query53	221	248	183	183
query54	563	557	484	484
query55	81	78	78	78
query56	327	299	282	282
query57	1209	1193	1153	1153
query58	263	251	258	251
query59	2559	2666	2548	2548
query60	323	318	315	315
query61	153	150	149	149
query62	802	728	681	681
query63	221	193	188	188
query64	4602	1324	816	816
query65	4250	4156	4172	4156
query66	1132	409	310	310
query67	16063	15754	15696	15696
query68	7994	871	527	527
query69	507	328	268	268
query70	1165	1096	1152	1096
query71	467	315	302	302
query72	5729	4685	4898	4685
query73	725	646	347	347
query74	9195	8854	9187	8854
query75	3765	3168	2692	2692
query76	3612	1139	752	752
query77	814	374	278	278
query78	10944	11005	10424	10424
query79	2187	824	574	574
query80	628	558	438	438
query81	483	265	227	227
query82	184	131	94	94
query83	252	248	234	234
query84	299	106	81	81
query85	758	356	312	312
query86	382	295	253	253
query87	4497	4430	4345	4345
query88	3411	2277	2277	2277
query89	402	329	287	287
query90	1982	215	205	205
query91	137	137	110	110
query92	77	56	53	53
query93	2181	949	588	588
query94	634	314	197	197
query95	380	291	288	288
query96	497	573	282	282
query97	2662	2736	2660	2660
query98	249	212	211	211
query99	1327	1395	1326	1326
Total cold run time: 275682 ms
Total hot run time: 187757 ms

@doris-robot

doris-robot commented Jul 15, 2025

Copy link
Copy Markdown
ClickBench: Total hot run time: 32.19 s
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 57b2471a023b748a72e4f2c7bb6bad1153322178, data reload: false
query1	0.04	0.04	0.03
query2	0.08	0.04	0.04
query3	0.24	0.07	0.07
query4	1.63	0.11	0.11
query5	0.45	0.44	0.41
query6	1.19	0.67	0.66
query7	0.03	0.02	0.02
query8	0.04	0.03	0.03
query9	0.61	0.50	0.51
query10	0.56	0.57	0.55
query11	0.16	0.11	0.11
query12	0.15	0.11	0.12
query13	0.62	0.61	0.61
query14	0.80	0.81	0.81
query15	0.89	0.89	0.87
query16	0.41	0.37	0.39
query17	1.10	1.04	1.06
query18	0.22	0.22	0.21
query19	1.89	1.88	1.91
query20	0.02	0.01	0.01
query21	15.41	0.90	0.53
query22	0.76	1.24	0.64
query23	14.93	1.39	0.66
query24	7.26	1.23	0.50
query25	0.54	0.09	0.06
query26	0.63	0.17	0.15
query27	0.06	0.06	0.06
query28	9.92	0.92	0.46
query29	12.56	4.03	3.32
query30	3.06	2.97	2.94
query31	2.81	0.60	0.37
query32	3.23	0.54	0.48
query33	3.15	3.08	3.10
query34	16.15	5.43	4.80
query35	4.84	4.85	4.88
query36	0.70	0.51	0.50
query37	0.08	0.06	0.07
query38	0.05	0.04	0.04
query39	0.03	0.02	0.03
query40	0.18	0.14	0.14
query41	0.08	0.03	0.03
query42	0.04	0.02	0.03
query43	0.04	0.04	0.04
Total cold run time: 107.64 s
Total hot run time: 32.19 s

@xinyiZzz

xinyiZzz commented Jul 16, 2025

Copy link
Copy Markdown
ContributorAuthor

run buildall

@doris-robot

doris-robot commented Jul 16, 2025

Copy link
Copy Markdown
TPC-H: Total hot run time: 34125 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 2e5f2c9db2caa13e032242cc60be89dc49945cb4, data reload: false
------ Round 1 ----------------------------------
q1	17576	5170	5125	5125
q2	1966	287	206	206
q3	10420	1273	712	712
q4	10272	1022	525	525
q5	8070	2417	2315	2315
q6	183	159	128	128
q7	898	775	589	589
q8	9313	1330	1073	1073
q9	7201	5184	5127	5127
q10	6904	2414	1962	1962
q11	491	291	272	272
q12	345	363	211	211
q13	17766	3743	3158	3158
q14	243	240	216	216
q15	551	500	488	488
q16	441	425	381	381
q17	569	889	356	356
q18	7628	7207	7168	7168
q19	1244	957	560	560
q20	349	339	226	226
q21	3864	2573	2370	2370
q22	1078	1009	957	957
Total cold run time: 107372 ms
Total hot run time: 34125 ms
----- Round 2, with runtime_filter_mode=off -----
q1	5229	5099	5141	5099
q2	250	343	222	222
q3	2209	2703	2281	2281
q4	1364	1779	1327	1327
q5	4212	4572	4540	4540
q6	232	171	128	128
q7	2035	2043	1833	1833
q8	2642	2563	2609	2563
q9	7291	7276	7249	7249
q10	3170	3330	2921	2921
q11	567	503	506	503
q12	721	803	668	668
q13	3665	4165	3589	3589
q14	277	305	263	263
q15	526	479	496	479
q16	445	497	450	450
q17	1167	1526	1395	1395
q18	8154	8047	7585	7585
q19	810	904	1125	904
q20	2021	2038	1800	1800
q21	4835	4444	4292	4292
q22	1085	1028	990	990
Total cold run time: 52907 ms
Total hot run time: 51081 ms

@doris-robot

doris-robot commented Jul 16, 2025

Copy link
Copy Markdown
TPC-DS: Total hot run time: 187218 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 2e5f2c9db2caa13e032242cc60be89dc49945cb4, data reload: false
query1	1007	404	395	395
query2	6519	1677	1678	1677
query3	6748	214	214	214
query4	26127	23366	23468	23366
query5	4355	555	415	415
query6	295	212	196	196
query7	4630	488	283	283
query8	252	219	206	206
query9	8605	2663	2626	2626
query10	462	322	252	252
query11	15910	15119	14821	14821
query12	161	104	101	101
query13	1635	530	380	380
query14	8500	5847	5918	5847
query15	199	201	167	167
query16	7158	629	506	506
query17	1175	714	589	589
query18	1979	395	300	300
query19	202	187	163	163
query20	124	121	120	120
query21	206	123	112	112
query22	4289	4323	4226	4226
query23	34196	33275	33027	33027
query24	8467	2408	2395	2395
query25	562	501	437	437
query26	1240	285	167	167
query27	2752	518	360	360
query28	4341	2189	2160	2160
query29	801	588	483	483
query30	291	224	193	193
query31	946	855	776	776
query32	74	61	65	61
query33	585	363	327	327
query34	828	879	543	543
query35	811	839	745	745
query36	977	995	928	928
query37	111	101	92	92
query38	4335	4112	4115	4112
query39	1504	1528	1426	1426
query40	212	123	110	110
query41	63	64	61	61
query42	128	106	107	106
query43	562	522	495	495
query44	1326	817	828	817
query45	172	172	162	162
query46	848	1001	621	621
query47	1793	1884	1761	1761
query48	386	413	303	303
query49	742	470	376	376
query50	629	691	413	413
query51	5520	5509	5379	5379
query52	155	107	95	95
query53	221	247	182	182
query54	572	578	503	503
query55	81	80	78	78
query56	308	320	286	286
query57	1196	1178	1139	1139
query58	272	250	258	250
query59	2540	2630	2552	2552
query60	332	313	314	313
query61	129	128	124	124
query62	806	688	649	649
query63	224	186	192	186
query64	4395	1029	648	648
query65	4292	4202	4210	4202
query66	1166	418	355	355
query67	15900	15812	15630	15630
query68	8475	916	532	532
query69	495	308	274	274
query70	1236	1163	1118	1118
query71	462	337	294	294
query72	5597	4740	4758	4740
query73	697	593	357	357
query74	8882	8988	8735	8735
query75	3944	3212	2687	2687
query76	3650	1179	728	728
query77	790	382	286	286
query78	10190	10226	9276	9276
query79	2097	804	576	576
query80	639	519	446	446
query81	476	253	222	222
query82	453	127	101	101
query83	284	252	238	238
query84	292	107	83	83
query85	772	353	313	313
query86	347	328	304	304
query87	4458	4408	4392	4392
query88	2853	2266	2258	2258
query89	400	319	286	286
query90	1916	204	201	201
query91	145	182	109	109
query92	77	61	60	60
query93	1149	969	593	593
query94	681	399	307	307
query95	372	284	269	269
query96	490	578	277	277
query97	2744	2758	2705	2705
query98	233	210	205	205
query99	1460	1429	1256	1256
Total cold run time: 275085 ms
Total hot run time: 187218 ms

@doris-robot

doris-robot commented Jul 16, 2025

Copy link
Copy Markdown
ClickBench: Total hot run time: 32.49 s
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 2e5f2c9db2caa13e032242cc60be89dc49945cb4, data reload: false
query1	0.04	0.04	0.04
query2	0.08	0.04	0.04
query3	0.24	0.07	0.07
query4	1.64	0.11	0.11
query5	0.43	0.43	0.43
query6	1.17	0.67	0.66
query7	0.02	0.02	0.01
query8	0.04	0.03	0.04
query9	0.60	0.52	0.51
query10	0.58	0.58	0.58
query11	0.17	0.11	0.11
query12	0.16	0.12	0.12
query13	0.63	0.60	0.61
query14	0.81	0.82	0.81
query15	0.90	0.88	0.86
query16	0.38	0.40	0.41
query17	1.05	1.05	1.07
query18	0.23	0.22	0.21
query19	1.98	1.89	1.82
query20	0.01	0.00	0.01
query21	15.43	0.93	0.55
query22	0.79	1.17	0.80
query23	14.77	1.39	0.64
query24	6.95	1.81	0.58
query25	0.41	0.19	0.14
query26	0.64	0.17	0.14
query27	0.07	0.06	0.06
query28	9.16	0.90	0.45
query29	12.56	3.98	3.30
query30	3.02	2.98	2.89
query31	2.82	0.59	0.38
query32	3.24	0.54	0.46
query33	3.12	3.18	3.20
query34	16.21	5.48	4.81
query35	4.89	4.88	4.82
query36	0.67	0.53	0.49
query37	0.09	0.06	0.07
query38	0.06	0.05	0.04
query39	0.04	0.02	0.02
query40	0.17	0.14	0.14
query41	0.08	0.03	0.03
query42	0.03	0.02	0.02
query43	0.04	0.03	0.03
Total cold run time: 106.42 s
Total hot run time: 32.49 s

@xinyiZzz

xinyiZzz commented Jul 21, 2025

Copy link
Copy Markdown
ContributorAuthor

run p0

@xinyiZzz
xinyiZzzforce-pushed the 20250715_fix_aarow_flight4 branch from 2e5f2c9 to 2e493a2CompareJuly 21, 2025 13:24
@morningmanmorningman mentioned this pull request Jul 15, 2026
Open
63 tasks
Sign up for freeto join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

No reviews

Assignees

No one assigned

Labels

None yet

Projects

None yet

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.

3 participants

@xinyiZzz@Thearas@doris-robot