[fix](third-party) enable keepalive on socket created by libevent by dataroaring · Pull Request #35805 · apache/doris

dataroaring · 2024-06-03T09:21:21Z

Proposed changes

We encounter a problem that tcp connections created by libevent is in established while there is no corresponding endpoint in the other endpoint. So we enable keepalive to recycle the tcp connection.

doris-robot · 2024-06-03T09:21:26Z

Thank you for your contribution to Apache Doris.
Don't know what should be done next? See How to process your PR

Since 2024-03-18, the Document has been moved to doris-website.
See Doris Document.

dataroaring · 2024-06-03T09:22:14Z

run buildall

doris-robot · 2024-06-03T09:39:54Z

TPC-H: Total hot run time: 41048 ms

machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 84da644d3a4f83e239ef5386e69656a55bc816c7, data reload: false
------ Round 1 ----------------------------------
q1	17875	4518	4441	4441
q2	2559	208	221	208
q3	10871	1336	1195	1195
q4	11119	866	833	833
q5	8125	2746	2706	2706
q6	231	142	148	142
q7	988	631	612	612
q8	9255	2098	2127	2098
q9	9080	6450	6481	6450
q10	8974	3777	3757	3757
q11	466	248	247	247
q12	433	240	240	240
q13	18832	2998	3023	2998
q14	268	228	219	219
q15	515	492	463	463
q16	523	387	381	381
q17	985	723	714	714
q18	7980	7332	7370	7332
q19	7962	1461	1464	1461
q20	672	316	312	312
q21	4883	4010	3906	3906
q22	392	340	333	333
Total cold run time: 122988 ms
Total hot run time: 41048 ms
----- Round 2, with runtime_filter_mode=off -----
q1	4395	4240	4258	4240
q2	368	265	261	261
q3	3005	2775	2789	2775
q4	1865	1647	1638	1638
q5	5252	5259	5240	5240
q6	221	130	131	130
q7	2149	1713	1731	1713
q8	3187	3301	3322	3301
q9	8379	8311	8310	8310
q10	3926	3674	3687	3674
q11	580	492	489	489
q12	760	588	620	588
q13	16765	2994	3016	2994
q14	298	276	271	271
q15	513	472	476	472
q16	481	414	416	414
q17	1766	1491	1475	1475
q18	7542	7464	7440	7440
q19	1777	1623	1673	1623
q20	1989	1792	1791	1791
q21	4962	4821	4708	4708
q22	645	542	527	527
Total cold run time: 70825 ms
Total hot run time: 54074 ms

doris-robot · 2024-06-03T09:50:52Z

TPC-DS: Total hot run time: 170444 ms

machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 84da644d3a4f83e239ef5386e69656a55bc816c7, data reload: false
query1	926	376	371	371
query2	6444	2404	2370	2370
query3	6651	210	209	209
query4	20345	17283	17399	17283
query5	4140	465	472	465
query6	259	162	157	157
query7	4595	305	299	299
query8	341	295	279	279
query9	8553	2439	2408	2408
query10	463	310	298	298
query11	10664	10034	10134	10034
query12	150	92	95	92
query13	1652	378	372	372
query14	10290	7708	7337	7337
query15	252	186	186	186
query16	7920	290	277	277
query17	1811	536	541	536
query18	1945	279	268	268
query19	208	167	163	163
query20	95	91	88	88
query21	220	126	130	126
query22	4676	4149	4044	4044
query23	33633	33013	33223	33013
query24	11859	2821	2840	2821
query25	670	357	364	357
query26	1756	158	158	158
query27	3008	323	330	323
query28	7434	2105	2073	2073
query29	1026	605	601	601
query30	294	148	155	148
query31	963	733	723	723
query32	95	55	57	55
query33	764	294	291	291
query34	959	490	478	478
query35	770	611	617	611
query36	1073	924	925	924
query37	195	71	73	71
query38	2875	2739	2743	2739
query39	890	795	802	795
query40	283	129	126	126
query41	53	52	53	52
query42	119	96	98	96
query43	580	539	538	538
query44	1197	728	757	728
query45	200	165	176	165
query46	1091	748	717	717
query47	1856	1740	1744	1740
query48	380	293	289	289
query49	1178	422	419	419
query50	794	408	399	399
query51	6919	6739	6748	6739
query52	104	100	94	94
query53	360	293	296	293
query54	927	457	453	453
query55	74	73	74	73
query56	285	268	262	262
query57	1125	1024	1031	1024
query58	280	255	258	255
query59	3491	3019	3341	3019
query60	333	280	269	269
query61	91	92	89	89
query62	648	435	445	435
query63	326	305	287	287
query64	9952	2255	1711	1711
query65	3177	3068	3115	3068
query66	1349	334	336	334
query67	15426	15052	15132	15052
query68	5374	562	551	551
query69	617	454	394	394
query70	1215	1120	1115	1115
query71	441	295	292	292
query72	7449	2706	2521	2521
query73	823	327	319	319
query74	5963	5503	5524	5503
query75	3787	2669	2644	2644
query76	3252	871	935	871
query77	660	312	291	291
query78	10551	9851	9715	9715
query79	1980	528	518	518
query80	1103	492	475	475
query81	566	218	220	218
query82	759	106	102	102
query83	209	172	170	170
query84	271	89	90	89
query85	1412	293	286	286
query86	467	295	299	295
query87	3257	3088	3104	3088
query88	3866	2357	2371	2357
query89	489	394	395	394
query90	1813	198	198	198
query91	137	113	178	113
query92	58	49	52	49
query93	1857	520	506	506
query94	1193	203	186	186
query95	417	317	317	317
query96	588	268	274	268
query97	3178	2991	3043	2991
query98	251	217	220	217
query99	1376	822	851	822
Total cold run time: 278841 ms
Total hot run time: 170444 ms

doris-robot · 2024-06-03T09:52:19Z

TeamCity be ut coverage result:
Function Coverage: 36.29% (9240/25460)
Line Coverage: 27.66% (75862/274277)
Region Coverage: 26.89% (39310/146195)
Branch Coverage: 23.61% (19918/84362)
Coverage Report: http://coverage.selectdb-in.cc/coverage/84da644d3a4f83e239ef5386e69656a55bc816c7_84da644d3a4f83e239ef5386e69656a55bc816c7/report/index.html

doris-robot · 2024-06-03T09:56:24Z

ClickBench: Total hot run time: 30.72 s

machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 84da644d3a4f83e239ef5386e69656a55bc816c7, data reload: false
query1	0.04	0.03	0.04
query2	0.09	0.04	0.04
query3	0.23	0.06	0.05
query4	1.64	0.09	0.09
query5	0.51	0.47	0.51
query6	1.14	0.73	0.72
query7	0.02	0.01	0.02
query8	0.05	0.04	0.04
query9	0.54	0.48	0.49
query10	0.53	0.55	0.55
query11	0.16	0.11	0.12
query12	0.15	0.13	0.12
query13	0.59	0.58	0.60
query14	0.77	0.77	0.79
query15	0.84	0.82	0.80
query16	0.36	0.37	0.38
query17	0.97	1.04	1.04
query18	0.22	0.28	0.25
query19	1.92	1.75	1.72
query20	0.02	0.01	0.02
query21	15.70	0.66	0.65
query22	4.13	6.98	2.06
query23	18.26	1.41	1.28
query24	2.11	0.23	0.20
query25	0.15	0.09	0.08
query26	0.27	0.18	0.18
query27	0.08	0.08	0.08
query28	13.24	1.03	1.02
query29	13.16	3.34	3.29
query30	0.24	0.06	0.05
query31	2.88	0.39	0.37
query32	3.25	0.50	0.46
query33	2.87	2.93	2.86
query34	16.86	4.38	4.37
query35	4.47	4.43	4.47
query36	0.66	0.48	0.47
query37	0.18	0.16	0.16
query38	0.16	0.15	0.15
query39	0.05	0.04	0.04
query40	0.17	0.14	0.15
query41	0.09	0.04	0.05
query42	0.06	0.05	0.05
query43	0.04	0.04	0.04
Total cold run time: 109.87 s
Total hot run time: 30.72 s

github-actions · 2024-06-03T12:00:24Z

PR approved by anyone and no changes requested.

morningman

LGTM

github-actions · 2024-06-04T01:55:47Z

PR approved by at least one committer and no changes requested.

…5805) We encounter a problem that tcp connections created by libevent is in established while there is no corresponding endpoint in the other endpoint. So we enable keepalive to recycle the tcp connection.