[FIX](array)fix array with inverted index by amorynan · Pull Request #35926 · apache/doris

amorynan · 2024-06-05T10:07:41Z

Proposed changes

see also for branch-2.1: #35837
and master:
#34766
#35086
#34683
#34076

Issue Number: close #xxx

…e core

…n array

doris-robot · 2024-06-05T10:07:46Z

Thank you for your contribution to Apache Doris.
Don't know what should be done next? See How to process your PR

Since 2024-03-18, the Document has been moved to doris-website.
See Doris Document.

github-actions · 2024-06-05T10:14:53Z

clang-tidy review says "All clean, LGTM! 👍"

github-actions · 2024-06-05T11:06:13Z

clang-tidy review says "All clean, LGTM! 👍"

github-actions · 2024-06-05T11:12:06Z

clang-tidy review says "All clean, LGTM! 👍"

github-actions · 2024-06-05T11:31:12Z

clang-tidy review says "All clean, LGTM! 👍"

github-actions · 2024-06-05T11:53:12Z

clang-tidy review says "All clean, LGTM! 👍"

amorynan · 2024-06-05T13:25:01Z

run buildall

github-actions · 2024-06-05T13:31:46Z

clang-tidy review says "All clean, LGTM! 👍"

amorynan · 2024-06-05T13:33:00Z

run buildall

github-actions · 2024-06-05T13:39:57Z

clang-tidy review says "All clean, LGTM! 👍"

doris-robot · 2024-06-05T14:21:16Z

TPC-H: Total hot run time: 49856 ms

machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 6bf4496018c15332281f6cb1e3155f510f3993ff, data reload: false
------ Round 1 ----------------------------------
q1	17719	7115	4411	4411
q2	2127	161	151	151
q3	10586	1950	1893	1893
q4	10349	1264	1341	1264
q5	8415	3947	3998	3947
q6	261	127	126	126
q7	2061	1594	1609	1594
q8	9311	2769	2742	2742
q9	10834	10255	10309	10255
q10	8648	3510	3535	3510
q11	417	241	260	241
q12	484	306	305	305
q13	18364	3976	4042	3976
q14	363	328	327	327
q15	519	456	464	456
q16	666	569	572	569
q17	1147	968	986	968
q18	7324	6774	6919	6774
q19	1716	1645	1536	1536
q20	553	313	303	303
q21	4469	4150	4109	4109
q22	485	399	401	399
Total cold run time: 116818 ms
Total hot run time: 49856 ms
----- Round 2, with runtime_filter_mode=off -----
q1	4347	4303	4323	4303
q2	326	225	220	220
q3	4170	4213	4159	4159
q4	2786	2772	2763	2763
q5	7140	7077	7032	7032
q6	241	121	120	120
q7	3250	2866	2879	2866
q8	4364	4456	4515	4456
q9	16949	16676	16820	16676
q10	4250	4273	4244	4244
q11	765	690	690	690
q12	1013	847	835	835
q13	6873	3771	3725	3725
q14	451	435	413	413
q15	519	459	467	459
q16	753	688	689	688
q17	3871	3915	3905	3905
q18	8821	8781	8810	8781
q19	1712	1733	1690	1690
q20	2355	2149	2128	2128
q21	8559	8531	8504	8504
q22	1031	955	958	955
Total cold run time: 84546 ms
Total hot run time: 79612 ms

doris-robot · 2024-06-05T14:33:58Z

TPC-DS: Total hot run time: 202926 ms

machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 6bf4496018c15332281f6cb1e3155f510f3993ff, data reload: false
query1	944	423	384	384
query2	6545	2785	2700	2700
query3	6929	207	202	202
query4	20335	18091	17859	17859
query5	19753	6558	6565	6558
query6	291	217	222	217
query7	4164	305	310	305
query8	256	250	245	245
query9	3109	2652	2570	2570
query10	452	304	294	294
query11	11473	10674	10690	10674
query12	121	75	75	75
query13	5593	691	660	660
query14	17883	13294	13286	13286
query15	376	228	226	226
query16	6449	286	267	267
query17	1712	1466	880	880
query18	2291	409	413	409
query19	222	152	158	152
query20	81	79	90	79
query21	191	98	94	94
query22	5288	5109	5049	5049
query23	32303	31739	31996	31739
query24	7090	6584	6496	6496
query25	523	434	415	415
query26	531	158	160	158
query27	1881	298	292	292
query28	6136	2345	2286	2286
query29	2952	2820	2840	2820
query30	249	166	172	166
query31	905	770	769	769
query32	67	60	62	60
query33	401	250	256	250
query34	841	473	468	468
query35	1140	899	929	899
query36	1214	1194	1122	1122
query37	89	60	60	60
query38	3079	2946	2917	2917
query39	1368	1333	1334	1333
query40	214	94	97	94
query41	40	37	38	37
query42	83	82	81	81
query43	745	721	692	692
query44	1131	717	713	713
query45	244	232	231	231
query46	1219	942	990	942
query47	1856	1683	1713	1683
query48	1031	706	722	706
query49	614	377	367	367
query50	853	592	610	592
query51	4769	4628	4621	4621
query52	89	84	82	82
query53	441	331	331	331
query54	2632	2465	2487	2465
query55	87	77	74	74
query56	250	231	207	207
query57	1178	1300	1222	1222
query58	233	201	193	193
query59	4083	4317	3956	3956
query60	213	204	197	197
query61	96	94	93	93
query62	777	460	456	456
query63	488	339	337	337
query64	2444	1524	1434	1434
query65	3636	3530	3553	3530
query66	795	377	384	377
query67	15376	15204	16664	15204
query68	9803	633	643	633
query69	573	343	325	325
query70	1544	1330	1476	1330
query71	417	315	317	315
query72	6521	3503	3473	3473
query73	745	327	322	322
query74	6268	5817	5881	5817
query75	5297	3712	3701	3701
query76	6124	1123	1216	1123
query77	1039	259	249	249
query78	12778	11662	11713	11662
query79	7705	630	640	630
query80	1326	411	399	399
query81	487	235	232	232
query82	1649	99	95	95
query83	176	135	137	135
query84	265	70	72	70
query85	865	316	326	316
query86	337	322	322	322
query87	3226	3017	2966	2966
query88	4780	2294	2294	2294
query89	393	285	263	263
query90	1979	217	213	213
query91	183	149	141	141
query92	57	52	52	52
query93	5996	539	570	539
query94	707	212	217	212
query95	1105	1054	1042	1042
query96	630	340	313	313
query97	6437	6429	6367	6367
query98	193	178	173	173
query99	2931	941	850	850
Total cold run time: 313380 ms
Total hot run time: 202926 ms

doris-robot · 2024-06-05T14:39:24Z

ClickBench: Total hot run time: 30.42 s

machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 6bf4496018c15332281f6cb1e3155f510f3993ff, data reload: false
query1	0.02	0.02	0.02
query2	0.07	0.03	0.02
query3	0.25	0.06	0.05
query4	1.80	0.07	0.07
query5	0.53	0.52	0.52
query6	1.24	0.62	0.62
query7	0.02	0.01	0.01
query8	0.04	0.03	0.02
query9	0.52	0.51	0.48
query10	0.53	0.53	0.53
query11	0.13	0.08	0.08
query12	0.12	0.09	0.09
query13	0.62	0.62	0.61
query14	0.79	0.78	0.80
query15	0.77	0.75	0.76
query16	0.39	0.38	0.39
query17	1.02	0.98	1.02
query18	0.23	0.26	0.25
query19	1.94	1.84	1.87
query20	0.01	0.00	0.01
query21	15.47	0.58	0.56
query22	2.37	2.33	1.52
query23	17.34	0.94	0.86
query24	6.16	1.26	0.82
query25	0.37	0.06	0.10
query26	0.69	0.14	0.15
query27	0.03	0.03	0.04
query28	6.99	0.75	0.75
query29	12.68	2.31	2.26
query30	0.57	0.56	0.52
query31	2.83	0.39	0.38
query32	3.39	0.50	0.50
query33	3.08	3.05	3.09
query34	15.26	4.78	4.77
query35	4.85	4.84	4.84
query36	1.07	1.01	1.01
query37	0.06	0.05	0.05
query38	0.04	0.02	0.02
query39	0.01	0.01	0.01
query40	0.16	0.14	0.14
query41	0.07	0.01	0.01
query42	0.02	0.01	0.01
query43	0.02	0.01	0.01
Total cold run time: 104.57 s
Total hot run time: 30.42 s

doris-robot · 2024-06-05T14:42:37Z

Load test result on machine: 'aliyun_ecs.c7a.8xlarge_32C64G'

Load test result on commit 6bf4496018c15332281f6cb1e3155f510f3993ff with default session variables
Stream load json: 19 seconds loaded 2358488459 Bytes, about 118 MB/s
Stream load orc: 59 seconds loaded 1101869774 Bytes, about 17 MB/s
Stream load parquet: 31 seconds loaded 861443392 Bytes, about 26 MB/s
Insert into select: 21.2 seconds inserted 10000000 Rows, about 471K ops/s

doris-robot · 2024-06-05T14:49:52Z

TeamCity be ut coverage result:
Function Coverage: 37.80% (8094/21410)
Line Coverage: 29.48% (66130/224352)
Region Coverage: 28.94% (34082/117751)
Branch Coverage: 24.81% (17495/70502)
Coverage Report: http://coverage.selectdb-in.cc/coverage/6bf4496018c15332281f6cb1e3155f510f3993ff_6bf4496018c15332281f6cb1e3155f510f3993ff/report/index.html

amorynan · 2024-06-06T08:50:28Z

run buildall

github-actions · 2024-06-06T08:57:15Z

clang-tidy review says "All clean, LGTM! 👍"

amorynan · 2024-06-06T10:17:44Z

run buildall

doris-robot · 2024-06-06T10:36:20Z

TPC-H: Total hot run time: 49860 ms

machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 3e595133d7c74875948c28ccd60d55b7475800c7, data reload: false
------ Round 1 ----------------------------------
q1	16640	4484	4412	4412
q2	1967	167	149	149
q3	10202	1937	1939	1937
q4	10071	1241	1332	1241
q5	8469	3860	3916	3860
q6	236	129	126	126
q7	2055	1629	1646	1629
q8	9333	2769	2734	2734
q9	10849	10367	10301	10301
q10	8655	3558	3532	3532
q11	426	240	254	240
q12	476	305	306	305
q13	18252	4006	4035	4006
q14	355	320	333	320
q15	519	462	454	454
q16	653	584	578	578
q17	1121	982	972	972
q18	7285	6767	6871	6767
q19	1718	1566	1477	1477
q20	537	327	315	315
q21	4405	4198	4119	4119
q22	504	386	393	386
Total cold run time: 114728 ms
Total hot run time: 49860 ms
----- Round 2, with runtime_filter_mode=off -----
q1	4336	4333	4322	4322
q2	321	223	223	223
q3	4167	4155	4197	4155
q4	2748	2756	2742	2742
q5	7231	7146	7116	7116
q6	239	124	123	123
q7	3265	2845	2818	2818
q8	4338	4488	4511	4488
q9	16945	16708	16759	16708
q10	4273	4271	4267	4267
q11	771	683	690	683
q12	1034	842	868	842
q13	4187	3755	3722	3722
q14	464	429	428	428
q15	518	461	460	460
q16	721	687	683	683
q17	3824	3922	3885	3885
q18	8777	8810	8766	8766
q19	1706	1709	1636	1636
q20	2389	2079	2121	2079
q21	8476	8481	8551	8481
q22	1071	954	930	930
Total cold run time: 81801 ms
Total hot run time: 79557 ms

doris-robot · 2024-06-06T10:42:48Z

TeamCity be ut coverage result:
Function Coverage: 37.81% (8096/21410)
Line Coverage: 29.48% (66140/224359)
Region Coverage: 28.95% (34090/117759)
Branch Coverage: 24.81% (17495/70508)
Coverage Report: http://coverage.selectdb-in.cc/coverage/3e595133d7c74875948c28ccd60d55b7475800c7_3e595133d7c74875948c28ccd60d55b7475800c7/report/index.html

doris-robot · 2024-06-06T10:48:56Z

TPC-DS: Total hot run time: 203661 ms

machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 3e595133d7c74875948c28ccd60d55b7475800c7, data reload: false
query1	951	424	393	393
query2	6406	2991	2583	2583
query3	6922	214	200	200
query4	19865	18252	17996	17996
query5	19543	6489	6530	6489
query6	286	226	243	226
query7	4161	306	311	306
query8	269	253	236	236
query9	3064	2611	2572	2572
query10	420	314	308	308
query11	11367	10676	10766	10676
query12	122	78	80	78
query13	5577	703	684	684
query14	15812	13435	13462	13435
query15	339	220	250	220
query16	5467	293	263	263
query17	1679	1267	894	894
query18	2181	405	400	400
query19	204	152	150	150
query20	79	77	81	77
query21	180	93	95	93
query22	5264	5101	5126	5101
query23	32852	31798	31824	31798
query24	7038	6595	6535	6535
query25	536	423	442	423
query26	638	164	160	160
query27	2050	294	292	292
query28	6169	2348	2276	2276
query29	2896	2828	2770	2770
query30	246	164	168	164
query31	940	724	709	709
query32	69	66	63	63
query33	421	257	263	257
query34	849	469	469	469
query35	1114	942	930	930
query36	1418	1128	1306	1128
query37	85	58	61	58
query38	3065	2930	2982	2930
query39	1392	1343	1324	1324
query40	208	99	99	99
query41	41	37	35	35
query42	86	79	86	79
query43	661	673	674	673
query44	1138	715	705	705
query45	240	230	234	230
query46	1234	969	963	963
query47	1856	1896	1578	1578
query48	1039	733	705	705
query49	618	368	355	355
query50	872	597	630	597
query51	4760	4707	4688	4688
query52	92	73	71	71
query53	463	323	317	317
query54	2666	2462	2479	2462
query55	93	86	85	85
query56	249	226	210	210
query57	1156	1027	1011	1011
query58	223	208	197	197
query59	4021	4212	4113	4113
query60	211	201	231	201
query61	100	96	96	96
query62	820	508	482	482
query63	487	337	340	337
query64	2528	1501	1508	1501
query65	3638	3571	3617	3571
query66	834	371	375	371
query67	16631	15730	15322	15322
query68	8761	651	692	651
query69	564	332	345	332
query70	1633	1453	1361	1361
query71	412	330	331	330
query72	6538	3493	3464	3464
query73	748	318	318	318
query74	6314	5912	5877	5877
query75	5348	3734	3607	3607
query76	5348	1182	1189	1182
query77	952	246	256	246
query78	12507	11716	11770	11716
query79	7630	629	642	629
query80	1022	397	412	397
query81	490	240	237	237
query82	1481	99	100	99
query83	177	135	129	129
query84	257	72	73	72
query85	870	315	317	315
query86	339	313	310	310
query87	3237	3043	3020	3020
query88	4996	2337	2306	2306
query89	361	286	292	286
query90	1931	212	217	212
query91	174	141	139	139
query92	60	53	54	53
query93	4816	603	592	592
query94	708	211	214	211
query95	1103	1057	1064	1057
query96	655	327	328	327
query97	6454	6375	6453	6375
query98	183	174	172	172
query99	2804	1057	919	919
Total cold run time: 307774 ms
Total hot run time: 203661 ms

doris-robot · 2024-06-06T10:54:24Z

ClickBench: Total hot run time: 30.57 s

machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 3e595133d7c74875948c28ccd60d55b7475800c7, data reload: false
query1	0.02	0.02	0.02
query2	0.07	0.03	0.02
query3	0.25	0.05	0.06
query4	1.78	0.08	0.08
query5	0.53	0.53	0.52
query6	1.24	0.62	0.61
query7	0.01	0.01	0.00
query8	0.04	0.02	0.02
query9	0.52	0.49	0.48
query10	0.53	0.54	0.53
query11	0.12	0.09	0.09
query12	0.12	0.10	0.09
query13	0.62	0.62	0.61
query14	0.79	0.78	0.79
query15	0.79	0.76	0.75
query16	0.36	0.37	0.39
query17	1.02	1.00	1.02
query18	0.21	0.25	0.24
query19	1.92	1.86	1.81
query20	0.02	0.01	0.01
query21	15.50	0.61	0.54
query22	2.08	2.18	1.47
query23	17.12	1.08	0.91
query24	6.55	0.99	1.91
query25	0.40	0.12	0.05
query26	0.69	0.14	0.16
query27	0.03	0.04	0.03
query28	5.68	0.75	0.74
query29	12.57	2.30	2.36
query30	0.60	0.54	0.53
query31	2.80	0.41	0.37
query32	3.38	0.50	0.49
query33	3.09	3.06	3.08
query34	15.27	4.77	4.78
query35	4.87	4.84	4.84
query36	1.06	1.02	1.01
query37	0.06	0.04	0.05
query38	0.04	0.02	0.02
query39	0.03	0.01	0.02
query40	0.16	0.14	0.14
query41	0.07	0.02	0.02
query42	0.02	0.01	0.01
query43	0.02	0.02	0.01
Total cold run time: 103.05 s
Total hot run time: 30.57 s

doris-robot · 2024-06-06T10:57:38Z

Load test result on machine: 'aliyun_ecs.c7a.8xlarge_32C64G'

Load test result on commit 3e595133d7c74875948c28ccd60d55b7475800c7 with default session variables
Stream load json: 19 seconds loaded 2358488459 Bytes, about 118 MB/s
Stream load orc: 59 seconds loaded 1101869774 Bytes, about 17 MB/s
Stream load parquet: 31 seconds loaded 861443392 Bytes, about 26 MB/s
Insert into select: 21.3 seconds inserted 10000000 Rows, about 469K ops/s

amorynan · 2024-06-06T11:17:29Z

run feut

amorynan · 2024-06-06T11:17:36Z

run p0

amorynan · 2024-06-06T12:52:44Z

run buildall

github-actions · 2024-06-06T12:58:59Z

clang-tidy review says "All clean, LGTM! 👍"

doris-robot · 2024-06-06T13:16:53Z

TPC-H: Total hot run time: 49495 ms

machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 992c111a2b8fc85c2db6771d722566779cbe55e9, data reload: false
------ Round 1 ----------------------------------
q1	17537	4442	4348	4348
q2	2069	153	147	147
q3	10459	1888	1913	1888
q4	10341	1249	1304	1249
q5	8414	3832	3875	3832
q6	226	124	123	123
q7	2046	1645	1580	1580
q8	9544	2734	2697	2697
q9	14259	11121	10227	10227
q10	8642	3485	3512	3485
q11	410	248	247	247
q12	464	297	304	297
q13	18328	3945	4058	3945
q14	357	326	344	326
q15	508	452	460	452
q16	672	583	577	577
q17	1120	957	893	893
q18	7321	6834	6882	6834
q19	1727	1592	1601	1592
q20	525	307	301	301
q21	4343	4075	4061	4061
q22	480	394	394	394
Total cold run time: 119792 ms
Total hot run time: 49495 ms
----- Round 2, with runtime_filter_mode=off -----
q1	4299	4296	4295	4295
q2	318	226	220	220
q3	4170	4153	4126	4126
q4	2750	2725	2747	2725
q5	7132	7083	7007	7007
q6	239	121	121	121
q7	3210	2800	2826	2800
q8	4317	4423	4451	4423
q9	16872	16698	16697	16697
q10	4214	4275	4238	4238
q11	736	666	651	651
q12	1010	843	838	838
q13	6686	3722	3725	3722
q14	466	418	422	418
q15	508	462	455	455
q16	739	681	690	681
q17	3800	3819	3823	3819
q18	8742	8774	8897	8774
q19	1732	1715	1654	1654
q20	2430	2114	2115	2114
q21	8517	8457	8435	8435
q22	1044	938	936	936
Total cold run time: 83931 ms
Total hot run time: 79149 ms

doris-robot · 2024-06-06T13:21:48Z

TeamCity be ut coverage result:
Function Coverage: 37.80% (8094/21410)
Line Coverage: 29.48% (66133/224359)
Region Coverage: 28.94% (34083/117759)
Branch Coverage: 24.81% (17493/70508)
Coverage Report: http://coverage.selectdb-in.cc/coverage/992c111a2b8fc85c2db6771d722566779cbe55e9_992c111a2b8fc85c2db6771d722566779cbe55e9/report/index.html

doris-robot · 2024-06-06T13:29:38Z

TPC-DS: Total hot run time: 202737 ms

machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 992c111a2b8fc85c2db6771d722566779cbe55e9, data reload: false
query1	925	422	377	377
query2	6528	2883	2677	2677
query3	6920	209	207	207
query4	20241	18046	18095	18046
query5	19738	6495	6582	6495
query6	286	219	237	219
query7	4152	303	302	302
query8	256	244	246	244
query9	3080	2640	2562	2562
query10	401	307	296	296
query11	11401	10762	10680	10680
query12	120	77	71	71
query13	5586	675	671	671
query14	17760	13404	12941	12941
query15	365	223	227	223
query16	6462	284	264	264
query17	1711	1465	869	869
query18	2343	409	406	406
query19	206	153	150	150
query20	72	82	81	81
query21	198	95	99	95
query22	5280	5140	5032	5032
query23	32585	31951	31977	31951
query24	6964	6613	6467	6467
query25	533	436	431	431
query26	531	159	163	159
query27	1899	299	290	290
query28	6219	2342	2297	2297
query29	2868	2676	2802	2676
query30	244	166	169	166
query31	913	745	748	745
query32	66	65	58	58
query33	405	257	272	257
query34	832	464	470	464
query35	1095	937	918	918
query36	1278	1135	1226	1135
query37	90	61	61	61
query38	3056	2951	2927	2927
query39	1359	1354	1308	1308
query40	215	91	96	91
query41	40	37	37	37
query42	90	81	79	79
query43	721	666	706	666
query44	1121	700	717	700
query45	246	235	225	225
query46	1225	944	998	944
query47	2028	1750	1806	1750
query48	1025	728	707	707
query49	612	371	370	370
query50	860	625	579	579
query51	4727	4624	4663	4624
query52	87	88	80	80
query53	448	324	318	318
query54	2667	2480	2502	2480
query55	97	85	85	85
query56	241	226	197	197
query57	1191	1105	1136	1105
query58	217	211	193	193
query59	4345	4099	4230	4099
query60	224	205	205	205
query61	98	94	97	94
query62	819	474	516	474
query63	492	339	345	339
query64	2585	1524	1496	1496
query65	3617	3558	3572	3558
query66	808	377	375	375
query67	16251	15696	14869	14869
query68	9994	655	625	625
query69	583	337	352	337
query70	1760	1485	1474	1474
query71	409	310	317	310
query72	6563	3495	3478	3478
query73	743	317	314	314
query74	6403	5811	5862	5811
query75	5342	3640	3735	3640
query76	6312	1144	1192	1144
query77	1076	254	254	254
query78	12653	11704	11733	11704
query79	9364	642	634	634
query80	1222	406	415	406
query81	492	239	235	235
query82	1247	101	100	100
query83	172	130	130	130
query84	264	73	69	69
query85	867	310	308	308
query86	341	320	294	294
query87	3232	2953	3020	2953
query88	4581	2314	2302	2302
query89	480	315	271	271
query90	1960	216	213	213
query91	172	141	153	141
query92	60	53	55	53
query93	7348	551	590	551
query94	710	213	215	213
query95	1093	1078	1046	1046
query96	662	329	327	327
query97	6549	6448	6435	6435
query98	197	180	175	175
query99	3070	833	889	833
Total cold run time: 317986 ms
Total hot run time: 202737 ms

doris-robot · 2024-06-06T13:35:04Z

ClickBench: Total hot run time: 30.49 s

machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 992c111a2b8fc85c2db6771d722566779cbe55e9, data reload: false
query1	0.03	0.03	0.02
query2	0.08	0.02	0.02
query3	0.25	0.04	0.05
query4	1.79	0.06	0.06
query5	0.53	0.52	0.52
query6	1.29	0.62	0.62
query7	0.01	0.02	0.01
query8	0.03	0.02	0.02
query9	0.52	0.49	0.47
query10	0.52	0.53	0.53
query11	0.13	0.09	0.08
query12	0.12	0.09	0.10
query13	0.62	0.61	0.62
query14	0.80	0.79	0.78
query15	0.78	0.76	0.75
query16	0.35	0.39	0.36
query17	1.02	1.02	1.02
query18	0.20	0.28	0.23
query19	1.85	1.85	1.78
query20	0.02	0.01	0.01
query21	15.49	0.53	0.54
query22	2.02	2.06	1.60
query23	17.26	1.15	0.79
query24	4.89	1.10	0.97
query25	0.31	0.08	0.06
query26	0.61	0.17	0.15
query27	0.05	0.05	0.04
query28	8.19	0.77	0.74
query29	12.80	2.29	2.31
query30	0.52	0.53	0.50
query31	2.82	0.37	0.38
query32	3.38	0.49	0.49
query33	3.08	3.07	3.05
query34	15.27	4.79	4.78
query35	4.85	4.85	4.86
query36	1.06	1.01	1.02
query37	0.06	0.04	0.04
query38	0.03	0.02	0.02
query39	0.02	0.01	0.02
query40	0.16	0.14	0.14
query41	0.06	0.02	0.02
query42	0.02	0.02	0.01
query43	0.02	0.02	0.01
Total cold run time: 103.91 s
Total hot run time: 30.49 s

doris-robot · 2024-06-06T13:38:19Z

Load test result on machine: 'aliyun_ecs.c7a.8xlarge_32C64G'

Load test result on commit 992c111a2b8fc85c2db6771d722566779cbe55e9 with default session variables
Stream load json: 20 seconds loaded 2358488459 Bytes, about 112 MB/s
Stream load orc: 59 seconds loaded 1101869774 Bytes, about 17 MB/s
Stream load parquet: 31 seconds loaded 861443392 Bytes, about 26 MB/s
Insert into select: 21.2 seconds inserted 10000000 Rows, about 471K ops/s

airborne12

LGTM

github-actions · 2024-06-07T09:28:07Z

PR approved by anyone and no changes requested.

amorynan · 2024-06-12T08:33:47Z

run buildall

github-actions · 2024-06-12T08:37:25Z

clang-tidy review says "All clean, LGTM! 👍"

doris-robot · 2024-06-12T09:25:27Z

TPC-H: Total hot run time: 50192 ms

machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit f571822b7c1fea50ae8d167d62dc5c55e6a9353a, data reload: false
------ Round 1 ----------------------------------
q1	17709	6198	4389	4389
q2	2099	158	151	151
q3	10666	1940	1933	1933
q4	10426	1300	1335	1300
q5	8539	4005	3955	3955
q6	237	154	127	127
q7	2103	1622	1596	1596
q8	9387	2785	2763	2763
q9	10514	10334	10287	10287
q10	8644	3533	3507	3507
q11	412	247	254	247
q12	477	305	306	305
q13	18361	3961	3991	3961
q14	362	332	331	331
q15	518	457	461	457
q16	692	560	574	560
q17	1170	956	1011	956
q18	7185	6977	6867	6867
q19	1845	1696	1645	1645
q20	540	326	304	304
q21	4490	4141	4116	4116
q22	530	435	449	435
Total cold run time: 116906 ms
Total hot run time: 50192 ms
----- Round 2, with runtime_filter_mode=off -----
q1	4363	4332	4329	4329
q2	324	230	222	222
q3	4165	4193	4096	4096
q4	2761	2743	2747	2743
q5	7123	7024	7120	7024
q6	240	122	122	122
q7	3184	2825	2837	2825
q8	4291	4459	4434	4434
q9	16888	16704	16938	16704
q10	4234	4282	4232	4232
q11	745	658	749	658
q12	1037	853	862	853
q13	6758	3962	3708	3708
q14	441	434	424	424
q15	509	454	455	454
q16	732	689	695	689
q17	3767	3787	3831	3787
q18	8888	8712	8789	8712
q19	1765	1722	1692	1692
q20	2398	2172	2121	2121
q21	8560	8509	8473	8473
q22	1033	959	957	957
Total cold run time: 84206 ms
Total hot run time: 79259 ms

doris-robot · 2024-06-12T09:34:00Z

TeamCity be ut coverage result:
Function Coverage: 37.80% (8094/21411)
Line Coverage: 29.47% (66134/224383)
Region Coverage: 28.94% (34085/117776)
Branch Coverage: 24.81% (17496/70520)
Coverage Report: http://coverage.selectdb-in.cc/coverage/f571822b7c1fea50ae8d167d62dc5c55e6a9353a_f571822b7c1fea50ae8d167d62dc5c55e6a9353a/report/index.html

doris-robot · 2024-06-12T09:38:09Z

TPC-DS: Total hot run time: 203186 ms

machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit f571822b7c1fea50ae8d167d62dc5c55e6a9353a, data reload: false
query1	966	423	378	378
query2	6533	2711	2589	2589
query3	6918	204	199	199
query4	20303	17979	17944	17944
query5	19732	6535	6581	6535
query6	287	214	219	214
query7	4162	301	304	301
query8	461	411	444	411
query9	3085	2664	2601	2601
query10	411	309	310	309
query11	11248	10679	10673	10673
query12	126	78	75	75
query13	5591	724	671	671
query14	17588	13414	13641	13414
query15	360	246	239	239
query16	6473	283	263	263
query17	1704	1473	878	878
query18	2298	417	419	417
query19	207	149	149	149
query20	74	76	78	76
query21	191	93	93	93
query22	5206	5085	4978	4978
query23	32548	31812	31979	31812
query24	7034	6499	6475	6475
query25	531	423	425	423
query26	615	160	161	160
query27	2026	295	297	295
query28	6083	2351	2347	2347
query29	2907	2827	2853	2827
query30	249	164	163	163
query31	911	768	762	762
query32	66	62	59	59
query33	411	247	256	247
query34	829	459	467	459
query35	1094	892	915	892
query36	1274	1201	1180	1180
query37	88	63	62	62
query38	3126	2881	2868	2868
query39	1361	1323	1303	1303
query40	222	93	96	93
query41	46	44	44	44
query42	83	86	81	81
query43	781	811	676	676
query44	1151	707	705	705
query45	246	240	232	232
query46	1228	956	966	956
query47	1748	2054	2027	2027
query48	1022	724	701	701
query49	619	358	361	358
query50	854	617	587	587
query51	4815	4648	4735	4648
query52	102	73	83	73
query53	444	326	325	325
query54	2635	2437	2521	2437
query55	90	86	85	85
query56	245	219	202	202
query57	1213	1101	1060	1060
query58	215	201	196	196
query59	4170	3976	3670	3670
query60	203	206	213	206
query61	96	94	97	94
query62	761	487	511	487
query63	484	340	344	340
query64	2627	1530	1470	1470
query65	3638	3651	3586	3586
query66	825	378	371	371
query67	16139	16073	14848	14848
query68	9127	652	674	652
query69	572	344	346	344
query70	1550	1562	1874	1562
query71	415	312	320	312
query72	6500	3466	3453	3453
query73	740	314	320	314
query74	6333	5829	5837	5829
query75	5250	3677	3811	3677
query76	5663	1153	1226	1153
query77	942	258	255	255
query78	12668	11706	12014	11706
query79	7864	638	644	638
query80	1283	405	403	403
query81	491	234	231	231
query82	1672	97	94	94
query83	174	130	131	130
query84	258	72	70	70
query85	875	316	327	316
query86	337	288	290	288
query87	3223	2977	2983	2977
query88	4885	2331	2319	2319
query89	379	283	296	283
query90	1948	214	205	205
query91	173	148	141	141
query92	59	51	55	51
query93	5874	614	577	577
query94	707	209	207	207
query95	1096	1039	1047	1039
query96	646	332	342	332
query97	6465	6278	6402	6278
query98	188	180	173	173
query99	2781	927	878	878
Total cold run time: 312917 ms
Total hot run time: 203186 ms

doris-robot · 2024-06-12T09:43:35Z

ClickBench: Total hot run time: 30.8 s

machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit f571822b7c1fea50ae8d167d62dc5c55e6a9353a, data reload: false
query1	0.02	0.02	0.02
query2	0.06	0.03	0.02
query3	0.25	0.05	0.05
query4	1.80	0.07	0.07
query5	0.55	0.52	0.52
query6	1.23	0.62	0.61
query7	0.02	0.01	0.02
query8	0.03	0.02	0.02
query9	0.53	0.48	0.48
query10	0.53	0.52	0.54
query11	0.12	0.09	0.08
query12	0.12	0.09	0.08
query13	0.63	0.61	0.62
query14	0.78	0.79	0.78
query15	0.78	0.75	0.76
query16	0.37	0.39	0.37
query17	1.01	0.98	0.99
query18	0.21	0.25	0.24
query19	1.93	1.83	1.83
query20	0.02	0.01	0.01
query21	15.48	0.55	0.54
query22	2.20	2.10	1.81
query23	17.68	0.99	0.84
query24	5.06	2.03	1.17
query25	0.39	0.12	0.05
query26	0.67	0.15	0.16
query27	0.05	0.03	0.03
query28	7.10	0.73	0.71
query29	12.69	2.39	2.17
query30	0.61	0.52	0.53
query31	2.82	0.39	0.38
query32	3.39	0.49	0.49
query33	3.05	3.02	3.10
query34	15.26	4.79	4.78
query35	4.83	4.85	4.84
query36	1.05	1.01	1.02
query37	0.06	0.04	0.05
query38	0.03	0.02	0.02
query39	0.02	0.01	0.01
query40	0.16	0.14	0.14
query41	0.07	0.01	0.02
query42	0.02	0.01	0.02
query43	0.02	0.01	0.02
Total cold run time: 103.7 s
Total hot run time: 30.8 s

doris-robot · 2024-06-12T09:46:52Z

Load test result on machine: 'aliyun_ecs.c7a.8xlarge_32C64G'

Load test result on commit f571822b7c1fea50ae8d167d62dc5c55e6a9353a with default session variables
Stream load json: 20 seconds loaded 2358488459 Bytes, about 112 MB/s
Stream load orc: 59 seconds loaded 1101869774 Bytes, about 17 MB/s
Stream load parquet: 32 seconds loaded 861443392 Bytes, about 25 MB/s
Insert into select: 21.4 seconds inserted 10000000 Rows, about 467K ops/s

…pache#34683 apache#34076 (apache#35926) ## Proposed changes see also for branch-2.1: apache#35837 and master: apache#34766 apache#35086 apache#34683 apache#34076

amorynan added 2 commits June 5, 2024 17:02

fix for array inverted index writer with large dataset witch will mak…
fd4c513
…e core

delete match_element_xx and add fe config for create inverted index o…
b017368
…n array

github-actionsBot added area/nereids area/planner Issues or PRs related to the query planner kind/test labels Jun 5, 2024

amorynanand others added 2 commits June 5, 2024 18:59

delete not defined
cd38486

update inverted index format
fed9ea4

update clucene
ffcd674

fix none functions
8885519

fix code
b170d7e

format be code
6bf4496

delete hard code limit
7d1cd50

fix fe code
b1ef1fd

fix cases
992c111

airborne12 approved these changes Jun 7, 2024
View reviewed changes

github-actionsBot added the reviewed label Jun 7, 2024

xiaokang changed the title ~~[FIX](array)fix array with inverted index part~~[FIX](array)fix array with inverted indexJun 11, 2024

fix merge_on_write set true for agg table
f571822

xiaokang merged commit 0bd451d into apache:branch-2.0Jun 12, 2024

Uh oh!

Conversation

amorynan commented Jun 5, 2024

Proposed changes

Uh oh!

doris-robot commented Jun 5, 2024

Uh oh!

github-actionsBot commented Jun 5, 2024

Uh oh!

github-actionsBot commented Jun 5, 2024

Uh oh!

github-actionsBot commented Jun 5, 2024

Uh oh!

github-actionsBot commented Jun 5, 2024

Uh oh!

github-actionsBot commented Jun 5, 2024

Uh oh!

amorynan commented Jun 5, 2024

Uh oh!

github-actionsBot commented Jun 5, 2024

Uh oh!

amorynan commented Jun 5, 2024

Uh oh!

github-actionsBot commented Jun 5, 2024

Uh oh!

doris-robot commented Jun 5, 2024

Uh oh!

doris-robot commented Jun 5, 2024

Uh oh!

doris-robot commented Jun 5, 2024

Uh oh!

doris-robot commented Jun 5, 2024

Uh oh!

doris-robot commented Jun 5, 2024

Uh oh!

amorynan commented Jun 6, 2024

Uh oh!

github-actionsBot commented Jun 6, 2024

Uh oh!

amorynan commented Jun 6, 2024

Uh oh!

doris-robot commented Jun 6, 2024

Uh oh!

doris-robot commented Jun 6, 2024

Uh oh!

doris-robot commented Jun 6, 2024

Uh oh!

doris-robot commented Jun 6, 2024

Uh oh!

doris-robot commented Jun 6, 2024

Uh oh!

amorynan commented Jun 6, 2024

Uh oh!

amorynan commented Jun 6, 2024

Uh oh!

amorynan commented Jun 6, 2024

Uh oh!

github-actionsBot commented Jun 6, 2024

Uh oh!

doris-robot commented Jun 6, 2024

Uh oh!

doris-robot commented Jun 6, 2024

Uh oh!

doris-robot commented Jun 6, 2024

Uh oh!

doris-robot commented Jun 6, 2024

Uh oh!

doris-robot commented Jun 6, 2024

Uh oh!

airborne12 left a comment

Choose a reason for hiding this comment

Uh oh!

github-actionsBot commented Jun 7, 2024

Uh oh!

amorynan commented Jun 12, 2024

Uh oh!

github-actionsBot commented Jun 12, 2024

Uh oh!

doris-robot commented Jun 12, 2024

Uh oh!