[fix](json) Add . after in JSON path to support correct token parsing by mrhhsg · Pull Request #52543 · apache/doris

mrhhsg · 2025-06-30T10:59:51Z

Boost tokenizer requires explicit "." after "$" to correctly extract JSON path tokens. Without this, expressions like "$[0].key" cannot be properly split, causing issues in downstream logic. This commit ensures a "." is automatically added after "$" to maintain consistent token parsing behavior.

What problem does this PR solve?

SELECT JSON_EXTRACT('[{"key": [123]}]', '$[0].key');

before:

+----------------------------------------------+
| JSON_EXTRACT('[{"key": [123]}]', '$[0].key') |
+----------------------------------------------+
| NULL |
+----------------------------------------------+

after:

+----------------------------------------------+
| JSON_EXTRACT('[{"key": [123]}]', '$[0].key') |
+----------------------------------------------+
| [123] |
+----------------------------------------------+

Problem Summary:

Release note

Check List (For Author)

Test
- Regression test
- Unit Test
- Manual test (add detailed scripts or steps below)
- No need to test or manual test. Explain why:
  - This is a refactor/code format and no logic has been changed.
  - Previous test can cover this change.
  - No code files have been changed.
  - Other reason
Behavior changed:
- No.
- Yes.
Does this need documentation?
- No.
- Yes.

Check List (For Reviewer who merge this PR)

Confirm the release note
Confirm test cases
Confirm document
Add branch pick label

mrhhsg · 2025-06-30T11:00:27Z

run buildall

Thearas · 2025-06-30T11:01:08Z

Thank you for your contribution to Apache Doris.
Don't know what should be done next? See How to process your PR.

Please clearly describe your PR:

What problem was fixed (it's best to include specific error reporting information). How it was fixed.
Which behaviors were modified. What was the previous behavior, what is it now, why was it modified, and what possible impacts might there be.
What features were added. Why was this function added?
Which code was refactored and why was this part of the code refactored?
Which functions were optimized and what is the difference before and after the optimization?

doris-robot · 2025-06-30T12:23:43Z

TPC-H: Total hot run time: 34033 ms

machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 46bab93d52953e908f99f67e68c5445a668f0a01, data reload: false
------ Round 1 ----------------------------------
q1	17604	5236	5010	5010
q2	1933	279	198	198
q3	10312	1323	766	766
q4	10221	1077	534	534
q5	7568	2408	2361	2361
q6	177	155	126	126
q7	883	741	604	604
q8	9305	1285	1110	1110
q9	6941	5137	5109	5109
q10	6888	2382	1958	1958
q11	462	289	266	266
q12	341	360	224	224
q13	17774	3712	3130	3130
q14	228	221	219	219
q15	540	471	490	471
q16	411	428	394	394
q17	581	870	352	352
q18	7464	7312	7150	7150
q19	1219	962	550	550
q20	346	350	218	218
q21	3984	2590	2351	2351
q22	1035	1014	932	932
Total cold run time: 106217 ms
Total hot run time: 34033 ms
----- Round 2, with runtime_filter_mode=off -----
q1	5092	5100	5068	5068
q2	238	324	227	227
q3	2181	2680	2302	2302
q4	1392	1763	1335	1335
q5	4210	4314	4142	4142
q6	204	162	120	120
q7	1872	1828	1669	1669
q8	2517	2497	2434	2434
q9	6829	6736	6803	6736
q10	2923	3125	2710	2710
q11	568	516	486	486
q12	628	721	603	603
q13	3305	3680	3135	3135
q14	263	299	248	248
q15	514	462	460	460
q16	437	477	419	419
q17	1123	1502	1351	1351
q18	7433	7266	6999	6999
q19	764	778	905	778
q20	1938	1969	1835	1835
q21	4809	4405	4252	4252
q22	1063	1011	998	998
Total cold run time: 50303 ms
Total hot run time: 48307 ms

doris-robot · 2025-06-30T12:35:21Z

TPC-DS: Total hot run time: 185028 ms

machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 46bab93d52953e908f99f67e68c5445a668f0a01, data reload: false
query1	1017	388	387	387
query2	6525	1696	1757	1696
query3	6738	209	206	206
query4	26261	23757	23032	23032
query5	5434	608	440	440
query6	307	216	213	213
query7	4628	496	289	289
query8	280	215	228	215
query9	8635	2648	2665	2648
query10	516	305	256	256
query11	15428	15046	14790	14790
query12	162	102	103	102
query13	1667	517	403	403
query14	9589	5682	5649	5649
query15	198	179	190	179
query16	7648	637	490	490
query17	1269	719	592	592
query18	2020	412	311	311
query19	192	208	168	168
query20	122	116	114	114
query21	214	139	110	110
query22	4239	4155	4035	4035
query23	34214	33114	33212	33114
query24	8384	2365	2381	2365
query25	554	487	427	427
query26	1238	281	153	153
query27	2726	509	338	338
query28	4328	2155	2122	2122
query29	733	548	427	427
query30	281	220	191	191
query31	924	886	788	788
query32	71	63	59	59
query33	545	363	302	302
query34	807	846	527	527
query35	812	818	726	726
query36	931	966	900	900
query37	115	96	72	72
query38	4169	4162	4063	4063
query39	1494	1419	1398	1398
query40	225	113	106	106
query41	56	53	50	50
query42	125	112	110	110
query43	487	507	463	463
query44	1301	816	813	813
query45	172	167	161	161
query46	851	1006	638	638
query47	1787	1845	1692	1692
query48	383	411	301	301
query49	728	475	383	383
query50	627	692	408	408
query51	4067	4154	4206	4154
query52	109	102	101	101
query53	228	259	183	183
query54	574	592	497	497
query55	79	77	82	77
query56	309	322	319	319
query57	1179	1178	1119	1119
query58	264	251	266	251
query59	2653	2802	2693	2693
query60	324	309	300	300
query61	124	123	124	123
query62	810	713	653	653
query63	219	190	183	183
query64	4295	1043	684	684
query65	4290	4145	4183	4145
query66	1027	407	310	310
query67	15769	15633	15412	15412
query68	8839	893	532	532
query69	499	297	262	262
query70	1211	1129	1030	1030
query71	484	319	281	281
query72	5291	4705	4721	4705
query73	698	564	340	340
query74	9220	9053	9177	9053
query75	4095	3184	2694	2694
query76	3741	1154	717	717
query77	781	411	309	309
query78	9966	10275	9368	9368
query79	3515	827	571	571
query80	656	508	448	448
query81	481	255	218	218
query82	232	124	93	93
query83	271	253	231	231
query84	292	107	86	86
query85	745	368	319	319
query86	324	316	283	283
query87	4476	4389	4311	4311
query88	2888	2243	2260	2243
query89	420	318	283	283
query90	1978	207	197	197
query91	139	137	110	110
query92	64	59	56	56
query93	2488	936	590	590
query94	672	412	290	290
query95	366	289	282	282
query96	481	572	276	276
query97	2716	2781	2717	2717
query98	231	206	200	200
query99	1420	1399	1307	1307
Total cold run time: 278157 ms
Total hot run time: 185028 ms

mrhhsg · 2025-06-30T15:19:04Z

run buildall

doris-robot · 2025-06-30T15:52:40Z

TPC-H: Total hot run time: 33896 ms

machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 566e8fcca40bab35b23519e64a8b02b9508f5da2, data reload: false
------ Round 1 ----------------------------------
q1	17598	5208	5039	5039
q2	1927	296	188	188
q3	10368	1339	684	684
q4	10256	1055	502	502
q5	8129	2401	2334	2334
q6	185	158	125	125
q7	879	732	601	601
q8	9296	1288	1174	1174
q9	6892	5145	5096	5096
q10	6879	2381	1961	1961
q11	482	287	282	282
q12	347	350	205	205
q13	17776	3741	3107	3107
q14	237	224	206	206
q15	590	486	482	482
q16	438	418	378	378
q17	595	858	358	358
q18	7694	7321	7118	7118
q19	1396	967	544	544
q20	333	346	219	219
q21	3698	2586	2315	2315
q22	1071	1039	978	978
Total cold run time: 107066 ms
Total hot run time: 33896 ms
----- Round 2, with runtime_filter_mode=off -----
q1	5170	5082	5107	5082
q2	234	324	223	223
q3	2174	2709	2307	2307
q4	1388	1780	1351	1351
q5	4198	4389	4374	4374
q6	209	173	125	125
q7	1967	1949	1799	1799
q8	2630	2590	2560	2560
q9	7091	7159	7191	7159
q10	3094	3308	2828	2828
q11	568	503	487	487
q12	701	748	605	605
q13	3501	3896	3298	3298
q14	277	319	288	288
q15	523	495	492	492
q16	447	474	424	424
q17	1156	1572	1399	1399
q18	7440	7070	7124	7070
q19	770	822	953	822
q20	1952	1983	1830	1830
q21	4858	4258	4301	4258
q22	1086	1041	998	998
Total cold run time: 51434 ms
Total hot run time: 49779 ms

doris-robot · 2025-06-30T16:04:14Z

TPC-DS: Total hot run time: 185416 ms

machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 566e8fcca40bab35b23519e64a8b02b9508f5da2, data reload: false
query1	993	385	387	385
query2	6545	1709	1757	1709
query3	6743	215	211	211
query4	26308	23854	23483	23483
query5	4313	595	456	456
query6	306	216	200	200
query7	4642	486	286	286
query8	261	227	210	210
query9	8626	2660	2651	2651
query10	466	332	268	268
query11	15354	15091	14806	14806
query12	147	106	103	103
query13	1641	507	397	397
query14	9147	5692	5569	5569
query15	211	195	190	190
query16	7325	625	481	481
query17	1180	726	567	567
query18	1985	401	298	298
query19	194	185	156	156
query20	118	114	107	107
query21	208	120	108	108
query22	4124	4218	4089	4089
query23	33924	33076	33010	33010
query24	8462	2360	2372	2360
query25	539	475	399	399
query26	1242	270	145	145
query27	2769	523	343	343
query28	4296	2113	2098	2098
query29	773	567	439	439
query30	281	215	192	192
query31	898	849	762	762
query32	69	62	56	56
query33	552	355	298	298
query34	804	841	536	536
query35	798	805	732	732
query36	953	960	873	873
query37	113	100	77	77
query38	4163	4127	4069	4069
query39	1492	1431	1411	1411
query40	212	114	104	104
query41	56	60	58	58
query42	123	107	105	105
query43	505	501	469	469
query44	1291	814	800	800
query45	174	170	167	167
query46	848	1004	629	629
query47	1736	1842	1704	1704
query48	386	406	309	309
query49	749	480	364	364
query50	632	699	404	404
query51	4133	4155	4132	4132
query52	113	113	98	98
query53	217	253	194	194
query54	572	565	502	502
query55	112	78	80	78
query56	309	296	298	296
query57	1196	1167	1113	1113
query58	262	251	259	251
query59	2684	2703	2620	2620
query60	314	319	288	288
query61	125	120	119	119
query62	801	729	656	656
query63	218	186	188	186
query64	4353	1009	751	751
query65	4274	4170	4199	4170
query66	1125	418	330	330
query67	15808	15408	15458	15408
query68	7881	901	540	540
query69	491	319	277	277
query70	1161	1089	1103	1089
query71	409	326	296	296
query72	5735	4942	4838	4838
query73	661	633	349	349
query74	8897	9217	9056	9056
query75	3184	3203	2735	2735
query76	3198	1150	732	732
query77	468	373	299	299
query78	10111	10035	9257	9257
query79	2757	838	595	595
query80	776	503	448	448
query81	470	259	217	217
query82	444	130	96	96
query83	283	252	240	240
query84	299	106	84	84
query85	795	353	313	313
query86	377	299	274	274
query87	4540	4467	4341	4341
query88	3754	2271	2260	2260
query89	387	328	330	328
query90	1905	207	212	207
query91	135	144	113	113
query92	77	58	54	54
query93	2410	944	582	582
query94	708	411	303	303
query95	371	288	283	283
query96	489	582	281	281
query97	2691	2802	2639	2639
query98	235	207	209	207
query99	1452	1394	1248	1248
Total cold run time: 273844 ms
Total hot run time: 185416 ms

doris-robot · 2025-06-30T16:09:29Z

ClickBench: Total hot run time: 29.96 s

machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 566e8fcca40bab35b23519e64a8b02b9508f5da2, data reload: false
query1	0.04	0.04	0.03
query2	0.08	0.04	0.05
query3	0.24	0.08	0.08
query4	1.61	0.11	0.11
query5	0.44	0.43	0.44
query6	1.19	0.66	0.66
query7	0.03	0.02	0.02
query8	0.05	0.04	0.04
query9	0.61	0.52	0.53
query10	0.56	0.57	0.56
query11	0.16	0.11	0.11
query12	0.16	0.12	0.12
query13	0.63	0.62	0.61
query14	0.79	0.81	0.84
query15	0.89	0.87	0.87
query16	0.40	0.38	0.39
query17	1.02	1.08	1.06
query18	0.23	0.22	0.21
query19	1.94	1.89	1.86
query20	0.02	0.01	0.02
query21	15.42	0.88	0.54
query22	0.75	1.20	0.63
query23	14.98	1.37	0.58
query24	6.66	1.12	1.27
query25	0.47	0.18	0.08
query26	0.58	0.17	0.15
query27	0.06	0.05	0.05
query28	9.35	0.92	0.42
query29	12.57	3.96	3.32
query30	0.25	0.10	0.07
query31	2.84	0.56	0.39
query32	3.25	0.55	0.48
query33	3.02	3.14	3.12
query34	16.15	5.42	4.79
query35	4.87	4.87	4.88
query36	0.73	0.50	0.49
query37	0.09	0.06	0.06
query38	0.05	0.05	0.04
query39	0.03	0.02	0.03
query40	0.17	0.14	0.14
query41	0.08	0.02	0.03
query42	0.03	0.02	0.03
query43	0.04	0.03	0.03
Total cold run time: 103.53 s
Total hot run time: 29.96 s

hello-stephen · 2025-06-30T18:07:55Z

BE UT Coverage Report

Increment line coverage 33.33% (2/6) 🎉

Increment coverage report
Complete coverage report

Category	Coverage
Function Coverage	57.05% (15345/26898)
Line Coverage	46.12% (139397/302240)
Region Coverage	45.43% (70648/155508)
Branch Coverage	40.21% (37311/92794)

mrhhsg · 2025-07-02T00:45:30Z

run buildall

doris-robot · 2025-07-02T01:21:39Z

TPC-H: Total hot run time: 33886 ms

machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit e46cde97a9a5810b24c6d3441e1fc53fae120937, data reload: false
------ Round 1 ----------------------------------
q1	17614	5137	5017	5017
q2	1936	292	197	197
q3	10319	1317	695	695
q4	10273	1021	533	533
q5	8427	2322	2343	2322
q6	178	160	130	130
q7	877	750	598	598
q8	9303	1289	1080	1080
q9	6676	5063	5109	5063
q10	6869	2381	1930	1930
q11	487	293	291	291
q12	341	349	219	219
q13	17790	3658	3079	3079
q14	229	229	216	216
q15	555	467	484	467
q16	426	417	381	381
q17	576	845	357	357
q18	7527	7240	7268	7240
q19	1557	939	531	531
q20	310	343	218	218
q21	3675	3168	2364	2364
q22	1031	986	958	958
Total cold run time: 106976 ms
Total hot run time: 33886 ms
----- Round 2, with runtime_filter_mode=off -----
q1	5112	5230	5059	5059
q2	242	313	220	220
q3	2159	2642	2297	2297
q4	1332	1750	1359	1359
q5	4190	4468	4513	4468
q6	210	164	128	128
q7	2024	1973	1862	1862
q8	2612	2466	2663	2466
q9	7245	7253	7340	7253
q10	3050	3277	2955	2955
q11	568	571	483	483
q12	647	708	607	607
q13	3286	3682	3098	3098
q14	261	273	268	268
q15	503	461	465	461
q16	411	479	445	445
q17	1088	1448	1321	1321
q18	7250	7113	7056	7056
q19	732	717	834	717
q20	1919	1958	1818	1818
q21	4784	4449	4293	4293
q22	1027	1015	985	985
Total cold run time: 50652 ms
Total hot run time: 49619 ms

doris-robot · 2025-07-02T01:33:13Z

TPC-DS: Total hot run time: 183866 ms

machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit e46cde97a9a5810b24c6d3441e1fc53fae120937, data reload: false
query1	998	402	388	388
query2	6538	1654	1615	1615
query3	6739	212	219	212
query4	26556	23721	22910	22910
query5	4375	591	466	466
query6	297	216	216	216
query7	4620	495	290	290
query8	300	222	215	215
query9	8663	2610	2649	2610
query10	482	317	287	287
query11	15690	14961	14780	14780
query12	175	104	101	101
query13	1678	524	468	468
query14	9797	5658	5675	5658
query15	219	189	184	184
query16	7639	638	468	468
query17	1260	709	605	605
query18	2054	407	307	307
query19	201	194	161	161
query20	119	126	111	111
query21	211	127	104	104
query22	4144	4198	3865	3865
query23	34015	33058	33124	33058
query24	8312	2437	2377	2377
query25	506	448	375	375
query26	1217	262	145	145
query27	2715	498	342	342
query28	4306	2120	2092	2092
query29	728	550	448	448
query30	283	220	183	183
query31	950	821	754	754
query32	72	71	67	67
query33	548	364	299	299
query34	789	859	519	519
query35	796	808	719	719
query36	911	980	881	881
query37	111	95	72	72
query38	4130	4144	4112	4112
query39	1483	1396	1416	1396
query40	208	112	100	100
query41	53	50	49	49
query42	119	102	98	98
query43	496	503	478	478
query44	1295	815	818	815
query45	175	173	160	160
query46	836	1014	627	627
query47	1744	1822	1712	1712
query48	384	419	325	325
query49	719	458	380	380
query50	627	685	416	416
query51	4104	4178	4045	4045
query52	111	109	95	95
query53	213	246	182	182
query54	579	547	486	486
query55	82	82	78	78
query56	303	314	271	271
query57	1184	1223	1134	1134
query58	255	244	251	244
query59	2633	2626	2572	2572
query60	316	306	309	306
query61	125	120	121	120
query62	816	724	680	680
query63	218	181	180	180
query64	4228	1007	652	652
query65	4244	4150	4149	4149
query66	1064	465	307	307
query67	15818	15790	15264	15264
query68	7990	914	525	525
query69	472	302	258	258
query70	1181	1145	1111	1111
query71	471	315	304	304
query72	5602	4739	4709	4709
query73	721	594	355	355
query74	8906	9171	8682	8682
query75	3841	3173	2700	2700
query76	3686	1150	713	713
query77	781	370	277	277
query78	10040	10380	9259	9259
query79	2196	825	610	610
query80	582	511	449	449
query81	485	261	226	226
query82	442	125	95	95
query83	261	312	231	231
query84	242	110	83	83
query85	787	358	321	321
query86	383	317	295	295
query87	4536	4477	4357	4357
query88	3619	2307	2307	2307
query89	373	321	292	292
query90	1866	211	210	210
query91	213	141	110	110
query92	78	61	56	56
query93	1604	960	596	596
query94	676	403	296	296
query95	375	287	290	287
query96	489	561	278	278
query97	2724	2871	2632	2632
query98	226	208	212	208
query99	1428	1394	1249	1249
Total cold run time: 274852 ms
Total hot run time: 183866 ms

doris-robot · 2025-07-02T01:38:30Z

ClickBench: Total hot run time: 30 s

machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit e46cde97a9a5810b24c6d3441e1fc53fae120937, data reload: false
query1	0.04	0.04	0.03
query2	0.09	0.04	0.05
query3	0.24	0.07	0.08
query4	1.61	0.11	0.11
query5	0.43	0.44	0.41
query6	1.19	0.67	0.66
query7	0.02	0.02	0.02
query8	0.05	0.04	0.04
query9	0.61	0.51	0.52
query10	0.56	0.56	0.56
query11	0.16	0.11	0.11
query12	0.15	0.12	0.11
query13	0.63	0.61	0.62
query14	0.82	0.82	0.86
query15	0.91	0.89	0.86
query16	0.40	0.39	0.40
query17	1.03	1.05	1.04
query18	0.23	0.22	0.22
query19	2.00	1.86	1.92
query20	0.02	0.02	0.01
query21	15.40	0.89	0.55
query22	0.75	1.12	0.70
query23	14.97	1.38	0.68
query24	6.79	1.88	1.00
query25	0.54	0.29	0.19
query26	0.64	0.16	0.14
query27	0.06	0.06	0.05
query28	9.60	0.92	0.47
query29	12.54	3.98	3.30
query30	0.25	0.09	0.07
query31	2.84	0.59	0.38
query32	3.25	0.56	0.47
query33	3.05	3.05	3.17
query34	16.15	5.40	4.78
query35	4.84	4.89	4.84
query36	0.69	0.52	0.51
query37	0.09	0.06	0.07
query38	0.06	0.04	0.03
query39	0.04	0.03	0.03
query40	0.17	0.15	0.14
query41	0.08	0.03	0.03
query42	0.03	0.03	0.02
query43	0.04	0.04	0.03
Total cold run time: 104.06 s
Total hot run time: 30 s

hello-stephen · 2025-07-02T02:46:49Z

BE UT Coverage Report

Increment line coverage 40.00% (12/30) 🎉

Increment coverage report
Complete coverage report

Category	Coverage
Function Coverage	57.06% (15357/26912)
Line Coverage	46.12% (139403/302233)
Region Coverage	45.43% (70642/155510)
Branch Coverage	40.21% (37311/92790)

Boost tokenizer requires explicit "." after "$" to correctly extract JSON path tokens. Without this, expressions like "$[0].key" cannot be properly split, causing issues in downstream logic. This commit ensures a "." is automatically added after "$" to maintain consistent token parsing behavior.

mrhhsg · 2025-07-02T08:54:21Z

run buildall

doris-robot · 2025-07-02T09:43:03Z

TPC-H: Total hot run time: 33801 ms

machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit b4213d22938c6d3047af431c6a13893c103f19c9, data reload: false
------ Round 1 ----------------------------------
q1	17627	5259	5031	5031
q2	1950	274	180	180
q3	10326	1323	743	743
q4	10256	1031	532	532
q5	7793	2360	2311	2311
q6	180	159	130	130
q7	891	754	593	593
q8	9306	1288	1020	1020
q9	6714	5002	5059	5002
q10	6946	2370	1998	1998
q11	504	320	270	270
q12	347	356	214	214
q13	17788	3703	3133	3133
q14	225	219	217	217
q15	571	477	487	477
q16	420	442	385	385
q17	603	850	358	358
q18	7666	7080	7064	7064
q19	1482	934	555	555
q20	336	352	222	222
q21	3663	3228	2389	2389
q22	1020	1019	977	977
Total cold run time: 106614 ms
Total hot run time: 33801 ms
----- Round 2, with runtime_filter_mode=off -----
q1	5159	5107	5071	5071
q2	237	320	221	221
q3	2150	2691	2272	2272
q4	1385	1783	1327	1327
q5	4176	4502	4539	4502
q6	223	173	133	133
q7	2016	2019	1826	1826
q8	2675	2659	2618	2618
q9	7303	7148	7407	7148
q10	3092	3255	2934	2934
q11	583	515	501	501
q12	714	778	634	634
q13	3796	4053	3468	3468
q14	273	290	263	263
q15	530	469	478	469
q16	461	491	455	455
q17	1193	1593	1437	1437
q18	7754	7841	7533	7533
q19	855	834	997	834
q20	2064	2032	1792	1792
q21	4873	4368	4300	4300
q22	1012	1003	1001	1001
Total cold run time: 52524 ms
Total hot run time: 50739 ms

doris-robot · 2025-07-02T09:54:33Z

TPC-DS: Total hot run time: 184454 ms

machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit b4213d22938c6d3047af431c6a13893c103f19c9, data reload: false
query1	998	397	388	388
query2	6545	1616	1623	1616
query3	6744	208	210	208
query4	26452	23597	23084	23084
query5	4382	604	446	446
query6	305	216	196	196
query7	4616	503	290	290
query8	263	223	226	223
query9	8606	2634	2632	2632
query10	487	328	272	272
query11	15755	14979	14771	14771
query12	167	107	104	104
query13	1649	539	423	423
query14	9516	5729	5836	5729
query15	205	189	185	185
query16	7655	637	450	450
query17	1197	737	588	588
query18	2022	409	308	308
query19	195	200	160	160
query20	122	116	112	112
query21	218	123	106	106
query22	4066	4079	3972	3972
query23	33814	33015	32963	32963
query24	8199	2378	2374	2374
query25	524	479	388	388
query26	716	269	155	155
query27	2647	509	343	343
query28	4161	2112	2103	2103
query29	707	546	425	425
query30	288	217	192	192
query31	932	818	769	769
query32	70	67	60	60
query33	540	357	311	311
query34	836	836	534	534
query35	821	811	743	743
query36	948	955	874	874
query37	116	100	81	81
query38	4151	4092	4021	4021
query39	1470	1435	1426	1426
query40	202	115	104	104
query41	55	53	49	49
query42	121	109	106	106
query43	501	521	461	461
query44	1352	832	815	815
query45	178	170	158	158
query46	839	1017	634	634
query47	1719	1763	1670	1670
query48	388	417	330	330
query49	679	502	375	375
query50	650	697	410	410
query51	4109	4169	4087	4087
query52	115	111	103	103
query53	229	256	192	192
query54	578	585	508	508
query55	86	80	80	80
query56	306	304	290	290
query57	1162	1162	1136	1136
query58	262	253	251	251
query59	2549	2704	2499	2499
query60	325	352	304	304
query61	126	121	145	121
query62	805	700	655	655
query63	233	188	192	188
query64	2904	1017	682	682
query65	4261	4172	4176	4172
query66	863	411	310	310
query67	15611	15582	15268	15268
query68	8383	901	525	525
query69	479	308	269	269
query70	1213	1116	1110	1110
query71	478	319	312	312
query72	5263	4719	4750	4719
query73	736	624	352	352
query74	9115	9147	8878	8878
query75	3900	3244	2712	2712
query76	3598	1151	733	733
query77	807	381	295	295
query78	10068	10342	9396	9396
query79	2349	789	596	596
query80	581	499	434	434
query81	507	263	219	219
query82	261	123	92	92
query83	243	247	241	241
query84	246	108	84	84
query85	828	357	406	357
query86	379	302	283	283
query87	4386	4459	4390	4390
query88	3645	2268	2261	2261
query89	387	313	285	285
query90	1868	207	205	205
query91	140	145	110	110
query92	70	60	54	54
query93	1754	960	576	576
query94	641	412	306	306
query95	375	289	283	283
query96	489	560	275	275
query97	2700	2783	2653	2653
query98	233	199	209	199
query99	1289	1407	1267	1267
Total cold run time: 271724 ms
Total hot run time: 184454 ms

doris-robot · 2025-07-02T09:59:50Z

ClickBench: Total hot run time: 29.64 s

machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit b4213d22938c6d3047af431c6a13893c103f19c9, data reload: false
query1	0.04	0.04	0.03
query2	0.08	0.04	0.04
query3	0.24	0.07	0.08
query4	1.60	0.11	0.11
query5	0.42	0.44	0.41
query6	1.16	0.66	0.67
query7	0.02	0.02	0.02
query8	0.05	0.03	0.03
query9	0.60	0.51	0.53
query10	0.58	0.58	0.56
query11	0.16	0.11	0.11
query12	0.15	0.12	0.11
query13	0.63	0.62	0.62
query14	0.79	0.82	0.81
query15	0.92	0.88	0.87
query16	0.38	0.40	0.39
query17	1.11	1.08	1.09
query18	0.22	0.21	0.21
query19	1.99	1.83	1.86
query20	0.02	0.01	0.02
query21	15.48	0.89	0.54
query22	0.76	1.21	0.81
query23	14.76	1.39	0.61
query24	7.21	1.25	0.90
query25	0.48	0.11	0.07
query26	0.62	0.17	0.15
query27	0.06	0.05	0.06
query28	9.24	0.89	0.46
query29	12.58	4.01	3.28
query30	0.25	0.08	0.06
query31	2.84	0.59	0.38
query32	3.24	0.56	0.47
query33	3.04	3.03	3.09
query34	16.12	5.37	4.74
query35	4.80	4.84	4.79
query36	0.69	0.50	0.48
query37	0.09	0.07	0.06
query38	0.05	0.04	0.04
query39	0.03	0.03	0.03
query40	0.17	0.15	0.14
query41	0.08	0.02	0.03
query42	0.03	0.03	0.02
query43	0.03	0.04	0.03
Total cold run time: 103.81 s
Total hot run time: 29.64 s

hello-stephen · 2025-07-02T11:37:39Z

BE UT Coverage Report

Increment line coverage 38.24% (13/34) 🎉

Increment coverage report
Complete coverage report

Category	Coverage
Function Coverage	57.14% (15390/26935)
Line Coverage	46.16% (139594/302411)
Region Coverage	45.48% (70758/155591)
Branch Coverage	40.24% (37344/92808)

eldenmoon

LGTM

…#52543) (#52544) Boost tokenizer requires explicit "." after "$" to correctly extract JSON path tokens. Without this, expressions like "$[0].key" cannot be properly split, causing issues in downstream logic. This commit ensures a "." is automatically added after "$" to maintain consistent token parsing behavior.

…apache#52543) Boost tokenizer requires explicit "." after "$" to correctly extract JSON path tokens. Without this, expressions like "$[0].key" cannot be properly split, causing issues in downstream logic. This commit ensures a "." is automatically added after "$" to maintain consistent token parsing behavior.

…#52543) (#52744) Boost tokenizer requires explicit "." after "$" to correctly extract JSON path tokens. Without this, expressions like "$[0].key" cannot be properly split, causing issues in downstream logic. This commit ensures a "." is automatically added after "$" to maintain consistent token parsing behavior. ### What problem does this PR solve? pick #52543 Issue Number: close #xxx Related PR: #52543 Problem Summary: ### Release note None ### Check List (For Author) - Test  - [ ] Regression test - [ ] Unit Test - [ ] Manual test (add detailed scripts or steps below) - [ ] No need to test or manual test. Explain why: - [ ] This is a refactor/code format and no logic has been changed. - [ ] Previous test can cover this change. - [ ] No code files have been changed. - [ ] Other reason  - Behavior changed: - [ ] No. - [ ] Yes.  - Does this need documentation? - [ ] No. - [ ] Yes.  ### Check List (For Reviewer who merge this PR) - [ ] Confirm the release note - [ ] Confirm test cases - [ ] Confirm document - [ ] Add branch pick label

…apache#52543) Boost tokenizer requires explicit "." after "$" to correctly extract JSON path tokens. Without this, expressions like "$[0].key" cannot be properly split, causing issues in downstream logic. This commit ensures a "." is automatically added after "$" to maintain consistent token parsing behavior.

…apache#52543) (apache#52744) Boost tokenizer requires explicit "." after "$" to correctly extract JSON path tokens. Without this, expressions like "$[0].key" cannot be properly split, causing issues in downstream logic. This commit ensures a "." is automatically added after "$" to maintain consistent token parsing behavior. ### What problem does this PR solve? pick apache#52543 Issue Number: close #xxx Related PR: apache#52543 Problem Summary: ### Release note None ### Check List (For Author) - Test  - [ ] Regression test - [ ] Unit Test - [ ] Manual test (add detailed scripts or steps below) - [ ] No need to test or manual test. Explain why: - [ ] This is a refactor/code format and no logic has been changed. - [ ] Previous test can cover this change. - [ ] No code files have been changed. - [ ] Other reason  - Behavior changed: - [ ] No. - [ ] Yes.  - Does this need documentation? - [ ] No. - [ ] Yes.  ### Check List (For Reviewer who merge this PR) - [ ] Confirm the release note - [ ] Confirm test cases - [ ] Confirm document - [ ] Add branch pick label

…oken parsing #52543 (#52794) pick #52543

mrhhsg added the dev/2.1.x label Jun 30, 2025

mrhhsg added the usercase Important user case type label label Jun 30, 2025

mrhhsg mentioned this pull request Jun 30, 2025
[fix](json) Add . after in JSON path to support correct token parsing (#52543) #52544
Merged
16 tasks

mrhhsg force-pushed the fix_array_path branch from 46bab93 to 566e8fcCompare June 30, 2025 15:18

yiguolei added dev/3.0.x dev/3.1.x labels Jul 1, 2025

mrhhsg force-pushed the fix_array_path branch from 566e8fc to e46cde9Compare July 2, 2025 00:45

mrhhsg force-pushed the fix_array_path branch from e46cde9 to b4213d2Compare July 2, 2025 08:54

eldenmoon approved these changes Jul 3, 2025
View reviewed changes

eldenmoon added the kind/behavior-changed label Jul 3, 2025

yiguolei approved these changes Jul 3, 2025
View reviewed changes

yiguolei closed this Jul 3, 2025

yiguolei reopened this Jul 3, 2025

yiguolei approved these changes Jul 3, 2025
View reviewed changes

Mryange approved these changes Jul 3, 2025
View reviewed changes

yiguolei merged commit f00c8a6 into apache:masterJul 3, 2025

github-actionsBot added the dev/3.0.x-conflict label Jul 3, 2025

github-actionsBot added the dev/2.1.x-conflict label Jul 3, 2025

yiguolei added dev/2.1.11-merged and removed dev/2.1.x dev/2.1.x-conflict labels Jul 3, 2025

github-actionsBot added the dev/3.1.x-conflict label Jul 3, 2025

mrhhsg mentioned this pull request Jul 3, 2025
[fix](json) Add . after in JSON path to support correct token parsing (#52543) #52744
Merged
16 tasks

mrhhsg mentioned this pull request Jul 4, 2025
branch-3.1: [fix](json) Add . after in JSON path to support correct token parsing #52543 #52794
Merged

dataroaring added dev/3.0.7-merged and removed dev/3.0.x dev/3.0.x-conflict labels Jul 7, 2025

morrySnow pushed a commit that referenced this pull request Jul 8, 2025
branch-3.1: [fix](json) Add . after in JSON path to support correct t…
0da2a00
…oken parsing #52543 (#52794) pick #52543

morrySnow added dev/3.1.0-merged and removed dev/3.1.x dev/3.1.x-conflict labels Jul 8, 2025

yiguolei mentioned this pull request Aug 11, 2025
2.1.11 Release Notes #54550
Closed

Uh oh!

Conversation

mrhhsg commented Jun 30, 2025• edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

What problem does this PR solve?

Release note

Check List (For Author)

Check List (For Reviewer who merge this PR)

Uh oh!

mrhhsg commented Jun 30, 2025

Uh oh!

Thearas commented Jun 30, 2025

Uh oh!

doris-robot commented Jun 30, 2025

Uh oh!

doris-robot commented Jun 30, 2025

Uh oh!

mrhhsg commented Jun 30, 2025

Uh oh!

doris-robot commented Jun 30, 2025

Uh oh!

doris-robot commented Jun 30, 2025

Uh oh!

doris-robot commented Jun 30, 2025

Uh oh!

hello-stephen commented Jun 30, 2025

BE UT Coverage Report

Uh oh!

mrhhsg commented Jul 2, 2025

Uh oh!

doris-robot commented Jul 2, 2025

Uh oh!

doris-robot commented Jul 2, 2025

Uh oh!

doris-robot commented Jul 2, 2025

Uh oh!

hello-stephen commented Jul 2, 2025

BE UT Coverage Report

Uh oh!

mrhhsg commented Jul 2, 2025

Uh oh!

doris-robot commented Jul 2, 2025

Uh oh!

doris-robot commented Jul 2, 2025

Uh oh!

doris-robot commented Jul 2, 2025

Uh oh!

hello-stephen commented Jul 2, 2025

BE UT Coverage Report

Uh oh!

eldenmoon left a comment

Choose a reason for hiding this comment

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

9 participants

mrhhsg commented Jun 30, 2025•
edited
Loading