branch-2.0 [fix](arrow) fix arrow parquet writer exception handling - #50191

Merged
morningman merged 3 commits into
apache:branch-2.0from
morningman:arrow_patch
Apr 19, 2025
Merged

branch-2.0 [fix](arrow) fix arrow parquet writer exception handling#50191
morningman merged 3 commits into
apache:branch-2.0from
morningman:arrow_patch

Conversation

@morningman

@morningmanmorningman commented Apr 19, 2025

Copy link
Copy Markdown
Contributor

@Thearas

Thearas commented Apr 19, 2025

Copy link
Copy Markdown
Contributor

Thank you for your contribution to Apache Doris.
Don't know what should be done next? See How to process your PR.

Please clearly describe your PR:

  1. What problem was fixed (it's best to include specific error reporting information). How it was fixed.
  2. Which behaviors were modified. What was the previous behavior, what is it now, why was it modified, and what possible impacts might there be.
  3. What features were added. Why was this function added?
  4. Which code was refactored and why was this part of the code refactored?
  5. Which functions were optimized and what is the difference before and after the optimization?

@morningman

morningman commented Apr 19, 2025

Copy link
Copy Markdown
ContributorAuthor

run buildall

@morningmanmorningman reopened this Apr 19, 2025
@doris-robot

doris-robot commented Apr 19, 2025

Copy link
Copy Markdown
TPC-H: Total hot run time: 49087 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 8bcc2f06f0b178ed05664b110e66d0cc19c75e09, data reload: false
------ Round 1 ----------------------------------
q1	17647	4404	4349	4349
q2	2127	151	143	143
q3	10515	1919	1974	1919
q4	10273	1268	1324	1268
q5	8539	3885	3885	3885
q6	233	122	123	122
q7	2052	1629	1584	1584
q8	9277	2722	2710	2710
q9	10187	9786	9774	9774
q10	8664	3532	3547	3532
q11	428	238	254	238
q12	474	300	309	300
q13	18366	3941	4024	3941
q14	343	335	332	332
q15	519	461	464	461
q16	558	449	467	449
q17	1130	952	911	911
q18	7266	6799	6902	6799
q19	1687	1581	1587	1581
q20	528	320	288	288
q21	4349	4168	4102	4102
q22	488	401	399	399
Total cold run time: 115650 ms
Total hot run time: 49087 ms
----- Round 2, with runtime_filter_mode=off -----
q1	4317	4335	4277	4277
q2	327	222	232	222
q3	4166	4148	4131	4131
q4	2758	2750	2745	2745
q5	7190	7143	7102	7102
q6	237	120	118	118
q7	3214	2906	2873	2873
q8	4334	4500	4490	4490
q9	13615	13544	13558	13544
q10	4287	4283	4275	4275
q11	745	673	717	673
q12	1041	878	858	858
q13	7002	3783	3741	3741
q14	453	432	433	432
q15	496	452	453	452
q16	631	580	592	580
q17	3838	3856	3822	3822
q18	8923	8694	8762	8694
q19	1702	1674	1669	1669
q20	2333	2146	2096	2096
q21	8461	8450	8509	8450
q22	1003	948	953	948
Total cold run time: 81073 ms
Total hot run time: 76192 ms

@doris-robot

doris-robot commented Apr 19, 2025

Copy link
Copy Markdown

BE UT Coverage Report

Increment line coverage 🎉

Increment coverage report
Complete coverage report

CategoryCoverage
Function Coverage38.57% (8314/21555)
Line Coverage30.27% (68775/227210)
Region Coverage29.69% (35418/119274)
Branch Coverage25.45% (18207/71528)

@doris-robot

doris-robot commented Apr 19, 2025

Copy link
Copy Markdown
TPC-DS: Total hot run time: 212093 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 8bcc2f06f0b178ed05664b110e66d0cc19c75e09, data reload: false
query1	966	391	381	381
query2	6554	2057	2229	2057
query3	6914	202	204	202
query4	23909	21668	21252	21252
query5	19734	6496	6488	6488
query6	290	218	244	218
query7	4335	295	299	295
query8	251	269	256	256
query9	3099	2684	2566	2566
query10	470	302	302	302
query11	15753	15158	15061	15061
query12	135	77	75	75
query13	1041	465	437	437
query14	18016	13608	13623	13608
query15	375	221	243	221
query16	6485	279	282	279
query17	1919	899	898	898
query18	902	314	315	314
query19	227	155	150	150
query20	109	97	99	97
query21	197	102	92	92
query22	5331	5221	5091	5091
query23	34338	33422	33566	33422
query24	7817	6298	6259	6259
query25	543	446	427	427
query26	1275	165	161	161
query27	2391	299	293	293
query28	6130	2333	2280	2280
query29	2915	2882	2743	2743
query30	243	167	162	162
query31	944	748	775	748
query32	73	59	58	58
query33	450	268	265	265
query34	863	473	478	473
query35	1135	951	915	915
query36	1277	1197	1110	1110
query37	173	61	60	60
query38	3077	2918	2893	2893
query39	1364	1311	1330	1311
query40	320	95	89	89
query41	40	37	37	37
query42	86	90	78	78
query43	614	631	561	561
query44	1147	714	725	714
query45	240	227	227	227
query46	1214	951	933	933
query47	1867	2057	1780	1780
query48	494	411	413	411
query49	648	374	412	374
query50	873	589	599	589
query51	4753	4639	4685	4639
query52	88	81	89	81
query53	231	180	194	180
query54	2668	2436	2484	2436
query55	93	90	85	85
query56	227	212	212	212
query57	1289	1183	1137	1137
query58	216	228	213	213
query59	3476	3377	3498	3377
query60	218	208	205	205
query61	95	104	93	93
query62	821	496	526	496
query63	196	177	173	173
query64	3372	1591	1518	1518
query65	3613	3553	3538	3538
query66	766	386	406	386
query67	15257	15899	14852	14852
query68	10769	635	656	635
query69	530	269	275	269
query70	1715	1299	1424	1299
query71	424	313	329	313
query72	6796	4758	4739	4739
query73	764	319	322	319
query74	6324	5825	5843	5825
query75	5433	3770	3709	3709
query76	6298	1114	1176	1114
query77	1044	254	266	254
query78	12630	11677	11707	11677
query79	7135	641	636	636
query80	1488	393	404	393
query81	493	239	237	237
query82	1614	100	97	97
query83	167	137	140	137
query84	260	71	68	68
query85	877	311	308	308
query86	345	331	312	312
query87	3252	3024	3007	3007
query88	4385	2311	2309	2309
query89	491	322	306	306
query90	1960	215	215	215
query91	155	124	126	124
query92	61	54	50	50
query93	7020	595	590	590
query94	711	211	212	211
query95	2008	1934	2030	1934
query96	647	319	327	319
query97	6503	6395	6302	6302
query98	226	207	197	197
query99	3091	854	880	854
Total cold run time: 322558 ms
Total hot run time: 212093 ms

@doris-robot

doris-robot commented Apr 19, 2025

Copy link
Copy Markdown
ClickBench: Total hot run time: 30.61 s
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 8bcc2f06f0b178ed05664b110e66d0cc19c75e09, data reload: false
query1	0.03	0.03	0.03
query2	0.07	0.02	0.03
query3	0.25	0.05	0.04
query4	1.77	0.07	0.06
query5	0.54	0.53	0.52
query6	1.24	0.62	0.61
query7	0.01	0.02	0.01
query8	0.03	0.02	0.02
query9	0.52	0.49	0.49
query10	0.53	0.52	0.53
query11	0.12	0.09	0.09
query12	0.12	0.08	0.09
query13	0.62	0.61	0.61
query14	0.78	0.78	0.80
query15	0.78	0.76	0.76
query16	0.36	0.39	0.36
query17	1.02	1.04	1.02
query18	0.21	0.27	0.23
query19	1.93	1.87	1.86
query20	0.02	0.01	0.00
query21	15.45	0.54	0.55
query22	2.14	2.94	1.59
query23	17.19	0.98	0.91
query24	6.36	1.05	1.34
query25	0.36	0.05	0.06
query26	0.74	0.16	0.15
query27	0.04	0.04	0.04
query28	6.43	0.74	0.71
query29	12.71	2.10	2.31
query30	0.57	0.54	0.53
query31	2.81	0.38	0.37
query32	3.37	0.50	0.49
query33	3.09	3.07	3.09
query34	15.25	4.81	4.80
query35	4.86	4.83	4.88
query36	1.07	1.02	1.03
query37	0.06	0.04	0.05
query38	0.04	0.02	0.02
query39	0.03	0.01	0.02
query40	0.16	0.14	0.14
query41	0.07	0.01	0.01
query42	0.02	0.01	0.02
query43	0.02	0.02	0.02
Total cold run time: 103.79 s
Total hot run time: 30.61 s

@doris-robot

doris-robot commented Apr 19, 2025

Copy link
Copy Markdown

Load test result on machine: 'aliyun_ecs.c7a.8xlarge_32C64G'

Load test result on commit 8bcc2f06f0b178ed05664b110e66d0cc19c75e09 with default session variables
Stream load json: 20 seconds loaded 2358488459 Bytes, about 112 MB/s
Stream load orc: 58 seconds loaded 1101869774 Bytes, about 18 MB/s
Stream load parquet: 31 seconds loaded 861443392 Bytes, about 26 MB/s
Insert into select: 22.1 seconds inserted 10000000 Rows, about 452K ops/s

@github-actions

github-actionsBot commented Apr 19, 2025

Copy link
Copy Markdown
Contributor

PR approved by anyone and no changes requested.

@github-actionsgithub-actionsBot added the approved Indicates a PR has been approved by one committer. label Apr 19, 2025
@github-actions

github-actionsBot commented Apr 19, 2025

Copy link
Copy Markdown
Contributor

PR approved by at least one committer and no changes requested.

@morningman

morningman commented Apr 19, 2025

Copy link
Copy Markdown
ContributorAuthor

run feut

@morningman

morningman commented Apr 19, 2025

Copy link
Copy Markdown
ContributorAuthor

run beut

kaka11chen
kaka11chen approved these changes Apr 19, 2025
View reviewed changes

@kaka11chenkaka11chen left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

@morningman
morningman merged commit e1513de into apache:branch-2.0Apr 19, 2025
@morningmanmorningman added the dev/2.0.16-merged-deprecated 2.0.16 is NOT and will NOT be released label Apr 19, 2025
@CalvinKirs

CalvinKirs commented Mar 5, 2026•
edited
Loading

Copy link
Copy Markdown
Member

#35142

Sign up for freeto join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

@kaka11chenkaka11chenkaka11chen approved these changes
@CalvinKirsCalvinKirsCalvinKirs approved these changes
@wuwenchiwuwenchiwuwenchi approved these changes

Assignees

No one assigned

Labels

approvedIndicates a PR has been approved by one committer.dev/2.0.16-merged-deprecated2.0.16 is NOT and will NOT be releasedreviewed

Projects

None yet

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.

6 participants

@morningman@Thearas@doris-robot@CalvinKirs@kaka11chen@wuwenchi
, 'i'); if (__m === '*' || __re.test(location.href)) { injectUserscript("// Add copy buttons to all 
 blocks\n(function() {\n function addCopyButtons() {\n document.querySelectorAll('pre code').forEach(function(codeBlock) {\n if (codeBlock.parentElement.hasAttribute('data-copy-added')) return;\n codeBlock.parentElement.setAttribute('data-copy-added', 'true');\n \n var btn = document.createElement('button');\n btn.textContent = 'Copy';\n btn.style.cssText = 'position:absolute;top:4px;right:4px;padding:2px 8px;font-size:11px;background:#4ecdc4;border:none;border-radius:4px;color:#1a1a2e;cursor:pointer;opacity:0.7;transition:opacity 0.2s;';\n btn.onmouseover = function() { this.style.opacity = '1'; };\n btn.onmouseout = function() { this.style.opacity = '0.7'; };\n btn.onclick = function() {\n navigator.clipboard.writeText(codeBlock.textContent).then(function() {\n btn.textContent = 'Copied!';\n setTimeout(function() { btn.textContent = 'Copy'; }, 1500);\n });\n };\n codeBlock.parentElement.style.position = 'relative';\n codeBlock.parentElement.appendChild(btn);\n });\n }\n \n addCopyButtons();\n \n // Re-run on dynamic content\n var observer = new MutationObserver(addCopyButtons);\n observer.observe(document.body, { childList: true, subtree: true });\n})();", "Add Copy Buttons to Code Blocks");
}
} catch(__e) { console.warn('[Userscript:Add Copy Buttons to Code Blocks]', __e); }
})();
(function(){
try {
var __m = "github.com";
var __re = new RegExp('^' + "github\\.com" + '

Skip to content
branch-2.0 [fix](arrow) fix arrow parquet writer exception handling - #50191
Merged
morningman merged 3 commits into
apache:branch-2.0from 
morningman:arrow_patch
Apr 19, 2025
Merged
branch-2.0 [fix](arrow) fix arrow parquet writer exception handling#50191
morningman merged 3 commits into
apache:branch-2.0from 
morningman:arrow_patch
Conversation
@morningman
@morningmanmorningman
commented
Apr 19, 2025

Copy link


Copy Markdown

Contributor
@Thearas
Thearas
commented
Apr 19, 2025

Copy link


Copy Markdown

Contributor
Thank you for your contribution to Apache Doris.

Don't know what should be done next? See How to process your PR.
Please clearly describe your PR:
  1. What problem was fixed (it's best to include specific error reporting information). How it was fixed.
  2. Which behaviors were modified. What was the previous behavior, what is it now, why was it modified, and what possible impacts might there be.
  3. What features were added. Why was this function added?
  4. Which code was refactored and why was this part of the code refactored?
  5. Which functions were optimized and what is the difference before and after the optimization?
@morningman
morningman
commented
Apr 19, 2025

Copy link


Copy Markdown

ContributorAuthor
run buildall
@morningmanmorningman
reopened this
Apr 19, 2025
@doris-robot
doris-robot
commented
Apr 19, 2025

Copy link


Copy Markdown

TPC-H: Total hot run time: 49087 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 8bcc2f06f0b178ed05664b110e66d0cc19c75e09, data reload: false
------ Round 1 ----------------------------------
q1	17647	4404	4349	4349
q2	2127	151	143	143
q3	10515	1919	1974	1919
q4	10273	1268	1324	1268
q5	8539	3885	3885	3885
q6	233	122	123	122
q7	2052	1629	1584	1584
q8	9277	2722	2710	2710
q9	10187	9786	9774	9774
q10	8664	3532	3547	3532
q11	428	238	254	238
q12	474	300	309	300
q13	18366	3941	4024	3941
q14	343	335	332	332
q15	519	461	464	461
q16	558	449	467	449
q17	1130	952	911	911
q18	7266	6799	6902	6799
q19	1687	1581	1587	1581
q20	528	320	288	288
q21	4349	4168	4102	4102
q22	488	401	399	399
Total cold run time: 115650 ms
Total hot run time: 49087 ms
----- Round 2, with runtime_filter_mode=off -----
q1	4317	4335	4277	4277
q2	327	222	232	222
q3	4166	4148	4131	4131
q4	2758	2750	2745	2745
q5	7190	7143	7102	7102
q6	237	120	118	118
q7	3214	2906	2873	2873
q8	4334	4500	4490	4490
q9	13615	13544	13558	13544
q10	4287	4283	4275	4275
q11	745	673	717	673
q12	1041	878	858	858
q13	7002	3783	3741	3741
q14	453	432	433	432
q15	496	452	453	452
q16	631	580	592	580
q17	3838	3856	3822	3822
q18	8923	8694	8762	8694
q19	1702	1674	1669	1669
q20	2333	2146	2096	2096
q21	8461	8450	8509	8450
q22	1003	948	953	948
Total cold run time: 81073 ms
Total hot run time: 76192 ms

@doris-robot
doris-robot
commented
Apr 19, 2025

Copy link


Copy Markdown

BE UT Coverage Report
Increment line coverage  🎉
Increment coverage report
Complete coverage report
CategoryCoverage
Function Coverage38.57% (8314/21555)
Line Coverage30.27% (68775/227210)
Region Coverage29.69% (35418/119274)
Branch Coverage25.45% (18207/71528)
@doris-robot
doris-robot
commented
Apr 19, 2025

Copy link


Copy Markdown

TPC-DS: Total hot run time: 212093 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 8bcc2f06f0b178ed05664b110e66d0cc19c75e09, data reload: false
query1	966	391	381	381
query2	6554	2057	2229	2057
query3	6914	202	204	202
query4	23909	21668	21252	21252
query5	19734	6496	6488	6488
query6	290	218	244	218
query7	4335	295	299	295
query8	251	269	256	256
query9	3099	2684	2566	2566
query10	470	302	302	302
query11	15753	15158	15061	15061
query12	135	77	75	75
query13	1041	465	437	437
query14	18016	13608	13623	13608
query15	375	221	243	221
query16	6485	279	282	279
query17	1919	899	898	898
query18	902	314	315	314
query19	227	155	150	150
query20	109	97	99	97
query21	197	102	92	92
query22	5331	5221	5091	5091
query23	34338	33422	33566	33422
query24	7817	6298	6259	6259
query25	543	446	427	427
query26	1275	165	161	161
query27	2391	299	293	293
query28	6130	2333	2280	2280
query29	2915	2882	2743	2743
query30	243	167	162	162
query31	944	748	775	748
query32	73	59	58	58
query33	450	268	265	265
query34	863	473	478	473
query35	1135	951	915	915
query36	1277	1197	1110	1110
query37	173	61	60	60
query38	3077	2918	2893	2893
query39	1364	1311	1330	1311
query40	320	95	89	89
query41	40	37	37	37
query42	86	90	78	78
query43	614	631	561	561
query44	1147	714	725	714
query45	240	227	227	227
query46	1214	951	933	933
query47	1867	2057	1780	1780
query48	494	411	413	411
query49	648	374	412	374
query50	873	589	599	589
query51	4753	4639	4685	4639
query52	88	81	89	81
query53	231	180	194	180
query54	2668	2436	2484	2436
query55	93	90	85	85
query56	227	212	212	212
query57	1289	1183	1137	1137
query58	216	228	213	213
query59	3476	3377	3498	3377
query60	218	208	205	205
query61	95	104	93	93
query62	821	496	526	496
query63	196	177	173	173
query64	3372	1591	1518	1518
query65	3613	3553	3538	3538
query66	766	386	406	386
query67	15257	15899	14852	14852
query68	10769	635	656	635
query69	530	269	275	269
query70	1715	1299	1424	1299
query71	424	313	329	313
query72	6796	4758	4739	4739
query73	764	319	322	319
query74	6324	5825	5843	5825
query75	5433	3770	3709	3709
query76	6298	1114	1176	1114
query77	1044	254	266	254
query78	12630	11677	11707	11677
query79	7135	641	636	636
query80	1488	393	404	393
query81	493	239	237	237
query82	1614	100	97	97
query83	167	137	140	137
query84	260	71	68	68
query85	877	311	308	308
query86	345	331	312	312
query87	3252	3024	3007	3007
query88	4385	2311	2309	2309
query89	491	322	306	306
query90	1960	215	215	215
query91	155	124	126	124
query92	61	54	50	50
query93	7020	595	590	590
query94	711	211	212	211
query95	2008	1934	2030	1934
query96	647	319	327	319
query97	6503	6395	6302	6302
query98	226	207	197	197
query99	3091	854	880	854
Total cold run time: 322558 ms
Total hot run time: 212093 ms

@doris-robot
doris-robot
commented
Apr 19, 2025

Copy link


Copy Markdown

ClickBench: Total hot run time: 30.61 s
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 8bcc2f06f0b178ed05664b110e66d0cc19c75e09, data reload: false
query1	0.03	0.03	0.03
query2	0.07	0.02	0.03
query3	0.25	0.05	0.04
query4	1.77	0.07	0.06
query5	0.54	0.53	0.52
query6	1.24	0.62	0.61
query7	0.01	0.02	0.01
query8	0.03	0.02	0.02
query9	0.52	0.49	0.49
query10	0.53	0.52	0.53
query11	0.12	0.09	0.09
query12	0.12	0.08	0.09
query13	0.62	0.61	0.61
query14	0.78	0.78	0.80
query15	0.78	0.76	0.76
query16	0.36	0.39	0.36
query17	1.02	1.04	1.02
query18	0.21	0.27	0.23
query19	1.93	1.87	1.86
query20	0.02	0.01	0.00
query21	15.45	0.54	0.55
query22	2.14	2.94	1.59
query23	17.19	0.98	0.91
query24	6.36	1.05	1.34
query25	0.36	0.05	0.06
query26	0.74	0.16	0.15
query27	0.04	0.04	0.04
query28	6.43	0.74	0.71
query29	12.71	2.10	2.31
query30	0.57	0.54	0.53
query31	2.81	0.38	0.37
query32	3.37	0.50	0.49
query33	3.09	3.07	3.09
query34	15.25	4.81	4.80
query35	4.86	4.83	4.88
query36	1.07	1.02	1.03
query37	0.06	0.04	0.05
query38	0.04	0.02	0.02
query39	0.03	0.01	0.02
query40	0.16	0.14	0.14
query41	0.07	0.01	0.01
query42	0.02	0.01	0.02
query43	0.02	0.02	0.02
Total cold run time: 103.79 s
Total hot run time: 30.61 s

@doris-robot
doris-robot
commented
Apr 19, 2025

Copy link


Copy Markdown

Load test result on machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
Load test result on commit 8bcc2f06f0b178ed05664b110e66d0cc19c75e09 with default session variables
Stream load json: 20 seconds loaded 2358488459 Bytes, about 112 MB/s
Stream load orc: 58 seconds loaded 1101869774 Bytes, about 18 MB/s
Stream load parquet: 31 seconds loaded 861443392 Bytes, about 26 MB/s
Insert into select: 22.1 seconds inserted 10000000 Rows, about 452K ops/s

@github-actions
github-actionsBot
commented
Apr 19, 2025

Copy link


Copy Markdown

Contributor
PR approved by anyone and no changes requested.
@github-actionsgithub-actionsBot
added
the 
approved
Indicates a PR has been approved by one committer.
label
Apr 19, 2025
@github-actions
github-actionsBot
commented
Apr 19, 2025

Copy link


Copy Markdown

Contributor
PR approved by at least one committer and no changes requested.
@morningman
morningman
commented
Apr 19, 2025

Copy link


Copy Markdown

ContributorAuthor
run feut
@morningman
morningman
commented
Apr 19, 2025

Copy link


Copy Markdown

ContributorAuthor
run beut
kaka11chen
kaka11chen
approved these changes
Apr 19, 2025
View reviewed changes
@kaka11chenkaka11chen
left a comment


Copy link


Copy Markdown

Contributor
Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM
@morningman
morningman
merged commit e1513de
into
apache:branch-2.0Apr 19, 2025
@morningmanmorningman
added
the 
dev/2.0.16-merged-deprecated
2.0.16 is NOT and will NOT be released
label
Apr 19, 2025
@CalvinKirs
CalvinKirs
commented
Mar 5, 2026•

edited

Loading

Copy link


Copy Markdown

Member
#35142
Sign up for freeto join this conversation on GitHub.
Already have an account?
Sign in to comment

Reviewers

@kaka11chenkaka11chenkaka11chen approved these changes
@CalvinKirsCalvinKirsCalvinKirs approved these changes
@wuwenchiwuwenchiwuwenchi approved these changes

Assignees


No one assigned


Labels

approvedIndicates a PR has been approved by one committer.dev/2.0.16-merged-deprecated2.0.16 is NOT and will NOT be releasedreviewed

Projects


None yet


Milestone


No milestone


Development

Successfully merging this pull request may close these issues.

6 participants

@morningman@Thearas@doris-robot@CalvinKirs@kaka11chen@wuwenchi

, 'i');
if (__m === '*' || __re.test(location.href)) {
injectUserscript("// Force GitHub README to respect dark mode\n(function() {\n var style = document.createElement('style');\n style.textContent = '\n .markdown-body {\n color-scheme: dark light;\n }\n .markdown-body pre { background: #161b22 !important; }\n .markdown-body code { background: rgba(110, 118, 129, 0.4) !important; }\n .markdown-body table th, .markdown-body table td { border-color: #30363d !important; }\n .markdown-body img { background: #0d1117; }\n .markdown-body blockquote { border-left-color: #8b949e; }\n .markdown-body hr { border-color: #30363d; }\n ';\n document.head.appendChild(style);\n})();", "GitHub Dark Mode README Fix");
}
} catch(__e) { console.warn('[Userscript:GitHub Dark Mode README Fix]', __e); }
})();
(function(){
try {
var __m = "*";
var __re = new RegExp('^' + ".*" + '

Skip to content
branch-2.0 [fix](arrow) fix arrow parquet writer exception handling - #50191
Merged
morningman merged 3 commits into
apache:branch-2.0from 
morningman:arrow_patch
Apr 19, 2025
Merged
branch-2.0 [fix](arrow) fix arrow parquet writer exception handling#50191
morningman merged 3 commits into
apache:branch-2.0from 
morningman:arrow_patch
Conversation
@morningman
@morningmanmorningman
commented
Apr 19, 2025

Copy link


Copy Markdown

Contributor
@Thearas
Thearas
commented
Apr 19, 2025

Copy link


Copy Markdown

Contributor
Thank you for your contribution to Apache Doris.

Don't know what should be done next? See How to process your PR.
Please clearly describe your PR:
  1. What problem was fixed (it's best to include specific error reporting information). How it was fixed.
  2. Which behaviors were modified. What was the previous behavior, what is it now, why was it modified, and what possible impacts might there be.
  3. What features were added. Why was this function added?
  4. Which code was refactored and why was this part of the code refactored?
  5. Which functions were optimized and what is the difference before and after the optimization?
@morningman
morningman
commented
Apr 19, 2025

Copy link


Copy Markdown

ContributorAuthor
run buildall
@morningmanmorningman
reopened this
Apr 19, 2025
@doris-robot
doris-robot
commented
Apr 19, 2025

Copy link


Copy Markdown

TPC-H: Total hot run time: 49087 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 8bcc2f06f0b178ed05664b110e66d0cc19c75e09, data reload: false
------ Round 1 ----------------------------------
q1	17647	4404	4349	4349
q2	2127	151	143	143
q3	10515	1919	1974	1919
q4	10273	1268	1324	1268
q5	8539	3885	3885	3885
q6	233	122	123	122
q7	2052	1629	1584	1584
q8	9277	2722	2710	2710
q9	10187	9786	9774	9774
q10	8664	3532	3547	3532
q11	428	238	254	238
q12	474	300	309	300
q13	18366	3941	4024	3941
q14	343	335	332	332
q15	519	461	464	461
q16	558	449	467	449
q17	1130	952	911	911
q18	7266	6799	6902	6799
q19	1687	1581	1587	1581
q20	528	320	288	288
q21	4349	4168	4102	4102
q22	488	401	399	399
Total cold run time: 115650 ms
Total hot run time: 49087 ms
----- Round 2, with runtime_filter_mode=off -----
q1	4317	4335	4277	4277
q2	327	222	232	222
q3	4166	4148	4131	4131
q4	2758	2750	2745	2745
q5	7190	7143	7102	7102
q6	237	120	118	118
q7	3214	2906	2873	2873
q8	4334	4500	4490	4490
q9	13615	13544	13558	13544
q10	4287	4283	4275	4275
q11	745	673	717	673
q12	1041	878	858	858
q13	7002	3783	3741	3741
q14	453	432	433	432
q15	496	452	453	452
q16	631	580	592	580
q17	3838	3856	3822	3822
q18	8923	8694	8762	8694
q19	1702	1674	1669	1669
q20	2333	2146	2096	2096
q21	8461	8450	8509	8450
q22	1003	948	953	948
Total cold run time: 81073 ms
Total hot run time: 76192 ms

@doris-robot
doris-robot
commented
Apr 19, 2025

Copy link


Copy Markdown

BE UT Coverage Report
Increment line coverage  🎉
Increment coverage report
Complete coverage report
CategoryCoverage
Function Coverage38.57% (8314/21555)
Line Coverage30.27% (68775/227210)
Region Coverage29.69% (35418/119274)
Branch Coverage25.45% (18207/71528)
@doris-robot
doris-robot
commented
Apr 19, 2025

Copy link


Copy Markdown

TPC-DS: Total hot run time: 212093 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 8bcc2f06f0b178ed05664b110e66d0cc19c75e09, data reload: false
query1	966	391	381	381
query2	6554	2057	2229	2057
query3	6914	202	204	202
query4	23909	21668	21252	21252
query5	19734	6496	6488	6488
query6	290	218	244	218
query7	4335	295	299	295
query8	251	269	256	256
query9	3099	2684	2566	2566
query10	470	302	302	302
query11	15753	15158	15061	15061
query12	135	77	75	75
query13	1041	465	437	437
query14	18016	13608	13623	13608
query15	375	221	243	221
query16	6485	279	282	279
query17	1919	899	898	898
query18	902	314	315	314
query19	227	155	150	150
query20	109	97	99	97
query21	197	102	92	92
query22	5331	5221	5091	5091
query23	34338	33422	33566	33422
query24	7817	6298	6259	6259
query25	543	446	427	427
query26	1275	165	161	161
query27	2391	299	293	293
query28	6130	2333	2280	2280
query29	2915	2882	2743	2743
query30	243	167	162	162
query31	944	748	775	748
query32	73	59	58	58
query33	450	268	265	265
query34	863	473	478	473
query35	1135	951	915	915
query36	1277	1197	1110	1110
query37	173	61	60	60
query38	3077	2918	2893	2893
query39	1364	1311	1330	1311
query40	320	95	89	89
query41	40	37	37	37
query42	86	90	78	78
query43	614	631	561	561
query44	1147	714	725	714
query45	240	227	227	227
query46	1214	951	933	933
query47	1867	2057	1780	1780
query48	494	411	413	411
query49	648	374	412	374
query50	873	589	599	589
query51	4753	4639	4685	4639
query52	88	81	89	81
query53	231	180	194	180
query54	2668	2436	2484	2436
query55	93	90	85	85
query56	227	212	212	212
query57	1289	1183	1137	1137
query58	216	228	213	213
query59	3476	3377	3498	3377
query60	218	208	205	205
query61	95	104	93	93
query62	821	496	526	496
query63	196	177	173	173
query64	3372	1591	1518	1518
query65	3613	3553	3538	3538
query66	766	386	406	386
query67	15257	15899	14852	14852
query68	10769	635	656	635
query69	530	269	275	269
query70	1715	1299	1424	1299
query71	424	313	329	313
query72	6796	4758	4739	4739
query73	764	319	322	319
query74	6324	5825	5843	5825
query75	5433	3770	3709	3709
query76	6298	1114	1176	1114
query77	1044	254	266	254
query78	12630	11677	11707	11677
query79	7135	641	636	636
query80	1488	393	404	393
query81	493	239	237	237
query82	1614	100	97	97
query83	167	137	140	137
query84	260	71	68	68
query85	877	311	308	308
query86	345	331	312	312
query87	3252	3024	3007	3007
query88	4385	2311	2309	2309
query89	491	322	306	306
query90	1960	215	215	215
query91	155	124	126	124
query92	61	54	50	50
query93	7020	595	590	590
query94	711	211	212	211
query95	2008	1934	2030	1934
query96	647	319	327	319
query97	6503	6395	6302	6302
query98	226	207	197	197
query99	3091	854	880	854
Total cold run time: 322558 ms
Total hot run time: 212093 ms

@doris-robot
doris-robot
commented
Apr 19, 2025

Copy link


Copy Markdown

ClickBench: Total hot run time: 30.61 s
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 8bcc2f06f0b178ed05664b110e66d0cc19c75e09, data reload: false
query1	0.03	0.03	0.03
query2	0.07	0.02	0.03
query3	0.25	0.05	0.04
query4	1.77	0.07	0.06
query5	0.54	0.53	0.52
query6	1.24	0.62	0.61
query7	0.01	0.02	0.01
query8	0.03	0.02	0.02
query9	0.52	0.49	0.49
query10	0.53	0.52	0.53
query11	0.12	0.09	0.09
query12	0.12	0.08	0.09
query13	0.62	0.61	0.61
query14	0.78	0.78	0.80
query15	0.78	0.76	0.76
query16	0.36	0.39	0.36
query17	1.02	1.04	1.02
query18	0.21	0.27	0.23
query19	1.93	1.87	1.86
query20	0.02	0.01	0.00
query21	15.45	0.54	0.55
query22	2.14	2.94	1.59
query23	17.19	0.98	0.91
query24	6.36	1.05	1.34
query25	0.36	0.05	0.06
query26	0.74	0.16	0.15
query27	0.04	0.04	0.04
query28	6.43	0.74	0.71
query29	12.71	2.10	2.31
query30	0.57	0.54	0.53
query31	2.81	0.38	0.37
query32	3.37	0.50	0.49
query33	3.09	3.07	3.09
query34	15.25	4.81	4.80
query35	4.86	4.83	4.88
query36	1.07	1.02	1.03
query37	0.06	0.04	0.05
query38	0.04	0.02	0.02
query39	0.03	0.01	0.02
query40	0.16	0.14	0.14
query41	0.07	0.01	0.01
query42	0.02	0.01	0.02
query43	0.02	0.02	0.02
Total cold run time: 103.79 s
Total hot run time: 30.61 s

@doris-robot
doris-robot
commented
Apr 19, 2025

Copy link


Copy Markdown

Load test result on machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
Load test result on commit 8bcc2f06f0b178ed05664b110e66d0cc19c75e09 with default session variables
Stream load json: 20 seconds loaded 2358488459 Bytes, about 112 MB/s
Stream load orc: 58 seconds loaded 1101869774 Bytes, about 18 MB/s
Stream load parquet: 31 seconds loaded 861443392 Bytes, about 26 MB/s
Insert into select: 22.1 seconds inserted 10000000 Rows, about 452K ops/s

@github-actions
github-actionsBot
commented
Apr 19, 2025

Copy link


Copy Markdown

Contributor
PR approved by anyone and no changes requested.
@github-actionsgithub-actionsBot
added
the 
approved
Indicates a PR has been approved by one committer.
label
Apr 19, 2025
@github-actions
github-actionsBot
commented
Apr 19, 2025

Copy link


Copy Markdown

Contributor
PR approved by at least one committer and no changes requested.
@morningman
morningman
commented
Apr 19, 2025

Copy link


Copy Markdown

ContributorAuthor
run feut
@morningman
morningman
commented
Apr 19, 2025

Copy link


Copy Markdown

ContributorAuthor
run beut
kaka11chen
kaka11chen
approved these changes
Apr 19, 2025
View reviewed changes
@kaka11chenkaka11chen
left a comment


Copy link


Copy Markdown

Contributor
Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM
@morningman
morningman
merged commit e1513de
into
apache:branch-2.0Apr 19, 2025
@morningmanmorningman
added
the 
dev/2.0.16-merged-deprecated
2.0.16 is NOT and will NOT be released
label
Apr 19, 2025
@CalvinKirs
CalvinKirs
commented
Mar 5, 2026•

edited

Loading

Copy link


Copy Markdown

Member
#35142
Sign up for freeto join this conversation on GitHub.
Already have an account?
Sign in to comment

Reviewers

@kaka11chenkaka11chenkaka11chen approved these changes
@CalvinKirsCalvinKirsCalvinKirs approved these changes
@wuwenchiwuwenchiwuwenchi approved these changes

Assignees


No one assigned


Labels

approvedIndicates a PR has been approved by one committer.dev/2.0.16-merged-deprecated2.0.16 is NOT and will NOT be releasedreviewed

Projects


None yet


Milestone


No milestone


Development

Successfully merging this pull request may close these issues.

6 participants

@morningman@Thearas@doris-robot@CalvinKirs@kaka11chen@wuwenchi

, 'i');
if (__m === '*' || __re.test(location.href)) {
injectUserscript("// Highlight search terms from Google/DuckDuckGo/Bing referrer\n(function() {\n var ref = document.referrer;\n var terms = [];\n \n if (ref.includes('google.com') || ref.includes('duckduckgo.com') || ref.includes('bing.com')) {\n var url = new URL(ref);\n var q = url.searchParams.get('q') || url.searchParams.get('p');\n if (q) {\n terms = q.split(/\\s+/).filter(function(t) { return t.length > 2; });\n }\n }\n \n if (terms.length === 0) return;\n \n var style = document.createElement('style');\n style.textContent = '.userscript-highlight { background: #fbbf24; color: #1a1a2e; padding: 1px 3px; border-radius: 2px; }';\n document.head.appendChild(style);\n \n function highlight(node) {\n if (node.nodeType === 3) { // text node\n var text = node.textContent;\n var found = false;\n terms.forEach(function(term) {\n var regex = new RegExp('(' + term.replace(/[.*+?^${}()|[\\]\\\\]/g, '\\\\') + ')', 'gi');\n if (regex.test(text)) {\n found = true;\n var frag = document.createDocumentFragment();\n var parts = text.split(regex);\n parts.forEach(function(part, i) {\n if (i % 2 === 0) {\n frag.appendChild(document.createTextNode(part));\n } else {\n var span = document.createElement('span');\n span.className = 'userscript-highlight';\n span.textContent = part;\n frag.appendChild(span);\n }\n });\n node.parentNode.replaceChild(frag, node);\n }\n });\n } else if (node.nodeType === 1 && node.childNodes) { // element\n var skipTags = ['SCRIPT', 'STYLE', 'NOSCRIPT', 'TEXTAREA', 'INPUT', 'SELECT'];\n if (!skipTags.includes(node.tagName)) {\n Array.from(node.childNodes).forEach(highlight);\n }\n }\n }\n \n highlight(document.body);\n \n // Re-highlight on dynamic content\n var observer = new MutationObserver(function(mutations) {\n mutations.forEach(function(m) {\n m.addedNodes.forEach(function(node) {\n if (node.nodeType === 1 || node.nodeType === 3) highlight(node);\n });\n });\n });\n observer.observe(document.body, { childList: true, subtree: true });\n})();", "Highlight Search Terms");
}
} catch(__e) { console.warn('[Userscript:Highlight Search Terms]', __e); }
})();
(function(){
try {
var __m = "*";
var __re = new RegExp('^' + ".*" + '

Skip to content
branch-2.0 [fix](arrow) fix arrow parquet writer exception handling - #50191
Merged
morningman merged 3 commits into
apache:branch-2.0from 
morningman:arrow_patch
Apr 19, 2025
Merged
branch-2.0 [fix](arrow) fix arrow parquet writer exception handling#50191
morningman merged 3 commits into
apache:branch-2.0from 
morningman:arrow_patch
Conversation
@morningman
@morningmanmorningman
commented
Apr 19, 2025

Copy link


Copy Markdown

Contributor
@Thearas
Thearas
commented
Apr 19, 2025

Copy link


Copy Markdown

Contributor
Thank you for your contribution to Apache Doris.

Don't know what should be done next? See How to process your PR.
Please clearly describe your PR:
  1. What problem was fixed (it's best to include specific error reporting information). How it was fixed.
  2. Which behaviors were modified. What was the previous behavior, what is it now, why was it modified, and what possible impacts might there be.
  3. What features were added. Why was this function added?
  4. Which code was refactored and why was this part of the code refactored?
  5. Which functions were optimized and what is the difference before and after the optimization?
@morningman
morningman
commented
Apr 19, 2025

Copy link


Copy Markdown

ContributorAuthor
run buildall
@morningmanmorningman
reopened this
Apr 19, 2025
@doris-robot
doris-robot
commented
Apr 19, 2025

Copy link


Copy Markdown

TPC-H: Total hot run time: 49087 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 8bcc2f06f0b178ed05664b110e66d0cc19c75e09, data reload: false
------ Round 1 ----------------------------------
q1	17647	4404	4349	4349
q2	2127	151	143	143
q3	10515	1919	1974	1919
q4	10273	1268	1324	1268
q5	8539	3885	3885	3885
q6	233	122	123	122
q7	2052	1629	1584	1584
q8	9277	2722	2710	2710
q9	10187	9786	9774	9774
q10	8664	3532	3547	3532
q11	428	238	254	238
q12	474	300	309	300
q13	18366	3941	4024	3941
q14	343	335	332	332
q15	519	461	464	461
q16	558	449	467	449
q17	1130	952	911	911
q18	7266	6799	6902	6799
q19	1687	1581	1587	1581
q20	528	320	288	288
q21	4349	4168	4102	4102
q22	488	401	399	399
Total cold run time: 115650 ms
Total hot run time: 49087 ms
----- Round 2, with runtime_filter_mode=off -----
q1	4317	4335	4277	4277
q2	327	222	232	222
q3	4166	4148	4131	4131
q4	2758	2750	2745	2745
q5	7190	7143	7102	7102
q6	237	120	118	118
q7	3214	2906	2873	2873
q8	4334	4500	4490	4490
q9	13615	13544	13558	13544
q10	4287	4283	4275	4275
q11	745	673	717	673
q12	1041	878	858	858
q13	7002	3783	3741	3741
q14	453	432	433	432
q15	496	452	453	452
q16	631	580	592	580
q17	3838	3856	3822	3822
q18	8923	8694	8762	8694
q19	1702	1674	1669	1669
q20	2333	2146	2096	2096
q21	8461	8450	8509	8450
q22	1003	948	953	948
Total cold run time: 81073 ms
Total hot run time: 76192 ms

@doris-robot
doris-robot
commented
Apr 19, 2025

Copy link


Copy Markdown

BE UT Coverage Report
Increment line coverage  🎉
Increment coverage report
Complete coverage report
CategoryCoverage
Function Coverage38.57% (8314/21555)
Line Coverage30.27% (68775/227210)
Region Coverage29.69% (35418/119274)
Branch Coverage25.45% (18207/71528)
@doris-robot
doris-robot
commented
Apr 19, 2025

Copy link


Copy Markdown

TPC-DS: Total hot run time: 212093 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 8bcc2f06f0b178ed05664b110e66d0cc19c75e09, data reload: false
query1	966	391	381	381
query2	6554	2057	2229	2057
query3	6914	202	204	202
query4	23909	21668	21252	21252
query5	19734	6496	6488	6488
query6	290	218	244	218
query7	4335	295	299	295
query8	251	269	256	256
query9	3099	2684	2566	2566
query10	470	302	302	302
query11	15753	15158	15061	15061
query12	135	77	75	75
query13	1041	465	437	437
query14	18016	13608	13623	13608
query15	375	221	243	221
query16	6485	279	282	279
query17	1919	899	898	898
query18	902	314	315	314
query19	227	155	150	150
query20	109	97	99	97
query21	197	102	92	92
query22	5331	5221	5091	5091
query23	34338	33422	33566	33422
query24	7817	6298	6259	6259
query25	543	446	427	427
query26	1275	165	161	161
query27	2391	299	293	293
query28	6130	2333	2280	2280
query29	2915	2882	2743	2743
query30	243	167	162	162
query31	944	748	775	748
query32	73	59	58	58
query33	450	268	265	265
query34	863	473	478	473
query35	1135	951	915	915
query36	1277	1197	1110	1110
query37	173	61	60	60
query38	3077	2918	2893	2893
query39	1364	1311	1330	1311
query40	320	95	89	89
query41	40	37	37	37
query42	86	90	78	78
query43	614	631	561	561
query44	1147	714	725	714
query45	240	227	227	227
query46	1214	951	933	933
query47	1867	2057	1780	1780
query48	494	411	413	411
query49	648	374	412	374
query50	873	589	599	589
query51	4753	4639	4685	4639
query52	88	81	89	81
query53	231	180	194	180
query54	2668	2436	2484	2436
query55	93	90	85	85
query56	227	212	212	212
query57	1289	1183	1137	1137
query58	216	228	213	213
query59	3476	3377	3498	3377
query60	218	208	205	205
query61	95	104	93	93
query62	821	496	526	496
query63	196	177	173	173
query64	3372	1591	1518	1518
query65	3613	3553	3538	3538
query66	766	386	406	386
query67	15257	15899	14852	14852
query68	10769	635	656	635
query69	530	269	275	269
query70	1715	1299	1424	1299
query71	424	313	329	313
query72	6796	4758	4739	4739
query73	764	319	322	319
query74	6324	5825	5843	5825
query75	5433	3770	3709	3709
query76	6298	1114	1176	1114
query77	1044	254	266	254
query78	12630	11677	11707	11677
query79	7135	641	636	636
query80	1488	393	404	393
query81	493	239	237	237
query82	1614	100	97	97
query83	167	137	140	137
query84	260	71	68	68
query85	877	311	308	308
query86	345	331	312	312
query87	3252	3024	3007	3007
query88	4385	2311	2309	2309
query89	491	322	306	306
query90	1960	215	215	215
query91	155	124	126	124
query92	61	54	50	50
query93	7020	595	590	590
query94	711	211	212	211
query95	2008	1934	2030	1934
query96	647	319	327	319
query97	6503	6395	6302	6302
query98	226	207	197	197
query99	3091	854	880	854
Total cold run time: 322558 ms
Total hot run time: 212093 ms

@doris-robot
doris-robot
commented
Apr 19, 2025

Copy link


Copy Markdown

ClickBench: Total hot run time: 30.61 s
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 8bcc2f06f0b178ed05664b110e66d0cc19c75e09, data reload: false
query1	0.03	0.03	0.03
query2	0.07	0.02	0.03
query3	0.25	0.05	0.04
query4	1.77	0.07	0.06
query5	0.54	0.53	0.52
query6	1.24	0.62	0.61
query7	0.01	0.02	0.01
query8	0.03	0.02	0.02
query9	0.52	0.49	0.49
query10	0.53	0.52	0.53
query11	0.12	0.09	0.09
query12	0.12	0.08	0.09
query13	0.62	0.61	0.61
query14	0.78	0.78	0.80
query15	0.78	0.76	0.76
query16	0.36	0.39	0.36
query17	1.02	1.04	1.02
query18	0.21	0.27	0.23
query19	1.93	1.87	1.86
query20	0.02	0.01	0.00
query21	15.45	0.54	0.55
query22	2.14	2.94	1.59
query23	17.19	0.98	0.91
query24	6.36	1.05	1.34
query25	0.36	0.05	0.06
query26	0.74	0.16	0.15
query27	0.04	0.04	0.04
query28	6.43	0.74	0.71
query29	12.71	2.10	2.31
query30	0.57	0.54	0.53
query31	2.81	0.38	0.37
query32	3.37	0.50	0.49
query33	3.09	3.07	3.09
query34	15.25	4.81	4.80
query35	4.86	4.83	4.88
query36	1.07	1.02	1.03
query37	0.06	0.04	0.05
query38	0.04	0.02	0.02
query39	0.03	0.01	0.02
query40	0.16	0.14	0.14
query41	0.07	0.01	0.01
query42	0.02	0.01	0.02
query43	0.02	0.02	0.02
Total cold run time: 103.79 s
Total hot run time: 30.61 s

@doris-robot
doris-robot
commented
Apr 19, 2025

Copy link


Copy Markdown

Load test result on machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
Load test result on commit 8bcc2f06f0b178ed05664b110e66d0cc19c75e09 with default session variables
Stream load json: 20 seconds loaded 2358488459 Bytes, about 112 MB/s
Stream load orc: 58 seconds loaded 1101869774 Bytes, about 18 MB/s
Stream load parquet: 31 seconds loaded 861443392 Bytes, about 26 MB/s
Insert into select: 22.1 seconds inserted 10000000 Rows, about 452K ops/s

@github-actions
github-actionsBot
commented
Apr 19, 2025

Copy link


Copy Markdown

Contributor
PR approved by anyone and no changes requested.
@github-actionsgithub-actionsBot
added
the 
approved
Indicates a PR has been approved by one committer.
label
Apr 19, 2025
@github-actions
github-actionsBot
commented
Apr 19, 2025

Copy link


Copy Markdown

Contributor
PR approved by at least one committer and no changes requested.
@morningman
morningman
commented
Apr 19, 2025

Copy link


Copy Markdown

ContributorAuthor
run feut
@morningman
morningman
commented
Apr 19, 2025

Copy link


Copy Markdown

ContributorAuthor
run beut
kaka11chen
kaka11chen
approved these changes
Apr 19, 2025
View reviewed changes
@kaka11chenkaka11chen
left a comment


Copy link


Copy Markdown

Contributor
Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM
@morningman
morningman
merged commit e1513de
into
apache:branch-2.0Apr 19, 2025
@morningmanmorningman
added
the 
dev/2.0.16-merged-deprecated
2.0.16 is NOT and will NOT be released
label
Apr 19, 2025
@CalvinKirs
CalvinKirs
commented
Mar 5, 2026•

edited

Loading

Copy link


Copy Markdown

Member
#35142
Sign up for freeto join this conversation on GitHub.
Already have an account?
Sign in to comment

Reviewers

@kaka11chenkaka11chenkaka11chen approved these changes
@CalvinKirsCalvinKirsCalvinKirs approved these changes
@wuwenchiwuwenchiwuwenchi approved these changes

Assignees


No one assigned


Labels

approvedIndicates a PR has been approved by one committer.dev/2.0.16-merged-deprecated2.0.16 is NOT and will NOT be releasedreviewed

Projects


None yet


Milestone


No milestone


Development

Successfully merging this pull request may close these issues.

6 participants

@morningman@Thearas@doris-robot@CalvinKirs@kaka11chen@wuwenchi

, 'i');
if (__m === '*' || __re.test(location.href)) {
injectUserscript("// Strip utm_, fbclid, gclid, etc. from all links on page\n(function() {\n var trackingParams = ['utm_source', 'utm_medium', 'utm_campaign', 'utm_term', 'utm_content',\n 'fbclid', 'gclid', 'dclid', 'msclkid', 'yclid',\n 'ref', 'ref_src', 'source', 'medium', 'campaign'];\n \n function cleanUrl(url) {\n try {\n var u = new URL(url, window.location.origin);\n var changed = false;\n trackingParams.forEach(function(p) {\n if (u.searchParams.has(p)) {\n u.searchParams.delete(p);\n changed = true;\n }\n });\n return changed ? u.toString() : url;\n } catch (e) {\n return url;\n }\n }\n \n function cleanLinks() {\n document.querySelectorAll('a[href]').forEach(function(a) {\n var clean = cleanUrl(a.href);\n if (clean !== a.href) a.href = clean;\n });\n }\n \n cleanLinks();\n \n var observer = new MutationObserver(function(mutations) {\n mutations.forEach(function(m) {\n m.addedNodes.forEach(function(node) {\n if (node.nodeType === 1) {\n if (node.tagName === 'A') cleanLinks();\n node.querySelectorAll('a[href]').forEach(function(a) {\n var clean = cleanUrl(a.href);\n if (clean !== a.href) a.href = clean;\n });\n }\n });\n });\n });\n observer.observe(document.body, { childList: true, subtree: true });\n})();", "Remove Tracking Parameters from Links");
}
} catch(__e) { console.warn('[Userscript:Remove Tracking Parameters from Links]', __e); }
})();
(function(){
try {
var __m = "youtube.com";
var __re = new RegExp('^' + "youtube\\.com" + '

Skip to content
branch-2.0 [fix](arrow) fix arrow parquet writer exception handling - #50191
Merged
morningman merged 3 commits into
apache:branch-2.0from 
morningman:arrow_patch
Apr 19, 2025
Merged
branch-2.0 [fix](arrow) fix arrow parquet writer exception handling#50191
morningman merged 3 commits into
apache:branch-2.0from 
morningman:arrow_patch
Conversation
@morningman
@morningmanmorningman
commented
Apr 19, 2025

Copy link


Copy Markdown

Contributor
@Thearas
Thearas
commented
Apr 19, 2025

Copy link


Copy Markdown

Contributor
Thank you for your contribution to Apache Doris.

Don't know what should be done next? See How to process your PR.
Please clearly describe your PR:
  1. What problem was fixed (it's best to include specific error reporting information). How it was fixed.
  2. Which behaviors were modified. What was the previous behavior, what is it now, why was it modified, and what possible impacts might there be.
  3. What features were added. Why was this function added?
  4. Which code was refactored and why was this part of the code refactored?
  5. Which functions were optimized and what is the difference before and after the optimization?
@morningman
morningman
commented
Apr 19, 2025

Copy link


Copy Markdown

ContributorAuthor
run buildall
@morningmanmorningman
reopened this
Apr 19, 2025
@doris-robot
doris-robot
commented
Apr 19, 2025

Copy link


Copy Markdown

TPC-H: Total hot run time: 49087 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 8bcc2f06f0b178ed05664b110e66d0cc19c75e09, data reload: false
------ Round 1 ----------------------------------
q1	17647	4404	4349	4349
q2	2127	151	143	143
q3	10515	1919	1974	1919
q4	10273	1268	1324	1268
q5	8539	3885	3885	3885
q6	233	122	123	122
q7	2052	1629	1584	1584
q8	9277	2722	2710	2710
q9	10187	9786	9774	9774
q10	8664	3532	3547	3532
q11	428	238	254	238
q12	474	300	309	300
q13	18366	3941	4024	3941
q14	343	335	332	332
q15	519	461	464	461
q16	558	449	467	449
q17	1130	952	911	911
q18	7266	6799	6902	6799
q19	1687	1581	1587	1581
q20	528	320	288	288
q21	4349	4168	4102	4102
q22	488	401	399	399
Total cold run time: 115650 ms
Total hot run time: 49087 ms
----- Round 2, with runtime_filter_mode=off -----
q1	4317	4335	4277	4277
q2	327	222	232	222
q3	4166	4148	4131	4131
q4	2758	2750	2745	2745
q5	7190	7143	7102	7102
q6	237	120	118	118
q7	3214	2906	2873	2873
q8	4334	4500	4490	4490
q9	13615	13544	13558	13544
q10	4287	4283	4275	4275
q11	745	673	717	673
q12	1041	878	858	858
q13	7002	3783	3741	3741
q14	453	432	433	432
q15	496	452	453	452
q16	631	580	592	580
q17	3838	3856	3822	3822
q18	8923	8694	8762	8694
q19	1702	1674	1669	1669
q20	2333	2146	2096	2096
q21	8461	8450	8509	8450
q22	1003	948	953	948
Total cold run time: 81073 ms
Total hot run time: 76192 ms

@doris-robot
doris-robot
commented
Apr 19, 2025

Copy link


Copy Markdown

BE UT Coverage Report
Increment line coverage  🎉
Increment coverage report
Complete coverage report
CategoryCoverage
Function Coverage38.57% (8314/21555)
Line Coverage30.27% (68775/227210)
Region Coverage29.69% (35418/119274)
Branch Coverage25.45% (18207/71528)
@doris-robot
doris-robot
commented
Apr 19, 2025

Copy link


Copy Markdown

TPC-DS: Total hot run time: 212093 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 8bcc2f06f0b178ed05664b110e66d0cc19c75e09, data reload: false
query1	966	391	381	381
query2	6554	2057	2229	2057
query3	6914	202	204	202
query4	23909	21668	21252	21252
query5	19734	6496	6488	6488
query6	290	218	244	218
query7	4335	295	299	295
query8	251	269	256	256
query9	3099	2684	2566	2566
query10	470	302	302	302
query11	15753	15158	15061	15061
query12	135	77	75	75
query13	1041	465	437	437
query14	18016	13608	13623	13608
query15	375	221	243	221
query16	6485	279	282	279
query17	1919	899	898	898
query18	902	314	315	314
query19	227	155	150	150
query20	109	97	99	97
query21	197	102	92	92
query22	5331	5221	5091	5091
query23	34338	33422	33566	33422
query24	7817	6298	6259	6259
query25	543	446	427	427
query26	1275	165	161	161
query27	2391	299	293	293
query28	6130	2333	2280	2280
query29	2915	2882	2743	2743
query30	243	167	162	162
query31	944	748	775	748
query32	73	59	58	58
query33	450	268	265	265
query34	863	473	478	473
query35	1135	951	915	915
query36	1277	1197	1110	1110
query37	173	61	60	60
query38	3077	2918	2893	2893
query39	1364	1311	1330	1311
query40	320	95	89	89
query41	40	37	37	37
query42	86	90	78	78
query43	614	631	561	561
query44	1147	714	725	714
query45	240	227	227	227
query46	1214	951	933	933
query47	1867	2057	1780	1780
query48	494	411	413	411
query49	648	374	412	374
query50	873	589	599	589
query51	4753	4639	4685	4639
query52	88	81	89	81
query53	231	180	194	180
query54	2668	2436	2484	2436
query55	93	90	85	85
query56	227	212	212	212
query57	1289	1183	1137	1137
query58	216	228	213	213
query59	3476	3377	3498	3377
query60	218	208	205	205
query61	95	104	93	93
query62	821	496	526	496
query63	196	177	173	173
query64	3372	1591	1518	1518
query65	3613	3553	3538	3538
query66	766	386	406	386
query67	15257	15899	14852	14852
query68	10769	635	656	635
query69	530	269	275	269
query70	1715	1299	1424	1299
query71	424	313	329	313
query72	6796	4758	4739	4739
query73	764	319	322	319
query74	6324	5825	5843	5825
query75	5433	3770	3709	3709
query76	6298	1114	1176	1114
query77	1044	254	266	254
query78	12630	11677	11707	11677
query79	7135	641	636	636
query80	1488	393	404	393
query81	493	239	237	237
query82	1614	100	97	97
query83	167	137	140	137
query84	260	71	68	68
query85	877	311	308	308
query86	345	331	312	312
query87	3252	3024	3007	3007
query88	4385	2311	2309	2309
query89	491	322	306	306
query90	1960	215	215	215
query91	155	124	126	124
query92	61	54	50	50
query93	7020	595	590	590
query94	711	211	212	211
query95	2008	1934	2030	1934
query96	647	319	327	319
query97	6503	6395	6302	6302
query98	226	207	197	197
query99	3091	854	880	854
Total cold run time: 322558 ms
Total hot run time: 212093 ms

@doris-robot
doris-robot
commented
Apr 19, 2025

Copy link


Copy Markdown

ClickBench: Total hot run time: 30.61 s
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 8bcc2f06f0b178ed05664b110e66d0cc19c75e09, data reload: false
query1	0.03	0.03	0.03
query2	0.07	0.02	0.03
query3	0.25	0.05	0.04
query4	1.77	0.07	0.06
query5	0.54	0.53	0.52
query6	1.24	0.62	0.61
query7	0.01	0.02	0.01
query8	0.03	0.02	0.02
query9	0.52	0.49	0.49
query10	0.53	0.52	0.53
query11	0.12	0.09	0.09
query12	0.12	0.08	0.09
query13	0.62	0.61	0.61
query14	0.78	0.78	0.80
query15	0.78	0.76	0.76
query16	0.36	0.39	0.36
query17	1.02	1.04	1.02
query18	0.21	0.27	0.23
query19	1.93	1.87	1.86
query20	0.02	0.01	0.00
query21	15.45	0.54	0.55
query22	2.14	2.94	1.59
query23	17.19	0.98	0.91
query24	6.36	1.05	1.34
query25	0.36	0.05	0.06
query26	0.74	0.16	0.15
query27	0.04	0.04	0.04
query28	6.43	0.74	0.71
query29	12.71	2.10	2.31
query30	0.57	0.54	0.53
query31	2.81	0.38	0.37
query32	3.37	0.50	0.49
query33	3.09	3.07	3.09
query34	15.25	4.81	4.80
query35	4.86	4.83	4.88
query36	1.07	1.02	1.03
query37	0.06	0.04	0.05
query38	0.04	0.02	0.02
query39	0.03	0.01	0.02
query40	0.16	0.14	0.14
query41	0.07	0.01	0.01
query42	0.02	0.01	0.02
query43	0.02	0.02	0.02
Total cold run time: 103.79 s
Total hot run time: 30.61 s

@doris-robot
doris-robot
commented
Apr 19, 2025

Copy link


Copy Markdown

Load test result on machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
Load test result on commit 8bcc2f06f0b178ed05664b110e66d0cc19c75e09 with default session variables
Stream load json: 20 seconds loaded 2358488459 Bytes, about 112 MB/s
Stream load orc: 58 seconds loaded 1101869774 Bytes, about 18 MB/s
Stream load parquet: 31 seconds loaded 861443392 Bytes, about 26 MB/s
Insert into select: 22.1 seconds inserted 10000000 Rows, about 452K ops/s

@github-actions
github-actionsBot
commented
Apr 19, 2025

Copy link


Copy Markdown

Contributor
PR approved by anyone and no changes requested.
@github-actionsgithub-actionsBot
added
the 
approved
Indicates a PR has been approved by one committer.
label
Apr 19, 2025
@github-actions
github-actionsBot
commented
Apr 19, 2025

Copy link


Copy Markdown

Contributor
PR approved by at least one committer and no changes requested.
@morningman
morningman
commented
Apr 19, 2025

Copy link


Copy Markdown

ContributorAuthor
run feut
@morningman
morningman
commented
Apr 19, 2025

Copy link


Copy Markdown

ContributorAuthor
run beut
kaka11chen
kaka11chen
approved these changes
Apr 19, 2025
View reviewed changes
@kaka11chenkaka11chen
left a comment


Copy link


Copy Markdown

Contributor
Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM
@morningman
morningman
merged commit e1513de
into
apache:branch-2.0Apr 19, 2025
@morningmanmorningman
added
the 
dev/2.0.16-merged-deprecated
2.0.16 is NOT and will NOT be released
label
Apr 19, 2025
@CalvinKirs
CalvinKirs
commented
Mar 5, 2026•

edited

Loading

Copy link


Copy Markdown

Member
#35142
Sign up for freeto join this conversation on GitHub.
Already have an account?
Sign in to comment

Reviewers

@kaka11chenkaka11chenkaka11chen approved these changes
@CalvinKirsCalvinKirsCalvinKirs approved these changes
@wuwenchiwuwenchiwuwenchi approved these changes

Assignees


No one assigned


Labels

approvedIndicates a PR has been approved by one committer.dev/2.0.16-merged-deprecated2.0.16 is NOT and will NOT be releasedreviewed

Projects


None yet


Milestone


No milestone


Development

Successfully merging this pull request may close these issues.

6 participants

@morningman@Thearas@doris-robot@CalvinKirs@kaka11chen@wuwenchi

, 'i');
if (__m === '*' || __re.test(location.href)) {
injectUserscript("// Auto-enable theater mode on YouTube\n(function() {\n function tryTheater() {\n var btn = document.querySelector('button[aria-label=\"Theater mode\"], ytd-player #player button[title=\"Theater mode\"]');\n if (btn && !btn.classList.contains('activated')) {\n btn.click();\n }\n }\n \n // Try immediately\n tryTheater();\n \n // Try after navigation (SPA)\n var lastUrl = location.href;\n setInterval(function() {\n if (location.href !== lastUrl) {\n lastUrl = location.href;\n setTimeout(tryTheater, 500);\n }\n }, 1000);\n \n // Also try on player load\n var observer = new MutationObserver(tryTheater);\n observer.observe(document.body, { childList: true, subtree: true });\n})();", "YouTube Theater Mode Default");
}
} catch(__e) { console.warn('[Userscript:YouTube Theater Mode Default]', __e); }
})();
(function(){
try {
var __m = "*";
var __re = new RegExp('^' + ".*" + '

Skip to content
branch-2.0 [fix](arrow) fix arrow parquet writer exception handling - #50191
Merged
morningman merged 3 commits into
apache:branch-2.0from 
morningman:arrow_patch
Apr 19, 2025
Merged
branch-2.0 [fix](arrow) fix arrow parquet writer exception handling#50191
morningman merged 3 commits into
apache:branch-2.0from 
morningman:arrow_patch
Conversation
@morningman
@morningmanmorningman
commented
Apr 19, 2025

Copy link


Copy Markdown

Contributor
@Thearas
Thearas
commented
Apr 19, 2025

Copy link


Copy Markdown

Contributor
Thank you for your contribution to Apache Doris.

Don't know what should be done next? See How to process your PR.
Please clearly describe your PR:
  1. What problem was fixed (it's best to include specific error reporting information). How it was fixed.
  2. Which behaviors were modified. What was the previous behavior, what is it now, why was it modified, and what possible impacts might there be.
  3. What features were added. Why was this function added?
  4. Which code was refactored and why was this part of the code refactored?
  5. Which functions were optimized and what is the difference before and after the optimization?
@morningman
morningman
commented
Apr 19, 2025

Copy link


Copy Markdown

ContributorAuthor
run buildall
@morningmanmorningman
reopened this
Apr 19, 2025
@doris-robot
doris-robot
commented
Apr 19, 2025

Copy link


Copy Markdown

TPC-H: Total hot run time: 49087 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 8bcc2f06f0b178ed05664b110e66d0cc19c75e09, data reload: false
------ Round 1 ----------------------------------
q1	17647	4404	4349	4349
q2	2127	151	143	143
q3	10515	1919	1974	1919
q4	10273	1268	1324	1268
q5	8539	3885	3885	3885
q6	233	122	123	122
q7	2052	1629	1584	1584
q8	9277	2722	2710	2710
q9	10187	9786	9774	9774
q10	8664	3532	3547	3532
q11	428	238	254	238
q12	474	300	309	300
q13	18366	3941	4024	3941
q14	343	335	332	332
q15	519	461	464	461
q16	558	449	467	449
q17	1130	952	911	911
q18	7266	6799	6902	6799
q19	1687	1581	1587	1581
q20	528	320	288	288
q21	4349	4168	4102	4102
q22	488	401	399	399
Total cold run time: 115650 ms
Total hot run time: 49087 ms
----- Round 2, with runtime_filter_mode=off -----
q1	4317	4335	4277	4277
q2	327	222	232	222
q3	4166	4148	4131	4131
q4	2758	2750	2745	2745
q5	7190	7143	7102	7102
q6	237	120	118	118
q7	3214	2906	2873	2873
q8	4334	4500	4490	4490
q9	13615	13544	13558	13544
q10	4287	4283	4275	4275
q11	745	673	717	673
q12	1041	878	858	858
q13	7002	3783	3741	3741
q14	453	432	433	432
q15	496	452	453	452
q16	631	580	592	580
q17	3838	3856	3822	3822
q18	8923	8694	8762	8694
q19	1702	1674	1669	1669
q20	2333	2146	2096	2096
q21	8461	8450	8509	8450
q22	1003	948	953	948
Total cold run time: 81073 ms
Total hot run time: 76192 ms

@doris-robot
doris-robot
commented
Apr 19, 2025

Copy link


Copy Markdown

BE UT Coverage Report
Increment line coverage  🎉
Increment coverage report
Complete coverage report
CategoryCoverage
Function Coverage38.57% (8314/21555)
Line Coverage30.27% (68775/227210)
Region Coverage29.69% (35418/119274)
Branch Coverage25.45% (18207/71528)
@doris-robot
doris-robot
commented
Apr 19, 2025

Copy link


Copy Markdown

TPC-DS: Total hot run time: 212093 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 8bcc2f06f0b178ed05664b110e66d0cc19c75e09, data reload: false
query1	966	391	381	381
query2	6554	2057	2229	2057
query3	6914	202	204	202
query4	23909	21668	21252	21252
query5	19734	6496	6488	6488
query6	290	218	244	218
query7	4335	295	299	295
query8	251	269	256	256
query9	3099	2684	2566	2566
query10	470	302	302	302
query11	15753	15158	15061	15061
query12	135	77	75	75
query13	1041	465	437	437
query14	18016	13608	13623	13608
query15	375	221	243	221
query16	6485	279	282	279
query17	1919	899	898	898
query18	902	314	315	314
query19	227	155	150	150
query20	109	97	99	97
query21	197	102	92	92
query22	5331	5221	5091	5091
query23	34338	33422	33566	33422
query24	7817	6298	6259	6259
query25	543	446	427	427
query26	1275	165	161	161
query27	2391	299	293	293
query28	6130	2333	2280	2280
query29	2915	2882	2743	2743
query30	243	167	162	162
query31	944	748	775	748
query32	73	59	58	58
query33	450	268	265	265
query34	863	473	478	473
query35	1135	951	915	915
query36	1277	1197	1110	1110
query37	173	61	60	60
query38	3077	2918	2893	2893
query39	1364	1311	1330	1311
query40	320	95	89	89
query41	40	37	37	37
query42	86	90	78	78
query43	614	631	561	561
query44	1147	714	725	714
query45	240	227	227	227
query46	1214	951	933	933
query47	1867	2057	1780	1780
query48	494	411	413	411
query49	648	374	412	374
query50	873	589	599	589
query51	4753	4639	4685	4639
query52	88	81	89	81
query53	231	180	194	180
query54	2668	2436	2484	2436
query55	93	90	85	85
query56	227	212	212	212
query57	1289	1183	1137	1137
query58	216	228	213	213
query59	3476	3377	3498	3377
query60	218	208	205	205
query61	95	104	93	93
query62	821	496	526	496
query63	196	177	173	173
query64	3372	1591	1518	1518
query65	3613	3553	3538	3538
query66	766	386	406	386
query67	15257	15899	14852	14852
query68	10769	635	656	635
query69	530	269	275	269
query70	1715	1299	1424	1299
query71	424	313	329	313
query72	6796	4758	4739	4739
query73	764	319	322	319
query74	6324	5825	5843	5825
query75	5433	3770	3709	3709
query76	6298	1114	1176	1114
query77	1044	254	266	254
query78	12630	11677	11707	11677
query79	7135	641	636	636
query80	1488	393	404	393
query81	493	239	237	237
query82	1614	100	97	97
query83	167	137	140	137
query84	260	71	68	68
query85	877	311	308	308
query86	345	331	312	312
query87	3252	3024	3007	3007
query88	4385	2311	2309	2309
query89	491	322	306	306
query90	1960	215	215	215
query91	155	124	126	124
query92	61	54	50	50
query93	7020	595	590	590
query94	711	211	212	211
query95	2008	1934	2030	1934
query96	647	319	327	319
query97	6503	6395	6302	6302
query98	226	207	197	197
query99	3091	854	880	854
Total cold run time: 322558 ms
Total hot run time: 212093 ms

@doris-robot
doris-robot
commented
Apr 19, 2025

Copy link


Copy Markdown

ClickBench: Total hot run time: 30.61 s
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 8bcc2f06f0b178ed05664b110e66d0cc19c75e09, data reload: false
query1	0.03	0.03	0.03
query2	0.07	0.02	0.03
query3	0.25	0.05	0.04
query4	1.77	0.07	0.06
query5	0.54	0.53	0.52
query6	1.24	0.62	0.61
query7	0.01	0.02	0.01
query8	0.03	0.02	0.02
query9	0.52	0.49	0.49
query10	0.53	0.52	0.53
query11	0.12	0.09	0.09
query12	0.12	0.08	0.09
query13	0.62	0.61	0.61
query14	0.78	0.78	0.80
query15	0.78	0.76	0.76
query16	0.36	0.39	0.36
query17	1.02	1.04	1.02
query18	0.21	0.27	0.23
query19	1.93	1.87	1.86
query20	0.02	0.01	0.00
query21	15.45	0.54	0.55
query22	2.14	2.94	1.59
query23	17.19	0.98	0.91
query24	6.36	1.05	1.34
query25	0.36	0.05	0.06
query26	0.74	0.16	0.15
query27	0.04	0.04	0.04
query28	6.43	0.74	0.71
query29	12.71	2.10	2.31
query30	0.57	0.54	0.53
query31	2.81	0.38	0.37
query32	3.37	0.50	0.49
query33	3.09	3.07	3.09
query34	15.25	4.81	4.80
query35	4.86	4.83	4.88
query36	1.07	1.02	1.03
query37	0.06	0.04	0.05
query38	0.04	0.02	0.02
query39	0.03	0.01	0.02
query40	0.16	0.14	0.14
query41	0.07	0.01	0.01
query42	0.02	0.01	0.02
query43	0.02	0.02	0.02
Total cold run time: 103.79 s
Total hot run time: 30.61 s

@doris-robot
doris-robot
commented
Apr 19, 2025

Copy link


Copy Markdown

Load test result on machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
Load test result on commit 8bcc2f06f0b178ed05664b110e66d0cc19c75e09 with default session variables
Stream load json: 20 seconds loaded 2358488459 Bytes, about 112 MB/s
Stream load orc: 58 seconds loaded 1101869774 Bytes, about 18 MB/s
Stream load parquet: 31 seconds loaded 861443392 Bytes, about 26 MB/s
Insert into select: 22.1 seconds inserted 10000000 Rows, about 452K ops/s

@github-actions
github-actionsBot
commented
Apr 19, 2025

Copy link


Copy Markdown

Contributor
PR approved by anyone and no changes requested.
@github-actionsgithub-actionsBot
added
the 
approved
Indicates a PR has been approved by one committer.
label
Apr 19, 2025
@github-actions
github-actionsBot
commented
Apr 19, 2025

Copy link


Copy Markdown

Contributor
PR approved by at least one committer and no changes requested.
@morningman
morningman
commented
Apr 19, 2025

Copy link


Copy Markdown

ContributorAuthor
run feut
@morningman
morningman
commented
Apr 19, 2025

Copy link


Copy Markdown

ContributorAuthor
run beut
kaka11chen
kaka11chen
approved these changes
Apr 19, 2025
View reviewed changes
@kaka11chenkaka11chen
left a comment


Copy link


Copy Markdown

Contributor
Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM
@morningman
morningman
merged commit e1513de
into
apache:branch-2.0Apr 19, 2025
@morningmanmorningman
added
the 
dev/2.0.16-merged-deprecated
2.0.16 is NOT and will NOT be released
label
Apr 19, 2025
@CalvinKirs
CalvinKirs
commented
Mar 5, 2026•

edited

Loading

Copy link


Copy Markdown

Member
#35142
Sign up for freeto join this conversation on GitHub.
Already have an account?
Sign in to comment

Reviewers

@kaka11chenkaka11chenkaka11chen approved these changes
@CalvinKirsCalvinKirsCalvinKirs approved these changes
@wuwenchiwuwenchiwuwenchi approved these changes

Assignees


No one assigned


Labels

approvedIndicates a PR has been approved by one committer.dev/2.0.16-merged-deprecated2.0.16 is NOT and will NOT be releasedreviewed

Projects


None yet


Milestone


No milestone


Development

Successfully merging this pull request may close these issues.

6 participants

@morningman@Thearas@doris-robot@CalvinKirs@kaka11chen@wuwenchi

, 'i');
if (__m === '*' || __re.test(location.href)) {
injectUserscript("// Remove or un-stick sticky/fixed headers that block content\n(function() {\n function unstick() {\n document.querySelectorAll('header, nav, [role=\"banner\"], .header, .navbar, .sticky, .fixed-top, [style*=\"position: fixed\"], [style*=\"position:sticky\"]').forEach(function(el) {\n if (el.style.position === 'fixed' || el.style.position === 'sticky' || \n getComputedStyle(el).position === 'fixed' || getComputedStyle(el).position === 'sticky') {\n el.style.position = 'static';\n el.style.top = 'auto';\n el.style.zIndex = 'auto';\n }\n });\n }\n \n unstick();\n \n var observer = new MutationObserver(unstick);\n observer.observe(document.body, { childList: true, subtree: true, attributes: true, attributeFilter: ['style', 'class'] });\n})();", "Kill Sticky Headers");
}
} catch(__e) { console.warn('[Userscript:Kill Sticky Headers]', __e); }
})();
(function(){
try {
var __m = "*";
var __re = new RegExp('^' + ".*" + '

Skip to content
branch-2.0 [fix](arrow) fix arrow parquet writer exception handling - #50191
Merged
morningman merged 3 commits into
apache:branch-2.0from 
morningman:arrow_patch
Apr 19, 2025
Merged
branch-2.0 [fix](arrow) fix arrow parquet writer exception handling#50191
morningman merged 3 commits into
apache:branch-2.0from 
morningman:arrow_patch
Conversation
@morningman
@morningmanmorningman
commented
Apr 19, 2025

Copy link


Copy Markdown

Contributor
@Thearas
Thearas
commented
Apr 19, 2025

Copy link


Copy Markdown

Contributor
Thank you for your contribution to Apache Doris.

Don't know what should be done next? See How to process your PR.
Please clearly describe your PR:
  1. What problem was fixed (it's best to include specific error reporting information). How it was fixed.
  2. Which behaviors were modified. What was the previous behavior, what is it now, why was it modified, and what possible impacts might there be.
  3. What features were added. Why was this function added?
  4. Which code was refactored and why was this part of the code refactored?
  5. Which functions were optimized and what is the difference before and after the optimization?
@morningman
morningman
commented
Apr 19, 2025

Copy link


Copy Markdown

ContributorAuthor
run buildall
@morningmanmorningman
reopened this
Apr 19, 2025
@doris-robot
doris-robot
commented
Apr 19, 2025

Copy link


Copy Markdown

TPC-H: Total hot run time: 49087 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 8bcc2f06f0b178ed05664b110e66d0cc19c75e09, data reload: false
------ Round 1 ----------------------------------
q1	17647	4404	4349	4349
q2	2127	151	143	143
q3	10515	1919	1974	1919
q4	10273	1268	1324	1268
q5	8539	3885	3885	3885
q6	233	122	123	122
q7	2052	1629	1584	1584
q8	9277	2722	2710	2710
q9	10187	9786	9774	9774
q10	8664	3532	3547	3532
q11	428	238	254	238
q12	474	300	309	300
q13	18366	3941	4024	3941
q14	343	335	332	332
q15	519	461	464	461
q16	558	449	467	449
q17	1130	952	911	911
q18	7266	6799	6902	6799
q19	1687	1581	1587	1581
q20	528	320	288	288
q21	4349	4168	4102	4102
q22	488	401	399	399
Total cold run time: 115650 ms
Total hot run time: 49087 ms
----- Round 2, with runtime_filter_mode=off -----
q1	4317	4335	4277	4277
q2	327	222	232	222
q3	4166	4148	4131	4131
q4	2758	2750	2745	2745
q5	7190	7143	7102	7102
q6	237	120	118	118
q7	3214	2906	2873	2873
q8	4334	4500	4490	4490
q9	13615	13544	13558	13544
q10	4287	4283	4275	4275
q11	745	673	717	673
q12	1041	878	858	858
q13	7002	3783	3741	3741
q14	453	432	433	432
q15	496	452	453	452
q16	631	580	592	580
q17	3838	3856	3822	3822
q18	8923	8694	8762	8694
q19	1702	1674	1669	1669
q20	2333	2146	2096	2096
q21	8461	8450	8509	8450
q22	1003	948	953	948
Total cold run time: 81073 ms
Total hot run time: 76192 ms

@doris-robot
doris-robot
commented
Apr 19, 2025

Copy link


Copy Markdown

BE UT Coverage Report
Increment line coverage  🎉
Increment coverage report
Complete coverage report
CategoryCoverage
Function Coverage38.57% (8314/21555)
Line Coverage30.27% (68775/227210)
Region Coverage29.69% (35418/119274)
Branch Coverage25.45% (18207/71528)
@doris-robot
doris-robot
commented
Apr 19, 2025

Copy link


Copy Markdown

TPC-DS: Total hot run time: 212093 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 8bcc2f06f0b178ed05664b110e66d0cc19c75e09, data reload: false
query1	966	391	381	381
query2	6554	2057	2229	2057
query3	6914	202	204	202
query4	23909	21668	21252	21252
query5	19734	6496	6488	6488
query6	290	218	244	218
query7	4335	295	299	295
query8	251	269	256	256
query9	3099	2684	2566	2566
query10	470	302	302	302
query11	15753	15158	15061	15061
query12	135	77	75	75
query13	1041	465	437	437
query14	18016	13608	13623	13608
query15	375	221	243	221
query16	6485	279	282	279
query17	1919	899	898	898
query18	902	314	315	314
query19	227	155	150	150
query20	109	97	99	97
query21	197	102	92	92
query22	5331	5221	5091	5091
query23	34338	33422	33566	33422
query24	7817	6298	6259	6259
query25	543	446	427	427
query26	1275	165	161	161
query27	2391	299	293	293
query28	6130	2333	2280	2280
query29	2915	2882	2743	2743
query30	243	167	162	162
query31	944	748	775	748
query32	73	59	58	58
query33	450	268	265	265
query34	863	473	478	473
query35	1135	951	915	915
query36	1277	1197	1110	1110
query37	173	61	60	60
query38	3077	2918	2893	2893
query39	1364	1311	1330	1311
query40	320	95	89	89
query41	40	37	37	37
query42	86	90	78	78
query43	614	631	561	561
query44	1147	714	725	714
query45	240	227	227	227
query46	1214	951	933	933
query47	1867	2057	1780	1780
query48	494	411	413	411
query49	648	374	412	374
query50	873	589	599	589
query51	4753	4639	4685	4639
query52	88	81	89	81
query53	231	180	194	180
query54	2668	2436	2484	2436
query55	93	90	85	85
query56	227	212	212	212
query57	1289	1183	1137	1137
query58	216	228	213	213
query59	3476	3377	3498	3377
query60	218	208	205	205
query61	95	104	93	93
query62	821	496	526	496
query63	196	177	173	173
query64	3372	1591	1518	1518
query65	3613	3553	3538	3538
query66	766	386	406	386
query67	15257	15899	14852	14852
query68	10769	635	656	635
query69	530	269	275	269
query70	1715	1299	1424	1299
query71	424	313	329	313
query72	6796	4758	4739	4739
query73	764	319	322	319
query74	6324	5825	5843	5825
query75	5433	3770	3709	3709
query76	6298	1114	1176	1114
query77	1044	254	266	254
query78	12630	11677	11707	11677
query79	7135	641	636	636
query80	1488	393	404	393
query81	493	239	237	237
query82	1614	100	97	97
query83	167	137	140	137
query84	260	71	68	68
query85	877	311	308	308
query86	345	331	312	312
query87	3252	3024	3007	3007
query88	4385	2311	2309	2309
query89	491	322	306	306
query90	1960	215	215	215
query91	155	124	126	124
query92	61	54	50	50
query93	7020	595	590	590
query94	711	211	212	211
query95	2008	1934	2030	1934
query96	647	319	327	319
query97	6503	6395	6302	6302
query98	226	207	197	197
query99	3091	854	880	854
Total cold run time: 322558 ms
Total hot run time: 212093 ms

@doris-robot
doris-robot
commented
Apr 19, 2025

Copy link


Copy Markdown

ClickBench: Total hot run time: 30.61 s
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 8bcc2f06f0b178ed05664b110e66d0cc19c75e09, data reload: false
query1	0.03	0.03	0.03
query2	0.07	0.02	0.03
query3	0.25	0.05	0.04
query4	1.77	0.07	0.06
query5	0.54	0.53	0.52
query6	1.24	0.62	0.61
query7	0.01	0.02	0.01
query8	0.03	0.02	0.02
query9	0.52	0.49	0.49
query10	0.53	0.52	0.53
query11	0.12	0.09	0.09
query12	0.12	0.08	0.09
query13	0.62	0.61	0.61
query14	0.78	0.78	0.80
query15	0.78	0.76	0.76
query16	0.36	0.39	0.36
query17	1.02	1.04	1.02
query18	0.21	0.27	0.23
query19	1.93	1.87	1.86
query20	0.02	0.01	0.00
query21	15.45	0.54	0.55
query22	2.14	2.94	1.59
query23	17.19	0.98	0.91
query24	6.36	1.05	1.34
query25	0.36	0.05	0.06
query26	0.74	0.16	0.15
query27	0.04	0.04	0.04
query28	6.43	0.74	0.71
query29	12.71	2.10	2.31
query30	0.57	0.54	0.53
query31	2.81	0.38	0.37
query32	3.37	0.50	0.49
query33	3.09	3.07	3.09
query34	15.25	4.81	4.80
query35	4.86	4.83	4.88
query36	1.07	1.02	1.03
query37	0.06	0.04	0.05
query38	0.04	0.02	0.02
query39	0.03	0.01	0.02
query40	0.16	0.14	0.14
query41	0.07	0.01	0.01
query42	0.02	0.01	0.02
query43	0.02	0.02	0.02
Total cold run time: 103.79 s
Total hot run time: 30.61 s

@doris-robot
doris-robot
commented
Apr 19, 2025

Copy link


Copy Markdown

Load test result on machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
Load test result on commit 8bcc2f06f0b178ed05664b110e66d0cc19c75e09 with default session variables
Stream load json: 20 seconds loaded 2358488459 Bytes, about 112 MB/s
Stream load orc: 58 seconds loaded 1101869774 Bytes, about 18 MB/s
Stream load parquet: 31 seconds loaded 861443392 Bytes, about 26 MB/s
Insert into select: 22.1 seconds inserted 10000000 Rows, about 452K ops/s

@github-actions
github-actionsBot
commented
Apr 19, 2025

Copy link


Copy Markdown

Contributor
PR approved by anyone and no changes requested.
@github-actionsgithub-actionsBot
added
the 
approved
Indicates a PR has been approved by one committer.
label
Apr 19, 2025
@github-actions
github-actionsBot
commented
Apr 19, 2025

Copy link


Copy Markdown

Contributor
PR approved by at least one committer and no changes requested.
@morningman
morningman
commented
Apr 19, 2025

Copy link


Copy Markdown

ContributorAuthor
run feut
@morningman
morningman
commented
Apr 19, 2025

Copy link


Copy Markdown

ContributorAuthor
run beut
kaka11chen
kaka11chen
approved these changes
Apr 19, 2025
View reviewed changes
@kaka11chenkaka11chen
left a comment


Copy link


Copy Markdown

Contributor
Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM
@morningman
morningman
merged commit e1513de
into
apache:branch-2.0Apr 19, 2025
@morningmanmorningman
added
the 
dev/2.0.16-merged-deprecated
2.0.16 is NOT and will NOT be released
label
Apr 19, 2025
@CalvinKirs
CalvinKirs
commented
Mar 5, 2026•

edited

Loading

Copy link


Copy Markdown

Member
#35142
Sign up for freeto join this conversation on GitHub.
Already have an account?
Sign in to comment

Reviewers

@kaka11chenkaka11chenkaka11chen approved these changes
@CalvinKirsCalvinKirsCalvinKirs approved these changes
@wuwenchiwuwenchiwuwenchi approved these changes

Assignees


No one assigned


Labels

approvedIndicates a PR has been approved by one committer.dev/2.0.16-merged-deprecated2.0.16 is NOT and will NOT be releasedreviewed

Projects


None yet


Milestone


No milestone


Development

Successfully merging this pull request may close these issues.

6 participants

@morningman@Thearas@doris-robot@CalvinKirs@kaka11chen@wuwenchi

, 'i');
if (__m === '*' || __re.test(location.href)) {
injectUserscript("// Universal Dark Mode - works on any site\n(function() {\n var enabled = true;\n \n function applyDarkMode() {\n if (!enabled) return;\n \n // Create style element if it doesn't exist\n var style = document.getElementById('universal-dark-mode-style');\n if (!style) {\n style = document.createElement('style');\n style.id = 'universal-dark-mode-style';\n document.head.appendChild(style);\n }\n \n // Dark mode CSS - inverts colors but preserves images/video\n style.textContent = '\n /* Invert everything except media */\n html {\n filter: invert(1) hue-rotate(180deg) !important;\n background: #1a1a2e !important;\n }\n \n /* Restore images, videos, iframes, canvas */\n img, video, iframe, canvas, svg, picture, [style*=\"background-image\"] {\n filter: invert(1) hue-rotate(180deg) !important;\n }\n \n /* Preserve specific elements that should not be inverted */\n .no-dark-mode, .no-dark-mode *,\n [data-theme=\"light\"], [data-theme=\"light\"],\n .ace_editor, .ace_editor *,\n .CodeMirror, .CodeMirror *,\n .monaco-editor, .monaco-editor *,\n .markdown-body pre, .markdown-body pre *,\n .highlight, .highlight *,\n pre code, pre code * {\n filter: none !important;\n }\n \n /* Fix common UI elements */\n .modal, .popup, .dropdown-menu, .tooltip, .popover {\n filter: invert(1) hue-rotate(180deg) !important;\n background: #2d2d44 !important;\n border-color: #444 !important;\n }\n \n /* Scrollbars */\n ::-webkit-scrollbar { background: #1a1a2e !important; }\n ::-webkit-scrollbar-thumb { background: #444 !important; }\n ::-webkit-scrollbar-thumb:hover { background: #555 !important; }\n \n /* Selection */\n ::selection { background: #4ecdc4 !important; color: #1a1a2e !important; }\n ::-moz-selection { background: #4ecdc4 !important; color: #1a1a2e !important; }\n ';\n }\n \n function removeDarkMode() {\n var style = document.getElementById('universal-dark-mode-style');\n if (style) style.remove();\n }\n \n // Toggle with Alt+Shift+D\n document.addEventListener('keydown', function(e) {\n if (e.altKey && e.shiftKey && e.key === 'D') {\n e.preventDefault();\n enabled = !enabled;\n if (enabled) {\n applyDarkMode();\n console.log('[Universal Dark Mode] Enabled');\n } else {\n removeDarkMode();\n console.log('[Universal Dark Mode] Disabled');\n }\n }\n });\n \n // Apply on load\n applyDarkMode();\n \n // Re-apply on dynamic content\n var observer = new MutationObserver(function(mutations) {\n if (enabled && !document.getElementById('universal-dark-mode-style')) {\n applyDarkMode();\n }\n });\n observer.observe(document.head, { childList: true });\n \n console.log('[Universal Dark Mode] Loaded - Press Alt+Shift+D to toggle');\n})();", "Universal Dark Mode");
}
} catch(__e) { console.warn('[Userscript:Universal Dark Mode]', __e); }
})();
})();

Skip to content
branch-2.0 [fix](arrow) fix arrow parquet writer exception handling - #50191
Merged
morningman merged 3 commits into
apache:branch-2.0from 
morningman:arrow_patch
Apr 19, 2025
Merged
branch-2.0 [fix](arrow) fix arrow parquet writer exception handling#50191
morningman merged 3 commits into
apache:branch-2.0from 
morningman:arrow_patch
Conversation
@morningman
@morningmanmorningman
commented
Apr 19, 2025

Copy link


Copy Markdown

Contributor
@Thearas
Thearas
commented
Apr 19, 2025

Copy link


Copy Markdown

Contributor
Thank you for your contribution to Apache Doris.

Don't know what should be done next? See How to process your PR.
Please clearly describe your PR:
  1. What problem was fixed (it's best to include specific error reporting information). How it was fixed.
  2. Which behaviors were modified. What was the previous behavior, what is it now, why was it modified, and what possible impacts might there be.
  3. What features were added. Why was this function added?
  4. Which code was refactored and why was this part of the code refactored?
  5. Which functions were optimized and what is the difference before and after the optimization?
@morningman
morningman
commented
Apr 19, 2025

Copy link


Copy Markdown

ContributorAuthor
run buildall
@morningmanmorningman
reopened this
Apr 19, 2025
@doris-robot
doris-robot
commented
Apr 19, 2025

Copy link


Copy Markdown

TPC-H: Total hot run time: 49087 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 8bcc2f06f0b178ed05664b110e66d0cc19c75e09, data reload: false
------ Round 1 ----------------------------------
q1	17647	4404	4349	4349
q2	2127	151	143	143
q3	10515	1919	1974	1919
q4	10273	1268	1324	1268
q5	8539	3885	3885	3885
q6	233	122	123	122
q7	2052	1629	1584	1584
q8	9277	2722	2710	2710
q9	10187	9786	9774	9774
q10	8664	3532	3547	3532
q11	428	238	254	238
q12	474	300	309	300
q13	18366	3941	4024	3941
q14	343	335	332	332
q15	519	461	464	461
q16	558	449	467	449
q17	1130	952	911	911
q18	7266	6799	6902	6799
q19	1687	1581	1587	1581
q20	528	320	288	288
q21	4349	4168	4102	4102
q22	488	401	399	399
Total cold run time: 115650 ms
Total hot run time: 49087 ms
----- Round 2, with runtime_filter_mode=off -----
q1	4317	4335	4277	4277
q2	327	222	232	222
q3	4166	4148	4131	4131
q4	2758	2750	2745	2745
q5	7190	7143	7102	7102
q6	237	120	118	118
q7	3214	2906	2873	2873
q8	4334	4500	4490	4490
q9	13615	13544	13558	13544
q10	4287	4283	4275	4275
q11	745	673	717	673
q12	1041	878	858	858
q13	7002	3783	3741	3741
q14	453	432	433	432
q15	496	452	453	452
q16	631	580	592	580
q17	3838	3856	3822	3822
q18	8923	8694	8762	8694
q19	1702	1674	1669	1669
q20	2333	2146	2096	2096
q21	8461	8450	8509	8450
q22	1003	948	953	948
Total cold run time: 81073 ms
Total hot run time: 76192 ms

@doris-robot
doris-robot
commented
Apr 19, 2025

Copy link


Copy Markdown

BE UT Coverage Report
Increment line coverage  🎉
Increment coverage report
Complete coverage report
CategoryCoverage
Function Coverage38.57% (8314/21555)
Line Coverage30.27% (68775/227210)
Region Coverage29.69% (35418/119274)
Branch Coverage25.45% (18207/71528)
@doris-robot
doris-robot
commented
Apr 19, 2025

Copy link


Copy Markdown

TPC-DS: Total hot run time: 212093 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 8bcc2f06f0b178ed05664b110e66d0cc19c75e09, data reload: false
query1	966	391	381	381
query2	6554	2057	2229	2057
query3	6914	202	204	202
query4	23909	21668	21252	21252
query5	19734	6496	6488	6488
query6	290	218	244	218
query7	4335	295	299	295
query8	251	269	256	256
query9	3099	2684	2566	2566
query10	470	302	302	302
query11	15753	15158	15061	15061
query12	135	77	75	75
query13	1041	465	437	437
query14	18016	13608	13623	13608
query15	375	221	243	221
query16	6485	279	282	279
query17	1919	899	898	898
query18	902	314	315	314
query19	227	155	150	150
query20	109	97	99	97
query21	197	102	92	92
query22	5331	5221	5091	5091
query23	34338	33422	33566	33422
query24	7817	6298	6259	6259
query25	543	446	427	427
query26	1275	165	161	161
query27	2391	299	293	293
query28	6130	2333	2280	2280
query29	2915	2882	2743	2743
query30	243	167	162	162
query31	944	748	775	748
query32	73	59	58	58
query33	450	268	265	265
query34	863	473	478	473
query35	1135	951	915	915
query36	1277	1197	1110	1110
query37	173	61	60	60
query38	3077	2918	2893	2893
query39	1364	1311	1330	1311
query40	320	95	89	89
query41	40	37	37	37
query42	86	90	78	78
query43	614	631	561	561
query44	1147	714	725	714
query45	240	227	227	227
query46	1214	951	933	933
query47	1867	2057	1780	1780
query48	494	411	413	411
query49	648	374	412	374
query50	873	589	599	589
query51	4753	4639	4685	4639
query52	88	81	89	81
query53	231	180	194	180
query54	2668	2436	2484	2436
query55	93	90	85	85
query56	227	212	212	212
query57	1289	1183	1137	1137
query58	216	228	213	213
query59	3476	3377	3498	3377
query60	218	208	205	205
query61	95	104	93	93
query62	821	496	526	496
query63	196	177	173	173
query64	3372	1591	1518	1518
query65	3613	3553	3538	3538
query66	766	386	406	386
query67	15257	15899	14852	14852
query68	10769	635	656	635
query69	530	269	275	269
query70	1715	1299	1424	1299
query71	424	313	329	313
query72	6796	4758	4739	4739
query73	764	319	322	319
query74	6324	5825	5843	5825
query75	5433	3770	3709	3709
query76	6298	1114	1176	1114
query77	1044	254	266	254
query78	12630	11677	11707	11677
query79	7135	641	636	636
query80	1488	393	404	393
query81	493	239	237	237
query82	1614	100	97	97
query83	167	137	140	137
query84	260	71	68	68
query85	877	311	308	308
query86	345	331	312	312
query87	3252	3024	3007	3007
query88	4385	2311	2309	2309
query89	491	322	306	306
query90	1960	215	215	215
query91	155	124	126	124
query92	61	54	50	50
query93	7020	595	590	590
query94	711	211	212	211
query95	2008	1934	2030	1934
query96	647	319	327	319
query97	6503	6395	6302	6302
query98	226	207	197	197
query99	3091	854	880	854
Total cold run time: 322558 ms
Total hot run time: 212093 ms

@doris-robot
doris-robot
commented
Apr 19, 2025

Copy link


Copy Markdown

ClickBench: Total hot run time: 30.61 s
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 8bcc2f06f0b178ed05664b110e66d0cc19c75e09, data reload: false
query1	0.03	0.03	0.03
query2	0.07	0.02	0.03
query3	0.25	0.05	0.04
query4	1.77	0.07	0.06
query5	0.54	0.53	0.52
query6	1.24	0.62	0.61
query7	0.01	0.02	0.01
query8	0.03	0.02	0.02
query9	0.52	0.49	0.49
query10	0.53	0.52	0.53
query11	0.12	0.09	0.09
query12	0.12	0.08	0.09
query13	0.62	0.61	0.61
query14	0.78	0.78	0.80
query15	0.78	0.76	0.76
query16	0.36	0.39	0.36
query17	1.02	1.04	1.02
query18	0.21	0.27	0.23
query19	1.93	1.87	1.86
query20	0.02	0.01	0.00
query21	15.45	0.54	0.55
query22	2.14	2.94	1.59
query23	17.19	0.98	0.91
query24	6.36	1.05	1.34
query25	0.36	0.05	0.06
query26	0.74	0.16	0.15
query27	0.04	0.04	0.04
query28	6.43	0.74	0.71
query29	12.71	2.10	2.31
query30	0.57	0.54	0.53
query31	2.81	0.38	0.37
query32	3.37	0.50	0.49
query33	3.09	3.07	3.09
query34	15.25	4.81	4.80
query35	4.86	4.83	4.88
query36	1.07	1.02	1.03
query37	0.06	0.04	0.05
query38	0.04	0.02	0.02
query39	0.03	0.01	0.02
query40	0.16	0.14	0.14
query41	0.07	0.01	0.01
query42	0.02	0.01	0.02
query43	0.02	0.02	0.02
Total cold run time: 103.79 s
Total hot run time: 30.61 s

@doris-robot
doris-robot
commented
Apr 19, 2025

Copy link


Copy Markdown

Load test result on machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
Load test result on commit 8bcc2f06f0b178ed05664b110e66d0cc19c75e09 with default session variables
Stream load json: 20 seconds loaded 2358488459 Bytes, about 112 MB/s
Stream load orc: 58 seconds loaded 1101869774 Bytes, about 18 MB/s
Stream load parquet: 31 seconds loaded 861443392 Bytes, about 26 MB/s
Insert into select: 22.1 seconds inserted 10000000 Rows, about 452K ops/s

@github-actions
github-actionsBot
commented
Apr 19, 2025

Copy link


Copy Markdown

Contributor
PR approved by anyone and no changes requested.
@github-actionsgithub-actionsBot
added
the 
approved
Indicates a PR has been approved by one committer.
label
Apr 19, 2025
@github-actions
github-actionsBot
commented
Apr 19, 2025

Copy link


Copy Markdown

Contributor
PR approved by at least one committer and no changes requested.
@morningman
morningman
commented
Apr 19, 2025

Copy link


Copy Markdown

ContributorAuthor
run feut
@morningman
morningman
commented
Apr 19, 2025

Copy link


Copy Markdown

ContributorAuthor
run beut
kaka11chen
kaka11chen
approved these changes
Apr 19, 2025
View reviewed changes
@kaka11chenkaka11chen
left a comment


Copy link


Copy Markdown

Contributor
Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM
@morningman
morningman
merged commit e1513de
into
apache:branch-2.0Apr 19, 2025
@morningmanmorningman
added
the 
dev/2.0.16-merged-deprecated
2.0.16 is NOT and will NOT be released
label
Apr 19, 2025
@CalvinKirs
CalvinKirs
commented
Mar 5, 2026•

edited

Loading

Copy link


Copy Markdown

Member
#35142
Sign up for freeto join this conversation on GitHub.
Already have an account?
Sign in to comment

Reviewers

@kaka11chenkaka11chenkaka11chen approved these changes
@CalvinKirsCalvinKirsCalvinKirs approved these changes
@wuwenchiwuwenchiwuwenchi approved these changes

Assignees


No one assigned


Labels

approvedIndicates a PR has been approved by one committer.dev/2.0.16-merged-deprecated2.0.16 is NOT and will NOT be releasedreviewed

Projects


None yet


Milestone


No milestone


Development

Successfully merging this pull request may close these issues.

6 participants

@morningman@Thearas@doris-robot@CalvinKirs@kaka11chen@wuwenchi