Skip to content

[feat](FE) add rest api to get last profile - #38268

Merged
englefly merged 1 commit into
apache:masterfrom
englefly:last-profile
Jul 26, 2024
Merged

[feat](FE) add rest api to get last profile#38268
englefly merged 1 commit into
apache:masterfrom
englefly:last-profile

Conversation

@englefly

@engleflyenglefly commented Jul 23, 2024

Copy link
Copy Markdown
Contributor

Proposed changes

if you want to get the profile of the query just executed, it not neccessary to find the query_id now.
this is useful to get profiles in shell script, for example, we want to get all profiles of tpcds queries (103 query profile) in a shell script.

before:
curl http://root:@127.0.0.1:8030/api/profile/text?query_id=990cc3b19e464e03-a3af05a997eb4091 > profile
after:
curl http://root:@127.0.0.1:8030/api/profile/text > profilex

Issue Number: close #xxx

@doris-robot

doris-robot commented Jul 23, 2024

Copy link
Copy Markdown

Thank you for your contribution to Apache Doris.
Don't know what should be done next? See How to process your PR

Since 2024-03-18, the Document has been moved to doris-website.
See Doris Document.

@englefly

englefly commented Jul 23, 2024

Copy link
Copy Markdown
ContributorAuthor

run buildall

@doris-robot

doris-robot commented Jul 23, 2024

Copy link
Copy Markdown
TPC-H: Total hot run time: 40118 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit ce4aa91a3607dfe56737b068826e4902dad4b61c, data reload: false
------ Round 1 ----------------------------------
q1	17962	4535	4326	4326
q2	2019	188	183	183
q3	10799	1260	1135	1135
q4	10559	763	765	763
q5	7920	2733	2730	2730
q6	223	137	138	137
q7	986	611	601	601
q8	9575	2103	2091	2091
q9	8990	6663	6690	6663
q10	9465	3740	3774	3740
q11	455	238	236	236
q12	393	223	221	221
q13	17799	3000	2957	2957
q14	273	235	230	230
q15	539	489	486	486
q16	492	381	379	379
q17	960	677	713	677
q18	8062	7420	7540	7420
q19	2094	1377	1317	1317
q20	675	309	322	309
q21	5020	3228	3282	3228
q22	351	291	289	289
Total cold run time: 115611 ms
Total hot run time: 40118 ms
----- Round 2, with runtime_filter_mode=off -----
q1	4429	4281	4259	4259
q2	359	268	270	268
q3	3000	2765	2914	2765
q4	2004	1659	1687	1659
q5	5587	5499	5520	5499
q6	223	129	130	129
q7	2201	1881	1846	1846
q8	3324	3460	3430	3430
q9	8770	8495	8698	8495
q10	4092	3854	3795	3795
q11	586	494	493	493
q12	806	634	629	629
q13	17848	3139	3217	3139
q14	314	282	305	282
q15	535	482	502	482
q16	513	435	429	429
q17	1807	1534	1536	1534
q18	8071	8110	7750	7750
q19	1746	1486	1587	1486
q20	2097	1807	1788	1788
q21	8302	4868	4810	4810
q22	628	535	505	505
Total cold run time: 77242 ms
Total hot run time: 55472 ms

@doris-robot

doris-robot commented Jul 23, 2024

Copy link
Copy Markdown
TPC-DS: Total hot run time: 173778 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit ce4aa91a3607dfe56737b068826e4902dad4b61c, data reload: false
query1	909	384	361	361
query2	6299	1857	1777	1777
query3	6656	205	218	205
query4	28183	17556	16992	16992
query5	3716	474	480	474
query6	277	170	158	158
query7	4575	292	279	279
query8	247	201	200	200
query9	8533	2447	2424	2424
query10	432	291	272	272
query11	10620	10081	10129	10081
query12	137	84	83	83
query13	1649	380	371	371
query14	10160	7628	7609	7609
query15	220	170	165	165
query16	7491	467	474	467
query17	1156	586	546	546
query18	1962	287	285	285
query19	198	154	151	151
query20	93	85	82	82
query21	214	131	126	126
query22	4290	4236	4025	4025
query23	34065	33554	33689	33554
query24	12358	2966	2962	2962
query25	706	411	429	411
query26	1831	160	155	155
query27	2952	279	289	279
query28	7781	2091	2092	2091
query29	1249	667	667	667
query30	290	151	156	151
query31	971	775	785	775
query32	99	53	57	53
query33	789	357	356	356
query34	931	509	505	505
query35	865	762	766	762
query36	1135	972	979	972
query37	283	78	84	78
query38	3001	2859	2899	2859
query39	890	822	811	811
query40	251	124	118	118
query41	44	43	43	43
query42	118	98	102	98
query43	489	459	447	447
query44	1186	726	729	726
query45	201	156	161	156
query46	1098	727	742	727
query47	1847	1785	1774	1774
query48	375	294	286	286
query49	1012	398	406	398
query50	785	383	380	380
query51	6780	6734	6618	6618
query52	102	89	94	89
query53	356	288	287	287
query54	862	450	457	450
query55	74	72	73	72
query56	292	278	267	267
query57	1160	1016	1067	1016
query58	244	257	261	257
query59	2764	2742	2536	2536
query60	310	272	269	269
query61	107	93	110	93
query62	802	649	652	649
query63	311	283	282	282
query64	10300	2224	1691	1691
query65	3171	3152	3084	3084
query66	1281	326	327	326
query67	15788	14963	14958	14958
query68	8515	554	544	544
query69	700	408	362	362
query70	1402	1138	1158	1138
query71	547	278	274	274
query72	9012	5807	5974	5807
query73	2186	365	324	324
query74	6250	5665	5630	5630
query75	5413	2691	2662	2662
query76	5254	926	904	904
query77	765	309	301	301
query78	11098	9117	8892	8892
query79	11824	538	529	529
query80	856	470	464	464
query81	583	225	227	225
query82	294	127	131	127
query83	336	163	161	161
query84	275	85	83	83
query85	894	308	343	308
query86	351	327	308	308
query87	3372	3154	3103	3103
query88	4932	2403	2398	2398
query89	532	385	389	385
query90	2202	193	190	190
query91	128	102	97	97
query92	61	48	53	48
query93	6141	509	504	504
query94	1418	297	276	276
query95	419	317	318	317
query96	604	277	286	277
query97	3151	3010	3038	3010
query98	216	198	204	198
query99	1544	1261	1287	1261
Total cold run time: 311598 ms
Total hot run time: 173778 ms

@doris-robot

doris-robot commented Jul 23, 2024

Copy link
Copy Markdown
ClickBench: Total hot run time: 30.32 s
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit ce4aa91a3607dfe56737b068826e4902dad4b61c, data reload: false
query1	0.04	0.03	0.03
query2	0.08	0.04	0.04
query3	0.22	0.05	0.05
query4	1.68	0.08	0.08
query5	0.49	0.48	0.48
query6	1.13	0.73	0.72
query7	0.01	0.01	0.01
query8	0.05	0.04	0.04
query9	0.55	0.49	0.49
query10	0.54	0.56	0.54
query11	0.15	0.11	0.11
query12	0.15	0.12	0.12
query13	0.60	0.60	0.59
query14	0.75	0.78	0.79
query15	0.86	0.83	0.81
query16	0.36	0.36	0.37
query17	0.95	1.03	0.98
query18	0.22	0.22	0.22
query19	1.76	1.68	1.80
query20	0.01	0.00	0.01
query21	15.39	0.75	0.64
query22	4.46	7.06	1.62
query23	18.27	1.43	1.28
query24	2.12	0.22	0.22
query25	0.16	0.08	0.09
query26	0.31	0.22	0.21
query27	0.45	0.24	0.23
query28	13.29	1.02	1.00
query29	12.61	3.31	3.30
query30	0.26	0.06	0.06
query31	2.85	0.39	0.39
query32	3.28	0.48	0.47
query33	2.88	2.94	2.92
query34	17.22	4.35	4.34
query35	4.43	4.40	4.41
query36	0.65	0.46	0.49
query37	0.19	0.17	0.16
query38	0.15	0.14	0.15
query39	0.04	0.04	0.03
query40	0.16	0.13	0.13
query41	0.10	0.04	0.05
query42	0.06	0.04	0.05
query43	0.05	0.04	0.03
Total cold run time: 109.98 s
Total hot run time: 30.32 s

@englefly

englefly commented Jul 24, 2024

Copy link
Copy Markdown
ContributorAuthor

run cloud_p0

@englefly

englefly commented Jul 24, 2024

Copy link
Copy Markdown
ContributorAuthor

run external

@github-actionsgithub-actionsBot added the approved Indicates a PR has been approved by one committer. label Jul 24, 2024
@github-actions

github-actionsBot commented Jul 24, 2024

Copy link
Copy Markdown
Contributor

PR approved by at least one committer and no changes requested.

@github-actions

github-actionsBot commented Jul 24, 2024

Copy link
Copy Markdown
Contributor

PR approved by anyone and no changes requested.

@englefly
englefly merged commit fd6b290 into apache:masterJul 26, 2024
@englefly
englefly deleted the last-profile branch July 26, 2024 01:21
@RoanHeNaNRoanHeNaN mentioned this pull request Jul 26, 2024
Merged
hello-stephen pushed a commit that referenced this pull request Jul 26, 2024
@RoanHeNaN
[fix](compile) Fix frontend compile fail (#38404)
930173d
#38268 and
#33690 has conflict
englefly added a commit to englefly/incubator-doris that referenced this pull request Jul 29, 2024
@englefly
[feat](FE) add rest api to get last profile (apache#38268)
ca8625c
## Proposed changes
if you want to get the profile of the query just executed, it not
neccessary to find the query_id now.
this is useful to get profiles in shell script, for example, we want to
get all profiles of tpcds queries (103 query profile) in a shell script.
before:
curl
http://root:@127.0.0.1:8030/api/profile/text?query_id=990cc3b19e464e03-a3af05a997eb4091
> profile
after:
curl http://root:@127.0.0.1:8030/api/profile/text > profilex
Issue Number: close #xxx
<!--Describe your changes.-->
@engleflyenglefly mentioned this pull request Jul 29, 2024
Merged
englefly added a commit that referenced this pull request Jul 30, 2024
@englefly
[feat](FE) add rest api to get last profile (#38268) (#38451)
377d461
## Proposed changes
pick from #38268
if you want to get the profile of the query just executed, it not
neccessary to find the query_id now.
this is useful to get profiles in shell script, for example, we want to
get all profiles of tpcds queries (103 query profile) in a shell script.
before:
curl
http://root:@127.0.0.1:8030/api/profile/text?query_id=990cc3b19e464e03-a3af05a997eb4091
> profile
after:
curl http://root:@127.0.0.1:8030/api/profile/text > profilex
Issue Number: close #xxx
<!--Describe your changes.-->
## Proposed changes
Issue Number: close #xxx
<!--Describe your changes.-->
@morrySnowmorrySnow mentioned this pull request Jul 31, 2024
Merged
morrySnow pushed a commit that referenced this pull request Jul 31, 2024
@englefly
[feat](FE) add rest api to get last profile#38268(#38450)
a6fc082
pick from master #38268
@xiaokangxiaokang mentioned this pull request Aug 3, 2024
Closed
dataroaring pushed a commit that referenced this pull request Aug 11, 2024
@englefly@dataroaring
[feat](FE) add rest api to get last profile (#38268)
746bca9
## Proposed changes
if you want to get the profile of the query just executed, it not
neccessary to find the query_id now.
this is useful to get profiles in shell script, for example, we want to
get all profiles of tpcds queries (103 query profile) in a shell script.
before:
curl
http://root:@127.0.0.1:8030/api/profile/text?query_id=990cc3b19e464e03-a3af05a997eb4091
> profile
after:
curl http://root:@127.0.0.1:8030/api/profile/text > profilex
Issue Number: close #xxx
<!--Describe your changes.-->
dataroaring pushed a commit that referenced this pull request Aug 12, 2024
@RoanHeNaN@dataroaring
[fix](compile) Fix frontend compile fail (#38404)
559c22e
#38268 and
#33690 has conflict
dataroaring pushed a commit that referenced this pull request Aug 16, 2024
@englefly@dataroaring
[feat](FE) add rest api to get last profile (#38268)
e5806f3
## Proposed changes
if you want to get the profile of the query just executed, it not
neccessary to find the query_id now.
this is useful to get profiles in shell script, for example, we want to
get all profiles of tpcds queries (103 query profile) in a shell script.
before:
curl
http://root:@127.0.0.1:8030/api/profile/text?query_id=990cc3b19e464e03-a3af05a997eb4091
> profile
after:
curl http://root:@127.0.0.1:8030/api/profile/text > profilex
Issue Number: close #xxx
<!--Describe your changes.-->
dataroaring pushed a commit that referenced this pull request Aug 16, 2024
@RoanHeNaN@dataroaring
[fix](compile) Fix frontend compile fail (#38404)
e8086b0
#38268 and
#33690 has conflict
mongo360 pushed a commit to mongo360/doris that referenced this pull request Dec 11, 2024
@engleflycaokaihua1
[feat](FE) add rest api to get last profileapache#38268(apache#38450)
0e72eb5
pick from master apache#38268
HappenLee pushed a commit to HappenLee/incubator-doris that referenced this pull request Apr 24, 2026
@englefly@HappenLee
[feat](FE) add rest api to get last profile (apache#38268)
36d91d2
## Proposed changes
if you want to get the profile of the query just executed, it not
neccessary to find the query_id now.
this is useful to get profiles in shell script, for example, we want to
get all profiles of tpcds queries (103 query profile) in a shell script.
before:
curl
http://root:@127.0.0.1:8030/api/profile/text?query_id=990cc3b19e464e03-a3af05a997eb4091
> profile
after:
curl http://root:@127.0.0.1:8030/api/profile/text > profilex
Issue Number: close #xxx
<!--Describe your changes.-->
HappenLee pushed a commit to HappenLee/incubator-doris that referenced this pull request Apr 24, 2026
@RoanHeNaN@HappenLee
[fix](compile) Fix frontend compile fail (apache#38404)
0ddab1d
apache#38268 and
apache#33690 has conflict
Sign up for freeto join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

@starocean999starocean999starocean999 approved these changes
+1 more reviewer
@LiBinfeng-01LiBinfeng-01LiBinfeng-01 approved these changes
Reviewers whose approvals may not affect merge requirements

Assignees

No one assigned

Labels

approvedIndicates a PR has been approved by one committer.dev/2.0.14-mergeddev/2.1.6-mergeddev/3.0.2-mergedreviewed

Projects

None yet

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.

7 participants

@englefly@doris-robot@starocean999@LiBinfeng-01@wm1581066@dataroaring@morrySnow