Skip to content

Report benchmark statistics and comparison - #137

Draft
luispfgarces wants to merge 5 commits into
masterfrom
report_benchmark_statistics_and_comparison_2
Draft

Report benchmark statistics and comparison#137
luispfgarces wants to merge 5 commits into
masterfrom
report_benchmark_statistics_and_comparison_2

Conversation

@luispfgarces

Copy link
Copy Markdown
Contributor

Description

Please include here a description of the changes introduced by your new pull request.

Remember, it is important to include as much information as possible on the context of the changes, so that we can properly review it.

Also mention any issues to be closed with this pull request: Closes #(issue number).

Change checklist

  • Code follows the code rules guidelines of this project
  • Commit messages follow the commit rules of this project
  • I have self-reviewed my changes before submitting this pull request
  • I have covered new/changed code with new tests and/or adjusted existent ones
  • I have made changes necessary to update the documentation accordingly

Please also check the I want to contribute guidelines and make sure you have done accordingly.

Disclaimer

By sending us your contributions, you are agreeing that your contribution is made subject to the terms of our Contributor Ownership Statement

chore: refactor benchmark report results generation
chore: add new job to run benchmarks and publish results to github pr comment
fix: change outputs notation
fix: resolve notation issue
fix: resolve mispelled outputs
fix: add missing git checkout action
fix: use dotnet command to run benchmarks
fix: publish benchmarks and run binary
fix: change to run benchmark with privileges
chore: add list commands
chore: run benchmarks with dotnet and dll
chore: run benchmarks as self-contained and remove bin folder
chore: run benchmarks as framework dependent
chore: change build & run benchmarks to run from csproj
fix: add missing project switch
fix: add framework to run command
feat: produce benchmarks report on markdown format
fix: fix null reference when there are statistics missing
chore: review file permissions and list all directories and sub-directories
chore: prefix paths from current folder
chore: change to path of results
chore: consolidate change directory and determine report file
fix: set artifacts folder on chmod
fix: fix report results file path
chore: change to use event number
feat: changes to add/update a single comment with benchmarks results
chore: fix static code analysis issues and remove old logic for running benchmarks
@github-actions

github-actionsBot commented Apr 10, 2023

Copy link
Copy Markdown

Benchmark Results Report

Date & Time: 2023-04-10 21:37:06

Environment

BenchmarkDotNet Version=0.13.5

Processor=Intel(R) Xeon(R) Platinum 8171M CPU @ 2.60GHz,2 physical cores, 2 logical cores

Architecture=X64, Runtime=.NET 6.0.15 (6.0.1523.11507), Configuration=RELEASE

.NET CLI Version=7.0.202

Statistics

NameParametersMean Time TakenStd ErrorBranch
Instructions/Op
Branch
Mispredictions/Op
GC Gen0Allocated Memory
Benchmark1.RunAsync[EnableCompilation=False]27,702 ns450 ns000.42728794 B
Benchmark2.RunAsync[EnableCompilation=False]156,257 ns1,033 ns002.929755919 B
Benchmark3.RunAsync[EnableCompilation=False]3,724,889 ns19,363 ns0085.93751623834 B
Benchmark1.RunAsync[EnableCompilation=True]28,410 ns378 ns000.51889746 B
Benchmark2.RunAsync[EnableCompilation=True]5,114,277 ns28,238 ns007.8125270882 B
Benchmark3.RunAsync[EnableCompilation=True]104,973,836 ns588,151 ns00200.00006464525 B

Statistics Comparison

NameBaselineCompareMean Time Taken
[Baseline]
Mean Time Taken
[Compare]
Mean Time Taken
[Comparison %]
Allocated Memory
[Baseline]
Allocated Memory
[Compare]
Allocated Memory
[Comparison %]
Benchmark1.RunAsync[EnableCompilation=False][EnableCompilation=True]27,702 ns28,410 ns-2.56 %8794 B9746 B-10.83 %
Benchmark2.RunAsync[EnableCompilation=False][EnableCompilation=True]156,257 ns5,114,277 ns-3172.99 %55919 B270882 B-384.42 %
Benchmark3.RunAsync[EnableCompilation=False][EnableCompilation=True]3,724,889 ns104,973,836 ns-2718.17 %1623834 B6464525 B-298.1 %

Sign up for freeto join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant

@luispfgarces