Skip to content

tools: increase macOS cores to 3 on GitHub CI - #45340

Merged
nodejs-github-bot merged 1 commit into
nodejs:mainfrom
Trott:macos-cores
Nov 6, 2022
Merged

tools: increase macOS cores to 3 on GitHub CI#45340
nodejs-github-bot merged 1 commit into
nodejs:mainfrom
Trott:macos-cores

Conversation

@Trott

@TrottTrott commented Nov 6, 2022

Copy link
Copy Markdown
Member

In efbec85, we reduced the cores to 2 based on GitHub documentation. The documentation now says that there are 3 cores.

Refs: https://docs.github.com/en/actions/using-github-hosted-runners/about-github-hosted-runners#supported-runners-and-hardware-resources

@nodejs-github-bot

Copy link
Copy Markdown
Collaborator

Review requested:

  • @nodejs/actions

@nodejs-github-botnodejs-github-bot added the meta Issues and PRs related to the general management of the project. label Nov 6, 2022
run: make build-ci -j3 V=1 CONFIG_FLAGS="--error-on-warn"
- name: Test
run: make run-ci -j2 V=1 TEST_CI_ARGS="-p actions --measure-flakiness 9"
run: make run-ci -j3 V=1 TEST_CI_ARGS="-p actions --measure-flakiness 9"

Copy link
Copy Markdown
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

@Trott Can we get the core count using bash, and remove the need to update this workflow in the future? Something like getconf _NPROCESSORS_ONLN

@TrottTrottNov 6, 2022

Copy link
Copy Markdown
MemberAuthor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

If we're sure it returns the right number on virtual machines (instead of returning the number available to the physical host that the VM is running on), yeah, that would be great. I'm going to let this run as-is so we can confirm that -j3 is faster than -j2. I'll leave a comment about that on main.

@Trott

Trott commented Nov 6, 2022

Copy link
Copy Markdown
MemberAuthor

The last successful GitHub Action (at the time of this writing) for building/testing on macOS took 1h 50m 36s for the build step, 33m 0s for the test step, and 2h 24m 49s overall. https://github.com/nodejs/node/actions/runs/3404078997/jobs/5661053610

Hopefully this will improve at least a tiny bit on those times... https://github.com/nodejs/node/actions/runs/3405116815/jobs/5662849595

@Trott

Trott commented Nov 6, 2022

Copy link
Copy Markdown
MemberAuthor

The last successful GitHub Action (at the time of this writing) for building/testing on macOS took 1h 50m 36s for the build step, 33m 0s for the test step, and 2h 24m 49s overall. https://github.com/nodejs/node/actions/runs/3404078997/jobs/5661053610

Hopefully this will improve at least a tiny bit on those times... https://github.com/nodejs/node/actions/runs/3405116815/jobs/5662849595

This cuts the build time by about 28%, around a half hour. Let's land it!

Build time went from 1h 50m 36s to 1h 19m 11s. 🚀

Test time went from 33m to 30m. Tests are parallelized by tools/test.py and not the make step, so that checks out.

Total time went form 2h 24m 49s to 1h 50m 33s. 🚀

@TrottTrott added build Issues and PRs related to build files or the CI. fast-track PRs that do not need to wait for 48 hours to land. and removed meta Issues and PRs related to the general management of the project. labels Nov 6, 2022
@github-actions

Copy link
Copy Markdown
Contributor

Fast-track has been requested by @Trott. Please 👍 to approve.

@aduh95aduh95 added the commit-queue Add this label to land a pull request using GitHub Actions. label Nov 6, 2022
@nodejs-github-botnodejs-github-bot removed the commit-queue Add this label to land a pull request using GitHub Actions. label Nov 6, 2022
@nodejs-github-bot
nodejs-github-bot merged commit f9fab41 into nodejs:mainNov 6, 2022
@nodejs-github-bot

Copy link
Copy Markdown
Collaborator

Landed in f9fab41

@Trott
Trott deleted the macos-cores branch November 7, 2022 00:09
Trott added a commit to Trott/io.js that referenced this pull request Nov 7, 2022
RafaelGSS pushed a commit that referenced this pull request Nov 10, 2022
In efbec85, we reduced the cores to 2
based on GitHub documentation. The documentation now says that there are
3 cores.
Refs: https://docs.github.com/en/actions/using-github-hosted-runners/about-github-hosted-runners#supported-runners-and-hardware-resources
PR-URL: #45340
Reviewed-By: Yagiz Nizipli <yagiz@nizipli.com>
Reviewed-By: Michaël Zasso <targos@protonmail.com>
Reviewed-By: Antoine du Hamel <duhamelantoine1995@gmail.com>
@RafaelGSSRafaelGSS mentioned this pull request Nov 10, 2022
nodejs-github-bot pushed a commit that referenced this pull request Nov 10, 2022
Refs: #45340 (comment)
PR-URL: #45350
Reviewed-By: Luigi Pinca <luigipinca@gmail.com>
Reviewed-By: Michaël Zasso <targos@protonmail.com>
ruyadorno pushed a commit that referenced this pull request Nov 21, 2022
Refs: #45340 (comment)
PR-URL: #45350
Reviewed-By: Luigi Pinca <luigipinca@gmail.com>
Reviewed-By: Michaël Zasso <targos@protonmail.com>
danielleadams pushed a commit that referenced this pull request Dec 30, 2022
In efbec85, we reduced the cores to 2
based on GitHub documentation. The documentation now says that there are
3 cores.
Refs: https://docs.github.com/en/actions/using-github-hosted-runners/about-github-hosted-runners#supported-runners-and-hardware-resources
PR-URL: #45340
Reviewed-By: Yagiz Nizipli <yagiz@nizipli.com>
Reviewed-By: Michaël Zasso <targos@protonmail.com>
Reviewed-By: Antoine du Hamel <duhamelantoine1995@gmail.com>
danielleadams pushed a commit that referenced this pull request Dec 30, 2022
Refs: #45340 (comment)
PR-URL: #45350
Reviewed-By: Luigi Pinca <luigipinca@gmail.com>
Reviewed-By: Michaël Zasso <targos@protonmail.com>
danielleadams pushed a commit that referenced this pull request Jan 3, 2023
In efbec85, we reduced the cores to 2
based on GitHub documentation. The documentation now says that there are
3 cores.
Refs: https://docs.github.com/en/actions/using-github-hosted-runners/about-github-hosted-runners#supported-runners-and-hardware-resources
PR-URL: #45340
Reviewed-By: Yagiz Nizipli <yagiz@nizipli.com>
Reviewed-By: Michaël Zasso <targos@protonmail.com>
Reviewed-By: Antoine du Hamel <duhamelantoine1995@gmail.com>
danielleadams pushed a commit that referenced this pull request Jan 3, 2023
Refs: #45340 (comment)
PR-URL: #45350
Reviewed-By: Luigi Pinca <luigipinca@gmail.com>
Reviewed-By: Michaël Zasso <targos@protonmail.com>
Sign up for freeto join this conversation on GitHub. Already have an account? Sign in to comment

Labels

buildIssues and PRs related to build files or the CI.fast-trackPRs that do not need to wait for 48 hours to land.

Projects

None yet

Development

Successfully merging this pull request may close these issues.

5 participants

@Trott@nodejs-github-bot@anonrig@targos@aduh95