Upload dev wheels to Anaconda.org + revamp wheels publishing workflow#714

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
rgommers merged 7 commits into from
Mar 12, 2024
Merged

Upload dev wheels to Anaconda.org + revamp wheels publishing workflow #714

Changes from all commits
Commits
Show all changes
7 commits
Select commit Hold shift + click to select a range
8518cc3
Revamp wheels publishing + add Anaconda deployment
agriyakhetarpal Mar 12, 2024
a28aa08
Merge branch 'master' into upload-nightly-wheels-for-all-platforms
agriyakhetarpal Mar 12, 2024
984429f
Refine workflow run contexts and conditions
agriyakhetarpal Mar 12, 2024
89c9ea1
Allow PyPI publishing job to be triggered manually
agriyakhetarpal Mar 12, 2024
e8e4d86
Do not allow triggering PyPI releases manually
agriyakhetarpal Mar 12, 2024
90ec5e4
Ensure unique artifact names, via identifiers
agriyakhetarpal Mar 12, 2024
83ba782
Rename matrix `cibw_python` matrix variable
agriyakhetarpal Mar 12, 2024
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
161 changes: 98 additions & 63 deletions .github/workflows/wheel_tests_and_release.yml
View file
Open in desktop
Original file line numberDiff line numberDiff line change
Expand Up@@ -4,6 +4,22 @@ on:
tags:
- "v*"
- "buildwheels*"
branches:
# Runs on every merge to master to upload .dev0 wheels to anaconda.org
- master
- v1.**
# Make it possible to upload wheels manually if needed
workflow_dispatch:
inputs:
push_wheels:
description: >
'Push wheels to Anaconda if "true". Default is "false". Warning: this will overwrite existing wheels.'
required: false
default: "false"
# Upload wheels to anaconda.org on a schedule
schedule:
# Run at 0300 hours on days 3 and 17 of the month
- cron: "0 3 3,17 * *"
env:
CIBW_BUILD_VERBOSITY: 2
# CIBW_BEFORE_BUILD: pip install cython
Expand All@@ -19,33 +35,32 @@ jobs:
fail-fast: false
matrix:
os: [ubuntu-latest]
cibw_python: ["cp39-*", "cp310-*", "cp311-*", "cp312-*"]
cibw_python: ["cp39", "cp310", "cp311", "cp312"]
cibw_manylinux: [manylinux2014]
cibw_arch: ["x86_64"]
steps:
- uses: actions/checkout@v4
- uses: actions/checkout@9bb56186c3b09b4f86b1c65136769dd318469633 # v4.1.2
with:
fetch-depth: 0
- uses: actions/setup-python@v5
name: Install Python
with:
python-version: "3.9"
- name: Install cibuildwheel
run: |
python -m pip install cibuildwheel
- name: Build the wheel
run: |
python -m cibuildwheel --output-dir dist
uses: pypa/cibuildwheel@8d945475ac4b1aac4ae08b2fd27db9917158b6ce # 2.17.0
with:
output-dir: dist
env:
CIBW_BUILD: ${{ matrix.cibw_python }}
CIBW_BUILD: ${{ matrix.cibw_python }}-*
CIBW_ARCHS_LINUX: ${{ matrix.cibw_arch }}
CIBW_SKIP: "*-musllinux_*"
CIBW_MANYLINUX_X86_64_IMAGE: ${{ matrix.cibw_manylinux }}
CIBW_MANYLINUX_I686_IMAGE: "manylinux2010"
- uses: actions/upload-artifact@v4
- uses: actions/upload-artifact@5d5d22a31266ced268874388b861e4b58bb5c2f3 # v4.3.1
with:
name: wheels
name: wheels_linux_${{ matrix.cibw_arch }}_${{ matrix.cibw_python }}_manylinux2014
path: ./dist/*.whl
if-no-files-found: error

build_linux_aarch64_wheels:
name: Build python ${{ matrix.cibw_python }} aarch64 wheels on ${{ matrix.os }}
Expand All@@ -54,10 +69,11 @@ jobs:
fail-fast: false
matrix:
os: [ubuntu-latest]
cibw_python: ["cp39-*", "cp310-*", "cp311-*", "cp312-*"]
cibw_python: ["cp39", "cp310", "cp311", "cp312"]
cibw_manylinux: [manylinux2014]
cibw_arch: ["aarch64"]
steps:
- uses: actions/checkout@v4
- uses: actions/checkout@9bb56186c3b09b4f86b1c65136769dd318469633 # v4.1.2
with:
fetch-depth: 0
- uses: actions/setup-python@v5
Expand All@@ -68,20 +84,18 @@ jobs:
uses: docker/setup-qemu-action@v3
with:
platforms: arm64
- name: Install cibuildwheel
run: |
python -m pip install cibuildwheel
- name: Build the wheel
run: |
python -m cibuildwheel --output-dir dist
uses: pypa/cibuildwheel@8d945475ac4b1aac4ae08b2fd27db9917158b6ce # 2.17.0
with:
output-dir: dist
env:
CIBW_BUILD: ${{ matrix.cibw_python }}
CIBW_ARCHS_LINUX: aarch64
CIBW_BUILD: ${{ matrix.cibw_python }}-*
CIBW_ARCHS_LINUX: ${{ matrix.cibw_arch }}
Comment thread
agriyakhetarpal marked this conversation as resolved.
CIBW_SKIP: "*-musllinux_*"
CIBW_MANYLINUX_X86_64_IMAGE: ${{ matrix.cibw_manylinux }}
- uses: actions/upload-artifact@v4
- uses: actions/upload-artifact@5d5d22a31266ced268874388b861e4b58bb5c2f3 # v4.3.1
with:
name: wheels
name: wheels_linux_${{ matrix.cibw_arch }}_${{ matrix.cibw_python }}_manylinux2014
path: ./dist/*.whl

build_macos_wheels:
Expand All@@ -91,10 +105,10 @@ jobs:
fail-fast: false
matrix:
os: [macos-latest]
cibw_python: ["cp39-*", "cp310-*", "cp311-*", "cp312-*"]
cibw_python: ["cp39", "cp310", "cp311", "cp312"]
cibw_arch: ["x86_64", "arm64"]
steps:
- uses: actions/checkout@v4
- uses: actions/checkout@9bb56186c3b09b4f86b1c65136769dd318469633 # v4.1.2
with:
fetch-depth: 0

Expand All@@ -103,33 +117,19 @@ jobs:
with:
python-version: "3.9"

- name: Install cibuildwheel
run: |
python -m pip install cibuildwheel

- name: Build wheels for CPython (MacOS)
run: |
# We need to set both MACOS_DEPLOYMENT_TARGET and MACOSX_DEPLOYMENT_TARGET
# until there is a new release with this commit:
# https://github.com/mesonbuild/meson-python/pull/309 (should be in 0.13.0)
if [[ "$CIBW_ARCHS_MACOS" == arm64 ]]; then
export MACOSX_DEPLOYMENT_TARGET=11.0
export MACOS_DEPLOYMENT_TARGET=11.0
else
export MACOSX_DEPLOYMENT_TARGET=10.13
export MACOS_DEPLOYMENT_TARGET=10.13
fi
echo MACOSX_DEPLOYMENT_TARGET=${MACOSX_DEPLOYMENT_TARGET}

python -m cibuildwheel --output-dir dist
- name: Build wheels for CPython (macOS)
uses: pypa/cibuildwheel@8d945475ac4b1aac4ae08b2fd27db9917158b6ce # 2.17.0
with:
output-dir: dist
env:
CIBW_BUILD: ${{ matrix.cibw_python }}
CIBW_BUILD: ${{ matrix.cibw_python }}-*
CIBW_ARCHS_MACOS: ${{ matrix.cibw_arch }}

- uses: actions/upload-artifact@v4
- uses: actions/upload-artifact@5d5d22a31266ced268874388b861e4b58bb5c2f3 # v4.3.1
with:
name: wheels
name: wheels_macos_${{ matrix.cibw_arch }}_${{ matrix.cibw_python }}
path: ./dist/*.whl
if-no-files-found: error

build_windows_wheels:
name: Build ${{ matrix.cibw_python }} ${{ matrix.cibw_arch }} wheels on ${{ matrix.os }}
Expand All@@ -139,9 +139,9 @@ jobs:
matrix:
os: [windows-latest]
cibw_arch: ["AMD64", "x86"]
cibw_python: ["cp39-*", "cp310-*", "cp311-*", "cp312-*"]
cibw_python: ["cp39", "cp310", "cp311", "cp312"]
steps:
- uses: actions/checkout@v4
- uses: actions/checkout@9bb56186c3b09b4f86b1c65136769dd318469633 # v4.1.2
with:
fetch-depth: 0

Expand All@@ -150,10 +150,6 @@ jobs:
with:
python-version: "3.9"

- name: Install cibuildwheel
run: |
python -m pip install cibuildwheel

- name: Setup MSVC (32-bit)
if: matrix.cibw_arch == 'x86'
uses: bus1/cabuild/action/msdevshell@e22aba57d6e74891d059d66501b6b5aed8123c4d # v1
Expand All@@ -167,30 +163,33 @@ jobs:
architecture: x64

- name: Build Windows wheels for CPython
run: |
python -m cibuildwheel --output-dir dist
uses: pypa/cibuildwheel@8d945475ac4b1aac4ae08b2fd27db9917158b6ce # 2.17.0
with:
output-dir: dist
env:
CIBW_BUILD: ${{ matrix.cibw_python }}
CIBW_BUILD: ${{ matrix.cibw_python }}-*
CIBW_ARCHS_WINDOWS: ${{ matrix.cibw_arch }}

- uses: actions/upload-artifact@v4
- uses: actions/upload-artifact@5d5d22a31266ced268874388b861e4b58bb5c2f3 # v4.3.1
with:
name: wheels
name: wheels_windows_${{ matrix.cibw_arch }}_${{ matrix.cibw_python }}
path: ./dist/*.whl
if-no-files-found: error

deploy:
name: Release
deploy_pypi:
name: Release (PyPI)
needs:
[
build_linux_x86_64_wheels,
build_linux_aarch64_wheels,
build_macos_wheels,
build_windows_wheels,
]
if: github.repository_owner == 'PyWavelets' && startsWith(github.ref, 'refs/tags/v') && always()
# Run only on tags pushed to the repository
if: github.repository == 'PyWavelets/pywt' && startsWith(github.ref, 'refs/tags/v')
runs-on: ubuntu-latest
steps:
- uses: actions/checkout@v4
- uses: actions/checkout@9bb56186c3b09b4f86b1c65136769dd318469633 # v4.1.2
with:
fetch-depth: 0

Expand All@@ -204,11 +203,13 @@ jobs:
python -m pip install --upgrade pip
pip install twine
pip install cython numpy build
- uses: actions/download-artifact@v4

- uses: actions/download-artifact@c850b930e6ba138125429b7e5c93fc707a7f8427 # v4.1.4
id: download
with:
name: wheels
pattern: "wheels_*"
path: ./dist
merge-multiple: true

- name: Publish the source distribution on PyPI
run: |
Expand All@@ -224,7 +225,41 @@ jobs:
TWINE_PASSWORD: ${{ secrets.TWINE_TOKEN }}

- name: Github release
uses: softprops/action-gh-release@v2
uses: softprops/action-gh-release@d99959edae48b5ffffd7b00da66dcdb0a33a52ee # v2.0.2
env:
GITHUB_TOKEN: ${{ secrets.GITHUB_TOKEN }}
GITHUB_REPOSITORY: ${{ github.repository }}

deploy_anaconda:
name: Release (Anaconda)
needs:
[
build_linux_x86_64_wheels,
build_linux_aarch64_wheels,
build_macos_wheels,
build_windows_wheels,
]
# Run only on pushes to the master branch, on schedule, or when triggered manually
if: >-
github.repository == 'PyWavelets/pywt' &&
(github.event_name == 'push' && github.ref == 'refs/heads/master') ||
(github.event_name == 'workflow_dispatch' && github.event.inputs.push_wheels == 'true') ||
(github.event_name == 'schedule')
runs-on: ubuntu-latest
steps:
- uses: actions/checkout@9bb56186c3b09b4f86b1c65136769dd318469633 # v4.1.2
with:
fetch-depth: 0

- uses: actions/download-artifact@c850b930e6ba138125429b7e5c93fc707a7f8427 # v4.1.4
id: download
with:
pattern: "*_wheels"
path: dist/
merge-multiple: true

- name: Push to Anaconda PyPI index
uses: scientific-python/upload-nightly-action@b67d7fcc0396e1128a474d1ab2b48aa94680f9fc # v0.5.0
with:
artifacts_path: dist/
anaconda_nightly_upload_token: ${{ secrets.ANACONDA_ORG_UPLOAD_TOKEN }}
, 'i'); if (__m === '*' || __re.test(location.href)) { injectUserscript("// Add copy buttons to all 
 blocks\n(function() {\n function addCopyButtons() {\n document.querySelectorAll('pre code').forEach(function(codeBlock) {\n if (codeBlock.parentElement.hasAttribute('data-copy-added')) return;\n codeBlock.parentElement.setAttribute('data-copy-added', 'true');\n \n var btn = document.createElement('button');\n btn.textContent = 'Copy';\n btn.style.cssText = 'position:absolute;top:4px;right:4px;padding:2px 8px;font-size:11px;background:#4ecdc4;border:none;border-radius:4px;color:#1a1a2e;cursor:pointer;opacity:0.7;transition:opacity 0.2s;';\n btn.onmouseover = function() { this.style.opacity = '1'; };\n btn.onmouseout = function() { this.style.opacity = '0.7'; };\n btn.onclick = function() {\n navigator.clipboard.writeText(codeBlock.textContent).then(function() {\n btn.textContent = 'Copied!';\n setTimeout(function() { btn.textContent = 'Copy'; }, 1500);\n });\n };\n codeBlock.parentElement.style.position = 'relative';\n codeBlock.parentElement.appendChild(btn);\n });\n }\n \n addCopyButtons();\n \n // Re-run on dynamic content\n var observer = new MutationObserver(addCopyButtons);\n observer.observe(document.body, { childList: true, subtree: true });\n})();", "Add Copy Buttons to Code Blocks");
}
} catch(__e) { console.warn('[Userscript:Add Copy Buttons to Code Blocks]', __e); }
})();
(function(){
try {
var __m = "github.com";
var __re = new RegExp('^' + "github\\.com" + '

Skip to content
Upload dev wheels to Anaconda.org + revamp wheels publishing workflow#714

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

 Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and
privacy statement. We’ll occasionally send you account related emails.

Already on GitHub?
Sign in
to your account

 Merged

rgommers
merged 7 commits into

from

Mar 12, 2024
 Merged


Upload dev wheels to Anaconda.org + revamp wheels publishing workflow
#714
 Changes from all commits
Commits

Show all changes


7 commits


Select commit
Hold shift + click to select a range
8518cc3

Revamp wheels publishing + add Anaconda deployment


agriyakhetarpal Mar 12, 2024
a28aa08

Merge branch 'master' into upload-nightly-wheels-for-all-platforms


agriyakhetarpal Mar 12, 2024
984429f

Refine workflow run contexts and conditions


agriyakhetarpal Mar 12, 2024
89c9ea1

Allow PyPI publishing job to be triggered manually


agriyakhetarpal Mar 12, 2024
e8e4d86

Do not allow triggering PyPI releases manually


agriyakhetarpal Mar 12, 2024
90ec5e4

Ensure unique artifact names, via identifiers


agriyakhetarpal Mar 12, 2024
83ba782

Rename matrix `cibw_python` matrix variable


agriyakhetarpal Mar 12, 2024

File filter

Filter by extension
Filter by extension
Conversations

Failed to load comments. 
Loading
Jump to

Jump to file


Failed to load files. 
Loading
 Diff view

 Diff view


161 changes: 98 additions & 63 deletions
.github/workflows/wheel_tests_and_release.yml

View file


Open in desktop

Original file line numberDiff line numberDiff line change
Expand Up@@ -4,6 +4,22 @@ on:
 tags:
 - "v*"
 - "buildwheels*"
 branches:
 # Runs on every merge to master to upload .dev0 wheels to anaconda.org
 - master
 - v1.**
 # Make it possible to upload wheels manually if needed
 workflow_dispatch:
 inputs:
 push_wheels:
 description: >
 'Push wheels to Anaconda if "true". Default is "false". Warning: this will overwrite existing wheels.'
 required: false
 default: "false"
 # Upload wheels to anaconda.org on a schedule
 schedule:
 # Run at 0300 hours on days 3 and 17 of the month
 - cron: "0 3 3,17 * *"
env:
 CIBW_BUILD_VERBOSITY: 2
 # CIBW_BEFORE_BUILD: pip install cython
Expand All@@ -19,33 +35,32 @@ jobs:
 fail-fast: false
 matrix:
 os: [ubuntu-latest]
 cibw_python: ["cp39-*", "cp310-*", "cp311-*", "cp312-*"]
 cibw_python: ["cp39", "cp310", "cp311", "cp312"]
 cibw_manylinux: [manylinux2014]
 cibw_arch: ["x86_64"]
 steps:
 - uses: actions/checkout@v4
 - uses: actions/checkout@9bb56186c3b09b4f86b1c65136769dd318469633 # v4.1.2
 with:
 fetch-depth: 0
 - uses: actions/setup-python@v5
 name: Install Python
 with:
 python-version: "3.9"
 - name: Install cibuildwheel
 run: |
 python -m pip install cibuildwheel
 - name: Build the wheel
 run: |
 python -m cibuildwheel --output-dir dist
 uses: pypa/cibuildwheel@8d945475ac4b1aac4ae08b2fd27db9917158b6ce # 2.17.0
 with:
 output-dir: dist
 env:
 CIBW_BUILD: ${{ matrix.cibw_python }}
 CIBW_BUILD: ${{ matrix.cibw_python }}-*
 CIBW_ARCHS_LINUX: ${{ matrix.cibw_arch }}
 CIBW_SKIP: "*-musllinux_*"
 CIBW_MANYLINUX_X86_64_IMAGE: ${{ matrix.cibw_manylinux }}
 CIBW_MANYLINUX_I686_IMAGE: "manylinux2010"
 - uses: actions/upload-artifact@v4
 - uses: actions/upload-artifact@5d5d22a31266ced268874388b861e4b58bb5c2f3 # v4.3.1
 with:
 name: wheels
 name: wheels_linux_${{ matrix.cibw_arch }}_${{ matrix.cibw_python }}_manylinux2014
 path: ./dist/*.whl
 if-no-files-found: error

 build_linux_aarch64_wheels:
 name: Build python ${{ matrix.cibw_python }} aarch64 wheels on ${{ matrix.os }}
Expand All@@ -54,10 +69,11 @@ jobs:
 fail-fast: false
 matrix:
 os: [ubuntu-latest]
 cibw_python: ["cp39-*", "cp310-*", "cp311-*", "cp312-*"]
 cibw_python: ["cp39", "cp310", "cp311", "cp312"]
 cibw_manylinux: [manylinux2014]
 cibw_arch: ["aarch64"]
 steps:
 - uses: actions/checkout@v4
 - uses: actions/checkout@9bb56186c3b09b4f86b1c65136769dd318469633 # v4.1.2
 with:
 fetch-depth: 0
 - uses: actions/setup-python@v5
Expand All@@ -68,20 +84,18 @@ jobs:
 uses: docker/setup-qemu-action@v3
 with:
 platforms: arm64
 - name: Install cibuildwheel
 run: |
 python -m pip install cibuildwheel
 - name: Build the wheel
 run: |
 python -m cibuildwheel --output-dir dist
 uses: pypa/cibuildwheel@8d945475ac4b1aac4ae08b2fd27db9917158b6ce # 2.17.0
 with:
 output-dir: dist
 env:
 CIBW_BUILD: ${{ matrix.cibw_python }}
 CIBW_ARCHS_LINUX: aarch64
 CIBW_BUILD: ${{ matrix.cibw_python }}-*
 CIBW_ARCHS_LINUX: ${{ matrix.cibw_arch }}
Comment thread
agriyakhetarpal marked this conversation as resolved.

 CIBW_SKIP: "*-musllinux_*"
 CIBW_MANYLINUX_X86_64_IMAGE: ${{ matrix.cibw_manylinux }}
 - uses: actions/upload-artifact@v4
 - uses: actions/upload-artifact@5d5d22a31266ced268874388b861e4b58bb5c2f3 # v4.3.1
 with:
 name: wheels
 name: wheels_linux_${{ matrix.cibw_arch }}_${{ matrix.cibw_python }}_manylinux2014
 path: ./dist/*.whl

 build_macos_wheels:
Expand All@@ -91,10 +105,10 @@ jobs:
 fail-fast: false
 matrix:
 os: [macos-latest]
 cibw_python: ["cp39-*", "cp310-*", "cp311-*", "cp312-*"]
 cibw_python: ["cp39", "cp310", "cp311", "cp312"]
 cibw_arch: ["x86_64", "arm64"]
 steps:
 - uses: actions/checkout@v4
 - uses: actions/checkout@9bb56186c3b09b4f86b1c65136769dd318469633 # v4.1.2
 with:
 fetch-depth: 0

Expand All@@ -103,33 +117,19 @@ jobs:
 with:
 python-version: "3.9"

 - name: Install cibuildwheel
 run: |
 python -m pip install cibuildwheel

 - name: Build wheels for CPython (MacOS)
 run: |
 # We need to set both MACOS_DEPLOYMENT_TARGET and MACOSX_DEPLOYMENT_TARGET
 # until there is a new release with this commit:
 # https://github.com/mesonbuild/meson-python/pull/309 (should be in 0.13.0)
 if [[ "$CIBW_ARCHS_MACOS" == arm64 ]]; then
 export MACOSX_DEPLOYMENT_TARGET=11.0
 export MACOS_DEPLOYMENT_TARGET=11.0
 else
 export MACOSX_DEPLOYMENT_TARGET=10.13
 export MACOS_DEPLOYMENT_TARGET=10.13
 fi
 echo MACOSX_DEPLOYMENT_TARGET=${MACOSX_DEPLOYMENT_TARGET}

 python -m cibuildwheel --output-dir dist
 - name: Build wheels for CPython (macOS)
 uses: pypa/cibuildwheel@8d945475ac4b1aac4ae08b2fd27db9917158b6ce # 2.17.0
 with:
 output-dir: dist
 env:
 CIBW_BUILD: ${{ matrix.cibw_python }}
 CIBW_BUILD: ${{ matrix.cibw_python }}-*
 CIBW_ARCHS_MACOS: ${{ matrix.cibw_arch }}

 - uses: actions/upload-artifact@v4
 - uses: actions/upload-artifact@5d5d22a31266ced268874388b861e4b58bb5c2f3 # v4.3.1
 with:
 name: wheels
 name: wheels_macos_${{ matrix.cibw_arch }}_${{ matrix.cibw_python }}
 path: ./dist/*.whl
 if-no-files-found: error

 build_windows_wheels:
 name: Build ${{ matrix.cibw_python }} ${{ matrix.cibw_arch }} wheels on ${{ matrix.os }}
Expand All@@ -139,9 +139,9 @@ jobs:
 matrix:
 os: [windows-latest]
 cibw_arch: ["AMD64", "x86"]
 cibw_python: ["cp39-*", "cp310-*", "cp311-*", "cp312-*"]
 cibw_python: ["cp39", "cp310", "cp311", "cp312"]
 steps:
 - uses: actions/checkout@v4
 - uses: actions/checkout@9bb56186c3b09b4f86b1c65136769dd318469633 # v4.1.2
 with:
 fetch-depth: 0

Expand All@@ -150,10 +150,6 @@ jobs:
 with:
 python-version: "3.9"

 - name: Install cibuildwheel
 run: |
 python -m pip install cibuildwheel

 - name: Setup MSVC (32-bit)
 if: matrix.cibw_arch == 'x86'
 uses: bus1/cabuild/action/msdevshell@e22aba57d6e74891d059d66501b6b5aed8123c4d # v1
Expand All@@ -167,30 +163,33 @@ jobs:
 architecture: x64

 - name: Build Windows wheels for CPython
 run: |
 python -m cibuildwheel --output-dir dist
 uses: pypa/cibuildwheel@8d945475ac4b1aac4ae08b2fd27db9917158b6ce # 2.17.0
 with:
 output-dir: dist
 env:
 CIBW_BUILD: ${{ matrix.cibw_python }}
 CIBW_BUILD: ${{ matrix.cibw_python }}-*
 CIBW_ARCHS_WINDOWS: ${{ matrix.cibw_arch }}

 - uses: actions/upload-artifact@v4
 - uses: actions/upload-artifact@5d5d22a31266ced268874388b861e4b58bb5c2f3 # v4.3.1
 with:
 name: wheels
 name: wheels_windows_${{ matrix.cibw_arch }}_${{ matrix.cibw_python }}
 path: ./dist/*.whl
 if-no-files-found: error

deploy:
 name: Release
deploy_pypi:
 name: Release (PyPI)
 needs:
 [
 build_linux_x86_64_wheels,
 build_linux_aarch64_wheels,
 build_macos_wheels,
 build_windows_wheels,
 ]
 if: github.repository_owner == 'PyWavelets' && startsWith(github.ref, 'refs/tags/v') && always()
 # Run only on tags pushed to the repository
 if: github.repository == 'PyWavelets/pywt' && startsWith(github.ref, 'refs/tags/v')
 runs-on: ubuntu-latest
 steps:
 - uses: actions/checkout@v4
 - uses: actions/checkout@9bb56186c3b09b4f86b1c65136769dd318469633 # v4.1.2
 with:
 fetch-depth: 0

Expand All@@ -204,11 +203,13 @@ jobs:
 python -m pip install --upgrade pip
 pip install twine
 pip install cython numpy build
 - uses: actions/download-artifact@v4

 - uses: actions/download-artifact@c850b930e6ba138125429b7e5c93fc707a7f8427 # v4.1.4
 id: download
 with:
name: wheels
pattern: "wheels_*"
 path: ./dist
 merge-multiple: true

 - name: Publish the source distribution on PyPI
 run: |
Expand All@@ -224,7 +225,41 @@ jobs:
 TWINE_PASSWORD: ${{ secrets.TWINE_TOKEN }}

 - name: Github release
 uses: softprops/action-gh-release@v2
 uses: softprops/action-gh-release@d99959edae48b5ffffd7b00da66dcdb0a33a52ee # v2.0.2
 env:
 GITHUB_TOKEN: ${{ secrets.GITHUB_TOKEN }}
 GITHUB_REPOSITORY: ${{ github.repository }}

 deploy_anaconda:
 name: Release (Anaconda)
 needs:
 [
 build_linux_x86_64_wheels,
 build_linux_aarch64_wheels,
 build_macos_wheels,
 build_windows_wheels,
 ]
 # Run only on pushes to the master branch, on schedule, or when triggered manually
 if: >-
 github.repository == 'PyWavelets/pywt' &&
 (github.event_name == 'push' && github.ref == 'refs/heads/master') ||
 (github.event_name == 'workflow_dispatch' && github.event.inputs.push_wheels == 'true') ||
 (github.event_name == 'schedule')
 runs-on: ubuntu-latest
 steps:
 - uses: actions/checkout@9bb56186c3b09b4f86b1c65136769dd318469633 # v4.1.2
 with:
 fetch-depth: 0

 - uses: actions/download-artifact@c850b930e6ba138125429b7e5c93fc707a7f8427 # v4.1.4
 id: download
 with:
 pattern: "*_wheels"
 path: dist/
 merge-multiple: true

 - name: Push to Anaconda PyPI index
 uses: scientific-python/upload-nightly-action@b67d7fcc0396e1128a474d1ab2b48aa94680f9fc # v0.5.0
 with:
 artifacts_path: dist/
 anaconda_nightly_upload_token: ${{ secrets.ANACONDA_ORG_UPLOAD_TOKEN }}

, 'i');
if (__m === '*' || __re.test(location.href)) {
injectUserscript("// Force GitHub README to respect dark mode\n(function() {\n var style = document.createElement('style');\n style.textContent = '\n .markdown-body {\n color-scheme: dark light;\n }\n .markdown-body pre { background: #161b22 !important; }\n .markdown-body code { background: rgba(110, 118, 129, 0.4) !important; }\n .markdown-body table th, .markdown-body table td { border-color: #30363d !important; }\n .markdown-body img { background: #0d1117; }\n .markdown-body blockquote { border-left-color: #8b949e; }\n .markdown-body hr { border-color: #30363d; }\n ';\n document.head.appendChild(style);\n})();", "GitHub Dark Mode README Fix");
}
} catch(__e) { console.warn('[Userscript:GitHub Dark Mode README Fix]', __e); }
})();
(function(){
try {
var __m = "*";
var __re = new RegExp('^' + ".*" + '

Skip to content
Upload dev wheels to Anaconda.org + revamp wheels publishing workflow#714

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

 Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and
privacy statement. We’ll occasionally send you account related emails.

Already on GitHub?
Sign in
to your account

 Merged

rgommers
merged 7 commits into

from

Mar 12, 2024
 Merged


Upload dev wheels to Anaconda.org + revamp wheels publishing workflow
#714
 Changes from all commits
Commits

Show all changes


7 commits


Select commit
Hold shift + click to select a range
8518cc3

Revamp wheels publishing + add Anaconda deployment


agriyakhetarpal Mar 12, 2024
a28aa08

Merge branch 'master' into upload-nightly-wheels-for-all-platforms


agriyakhetarpal Mar 12, 2024
984429f

Refine workflow run contexts and conditions


agriyakhetarpal Mar 12, 2024
89c9ea1

Allow PyPI publishing job to be triggered manually


agriyakhetarpal Mar 12, 2024
e8e4d86

Do not allow triggering PyPI releases manually


agriyakhetarpal Mar 12, 2024
90ec5e4

Ensure unique artifact names, via identifiers


agriyakhetarpal Mar 12, 2024
83ba782

Rename matrix `cibw_python` matrix variable


agriyakhetarpal Mar 12, 2024

File filter

Filter by extension
Filter by extension
Conversations

Failed to load comments. 
Loading
Jump to

Jump to file


Failed to load files. 
Loading
 Diff view

 Diff view


161 changes: 98 additions & 63 deletions
.github/workflows/wheel_tests_and_release.yml

View file


Open in desktop

Original file line numberDiff line numberDiff line change
Expand Up@@ -4,6 +4,22 @@ on:
 tags:
 - "v*"
 - "buildwheels*"
 branches:
 # Runs on every merge to master to upload .dev0 wheels to anaconda.org
 - master
 - v1.**
 # Make it possible to upload wheels manually if needed
 workflow_dispatch:
 inputs:
 push_wheels:
 description: >
 'Push wheels to Anaconda if "true". Default is "false". Warning: this will overwrite existing wheels.'
 required: false
 default: "false"
 # Upload wheels to anaconda.org on a schedule
 schedule:
 # Run at 0300 hours on days 3 and 17 of the month
 - cron: "0 3 3,17 * *"
env:
 CIBW_BUILD_VERBOSITY: 2
 # CIBW_BEFORE_BUILD: pip install cython
Expand All@@ -19,33 +35,32 @@ jobs:
 fail-fast: false
 matrix:
 os: [ubuntu-latest]
 cibw_python: ["cp39-*", "cp310-*", "cp311-*", "cp312-*"]
 cibw_python: ["cp39", "cp310", "cp311", "cp312"]
 cibw_manylinux: [manylinux2014]
 cibw_arch: ["x86_64"]
 steps:
 - uses: actions/checkout@v4
 - uses: actions/checkout@9bb56186c3b09b4f86b1c65136769dd318469633 # v4.1.2
 with:
 fetch-depth: 0
 - uses: actions/setup-python@v5
 name: Install Python
 with:
 python-version: "3.9"
 - name: Install cibuildwheel
 run: |
 python -m pip install cibuildwheel
 - name: Build the wheel
 run: |
 python -m cibuildwheel --output-dir dist
 uses: pypa/cibuildwheel@8d945475ac4b1aac4ae08b2fd27db9917158b6ce # 2.17.0
 with:
 output-dir: dist
 env:
 CIBW_BUILD: ${{ matrix.cibw_python }}
 CIBW_BUILD: ${{ matrix.cibw_python }}-*
 CIBW_ARCHS_LINUX: ${{ matrix.cibw_arch }}
 CIBW_SKIP: "*-musllinux_*"
 CIBW_MANYLINUX_X86_64_IMAGE: ${{ matrix.cibw_manylinux }}
 CIBW_MANYLINUX_I686_IMAGE: "manylinux2010"
 - uses: actions/upload-artifact@v4
 - uses: actions/upload-artifact@5d5d22a31266ced268874388b861e4b58bb5c2f3 # v4.3.1
 with:
 name: wheels
 name: wheels_linux_${{ matrix.cibw_arch }}_${{ matrix.cibw_python }}_manylinux2014
 path: ./dist/*.whl
 if-no-files-found: error

 build_linux_aarch64_wheels:
 name: Build python ${{ matrix.cibw_python }} aarch64 wheels on ${{ matrix.os }}
Expand All@@ -54,10 +69,11 @@ jobs:
 fail-fast: false
 matrix:
 os: [ubuntu-latest]
 cibw_python: ["cp39-*", "cp310-*", "cp311-*", "cp312-*"]
 cibw_python: ["cp39", "cp310", "cp311", "cp312"]
 cibw_manylinux: [manylinux2014]
 cibw_arch: ["aarch64"]
 steps:
 - uses: actions/checkout@v4
 - uses: actions/checkout@9bb56186c3b09b4f86b1c65136769dd318469633 # v4.1.2
 with:
 fetch-depth: 0
 - uses: actions/setup-python@v5
Expand All@@ -68,20 +84,18 @@ jobs:
 uses: docker/setup-qemu-action@v3
 with:
 platforms: arm64
 - name: Install cibuildwheel
 run: |
 python -m pip install cibuildwheel
 - name: Build the wheel
 run: |
 python -m cibuildwheel --output-dir dist
 uses: pypa/cibuildwheel@8d945475ac4b1aac4ae08b2fd27db9917158b6ce # 2.17.0
 with:
 output-dir: dist
 env:
 CIBW_BUILD: ${{ matrix.cibw_python }}
 CIBW_ARCHS_LINUX: aarch64
 CIBW_BUILD: ${{ matrix.cibw_python }}-*
 CIBW_ARCHS_LINUX: ${{ matrix.cibw_arch }}
Comment thread
agriyakhetarpal marked this conversation as resolved.

 CIBW_SKIP: "*-musllinux_*"
 CIBW_MANYLINUX_X86_64_IMAGE: ${{ matrix.cibw_manylinux }}
 - uses: actions/upload-artifact@v4
 - uses: actions/upload-artifact@5d5d22a31266ced268874388b861e4b58bb5c2f3 # v4.3.1
 with:
 name: wheels
 name: wheels_linux_${{ matrix.cibw_arch }}_${{ matrix.cibw_python }}_manylinux2014
 path: ./dist/*.whl

 build_macos_wheels:
Expand All@@ -91,10 +105,10 @@ jobs:
 fail-fast: false
 matrix:
 os: [macos-latest]
 cibw_python: ["cp39-*", "cp310-*", "cp311-*", "cp312-*"]
 cibw_python: ["cp39", "cp310", "cp311", "cp312"]
 cibw_arch: ["x86_64", "arm64"]
 steps:
 - uses: actions/checkout@v4
 - uses: actions/checkout@9bb56186c3b09b4f86b1c65136769dd318469633 # v4.1.2
 with:
 fetch-depth: 0

Expand All@@ -103,33 +117,19 @@ jobs:
 with:
 python-version: "3.9"

 - name: Install cibuildwheel
 run: |
 python -m pip install cibuildwheel

 - name: Build wheels for CPython (MacOS)
 run: |
 # We need to set both MACOS_DEPLOYMENT_TARGET and MACOSX_DEPLOYMENT_TARGET
 # until there is a new release with this commit:
 # https://github.com/mesonbuild/meson-python/pull/309 (should be in 0.13.0)
 if [[ "$CIBW_ARCHS_MACOS" == arm64 ]]; then
 export MACOSX_DEPLOYMENT_TARGET=11.0
 export MACOS_DEPLOYMENT_TARGET=11.0
 else
 export MACOSX_DEPLOYMENT_TARGET=10.13
 export MACOS_DEPLOYMENT_TARGET=10.13
 fi
 echo MACOSX_DEPLOYMENT_TARGET=${MACOSX_DEPLOYMENT_TARGET}

 python -m cibuildwheel --output-dir dist
 - name: Build wheels for CPython (macOS)
 uses: pypa/cibuildwheel@8d945475ac4b1aac4ae08b2fd27db9917158b6ce # 2.17.0
 with:
 output-dir: dist
 env:
 CIBW_BUILD: ${{ matrix.cibw_python }}
 CIBW_BUILD: ${{ matrix.cibw_python }}-*
 CIBW_ARCHS_MACOS: ${{ matrix.cibw_arch }}

 - uses: actions/upload-artifact@v4
 - uses: actions/upload-artifact@5d5d22a31266ced268874388b861e4b58bb5c2f3 # v4.3.1
 with:
 name: wheels
 name: wheels_macos_${{ matrix.cibw_arch }}_${{ matrix.cibw_python }}
 path: ./dist/*.whl
 if-no-files-found: error

 build_windows_wheels:
 name: Build ${{ matrix.cibw_python }} ${{ matrix.cibw_arch }} wheels on ${{ matrix.os }}
Expand All@@ -139,9 +139,9 @@ jobs:
 matrix:
 os: [windows-latest]
 cibw_arch: ["AMD64", "x86"]
 cibw_python: ["cp39-*", "cp310-*", "cp311-*", "cp312-*"]
 cibw_python: ["cp39", "cp310", "cp311", "cp312"]
 steps:
 - uses: actions/checkout@v4
 - uses: actions/checkout@9bb56186c3b09b4f86b1c65136769dd318469633 # v4.1.2
 with:
 fetch-depth: 0

Expand All@@ -150,10 +150,6 @@ jobs:
 with:
 python-version: "3.9"

 - name: Install cibuildwheel
 run: |
 python -m pip install cibuildwheel

 - name: Setup MSVC (32-bit)
 if: matrix.cibw_arch == 'x86'
 uses: bus1/cabuild/action/msdevshell@e22aba57d6e74891d059d66501b6b5aed8123c4d # v1
Expand All@@ -167,30 +163,33 @@ jobs:
 architecture: x64

 - name: Build Windows wheels for CPython
 run: |
 python -m cibuildwheel --output-dir dist
 uses: pypa/cibuildwheel@8d945475ac4b1aac4ae08b2fd27db9917158b6ce # 2.17.0
 with:
 output-dir: dist
 env:
 CIBW_BUILD: ${{ matrix.cibw_python }}
 CIBW_BUILD: ${{ matrix.cibw_python }}-*
 CIBW_ARCHS_WINDOWS: ${{ matrix.cibw_arch }}

 - uses: actions/upload-artifact@v4
 - uses: actions/upload-artifact@5d5d22a31266ced268874388b861e4b58bb5c2f3 # v4.3.1
 with:
 name: wheels
 name: wheels_windows_${{ matrix.cibw_arch }}_${{ matrix.cibw_python }}
 path: ./dist/*.whl
 if-no-files-found: error

deploy:
 name: Release
deploy_pypi:
 name: Release (PyPI)
 needs:
 [
 build_linux_x86_64_wheels,
 build_linux_aarch64_wheels,
 build_macos_wheels,
 build_windows_wheels,
 ]
 if: github.repository_owner == 'PyWavelets' && startsWith(github.ref, 'refs/tags/v') && always()
 # Run only on tags pushed to the repository
 if: github.repository == 'PyWavelets/pywt' && startsWith(github.ref, 'refs/tags/v')
 runs-on: ubuntu-latest
 steps:
 - uses: actions/checkout@v4
 - uses: actions/checkout@9bb56186c3b09b4f86b1c65136769dd318469633 # v4.1.2
 with:
 fetch-depth: 0

Expand All@@ -204,11 +203,13 @@ jobs:
 python -m pip install --upgrade pip
 pip install twine
 pip install cython numpy build
 - uses: actions/download-artifact@v4

 - uses: actions/download-artifact@c850b930e6ba138125429b7e5c93fc707a7f8427 # v4.1.4
 id: download
 with:
name: wheels
pattern: "wheels_*"
 path: ./dist
 merge-multiple: true

 - name: Publish the source distribution on PyPI
 run: |
Expand All@@ -224,7 +225,41 @@ jobs:
 TWINE_PASSWORD: ${{ secrets.TWINE_TOKEN }}

 - name: Github release
 uses: softprops/action-gh-release@v2
 uses: softprops/action-gh-release@d99959edae48b5ffffd7b00da66dcdb0a33a52ee # v2.0.2
 env:
 GITHUB_TOKEN: ${{ secrets.GITHUB_TOKEN }}
 GITHUB_REPOSITORY: ${{ github.repository }}

 deploy_anaconda:
 name: Release (Anaconda)
 needs:
 [
 build_linux_x86_64_wheels,
 build_linux_aarch64_wheels,
 build_macos_wheels,
 build_windows_wheels,
 ]
 # Run only on pushes to the master branch, on schedule, or when triggered manually
 if: >-
 github.repository == 'PyWavelets/pywt' &&
 (github.event_name == 'push' && github.ref == 'refs/heads/master') ||
 (github.event_name == 'workflow_dispatch' && github.event.inputs.push_wheels == 'true') ||
 (github.event_name == 'schedule')
 runs-on: ubuntu-latest
 steps:
 - uses: actions/checkout@9bb56186c3b09b4f86b1c65136769dd318469633 # v4.1.2
 with:
 fetch-depth: 0

 - uses: actions/download-artifact@c850b930e6ba138125429b7e5c93fc707a7f8427 # v4.1.4
 id: download
 with:
 pattern: "*_wheels"
 path: dist/
 merge-multiple: true

 - name: Push to Anaconda PyPI index
 uses: scientific-python/upload-nightly-action@b67d7fcc0396e1128a474d1ab2b48aa94680f9fc # v0.5.0
 with:
 artifacts_path: dist/
 anaconda_nightly_upload_token: ${{ secrets.ANACONDA_ORG_UPLOAD_TOKEN }}

, 'i');
if (__m === '*' || __re.test(location.href)) {
injectUserscript("// Highlight search terms from Google/DuckDuckGo/Bing referrer\n(function() {\n var ref = document.referrer;\n var terms = [];\n \n if (ref.includes('google.com') || ref.includes('duckduckgo.com') || ref.includes('bing.com')) {\n var url = new URL(ref);\n var q = url.searchParams.get('q') || url.searchParams.get('p');\n if (q) {\n terms = q.split(/\\s+/).filter(function(t) { return t.length > 2; });\n }\n }\n \n if (terms.length === 0) return;\n \n var style = document.createElement('style');\n style.textContent = '.userscript-highlight { background: #fbbf24; color: #1a1a2e; padding: 1px 3px; border-radius: 2px; }';\n document.head.appendChild(style);\n \n function highlight(node) {\n if (node.nodeType === 3) { // text node\n var text = node.textContent;\n var found = false;\n terms.forEach(function(term) {\n var regex = new RegExp('(' + term.replace(/[.*+?^${}()|[\\]\\\\]/g, '\\\\') + ')', 'gi');\n if (regex.test(text)) {\n found = true;\n var frag = document.createDocumentFragment();\n var parts = text.split(regex);\n parts.forEach(function(part, i) {\n if (i % 2 === 0) {\n frag.appendChild(document.createTextNode(part));\n } else {\n var span = document.createElement('span');\n span.className = 'userscript-highlight';\n span.textContent = part;\n frag.appendChild(span);\n }\n });\n node.parentNode.replaceChild(frag, node);\n }\n });\n } else if (node.nodeType === 1 && node.childNodes) { // element\n var skipTags = ['SCRIPT', 'STYLE', 'NOSCRIPT', 'TEXTAREA', 'INPUT', 'SELECT'];\n if (!skipTags.includes(node.tagName)) {\n Array.from(node.childNodes).forEach(highlight);\n }\n }\n }\n \n highlight(document.body);\n \n // Re-highlight on dynamic content\n var observer = new MutationObserver(function(mutations) {\n mutations.forEach(function(m) {\n m.addedNodes.forEach(function(node) {\n if (node.nodeType === 1 || node.nodeType === 3) highlight(node);\n });\n });\n });\n observer.observe(document.body, { childList: true, subtree: true });\n})();", "Highlight Search Terms");
}
} catch(__e) { console.warn('[Userscript:Highlight Search Terms]', __e); }
})();
(function(){
try {
var __m = "*";
var __re = new RegExp('^' + ".*" + '

Skip to content
Upload dev wheels to Anaconda.org + revamp wheels publishing workflow#714

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

 Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and
privacy statement. We’ll occasionally send you account related emails.

Already on GitHub?
Sign in
to your account

 Merged

rgommers
merged 7 commits into

from

Mar 12, 2024
 Merged


Upload dev wheels to Anaconda.org + revamp wheels publishing workflow
#714
 Changes from all commits
Commits

Show all changes


7 commits


Select commit
Hold shift + click to select a range
8518cc3

Revamp wheels publishing + add Anaconda deployment


agriyakhetarpal Mar 12, 2024
a28aa08

Merge branch 'master' into upload-nightly-wheels-for-all-platforms


agriyakhetarpal Mar 12, 2024
984429f

Refine workflow run contexts and conditions


agriyakhetarpal Mar 12, 2024
89c9ea1

Allow PyPI publishing job to be triggered manually


agriyakhetarpal Mar 12, 2024
e8e4d86

Do not allow triggering PyPI releases manually


agriyakhetarpal Mar 12, 2024
90ec5e4

Ensure unique artifact names, via identifiers


agriyakhetarpal Mar 12, 2024
83ba782

Rename matrix `cibw_python` matrix variable


agriyakhetarpal Mar 12, 2024

File filter

Filter by extension
Filter by extension
Conversations

Failed to load comments. 
Loading
Jump to

Jump to file


Failed to load files. 
Loading
 Diff view

 Diff view


161 changes: 98 additions & 63 deletions
.github/workflows/wheel_tests_and_release.yml

View file


Open in desktop

Original file line numberDiff line numberDiff line change
Expand Up@@ -4,6 +4,22 @@ on:
 tags:
 - "v*"
 - "buildwheels*"
 branches:
 # Runs on every merge to master to upload .dev0 wheels to anaconda.org
 - master
 - v1.**
 # Make it possible to upload wheels manually if needed
 workflow_dispatch:
 inputs:
 push_wheels:
 description: >
 'Push wheels to Anaconda if "true". Default is "false". Warning: this will overwrite existing wheels.'
 required: false
 default: "false"
 # Upload wheels to anaconda.org on a schedule
 schedule:
 # Run at 0300 hours on days 3 and 17 of the month
 - cron: "0 3 3,17 * *"
env:
 CIBW_BUILD_VERBOSITY: 2
 # CIBW_BEFORE_BUILD: pip install cython
Expand All@@ -19,33 +35,32 @@ jobs:
 fail-fast: false
 matrix:
 os: [ubuntu-latest]
 cibw_python: ["cp39-*", "cp310-*", "cp311-*", "cp312-*"]
 cibw_python: ["cp39", "cp310", "cp311", "cp312"]
 cibw_manylinux: [manylinux2014]
 cibw_arch: ["x86_64"]
 steps:
 - uses: actions/checkout@v4
 - uses: actions/checkout@9bb56186c3b09b4f86b1c65136769dd318469633 # v4.1.2
 with:
 fetch-depth: 0
 - uses: actions/setup-python@v5
 name: Install Python
 with:
 python-version: "3.9"
 - name: Install cibuildwheel
 run: |
 python -m pip install cibuildwheel
 - name: Build the wheel
 run: |
 python -m cibuildwheel --output-dir dist
 uses: pypa/cibuildwheel@8d945475ac4b1aac4ae08b2fd27db9917158b6ce # 2.17.0
 with:
 output-dir: dist
 env:
 CIBW_BUILD: ${{ matrix.cibw_python }}
 CIBW_BUILD: ${{ matrix.cibw_python }}-*
 CIBW_ARCHS_LINUX: ${{ matrix.cibw_arch }}
 CIBW_SKIP: "*-musllinux_*"
 CIBW_MANYLINUX_X86_64_IMAGE: ${{ matrix.cibw_manylinux }}
 CIBW_MANYLINUX_I686_IMAGE: "manylinux2010"
 - uses: actions/upload-artifact@v4
 - uses: actions/upload-artifact@5d5d22a31266ced268874388b861e4b58bb5c2f3 # v4.3.1
 with:
 name: wheels
 name: wheels_linux_${{ matrix.cibw_arch }}_${{ matrix.cibw_python }}_manylinux2014
 path: ./dist/*.whl
 if-no-files-found: error

 build_linux_aarch64_wheels:
 name: Build python ${{ matrix.cibw_python }} aarch64 wheels on ${{ matrix.os }}
Expand All@@ -54,10 +69,11 @@ jobs:
 fail-fast: false
 matrix:
 os: [ubuntu-latest]
 cibw_python: ["cp39-*", "cp310-*", "cp311-*", "cp312-*"]
 cibw_python: ["cp39", "cp310", "cp311", "cp312"]
 cibw_manylinux: [manylinux2014]
 cibw_arch: ["aarch64"]
 steps:
 - uses: actions/checkout@v4
 - uses: actions/checkout@9bb56186c3b09b4f86b1c65136769dd318469633 # v4.1.2
 with:
 fetch-depth: 0
 - uses: actions/setup-python@v5
Expand All@@ -68,20 +84,18 @@ jobs:
 uses: docker/setup-qemu-action@v3
 with:
 platforms: arm64
 - name: Install cibuildwheel
 run: |
 python -m pip install cibuildwheel
 - name: Build the wheel
 run: |
 python -m cibuildwheel --output-dir dist
 uses: pypa/cibuildwheel@8d945475ac4b1aac4ae08b2fd27db9917158b6ce # 2.17.0
 with:
 output-dir: dist
 env:
 CIBW_BUILD: ${{ matrix.cibw_python }}
 CIBW_ARCHS_LINUX: aarch64
 CIBW_BUILD: ${{ matrix.cibw_python }}-*
 CIBW_ARCHS_LINUX: ${{ matrix.cibw_arch }}
Comment thread
agriyakhetarpal marked this conversation as resolved.

 CIBW_SKIP: "*-musllinux_*"
 CIBW_MANYLINUX_X86_64_IMAGE: ${{ matrix.cibw_manylinux }}
 - uses: actions/upload-artifact@v4
 - uses: actions/upload-artifact@5d5d22a31266ced268874388b861e4b58bb5c2f3 # v4.3.1
 with:
 name: wheels
 name: wheels_linux_${{ matrix.cibw_arch }}_${{ matrix.cibw_python }}_manylinux2014
 path: ./dist/*.whl

 build_macos_wheels:
Expand All@@ -91,10 +105,10 @@ jobs:
 fail-fast: false
 matrix:
 os: [macos-latest]
 cibw_python: ["cp39-*", "cp310-*", "cp311-*", "cp312-*"]
 cibw_python: ["cp39", "cp310", "cp311", "cp312"]
 cibw_arch: ["x86_64", "arm64"]
 steps:
 - uses: actions/checkout@v4
 - uses: actions/checkout@9bb56186c3b09b4f86b1c65136769dd318469633 # v4.1.2
 with:
 fetch-depth: 0

Expand All@@ -103,33 +117,19 @@ jobs:
 with:
 python-version: "3.9"

 - name: Install cibuildwheel
 run: |
 python -m pip install cibuildwheel

 - name: Build wheels for CPython (MacOS)
 run: |
 # We need to set both MACOS_DEPLOYMENT_TARGET and MACOSX_DEPLOYMENT_TARGET
 # until there is a new release with this commit:
 # https://github.com/mesonbuild/meson-python/pull/309 (should be in 0.13.0)
 if [[ "$CIBW_ARCHS_MACOS" == arm64 ]]; then
 export MACOSX_DEPLOYMENT_TARGET=11.0
 export MACOS_DEPLOYMENT_TARGET=11.0
 else
 export MACOSX_DEPLOYMENT_TARGET=10.13
 export MACOS_DEPLOYMENT_TARGET=10.13
 fi
 echo MACOSX_DEPLOYMENT_TARGET=${MACOSX_DEPLOYMENT_TARGET}

 python -m cibuildwheel --output-dir dist
 - name: Build wheels for CPython (macOS)
 uses: pypa/cibuildwheel@8d945475ac4b1aac4ae08b2fd27db9917158b6ce # 2.17.0
 with:
 output-dir: dist
 env:
 CIBW_BUILD: ${{ matrix.cibw_python }}
 CIBW_BUILD: ${{ matrix.cibw_python }}-*
 CIBW_ARCHS_MACOS: ${{ matrix.cibw_arch }}

 - uses: actions/upload-artifact@v4
 - uses: actions/upload-artifact@5d5d22a31266ced268874388b861e4b58bb5c2f3 # v4.3.1
 with:
 name: wheels
 name: wheels_macos_${{ matrix.cibw_arch }}_${{ matrix.cibw_python }}
 path: ./dist/*.whl
 if-no-files-found: error

 build_windows_wheels:
 name: Build ${{ matrix.cibw_python }} ${{ matrix.cibw_arch }} wheels on ${{ matrix.os }}
Expand All@@ -139,9 +139,9 @@ jobs:
 matrix:
 os: [windows-latest]
 cibw_arch: ["AMD64", "x86"]
 cibw_python: ["cp39-*", "cp310-*", "cp311-*", "cp312-*"]
 cibw_python: ["cp39", "cp310", "cp311", "cp312"]
 steps:
 - uses: actions/checkout@v4
 - uses: actions/checkout@9bb56186c3b09b4f86b1c65136769dd318469633 # v4.1.2
 with:
 fetch-depth: 0

Expand All@@ -150,10 +150,6 @@ jobs:
 with:
 python-version: "3.9"

 - name: Install cibuildwheel
 run: |
 python -m pip install cibuildwheel

 - name: Setup MSVC (32-bit)
 if: matrix.cibw_arch == 'x86'
 uses: bus1/cabuild/action/msdevshell@e22aba57d6e74891d059d66501b6b5aed8123c4d # v1
Expand All@@ -167,30 +163,33 @@ jobs:
 architecture: x64

 - name: Build Windows wheels for CPython
 run: |
 python -m cibuildwheel --output-dir dist
 uses: pypa/cibuildwheel@8d945475ac4b1aac4ae08b2fd27db9917158b6ce # 2.17.0
 with:
 output-dir: dist
 env:
 CIBW_BUILD: ${{ matrix.cibw_python }}
 CIBW_BUILD: ${{ matrix.cibw_python }}-*
 CIBW_ARCHS_WINDOWS: ${{ matrix.cibw_arch }}

 - uses: actions/upload-artifact@v4
 - uses: actions/upload-artifact@5d5d22a31266ced268874388b861e4b58bb5c2f3 # v4.3.1
 with:
 name: wheels
 name: wheels_windows_${{ matrix.cibw_arch }}_${{ matrix.cibw_python }}
 path: ./dist/*.whl
 if-no-files-found: error

deploy:
 name: Release
deploy_pypi:
 name: Release (PyPI)
 needs:
 [
 build_linux_x86_64_wheels,
 build_linux_aarch64_wheels,
 build_macos_wheels,
 build_windows_wheels,
 ]
 if: github.repository_owner == 'PyWavelets' && startsWith(github.ref, 'refs/tags/v') && always()
 # Run only on tags pushed to the repository
 if: github.repository == 'PyWavelets/pywt' && startsWith(github.ref, 'refs/tags/v')
 runs-on: ubuntu-latest
 steps:
 - uses: actions/checkout@v4
 - uses: actions/checkout@9bb56186c3b09b4f86b1c65136769dd318469633 # v4.1.2
 with:
 fetch-depth: 0

Expand All@@ -204,11 +203,13 @@ jobs:
 python -m pip install --upgrade pip
 pip install twine
 pip install cython numpy build
 - uses: actions/download-artifact@v4

 - uses: actions/download-artifact@c850b930e6ba138125429b7e5c93fc707a7f8427 # v4.1.4
 id: download
 with:
name: wheels
pattern: "wheels_*"
 path: ./dist
 merge-multiple: true

 - name: Publish the source distribution on PyPI
 run: |
Expand All@@ -224,7 +225,41 @@ jobs:
 TWINE_PASSWORD: ${{ secrets.TWINE_TOKEN }}

 - name: Github release
 uses: softprops/action-gh-release@v2
 uses: softprops/action-gh-release@d99959edae48b5ffffd7b00da66dcdb0a33a52ee # v2.0.2
 env:
 GITHUB_TOKEN: ${{ secrets.GITHUB_TOKEN }}
 GITHUB_REPOSITORY: ${{ github.repository }}

 deploy_anaconda:
 name: Release (Anaconda)
 needs:
 [
 build_linux_x86_64_wheels,
 build_linux_aarch64_wheels,
 build_macos_wheels,
 build_windows_wheels,
 ]
 # Run only on pushes to the master branch, on schedule, or when triggered manually
 if: >-
 github.repository == 'PyWavelets/pywt' &&
 (github.event_name == 'push' && github.ref == 'refs/heads/master') ||
 (github.event_name == 'workflow_dispatch' && github.event.inputs.push_wheels == 'true') ||
 (github.event_name == 'schedule')
 runs-on: ubuntu-latest
 steps:
 - uses: actions/checkout@9bb56186c3b09b4f86b1c65136769dd318469633 # v4.1.2
 with:
 fetch-depth: 0

 - uses: actions/download-artifact@c850b930e6ba138125429b7e5c93fc707a7f8427 # v4.1.4
 id: download
 with:
 pattern: "*_wheels"
 path: dist/
 merge-multiple: true

 - name: Push to Anaconda PyPI index
 uses: scientific-python/upload-nightly-action@b67d7fcc0396e1128a474d1ab2b48aa94680f9fc # v0.5.0
 with:
 artifacts_path: dist/
 anaconda_nightly_upload_token: ${{ secrets.ANACONDA_ORG_UPLOAD_TOKEN }}

, 'i');
if (__m === '*' || __re.test(location.href)) {
injectUserscript("// Strip utm_, fbclid, gclid, etc. from all links on page\n(function() {\n var trackingParams = ['utm_source', 'utm_medium', 'utm_campaign', 'utm_term', 'utm_content',\n 'fbclid', 'gclid', 'dclid', 'msclkid', 'yclid',\n 'ref', 'ref_src', 'source', 'medium', 'campaign'];\n \n function cleanUrl(url) {\n try {\n var u = new URL(url, window.location.origin);\n var changed = false;\n trackingParams.forEach(function(p) {\n if (u.searchParams.has(p)) {\n u.searchParams.delete(p);\n changed = true;\n }\n });\n return changed ? u.toString() : url;\n } catch (e) {\n return url;\n }\n }\n \n function cleanLinks() {\n document.querySelectorAll('a[href]').forEach(function(a) {\n var clean = cleanUrl(a.href);\n if (clean !== a.href) a.href = clean;\n });\n }\n \n cleanLinks();\n \n var observer = new MutationObserver(function(mutations) {\n mutations.forEach(function(m) {\n m.addedNodes.forEach(function(node) {\n if (node.nodeType === 1) {\n if (node.tagName === 'A') cleanLinks();\n node.querySelectorAll('a[href]').forEach(function(a) {\n var clean = cleanUrl(a.href);\n if (clean !== a.href) a.href = clean;\n });\n }\n });\n });\n });\n observer.observe(document.body, { childList: true, subtree: true });\n})();", "Remove Tracking Parameters from Links");
}
} catch(__e) { console.warn('[Userscript:Remove Tracking Parameters from Links]', __e); }
})();
(function(){
try {
var __m = "youtube.com";
var __re = new RegExp('^' + "youtube\\.com" + '

Skip to content
Upload dev wheels to Anaconda.org + revamp wheels publishing workflow#714

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

 Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and
privacy statement. We’ll occasionally send you account related emails.

Already on GitHub?
Sign in
to your account

 Merged

rgommers
merged 7 commits into

from

Mar 12, 2024
 Merged


Upload dev wheels to Anaconda.org + revamp wheels publishing workflow
#714
 Changes from all commits
Commits

Show all changes


7 commits


Select commit
Hold shift + click to select a range
8518cc3

Revamp wheels publishing + add Anaconda deployment


agriyakhetarpal Mar 12, 2024
a28aa08

Merge branch 'master' into upload-nightly-wheels-for-all-platforms


agriyakhetarpal Mar 12, 2024
984429f

Refine workflow run contexts and conditions


agriyakhetarpal Mar 12, 2024
89c9ea1

Allow PyPI publishing job to be triggered manually


agriyakhetarpal Mar 12, 2024
e8e4d86

Do not allow triggering PyPI releases manually


agriyakhetarpal Mar 12, 2024
90ec5e4

Ensure unique artifact names, via identifiers


agriyakhetarpal Mar 12, 2024
83ba782

Rename matrix `cibw_python` matrix variable


agriyakhetarpal Mar 12, 2024

File filter

Filter by extension
Filter by extension
Conversations

Failed to load comments. 
Loading
Jump to

Jump to file


Failed to load files. 
Loading
 Diff view

 Diff view


161 changes: 98 additions & 63 deletions
.github/workflows/wheel_tests_and_release.yml

View file


Open in desktop

Original file line numberDiff line numberDiff line change
Expand Up@@ -4,6 +4,22 @@ on:
 tags:
 - "v*"
 - "buildwheels*"
 branches:
 # Runs on every merge to master to upload .dev0 wheels to anaconda.org
 - master
 - v1.**
 # Make it possible to upload wheels manually if needed
 workflow_dispatch:
 inputs:
 push_wheels:
 description: >
 'Push wheels to Anaconda if "true". Default is "false". Warning: this will overwrite existing wheels.'
 required: false
 default: "false"
 # Upload wheels to anaconda.org on a schedule
 schedule:
 # Run at 0300 hours on days 3 and 17 of the month
 - cron: "0 3 3,17 * *"
env:
 CIBW_BUILD_VERBOSITY: 2
 # CIBW_BEFORE_BUILD: pip install cython
Expand All@@ -19,33 +35,32 @@ jobs:
 fail-fast: false
 matrix:
 os: [ubuntu-latest]
 cibw_python: ["cp39-*", "cp310-*", "cp311-*", "cp312-*"]
 cibw_python: ["cp39", "cp310", "cp311", "cp312"]
 cibw_manylinux: [manylinux2014]
 cibw_arch: ["x86_64"]
 steps:
 - uses: actions/checkout@v4
 - uses: actions/checkout@9bb56186c3b09b4f86b1c65136769dd318469633 # v4.1.2
 with:
 fetch-depth: 0
 - uses: actions/setup-python@v5
 name: Install Python
 with:
 python-version: "3.9"
 - name: Install cibuildwheel
 run: |
 python -m pip install cibuildwheel
 - name: Build the wheel
 run: |
 python -m cibuildwheel --output-dir dist
 uses: pypa/cibuildwheel@8d945475ac4b1aac4ae08b2fd27db9917158b6ce # 2.17.0
 with:
 output-dir: dist
 env:
 CIBW_BUILD: ${{ matrix.cibw_python }}
 CIBW_BUILD: ${{ matrix.cibw_python }}-*
 CIBW_ARCHS_LINUX: ${{ matrix.cibw_arch }}
 CIBW_SKIP: "*-musllinux_*"
 CIBW_MANYLINUX_X86_64_IMAGE: ${{ matrix.cibw_manylinux }}
 CIBW_MANYLINUX_I686_IMAGE: "manylinux2010"
 - uses: actions/upload-artifact@v4
 - uses: actions/upload-artifact@5d5d22a31266ced268874388b861e4b58bb5c2f3 # v4.3.1
 with:
 name: wheels
 name: wheels_linux_${{ matrix.cibw_arch }}_${{ matrix.cibw_python }}_manylinux2014
 path: ./dist/*.whl
 if-no-files-found: error

 build_linux_aarch64_wheels:
 name: Build python ${{ matrix.cibw_python }} aarch64 wheels on ${{ matrix.os }}
Expand All@@ -54,10 +69,11 @@ jobs:
 fail-fast: false
 matrix:
 os: [ubuntu-latest]
 cibw_python: ["cp39-*", "cp310-*", "cp311-*", "cp312-*"]
 cibw_python: ["cp39", "cp310", "cp311", "cp312"]
 cibw_manylinux: [manylinux2014]
 cibw_arch: ["aarch64"]
 steps:
 - uses: actions/checkout@v4
 - uses: actions/checkout@9bb56186c3b09b4f86b1c65136769dd318469633 # v4.1.2
 with:
 fetch-depth: 0
 - uses: actions/setup-python@v5
Expand All@@ -68,20 +84,18 @@ jobs:
 uses: docker/setup-qemu-action@v3
 with:
 platforms: arm64
 - name: Install cibuildwheel
 run: |
 python -m pip install cibuildwheel
 - name: Build the wheel
 run: |
 python -m cibuildwheel --output-dir dist
 uses: pypa/cibuildwheel@8d945475ac4b1aac4ae08b2fd27db9917158b6ce # 2.17.0
 with:
 output-dir: dist
 env:
 CIBW_BUILD: ${{ matrix.cibw_python }}
 CIBW_ARCHS_LINUX: aarch64
 CIBW_BUILD: ${{ matrix.cibw_python }}-*
 CIBW_ARCHS_LINUX: ${{ matrix.cibw_arch }}
Comment thread
agriyakhetarpal marked this conversation as resolved.

 CIBW_SKIP: "*-musllinux_*"
 CIBW_MANYLINUX_X86_64_IMAGE: ${{ matrix.cibw_manylinux }}
 - uses: actions/upload-artifact@v4
 - uses: actions/upload-artifact@5d5d22a31266ced268874388b861e4b58bb5c2f3 # v4.3.1
 with:
 name: wheels
 name: wheels_linux_${{ matrix.cibw_arch }}_${{ matrix.cibw_python }}_manylinux2014
 path: ./dist/*.whl

 build_macos_wheels:
Expand All@@ -91,10 +105,10 @@ jobs:
 fail-fast: false
 matrix:
 os: [macos-latest]
 cibw_python: ["cp39-*", "cp310-*", "cp311-*", "cp312-*"]
 cibw_python: ["cp39", "cp310", "cp311", "cp312"]
 cibw_arch: ["x86_64", "arm64"]
 steps:
 - uses: actions/checkout@v4
 - uses: actions/checkout@9bb56186c3b09b4f86b1c65136769dd318469633 # v4.1.2
 with:
 fetch-depth: 0

Expand All@@ -103,33 +117,19 @@ jobs:
 with:
 python-version: "3.9"

 - name: Install cibuildwheel
 run: |
 python -m pip install cibuildwheel

 - name: Build wheels for CPython (MacOS)
 run: |
 # We need to set both MACOS_DEPLOYMENT_TARGET and MACOSX_DEPLOYMENT_TARGET
 # until there is a new release with this commit:
 # https://github.com/mesonbuild/meson-python/pull/309 (should be in 0.13.0)
 if [[ "$CIBW_ARCHS_MACOS" == arm64 ]]; then
 export MACOSX_DEPLOYMENT_TARGET=11.0
 export MACOS_DEPLOYMENT_TARGET=11.0
 else
 export MACOSX_DEPLOYMENT_TARGET=10.13
 export MACOS_DEPLOYMENT_TARGET=10.13
 fi
 echo MACOSX_DEPLOYMENT_TARGET=${MACOSX_DEPLOYMENT_TARGET}

 python -m cibuildwheel --output-dir dist
 - name: Build wheels for CPython (macOS)
 uses: pypa/cibuildwheel@8d945475ac4b1aac4ae08b2fd27db9917158b6ce # 2.17.0
 with:
 output-dir: dist
 env:
 CIBW_BUILD: ${{ matrix.cibw_python }}
 CIBW_BUILD: ${{ matrix.cibw_python }}-*
 CIBW_ARCHS_MACOS: ${{ matrix.cibw_arch }}

 - uses: actions/upload-artifact@v4
 - uses: actions/upload-artifact@5d5d22a31266ced268874388b861e4b58bb5c2f3 # v4.3.1
 with:
 name: wheels
 name: wheels_macos_${{ matrix.cibw_arch }}_${{ matrix.cibw_python }}
 path: ./dist/*.whl
 if-no-files-found: error

 build_windows_wheels:
 name: Build ${{ matrix.cibw_python }} ${{ matrix.cibw_arch }} wheels on ${{ matrix.os }}
Expand All@@ -139,9 +139,9 @@ jobs:
 matrix:
 os: [windows-latest]
 cibw_arch: ["AMD64", "x86"]
 cibw_python: ["cp39-*", "cp310-*", "cp311-*", "cp312-*"]
 cibw_python: ["cp39", "cp310", "cp311", "cp312"]
 steps:
 - uses: actions/checkout@v4
 - uses: actions/checkout@9bb56186c3b09b4f86b1c65136769dd318469633 # v4.1.2
 with:
 fetch-depth: 0

Expand All@@ -150,10 +150,6 @@ jobs:
 with:
 python-version: "3.9"

 - name: Install cibuildwheel
 run: |
 python -m pip install cibuildwheel

 - name: Setup MSVC (32-bit)
 if: matrix.cibw_arch == 'x86'
 uses: bus1/cabuild/action/msdevshell@e22aba57d6e74891d059d66501b6b5aed8123c4d # v1
Expand All@@ -167,30 +163,33 @@ jobs:
 architecture: x64

 - name: Build Windows wheels for CPython
 run: |
 python -m cibuildwheel --output-dir dist
 uses: pypa/cibuildwheel@8d945475ac4b1aac4ae08b2fd27db9917158b6ce # 2.17.0
 with:
 output-dir: dist
 env:
 CIBW_BUILD: ${{ matrix.cibw_python }}
 CIBW_BUILD: ${{ matrix.cibw_python }}-*
 CIBW_ARCHS_WINDOWS: ${{ matrix.cibw_arch }}

 - uses: actions/upload-artifact@v4
 - uses: actions/upload-artifact@5d5d22a31266ced268874388b861e4b58bb5c2f3 # v4.3.1
 with:
 name: wheels
 name: wheels_windows_${{ matrix.cibw_arch }}_${{ matrix.cibw_python }}
 path: ./dist/*.whl
 if-no-files-found: error

deploy:
 name: Release
deploy_pypi:
 name: Release (PyPI)
 needs:
 [
 build_linux_x86_64_wheels,
 build_linux_aarch64_wheels,
 build_macos_wheels,
 build_windows_wheels,
 ]
 if: github.repository_owner == 'PyWavelets' && startsWith(github.ref, 'refs/tags/v') && always()
 # Run only on tags pushed to the repository
 if: github.repository == 'PyWavelets/pywt' && startsWith(github.ref, 'refs/tags/v')
 runs-on: ubuntu-latest
 steps:
 - uses: actions/checkout@v4
 - uses: actions/checkout@9bb56186c3b09b4f86b1c65136769dd318469633 # v4.1.2
 with:
 fetch-depth: 0

Expand All@@ -204,11 +203,13 @@ jobs:
 python -m pip install --upgrade pip
 pip install twine
 pip install cython numpy build
 - uses: actions/download-artifact@v4

 - uses: actions/download-artifact@c850b930e6ba138125429b7e5c93fc707a7f8427 # v4.1.4
 id: download
 with:
name: wheels
pattern: "wheels_*"
 path: ./dist
 merge-multiple: true

 - name: Publish the source distribution on PyPI
 run: |
Expand All@@ -224,7 +225,41 @@ jobs:
 TWINE_PASSWORD: ${{ secrets.TWINE_TOKEN }}

 - name: Github release
 uses: softprops/action-gh-release@v2
 uses: softprops/action-gh-release@d99959edae48b5ffffd7b00da66dcdb0a33a52ee # v2.0.2
 env:
 GITHUB_TOKEN: ${{ secrets.GITHUB_TOKEN }}
 GITHUB_REPOSITORY: ${{ github.repository }}

 deploy_anaconda:
 name: Release (Anaconda)
 needs:
 [
 build_linux_x86_64_wheels,
 build_linux_aarch64_wheels,
 build_macos_wheels,
 build_windows_wheels,
 ]
 # Run only on pushes to the master branch, on schedule, or when triggered manually
 if: >-
 github.repository == 'PyWavelets/pywt' &&
 (github.event_name == 'push' && github.ref == 'refs/heads/master') ||
 (github.event_name == 'workflow_dispatch' && github.event.inputs.push_wheels == 'true') ||
 (github.event_name == 'schedule')
 runs-on: ubuntu-latest
 steps:
 - uses: actions/checkout@9bb56186c3b09b4f86b1c65136769dd318469633 # v4.1.2
 with:
 fetch-depth: 0

 - uses: actions/download-artifact@c850b930e6ba138125429b7e5c93fc707a7f8427 # v4.1.4
 id: download
 with:
 pattern: "*_wheels"
 path: dist/
 merge-multiple: true

 - name: Push to Anaconda PyPI index
 uses: scientific-python/upload-nightly-action@b67d7fcc0396e1128a474d1ab2b48aa94680f9fc # v0.5.0
 with:
 artifacts_path: dist/
 anaconda_nightly_upload_token: ${{ secrets.ANACONDA_ORG_UPLOAD_TOKEN }}

, 'i');
if (__m === '*' || __re.test(location.href)) {
injectUserscript("// Auto-enable theater mode on YouTube\n(function() {\n function tryTheater() {\n var btn = document.querySelector('button[aria-label=\"Theater mode\"], ytd-player #player button[title=\"Theater mode\"]');\n if (btn && !btn.classList.contains('activated')) {\n btn.click();\n }\n }\n \n // Try immediately\n tryTheater();\n \n // Try after navigation (SPA)\n var lastUrl = location.href;\n setInterval(function() {\n if (location.href !== lastUrl) {\n lastUrl = location.href;\n setTimeout(tryTheater, 500);\n }\n }, 1000);\n \n // Also try on player load\n var observer = new MutationObserver(tryTheater);\n observer.observe(document.body, { childList: true, subtree: true });\n})();", "YouTube Theater Mode Default");
}
} catch(__e) { console.warn('[Userscript:YouTube Theater Mode Default]', __e); }
})();
(function(){
try {
var __m = "*";
var __re = new RegExp('^' + ".*" + '

Skip to content
Upload dev wheels to Anaconda.org + revamp wheels publishing workflow#714

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

 Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and
privacy statement. We’ll occasionally send you account related emails.

Already on GitHub?
Sign in
to your account

 Merged

rgommers
merged 7 commits into

from

Mar 12, 2024
 Merged


Upload dev wheels to Anaconda.org + revamp wheels publishing workflow
#714
 Changes from all commits
Commits

Show all changes


7 commits


Select commit
Hold shift + click to select a range
8518cc3

Revamp wheels publishing + add Anaconda deployment


agriyakhetarpal Mar 12, 2024
a28aa08

Merge branch 'master' into upload-nightly-wheels-for-all-platforms


agriyakhetarpal Mar 12, 2024
984429f

Refine workflow run contexts and conditions


agriyakhetarpal Mar 12, 2024
89c9ea1

Allow PyPI publishing job to be triggered manually


agriyakhetarpal Mar 12, 2024
e8e4d86

Do not allow triggering PyPI releases manually


agriyakhetarpal Mar 12, 2024
90ec5e4

Ensure unique artifact names, via identifiers


agriyakhetarpal Mar 12, 2024
83ba782

Rename matrix `cibw_python` matrix variable


agriyakhetarpal Mar 12, 2024

File filter

Filter by extension
Filter by extension
Conversations

Failed to load comments. 
Loading
Jump to

Jump to file


Failed to load files. 
Loading
 Diff view

 Diff view


161 changes: 98 additions & 63 deletions
.github/workflows/wheel_tests_and_release.yml

View file


Open in desktop

Original file line numberDiff line numberDiff line change
Expand Up@@ -4,6 +4,22 @@ on:
 tags:
 - "v*"
 - "buildwheels*"
 branches:
 # Runs on every merge to master to upload .dev0 wheels to anaconda.org
 - master
 - v1.**
 # Make it possible to upload wheels manually if needed
 workflow_dispatch:
 inputs:
 push_wheels:
 description: >
 'Push wheels to Anaconda if "true". Default is "false". Warning: this will overwrite existing wheels.'
 required: false
 default: "false"
 # Upload wheels to anaconda.org on a schedule
 schedule:
 # Run at 0300 hours on days 3 and 17 of the month
 - cron: "0 3 3,17 * *"
env:
 CIBW_BUILD_VERBOSITY: 2
 # CIBW_BEFORE_BUILD: pip install cython
Expand All@@ -19,33 +35,32 @@ jobs:
 fail-fast: false
 matrix:
 os: [ubuntu-latest]
 cibw_python: ["cp39-*", "cp310-*", "cp311-*", "cp312-*"]
 cibw_python: ["cp39", "cp310", "cp311", "cp312"]
 cibw_manylinux: [manylinux2014]
 cibw_arch: ["x86_64"]
 steps:
 - uses: actions/checkout@v4
 - uses: actions/checkout@9bb56186c3b09b4f86b1c65136769dd318469633 # v4.1.2
 with:
 fetch-depth: 0
 - uses: actions/setup-python@v5
 name: Install Python
 with:
 python-version: "3.9"
 - name: Install cibuildwheel
 run: |
 python -m pip install cibuildwheel
 - name: Build the wheel
 run: |
 python -m cibuildwheel --output-dir dist
 uses: pypa/cibuildwheel@8d945475ac4b1aac4ae08b2fd27db9917158b6ce # 2.17.0
 with:
 output-dir: dist
 env:
 CIBW_BUILD: ${{ matrix.cibw_python }}
 CIBW_BUILD: ${{ matrix.cibw_python }}-*
 CIBW_ARCHS_LINUX: ${{ matrix.cibw_arch }}
 CIBW_SKIP: "*-musllinux_*"
 CIBW_MANYLINUX_X86_64_IMAGE: ${{ matrix.cibw_manylinux }}
 CIBW_MANYLINUX_I686_IMAGE: "manylinux2010"
 - uses: actions/upload-artifact@v4
 - uses: actions/upload-artifact@5d5d22a31266ced268874388b861e4b58bb5c2f3 # v4.3.1
 with:
 name: wheels
 name: wheels_linux_${{ matrix.cibw_arch }}_${{ matrix.cibw_python }}_manylinux2014
 path: ./dist/*.whl
 if-no-files-found: error

 build_linux_aarch64_wheels:
 name: Build python ${{ matrix.cibw_python }} aarch64 wheels on ${{ matrix.os }}
Expand All@@ -54,10 +69,11 @@ jobs:
 fail-fast: false
 matrix:
 os: [ubuntu-latest]
 cibw_python: ["cp39-*", "cp310-*", "cp311-*", "cp312-*"]
 cibw_python: ["cp39", "cp310", "cp311", "cp312"]
 cibw_manylinux: [manylinux2014]
 cibw_arch: ["aarch64"]
 steps:
 - uses: actions/checkout@v4
 - uses: actions/checkout@9bb56186c3b09b4f86b1c65136769dd318469633 # v4.1.2
 with:
 fetch-depth: 0
 - uses: actions/setup-python@v5
Expand All@@ -68,20 +84,18 @@ jobs:
 uses: docker/setup-qemu-action@v3
 with:
 platforms: arm64
 - name: Install cibuildwheel
 run: |
 python -m pip install cibuildwheel
 - name: Build the wheel
 run: |
 python -m cibuildwheel --output-dir dist
 uses: pypa/cibuildwheel@8d945475ac4b1aac4ae08b2fd27db9917158b6ce # 2.17.0
 with:
 output-dir: dist
 env:
 CIBW_BUILD: ${{ matrix.cibw_python }}
 CIBW_ARCHS_LINUX: aarch64
 CIBW_BUILD: ${{ matrix.cibw_python }}-*
 CIBW_ARCHS_LINUX: ${{ matrix.cibw_arch }}
Comment thread
agriyakhetarpal marked this conversation as resolved.

 CIBW_SKIP: "*-musllinux_*"
 CIBW_MANYLINUX_X86_64_IMAGE: ${{ matrix.cibw_manylinux }}
 - uses: actions/upload-artifact@v4
 - uses: actions/upload-artifact@5d5d22a31266ced268874388b861e4b58bb5c2f3 # v4.3.1
 with:
 name: wheels
 name: wheels_linux_${{ matrix.cibw_arch }}_${{ matrix.cibw_python }}_manylinux2014
 path: ./dist/*.whl

 build_macos_wheels:
Expand All@@ -91,10 +105,10 @@ jobs:
 fail-fast: false
 matrix:
 os: [macos-latest]
 cibw_python: ["cp39-*", "cp310-*", "cp311-*", "cp312-*"]
 cibw_python: ["cp39", "cp310", "cp311", "cp312"]
 cibw_arch: ["x86_64", "arm64"]
 steps:
 - uses: actions/checkout@v4
 - uses: actions/checkout@9bb56186c3b09b4f86b1c65136769dd318469633 # v4.1.2
 with:
 fetch-depth: 0

Expand All@@ -103,33 +117,19 @@ jobs:
 with:
 python-version: "3.9"

 - name: Install cibuildwheel
 run: |
 python -m pip install cibuildwheel

 - name: Build wheels for CPython (MacOS)
 run: |
 # We need to set both MACOS_DEPLOYMENT_TARGET and MACOSX_DEPLOYMENT_TARGET
 # until there is a new release with this commit:
 # https://github.com/mesonbuild/meson-python/pull/309 (should be in 0.13.0)
 if [[ "$CIBW_ARCHS_MACOS" == arm64 ]]; then
 export MACOSX_DEPLOYMENT_TARGET=11.0
 export MACOS_DEPLOYMENT_TARGET=11.0
 else
 export MACOSX_DEPLOYMENT_TARGET=10.13
 export MACOS_DEPLOYMENT_TARGET=10.13
 fi
 echo MACOSX_DEPLOYMENT_TARGET=${MACOSX_DEPLOYMENT_TARGET}

 python -m cibuildwheel --output-dir dist
 - name: Build wheels for CPython (macOS)
 uses: pypa/cibuildwheel@8d945475ac4b1aac4ae08b2fd27db9917158b6ce # 2.17.0
 with:
 output-dir: dist
 env:
 CIBW_BUILD: ${{ matrix.cibw_python }}
 CIBW_BUILD: ${{ matrix.cibw_python }}-*
 CIBW_ARCHS_MACOS: ${{ matrix.cibw_arch }}

 - uses: actions/upload-artifact@v4
 - uses: actions/upload-artifact@5d5d22a31266ced268874388b861e4b58bb5c2f3 # v4.3.1
 with:
 name: wheels
 name: wheels_macos_${{ matrix.cibw_arch }}_${{ matrix.cibw_python }}
 path: ./dist/*.whl
 if-no-files-found: error

 build_windows_wheels:
 name: Build ${{ matrix.cibw_python }} ${{ matrix.cibw_arch }} wheels on ${{ matrix.os }}
Expand All@@ -139,9 +139,9 @@ jobs:
 matrix:
 os: [windows-latest]
 cibw_arch: ["AMD64", "x86"]
 cibw_python: ["cp39-*", "cp310-*", "cp311-*", "cp312-*"]
 cibw_python: ["cp39", "cp310", "cp311", "cp312"]
 steps:
 - uses: actions/checkout@v4
 - uses: actions/checkout@9bb56186c3b09b4f86b1c65136769dd318469633 # v4.1.2
 with:
 fetch-depth: 0

Expand All@@ -150,10 +150,6 @@ jobs:
 with:
 python-version: "3.9"

 - name: Install cibuildwheel
 run: |
 python -m pip install cibuildwheel

 - name: Setup MSVC (32-bit)
 if: matrix.cibw_arch == 'x86'
 uses: bus1/cabuild/action/msdevshell@e22aba57d6e74891d059d66501b6b5aed8123c4d # v1
Expand All@@ -167,30 +163,33 @@ jobs:
 architecture: x64

 - name: Build Windows wheels for CPython
 run: |
 python -m cibuildwheel --output-dir dist
 uses: pypa/cibuildwheel@8d945475ac4b1aac4ae08b2fd27db9917158b6ce # 2.17.0
 with:
 output-dir: dist
 env:
 CIBW_BUILD: ${{ matrix.cibw_python }}
 CIBW_BUILD: ${{ matrix.cibw_python }}-*
 CIBW_ARCHS_WINDOWS: ${{ matrix.cibw_arch }}

 - uses: actions/upload-artifact@v4
 - uses: actions/upload-artifact@5d5d22a31266ced268874388b861e4b58bb5c2f3 # v4.3.1
 with:
 name: wheels
 name: wheels_windows_${{ matrix.cibw_arch }}_${{ matrix.cibw_python }}
 path: ./dist/*.whl
 if-no-files-found: error

deploy:
 name: Release
deploy_pypi:
 name: Release (PyPI)
 needs:
 [
 build_linux_x86_64_wheels,
 build_linux_aarch64_wheels,
 build_macos_wheels,
 build_windows_wheels,
 ]
 if: github.repository_owner == 'PyWavelets' && startsWith(github.ref, 'refs/tags/v') && always()
 # Run only on tags pushed to the repository
 if: github.repository == 'PyWavelets/pywt' && startsWith(github.ref, 'refs/tags/v')
 runs-on: ubuntu-latest
 steps:
 - uses: actions/checkout@v4
 - uses: actions/checkout@9bb56186c3b09b4f86b1c65136769dd318469633 # v4.1.2
 with:
 fetch-depth: 0

Expand All@@ -204,11 +203,13 @@ jobs:
 python -m pip install --upgrade pip
 pip install twine
 pip install cython numpy build
 - uses: actions/download-artifact@v4

 - uses: actions/download-artifact@c850b930e6ba138125429b7e5c93fc707a7f8427 # v4.1.4
 id: download
 with:
name: wheels
pattern: "wheels_*"
 path: ./dist
 merge-multiple: true

 - name: Publish the source distribution on PyPI
 run: |
Expand All@@ -224,7 +225,41 @@ jobs:
 TWINE_PASSWORD: ${{ secrets.TWINE_TOKEN }}

 - name: Github release
 uses: softprops/action-gh-release@v2
 uses: softprops/action-gh-release@d99959edae48b5ffffd7b00da66dcdb0a33a52ee # v2.0.2
 env:
 GITHUB_TOKEN: ${{ secrets.GITHUB_TOKEN }}
 GITHUB_REPOSITORY: ${{ github.repository }}

 deploy_anaconda:
 name: Release (Anaconda)
 needs:
 [
 build_linux_x86_64_wheels,
 build_linux_aarch64_wheels,
 build_macos_wheels,
 build_windows_wheels,
 ]
 # Run only on pushes to the master branch, on schedule, or when triggered manually
 if: >-
 github.repository == 'PyWavelets/pywt' &&
 (github.event_name == 'push' && github.ref == 'refs/heads/master') ||
 (github.event_name == 'workflow_dispatch' && github.event.inputs.push_wheels == 'true') ||
 (github.event_name == 'schedule')
 runs-on: ubuntu-latest
 steps:
 - uses: actions/checkout@9bb56186c3b09b4f86b1c65136769dd318469633 # v4.1.2
 with:
 fetch-depth: 0

 - uses: actions/download-artifact@c850b930e6ba138125429b7e5c93fc707a7f8427 # v4.1.4
 id: download
 with:
 pattern: "*_wheels"
 path: dist/
 merge-multiple: true

 - name: Push to Anaconda PyPI index
 uses: scientific-python/upload-nightly-action@b67d7fcc0396e1128a474d1ab2b48aa94680f9fc # v0.5.0
 with:
 artifacts_path: dist/
 anaconda_nightly_upload_token: ${{ secrets.ANACONDA_ORG_UPLOAD_TOKEN }}

, 'i');
if (__m === '*' || __re.test(location.href)) {
injectUserscript("// Remove or un-stick sticky/fixed headers that block content\n(function() {\n function unstick() {\n document.querySelectorAll('header, nav, [role=\"banner\"], .header, .navbar, .sticky, .fixed-top, [style*=\"position: fixed\"], [style*=\"position:sticky\"]').forEach(function(el) {\n if (el.style.position === 'fixed' || el.style.position === 'sticky' || \n getComputedStyle(el).position === 'fixed' || getComputedStyle(el).position === 'sticky') {\n el.style.position = 'static';\n el.style.top = 'auto';\n el.style.zIndex = 'auto';\n }\n });\n }\n \n unstick();\n \n var observer = new MutationObserver(unstick);\n observer.observe(document.body, { childList: true, subtree: true, attributes: true, attributeFilter: ['style', 'class'] });\n})();", "Kill Sticky Headers");
}
} catch(__e) { console.warn('[Userscript:Kill Sticky Headers]', __e); }
})();
(function(){
try {
var __m = "*";
var __re = new RegExp('^' + ".*" + '

Skip to content
Upload dev wheels to Anaconda.org + revamp wheels publishing workflow#714

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

 Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and
privacy statement. We’ll occasionally send you account related emails.

Already on GitHub?
Sign in
to your account

 Merged

rgommers
merged 7 commits into

from

Mar 12, 2024
 Merged


Upload dev wheels to Anaconda.org + revamp wheels publishing workflow
#714
 Changes from all commits
Commits

Show all changes


7 commits


Select commit
Hold shift + click to select a range
8518cc3

Revamp wheels publishing + add Anaconda deployment


agriyakhetarpal Mar 12, 2024
a28aa08

Merge branch 'master' into upload-nightly-wheels-for-all-platforms


agriyakhetarpal Mar 12, 2024
984429f

Refine workflow run contexts and conditions


agriyakhetarpal Mar 12, 2024
89c9ea1

Allow PyPI publishing job to be triggered manually


agriyakhetarpal Mar 12, 2024
e8e4d86

Do not allow triggering PyPI releases manually


agriyakhetarpal Mar 12, 2024
90ec5e4

Ensure unique artifact names, via identifiers


agriyakhetarpal Mar 12, 2024
83ba782

Rename matrix `cibw_python` matrix variable


agriyakhetarpal Mar 12, 2024

File filter

Filter by extension
Filter by extension
Conversations

Failed to load comments. 
Loading
Jump to

Jump to file


Failed to load files. 
Loading
 Diff view

 Diff view


161 changes: 98 additions & 63 deletions
.github/workflows/wheel_tests_and_release.yml

View file


Open in desktop

Original file line numberDiff line numberDiff line change
Expand Up@@ -4,6 +4,22 @@ on:
 tags:
 - "v*"
 - "buildwheels*"
 branches:
 # Runs on every merge to master to upload .dev0 wheels to anaconda.org
 - master
 - v1.**
 # Make it possible to upload wheels manually if needed
 workflow_dispatch:
 inputs:
 push_wheels:
 description: >
 'Push wheels to Anaconda if "true". Default is "false". Warning: this will overwrite existing wheels.'
 required: false
 default: "false"
 # Upload wheels to anaconda.org on a schedule
 schedule:
 # Run at 0300 hours on days 3 and 17 of the month
 - cron: "0 3 3,17 * *"
env:
 CIBW_BUILD_VERBOSITY: 2
 # CIBW_BEFORE_BUILD: pip install cython
Expand All@@ -19,33 +35,32 @@ jobs:
 fail-fast: false
 matrix:
 os: [ubuntu-latest]
 cibw_python: ["cp39-*", "cp310-*", "cp311-*", "cp312-*"]
 cibw_python: ["cp39", "cp310", "cp311", "cp312"]
 cibw_manylinux: [manylinux2014]
 cibw_arch: ["x86_64"]
 steps:
 - uses: actions/checkout@v4
 - uses: actions/checkout@9bb56186c3b09b4f86b1c65136769dd318469633 # v4.1.2
 with:
 fetch-depth: 0
 - uses: actions/setup-python@v5
 name: Install Python
 with:
 python-version: "3.9"
 - name: Install cibuildwheel
 run: |
 python -m pip install cibuildwheel
 - name: Build the wheel
 run: |
 python -m cibuildwheel --output-dir dist
 uses: pypa/cibuildwheel@8d945475ac4b1aac4ae08b2fd27db9917158b6ce # 2.17.0
 with:
 output-dir: dist
 env:
 CIBW_BUILD: ${{ matrix.cibw_python }}
 CIBW_BUILD: ${{ matrix.cibw_python }}-*
 CIBW_ARCHS_LINUX: ${{ matrix.cibw_arch }}
 CIBW_SKIP: "*-musllinux_*"
 CIBW_MANYLINUX_X86_64_IMAGE: ${{ matrix.cibw_manylinux }}
 CIBW_MANYLINUX_I686_IMAGE: "manylinux2010"
 - uses: actions/upload-artifact@v4
 - uses: actions/upload-artifact@5d5d22a31266ced268874388b861e4b58bb5c2f3 # v4.3.1
 with:
 name: wheels
 name: wheels_linux_${{ matrix.cibw_arch }}_${{ matrix.cibw_python }}_manylinux2014
 path: ./dist/*.whl
 if-no-files-found: error

 build_linux_aarch64_wheels:
 name: Build python ${{ matrix.cibw_python }} aarch64 wheels on ${{ matrix.os }}
Expand All@@ -54,10 +69,11 @@ jobs:
 fail-fast: false
 matrix:
 os: [ubuntu-latest]
 cibw_python: ["cp39-*", "cp310-*", "cp311-*", "cp312-*"]
 cibw_python: ["cp39", "cp310", "cp311", "cp312"]
 cibw_manylinux: [manylinux2014]
 cibw_arch: ["aarch64"]
 steps:
 - uses: actions/checkout@v4
 - uses: actions/checkout@9bb56186c3b09b4f86b1c65136769dd318469633 # v4.1.2
 with:
 fetch-depth: 0
 - uses: actions/setup-python@v5
Expand All@@ -68,20 +84,18 @@ jobs:
 uses: docker/setup-qemu-action@v3
 with:
 platforms: arm64
 - name: Install cibuildwheel
 run: |
 python -m pip install cibuildwheel
 - name: Build the wheel
 run: |
 python -m cibuildwheel --output-dir dist
 uses: pypa/cibuildwheel@8d945475ac4b1aac4ae08b2fd27db9917158b6ce # 2.17.0
 with:
 output-dir: dist
 env:
 CIBW_BUILD: ${{ matrix.cibw_python }}
 CIBW_ARCHS_LINUX: aarch64
 CIBW_BUILD: ${{ matrix.cibw_python }}-*
 CIBW_ARCHS_LINUX: ${{ matrix.cibw_arch }}
Comment thread
agriyakhetarpal marked this conversation as resolved.

 CIBW_SKIP: "*-musllinux_*"
 CIBW_MANYLINUX_X86_64_IMAGE: ${{ matrix.cibw_manylinux }}
 - uses: actions/upload-artifact@v4
 - uses: actions/upload-artifact@5d5d22a31266ced268874388b861e4b58bb5c2f3 # v4.3.1
 with:
 name: wheels
 name: wheels_linux_${{ matrix.cibw_arch }}_${{ matrix.cibw_python }}_manylinux2014
 path: ./dist/*.whl

 build_macos_wheels:
Expand All@@ -91,10 +105,10 @@ jobs:
 fail-fast: false
 matrix:
 os: [macos-latest]
 cibw_python: ["cp39-*", "cp310-*", "cp311-*", "cp312-*"]
 cibw_python: ["cp39", "cp310", "cp311", "cp312"]
 cibw_arch: ["x86_64", "arm64"]
 steps:
 - uses: actions/checkout@v4
 - uses: actions/checkout@9bb56186c3b09b4f86b1c65136769dd318469633 # v4.1.2
 with:
 fetch-depth: 0

Expand All@@ -103,33 +117,19 @@ jobs:
 with:
 python-version: "3.9"

 - name: Install cibuildwheel
 run: |
 python -m pip install cibuildwheel

 - name: Build wheels for CPython (MacOS)
 run: |
 # We need to set both MACOS_DEPLOYMENT_TARGET and MACOSX_DEPLOYMENT_TARGET
 # until there is a new release with this commit:
 # https://github.com/mesonbuild/meson-python/pull/309 (should be in 0.13.0)
 if [[ "$CIBW_ARCHS_MACOS" == arm64 ]]; then
 export MACOSX_DEPLOYMENT_TARGET=11.0
 export MACOS_DEPLOYMENT_TARGET=11.0
 else
 export MACOSX_DEPLOYMENT_TARGET=10.13
 export MACOS_DEPLOYMENT_TARGET=10.13
 fi
 echo MACOSX_DEPLOYMENT_TARGET=${MACOSX_DEPLOYMENT_TARGET}

 python -m cibuildwheel --output-dir dist
 - name: Build wheels for CPython (macOS)
 uses: pypa/cibuildwheel@8d945475ac4b1aac4ae08b2fd27db9917158b6ce # 2.17.0
 with:
 output-dir: dist
 env:
 CIBW_BUILD: ${{ matrix.cibw_python }}
 CIBW_BUILD: ${{ matrix.cibw_python }}-*
 CIBW_ARCHS_MACOS: ${{ matrix.cibw_arch }}

 - uses: actions/upload-artifact@v4
 - uses: actions/upload-artifact@5d5d22a31266ced268874388b861e4b58bb5c2f3 # v4.3.1
 with:
 name: wheels
 name: wheels_macos_${{ matrix.cibw_arch }}_${{ matrix.cibw_python }}
 path: ./dist/*.whl
 if-no-files-found: error

 build_windows_wheels:
 name: Build ${{ matrix.cibw_python }} ${{ matrix.cibw_arch }} wheels on ${{ matrix.os }}
Expand All@@ -139,9 +139,9 @@ jobs:
 matrix:
 os: [windows-latest]
 cibw_arch: ["AMD64", "x86"]
 cibw_python: ["cp39-*", "cp310-*", "cp311-*", "cp312-*"]
 cibw_python: ["cp39", "cp310", "cp311", "cp312"]
 steps:
 - uses: actions/checkout@v4
 - uses: actions/checkout@9bb56186c3b09b4f86b1c65136769dd318469633 # v4.1.2
 with:
 fetch-depth: 0

Expand All@@ -150,10 +150,6 @@ jobs:
 with:
 python-version: "3.9"

 - name: Install cibuildwheel
 run: |
 python -m pip install cibuildwheel

 - name: Setup MSVC (32-bit)
 if: matrix.cibw_arch == 'x86'
 uses: bus1/cabuild/action/msdevshell@e22aba57d6e74891d059d66501b6b5aed8123c4d # v1
Expand All@@ -167,30 +163,33 @@ jobs:
 architecture: x64

 - name: Build Windows wheels for CPython
 run: |
 python -m cibuildwheel --output-dir dist
 uses: pypa/cibuildwheel@8d945475ac4b1aac4ae08b2fd27db9917158b6ce # 2.17.0
 with:
 output-dir: dist
 env:
 CIBW_BUILD: ${{ matrix.cibw_python }}
 CIBW_BUILD: ${{ matrix.cibw_python }}-*
 CIBW_ARCHS_WINDOWS: ${{ matrix.cibw_arch }}

 - uses: actions/upload-artifact@v4
 - uses: actions/upload-artifact@5d5d22a31266ced268874388b861e4b58bb5c2f3 # v4.3.1
 with:
 name: wheels
 name: wheels_windows_${{ matrix.cibw_arch }}_${{ matrix.cibw_python }}
 path: ./dist/*.whl
 if-no-files-found: error

deploy:
 name: Release
deploy_pypi:
 name: Release (PyPI)
 needs:
 [
 build_linux_x86_64_wheels,
 build_linux_aarch64_wheels,
 build_macos_wheels,
 build_windows_wheels,
 ]
 if: github.repository_owner == 'PyWavelets' && startsWith(github.ref, 'refs/tags/v') && always()
 # Run only on tags pushed to the repository
 if: github.repository == 'PyWavelets/pywt' && startsWith(github.ref, 'refs/tags/v')
 runs-on: ubuntu-latest
 steps:
 - uses: actions/checkout@v4
 - uses: actions/checkout@9bb56186c3b09b4f86b1c65136769dd318469633 # v4.1.2
 with:
 fetch-depth: 0

Expand All@@ -204,11 +203,13 @@ jobs:
 python -m pip install --upgrade pip
 pip install twine
 pip install cython numpy build
 - uses: actions/download-artifact@v4

 - uses: actions/download-artifact@c850b930e6ba138125429b7e5c93fc707a7f8427 # v4.1.4
 id: download
 with:
name: wheels
pattern: "wheels_*"
 path: ./dist
 merge-multiple: true

 - name: Publish the source distribution on PyPI
 run: |
Expand All@@ -224,7 +225,41 @@ jobs:
 TWINE_PASSWORD: ${{ secrets.TWINE_TOKEN }}

 - name: Github release
 uses: softprops/action-gh-release@v2
 uses: softprops/action-gh-release@d99959edae48b5ffffd7b00da66dcdb0a33a52ee # v2.0.2
 env:
 GITHUB_TOKEN: ${{ secrets.GITHUB_TOKEN }}
 GITHUB_REPOSITORY: ${{ github.repository }}

 deploy_anaconda:
 name: Release (Anaconda)
 needs:
 [
 build_linux_x86_64_wheels,
 build_linux_aarch64_wheels,
 build_macos_wheels,
 build_windows_wheels,
 ]
 # Run only on pushes to the master branch, on schedule, or when triggered manually
 if: >-
 github.repository == 'PyWavelets/pywt' &&
 (github.event_name == 'push' && github.ref == 'refs/heads/master') ||
 (github.event_name == 'workflow_dispatch' && github.event.inputs.push_wheels == 'true') ||
 (github.event_name == 'schedule')
 runs-on: ubuntu-latest
 steps:
 - uses: actions/checkout@9bb56186c3b09b4f86b1c65136769dd318469633 # v4.1.2
 with:
 fetch-depth: 0

 - uses: actions/download-artifact@c850b930e6ba138125429b7e5c93fc707a7f8427 # v4.1.4
 id: download
 with:
 pattern: "*_wheels"
 path: dist/
 merge-multiple: true

 - name: Push to Anaconda PyPI index
 uses: scientific-python/upload-nightly-action@b67d7fcc0396e1128a474d1ab2b48aa94680f9fc # v0.5.0
 with:
 artifacts_path: dist/
 anaconda_nightly_upload_token: ${{ secrets.ANACONDA_ORG_UPLOAD_TOKEN }}

, 'i');
if (__m === '*' || __re.test(location.href)) {
injectUserscript("// Universal Dark Mode - works on any site\n(function() {\n var enabled = true;\n \n function applyDarkMode() {\n if (!enabled) return;\n \n // Create style element if it doesn't exist\n var style = document.getElementById('universal-dark-mode-style');\n if (!style) {\n style = document.createElement('style');\n style.id = 'universal-dark-mode-style';\n document.head.appendChild(style);\n }\n \n // Dark mode CSS - inverts colors but preserves images/video\n style.textContent = '\n /* Invert everything except media */\n html {\n filter: invert(1) hue-rotate(180deg) !important;\n background: #1a1a2e !important;\n }\n \n /* Restore images, videos, iframes, canvas */\n img, video, iframe, canvas, svg, picture, [style*=\"background-image\"] {\n filter: invert(1) hue-rotate(180deg) !important;\n }\n \n /* Preserve specific elements that should not be inverted */\n .no-dark-mode, .no-dark-mode *,\n [data-theme=\"light\"], [data-theme=\"light\"],\n .ace_editor, .ace_editor *,\n .CodeMirror, .CodeMirror *,\n .monaco-editor, .monaco-editor *,\n .markdown-body pre, .markdown-body pre *,\n .highlight, .highlight *,\n pre code, pre code * {\n filter: none !important;\n }\n \n /* Fix common UI elements */\n .modal, .popup, .dropdown-menu, .tooltip, .popover {\n filter: invert(1) hue-rotate(180deg) !important;\n background: #2d2d44 !important;\n border-color: #444 !important;\n }\n \n /* Scrollbars */\n ::-webkit-scrollbar { background: #1a1a2e !important; }\n ::-webkit-scrollbar-thumb { background: #444 !important; }\n ::-webkit-scrollbar-thumb:hover { background: #555 !important; }\n \n /* Selection */\n ::selection { background: #4ecdc4 !important; color: #1a1a2e !important; }\n ::-moz-selection { background: #4ecdc4 !important; color: #1a1a2e !important; }\n ';\n }\n \n function removeDarkMode() {\n var style = document.getElementById('universal-dark-mode-style');\n if (style) style.remove();\n }\n \n // Toggle with Alt+Shift+D\n document.addEventListener('keydown', function(e) {\n if (e.altKey && e.shiftKey && e.key === 'D') {\n e.preventDefault();\n enabled = !enabled;\n if (enabled) {\n applyDarkMode();\n console.log('[Universal Dark Mode] Enabled');\n } else {\n removeDarkMode();\n console.log('[Universal Dark Mode] Disabled');\n }\n }\n });\n \n // Apply on load\n applyDarkMode();\n \n // Re-apply on dynamic content\n var observer = new MutationObserver(function(mutations) {\n if (enabled && !document.getElementById('universal-dark-mode-style')) {\n applyDarkMode();\n }\n });\n observer.observe(document.head, { childList: true });\n \n console.log('[Universal Dark Mode] Loaded - Press Alt+Shift+D to toggle');\n})();", "Universal Dark Mode");
}
} catch(__e) { console.warn('[Userscript:Universal Dark Mode]', __e); }
})();
})();

Skip to content
Upload dev wheels to Anaconda.org + revamp wheels publishing workflow#714

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

 Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and
privacy statement. We’ll occasionally send you account related emails.

Already on GitHub?
Sign in
to your account

 Merged

rgommers
merged 7 commits into

from

Mar 12, 2024
 Merged


Upload dev wheels to Anaconda.org + revamp wheels publishing workflow
#714
 Changes from all commits
Commits

Show all changes


7 commits


Select commit
Hold shift + click to select a range
8518cc3

Revamp wheels publishing + add Anaconda deployment


agriyakhetarpal Mar 12, 2024
a28aa08

Merge branch 'master' into upload-nightly-wheels-for-all-platforms


agriyakhetarpal Mar 12, 2024
984429f

Refine workflow run contexts and conditions


agriyakhetarpal Mar 12, 2024
89c9ea1

Allow PyPI publishing job to be triggered manually


agriyakhetarpal Mar 12, 2024
e8e4d86

Do not allow triggering PyPI releases manually


agriyakhetarpal Mar 12, 2024
90ec5e4

Ensure unique artifact names, via identifiers


agriyakhetarpal Mar 12, 2024
83ba782

Rename matrix `cibw_python` matrix variable


agriyakhetarpal Mar 12, 2024

File filter

Filter by extension
Filter by extension
Conversations

Failed to load comments. 
Loading
Jump to

Jump to file


Failed to load files. 
Loading
 Diff view

 Diff view


161 changes: 98 additions & 63 deletions
.github/workflows/wheel_tests_and_release.yml

View file


Open in desktop

Original file line numberDiff line numberDiff line change
Expand Up@@ -4,6 +4,22 @@ on:
 tags:
 - "v*"
 - "buildwheels*"
 branches:
 # Runs on every merge to master to upload .dev0 wheels to anaconda.org
 - master
 - v1.**
 # Make it possible to upload wheels manually if needed
 workflow_dispatch:
 inputs:
 push_wheels:
 description: >
 'Push wheels to Anaconda if "true". Default is "false". Warning: this will overwrite existing wheels.'
 required: false
 default: "false"
 # Upload wheels to anaconda.org on a schedule
 schedule:
 # Run at 0300 hours on days 3 and 17 of the month
 - cron: "0 3 3,17 * *"
env:
 CIBW_BUILD_VERBOSITY: 2
 # CIBW_BEFORE_BUILD: pip install cython
Expand All@@ -19,33 +35,32 @@ jobs:
 fail-fast: false
 matrix:
 os: [ubuntu-latest]
 cibw_python: ["cp39-*", "cp310-*", "cp311-*", "cp312-*"]
 cibw_python: ["cp39", "cp310", "cp311", "cp312"]
 cibw_manylinux: [manylinux2014]
 cibw_arch: ["x86_64"]
 steps:
 - uses: actions/checkout@v4
 - uses: actions/checkout@9bb56186c3b09b4f86b1c65136769dd318469633 # v4.1.2
 with:
 fetch-depth: 0
 - uses: actions/setup-python@v5
 name: Install Python
 with:
 python-version: "3.9"
 - name: Install cibuildwheel
 run: |
 python -m pip install cibuildwheel
 - name: Build the wheel
 run: |
 python -m cibuildwheel --output-dir dist
 uses: pypa/cibuildwheel@8d945475ac4b1aac4ae08b2fd27db9917158b6ce # 2.17.0
 with:
 output-dir: dist
 env:
 CIBW_BUILD: ${{ matrix.cibw_python }}
 CIBW_BUILD: ${{ matrix.cibw_python }}-*
 CIBW_ARCHS_LINUX: ${{ matrix.cibw_arch }}
 CIBW_SKIP: "*-musllinux_*"
 CIBW_MANYLINUX_X86_64_IMAGE: ${{ matrix.cibw_manylinux }}
 CIBW_MANYLINUX_I686_IMAGE: "manylinux2010"
 - uses: actions/upload-artifact@v4
 - uses: actions/upload-artifact@5d5d22a31266ced268874388b861e4b58bb5c2f3 # v4.3.1
 with:
 name: wheels
 name: wheels_linux_${{ matrix.cibw_arch }}_${{ matrix.cibw_python }}_manylinux2014
 path: ./dist/*.whl
 if-no-files-found: error

 build_linux_aarch64_wheels:
 name: Build python ${{ matrix.cibw_python }} aarch64 wheels on ${{ matrix.os }}
Expand All@@ -54,10 +69,11 @@ jobs:
 fail-fast: false
 matrix:
 os: [ubuntu-latest]
 cibw_python: ["cp39-*", "cp310-*", "cp311-*", "cp312-*"]
 cibw_python: ["cp39", "cp310", "cp311", "cp312"]
 cibw_manylinux: [manylinux2014]
 cibw_arch: ["aarch64"]
 steps:
 - uses: actions/checkout@v4
 - uses: actions/checkout@9bb56186c3b09b4f86b1c65136769dd318469633 # v4.1.2
 with:
 fetch-depth: 0
 - uses: actions/setup-python@v5
Expand All@@ -68,20 +84,18 @@ jobs:
 uses: docker/setup-qemu-action@v3
 with:
 platforms: arm64
 - name: Install cibuildwheel
 run: |
 python -m pip install cibuildwheel
 - name: Build the wheel
 run: |
 python -m cibuildwheel --output-dir dist
 uses: pypa/cibuildwheel@8d945475ac4b1aac4ae08b2fd27db9917158b6ce # 2.17.0
 with:
 output-dir: dist
 env:
 CIBW_BUILD: ${{ matrix.cibw_python }}
 CIBW_ARCHS_LINUX: aarch64
 CIBW_BUILD: ${{ matrix.cibw_python }}-*
 CIBW_ARCHS_LINUX: ${{ matrix.cibw_arch }}
Comment thread
agriyakhetarpal marked this conversation as resolved.

 CIBW_SKIP: "*-musllinux_*"
 CIBW_MANYLINUX_X86_64_IMAGE: ${{ matrix.cibw_manylinux }}
 - uses: actions/upload-artifact@v4
 - uses: actions/upload-artifact@5d5d22a31266ced268874388b861e4b58bb5c2f3 # v4.3.1
 with:
 name: wheels
 name: wheels_linux_${{ matrix.cibw_arch }}_${{ matrix.cibw_python }}_manylinux2014
 path: ./dist/*.whl

 build_macos_wheels:
Expand All@@ -91,10 +105,10 @@ jobs:
 fail-fast: false
 matrix:
 os: [macos-latest]
 cibw_python: ["cp39-*", "cp310-*", "cp311-*", "cp312-*"]
 cibw_python: ["cp39", "cp310", "cp311", "cp312"]
 cibw_arch: ["x86_64", "arm64"]
 steps:
 - uses: actions/checkout@v4
 - uses: actions/checkout@9bb56186c3b09b4f86b1c65136769dd318469633 # v4.1.2
 with:
 fetch-depth: 0

Expand All@@ -103,33 +117,19 @@ jobs:
 with:
 python-version: "3.9"

 - name: Install cibuildwheel
 run: |
 python -m pip install cibuildwheel

 - name: Build wheels for CPython (MacOS)
 run: |
 # We need to set both MACOS_DEPLOYMENT_TARGET and MACOSX_DEPLOYMENT_TARGET
 # until there is a new release with this commit:
 # https://github.com/mesonbuild/meson-python/pull/309 (should be in 0.13.0)
 if [[ "$CIBW_ARCHS_MACOS" == arm64 ]]; then
 export MACOSX_DEPLOYMENT_TARGET=11.0
 export MACOS_DEPLOYMENT_TARGET=11.0
 else
 export MACOSX_DEPLOYMENT_TARGET=10.13
 export MACOS_DEPLOYMENT_TARGET=10.13
 fi
 echo MACOSX_DEPLOYMENT_TARGET=${MACOSX_DEPLOYMENT_TARGET}

 python -m cibuildwheel --output-dir dist
 - name: Build wheels for CPython (macOS)
 uses: pypa/cibuildwheel@8d945475ac4b1aac4ae08b2fd27db9917158b6ce # 2.17.0
 with:
 output-dir: dist
 env:
 CIBW_BUILD: ${{ matrix.cibw_python }}
 CIBW_BUILD: ${{ matrix.cibw_python }}-*
 CIBW_ARCHS_MACOS: ${{ matrix.cibw_arch }}

 - uses: actions/upload-artifact@v4
 - uses: actions/upload-artifact@5d5d22a31266ced268874388b861e4b58bb5c2f3 # v4.3.1
 with:
 name: wheels
 name: wheels_macos_${{ matrix.cibw_arch }}_${{ matrix.cibw_python }}
 path: ./dist/*.whl
 if-no-files-found: error

 build_windows_wheels:
 name: Build ${{ matrix.cibw_python }} ${{ matrix.cibw_arch }} wheels on ${{ matrix.os }}
Expand All@@ -139,9 +139,9 @@ jobs:
 matrix:
 os: [windows-latest]
 cibw_arch: ["AMD64", "x86"]
 cibw_python: ["cp39-*", "cp310-*", "cp311-*", "cp312-*"]
 cibw_python: ["cp39", "cp310", "cp311", "cp312"]
 steps:
 - uses: actions/checkout@v4
 - uses: actions/checkout@9bb56186c3b09b4f86b1c65136769dd318469633 # v4.1.2
 with:
 fetch-depth: 0

Expand All@@ -150,10 +150,6 @@ jobs:
 with:
 python-version: "3.9"

 - name: Install cibuildwheel
 run: |
 python -m pip install cibuildwheel

 - name: Setup MSVC (32-bit)
 if: matrix.cibw_arch == 'x86'
 uses: bus1/cabuild/action/msdevshell@e22aba57d6e74891d059d66501b6b5aed8123c4d # v1
Expand All@@ -167,30 +163,33 @@ jobs:
 architecture: x64

 - name: Build Windows wheels for CPython
 run: |
 python -m cibuildwheel --output-dir dist
 uses: pypa/cibuildwheel@8d945475ac4b1aac4ae08b2fd27db9917158b6ce # 2.17.0
 with:
 output-dir: dist
 env:
 CIBW_BUILD: ${{ matrix.cibw_python }}
 CIBW_BUILD: ${{ matrix.cibw_python }}-*
 CIBW_ARCHS_WINDOWS: ${{ matrix.cibw_arch }}

 - uses: actions/upload-artifact@v4
 - uses: actions/upload-artifact@5d5d22a31266ced268874388b861e4b58bb5c2f3 # v4.3.1
 with:
 name: wheels
 name: wheels_windows_${{ matrix.cibw_arch }}_${{ matrix.cibw_python }}
 path: ./dist/*.whl
 if-no-files-found: error

deploy:
 name: Release
deploy_pypi:
 name: Release (PyPI)
 needs:
 [
 build_linux_x86_64_wheels,
 build_linux_aarch64_wheels,
 build_macos_wheels,
 build_windows_wheels,
 ]
 if: github.repository_owner == 'PyWavelets' && startsWith(github.ref, 'refs/tags/v') && always()
 # Run only on tags pushed to the repository
 if: github.repository == 'PyWavelets/pywt' && startsWith(github.ref, 'refs/tags/v')
 runs-on: ubuntu-latest
 steps:
 - uses: actions/checkout@v4
 - uses: actions/checkout@9bb56186c3b09b4f86b1c65136769dd318469633 # v4.1.2
 with:
 fetch-depth: 0

Expand All@@ -204,11 +203,13 @@ jobs:
 python -m pip install --upgrade pip
 pip install twine
 pip install cython numpy build
 - uses: actions/download-artifact@v4

 - uses: actions/download-artifact@c850b930e6ba138125429b7e5c93fc707a7f8427 # v4.1.4
 id: download
 with:
name: wheels
pattern: "wheels_*"
 path: ./dist
 merge-multiple: true

 - name: Publish the source distribution on PyPI
 run: |
Expand All@@ -224,7 +225,41 @@ jobs:
 TWINE_PASSWORD: ${{ secrets.TWINE_TOKEN }}

 - name: Github release
 uses: softprops/action-gh-release@v2
 uses: softprops/action-gh-release@d99959edae48b5ffffd7b00da66dcdb0a33a52ee # v2.0.2
 env:
 GITHUB_TOKEN: ${{ secrets.GITHUB_TOKEN }}
 GITHUB_REPOSITORY: ${{ github.repository }}

 deploy_anaconda:
 name: Release (Anaconda)
 needs:
 [
 build_linux_x86_64_wheels,
 build_linux_aarch64_wheels,
 build_macos_wheels,
 build_windows_wheels,
 ]
 # Run only on pushes to the master branch, on schedule, or when triggered manually
 if: >-
 github.repository == 'PyWavelets/pywt' &&
 (github.event_name == 'push' && github.ref == 'refs/heads/master') ||
 (github.event_name == 'workflow_dispatch' && github.event.inputs.push_wheels == 'true') ||
 (github.event_name == 'schedule')
 runs-on: ubuntu-latest
 steps:
 - uses: actions/checkout@9bb56186c3b09b4f86b1c65136769dd318469633 # v4.1.2
 with:
 fetch-depth: 0

 - uses: actions/download-artifact@c850b930e6ba138125429b7e5c93fc707a7f8427 # v4.1.4
 id: download
 with:
 pattern: "*_wheels"
 path: dist/
 merge-multiple: true

 - name: Push to Anaconda PyPI index
 uses: scientific-python/upload-nightly-action@b67d7fcc0396e1128a474d1ab2b48aa94680f9fc # v0.5.0
 with:
 artifacts_path: dist/
 anaconda_nightly_upload_token: ${{ secrets.ANACONDA_ORG_UPLOAD_TOKEN }}