[CI][Release][R] r-binary-packages job fails on the release candidate branch for 22.0.0

[raulcd]

Describe the bug, including details regarding any error messages, version, and platform.

The r-binary-packages job is failing on the Release candidate branch, see:
https://github.com/ursacomputing/crossbow/actions/runs/18499537950

The failures logs vary per platform but in general all of them seem to be unable to download / find some files. On Linux / macOS error looks like:

 *** Found libcurl and OpenSSL >= 3.0.0
Error in download.file(from_url, to_file, quiet = hush, mode = "wb") : 
 cannot open URL 'file:///__w/crossbow/crossbow/repor-libarrow-linux-x86_64-openssl-3.0-22.0.0.zip', reason 'No such file or directory'
*** Unable to retrieve libarrow for version 22.0.0 (linux-x86_64-openssl-3.0)
*** Attempted to download the libarrow binary from: file:///__w/crossbow/crossbow/repor-libarrow-linux-x86_64-openssl-3.0-22.0.0.zip
*** Proceeding without libarrow (build not authorized)

On Windows:

*** Generating code with data-raw/codegen.R
./configure.win: line 37: 1788 Segmentation fault "${R_HOME}/bin${R_ARCH_BIN}/Rscript.exe" data-raw/codegen.R
*** pkg-config found.
Error in download.file(from_url, to_file, quiet = hush, mode = "wb") : 
 cannot open URL 'file://D:/a/crossbow/crossbow/repor-libarrow-windows-x86_64-22.0.0.zip', reason 'No such file or directory'
*** Unable to retrieve libarrow for version 22.0.0 (windows-x86_64)
*** Attempted to download the libarrow binary from: file://D:/a/crossbow/crossbow/repor-libarrow-windows-x86_64-22.0.0.zip
*** Proceeding without libarrow (build not authorized)

Component(s)

Continuous Integration, Release, R

[raulcd]

Is this a release blocker? cc @jonkeane @thisisnic @amoeba @kou

[jonkeane]

I might not be able to look at this in more detail until tomorrow (sorry!) but I think there's something wrong with our path construction here.

One error references file:///__w/crossbow/crossbow/repor-libarrow-linux-x86_64-openssl-3.0-22.0.0.zip but on that same job we download the artifacts to /__w/crossbow/crossbow/repo/libarrow I wonder if we need to do something like #47727 in this job? Also possibly related: #45964

[amoeba]

The "repor" in that string makes it look like we are just missing a path separator so this was likely introduced in one of the PRs @jonkeane linked. It looks like we set arrow.repo in macros.jinja and one way to fix this would be to tweak

arrow/r/tools/nixlibs.R

Line 159 in 2a5ad38

binary_url <- paste0(arrow_repo, libfile)

I'm not 100% sure this is a release blocker though since this looks limited to just this job and we can tweak nixlibs.R after the monorepo release (though it's not ideal).

[jonkeane]

I'm not 100% sure this is a release blocker though since this looks limited to just this job and we can tweak nixlibs.R after the monorepo release (though it's not ideal).

Agreed here — if this is just limited to this job, not a blocker (though like you say not ideal). Did you follow that thread @amoeba to confirm that this path won't get hit on CRAN after the release?

[amoeba]

I'd have to look later on tonight, it'd be nice to confirm a fix. Maybe @assignUser can beat me to it? :)

[kou]

Oh, sorry...

Could you try this?

diff --git a/dev/tasks/macros.jinja b/dev/tasks/macros.jinja
index ddcb0d554e..5b1a17d6b7 100644
--- a/dev/tasks/macros.jinja
+++ b/dev/tasks/macros.jinja
@@ -285,7 +285,7 @@ env:
 shell: Rscript {0}
 run: |
 profile_path <- file.path(getwd(), ".Rprofile")
- repo <- paste0("file://", getwd(), "/repo")
+ repo <- paste0("file://", getwd(), "/repo/")
 str <- paste0("options(arrow.repo = '", repo, "' )")
 print(str)
 write(str, file = profile_path, append = TRUE)

[kou]

This is not a blocker but it's better that we fix this for 22.0.0 to verify our binary artifacts.

[raulcd]

@kou should I try the above on the RC branch and if it works create a new RC? I'm unsure how to test it without pushing to the RC or creating a new RC

[kou]

Ah, good point.

Pushing the change to release-22.0.0-rc0 branch and add @github-actions crossbow submit r-binary-packages comment to #47818 may work. If it doesn't work, we need to create one more RC...

[raulcd]

It is still not working the job fails with:

 *** pkg-config not found.
trying URL 'https://github.com/apache/arrow/releases'
downloaded 360 KB

*** Found libcurl and OpenSSL >= 3.0.0
Error in download.file(from_url, to_file, quiet = hush, mode = "wb") : 
 cannot open URL 'file:///__w/crossbow/crossbow/repo/r-libarrow-linux-x86_64-openssl-3.0-22.0.0.zip', reason 'No such file or directory'
*** Unable to retrieve libarrow for version 22.0.0 (linux-x86_64-openssl-3.0)
*** Attempted to download the libarrow binary from: file:///__w/crossbow/crossbow/repo/r-libarrow-linux-x86_64-openssl-3.0-22.0.0.zip
*** Proceeding without libarrow (build not authorized)

but it seems the file should be on repo/libarrow/r-libarrow-linux-x86_64-openssl-3.0-22.0.0.zip instead of repo/r-libarrow-linux-x86_64-openssl-3.0-22.0.0.zip based on the download step:

Run actions/download-artifact@v4
/usr/bin/docker exec d6594edf4b4732419eee8f8ffcca0f87c7c8d2ff0b3c080a27140edb79ac30be sh -c "cat /etc/*release | grep ^ID"
Downloading single artifact
Preparing to download the following artifacts:
- r-libarrow-linux-x86_64-openssl-3.0 (ID: 4273939784, Size: 42351008, Expected Digest: sha256:899074ce7508d163f55a5437a9642d014d3f5a887e7a6f418542697fae554ae9)
Redirecting to blob download url: https://productionresultssa8.blob.core.windows.net/actions-results/40641e3e-e95d-4a53-85e6-2f26d73d3ebe/workflow-job-run-90e00d04-66e2-5c83-a5f4-b7120ce924c8/artifacts/bfbd4d76b6be8a628c4e99769738c88d97e9535b95750a8ff112f1fe5cb26080.zip
Starting download of artifact to: /__w/crossbow/crossbow/repo/libarrow