Skip to content

ARROW-14839 [R] test-fedora-r-clang-sanitizer job failing due to snappy causing a sanitizer error - #11796

Closed
jonkeane wants to merge 5 commits into
apache:masterfrom
jonkeane:ARROW-14839
Closed

ARROW-14839 [R] test-fedora-r-clang-sanitizer job failing due to snappy causing a sanitizer error#11796
jonkeane wants to merge 5 commits into
apache:masterfrom
jonkeane:ARROW-14839

Conversation

@jonkeane

Copy link
Copy Markdown
Member

No description provided.

@jonkeane

Copy link
Copy Markdown
MemberAuthor

@github-actions crossbow submit test-fedora-r-clang-sanitizer

@github-actions

Copy link
Copy Markdown

@github-actions

Copy link
Copy Markdown

⚠️ Ticket has not been started in JIRA, please click 'Start Progress'.

@github-actions

Copy link
Copy Markdown

Revision: b938a2a

Submitted crossbow builds: ursacomputing/crossbow @ actions-1215

TaskStatus
test-fedora-r-clang-sanitizerAzure

@jonkeane

Copy link
Copy Markdown
MemberAuthor

@github-actions crossbow submit test-fedora-r-clang-sanitizer

@github-actions

Copy link
Copy Markdown

Revision: e40ea9e

Submitted crossbow builds: ursacomputing/crossbow @ actions-1216

TaskStatus
test-fedora-r-clang-sanitizerAzure

Comment threadcpp/thirdparty/versions.txt Outdated
"ARROW_RAPIDJSON_URL rapidjson-${ARROW_RAPIDJSON_BUILD_VERSION}.tar.gz https://github.com/miloyip/rapidjson/archive/${ARROW_RAPIDJSON_BUILD_VERSION}.tar.gz"
"ARROW_RE2_URL re2-${ARROW_RE2_BUILD_VERSION}.tar.gz https://github.com/google/re2/archive/${ARROW_RE2_BUILD_VERSION}.tar.gz"
"ARROW_SNAPPY_URL snappy-${ARROW_SNAPPY_BUILD_VERSION}.tar.gz https://github.com/google/snappy/archive/${ARROW_SNAPPY_BUILD_VERSION}.tar.gz"
"ARROW_SNAPPY_URL snappy-${ARROW_SNAPPY_BUILD_VERSION}.tar.gz https://codeload.github.com/google/snappy/tar.gz/master"

Copy link
Copy Markdown
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Can you point to a specific commit? Won't this break (the checksum) as soon as another commit is added to master?

Copy link
Copy Markdown
MemberAuthor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Yes, if I can get this to work, that is what we'll need to do (or roll our own snappy "release" that we host)

@pitrou

Copy link
Copy Markdown
Member

@github-actions crossbow submit test-fedora-r-clang-sanitizer

@github-actions

Copy link
Copy Markdown

Revision: bcc4fe5

Submitted crossbow builds: ursacomputing/crossbow @ actions-1223

TaskStatus
test-fedora-r-clang-sanitizerAzure

@pitrou

Copy link
Copy Markdown
Member

Opened PR google/snappy#148 for Snappy so that we can update to upstream git master when merged.

@jonkeane

Copy link
Copy Markdown
MemberAuthor

Thank you @pitrou ! I've undone some of the stuff I did in my testing, and now we've got passing builds. I'll run a full r group run to confirm this isn't doing something else funny on any of the more exotic architectures and then merge.

@jonkeane

Copy link
Copy Markdown
MemberAuthor

@github-actions crossbow submit -g r

@github-actions

Copy link
Copy Markdown

Revision: d8845e4

Submitted crossbow builds: ursacomputing/crossbow @ actions-1224

TaskStatus
conda-linux-gcc-py36-cpu-r40Azure
conda-linux-gcc-py37-cpu-r41Azure
conda-osx-clang-py36-r40Azure
conda-osx-clang-py37-r41Azure
conda-win-vs2017-py36-r40Azure
conda-win-vs2017-py37-r41Azure
homebrew-r-autobrewGithub Actions
test-fedora-r-clang-sanitizerAzure
test-r-arrow-backwards-compatibilityGithub Actions
test-r-depsource-autoAzure
test-r-depsource-systemGithub Actions
test-r-devdocsGithub Actions
test-r-gcc-11Github Actions
test-r-install-localGithub Actions
test-r-linux-as-cranGithub Actions
test-r-linux-rchkGithub Actions
test-r-linux-valgrindAzure
test-r-minimal-buildAzure
test-r-offline-maximalGithub Actions
test-r-offline-minimalAzure
test-r-rhub-debian-gcc-devel-lto-latestAzure
test-r-rhub-ubuntu-gcc-release-latestAzure
test-r-rocker-r-base-latestAzure
test-r-rstudio-r-base-4.1-centos7-devtoolset-8Azure
test-r-rstudio-r-base-4.1-centos8Azure
test-r-rstudio-r-base-4.1-focalAzure
test-r-rstudio-r-base-4.1-opensuse15Azure
test-r-rstudio-r-base-4.1-opensuse42Azure
test-r-ubuntu-21.04Github Actions
test-r-versionsGithub Actions
test-ubuntu-18.04-r-sanitizerAzure

@pitrou

Copy link
Copy Markdown
Member

Uh, we should wait for the Snappy change to be merged before updating this. I don't think we want to fetch Snappy from some random third-party fork.

@jonkeane

Copy link
Copy Markdown
MemberAuthor

Could we put it into the ursa-labs thirdparty repo where we've put some of these before? Looking through the PRs (open and closed) upstream I'm a bit worried it'll take a while for it to be merged.

@jonkeane

jonkeane commented Dec 1, 2021

Copy link
Copy Markdown
MemberAuthor

The following failures in the group are all explained elsewhere:

homebrew-r-autobrew — failing on arrow@HEAD / in the nightlies, https://issues.apache.org/jira/browse/ARROW-14802
test-r-gcc-11 — resolved in #11795
test-r-linux-as-cran — resolved in #11795

And the conda-* builds are also failing arrow@HEAD, https://issues.apache.org/jira/browse/ARROW-14256

@jonkeane

Copy link
Copy Markdown
MemberAuthor

Ok, I've got an alternative that patches snappy 1.1.9 instead of using a special self-hosted version of snappy in #11875 I'm happy to do either that PR or this one (well, after we find a way to host our custom patched snappy source). But would like to merge one or the other so we have some clean clang sanitizer CI in the weeks leading up to the release burn down.

@pitrou

Copy link
Copy Markdown
Member

I'm ok with the patch solution.

jonkeane added a commit that referenced this pull request Dec 8, 2021
…ppy causing a sanitizer error
This would replace (temporarily) #11796 in a way that might be ship-able as is until Snappy accepts google/snappy#148 and is released.
Closes#11875 from jonkeane/ARROW-14839-two
Authored-by: Jonathan Keane <jkeane@gmail.com>
Signed-off-by: Jonathan Keane <jkeane@gmail.com>
@jonkeanejonkeane closed this Dec 8, 2021
Sign up for freeto join this conversation on GitHub. Already have an account? Sign in to comment

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants

@jonkeane@pitrou@nealrichardson