Skip to content

ARROW-14839: [R] test-fedora-r-clang-sanitizer job failing due to snappy causing a sanitizer error - #11875

Closed
jonkeane wants to merge 8 commits into
apache:masterfrom
jonkeane:ARROW-14839-two
Closed

ARROW-14839: [R] test-fedora-r-clang-sanitizer job failing due to snappy causing a sanitizer error#11875
jonkeane wants to merge 8 commits into
apache:masterfrom
jonkeane:ARROW-14839-two

Conversation

@jonkeane

Copy link
Copy Markdown
Member

This would replace (temporarily) #11796 in a way that might be ship-able as is until Snappy accepts google/snappy#148 and is released.

@jonkeanejonkeane changed the title ARROW-14839 [R] test-fedora-r-clang-sanitizer job failing due to snappy causing a sanitizer errorARROW-14839: [R] test-fedora-r-clang-sanitizer job failing due to snappy causing a sanitizer errorDec 6, 2021
@jonkeane

Copy link
Copy Markdown
MemberAuthor

@github-actions crossbow submit test-fedora-r-clang-sanitizer

@github-actions

Copy link
Copy Markdown

1 similar comment
@github-actions

Copy link
Copy Markdown

@github-actions

Copy link
Copy Markdown

⚠️ Ticket has not been started in JIRA, please click 'Start Progress'.

@github-actions

Copy link
Copy Markdown

Revision: 4c426a5

Submitted crossbow builds: ursacomputing/crossbow @ actions-1251

TaskStatus
test-fedora-r-clang-sanitizerAzure

@jonkeane

Copy link
Copy Markdown
MemberAuthor

@github-actions crossbow submit test-fedora-r-clang-sanitizer

@github-actions

Copy link
Copy Markdown

Revision: b141103

Submitted crossbow builds: ursacomputing/crossbow @ actions-1259

TaskStatus
test-fedora-r-clang-sanitizerAzure

@jonkeane

Copy link
Copy Markdown
MemberAuthor

@github-actions crossbow submit test-fedora-r-clang-sanitizer

@jonkeane

Copy link
Copy Markdown
MemberAuthor

@github-actions autotune

@github-actions

Copy link
Copy Markdown

Revision: e1599d3

Submitted crossbow builds: ursacomputing/crossbow @ actions-1260

TaskStatus
test-fedora-r-clang-sanitizerAzure

@jonkeane

Copy link
Copy Markdown
MemberAuthor

@github-actions crossbow submit test-fedora-r-clang-sanitizer

@github-actions

Copy link
Copy Markdown

Revision: a9e77fd

Submitted crossbow builds: ursacomputing/crossbow @ actions-1266

TaskStatus
test-fedora-r-clang-sanitizerAzure

apt-get update
apt-get install -y patch
fi
fi

Copy link
Copy Markdown
MemberAuthor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

This is not strictly necessary (see below where we disable snappy if we can't find patch), but it makes sure that we do have patch available so we do exercise this code in the sanitizer in our CI

if(patch)
set(SNAPPY_PATCH_COMMAND "patch" "snappy.cc"
"${CMAKE_SOURCE_DIR}/build-support/snappy-UBSAN.patch")
endif()

Copy link
Copy Markdown
MemberAuthor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Snappy works without the patch, though it has a UBSAN error, so this patches if we can and moves on if not so we don't break.

ARROW_RAPIDJSON_BUILD_SHA256_CHECKSUM=0b6b780b6c534bfb0b23d29910bfe361e486bcfeaf106db8bc8995792072905a
ARROW_RE2_BUILD_VERSION=2021-02-02
ARROW_RE2_BUILD_SHA256_CHECKSUM=1396ab50c06c1a8885fb68bf49a5ecfd989163015fd96699a180d6414937f33f
# 1.1.9 is patched to implement https://github.com/google/snappy/pull/148 if this is bumped, remove the patch

Copy link
Copy Markdown
MemberAuthor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I've tried to flag this, and if we pursue this path, I'll make a Jira that points to each of these lines that need to be deleted when > 1.1.9 is released

# patch available, so disable snappy in those cases. If the snappy version is bumped, we should remove this.
if [ ! $(command -v patch) ]; then
ARROW_WITH_SNAPPY=OFF
fi

Copy link
Copy Markdown
MemberAuthor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

For our CI this should not be hit, but is important incase CRAN happens to not have patch, it will disable snappy so we don't get a sanitizer error there.

@jonkeane

Copy link
Copy Markdown
MemberAuthor

@github-actions crossbow submit -g r

@github-actions

Copy link
Copy Markdown

Revision: a9e77fd

Submitted crossbow builds: ursacomputing/crossbow @ actions-1269

TaskStatus
conda-linux-gcc-py36-cpu-r40Azure
conda-linux-gcc-py37-cpu-r41Azure
conda-osx-clang-py36-r40Azure
conda-osx-clang-py37-r41Azure
conda-win-vs2017-py36-r40Azure
conda-win-vs2017-py37-r41Azure
homebrew-r-autobrewGithub Actions
test-fedora-r-clang-sanitizerAzure
test-r-arrow-backwards-compatibilityGithub Actions
test-r-depsource-autoAzure
test-r-depsource-systemGithub Actions
test-r-devdocsGithub Actions
test-r-gcc-11Github Actions
test-r-install-localGithub Actions
test-r-linux-as-cranGithub Actions
test-r-linux-rchkGithub Actions
test-r-linux-valgrindAzure
test-r-minimal-buildAzure
test-r-offline-maximalGithub Actions
test-r-offline-minimalAzure
test-r-rhub-debian-gcc-devel-lto-latestAzure
test-r-rhub-ubuntu-gcc-release-latestAzure
test-r-rocker-r-base-latestAzure
test-r-rstudio-r-base-4.1-centos7-devtoolset-8Azure
test-r-rstudio-r-base-4.1-centos8Azure
test-r-rstudio-r-base-4.1-focalAzure
test-r-rstudio-r-base-4.1-opensuse15Azure
test-r-rstudio-r-base-4.1-opensuse42Azure
test-r-ubuntu-21.04Github Actions
test-r-versionsGithub Actions
test-ubuntu-18.04-r-sanitizerAzure

@jonkeane

Copy link
Copy Markdown
MemberAuthor

The conda failures are known / on master. The test-r-depsource-system failure looks transient (and at the very least unrelated!)

@ursabot

ursabot commented Dec 8, 2021

Copy link
Copy Markdown

Benchmark runs are scheduled for baseline = cba23c4 and contender = c2a89e6. c2a89e6 is a master commit associated with this PR. Results will be available as each benchmark for each run completes.
Conbench compare runs links:
[Finished ⬇️0.0% ⬆️0.0%] ec2-t3-xlarge-us-east-2
[Failed ⬇️0.0% ⬆️0.0%] ursa-i9-9960x
[Finished ⬇️0.09% ⬆️0.09%] ursa-thinkcentre-m75q
Supported benchmarks:
ec2-t3-xlarge-us-east-2: Supported benchmark langs: Python. Runs only benchmarks with cloud = True
ursa-i9-9960x: Supported benchmark langs: Python, R, JavaScript
ursa-thinkcentre-m75q: Supported benchmark langs: C++, Java

Sign up for freeto join this conversation on GitHub. Already have an account? Sign in to comment

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants

@jonkeane@ursabot