Skip to content

ARROW-10388: [Java] Fix Spark integration build failure - #8526

Closed
liyafan82 wants to merge 2 commits into
apache:masterfrom
liyafan82:fly_1026_spk
Closed

ARROW-10388: [Java] Fix Spark integration build failure#8526
liyafan82 wants to merge 2 commits into
apache:masterfrom
liyafan82:fly_1026_spk

Conversation

@liyafan82

@liyafan82liyafan82 commented Oct 26, 2020

Copy link
Copy Markdown
Contributor

@github-actions

github-actionsBot commented Oct 26, 2020

Copy link
Copy Markdown

https://issues.apache.org/jira/browse/ARROW-10388

@kou

kou commented Oct 27, 2020

Copy link
Copy Markdown
Member

@github-actions crossbow submit -spark-

@github-actions

github-actionsBot commented Oct 27, 2020

Copy link
Copy Markdown

Revision: ef51e5246815469371863f896f7bc85457e46dfb

Submitted crossbow builds: ursa-labs/crossbow @ actions-681

TaskStatus
test-conda-python-3.7-spark-branch-3.0Github Actions
test-conda-python-3.8-spark-masterGithub Actions

@liyafan82

liyafan82 commented Oct 27, 2020•
edited
Loading

Copy link
Copy Markdown
ContributorAuthor

The first test (test-conda-python-3.7-spark-branch-3.0) failed because of lacking a library on the class path:

Caused by: java.lang.RuntimeException: No DefaultAllocationManager found on classpath. Can't allocate Arrow buffers. Please consider adding arrow-memory-netty or arrow-memory-unsafe as a dependency.

This change was introduced recently as we split the arrow-memory module into 3 modules.

@emkornfield

emkornfield commented Oct 28, 2020

Copy link
Copy Markdown
Contributor

@liyafan82 I applied a small cleanup patch. If this looks good and CI is green we should go ahead and merge this and open up a separate JIRA for the allocator issue.

@liyafan82

liyafan82 commented Oct 28, 2020

Copy link
Copy Markdown
ContributorAuthor

@liyafan82 I applied a small cleanup patch. If this looks good and CI is green we should go ahead and merge this and open up a separate JIRA for the allocator issue.

@emkornfield Sounds reasonable. Thanks.

@liyafan82liyafan82 reopened this Oct 29, 2020
@liyafan82

liyafan82 commented Oct 29, 2020

Copy link
Copy Markdown
ContributorAuthor

Merging this, as something is wrong with continuous-integration/travis-ci/pr

@liyafan82

liyafan82 commented Oct 29, 2020

Copy link
Copy Markdown
ContributorAuthor

I have opened https://issues.apache.org/jira/browse/SPARK-33279 to track the build failure on spark-3.0 branch.

@asfimportasfimport mentioned this pull request Oct 29, 2020
Closed
pribor pushed a commit to GlobalWebIndex/arrow that referenced this pull request Oct 24, 2025
@liyafan82@emkornfield@kou
ARROW-10388: [Java] Fix Spark integration build failure
15ede52
Please see https://issues.apache.org/jira/browse/ARROW-10388Closesapache#8526 from liyafan82/fly_1026_spk
Lead-authored-by: liyafan82 <fan_li_ya@foxmail.com>
Co-authored-by: emkornfield <emkornfield@gmail.com>
Signed-off-by: liyafan82 <fan_li_ya@foxmail.com>
Sign up for freeto join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

No reviews

Assignees

No one assigned

Labels

None yet

Projects

None yet

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.

3 participants

@liyafan82@kou@emkornfield