Skip to content

GH-47588: [C++] Bump mimalloc version to 3.1.5 - #47589

Merged
pitrou merged 7 commits into
apache:mainfrom
pitrou:gh-bump-mimalloc
Oct 9, 2025
Merged

GH-47588: [C++] Bump mimalloc version to 3.1.5#47589
pitrou merged 7 commits into
apache:mainfrom
pitrou:gh-bump-mimalloc

Conversation

@pitrou

@pitroupitrou commented Sep 17, 2025

Copy link
Copy Markdown
Member

Rationale for this change

According to microsoft/mimalloc#1073 , mimalloc v3 is preferred over v2 for production usage.

There are reports of higher than expected memory consumption with mimalloc 2.2.x, notably when reading Parquet data (example: GH-47266).

What changes are included in this PR?

Bump to mimalloc 3.1.5, which is the latest mimalloc 3.1.x release as of this writing.

Are these changes tested?

Yes, by existing tests and CI.

Are there any user-facing changes?

Hopefully not, besides a potential reduction in memory usage due to improvements in mimalloc v3.

@github-actionsgithub-actionsBot added the awaiting review Awaiting review label Sep 17, 2025
@pitrou

Copy link
Copy Markdown
MemberAuthor

@github-actions crossbow submit -g cpp

@github-actions

This comment was marked as outdated.

@pitrou

Copy link
Copy Markdown
MemberAuthor

@github-actions crossbow submit -g cpp

@github-actions

This comment was marked as outdated.

@pitrou

Copy link
Copy Markdown
MemberAuthor

@github-actions crossbow submit -g cpp

@github-actions

This comment was marked as outdated.

@pitrou

Copy link
Copy Markdown
MemberAuthor

@ursabot please benchmark

@voltrondatabot

Copy link
Copy Markdown

Benchmark runs are scheduled for commit 709942b35328dbf4c84206bfc8fc6c0071448639. Watch https://buildkite.com/apache-arrow and https://conbench.ursa.dev for updates. A comment will be posted here when the runs are complete.

@conbench-apache-arrow

Copy link
Copy Markdown

Thanks for your patience. Conbench analyzed the 4 benchmarking runs that have been run so far on PR commit 709942b35328dbf4c84206bfc8fc6c0071448639.

There were 80 benchmark results indicating a performance regression:

The full Conbench report has more details.

@pitrou

Copy link
Copy Markdown
MemberAuthor

@github-actions crossbow submit -g cpp

@github-actions

This comment was marked as outdated.

@pitrou

Copy link
Copy Markdown
MemberAuthor

@github-actions crossbow submit -g cpp

@pitroupitrou changed the title GH-47588: [C++] Bump mimalloc version to 3.0.9GH-47588: [C++] Bump mimalloc version to 3.1.5Oct 7, 2025
@github-actions

This comment was marked as outdated.

Comment threadci/scripts/msys2_setup.sh Outdated
@github-actionsgithub-actionsBot added awaiting committer review Awaiting committer review awaiting changes Awaiting changes and removed awaiting review Awaiting review awaiting committer review Awaiting committer review awaiting changes Awaiting changes labels Oct 7, 2025
@pitrou

Copy link
Copy Markdown
MemberAuthor

CI failures are unrelated. Should we merge this @kou@WillAyd ?

kou
kou approved these changes Oct 9, 2025

@koukou left a comment

Copy link
Copy Markdown
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

+1

@github-actionsgithub-actionsBot added awaiting merge Awaiting merge and removed awaiting change review Awaiting change review labels Oct 9, 2025
@pitrou

Copy link
Copy Markdown
MemberAuthor

@github-actions crossbow submit -g cpp -g r cp313

@github-actions

Copy link
Copy Markdown

Revision: 4294e34

Submitted crossbow builds: ursacomputing/crossbow @ actions-562e16c367

TaskStatus
example-cpp-minimal-build-staticGitHub Actions
example-cpp-minimal-build-static-system-dependencyGitHub Actions
example-cpp-tutorialGitHub Actions
r-binary-packagesGitHub Actions
r-recheck-mostGitHub Actions
test-build-cpp-fuzzGitHub Actions
test-conda-cppGitHub Actions
test-conda-cpp-valgrindGitHub Actions
test-cuda-cpp-ubuntu-22.04-cuda-11.7.1GitHub Actions
test-debian-12-cpp-amd64GitHub Actions
test-debian-12-cpp-i386GitHub Actions
test-fedora-42-cppGitHub Actions
test-r-arrow-backwards-compatibilityGitHub Actions
test-r-depsource-bundledAzure
test-r-depsource-systemGitHub Actions
test-r-dev-duckdbGitHub Actions
test-r-devdocsGitHub Actions
test-r-extra-packagesGitHub Actions
test-r-gcc-11GitHub Actions
test-r-gcc-12GitHub Actions
test-r-install-localGitHub Actions
test-r-install-local-minsizerelGitHub Actions
test-r-linux-as-cranGitHub Actions
test-r-linux-rchkGitHub Actions
test-r-linux-sanitizersGitHub Actions
test-r-linux-valgrindGitHub Actions
test-r-m1-sanGitHub Actions
test-r-macos-as-cranGitHub Actions
test-r-minimal-buildAzure
test-r-offline-maximalGitHub Actions
test-r-offline-minimalAzure
test-r-rhub-debian-gcc-devel-lto-latestAzure
test-r-rhub-ubuntu-gcc12-custom-ccacheAzure
test-r-rhub-ubuntu-release-latestAzure
test-r-rocker-r-ver-latestAzure
test-r-rstudio-r-base-4.1-focalAzure
test-r-rstudio-r-base-4.2-focalAzure
test-r-ubuntu-22.04GitHub Actions
test-r-versionsGitHub Actions
test-ubuntu-22.04-cppGitHub Actions
test-ubuntu-22.04-cpp-20GitHub Actions
test-ubuntu-22.04-cpp-bundledGitHub Actions
test-ubuntu-22.04-cpp-emscriptenGitHub Actions
test-ubuntu-22.04-cpp-no-threadingGitHub Actions
test-ubuntu-24.04-cppGitHub Actions
test-ubuntu-24.04-cpp-bundled-offlineGitHub Actions
test-ubuntu-24.04-cpp-gcc-13-bundledGitHub Actions
test-ubuntu-24.04-cpp-gcc-14GitHub Actions
test-ubuntu-24.04-cpp-minimal-with-formatsGitHub Actions
test-ubuntu-24.04-cpp-thread-sanitizerGitHub Actions
wheel-macos-monterey-cp313-cp313-amd64GitHub Actions
wheel-macos-monterey-cp313-cp313-arm64GitHub Actions
wheel-macos-monterey-cp313-cp313t-amd64GitHub Actions
wheel-macos-monterey-cp313-cp313t-arm64GitHub Actions
wheel-manylinux-2-28-cp313-cp313-amd64GitHub Actions
wheel-manylinux-2-28-cp313-cp313-arm64GitHub Actions
wheel-manylinux-2-28-cp313-cp313t-amd64GitHub Actions
wheel-manylinux-2-28-cp313-cp313t-arm64GitHub Actions
wheel-musllinux-1-2-cp313-cp313-amd64GitHub Actions
wheel-musllinux-1-2-cp313-cp313-arm64GitHub Actions
wheel-musllinux-1-2-cp313-cp313t-amd64GitHub Actions
wheel-musllinux-1-2-cp313-cp313t-arm64GitHub Actions
wheel-windows-cp313-cp313-amd64GitHub Actions
wheel-windows-cp313-cp313t-amd64GitHub Actions

@pitrou
pitrou merged commit e1f727c into apache:mainOct 9, 2025
60 checks passed
@pitroupitrou removed the awaiting merge Awaiting merge label Oct 9, 2025
@pitroupitrou mentioned this pull request Oct 9, 2025
@pitrou
pitrou deleted the gh-bump-mimalloc branch October 9, 2025 09:47
raulcd pushed a commit that referenced this pull request Oct 9, 2025
### Rationale for this change
According to microsoft/mimalloc#1073 , mimalloc v3 is preferred over v2 for production usage.
There are reports of higher than expected memory consumption with mimalloc 2.2.x, notably when reading Parquet data (example: GH-47266).
### What changes are included in this PR?
Bump to mimalloc 3.1.5, which is the latest mimalloc 3.1.x release as of this writing.
### Are these changes tested?
Yes, by existing tests and CI.
### Are there any user-facing changes?
Hopefully not, besides a potential reduction in memory usage due to improvements in mimalloc v3.
* GitHub Issue: #47588
Authored-by: Antoine Pitrou <antoine@python.org>
Signed-off-by: Antoine Pitrou <antoine@python.org>
@conbench-apache-arrow

Copy link
Copy Markdown

After merging your PR, Conbench analyzed the 3 benchmarking runs that have been run so far on merge-commit e1f727c.

There were 5 benchmark results indicating a performance regression:

The full Conbench report has more details. It also includes information about 16 possible false positives for unstable benchmarks that are known to sometimes produce them.

zanmato1984 pushed a commit to zanmato1984/arrow that referenced this pull request Oct 15, 2025
### Rationale for this change
According to microsoft/mimalloc#1073 , mimalloc v3 is preferred over v2 for production usage.
There are reports of higher than expected memory consumption with mimalloc 2.2.x, notably when reading Parquet data (example: apacheGH-47266).
### What changes are included in this PR?
Bump to mimalloc 3.1.5, which is the latest mimalloc 3.1.x release as of this writing.
### Are these changes tested?
Yes, by existing tests and CI.
### Are there any user-facing changes?
Hopefully not, besides a potential reduction in memory usage due to improvements in mimalloc v3.
* GitHub Issue: apache#47588
Authored-by: Antoine Pitrou <antoine@python.org>
Signed-off-by: Antoine Pitrou <antoine@python.org>
@lesterfan

Copy link
Copy Markdown
Contributor

Are there any user-facing changes?
Hopefully not, besides a potential reduction in memory usage due to improvements in mimalloc v3.

Just wanted to note that this change actually fixes an issue we've been observing with libarrow.so and the address sanitizer! Here is the issue I just filed for reference: #47828.

lesterfan pushed a commit to lesterfan/arrow that referenced this pull request Mar 20, 2026
According to microsoft/mimalloc#1073 , mimalloc v3 is preferred over v2 for production usage.
There are reports of higher than expected memory consumption with mimalloc 2.2.x, notably when reading Parquet data (example: apacheGH-47266).
Bump to mimalloc 3.1.5, which is the latest mimalloc 3.1.x release as of this writing.
Yes, by existing tests and CI.
Hopefully not, besides a potential reduction in memory usage due to improvements in mimalloc v3.
* GitHub Issue: apache#47588
Authored-by: Antoine Pitrou <antoine@python.org>
Signed-off-by: Antoine Pitrou <antoine@python.org>
lesterfan pushed a commit to lesterfan/arrow that referenced this pull request Mar 20, 2026
apacheGH-47588: [C++] Bump mimalloc version to 3.1.5 (apache#47589)
See merge request third-party/arrow!29
Mottl pushed a commit to Mottl/arrow that referenced this pull request May 26, 2026
### Rationale for this change
According to microsoft/mimalloc#1073 , mimalloc v3 is preferred over v2 for production usage.
There are reports of higher than expected memory consumption with mimalloc 2.2.x, notably when reading Parquet data (example: apacheGH-47266).
### What changes are included in this PR?
Bump to mimalloc 3.1.5, which is the latest mimalloc 3.1.x release as of this writing.
### Are these changes tested?
Yes, by existing tests and CI.
### Are there any user-facing changes?
Hopefully not, besides a potential reduction in memory usage due to improvements in mimalloc v3.
* GitHub Issue: apache#47588
Authored-by: Antoine Pitrou <antoine@python.org>
Signed-off-by: Antoine Pitrou <antoine@python.org>
Sign up for freeto join this conversation on GitHub. Already have an account? Sign in to comment

Labels

Projects

None yet

Development

Successfully merging this pull request may close these issues.

4 participants

@pitrou@voltrondatabot@kou@lesterfan