Skip to content

Make userbuffers support strictly opt-in - #161

Closed
timmoon10 wants to merge 1 commit into
NVIDIA:mainfrom
timmoon10:ub-build-debug
Closed

Make userbuffers support strictly opt-in#161
timmoon10 wants to merge 1 commit into
NVIDIA:mainfrom
timmoon10:ub-build-debug

Conversation

@timmoon10

@timmoon10timmoon10 commented Apr 20, 2023

Copy link
Copy Markdown
Member

#147 builds with support for userbuffers whenever MPI_HOME is set in the environment. This isn't great since users may run on non-DGX systems with MPI support (alas), not to mention userbuffers is very hacky. This PR only builds with userbuffers support when explicitly enabled:

export NVTE_WITH_USERBUFFERS=1
export MPI_HOME=/usr/local/mpi
cd TransformerEngine
pip install .

It also refactors the build system to handle MPI in a more standard way.

Signed-off-by: Tim Moon <tmoon@nvidia.com>
@timmoon10
timmoon10 marked this pull request as draft April 20, 2023 06:07
@timmoon10timmoon10 added 0.8.0 bug Something isn't working labels Apr 20, 2023
@timmoon10

Copy link
Copy Markdown
MemberAuthor

/te-ci

@timmoon10

timmoon10 commented Apr 20, 2023

Copy link
Copy Markdown
MemberAuthor

Pipeline w/ userbuffers: 8020580 passed
Pipeline w/o userbuffers: 8020619 passed

@timmoon10
timmoon10 marked this pull request as ready for review April 20, 2023 13:10
@timmoon10timmoon10 mentioned this pull request Apr 20, 2023
@timmoon10

Copy link
Copy Markdown
MemberAuthor

Merged into #162.

Sign up for freeto join this conversation on GitHub. Already have an account? Sign in to comment

Labels

0.8.0bugSomething isn't working

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant

@timmoon10