Skip to content

Feat: enable new modal gpus 🚀 - #286

Open
S1ro1 wants to merge 2 commits into
mainfrom
modal-new-gpus
Open

Feat: enable new modal gpus 🚀#286
S1ro1 wants to merge 2 commits into
mainfrom
modal-new-gpus

Conversation

@S1ro1

Copy link
Copy Markdown
Member

Enable H200 + B200 for Modal

CopilotAI review requested due to automatic review settings May 30, 2025 22:03

CopilotAI left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Pull Request Overview

This PR enables support for new modal GPUs for the application.

  • Updated the GPU list in modal_runner_archs.py to include B200 and H200.
  • Added H200 to the ModalGPU enum and its ranking criteria in consts.py.

Reviewed Changes

Copilot reviewed 2 out of 2 changed files in this pull request and generated no comments.

FileDescription
src/discord-cluster-manager/modal_runner_archs.pyUpdated GPU list to include new GPU identifiers for modal execution.
src/discord-cluster-manager/consts.pyAdded H200 to the ModalGPU enum and its corresponding rank mapping.

"L4": "80",
"A100": "80",
"H100": "90a",
"H200": "90a",

Copy link
Copy Markdown
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

should we enable H200 tho?

Copy link
Copy Markdown
MemberAuthor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Don't have a strong opinion, probably not too interesting GPU so idc if we remove.

Copy link
Copy Markdown
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

yeah'd rather we remove

Sign up for freeto join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants

@S1ro1@msaroufim