Feature request
Requesting to distribute a Pypi whl for aarch64.
Motivation
Nvidia's push to ARM64 architecture (e.g. GH200, NVL32/NV72) is driving a lot more projects to support this architecture. While downstream engines such as VLLM support aarch64, it would be more difficult to support official container distributions if they need to compile dependencies such as bitsandbytes from source for each build (vllm-project/vllm#10499).
Your contribution
I believe this would need to be done directly by the maintainers.
Feature request
Requesting to distribute a Pypi whl for aarch64.
Motivation
Nvidia's push to ARM64 architecture (e.g. GH200, NVL32/NV72) is driving a lot more projects to support this architecture. While downstream engines such as VLLM support aarch64, it would be more difficult to support official container distributions if they need to compile dependencies such as bitsandbytes from source for each build (vllm-project/vllm#10499).
Your contribution
I believe this would need to be done directly by the maintainers.