OpenBitSys

Popular repositories Loading

1. BitDistiller BitDistillerPublic

   [ACL 2024] A novel QAT with Self-Distillation framework to enhance ultra low-bit LLMs.

   Python 140 20

2. BitDecoding BitDecodingPublic

   [HPCA 2026] A GPU-optimized system for efficient long-context LLMs decoding with low-bit KV cache.

   C++ 99 14

3. vlut.cpp vlut.cppPublic

   [MobiSys 2026] On-device ultra-low-bit LLM inference with LUT.

   C++ 26 4