Skip to content

Popular repositories Loading

  1. exllamav2 exllamav2Public

    A fast inference library for running LLMs locally on modern consumer-class GPUs

    Python 4.6k 339

  2. exllamav3 exllamav3Public

    An optimized quantization and inference library for running LLMs locally on modern consumer-class GPUs

    Python 1.1k 128

  3. exui exuiPublic

    Web UI for ExLlamaV2

    JavaScript 513 45

Repositories

Showing 3 of 3 repositories

Top languages

Loading…

Most used topics

Loading…