Skip to content

@MachineLearningSystem MachineLearningSystem

All

    Repositories list

    820 repositories

    • 26SOSP-Anchor

      Public
      Python
      •
      Apache License 2.0
      •1•0•0•0•Updated Aug 27, 2026Aug 27, 2026

    • vllm-ascend

      Public
      Community maintained hardware plugin for vLLM on Ascend
      C++
      •
      Apache License 2.0
      •2.2k•0•0•0•Updated Aug 25, 2026Aug 25, 2026

    • spec-ptc

      Public
      Speculative programmatic tool calling (sPTC) for harnesses like RLM, CodeAct, etc.
      Python
      •
      MIT License
      •16•0•0•0•Updated Aug 24, 2026Aug 24, 2026

    • MagiAttention

      Public
      A Distributed Attention Towards Linear Scalability for Ultra-Long Context, Heterogeneous Data Training
      Python
      •
      Apache License 2.0
      •68•0•0•0•Updated Aug 24, 2026Aug 24, 2026

    • 26SOSP-MorphX

      Public
      Code for SOSP paper
      HTML
      •
      MIT License
      •1•0•0•0•Updated Aug 12, 2026Aug 12, 2026

    • 26SOSP-StreamEP-Artifact

      Public
      Python
      •0•0•0•0•Updated Aug 10, 2026Aug 10, 2026

    • 26MICRO-GTSim

      Public
      C++
      •
      MIT License
      •2•0•0•0•Updated Jul 30, 2026Jul 30, 2026

    • MoonEP

      Public
      MoonEP: A Perfectly Balanced Expert Parallelism Library via Dynamic Redundant Experts
      Python
      •
      MIT License
      •129•0•0•0•Updated Jul 28, 2026Jul 28, 2026

    • 26SOSP-llm-42

      Public
      [Accepted to SOSP 2026] Fast Deterministic LLM Inference
      Python
      •
      Apache License 2.0
      •5•0•0•0•Updated Jul 24, 2026Jul 24, 2026

    • 26SOSP-Janus

      Public
      C++
      •
      Apache License 2.0
      •1•0•0•0•Updated Jul 24, 2026Jul 24, 2026

    • 26SC-Maze

      Public
      A distributed framework for LLM agents
      Python
      •
      MIT License
      •26•0•0•0•Updated Jul 24, 2026Jul 24, 2026

    • UltraEP

      Public
      Production-ready expert load balancing library
      Cuda
      •
      MIT License
      •17•0•0•0•Updated Jul 17, 2026Jul 17, 2026

    • 26OSDI-batchgen

      Public
      High-Throughput Batch Inference
      C++
      •
      Apache License 2.0
      •1•0•0•0•Updated Jul 14, 2026Jul 14, 2026

    • labs-molt

      Public
      Python
      •
      Apache License 2.0
      •100•0•0•0•Updated Jul 14, 2026Jul 14, 2026

    • 26OSDI--ECHO

      Public
      Repo for ECHO: Efficient KV Cache Offloading with Lossless Prefetching for Serving Native Sparse Attention LLMs (OSDI'26)
      Python
      •6•0•0•0•Updated Jul 12, 2026Jul 12, 2026

    • 26OSDI-ECHO

      Public
      Repo for ECHO: Efficient KV Cache Offloading with Lossless Prefetching for Serving Native Sparse Attention LLMs (OSDI'26)
      Python
      •6•1•0•0•Updated Jul 12, 2026Jul 12, 2026

    • 26SOSP-StreamInfer

      Public
      A prototype inference engine implementing StreamEP.
      Python
      •
      Apache License 2.0
      •1•0•0•0•Updated Jul 12, 2026Jul 12, 2026

    • 26OSDI-EcoServe

      Public
      [OSDI' 26] Efficient LLM Serving on Commodity GPU Clusters with Data-Reduced Cross-Instance Orchestration
      Python
      •
      Apache License 2.0
      •1•0•0•0•Updated Jul 5, 2026Jul 5, 2026

    • 26OSDI-Nixie

      Public
      An efficient service for transparent GPU multiplexing with VRAM oversubscription
      Rust
      •
      Apache License 2.0
      •6•0•0•0•Updated Jun 28, 2026Jun 28, 2026

    • dmuon

      Public
      Python
      •
      Other
      •3•0•0•0•Updated Jun 24, 2026Jun 24, 2026

    • TraceLab

      Public
      An open toolkit and public dataset hub for collecting, sanitizing, analyzing, and visualizing agent traces.
      Python
      •
      Apache License 2.0
      •17•0•0•0•Updated Jun 21, 2026Jun 21, 2026

    • cachewise-coding-traces

      Public
      Python
      •3•0•0•0•Updated Jun 14, 2026Jun 14, 2026

    • uw-piper

      Public
      A programmable distributed training system for PyTorch
      Python
      •
      MIT License
      •5•0•0•0•Updated Jun 10, 2026Jun 10, 2026

    • 26OSDI-DirectKV

      Public
      Python
      •
      Other
      •3•1•0•0•Updated Jun 4, 2026Jun 4, 2026

    • InstantTensor

      Public
      An ultra-fast, distributed Safetensors loader
      C++
      •
      Apache License 2.0
      •16•0•0•0•Updated May 27, 2026May 27, 2026

    • 26OSDI-blitz-router

      Public
      BlitzScale Router - Distributed LLM Inference Router (Rust)
      Rust
      •1•0•0•0•Updated May 25, 2026May 25, 2026

    • 26OSDI-syncopate

      Public
      Python
      •
      MIT License
      •1•0•0•0•Updated May 17, 2026May 17, 2026

    • 26OSDI-OpenTela

      Public
      OpenTela is a decentralized compute fabric for running machine learning applications.
      Jupyter Notebook
      •
      Apache License 2.0
      •12•0•0•0•Updated May 14, 2026May 14, 2026

    • 26SIGCOMM-KVServe

      Public
      Python
      •
      Apache License 2.0
      •9•0•0•0•Updated May 13, 2026May 13, 2026

    • 26OSDI-SPEX

      Public
      Python
      •1•0•0•0•Updated May 12, 2026May 12, 2026
    ProTip! When viewing an organization's repositories, you can use the props. filter to filter by custom property.