RWKV

Popular repositories Loading

1. rwkv.cpp rwkv.cppPublic

   INT4/INT5/INT8 and FP16 inference on CPU for RWKV language model

   C++ 1.6k 129

2. RWKV-infctx-trainer RWKV-infctx-trainerPublic

   RWKV infctx trainer, for training arbitary context sizes, to 10k and beyond!

   Jupyter Notebook 149 30

3. RWKV-LM RWKV-LMPublic

   Forked from BlinkDL/RWKV-LM

   RWKV is an RNN with transformer-level LLM performance. It can be directly trained like a GPT (parallelizable). So it's combining the best of RNN and transformer - great performance, fast inference,…

   Python 62 4

4. rwkv-onnx rwkv-onnxPublic

   A converter and basic tester for rwkv onnx

   Python 44 3

5. RWKV-wiki RWKV-wikiPublic

   RWKV centralised docs for the community

   35 10

6. RWKV-block RWKV-blockPublic

   PyTorch implementation of RWKV blocks

   Python 31 1