BigScience Workshop

Popular repositories Loading

1. petals petalsPublic

   🌸 Run LLMs at home, BitTorrent-style. Fine-tuning and inference up to 10x faster than offloading

   Python 10.5k 638

2. promptsource promptsourcePublic

   Toolkit for creating, sharing and using natural language prompts.

   Python 3k 375

3. Megatron-DeepSpeed Megatron-DeepSpeedPublic

   Ongoing research training transformer language models at scale, including: BERT & GPT-2

   Python 1.4k 226

4. bigscience bigsciencePublic

   Central place for the engineering/scaling WG: documentation, SLURM scripts and logs, compute environment and data.

   Shell 1k 101

5. xmtf xmtfPublic

   Crosslingual Generalization through Multitask Finetuning

   Jupyter Notebook 535 43

6. biomedical biomedicalPublic

   Tools for curating biomedical training data for large-scale language modeling

   Python 507 118