Pinned Loading

1. tokenkittokenkitPublic

   A toolkit implementing advanced methods to transfer models and model knowledge across tokenizers.

   Python 72 5

2. zettzettPublic

   Code for Zero-Shot Tokenizer Transfer

   Python 147 11

3. segment-any-text/wtpsplitsegment-any-text/wtpsplitPublic

   Toolkit to segment text into sentences or other semantic units in a robust, efficient and adaptable way.

   Python 1.3k 84

4. CPJKU/wechselCPJKU/wechselPublic

   Code for WECHSEL: Effective initialization of subword embeddings for cross-lingual transfer of monolingual language models.

   Python 93 14

5. gerpt2gerpt2Public

   German small and large versions of GPT2.

   Python 20

6. nlprulenlprulePublic

   A fast, low-resource Natural Language Processing and Text Correction library written in Rust.

   Rust 670 44