Bitextor Team

Pinned Loading

1. bitextorbitextorPublic

   Bitextor generates translation memories from multilingual websites

   Python 300 41

2. bicleanerbicleanerPublic

   Bicleaner is a parallel corpus classifier/cleaner that aims at detecting noisy sentence pairs in a parallel corpus.

   Python 159 22

3. bifixerbifixerPublic

   Tool to fix bitexts and tag near-duplicates for removal

   Python 35 3

4. biroamerbiroamerPublic

   Utility that will help you to ROAM (Random Omit Anonymize and Mix) your parallel corpus.

   Python 11 2

5. pdf-extractpdf-extractPublic

   PDF parser and converter to HTML

   Java 95 13

6. warc2textwarc2textPublic

   Extracts plain text, language identification and more metadata from WARC records

   C++ 22 7