Common Crawl Foundation

Pinned Loading

1. cc-pysparkcc-pysparkPublic

   Process Common Crawl data with Python and Spark

   Python 458 96

2. cc-crawl-statisticscc-crawl-statisticsPublic

   Statistics of Common Crawl monthly archives mined from URL index files

   Python 228 18

3. cc-index-tablecc-index-tablePublic

   Index Common Crawl archives in tabular format

   Java 132 16

4. cc-warc-examplescc-warc-examplesPublic

   Forked from Smerity/cc-warc-examples

   CommonCrawl WARC/WET/WAT examples and processing code for Java + Hadoop

   Java 38 17

5. cc-citationscc-citationsPublic

   Scientific articles using or citing Common Crawl data

   Jupyter Notebook 30 4

6. cc-notebookscc-notebooksPublic

   Various Jupyter notebooks about Common Crawl data

   Jupyter Notebook 67 11