Name		Name	Last commit message	Last commit date
36kr		36kr
JD		JD
huxiu		huxiu
maoyan		maoyan
toutiao		toutiao
weibo		weibo
xiaohua_master		xiaohua_master
LICENSE		LICENSE
README.md		README.md

Repository files navigation

spiders

爬虫类，不定期更新采用scrapy，requests，bs4，selenium/PhantomJS，pyspider等主流爬虫工具全站爬取36kr，虎嗅，豆瓣，知乎，今日头条等网站存储格式有MongoDB，redis，excel等 Store CrawlProjects

About

spider

36kr crawlers requests scrapy spiders toutiao

MPL-2.0 license

0 stars

1 watching

Report repository

Releases

Packages

Contributors

Languages