GitHub - wosiu/WebScraper: JAVA based web scraper - collects results from given sources using implemented selectors for each website template. You can define proxy servers or user agent for each selector to act as a specific user. Goal is to allow easy extending modules for traversing through many websites by implementing proper Selector. HTML navigating managed by JSoup. Package includes also ProxyFinder which download active proxies adresses from defined proxy selectors, so you needn't search by yourself.

Name		Name	Last commit message	Last commit date
.idea/libraries		.idea/libraries
src		src
.gitignore		.gitignore
.travis.yml		.travis.yml
browse_empty.sh		browse_empty.sh
collectFiles.sh		collectFiles.sh
config.json		config.json
pom.xml		pom.xml
resultCheck.R		resultCheck.R
run.sh		run.sh

About

JAVA based web scraper - collects results from given sources using implemented selectors for each website template. You can define proxy servers or user agent for each selector to act as a specific user. Goal is to allow easy extending modules for traversing through many websites by implementing proper Selector. HTML navigating managed by JSoup. P…

Activity

0 stars

2 watching

0 forks

Report repository

Navigation Menu

About

Releases

Packages

Contributors

Languages

Latest commit

History

Folders and files

About

Stars

Watchers

Forks

Releases

Packages

Contributors

Languages