krabber

Easy to use webscraper using Axios and JSDOM.

Example

import{Scrape}from'krabber';constscrapeConfig={url: 'https://github.com/axios/axios',options: {headers: {'User-Agent': 'Mozilla/5.0 (Windows NT 6.1; WOW64; rv:64.0) Gecko/20100101 Firefox/64.0'}},select: {numberOfCommits: ({ dom, res, prev, url })=>{returndom.querySelector('.commits span.text-emphasized.num').innerHTML.trim();}}}Scrape(scrapeConfig).then((res)=>{console.log(res.numberOfCommits);})

More examples, including pagination handling

Please see the test suite in src/lib/scrape.spec.ts