Logo Questions Linux Laravel Mysql Ubuntu Git Menu
 

BeautifulSoup like scraper for nodejs [closed]

Tags:

I am former python developer and I have used BS4 for couple of years Now I am developing with node and yes cheerio package is very good, but I need smth like BS4 for scraping in node

Is there some alternatives for cheerio? Thanks!

like image 359
Jesus_Maria Avatar asked Sep 19 '15 10:09

Jesus_Maria


People also ask

Is Node JS good for scraping?

Web scraping is the process of extracting data from a website in an automated way and Node. js can be used for web scraping. Even though other languages and frameworks are more popular for web scraping, Node. js can be utilized well to do the job too.


1 Answers

I suggest you check out the x-ray node package. It is essentially an abstraction layer above cheerio that makes the code you need to 'structure any website' even more terse.

It has a composable syntax in style and it supports pagination, limiting/throttling, delaying, scraping collections etc.

like image 78
Mark Gibaud Avatar answered Oct 02 '22 13:10

Mark Gibaud