Logo Questions Linux Laravel Mysql Ubuntu Git Menu
 

Web scraping with Scheme

Is there a good library/package to do web scraping using Scheme (preferably Racket)?

e.g. a Scheme equivalent of mechanize?

like image 456
abeln Avatar asked Apr 05 '13 16:04

abeln


1 Answers

I've used a combination of the Racket net/url library, the html-parsing package, and SXML (especially sxpath, for XPath queries). Actually, I wrote some wrappers around net/url that make it slightly easier to use, IMO.

When I've needed to handle cookies, I've called out to the curl command instead of using net/url.

like image 131
Ryan Culpepper Avatar answered Nov 05 '22 02:11

Ryan Culpepper