Logo Questions Linux Laravel Mysql Ubuntu Git Menu
 

what is the best method or tool to scrape web sites? [closed]

i need to scrape (with approval) web sites before I start to write my own what is the best tool/way to scrape web sites, which is both fast (multithreaded) and easy to learn?

like image 504
user63898 Avatar asked Nov 14 '22 12:11

user63898


1 Answers

Take a look at this recent blog post by Lee Holmes. He wrote a pretty cool screen scraper using Powershell and the HTML Agility Pack.

like image 87
Nick Avatar answered Dec 17 '22 02:12

Nick