Logo Questions Linux Laravel Mysql Ubuntu Git Menu
 

How can I get data from other websites? [closed]

I want to create a website that extracts information from other websites and print them into my website, I am on research step, so I would like to hear some opinions and what's the best solution to this project?

I have heard that Python using parser can do this I just want to know what's the path I should take and which language should I use?.

like image 405
user2484278 Avatar asked Jan 13 '23 03:01

user2484278


2 Answers

Python with BeautifulSoup and Urllib2 will probably serve you well. Of course, it is questionable as to whether or not you should be scraping data from other websites and you might find yourself in a constant struggle if those websites change layouts.

like image 142
Tim Bender Avatar answered Jan 18 '23 04:01

Tim Bender


Requests is designed for this sort of thing.

Before scaping HTML however, check if the website offers an API. If so, you're already in business!

like image 45
Vortico Avatar answered Jan 18 '23 04:01

Vortico