Hey you should totally check out PhantomBuster.com, it's a platform I built and that my company sells.
It lets you API-fy the Web, meaning that you'll create bots that scrape (or automate) the web on your demand via simple HTTP API calls. We have many features that facilitate scraping, namely CAPTCHA solving, file storage (S3), proxy pools, integrated MongoDB... And it's scalable.