Schedule scrapy command scrapy crawl

Question

I've built a crawler to crawl and extract links matching a fixed regex. Now i want to schedule the task in windows task scheduler, such that it executes the crawler using command line prompt scrapy crawl crawlername. Any help would be useful?

Answer 1

You can create a bat file with the content:

cd path_to_scrapy_project
scrapy crawl crawlername

Then schedule this script with Windows Task Scheduler.