Logo Questions Linux Laravel Mysql Ubuntu Git Menu
 

Scrapyd-deploy command not found after scrapyd installation

I have created a couple of web spiders that I intend to run simultaneously with scrapyd. I first successfully installed scrapyd in Ubuntu 14.04 using the command: pip install scrapyd, and when I run the command: scrapyd, I get the following output in the terminal:

2015-07-14 01:22:02-0400 [-] Log opened.
2015-07-14 01:22:02-0400 [-] twistd 13.2.0 (/usr/bin/python 2.7.6) starting up.
2015-07-14 01:22:02-0400 [-] reactor class: twisted.internet.epollreactor.EPollReactor.
2015-07-14 01:22:02-0400 [-] Site starting on 6800
2015-07-14 01:22:02-0400 [-] Starting factory <twisted.web.server.Site instance at 0x7f762f4391b8>
2015-07-14 01:22:02-0400 [Launcher] Scrapyd 1.1.0 started: max_proc=8, runner='scrapyd.runner'

I believe that the fact that I got this output suggests that scrapy is working; however, when I run the command: scrapyd-deploy as in the docs, I get the error: scrapyd-deploy: command not found. How can this be possible if the installation was successful? I included the following target in the config file:

[deploy:scrapyd2]
url = http://scrapyd.mydomain.com/api/scrapyd/
username = name
password = secret

I'm not exactly sure how the target works, but I basically copied it from the docs so I would think that it would work. Is there something that I am supposed to import or configure that I haven't? Thanks.

like image 648
loremIpsum1771 Avatar asked Jul 14 '15 05:07

loremIpsum1771


2 Answers

scrapyd-deploy is a part of scrapyd-client.You can install it from PyPi. Try:

$ sudo pip install scrapyd-client
like image 60
rocktheartsm4l Avatar answered Nov 03 '22 07:11

rocktheartsm4l


Can be installed from git directly:

pip install git+https://github.com/scrapy/scrapyd-client
like image 1
krishna chandak Avatar answered Nov 03 '22 08:11

krishna chandak