Logo Questions Linux Laravel Mysql Ubuntu Git Menu
 

scrapyd deploy shows 0 spiders

Tags:

python

scrapy

I am using scrapy for a project. I ran the following commands for deploying the project :

$scrapy deploy -l

Then i got the following o/p:

scrapysite http://localhost:6800/

$cat scrapy.cfg

[settings] 
default = scrapBib.settings

[deploy:scrapysite]  
url = http://localhost:6800/  
project = scrapBib

$scrapy deploy scrapysite -p scrapBib

'Building egg of scrapBib-1346242513
'build/lib.linux-x86_64-2.7' does not exist -- can't clean it

'build/bdist.linux-x86_64' does not exist -- can't clean it

'build/scripts-2.7' does not exist -- can't clean it

zip_safe flag not set; analyzing archive contents...

Deploying scrapBib-1346242513 to `http://localhost:6800/addversion.json`

2012-08-29 17:45:14+0530 [HTTPChannel,22,127.0.0.1] 127.0.0.1 - - [29/Aug/2012:12:15:13 

+0000] "POST /addversion.json HTTP/1.1" 200 79 "-" "Python-urllib/2.7"

Server response (200):

{"status": "ok", "project": "scrapBib", "version": "1346242513", "spiders": 0}

As you can see, getting spiders as 0 , although i have written 3 spiders inside project/spiders/ folder. As as result i am unable to start the crawl with curl requests. Please help

like image 942
Aravindh Avatar asked Aug 29 '12 12:08

Aravindh


1 Answers

i also faced this issue once , do two things

1) remove project.egg-info, build, setup.py from your local system.

2) remove all deployed version from your server .

then try to deploy it will be fixed ...

like image 119
akhter wahab Avatar answered Sep 22 '22 14:09

akhter wahab