Logo Questions Linux Laravel Mysql Ubuntu Git Menu
 

twisted.internet.error.ReactorAlreadyInstalledError: reactor already installed

Tags:

python

scrapy

I am having this error when I run a crawl process multiples times. I am using scrapy 2.6 This is my code:

from scrapy.crawler import CrawlerProcess
from football.spiders.laliga import LaligaSpider
from scrapy.utils.project import get_project_settings

process = CrawlerProcess(settings=get_project_settings())
for i in range(1, 29):
    process.crawl(LaligaSpider, **{'week': i})
process.start()
like image 992
Leandro Hernández Mira Avatar asked Nov 02 '25 10:11

Leandro Hernández Mira


1 Answers

For me this worked, I put it before the CrawlerProcess

import sys    
if "twisted.internet.reactor" in sys.modules:
    del sys.modules["twisted.internet.reactor"]
like image 149
Mersad Avatar answered Nov 05 '25 01:11

Mersad



Donate For Us

If you love us? You can donate to us via Paypal or buy me a coffee so we can maintain and grow! Thank you!