Logo Questions Linux Laravel Mysql Ubuntu Git Menu
 

Can I fill web forms with Scrapy?

Now I'm using iMacros to extract data from a web and fill forms submitting the data.

But iMacros is a expensive tool. I need a free library and I've read about Scrapy for data minning. I's a litle more complex to programming with it but the money rules.

The question is if I can fill html forms with Scrapy and submit to the web page. I don't want to use Javascript, I want to use exclusively Python scripts.

I searched in http://doc.scrapy.org/ but I didn't found nothing about form-submit.

like image 383
Trimax Avatar asked Feb 21 '14 08:02

Trimax


1 Answers

Use the scrapy.http.FormRequest class.

The FormRequest class extends the base Request with functionality for dealing with HTML forms

http://doc.scrapy.org/en/latest/topics/request-response.html#formrequest-objects

like image 77
tread Avatar answered Nov 11 '22 14:11

tread