Granitosaurus

Granitosaurus has asked 18 questions and find answers to 62 problems.

Stats

About

Writer at https://scrapfly.io/
I like web-scraping and free software, all that in python if possible. Feel free to hit me up on @wraptile:matrix.org or granitosaurus at pm.me.

Granitosaurus questions

set default logging extra for python's Logger object
Pythonic way of doing composition aliases
correct way to nest Item data in scrapy
selecting second child in beautiful soup with soup.select?
Python poetry - how to install optional dependencies?

Granitosaurus answers

Scrapy spider can't find URLs that load on click
Write functions for all scrapy spiders
How to make Selenium scripts work faster?
Repeatedly scrape data from same url with a time delay
Website using DataDome gets captcha blocked while scraping using Selenium and Python
Scrapy response incomplete
scrapy not scrape page if subdomain have underscore
How Incapsula works and how to beat it
Using Selenium after authenticated login session with Scrapy
Processing images without downloading using Scrapy Spiders