Granitosaurus

Granitosaurus has asked 18 questions and find answers to 58 problems.

Stats

About

Writer at https://scrapfly.io/
I like web-scraping and free software, all that in python if possible. Feel free to hit me up on @wraptile:matrix.org or granitosaurus at pm.me.

Granitosaurus questions

set default logging extra for python's Logger object
Pythonic way of doing composition aliases
correct way to nest Item data in scrapy
selecting second child in beautiful soup with soup.select?
Python poetry - how to install optional dependencies?

Granitosaurus answers

Website using DataDome gets captcha blocked while scraping using Selenium and Python
Scrapy response incomplete
scrapy not scrape page if subdomain have underscore
How Incapsula works and how to beat it
Using Selenium after authenticated login session with Scrapy
Processing images without downloading using Scrapy Spiders
Authentication with selenium (Python)
Pausing and resuming a self contained scrapy script
How to extract the src of dynamically loaded images using scrapy
Scrapy, limit on start_url