BeautifulSoup: object of type 'Response' has no len()

Question

When I try to execute the code

BeautifulSoup(html, ...)

it gives the error message

TypeError: object of type 'Response' has no len()

I tried passing the actual HTML as a parameter, but it still doesn't work.

import requests

url = 'http://vineoftheday.com/?order_by=rating'
response = requests.get(url)
html = response.content

soup = BeautifulSoup(html, "html.parser")

Answer 1

You are getting response.content. But it return response body as bytes (docs). But you should pass str to BeautifulSoup constructor (docs). So you need to use the response.text instead of getting content.

Answer 2

Try to pass the HTML text directly

soup = BeautifulSoup(html.text)

Answer 3

html.parser is used to ignore the warnings in the page:

soup = BeautifulSoup(html.text, "html.parser")

Answer 4

If you're using requests.get('https://example.com') to get the HTML, you should use requests.get('https://example.com').text.