python file is showing AttributeError: module 'http' has no attribute 'client'

Question

I have the following Python script:

import http
import requests
from bs4 import BeautifulSoup
import urllib3
import pyrebase
import numpy as np
import yagmail
import time
from datetime import datetime, timedelta
import sys
import logging
import colorama
import csv
from random import randint
from numpy import genfromtxt
import sched, time
import threading
import http.client

import firebase_admin
from firebase_admin import credentials
from firebase_admin import db


# Fetch the service account key JSON file contents
cred = credentials.Certificate('service-account-credentials.json')
# Initialize the app with a service account, granting admin privileges
firebase_admin.initialize_app(cred, {
    'databaseURL': 'https://werrwrrw-catalogue.firebaseio.com'
})


config = {
    "apiKey": "BiXzaSdwhjwrhwjjrhwr",
    "authDomain": "whjwrhwjjrhwr.firebaseapp.com",
    "databaseURL": "https://whjwrhwjjrhwr.firebaseio.com",
    "projectId": "whjwrhwjjrhwr",
    "storageBucket": "rewrrrrr.appspot.com",
    "messagingSenderId": "606543434441"
}



firebaseuser = pyrebase.initialize_app(config)

auth = firebaseuser.auth()
dbuser = firebaseuser.database()

subref = db.reference('Subcribers').get()

for key, val in subref.items():
    subcriber_email = val['Email']
    print(key,subcriber_email)

The python file was working fine before, but now when I try to run it, it shows the following error:

>>Traceback (most recent call last):
  File "fax.py", line 1, in <module>
    import requests
  File "/Users/name/anaconda/lib/python3.6/site-packages/requests/__init__.py", line 43, in <module>
    import urllib3
  File "/Users/name/anaconda/lib/python3.6/site-packages/urllib3/__init__.py", line 8, in <module>
    from .connectionpool import (
  File "/Users/name/anaconda/lib/python3.6/site-packages/urllib3/connectionpool.py", line 11, in <module>
    from .exceptions import (
  File "/Users/name/anaconda/lib/python3.6/site-packages/urllib3/exceptions.py", line 2, in <module>
    from .packages.six.moves.http_client import (
  File "<frozen importlib._bootstrap>", line 961, in _find_and_load
  File "<frozen importlib._bootstrap>", line 950, in _find_and_load_unlocked
  File "<frozen importlib._bootstrap>", line 646, in _load_unlocked
  File "<frozen importlib._bootstrap>", line 616, in _load_backward_compatible
  File "/Users/name/anaconda/lib/python3.6/site-packages/urllib3/packages/six.py", line 203, in load_module
    mod = mod._resolve()
  File "/Users/name/anaconda/lib/python3.6/site-packages/urllib3/packages/six.py", line 115, in _resolve
    return _import_module(self.mod)
  File "/Users/name/anaconda/lib/python3.6/site-packages/urllib3/packages/six.py", line 82, in _import_module
    __import__(name)
  File "/Users/name/anaconda/lib/python3.6/http/client.py", line 71, in <module>
    import email.parser
  File "/Users/name/Desktop/Google Drive/FEBB/serverless/crwlr/email.py", line 3, in <module>
    from bs4 import BeautifulSoup
  File "/Users/name/anaconda/lib/python3.6/site-packages/bs4/__init__.py", line 35, in <module>
    from .builder import builder_registry, ParserRejectedMarkup
  File "/Users/name/anaconda/lib/python3.6/site-packages/bs4/builder/__init__.py", line 323, in <module>
    from . import _html5lib
  File "/Users/name/anaconda/lib/python3.6/site-packages/bs4/builder/_html5lib.py", line 20, in <module>
    import html5lib
  File "/Users/name/anaconda/lib/python3.6/site-packages/html5lib/__init__.py", line 19, in <module>
    from .serializer import serialize
  File "/Users/name/anaconda/lib/python3.6/site-packages/html5lib/serializer/__init__.py", line 5, in <module>
    from .htmlserializer import HTMLSerializer
  File "/Users/name/anaconda/lib/python3.6/site-packages/html5lib/serializer/htmlserializer.py", line 15, in <module>
    from xml.sax.saxutils import escape
  File "/Users/name/anaconda/lib/python3.6/xml/sax/saxutils.py", line 6, in <module>
    import os, urllib.parse, urllib.request
  File "/Users/name/anaconda/lib/python3.6/urllib/request.py", line 1350, in <module>
    if hasattr(http.client, 'HTTPSConnection'):
AttributeError: module 'http' has no attribute 'client'

I can't really pinpoint the error. How do I read the fix the error based on the traceback above?

Answer 1

Here:

File "/Users/name/anaconda/lib/python3.6/http/client.py", line 71, in <module>
    import email.parser
File "/Users/name/Desktop/Google Drive/FEBB/serverless/crwlr/email.py"
    from bs4 import BeautifulSoup

The local email.py in /Users/name/Desktop/Google Drive/FEBB/serverless/crwlr/ shadows the stdlib's one. Now in your local email.py module, you're importing bs4, which imports html5lib, which imports xml.sax.saxutils, which imports urllib.request, which wants to import http.

IOW you end up with an (accidental) circular dependencie. At this point the http module is only partially imported, and doesn't yet have defined "client", hence the error.

The simple solution is to rename your "email.py" module to something else, or (if it's only a script and not a module) move it out of your pythonpath.

EDIT: I just noticed that your code started by importing http, so the http module should be already fully loaded, so even if the problem with your email.py script/module needs to be fixed, this shouldn't lead to this problem. So chances are you have another http.py module or http package in your sys.path shadowing the stdlib's one. To debug this, add this line just after the import http one:

 print(http)

This should print something like:

<module 'http' from '/some/path/to/a/python/file.pyc`>

If the path is not the one to your python install stdlib's "http/init.pyc" then you found the offender. If it's one of your own scripts/modules, the fix is the same as for email.py.

Answer 2

Might be Bs4 is raising the exception, Kindly execute the below script in the existing one validate Bs4 import is working fine

try:
    from bs4 import BeautifulSoup
except Exception as err:
    raise ImportError('Bs4 is not imported correctly. - {}'.format(err))