Logo Questions Linux Laravel Mysql Ubuntu Git Menu
 

urllib "module object is not callable"

This is my third python project, and I've received an error message: 'module object' is not callable.

I know that this means I'm referencing a variable or function incorrectly. But trial and error hasn't been able to help me solve this.

import urllib

def get_url(url):
    '''get_url accepts a URL string and return the server response code, response headers, and contents of the file'''
    req_headers = {
        'User-Agent': 'Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US) AppleWebKit/525.13 (KHTML, like Gecko) Chrome/0.A.B.C Safari/525.13',
        'Referer': 'http://python.org'}

    #errors here on next line
    request = urllib.request(url, headers=req_headers) # create a request object for the URL
    opener = urllib.build_opener() # create an opener object
    response = opener.open(request) # open a connection and receive the http response headers + contents

    code = response.code
    headers = response.headers # headers object
    contents = response.read() # contents of the URL (HTML, javascript, css, img, etc.)
    return code , headers, contents


testURL = get_url('http://www.urlhere.filename.zip')
print ("outputs: %s" % (testURL,))

I've been using this link for reference: http://docs.python.org/release/3.0.1/library/urllib.request.html

Traceback:

Traceback (most recent call last):
  File "C:\Project\LinkCrawl\LinkCrawl.py", line 31, in <module>
    testURL = get_url('http://www.urlhere.filename.zip')
  File "C:\Project\LinkCrawl\LinkCrawl.py", line 21, in get_url
    request = urllib.request(url, headers=req_headers) # create a request object for the URL
TypeError: 'module' object is not callable
like image 414
danielpiestrak Avatar asked Oct 07 '12 19:10

danielpiestrak


People also ask

How do I fix error module object is not callable?

How to fix typeerror: 'module' object is not callable? To fix this error, we need to change the import statement in “mycode.py” file and specify a specific function in our import statement.

What is Urllib module in Python?

Urllib package is the URL handling module for python. It is used to fetch URLs (Uniform Resource Locators). It uses the urlopen function and is able to fetch URLs using a variety of different protocols. Urllib is a package that collects several modules for working with URLs, such as: urllib.

What does object is not callable mean in Python?

The “int object is not callable” error occurs when you declare a variable and name it with a built-in function name such as int() , sum() , max() , and others. The error also occurs when you don't specify an arithmetic operator while performing a mathematical operation.


2 Answers

In python 3, the urllib.request object is a module. You need to call objects contained in this module. This is an important change from Python 2, if you are using example code you need to take that into account.

For example, creating the Request object and the opener:

request = urllib.request.Request(url, headers=req_headers)
opener = urllib.request.build_opener()
response = opener.open(request)

Read the documentation carefully.

like image 111
Martijn Pieters Avatar answered Oct 05 '22 05:10

Martijn Pieters


urllib.request is a module. urllib.request.Request is a class. Calling a module like you're currently doing raises an error. You probably want to call the class, like this:

request = urllib.request.Request(url, headers=req_headers)  # create a request object for the URL

You'll also probably want to use build_opener of urllib.request rather than just urllib:

opener = urllib.request.build_opener()  # create an opener object
like image 44
icktoofay Avatar answered Oct 05 '22 04:10

icktoofay