Logo Questions Linux Laravel Mysql Ubuntu Git Menu
 

urllib HTTPS request: <urlopen error unknown url type: https>

Tags:

I have a script on python3.4 and it has been fine until the website I download the file from decides to use https and now I am getting error but can't figure out how I can retrive the file.

My script import the following library and uses the urlretrive to get the file previously. Since it is now forwarded to https with 302 redirection. I am getting some error.

import urllib
import urllib.request

urllib.request.urlretrieve("http://wordpress.org/latest.tar.gz", "/thefile.gz")

My error:-

Traceback (most recent call last):
  File "<stdin>", line 1, in <module>
  File "/usr/local/lib/python3.4/urllib/request.py", line 178, in urlretrieve
    with contextlib.closing(urlopen(url, data)) as fp:
  File "/usr/local/lib/python3.4/urllib/request.py", line 153, in urlopen
    return opener.open(url, data, timeout)
  File "/usr/local/lib/python3.4/urllib/request.py", line 461, in open
    response = meth(req, response)
  File "/usr/local/lib/python3.4/urllib/request.py", line 571, in http_response
    'http', request, response, code, msg, hdrs)
  File "/usr/local/lib/python3.4/urllib/request.py", line 493, in error
    result = self._call_chain(*args)
  File "/usr/local/lib/python3.4/urllib/request.py", line 433, in _call_chain
    result = func(*args)
  File "/usr/local/lib/python3.4/urllib/request.py", line 676, in http_error_302
    return self.parent.open(new, timeout=req.timeout)
  File "/usr/local/lib/python3.4/urllib/request.py", line 455, in open
    response = self._open(req, data)
  File "/usr/local/lib/python3.4/urllib/request.py", line 478, in _open
    'unknown_open', req)
  File "/usr/local/lib/python3.4/urllib/request.py", line 433, in _call_chain
    result = func(*args)
  File "/usr/local/lib/python3.4/urllib/request.py", line 1257, in unknown_open
    raise URLError('unknown url type: %s' % type)
urllib.error.URLError: <urlopen error unknown url type: https>
like image 931
Adi Wong Avatar asked Feb 06 '15 23:02

Adi Wong


4 Answers

Most likely your Python installation or operating system is broken.

Python has only support for HTTPS if it was compiled with HTTPS support. However, this should be the default for all sane installations.

HTTPS support is only available if the socket module was compiled with SSL support.

https://docs.python.org/3/library/http.client.html

Please clarify how you installed Python. Official Python distributions are available at python.org

like image 170
Mikko Ohtamaa Avatar answered Sep 21 '22 15:09

Mikko Ohtamaa


I had the same problem with Anaconda but after installing the OpenSSL package, it works well.

conda install -c anaconda openssl
like image 39
Farshad Hasanpour Avatar answered Sep 19 '22 15:09

Farshad Hasanpour


I ran into the similar problem.
I used anaconda, and I simply moved these two file to anaconda3\DLLs and it worked.

  • libcrypto-1_1-x64.dll
  • libssl-1_1-x64.dll

I don't know why.
The reason I know this is that I tried to use ssl module to ignore certificate errors.

import ssl
ctx = ssl.create_default_context()
ctx.check_hostname = False
ctx.verify_mode = ssl.CERT_NONE

After these lines, the https error went away and gave me another error:
DLL load failed while importing _ssl: The specified module could not be found.

So I went to this post and found these two important files.

ps: the ssl module is not necessary.

like image 4
ChrisQIU Avatar answered Sep 20 '22 15:09

ChrisQIU


Had this issue, and it was solved by upgrading Python with

brew upgrade python
like image 2
moyo Avatar answered Sep 21 '22 15:09

moyo