Logo Questions Linux Laravel Mysql Ubuntu Git Menu
 

OSError: [Errno 22] when I try to .read() a json file

I am simply trying to read my json file in Python. I am in the correct folder when I do so; I am in Downloads, and my file is called 'Books_5.json'. However, when I try to use the .read() function, I get the error

OSError: [Errno 22] Invalid argument

This is my code:

import json
config = json.loads(open('Books_5.json').read())

This also raises the same error:

books = open('Books_5.json').read()

If it helps, this is a small snippet of what my data looks like:

{"reviewerID": "A10000012B7CGYKOMPQ4L", "asin": "000100039X", "reviewerName": "Adam", "helpful": [0, 0], "reviewText": "Spiritually and mentally inspiring! A book that allows you to question your morals and will help you discover who you really are!", "overall": 5.0, "summary": "Wonderful!", "unixReviewTime": 1355616000, "reviewTime": "12 16, 2012"}
{"reviewerID": "A2S166WSCFIFP5", "asin": "000100039X", "reviewerName": "[email protected] \"[email protected]\"", "helpful": [0, 2], "reviewText": "This is one my must have books. It is a masterpiece of spirituality. I'll be the first to admit, its literary quality isn't much. It is rather simplistically written, but the message behind it is so powerful that you have to read it. It will take you to enlightenment.", "overall": 5.0, "summary": "close to god", "unixReviewTime": 1071100800, "reviewTime": "12 11, 2003"}

I'm using Python 3.6 on MacOSX

like image 657
user45254 Avatar asked May 01 '17 17:05

user45254


People also ask

How to solve OSError errno 22 invalid argument?

The reason behind the error is that python does not consider the backslash. Because of that, it showed oserror invalid argument. So what we have to do is that instead of a backslash, we have to replace it with a forwarding slash. Th error has been resolved now.

What is error No 22 in python?

OSError [Errno 22] invalid argument when use open() in Python.

What is invalid argument error in Python?

The invalid argument error is a WebDriver error that occurs when the arguments passed to a command are either invalid or malformed. Invalid argument errors can be likened to TypeError s in JavaScript, in that they can occur for a great many APIs when the input value is not of the expected type or malformed in some way.


1 Answers

It appears that this is some kind of bug that occurs when the file is too large (my file was ~10GB). Once I use split to break up the file by 200 k lines, the .read() error goes away. This is true even if the file is not in strict json format.

like image 197
user45254 Avatar answered Oct 04 '22 13:10

user45254