OSError: [Errno 22] 当我尝试 .read() 一个 json 文件时

2022-01-21 00:00:00 python json dataset

问题描述

我只是想在 Python 中读取我的 json 文件.当我这样做时,我在正确的文件夹中;我在下载中,我的文件名为Books_5.json".但是,当我尝试使用 .read() 函数时,我得到了错误

I am simply trying to read my json file in Python. I am in the correct folder when I do so; I am in Downloads, and my file is called 'Books_5.json'. However, when I try to use the .read() function, I get the error

OSError: [Errno 22] Invalid argument

这是我的代码:

import json
config = json.loads(open('Books_5.json').read())

这也会引发同样的错误:

This also raises the same error:

books = open('Books_5.json').read()

如果有帮助,这是我的数据的一小部分:

If it helps, this is a small snippet of what my data looks like:

{"reviewerID": "A10000012B7CGYKOMPQ4L", "asin": "000100039X", "reviewerName": "Adam", "helpful": [0, 0], "reviewText": "Spiritually and mentally inspiring! A book that allows you to question your morals and will help you discover who you really are!", "overall": 5.0, "summary": "Wonderful!", "unixReviewTime": 1355616000, "reviewTime": "12 16, 2012"}
{"reviewerID": "A2S166WSCFIFP5", "asin": "000100039X", "reviewerName": "adead_poet@hotmail.com "adead_poet@hotmail.com"", "helpful": [0, 2], "reviewText": "This is one my must have books. It is a masterpiece of spirituality. I'll be the first to admit, its literary quality isn't much. It is rather simplistically written, but the message behind it is so powerful that you have to read it. It will take you to enlightenment.", "overall": 5.0, "summary": "close to god", "unixReviewTime": 1071100800, "reviewTime": "12 11, 2003"}

我在 MacOSX 上使用 Python 3.6

I'm using Python 3.6 on MacOSX


解决方案

看来这是文件太大时出现的某种错误(我的文件是~10GB).一旦我使用 split 将文件分成 200 k 行,.read() 错误就会消失.即使文件不是严格的 json 格式也是如此.

It appears that this is some kind of bug that occurs when the file is too large (my file was ~10GB). Once I use split to break up the file by 200 k lines, the .read() error goes away. This is true even if the file is not in strict json format.

相关文章