Logo Questions Linux Laravel Mysql Ubuntu Git Menu
 

Mongodb Mongoimport too large: Failure parsing errors

I am trying to import into MongoDB 70 mb json file that is valid. But, I am getting this error over and over in a loop:

 01 11:42:20 exception:BSON representation of supplied JSON is too large: Failure parsing JSON string near: "name": "L  01 11:42:20  01 11:42:20 Assertion: 10340:Failure parsing JSON string near: "link": "h  01 11:42:20 mongoimport.exe    ???  01 11:42:20 mongoimport.exe    ???  01 11:42:20 mongoimport.exe    ???  01 11:42:20 mongoimport.exe    ???  01 11:42:20 mongoimport.exe    ???  01 11:42:20 mongoimport.exe    ???  01 11:42:20 mongoimport.exe    ???  01 11:42:20 kernel32.dll       BaseThreadInitThunk+0x12  01 11:42:20 ntdll.dll          RtlInitializeExceptionChain+0xef  01 11:42:20 exception:BSON representation of supplied JSON is too large: Failure parsing JSON string near: "link": "h  01 11:42:20  01 11:42:20 Assertion: 10340:Failure parsing JSON string near: }  01 11:42:20 mongoimport.exe    ???  01 11:42:20 mongoimport.exe    ???  01 11:42:20 mongoimport.exe    ???  01 11:42:20 mongoimport.exe    ???  01 11:42:20 mongoimport.exe    ???  01 11:42:20 mongoimport.exe    ???  01 11:42:20 mongoimport.exe    ???  01 11:42:20 kernel32.dll       BaseThreadInitThunk+0x12  01 11:42:20 ntdll.dll          RtlInitializeExceptionChain+0xef  01 11:42:20 exception:BSON representation of supplied JSON is too large: Failure parsing JSON string near: }  01 11:42:20  01 11:42:20 Assertion: 10340:Failure parsing JSON string near: ],  01 11:42:20 mongoimport.exe    ???  01 11:42:20 mongoimport.exe    ???  01 11:42:20 mongoimport.exe    ???  01 11:42:20 mongoimport.exe    ???  01 11:42:20 mongoimport.exe    ???  01 11:42:20 mongoimport.exe    ???  01 11:42:20 mongoimport.exe    ???  01 11:42:20 kernel32.dll       BaseThreadInitThunk+0x12  01 11:42:20 ntdll.dll          RtlInitializeExceptionChain+0xef  01 11:42:20 exception:BSON representation of supplied JSON is too large: Failure parsing JSON string near: ], 

My JSON ( only small example from it ) consist many many structures like this one :

[  {    "data": [          "id": "xxxxxxxxxxxxxxxxxx",          "from": {             "name": "yyyyyyyyyyy",             "id": "1111111111111"          },          "to": {             "data": [                {                   "version": 1,                   "name": "1111111111111",                   "id": "1111111111111"                }             ]          },          "picture": "fffffffffffffffffffffff.jpg",          "link": "http://www.youtube.com/watch?v=qqqqqqqqqqqqq",          "source": "http://www.youtube.com/v/qqqqqqqqqqqqq?version=3&autohide=1&autoplay=1",          "name": "xxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx",          "description": "xxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx...",          "icon": "http://static.ak.fbcdn.net/rsrc.php/v2/xxx/r/dddd",          "actions": [             {                "name": "Comment",                "link": "http://www.example.com/1111111111111/posts/1111111111111"             },             {                "name": "Like",                "link": "http://www.example.com/1111111111111/posts/1111111111111"             }          ],          "privacy": {             "value": ""          },          "type": "video",          "created_time": 1356953890,          "updated_time": 1356953890,          "likes": {             "data": [                {                   "name": "jjj ",                   "id": "59xxx67"                },                {                   "name": "xxxxx",                   "id": "79xxx27"                }             ],             "count": 2          },          "comments": {             "count": 0          }       },  .... .... .... } ] 

this is the general patern of the json ":

[ {    "data": [       {        }     ],     "paging": {       "previous": "link",       "next": "link"    } },    "data": [       {       }     ],     "paging": {       "previous": "link",       "next": "link"    } }, "data": [       {       }     ],     "paging": {       "previous": "link",       "next": "link"    } } ] 
like image 235
user63898 Avatar asked Jan 01 '13 09:01

user63898


1 Answers

Instead of using:

mongoimport -d DATABASE_NAME -c COLLECTION_NAME --file YOUR_JSON_FILE 

use the following command:

mongoimport -d DATABASE_NAME -c COLLECTION_NAME --file YOUR_JSON_FILE --jsonArray 
like image 68
Rajkumar Singh Avatar answered Oct 09 '22 03:10

Rajkumar Singh