Logo Questions Linux Laravel Mysql Ubuntu Git Menu
 

Java, MongoDB: How to update every object while iterating a huge collection?

I have a collection of about 1 million records with 20 fields each. I need to update integer flag field in every record (document) assigning randomly 1 or 2 to this flag field. How to do this while iterating cursor over the complete collection? It does not seem to be a good idea to search second time for object already found by MongoDB just to be able to update it:

  DBCursor cursor = coll.find();
  try {
     while(cursor.hasNext()) {
    BasicDBObject obj = (BasicDBObject) cursor.next();
    ...
    coll.update(query,newObj)

     }
  } finally {
     cursor.close();
  }

How to update a field in every document of a huge MongoDB collection with different values efficiently?

like image 516
Anton Ashanin Avatar asked Apr 12 '13 10:04

Anton Ashanin


1 Answers

Your approach is basically correct. However I wouldn't consider such a collection as "huge" You can run something similar from the shell:

coll.find({}).forEach(function (doc) {
    doc.flag = Math.floor((Math.random()*2)+1);
    coll.save(doc);
 });

Depending on your MongoDB version, configuration and load, this may take something between few minutes to several hours

If you want to perform this update in bulks, use some conditions in your query document, something such as coll.find({"aFiled" : {$gt : minVal}, "aFiled" : {$lt : maxVal}})

like image 194
Ori Dar Avatar answered Oct 16 '22 16:10

Ori Dar