11

I am facing some problems with findOneAndUpdate when the input coming from my csv file has two or more rows that have the same email address. Email address is set to unique in my model and I thought findOneAndUpdate would let me handle duplication in my csv file. The codes are below. Read here that it's because the fields in my query (in this case email) is also one of the fields I want to create in case the record is not found. I'm not sure if this is true. And in any case email is my identifier so it has to be in there.

To explain the behaviour more:

  1. When the csv file contains an email address that's already stored in MongoDB before I run my script, findOneAndUpdate works perfectly
  2. However, when I have two records in the csv file that share the same email address but no record of this email address is stored in MongoDB prior to running the script, I sometimes get a duplicate key error like so { MongoError: E11000 duplicate key error collection: db.accounts index: email_1 dup key: { : "[email protected]" }
  3. I wrote sometimes above because sometimes (although less often) I don't and everything works as it should be.

Codes:

for (let i = 0; i < accounts.length; i++) {
   let query = {'email': accounts[i].email};
   let accountHolderDoc = {
       email: accounts[i].email,
       name: {
         first: accounts[i].accountHolderFName,
         last: accounts[i].accountHolderLName,
       },
    };

    promise = AccountHolder
        .findOneAndUpdate(
            query, {$set: accountHolderDoc}, {upsert: true, new: true})
        .then(function(accountHolder) { ... })
        .catch( ... );
   ...
}
0

1 Answer 1

3

This post suggests that searching for and saving a non-existing document are not atomic, which means between the searching and the saving, another query could have yielded a not found result for the same search criteria. The only solution then, it seems, is to ensure that if duplicate key errors are handled, for example, by reapplying MongoDB operations to the document that was thrown out.

1
  • I would suggest you use async.js for looping, particularly async.eachSeries() to perform one operation at a time. Mixing synchronous for with asynchronous Mongoose operations always tends to lead to problems.
    – Mikey
    Commented Sep 25, 2017 at 0:26

Your Answer

By clicking “Post Your Answer”, you agree to our terms of service and acknowledge you have read our privacy policy.

Not the answer you're looking for? Browse other questions tagged or ask your own question.