Logo Questions Linux Laravel Mysql Ubuntu Git Menu
 

Cant read data from collection in MongoDB Atlas Trigger

New to MongoDB, very new to Atlas. I'm trying to set up a trigger such that it reads all the data from a collection named Config. This is my attempt:

exports = function(changeEvent) {
  const mongodb = context.services.get("Cluster0");
  const db = mongodb.db("TestDB");
  var collection = db.collection("Config");
  config_docs = collection.find().toArray(); 
  console.log(JSON.stringify(config_docs));
}

the function is part of an automatically created realm application called Triggers_RealmApp, which has Cluster0 as a named linked data source. When I go into Collections in Cluster0, TestDB.Config is one of the collections.

Some notes:

  • it's not throwing an error, but simply returning {}.
  • When I change context.services.get("Cluster0"); to something else, it throws an error
  • When I change "TestDB" to a db that doesnt exist, or "Config" to a collection which doesn't exist, I get the same output; {}
  • I've tried creating new Realm apps, manually creating services, creating new databases and new collections, etc. I keep bumping into the same issue.
  • The mongo docs reference promises and awaits, which I haven't seen in any examples (link). I tried experimenting with that a bit and got nowhere. From what I can tell, what I've already done is the typical way of doing it.

Images: Collection: TestDB database and Config collection Linked Data Source: Linked data source, Cluster0

like image 656
Warlax56 Avatar asked Sep 22 '21 05:09

Warlax56


People also ask

Is MongoDB Atlas no longer free?

It's easy to get started with MongoDB Atlas, and it's free.

How do database triggers work in MongoDB Atlas?

Database triggers use MongoDB change streams to listen for changes in watched collections and map them to database events. MongoDB Atlas performs a replace command rather than an update command when executing an update via the Atlas UI.

What is MongoDB Atlas?

MongoDB Atlas is a fully managed MongoDB database service hosted on the cloud. It can be used as a globally distributed database that automates administrative tasks such as database configuration, infrastructure provisioning, patching, scaling, and backups.

What can you do with MongoDB?

It can be used as a globally distributed database that automates administrative tasks such as database configuration, infrastructure provisioning, patching, scaling, and backups. With EventBridge, you can use data from MongoDB to trigger workflows for customer support, business operations and more.

How do I integrate MongoDB Atlas with Amazon eventbridge?

Once a MongoDB Atlas trigger is created, it creates a corresponding partner event source in the Amazon EventBridge console. Initially, these event sources show as Pending with no event bus associated to them. Next, use the AWS SAM template in the GitHub repo to create the event bus, Lambda function, and event rule.


Video Answer


1 Answers

I ended up taking it up with MongoDB directly, .find() is asynchronous and I was handling it incorrectly. Here is the reply straight from the horses mouth:


As I understand it, you are not getting your expected results from the query you posted above. I know it can be confusing when you are just starting out with a new technology and can't get something to work!

The issue is that the collection.find() function is an asynchronous function. That means it sends out the request but does not wait for the reply before continuing. Instead, it returns a Promise, which is an object that describes the current status of the operation. Since a Promise really isn't an array, your statment collection.find().toArray() is returning an empty object. You write this empty object to the console.log and end your function, probably before the asynchronous call even returns with your data.

There are a couple of ways to deal with this. The first is to make your function an async function and use the await operator to tell your function to wait for the collection.find() function to return before continuing.

exports = async function(changeEvent) {
  const mongodb = context.services.get("Cluster0");
  const db = mongodb.db("TestDB");
  var collection = db.collection("Config");
  config_docs = await collection.find().toArray(); 
  console.log(JSON.stringify(config_docs));

};

Notice the async keyword on the first line, and the await keyword on the second to last line.

The second method is to use the .then function to process the results when they return:

exports = function(changeEvent) {
  const mongodb = context.services.get("Cluster0");
  const db = mongodb.db("TestDB");
  var collection = db.collection("Config");
  collection.find().toArray().then(config_docs => {
    console.log(JSON.stringify(config_docs));
  });
};
like image 60
Warlax56 Avatar answered Oct 19 '22 13:10

Warlax56