we are using MongoDB (on Linux) as our main database. However, we need to periodically (e.g. nightly) export some of the collections from Mongo to a MS SQL server to run analytics.
I am thinking about the following approach:
Are there any other "tried and true" alternatives?
Thanks, Stefano
EDIT: for point 4, the analytics is to be run on SQL Server, not Mongo.
Click on the SQL Migration button in the toolbar, or right-click into a server, database or collection in the Connection Tree and select the SQL Migration option. Then select SQL → MongoDB Migration. This will open a new tab where you can configure and execute the import.
SQL databases are used to store structured data while NoSQL databases like MongoDB are used to save unstructured data. MongoDB is used to save unstructured data in JSON format. MongoDB does not support advanced analytics and joins like SQL databases support.
PolyBase allows T-SQL queries to join the data from external sources to relational tables in an instance of SQL Server. A key use case for data virtualization with the PolyBase feature is to allow the data to stay in its original location and format.
Overall looks fine, but i can suggest two things:
Also i can suggest look into such new approaches as cqrs and event sourcing, that's basically allow to avoid export tasks. You can just handle messages and store data into two data sources (linux mongodb, windows sql server) in real time with small delay, or even analyze data from messages and store in mongodb.
If you love us? You can donate to us via Paypal or buy me a coffee so we can maintain and grow! Thank you!
Donate Us With