What is the fastest and most stable non-sql database to store big data and process thousands requests during the day (it's for traffic exchange service)? I've found Kdb+ and Berkeley DB. Are they good? Are there other options?
More details...
Each day server processes > 100K visits. For each visit I need to read corresponding stats from DB, write log to DB and update stats in DB, aka 3 operations with DB per visit. Traffic is continuously increasing. Thus DB engine should be fast. From one side DB will be managed by demon written on C, Erlang or any other low-level language. From another side DB will be managed by PHP scripts.
DynamoDB is a fully managed NoSQL database offered by Amazon Web Services that support document data structure and key-value cloud services. DynamoDB offers seamless scalability with faster performance.
MongoDB is suitable for hierarchical data storage and is almost 100 times faster than Relational Database Management System (RDBMS). This platform centers around the CAP theorem (Consistency, Availability, and Partition tolerance.)
Best NoSQL database #1: MarkLogic MarkLogic is a multi-model NoSQL database designed to handle complex data integration use cases such as large data sets with multiple different models or in a fast-changing business environment. The database has been designed to have a single platform for data needs.
As for speed, NoSQL is generally faster than SQL, especially for key-value storage in our experiment; On the other hand, NoSQL database may not fully support ACID transactions, which may result data inconsistency.
The file system itself is faster and more stable than almost anything else. It stores big data seamlessly and efficiently. The API is very simple.
You can store and retrieve from the file system very, very efficiently.
Since your question is a little thin on "requirements" it's hard to say much more.
What about Redis?
http://code.google.com/p/redis/
Haven't try it yet did read about it and it seem to be a fast and stable enough for data storage. It also provides you with a decent anti-single-point-failure solution, as far as I understand.
If you love us? You can donate to us via Paypal or buy me a coffee so we can maintain and grow! Thank you!
Donate Us With