Logo Questions Linux Laravel Mysql Ubuntu Git Menu
 

Best database engine for huge datasets

I do datamining and my work involves loading and unloading +1GB database dump files into MySQL. I am wondering is there any other free database engine that works better than MySQL on huge databases? is PostgreSQL better in terms of performance?

I only use basic SQL commands so speed is the only factor for me to choose a database

like image 596
Mark Avatar asked Dec 10 '22 19:12

Mark


2 Answers

It is unlikely that substituting a different database engine will provide a huge increase in performance. The slow down you mention is more likely to be related to your schema design and data access patterns. Maybe you could provide some more information about that? For example, is the data stored as a time series? Are records written once sequentially or inserted / updated / deleted arbitrarily?

like image 161
Adamski Avatar answered Dec 17 '22 11:12

Adamski


As long as you drop indexes before inserting huge data, should not be much difference between those two.

like image 33
M. Utku ALTINKAYA Avatar answered Dec 17 '22 11:12

M. Utku ALTINKAYA