Logo Questions Linux Laravel Mysql Ubuntu Git Menu
 

is there any benchmarks for large data containers?

i'm currently looking for a way to handle large data set.

it seems stxxl is frequently recommended solution, however i need to know more about it, before making a decision.

the question is

  1. Is STXXL completely platform neutral?

  2. Any alternatives?

  3. Any benchmarks about large data library?

like image 637
user1360513 Avatar asked Apr 27 '12 08:04

user1360513


People also ask

Does Docker have performance overhead?

Docker has a very low overhead, which means that you can simply add up the individual memory usages of the applications you plan to run inside Docker to calculate your memory usage. For some context, a machine with 16GB RAM is likely to be sufficient for running a few standard-sized containers.

What is container in big data?

A container is an application, including all its dependencies, libraries and other binaries, and the configuration files needed to run it, bundled into a single package that can be moved, in total, from one computing environment to another.

Are containers faster than VMS?

Docker containers are generally faster and less resource-intensive than virtual machines, but full VMware virtualization still has its unique core benefits—namely, security and isolation.


1 Answers

1) I have personally tried it on both Windows and Linux, and there is no reason why it should not compile on Mac. I do not know what you mean by neutral though.

2) There are alternatives like TPIE, LEDA-SM etc. which are not developed anymore. I think STXXL is your best bet as it supports PDM (Parallel Disk Model).

like image 102
Hindol Avatar answered Oct 14 '22 05:10

Hindol