Insert/Update/Index many rows (10 billion) numbers as values

Question

I need to insert 10 billion rows and update their values few times.

Table structure:

Column1 Column2 Count
1       1       99
1       2       10003
1       3       1
1       4       23
1       5       9994
...
99999   1       2
99999   2       2233
99999   3       5904
99999   4       12
99999   5       4598435
...

I need Column1 to be indexed. In one table Count will be Integer in another it will be Double.

What database suits best for my needs? I was told I should use NoSQL but there are so many of them.

Answer 1

I would use a database you know well as long as it can handle your required throughput. So I assume since you are asking your preferred database hasn't met your requirements.

If you require high throughput with consistent sub-millisecond lookup latency take a look at Aerospike which is used a lot in the ADTech industry. See this Case Study from AppNexus and Intel. Aerospike is an open source, distributed, in memory and/or SSD NOSQL KV database with support for UDFs and Secondary Indexes.