Logo Questions Linux Laravel Mysql Ubuntu Git Menu
 

Java+Redis vs plain Java efficiency for data intensive applications?

Does it help to use Redis with Java to develop data intensive applications (e.g. data-mining) in Java?

Does it work faster or consume less memory comparing to plain Java for similar operation on high volume of data?

Edit: My question is mostly about running on single machine. For example for working with a large number of list/set/maps and query and sort them.

like image 973
Ali Shakiba Avatar asked Nov 05 '22 16:11

Ali Shakiba


1 Answers

Redis will definitely not be faster that native Java on a single machine. It would allow you to distribute processing, but if the chunks of data really are large, they're not likely to fit into memory anyway. Without knowing more about what you're doing, I would suggest storing the data on disk. When you get multiple machines, you can network mount the partition and share the data that way. Alternatively, Hadoop with MapReduce sounds like the right sort of thing for what you're doing.

like image 91
Joshua Martell Avatar answered Nov 12 '22 15:11

Joshua Martell