Logo Questions Linux Laravel Mysql Ubuntu Git Menu
 

Comparison between lz4 vs lz4_hc vs blosc vs snappy vs fastlz

I have a large file of size 500 mb to compress in a minute with the best possible compression ratio. I have found out these algorithms to be suitable for my use.

  1. lz4
  2. lz4_hc
  3. snappy
  4. quicklz
  5. blosc

Can someone give a comparison of speed and compression ratios between these algorithms?

like image 996
Sayantan Ghosh Avatar asked Jun 03 '16 12:06

Sayantan Ghosh


People also ask

How good is LZ4?

LZ4 is very fast both when compressing and decompressing, but the compression ratio is rather disappointing. DEFLATE is a very effective and well balanced compromise between speed and effectiveness. It achieves a decent compression ratio and it's fast enough during both compression and decompression.

Is LZ4 lossless?

LZ4 is a lossless data compression algorithm that is focused on compression and decompression speed. It belongs to the LZ77 family of byte-oriented compression schemes.

What is LZ4HC compression?

LZ4HC is a high compression variant of LZ4. LZ4HC compression results in larger compressed files than LZMA, but does not require the entire bundle to be decompressed before use.


2 Answers

Yann Collet's lz4, hands down.

enter image description here

like image 192
aalaap Avatar answered Sep 19 '22 12:09

aalaap


This migth help you: (lz4 vs snappy) http://java-performance.info/performance-general-compression/ (benchmarks for lz4, snappy, lz4hc, blosc) https://web.archive.org/web/20170706065303/http://blosc.org:80/synthetic-benchmarks.html (now not available on http://www.blosc.org/synthetic-benchmarks.html)

like image 37
Master M Avatar answered Sep 19 '22 12:09

Master M