Logo Questions Linux Laravel Mysql Ubuntu Git Menu
 

Any theoretical limit to compression?

Imagine that you had all the supercomputers in the world at your disposal for the next 10 years. Your task was to compress 10 full-length movies losslessly as much as possible. Another criteria was that a normal computer should be able to decompress it on the fly and should not need to spend much of his HD to install the decompressing software.

My question is, how much more compression could you achieve than the best alternatives today? 1%, 5%, 50%? More specifically: is there a theoretical limit to compression, given a fixed dictionary size (if it is called that for video compression as well)?

like image 768
David Avatar asked Dec 02 '10 22:12

David


People also ask

Is there a limit to lossless compression?

Shannon established that there is a fundamental limit to lossless data compression. This limit, called the entropy rate, is denoted by H. The exact value of H depends on the information source --- more specifically, the statistical nature of the source.

How much data can be compressed?

Data compression can reduce a text file to 50% or a significantly higher percentage of its original size. For data transmission, compression can be performed on the data content or on the entire transmission unit, including header data.

What is the maximum size of compression group?

The NetApp compression algorithm divides a file into chunks of data called “compression groups.” Compression groups are a maximum of 32KB in size.

What are the 2 methods of compression?

There are two types of compression: lossless and lossy.


2 Answers

The limits of compression are dictated by the randomness of the source. Welcome to the study of information theory! See data compression.

like image 147
Riedsio Avatar answered Oct 06 '22 09:10

Riedsio


There is a theoretical limit: I suggest reading this article on Information theory and the pigeon hole principle. It seems to sum up the issue in a very easy to understand way.

like image 42
JohnFx Avatar answered Oct 06 '22 09:10

JohnFx