Logo Questions Linux Laravel Mysql Ubuntu Git Menu
 

How to "reduce" a hash?

Tags:

.net

hashcode

Suppose I have any "long" hash, like a 16 bytes MD5 or a 20 bytes SHA1. I want to reduce this hash to fit on 4 bytes, for GetHashCode() purposes.

First, I'm perfectly aware that I'll get more collisions. That's totally fine in my case, but I'd still prefer to get the less possible collisions.

There are several solutions to my problem:

  • I could take the 4 first bytes of the hash.
  • I could take the 4 last bytes of the hash.
  • I could take 4 random bytes of the hash.
  • I could generate a hash of the hash, involving classic prime numbers multiplications.

Are there other solutons I didn't think about? And more importantly, what method will give me the most unique hash code? I'm currently supposing they're almost equivalent.

Microsoft chose that the public key token of an assembly is the last 8 bytes of the SHA1 hash of its public key, so I'll probably go for this solution but I'd like to know why.

like image 851
Julien Lebosquain Avatar asked Jun 13 '10 15:06

Julien Lebosquain


3 Answers

Any hash is already a reduction.

Cryptographic hashes are designed so that no part of the data has more influence on any part of the hash than any other. So it doesn't matter which bits of the hash you pick.

like image 109
Ben Voigt Avatar answered Oct 27 '22 17:10

Ben Voigt


Any option except the third one - picking bytes by random - works fine. If you pick the bytes by random, the same input will produce different hash codes each time, which defeats the purpose of the hash code.

like image 23
Guffa Avatar answered Oct 27 '22 19:10

Guffa


If you take a random 4 bytes, then you get a situation where two of your SHA1 hashes which are exactly the same produce different GetHashCode hashes.

I would just choose the first 4 bytes - SHA1 is designed so that no bytes should be as important as any other set of bytes.

like image 41
Callum Rogers Avatar answered Oct 27 '22 18:10

Callum Rogers