Logo Questions Linux Laravel Mysql Ubuntu Git Menu
 

How to count distinct values in a list in linear time?

I can think of sorting them and then going over each element one by one but this is nlogn. Is there a linear method to count distinct elements in a list?

like image 224
polerto Avatar asked Dec 13 '12 17:12

polerto


2 Answers

Update: - distinct vs. unique


If you are looking for "unique" values (As in if you see an element "JASON" more than once, than it is no longer unique and should not be counted)

You can do that in linear time by using a HashMap ;)

(The generalized / language-agnostic idea is Hash table)

Each entry of a HashMap / Hash table is <KEY, VALUE> pair where the keys are unique (but no restrictions on their corresponding value in the pair)

Step 1:

Iterate through all elements in the list once: O(n)

  • For each element seen in the list, check to see if it's in the HashMap already O(1), amortized
    • If not, add it to the HashMap with the value of the element in the list as the KEY, and the number of times you've seen this value so far as the VALUE O(1)
    • If so, increment the number of times you've seen this KEY so far O(1)

Step2:

Iterate through the HashMap and count the KEYS with VALUE equal to exactly 1 (thus unique) O(n)

Analysis:

  • Runtime: O(n), amortized
  • Space: O(U), where U is the number of distinct values.

If, however, you are looking for "distinct" values (As in if you want to count how many different elements there are), use a HashSet instead of a HashMap / Hash table, and then simply query the size of the HashSet.

like image 76
sampson-chen Avatar answered Oct 03 '22 13:10

sampson-chen


You can adapt this extremely cool O(n)-time and O(1)-space in-place algorithm for removing duplicates to the task of counting distinct values -- simply count the number of values equal to the sentinel value in a final O(n) pass, and subtract that from the size of the list.

like image 23
j_random_hacker Avatar answered Oct 03 '22 14:10

j_random_hacker