Logo Questions Linux Laravel Mysql Ubuntu Git Menu
 

python count number of unique elements in csv column

I'm trying to get the counts of unique items in a csv column using Python.

Sample CSV file (has no header):

AB,asd
AB,poi
AB,asd
BG,put
BG,asd

I've tried this so far.

import csv
from collections import defaultdict, Counter

input_file = open('Results/1_sample.csv')
csv_reader = csv.reader(input_file, delimiter=',')

data = defaultdict(list)
for row in csv_reader:
    data[row[0]].append(row[1])
for k, v in data.items():
    print k
    print Counter(v)

This gives output in this format:

AB
Counter({'asd': 2, 'poi': 1})
BG
Counter({'asd': 1, 'put': 1})

But I want my output to be like:

AB:2
BG:2
total_unique_count:3 #unique count of column[1], irrespective of the data in column[0]
like image 953
pam Avatar asked Apr 14 '15 18:04

pam


1 Answers

You're looking for the SeriesGroupby method nunique:

In [11]: df
Out[11]:
    0    1
0  AB  asd
1  AB  poi
2  AB  asd
3  BG  put
4  BG  asd

In [12]: g = df.groupby(0)

In [13]: g[1].nunique()
Out[13]:
0
AB    2
BG    2
Name: 1, dtype: int64
like image 115
Andy Hayden Avatar answered Oct 11 '22 20:10

Andy Hayden