Logo Questions Linux Laravel Mysql Ubuntu Git Menu
 

Pandas: boolean indexing with unequal Series lengths

Tags:

python

pandas

Given two pandas series objects A and Matches. Matches contains a subset of the indexes of A and has boolean entries. How does one do the equivalent of logical indexing?

If Matches were the same length as A, one could just use:

A[Matches] = 5.*Matches

With Matches shorter than A one gets:

error: Unalignable boolean Series key provided

Edit 1: Illustration as requested

In [15]: A = pd.Series(range(10))

In [16]: A
Out[16]: 0    0
1    1
2    2
3    3
4    4
5    5
6    6
7    7
8    8
9    9
dtype: int64

In [17]: Matches = (A<3)[:5]

In [18]: Matches
Out[18]: 0     True
1     True
2     True
3    False
4    False
dtype: bool

In [19]: A[Matches] = None
---------------------------------------------------------------------------
IndexingError                             Traceback (most recent call last)
<ipython-input-19-7a04f32ce860> in <module>()
----> 1 A[Matches] = None

C:\Anaconda\lib\site-packages\pandas\core\series.py in __setitem__(self, key, value)
    631 
    632         if _is_bool_indexer(key):
--> 633             key = _check_bool_indexer(self.index, key)
    634             try:
    635                 self.where(~key, value, inplace=True)

C:\Anaconda\lib\site-packages\pandas\core\indexing.py in _check_bool_indexer(ax, key)
   1379         mask = com.isnull(result.values)
   1380         if mask.any():
-> 1381             raise IndexingError('Unalignable boolean Series key provided')
   1382 
   1383         result = result.astype(bool).values

IndexingError: Unalignable boolean Series key provided

In [20]: 

The result I am looking for is:

In [16]: A
Out[16]: 0    None
1    None
2    None
3    3
4    4
5    5
6    6
7    7
8    8
9    9
dtype: int64

The construction of the Matches series is artificial and for illustration only. Also, in my case row indexes are obviously non-numeric and not equal to element values...

like image 272
ARF Avatar asked Apr 15 '14 16:04

ARF


1 Answers

Well, you can't have what you want, because int64 is not a possible dtype for a series containing None. None isn't an integer. But you can get close:

>>> A = pd.Series(range(10))
>>> Matches = (A<3)[:5]
>>> A[Matches[Matches].index] = None
>>> A
0    None
1    None
2    None
3       3
4       4
5       5
6       6
7       7
8       8
9       9
dtype: object

Which works because Matches[Matches] selects the elements of Matches which are true.

like image 70
DSM Avatar answered Oct 03 '22 10:10

DSM