How to split a sequence according to a predicate?

Question

I very often run into the need to split a sequence into the two subsequences of elements that satisfy and don't satisfy a given predicate (preserving the original relative ordering).

This hypothetical "splitter" function would look something like this in action:

>>> data = map(str, range(14)) >>> pred = lambda i: int(i) % 3 == 2 >>> splitter(data, pred) [('2', '5', '8', '11'), ('0', '1', '3', '4', '6', '7', '9', '10', '12', '13')] 

My question is:

does Python already have a standard/built-in way to do this?

This functionality is certainly not difficult to code (see Addendum below), but for a number of reasons, I'd prefer to use a standard/built-in method than a self-rolled one.

Thanks!

Addendum:

The best standard function I've found so far for handling this task in Python is itertools.groupby. To use it for this particular task however, it is necessary to call the predicate function twice for each list member, which I find annoyingly silly:

>>> import itertools as it >>> [tuple(v[1]) for v in it.groupby(sorted(data, key=pred), key=pred)] [('0', '1', '3', '4', '6', '7', '9', '10', '12', '13'), ('2', '5', '8', '11')] 

(The last output above differs from the desired one shown earlier in that the subsequence of elements that satisfy the predicate comes last rather than first, but this is very minor, and very easy to fix if needed.)

One can avoid the redundant calls to the predicate (by doing, basically, an "inline memoization"), but my best stab at this gets pretty elaborate, a far cry from the simplicity of splitter(data, pred):

>>> first = lambda t: t[0] >>> [zip(*i[1])[1] for i in it.groupby(sorted(((pred(x), x) for x in data), ... key=first), key=first)] [('0', '1', '3', '4', '6', '7', '9', '10', '12', '13'), ('2', '5', '8', '11')] 

BTW, if you don't care about preserving the original ordering, sorted's default sort order gets the job done (so the key parameter may be omitted from the sorted call):

>>> [zip(*i[1])[1] for i in it.groupby(sorted(((pred(x), x) for x in data)), ... key=first)] [('0', '1', '3', '4', '6', '7', '9', '10', '12', '13'), ('2', '5', '8', '11')] 

Answer 1

I know you said you didn't want to write your own function, but I can't imagine why. Your solutions involve writing your own code, you just aren't modularizing them into functions.

This does exactly what you want, is understandable, and only evaluates the predicate once per element:

def splitter(data, pred):     yes, no = [], []     for d in data:         if pred(d):             yes.append(d)         else:             no.append(d)     return [yes, no] 

If you want it to be more compact (for some reason):

def splitter(data, pred):     yes, no = [], []     for d in data:         (yes if pred(d) else no).append(d)     return [yes, no] 

Answer 2

Partitioning is one of those itertools recipes that does just that. It uses tee() to make sure it's iterating the collection in one pass despite the multiple iterators, the builtin filter() function to grab items that satisfies the predicate as well as filterfalse() to get the opposite effect of the filter. This is as close as you're going to get at a standard/builtin method.

def partition(pred, iterable):     'Use a predicate to partition entries into false entries and true entries'     # partition(is_odd, range(10)) --> 0 2 4 6 8   and  1 3 5 7 9     t1, t2 = tee(iterable)     return filterfalse(pred, t1), filter(pred, t2)