Logo Questions Linux Laravel Mysql Ubuntu Git Menu
 

How to filter cases in a data.table by multiple conditions defined in another data.table

I wondered whether there is any efficient way to filter a data.table by multiple conditions defined in another data.table. There are 2 data.table in this case:

# the filter data.table defines the condition
dt_filter<-data.table(A=c(1,2),B=c(8,7))
# dt1 the data.table to be filtered
dt1<-data.table(A=rep(c(1,2),5),B=c(8,4,3,1,1,5,9,7,1,1),C=c(rep(1,5),rep(2,5)))

ls_tmp<-lapply (1:nrow(dt_filter),function(i){
# exclude the record with the A&B defined the filter
dt1_add<-dt1[A==dt_filter[[i,1]]&B!=dt_filter[[i,2]]]
})
result<- rbindlist(ls_tmp)

It seems my sample is not efficient because of lapply loop. I am not sure how to re-write it by some other way.

like image 982
YYY Avatar asked Feb 24 '15 20:02

YYY


Video Answer


2 Answers

setkey(dt1, A)

dt1[dt_filter, allow = T][B != i.B, !'i.B']
#   A B C
#1: 1 1 1
#2: 1 1 2
#3: 1 3 1
#4: 1 9 2
#5: 2 1 1
#6: 2 1 2
#7: 2 4 1
#8: 2 5 2
like image 196
eddi Avatar answered Oct 06 '22 23:10

eddi


Two other solutions which read more clearly and which don't need to setkey:

dt1[ which(dt1$A == dt_filter$A & dt1$B != dt_filter$B) ,]

Now using %in%

dt1[dt1$A %in% dt_filter$A & !(dt1$B %in% dt_filter$B) ,]

like image 36
rafa.pereira Avatar answered Oct 06 '22 23:10

rafa.pereira