Logo Questions Linux Laravel Mysql Ubuntu Git Menu
 

calculate mean for multiple columns in data.frame

Tags:

r

Just wondering whether it is possible to calculate means for multiple columns by just using the mean function

e.g.

mean(iris[,1])

is possible but not

mean(iris[,1:4])

tried:

mean(iris[,c(1:4)])

got this error message:

Warning message: In mean.default(iris[, 1:4]) : argument is not numeric or logical: returning NA

I know I can just use lapply(iris[,1:4],mean) or sapply(iris[,1:4],mean)

like image 797
Kuan Hoong Avatar asked Jun 19 '15 15:06

Kuan Hoong


2 Answers

Try colMeans:

But the column must be numeric. You can add a test for it for larger datasets.

colMeans(iris[sapply(iris, is.numeric)])
Sepal.Length  Sepal.Width Petal.Length  Petal.Width 
    5.843333     3.057333     3.758000     1.199333 

Benchmark

Seems long for dplyr and data.table. Perhaps someone can replicate the findings for veracity.

microbenchmark(
  plafort = colMeans(big.df[sapply(big.df, is.numeric)]),
  Carlos  = colMeans(Filter(is.numeric, big.df)),
  Cdtable = big.dt[, lapply(.SD, mean)],
  Cdplyr  = big.df %>% summarise_each(funs(mean))
  )
#Unit: milliseconds
#    expr       min        lq     mean    median       uq       max
# plafort  9.862934 10.506778 12.07027 10.699616 11.16404  31.23927
#  Carlos  9.215143  9.557987 11.30063  9.843197 10.21821  65.21379
# Cdtable 57.157250 64.866996 78.72452 67.633433 87.52451 264.60453
#  Cdplyr 62.933293 67.853312 81.77382 71.296555 91.44994 182.36578

Data

m <- matrix(1:1e6, 1000)
m2 <- matrix(rep('a', 1000), ncol=1)
big.df <- as.data.frame(cbind(m2, m), stringsAsFactors=F)
big.df[,-1] <- lapply(big.df[,-1], as.numeric)
big.dt <- as.data.table(big.df)
like image 186
Pierre L Avatar answered Sep 23 '22 12:09

Pierre L


With sapply + Filter:

sapply(Filter(is.numeric, iris), mean)
Sepal.Length  Sepal.Width Petal.Length  Petal.Width 
    5.843333     3.057333     3.758000     1.199333 

With dplyr:

library(dplyr)
iris %>% summarise_each(funs(mean))
   Sepal.Length Sepal.Width Petal.Length Petal.Width Species
1:     5.843333    3.057333        3.758    1.199333      NA

PS: in dplyr you can now use summarize_if,

iris %>% summarise_if(is.numeric, mean)
#>   Sepal.Length Sepal.Width Petal.Length Petal.Width
#> 1     5.843333    3.057333        3.758    1.199333

With data.table:

library(data.table)
iris <- data.table(iris)
iris[,lapply(.SD, mean)]
   Sepal.Length Sepal.Width Petal.Length Petal.Width Species
1:     5.843333    3.057333        3.758    1.199333      NA
like image 44
Carlos Cinelli Avatar answered Sep 23 '22 12:09

Carlos Cinelli