Logo Questions Linux Laravel Mysql Ubuntu Git Menu
 

Predict.glm not predicting missing values in response

For some reason, when I specify glms (and lm's too, it turns out), R is not predicting missing values of the data. Here is an example:

y = round(runif(50))
y = c(y,rep(NA,50))
x = rnorm(100)
m = glm(y~x, family=binomial(link="logit"))
p = predict(m,na.action=na.pass)
length(p)

y = round(runif(50))
y = c(y,rep(NA,50))
x = rnorm(100)
m = lm(y~x)
p = predict(m)
length(p)

The length of p should be 100, but its 50. The weird thing is that I have other predicts in the same script that do predict from missing data.

EDIT: It turns out that those other predicts were quite wrong -- I was doing imputed.value = rnorm(N,mean.from.predict,var.of.prediction.interval). This recycled the mean and sd vectors from the lm predict or glm predict functions when length(predict)<N, which was quite different from what I was seeking.

So my question is what about my example code is stopping glm and lm from predicting missing values?

Thanks!

like image 524
generic_user Avatar asked Apr 28 '13 17:04

generic_user


2 Answers

When glm fits the model, it uses only the cases where there are no missing values. You can still get predictions for the cases where your y values are missing, by constructing a data frame and passing that to predict.glm.

predict(m, newdata=data.frame(y, x))
like image 161
Hong Ooi Avatar answered Oct 18 '22 04:10

Hong Ooi


The issue is with your call to glm, which has a na.action argument which is set to na.omit

Therefore these values are omited (and when predict.glm is called, they are still omitted)

From ?glm

na.action

a function which indicates what should happen when the data contain NAs. The default is set by the na.action setting of options, and is na.fail if that is unset. The ‘factory-fresh’ default is na.omit. Another possible value is NULL, no action. Value na.exclude can be useful.

from ?na.exclude (which is general NA action help page)

na.exclude differs from na.omit only in the class of the "na.action" attribute of the result, which is "exclude". This gives different behaviour in functions making use of naresid and napredict: when na.exclude is used the residuals and predictions are padded to the correct length by inserting NAs for cases omitted by na.exclude.

like image 26
mnel Avatar answered Oct 18 '22 05:10

mnel