Logo Questions Linux Laravel Mysql Ubuntu Git Menu
 

How to preserve Labels when SPSS file (.sav) imported into pandas via rpy?

I'm looking to work on a SPSS files (.sav) using pandas. In the absence of the SPSS program, here's what a typical file looks like when converted to .csv:

enter image description here

On investigation into what the first two rows signify (I don't know SPSS), it seems that the first row contains the Labels, while the second row contains the VarNames.

enter image description here

When I bring the file into pandas thus:

import pandas.rpy.common as com

def savtocsv(filename):
    w = com.robj.r('foreign::read.spss("%s", to.data.frame=TRUE)' % filename)
    w = com.convert_robj(w)
    return w

and then do a head(), the first row (Label) is missing:

enter image description here

How can labels be maintained?

  • Ref: Is there a Python module to open SPSS files?
  • Python: 2.7.10
  • Pandas: 0.17.1
like image 839
Pyderman Avatar asked Mar 29 '16 14:03

Pyderman


1 Answers

Labels in a sav file are stored in variable.labels attribute of the returning object from the read.spss function.

You can get the variable labels with the following:

import pandas.rpy.common as com

def get_labels(filename):
    w = com.robj.r('attr(foreign::read.spss("%s"), "variable.labels")' % filename)
    w = com.convert_robj(w)
    return w

If you want to set the labels as the column names of your dataframe:

import pandas.rpy.common as com

def savtocsv(filename):
    w = com.robj.r('foreign::read.spss("%s", to.data.frame=TRUE)' % filename)
    cols = list(com.robj.r("attr")(w, "variable.labels"))
    w = com.convert_robj(w)
    w.columns = cols
    return w
like image 92
ayhan Avatar answered Oct 18 '22 20:10

ayhan