Modifying variables in Python function is affecting variables with different names outside the function

Question

I have a nested dictionary containing a bunch of data on a number of different objects (where I mean object in the non-programming sense of the word). The format of the dictionary is allData[i][someDataType], where i is a number designation of the object that I have data on, and someDataType is a specific data array associated with the object in question.

Now, I have a function that I have defined that requires a particular data array for a calculation to be performed for each object. The data array is called cleanFDF. So I feed this to my function, along with a bunch of other things it requires to work. I call it like this:

rm.analyze4complexity(allData[i]['cleanFDF'], other data, other data, other data)

Inside the function itself, I straight away re-assign the cleanFDF data to another variable name, namely clFDF. I.e. The end result is:

clFDF = allData[i]['cleanFDF']

I then have to zero out all of the data that lies below a certain threshold, as such:

clFDF[ clFDF < threshold ] = 0

OK - the function works as it is supposed to. But now when I try to plot the original cleanFDF data back in the main script, the entries that got zeroed out in clFDF are also zeroed out in allData[i]['cleanFDF']. WTF? Obviously something is happening here that I do not understand.

To make matters even weirder (from my point of view), I've tried to do a bodgy kludge to get around this by 'saving' the array to another variable before calling the function. I.e. I do

saveFDF = allData[i]['cleanFDF']

then run the function, then update the cleanFDF entry with the 'saved' data:

allData[i].update( {'cleanFDF':saveFDF} )

but somehow, simply by performing clFDF[ clFDF < threshold ] = 0 within the function modifies clFDF, saveFDF and allData[i]['cleanFDF'] in the main friggin' script, zeroing out all the entires at the same array indexes! It is like they are all associated global variables somehow, but I've made no such declarations anywhere...

I am a hopeless Python newbie, so no doubt I'm not understanding something about how it works. Any help would be greatly appreciated!

Answer 1

You are passing the value at allData[i]['cleanFDF'] by reference (decent explanation at https://stackoverflow.com/a/430958/337678). Any changes made to it will be made to the object it refers to, which is still the same object as the original, just assigned to a different variable.

Making a deep copy of the data will likely fix your issue (Python has a deepcopy library that should do the trick ;)).

Answer 2

Everything is a reference in Python.

def function(y):
    y.append('yes')
    return y

example = list()
function(example)
print(example)

it would return ['yes'] even though i am not directly changing the variable 'example'.

See Why does list.append evaluate to false?, Python append() vs. + operator on lists, why do these give different results?, Python lists append return value.