I get the following error when I attempt to load a saved sklearn.preprocessing.MinMaxScaler
/shared/env/lib/python3.6/site-packages/sklearn/base.py:315: UserWarning: Trying to unpickle estimator MinMaxScaler from version 0.23.2 when using version 0.24.0. This might lead to breaking code or invalid results. Use at your own risk.
UserWarning)
[2021-01-08 19:40:28,805 INFO train.py:1317 - main ] EXCEPTION WORKER 100:
Traceback (most recent call last):
...
File "/shared/core/simulate.py", line 129, in process_obs
obs = scaler.transform(obs)
File "/shared/env/lib/python3.6/site-packages/sklearn/preprocessing/_data.py", line 439, in transform
if self.clip:
AttributeError: 'MinMaxScaler' object has no attribute 'clip'
I trained the scaler on one machine, saved it, and pushed it to a second machine where it was loaded and used to transform input.
# loading and transforming
import joblib
from sklearn.preprocessing import MinMaxScaler
scaler = joblib.load('scaler')
assert isinstance(scaler, MinMaxScaler)
data = scaler.transform(data) # throws exception
The issue is you are training the scaler on a machine with an older verion of sklearn than the machine you're using to load the scaler.
Noitce the UserWarning
UserWarning: Trying to unpickle estimator MinMaxScaler from version 0.23.2 when using version 0.24.0. This might lead to breaking code or invalid results. Use at your own risk. UserWarning)
The solution is to fix the version mismatch. Either by upgrading one sklearn to 0.24.0
or downgrading to 0.23.2
New property clip
was added to MinMaxScaler
in later version (since 0.24).
# loading and transforming
import joblib
from sklearn.preprocessing import MinMaxScaler
scaler = joblib.load('scaler')
assert isinstance(scaler, MinMaxScaler)
scaler.clip = False # add this line
data = scaler.transform(data) # throws exceptio
Explanation:
Becase clip
is defined in __init__
method it is part of MinMaxScaler.__dict__
. When you try to create object from pickle __setattr__
method is used to set all attributues, but clip
was not used in older version therefore is missing in your new MinMaxScale
instance. Simply add:
scaler.clip = False
and it should work fine.
If you love us? You can donate to us via Paypal or buy me a coffee so we can maintain and grow! Thank you!
Donate Us With