Logo Questions Linux Laravel Mysql Ubuntu Git Menu
 

how to fix the flake 8 error "E712 comparison to False should be 'if cond is False:' or 'if not cond:'" in pandas dataframe

I am getting the flake 8 error of E712 at the line "added_parts = new_part_set[(new_part_set["duplicate"] == False) & (new_part_set["version"] == "target")]"**

Following is snippet of code which we used for spreadsheet comparison

source_df = pd.read_excel(self.source, sheet).fillna('NA')
target_df = pd.read_excel(self.target, sheet).fillna('NA')
file_path = os.path.dirname(self.source)

column_list = source_df.columns.tolist()

source_df['version'] = "source"
target_df['version'] = "target"

source_df.sort_values(by=unique_col)
source_df = source_df.reindex()
target_df.sort_values(by=unique_col)
target_df = target_df.reindex()

# full_set = pd.concat([source_df, target_df], ignore_index=True)
diff_panel = pd.concat([source_df, target_df],
                       axis='columns', keys=['df1', 'df2'], join='outer', sort=False)
diff_output = diff_panel.apply(self.__report_diff, axis=0)
diff_output['has_change'] = diff_output.apply(self.__has_change)

full_set = pd.concat([source_df, target_df], ignore_index=True)
changes = full_set.drop_duplicates(subset=column_list, keep='last')
dupe_records = changes.set_index(unique_col).index.unique()

changes['duplicate'] = changes[unique_col].isin(dupe_records)
removed_parts = changes[(changes["duplicate"] == False) & (changes["version"] == "source")]
new_part_set = full_set.drop_duplicates(subset=column_list, keep='last')
new_part_set['duplicate'] = new_part_set[unique_col].isin(dupe_records)
added_parts = new_part_set[(new_part_set["duplicate"] == False) & (new_part_set["version"] == "target")]

diff_file = file_path + "file_diff.xlsx"
if os.path.exists(diff_file):
    os.remove(diff_file)
writer = pd.ExcelWriter(file_path + "file_diff.xlsx")
diff_output.to_excel(writer, "changed")
removed_parts.to_excel(writer, "removed", index=False, columns=column_list)
added_parts.to_excel(writer, "added", index=False, columns=column_list)
writer.save()

Are there any other ways of how this can be avoided, Unsure on proceeding further.

like image 383
Komera Obanna Avatar asked Feb 01 '19 06:02

Komera Obanna


1 Answers

In your DataFrame masks you have (changes["duplicate"] == False) and (new_part_set["duplicate"] == False) flake8 is suggesting that you should change these. The reason it's complaining is that in python it's considered bad practice to compare to boolean values using the == operator, rather you should write if my_bool:... and if not my_bool:... etc. In pandas if you have a boolean series you can take the negation of it using the ~ operator so your new masks would be written:

~changes["duplicate"] # & ... blah blah
~new_part_set["duplicate"] # & ... blah blah
like image 171
Sven Harris Avatar answered Dec 10 '22 18:12

Sven Harris