Pandas to_sql fails on duplicate primary key

Question

I'd like to append to an existing table, using pandas df.to_sql() function.

I set if_exists='append', but my table has primary keys.

I'd like to do the equivalent of insert ignore when trying to append to the existing table, so I would avoid a duplicate entry error.

Is this possible with pandas, or do I need to write an explicit query?

Answer 1

There is unfortunately no option to specify "INSERT IGNORE". This is how I got around that limitation to insert rows into that database that were not duplicates (dataframe name is df)

for i in range(len(df)):     try:         df.iloc[i:i+1].to_sql(name="Table_Name",if_exists='append',con = Engine)     except IntegrityError:         pass #or any other action