I am writing the result of an SQL query into an Excel sheet and attempting to transpose rows into columns but cannot seem to get Pandas to budge; there seems to be an conundrum of some sort with Excel. I have looked at:
how to switch columns rows in a pandas dataframe
How to convert rows values in dataframe to columns labels in Python after groupby?
Convert column to row in Python Pandas
Python Pandas: Convert Rows as Column headers
None seem to work.
import psycopg2
import pandas as pd
import xlsxwriter
try:
conn = psycopg2.connect(private stuff cannot be shared)
except:
print ("I am unable to connect to the database")
cursor = conn.cursor()
writer = pd.ExcelWriter("Z:/AWS/SQLQueries/Phoebe's Request.xlsx",engine = 'xlsxwriter')
query20 = """SELECT 2 AS rowtype
, source AS "TrafficTypes_Name"
, COUNT(source) AS "Traffic"
, to_char(week,'MM/dd/yyyy') AS "Week_Ending"
FROM amazon.tracker
where project_id = 'PCR'
GROUP
BY source
, to_char(week,'MM/dd/yyyy')
UNION ALL
SELECT 1
, 'Visitor Center Walk-ins'
, COUNT(source)
, to_char(week,'MM/dd/yyyy') as week
FROM amazon.tracker
where project_id = 'PCR'
GROUP
BY to_char(week,'MM/dd/yyyy')
ORDER
BY "Week_Ending"
, rowtype"""
cursor.execute(query20)
result = cursor.fetchall()
first = pd.DataFrame(result, columns = ["rowtype","TrafficTypes_Name","Traffic","Week_Ending"])
first.drop(first.columns[0],axis=1, inplace = True)
first.pivot(index = 'Week_Ending', columns = 'TrafficTypes_Name' , values = 'Traffic' )
first.to_excel(writer, sheet_name = 'Visitor Traffic',index = False)
print ("Query 20 Created")
writer.save()
Excel sheet:
TrafficTypes_Name Traffic Week_Ending
Visitor Center Walk-ins 18 01/01/2017
Resident Referral 1 01/01/2017
Community Website 1 01/01/2017
Realtor 1 01/01/2017
Other Website 1 01/01/2017
Social Media 1 01/01/2017
Builder 3 01/01/2017
Drive-by 10 01/01/2017
Requesting:
Week_Ending Visitor Center Walk-ins Resident Referral Community Website Realtor ....................
01/01/2017 18 1 1 1 .........................
columns() to Convert Row to Column Header. You can use df. columns=df. iloc[0] to set the column labels by extracting the first row.
Reversing the rows of a data frame in pandas can be done in python by invoking the loc() function. The panda's dataframe. loc() attribute accesses a set of rows and columns in the given data frame by either a label or a boolean array.
Use the T attribute or the transpose() method to swap (= transpose) the rows and columns of DataFrame. Neither method changes an original object but returns the new object with the rows and columns swapped (= transposed object).
Pivot would work here
df1 = df.pivot(index='Week_Ending', columns='TrafficTypes_Name', values='Traffic')
TrafficTypes_Name Builder CommunityWebsite Drive-by OtherWebsite Realtor ResidentReferral SocialMedia VisitorCenterWalk-ins
Week_Ending
01/01/2017 3 1 10 1 1 1 1 18
If you love us? You can donate to us via Paypal or buy me a coffee so we can maintain and grow! Thank you!
Donate Us With