Learn Python Pandas Via Usecases — Part 2 Use cases open up more functionalities In the last blog, I hope I have sold you the idea that Pandas is an amazing library for quick and easy data analysis and it’s much easier to use than you thought. If you have not read my first blog about Pandas, please go through it before you move forward. Oops !! We missed Some Data In the last blog, we saw basic Dataframe operations using sample sales data. Let’s assume you are a manager leading a sales team, and you were all happy about the sales trajectory and the pivot representation of the data you learned to create from our last blog. import numpy as np
df.pivot_table(index=["Country"], 
               columns=["Region"], 
               values=["Quantity"], 
               aggfunc=[np.sum]) That’s when you realize you have because it was lost in one of the spreadsheets. Now, what do you do? You already have a report ready to go. How can you incorporate the new data into the current pivot representation without major changes? missed sales data of a particular quarter If you see, the pivot table is constructed with a single Dataframe df, somehow if we can find a way to feed our new data into the df then we can just re-run the pivot code and voila!! we will get the report again. So here are the steps we are going to follow, 1. Load the new spreadsheet data into a new Dataframe df2 = pd.read_csv("data/Pandas - Q4 Sales.csv")
df2.head() 2. Combine two Dataframe into a single df object, Using concat Pandas method concatenates the contents of multiple Dataframes and creates a new Dataframe. Concat The axis param of the method enables you to concatenate data along rows or columns result_df = pd.concat([df, df2], axis=0, sort=False)
# axis = 0, append along rows, 
# axis = 1, append along cols

result_df.tail() # tail is similar to head returns last 10 entries Using append Unlike concat , the append method adds up data to an existing dataframe instead of creating a new Dataframe. Also, you can notice that we don’t supply any axis parameter here since append method only allows adding new entries as rows. result_df = df.append([df2],sort=False)
result_df.tail() If you take a closer look, in both cases, the data frames that need to be combined are supplied as a python list [df1, df2]. This implies that we can combine as many Dataframes as we want 3. Re-run the pivot code pivot = result_df.pivot_table(index=["Country"], 
                              columns=["Region"], 
                              values="Quantity") Charts are better than tables You have a couple of hours for your final meeting. Your presentation is concrete, your sales are good but still, something is missing. For a management person who was so used to spreadsheets charts, leaving them behind is not a good idea. But, we have a short time to go back to spreadsheets, don’t we? Worry not, Pandas comes with a built-in charting framework which lets you draw graphs of our pivot representation Charts. Perfection As a person who was known for your perfection something doesn’t sit well in you. One of the tabular representations that you have created has unnecessary information that doesn’t interest your management, and a couple of columns have names that are used internally in your company and will not ring any bell to the management. Worry not, we can do it and pretty quick. In pandas terms, we call this method chaining. all in one shot Method chaining enables you to perform a various transformation on the same data without storing the intermediate result. Explicit is better than implicit hence let’s rename “Total” to “Total Sales” We don’t need the date of purchase just the and year quarter We don’t need the requester of purchase, Salesperson, and Date of purchase. So let’s drop it. result_df.rename({"Total": "Total Sales"}, axis=1).assign(Quarter=result_df['Date of Purchase'].dt.quarter, Year=result_df['Date of Purchase'].dt.year) .drop(["Requester", "Sales Person", "Date of Purchase"], axis=1).head() One Last Thing With that, our final report looks good and guess what? Your management is not only happy about your sales this year but also excited about your new found love for Pandas, but there is just one last thing remaining, you need to send the final data as a CSV back to your management. But worry not we have pandas to do it for you. result_df.to_csv(path_or_buf="Export_Data.csv") An file would be created in your current path which you can happily send to your management as an email attachment. “Export_Data.csv” As you rest back on your seat, you want to automate the pandas experiment that you just did for the future sales reports. Thankfully, you have an intern who is joining you in a couple of days. It will be a great project for him to pick it up. Something in me tells that things aren’t going to be as easy as it was for you. which we will see in the next blog “What’s wrong with Pandas?” Did the blog nudge you to deep dive into pandas? Hold the “claps” icon and give a shout on twitter . Follow to stay tuned on future blogs. Preview image with title

Google

Lear

Twitter

Caches in Python

Planning to Switch Site From Html to Gatsby?

Read My Stories

Too Long; Didn't Read

Boost your HackerNoon story @ $159.99! 🚀

Learn Pandas Via Usecases — Part 2

About Author

Comments

TOPICS

THIS ARTICLE WAS FEATURED IN

Related Stories

Untitled Story

Caches in Python

What Are Convolution Neural Networks? [ELI5]

The Noonification: Have U Been Pwned? (1/12/2023)

Goldman Sachs, Data Lineage, and Harry Potter Spells

People are still crazy about Python after twenty-five years

Caches in Python

What Are Convolution Neural Networks? [ELI5]

The Noonification: Have U Been Pwned? (1/12/2023)

Goldman Sachs, Data Lineage, and Harry Potter Spells

People are still crazy about Python after twenty-five years

Light-Mode

Classic

Newspaper

Dark-Mode

Neon Noir

Minty

HN StartUps