Skip to content

Tag: pandas

Cleaning up data frame and date time

I am working with data frame. One of the columns contains date where the format of cell are mixed between date, time and string. The sample date frame is as follow: I want to create a new column that contains the text of date column. The expected output is as follows: How can I do that? Answer IIUC using to_d…

How to combine 2 dataframe histograms in 1 plot?

I would like to use a code that shows all histograms in a dataframe. That will be df.hist(bins=10). However, I would like to add another histograms which shows CDF df_hist=df.hist(cumulative=True,bins=100,density=1,histtype=”step”) I tried separating their matplotlib axes by using fig=plt.figure()…

Does loc/iloc return a reference or a copy?

I am experiencing some problems while using .loc / .iloc as part of a loop. This is a simplified version of my code: basically: I initialize a dataframe with index and columns I populate each row of the dataframe with a for loop I find the index “i_max” finding the maximum value in column ‘A…

Why does Excel styling not work in Pandas?

I tried to apply highlight_max to columns Answer So I’m going to assume you want to apply your style change to your dataframe in python the way it is designed to be implemented and display the color modifications when you print your dataframe in console. The issue is (I’m assuming) that you are no…

Append only matching columns to dataframe

I have a sort of ‘master’ dataframe that I’d like to append only matching columns from another dataframe to The problem is that when I use df.append(), It also appends the unmatched columns to df. But my desired output is to drop columns D and E since they are not a part of the original data…

Pandas ‘partial melt’ or ‘group melt’

I have a DataFrame like this and I want to transform it into something like this This is an unpivot / melt problem, but I don’t know of any way to melt by keeping these groups intact. I know I can create projections across the original dataframe and then concat those but I’m wondering if I’m…