I have a number of values per ID in this format: I want to randomly select IDs but keep all values per ID, so for example, if I wanted to get 2 random IDs; the outcome would look like this: Giving me, ID 2 & 5. Answer Use numpy.random.choice to select random values then select them. Edit: please read the
Tag: pandas-groupby
Pandas Dataframe: Retrieve the Maximum Value in a Pandas Dataframe using .groupby and .idxmax()
I have a Pandas Dataframe that contains a series of Airbnb Prices grouped by neighbourhood group neighbourhood and room_type. My objective is to return the Maximum Average Price for each room_type per Neighbourhood and return only this. My approach to this was to use .groupby and .idxmax() to get the maximum …
Group by from wide form in Pandas
I have a DataFrame like this one: I want to find out the characteristics of the Disloyal and Not Satisfied customers that are between 30 and 40 years old, grouping them by the service they have rated: I suspect I have to use melt but I can’t figure out how to groupby from there. Answer With the followin…
Create Python graphviz Digraph with Pandas
I am trying to make a diagram tree in graphviz.Digraph, I am using Pandas dataframe. By the below query, I am getting the processid’s and their dependents id’s in a form of a dictionary But I want the data in below format: Can someone please help me return pandas dataframe output in such format? A…
Cumulative count of column based on Month
I have a dataframe that looks like this: Code Period A 2022-04-29 A 2022-04-29 A 2022-04-30 A 2022-05-01 A 2022-05-01 A 2022-05-01 I have to create a new column, i.e., if the month ends then Count should start from 1. Below is the code that I have tried at my end. Code Period size A 2022-04-29 2 A 2022-04-30 …
Pandas filter without ~ and not in operator
I have two dataframes like as below I would like to do the below a) Check whether the ID and Name from df1 is present in df2. b) If present in df2, put Yes in Status column or No in Status column. Don’t use ~ or not in operator because my df2 has million of rows. So, it will result
Calculate column value count as a bar plot in Python dataframe
I have time series data and want to see total number of Septic (1) and Non-septic (0) patients in the SepsisLabel column. The Non-septic patients don’t have entries of ‘1’. While the Septic patients have first ‘Zeros (0)’ then it changes to ‘1’ means it now becomes se…
Creating adjacency matrix from sparse SKU data in Python
I have ecommerce data with about 6000 SKUs and 250,000 obs. Simple version below but a lot more sparse. There is only one SKU per line as each line is a transaction. What I have: I want to create a weighted undirected adjacency matrix so that I can do some graph analysis on the market baskets. It would look l…
Pandas groupby – Find mean of first 10 items
I have 30 items in each group. To find mean of entire items, I use this code. That returns a value like this. However, I would like to find the mean of the first 10 items in the group instead of the entire items. That code return only a single Value instead of a pandas series. So I’m getting errors
Is there a way to get the count of every element in lists stored as rows in a data frame?
Hi, I’m using pandas to display and analyze a csv file, some columns were ‘object dtype’ and were displayed as lists, I used ‘literal_eval’ to convert the rows of a column named ‘sdgs’ to lists, my problem is how to use ‘groupby’ or any another way to disp…