You can use the function tz_localize to make a Timestamp or DateTimeIndex timezone aware, but how can you do the opposite: how can you convert a timezone aware Timestamp to a naive one, while preserving its timezone? An example: I could remove the timezone by setting it to None, but then the result is convert…
Tag: pandas
Pandas: Setting no. of max rows
I have a problem viewing the following DataFrame: The problem is that it does not print all rows per default in ipython notebook, but I have to slice to view the resulting rows. Even the following option does not change the output: Does anyone know how to display the whole array? Answer Set display.max_rows: …
How to add an empty column to a dataframe?
What’s the easiest way to add an empty column to a pandas DataFrame object? The best I’ve stumbled upon is something like Is there a less perverse method? Answer If I understand correctly, assignment should fill:
Random row selection in Pandas dataframe
Is there a way to select random rows from a DataFrame in Pandas. In R, using the car package, there is a useful function some(x, n) which is similar to head but selects, in this example, 10 rows at random from x. I have also looked at the slicing documentation and there seems to be nothing equivalent. Update …
Pandas ‘count(distinct)’ equivalent
I am using Pandas as a database substitute as I have multiple databases (Oracle, SQL Server, etc.), and I am unable to make a sequence of commands to a SQL equivalent. I have a table loaded in a DataFrame with some columns: In SQL, to count the amount of different clients per year would be: And the result wou…
How to return a matplotlib.figure.Figure object from Pandas plot function
I have a dt: And use pandas function plot to create a barplot object But I want a <matplotlib.figure.Figure object> instead to pass to other function, just like the object type below: So how can I transform <matplotlib.axes.AxesSubplot object> to <matplotlib.figure.Figure object> or directly…
How to split a dataframe string column into two columns?
I have a data frame with one (string) column and I’d like to split it into two (string) columns, with one column header as ‘fips’ and the other ‘row’ My dataframe df looks like this: I do not know how to use df.row.str[:] to achieve my goal of splitting the row cell. I can use df…
python pandas extract unique dates from time series
I have a DataFrame which contains a lot of intraday data, the DataFrame has several days of data, dates are not continuous. How can I extract the unique date in the datetime format from the above DataFrame? To have result like [2012-10-08, 2012-10-10] Answer If you have a Series like: where each object is a T…
How to drop a list of rows from Pandas dataframe?
I have a dataframe df : Then I want to drop rows with certain sequence numbers which indicated in a list, suppose here is [1,2,4], then left: How or what function can do that ? Answer Use DataFrame.drop and pass it a Series of index labels:
How do I Pass a List of Series to a Pandas DataFrame?
I realize Dataframe takes a map of {‘series_name’:Series(data, index)}. However, it automatically sorts that map even if the map is an OrderedDict(). Is there a simple way to pass a list of Series(data, index, name=name) such that the order is preserved and the column names are the series.name? Is…