Tag: datetime

Deleting rows based on time interval in pandas

I have a dataframe with datetime timestamps (every 1 minute). I’d like to increase the time interval between rows to 5 minutes. Basically keep rows 0, 5, 10 etc and remove the rest. How would I do that? Thanks Answer Firstly convert your date column to datetime dtype by using to_datetime() method(If its…

How do I pass a function parameter into a lambda function subsequently

datetime pandas python

I am trying to pass in the timeframe=’month’ parameter into my function. I tried applying with lambda function but it doesn’t seem to work. Any advice on how to apply my timeframe inside? I want to able to extract the day, month or year with a function. Answer you can do that by using the du…

How do I activate a python program at exact whole hours? (12:00:00pm, 04:00:00am)

datetime python time

I want to write a program that keeps running in the background and performs a certain task at each hour of the day. How do I achieve this? Answer for production i would add cron or schedule

Multiple dates in a pandas column

datetime pandas python

I am trying to make the dates in a Pandas DataFrame all of the same format. Currently I have the DataFrame storing the dates in two formats. “6/08/2017 2:15:00 AM” & 2016-01-01T00:05:00 The column name which these dates are stored under is INTERVAL_END. As you can see, one of the dates is a st…

datetime.combine with timezone is different from datetime.now with timezone

datetime python pytz timezone

In the below code: Why are d1 and d2 showing different timezone information? How do I get the same datetime as datetime.now when using datetime.combine? Answer datetime.now effectively converts (localizes) your datetime with the pytz timezone object – from the docs: If tz is not None, it must be an inst…

selecting the row with given datetime index

datetime pandas python

There are 2 datasets I wanna use to find the evaluation score which data_pred , data_test First of all, the data_test is the data that is used to check the accuracy which looks like this the data_pred is got from ARIMA prediction which looks like this The reason I can’t find the MSE score between these…

Creating date range pairs in pandas

date-range datetime pandas python timestamp

I have two datetimes between which I would like to generate regular intervals of 4 hours (excluding the last interval, which can be less than 4 hours if there are less than 4 hours between the previous timestamp and end). I am stuck on interval generation with pandas.date_range, which only returns the end tim…

Autofill datetime in Pandas by previous increment

datetime pandas python time-series

Given previous datetime values in a Pandas DataFrame–either as an index or as values in a column–is there a way to “autofill” remaining time increments based on the previous fixed increments? For example, given: I would like to apply a function to yield: B 2013-01-01 09:00:00 0.0 2013-…

Writing a pydantic object into a sqlalchemy json column

datetime pydantic python sqlalchemy

I’m looking for a way to have a pydantic object stored in a sqlalchemy json column. My attempts so far are being tripped up by a datetime field in the pydantic object. I feel like I’m missing something obvious. My first attempt was to simply serialise the result of .dict(). But this doesn’t …