I have been tasked lately, to ingest JSON responses onto Databricks Delta-lake. I have to hit the REST API endpoint URL 6500 times with different parameters and pull the responses. I have tried two modules, ThreadPool and Pool from the multiprocessing library, to make each execution a little quicker. ThreadPo…
Tag: python
play as many sounds as loop count in python
I want the alarm.play() function to repeat for the number of loops and ring 10 times as in the example, but it just keeps ringing once every time I try or change it. How can I fix this? And does it make more sense to use for instead of while ? Answer just stop the alarm at the end of
Import functions from another directory
I am running a python script (app.py) where I have to use two functions from another script (src.py), located inside another directory. The structure is the following: I am using, in app.py, the following lines: to access to the functions odd_all, even_all declared inside src.py. However, I get the error: Mod…
Replacing NaN values in timeseries Pandas dataframe with mean values
I have a dataframe that has 2 columns, date and values. I want to replace NaN values in the dataframe with mean values, but with specific condition. NaN values should be replaced with mean value of the values from the same period for the year that has that value (+/- 1 day). Value for 2021-02-04 should be: Be…
Use a different fixed type for interfaces defined in the base class for subclasses
I have a BaseList container that takes BaseItem’s as items. I then derive a new list CustomList and I want it to hold CustomItem’s. How to I type methods in BaseList many methods to accept BaseItem. And also tell it to use CustomItem the derived list CustomList? Here is the code I have so far: Que…
I can’t add cookies on python selenium webdriver
I’m trying to enter a page and then add cookies on it, but it returns an error and I don’t know why. I did it exactly like is written on the selenium docs, and here is the code i used: And it returns selenium.common.exceptions.InvalidArgumentException: Message: invalid argument: missing ‘nam…
when subsetting with and without .loc[ ] in python?
I was doing a Python exercises and I got the wrong answer (in red). I’m a bit confused about subsetting with and without loc[ ]. Please enlighten me. Thank you. Answer The df.loc[:, [‘alignment’, ‘character’]] itself is a dataframe. What you’re doing wrong is passing it ins…
Generating new unique uuid4 in Django for each object of Factory class
I have a Model Sector which has a id field (pk) which is UUID4 type. I am trying to populate that table(Sector Model) using faker and factory_boy. But, This is the error I am getting. Is it possible that the error is due to the fact that everytime I am creating SectorFactory objects (which is in a different d…
How to solve local variable error with forloop in django?
Info: I want to get data from context. The context data is coming from for loop function. Problem: I am getting this UnboundLocalError local variable ‘context’ referenced before assignment Answer You should do something like this :
How to improve performance of querying data from Salesforce with Python?
Is there any solution we can retrieve Salesforce data from Python with more than 2000 records for each chunk? I have used REST API to retrieve data and check nextRecordsUrl for the next chunk. But if it is a million records, this solution will take time. I tried to find a Salesforce parameter to increase the …