Using boto3, I can access my AWS S3 bucket: Now, the bucket contains folder first-level, which itself contains several sub-folders named with a timestamp, for instance 1456753904534. I need to know the name of these sub-folders for another job I’m doing and I wonder whether I could have boto3 retrieve t…
Tag: python
Following links in Python
I have to write a program that will read the HTML from this link(http://python-data.dr-chuck.net/known_by_Maira.html), extract the href= values from the anchor tags, scan for a tag that is in a particular position relative to the first name in the list, follow that link and repeat the process a number of time…
python how to pad numpy array with zeros
I want to know how I can pad a 2D numpy array with zeros using python 2.6.6 with numpy version 1.5.0. But these are my limitations. Therefore I cannot use np.pad. For example, I want to pad a with zeros such that its shape matches b. The reason why I want to do this is so I can do: such
How can a string representation of a NumPy array be converted to a NumPy array?
The function numpy.array_repr can be used to create a string representation of a NumPy array. How can a string representation of a NumPy array be converted to a NumPy array? Let’s say the string representation is as follows: How could this be converted to a NumPy array? Answer eval is the easiest, proba…
In Pandas, whats the equivalent of ‘nrows’ from read_csv() to be used in read_excel()?
Want to import only certain range of data from an excel spreadsheet (.xlsm format as it has macros) into a pandas dataframe. Was doing it this way: But it seems that nrows works only with read_csv() ? What would be the equivalent for read_excel()? Answer If you know the number of rows in your Excel sheet, you…
Failure to understand some prime sieve syntax
Could someone walk me line-by line through this prime sieve? I’m attempting to develop my own sieve but most of the faster ones contain syntax that I don’t understand (like the lines i’ve made comments on). Sorry if this is sort of a newbie question — also if you have any links that co…
Module imports and __init__.py
I am trying to understand what the best practices are with regards to Python’s (v2.7) import mechanics. I have a project that has started to grow a bit and lets say my code is organized as follows: The package name is foo and underneath it I have module Foo.py which contains code for the class Foo. Henc…
How to use sklearn fit_transform with pandas and return dataframe instead of numpy array?
I want to apply scaling (using StandardScaler() from sklearn.preprocessing) to a pandas dataframe. The following code returns a numpy array, so I lose all the column names and indeces. This is not what I want. A “solution” I found online is: It appears to work, but leads to a deprecationwarning: /…
How to run only one test in tox?
I’m trying to write a new test for a project and I’d like to test only that one test in tox. I’m already completely sure that other tests are fine, I don’t need them being run every time. The only suggestion I’ve found doesn’t work with Answer As written by jason meridth: B…
How to convert python logging level name to integer code
As of Python 3.2, logging.Logger.setLevel accepts a string level such as ‘INFO’ instead of the corresponding integer constant. This is very handy except that you can’t compare the levels numerically that way and most other logging methods accept integers only. How do I convert a level string…