Skip to content
Advertisement

Tag: h5py

Efficiently reading small pieces from multiple h5df files?

I have a hdf5 file every day, which contains compressed data for many assets. Specifically, each h5 file contains 5000 assets, and is organized by key-value structure such as The data of each asset has the same format and size and all together I have around 1000 days of data. Now the task is to do ad-hoc analysis of different

Save a list of dictionaries with numpy arrays

I have a dataset composed as: Each element of the list is a dictionary containing a key “sample” and its value is a numpy array that has shape (2048,3) and the category is the class of that sample. The dataset len is 8000. I tried to save in JSON but it said it can’t serialize numpy arrays. What’s the best

Extracting datasets from 1 HDF5 file to multiple files

I have actually raised a question in generating img from HDF5. Now, another problem I have is to generate the h5 from the existing. For instance, I have a [ABC.h5], inside, there is the dataset for image and its gt_density map. The keys would be [images, density_maps] I want to have [GT_001.h5], [GT_002.h5]… instead of the single h5 file. This

Errors in installing keras using pip?

I am trying to install Keras library using pip in windows 10. I have all the requirements installed, python>=3.8, pip>=20.0.0, NumPy, pandas, matplotlib, virtualenv. But I’m getting the following error. I thought this error was caused due to improper installation of h5py & hdf5. I tried installing them using pip install h5py but then I encountered the following error: Please

How to use HDF5 dimension scales in h5py

HDF5 has the concept of dimension scales, as explained on the HDF5 and h5py websites. However, the explanations both use terse or generic examples and so I don’t really understand how to use dimension scales. Namely, given a dataset f[‘coordinates’] in some HDF5 file f = h5py.File(‘data.h5’): I’d like to make it clear that the first column is the latitude

Advertisement