Tag: training-data

How to split in train and test by month

I have a dataframe structured like this I have data for all days and months from 2018 to 2021, with around 50k observations How can I aggregate all the data for the same month and perform a Train-Test splitting for each month? I.e. for all the data of the months of January, February, March and so on. Answer try this:

Data type preference for training CNN?

I originally was using input data of int8 type ranging from 0-255 before learning that standardizing and normalizing should increase learning speeds and accuracy. I attempted both, with and without a mean of zero, and none of these methods improved learning speed or accuracy for my model relative to 0-255, int8 approach. I’m just wondering whether training with, for example,

How to label multi-word entities?

I’m quite new to data analysis (and Python in general), and I’m currently a bit stuck in my project. For my NLP-task I need to create training data, i.e. find specific entities in sentences and label them. I have multiple csv files containing the entities I am trying to find, many of them consisting of multiple words. I have tokenized

Using Yolox on an asset image doesn’t draw any detection

So I’m trying to learn how to use Yolox for my bachelor thesis, and after hours of installing and updating components, finally managed to run Yolox on a test image in the assets folder. However, when I go to the output folder, it’s the same image there, with no boxes on detected objects and I can’t understand why.. Here is

Training a single model jointly over multiple datasets in tensorflow

I want to train a single variational autoencoder model or even a standard autoencoder over many datasets jointly (e.g. mnist, cifar, svhn, etc. where all the images in the datasets are resized to be …

PyTorch DataLoader shuffle

I did an experiment and I did not get the result I was expecting. For the first part, I am using trainloader = torch.utils.data.DataLoader(trainset, batch_size=128, …

sorting out pictures in training data to train a cnn (alexnet)

i’m training a alexnet with footage from playing an emulated nes game (f1 racer), to further on let it play the game by itself. now while i’m capturing the training data, the background of the game is changing heavily when it comes to gray pixel values (like light yellow to black for the same areas). is there a function (cv2