I am confused about using huggingface BERT models and about how to make them yield a prediction at a fixed shape, regardless of input size (i.e., input string length). I tried to call the tokenizer with the parameters padding=True, truncation=True, max_length = 15, but the prediction output dimensions for inp…
Tag: pytorch
Why tensor size was not changed?
I made the toy CNN model. Then, I had checked model.summary via this code And I was able to get the following results: I want to reduce model size cuz i wanna increase the batch size. So, I had changed torch.float32 -> torch.float16 via NVIDIA/apex As a result, torch.dtype was changed torch.float16 from to…
How to infer the shape of the output when connecting convolution layer with dense layers?
I am trying to construct a Convolutional Neural Network using pytorch and can not understand how to interpret the input neurons for the first densely connected layer. Say, for example, I have the following architecture: Here X would be the number of neurons in the first linear layer. So, do I need to keep tra…
Cannot install the gpu version of torch and torchvision in poetry due to a dependency problem
I am trying to create a virtual environment for machine learning using poetry. So, I am using pytorch as a framework for deep learning. I will extract the relevant part of my pyproject.toml. Since pytroch uses the GPU, you need to install it by specifying the whl file. If you install it this way, the version …
How to avoid two variables refering to the same data? #Pytorch
During initializing, I tried to reduce the repeats in my code, so instead of: I wrote: However, I find that the second method is wrong. If I assign the data to variables h,c, any change on h would also be applied to c results of the test above: Is there a more elegent way to initialize two indenpendent variab…
Receiving Infinity Infinity in LineString
I am try get linestring so I can measure the distance and time. Here in this linestring I am getting nan distance and time. Also, pleased to hear any of your suggestion on my code or logic. Thanks data: Code: Output: Answer Probably, previous pyproj EPSG was switching the opposite interpretation. So I change …
How to test a trained model saved in .pth.tar files?
I am working with CORnet-Z and I am building a separate test file. The model seems to be saved as .pth.tar files What would be the best approach to load this model and run evaluation and testing? Answer To test a model you need to load the state dictionary of your trained model and optimizer (if applicable). …
Is there a way to use torch.nn.DataParallel with CPU?
I’m trying to change some PyTorch code so that it can run on the CPU. The model was trained with torch.nn.DataParallel() so when I load the pre-trained model and try using it I must use nn.DataParallel() which I am currently doing like this: However after I switched my torch device to cpu like this: I g…
How to efficiently draw a plot of a torch.nn model?
I’m exploring neural networks, and I want to model some pictures with neural network. Picture is a function that maps pixel coordinates to color, so I make my network also with 2 input variables (x, y) and 1 (shade) to 3 (R, G, B) output coordinates. For example, like this: Now, I plot it like this: But…
Whats the purpose of torch.positive?
From the documentation: torch.positive(input) → Tensor Returns input. Throws a runtime error if input is a bool tensor. It just returns the input and throws error if its a bool tensor, but that’s not an efficient nor readable way of checking if a tensor is bool. Answer It seems like pytorch added pytorc…