Skip to content
Advertisement

Tag: keras

Keras – Hyper Tuning the initial state of the model

I’ve written an LSTM model that predicts the sequential data. I’ve tuned some of the layer’s params using AWS SageMaker. While validating the model I’ve run a model with a specific configuration several times. Most of the time the results are similar, however, one run was much better than others, which led me to think that the initial state of

How tensorflow initialize weight values in my neural network

i found that by default keras use Glorot/Xavier to initialize weight, this means that the values will be between +- (sqrt(6 / float(F_in + F_out)) But in my case i use the architecture below, with ishape = (None, 4): i don’t use fixed input size. ( My input data is a DNA sequence in one hot encoding) How keras initialize

Advertisement