Now, because the activations are a function of the weight matrices of the previous two layers (which are changing a lot b/c gradient descent), the distribution of those activations can vary a lot as ...
This project is a deep dive into the mathematical and algorithmic foundations of Deep Learning. It demonstrates how to build a fully functional Deep Neural Network (DNN) from the ground up using only ...