Gradient descent is the backbone of a lot of machine learning algorithms, deep learning included. It is used only during the training, and it is the most computationally expensive part…

The primary function of a feedfoward neural network is to create a prediction of some sorts. The most popular task that is handled by a feedfoward neural network is classification…

In part one of this series, I covered two very basic probability distributions – Bernoulli and multinouli. If you want to find out more about those, or if you wish…

Probability distributions are used in statistics to describe how likely a random variable is to take on each of it’s possible states. Random variables can be discrete and continuous. A…

Linear algebra is a branch of mathematics which deals with solving a system of linear equations. It is widely used throughout science and engineering and it is essential to understanding…

I love this kind of featured images. It makes people think that you are so smart and that you’ve figured out life. They’re hilarious. It it makes the topic of…

Overfitting can be a serious problem in deep learning. Dropout is a technique developed to solve this exact problem. It is one of the biggest advancements in deep learning to…