Softmax
- This algorithm ensures that weights are non-negative,
- and that they sum up to 1.
- It's a normalization algorithm
Dot Product
From: https://en.wikipedia.org/wiki/Dot_product
dot product is a measure of similarity of two vectors. It is a single number.