[DL] Natural Gradient
Category: deep-learning
Posted: February 01, 2024
The Steepest Descent in Riemannian Space
[DL] Knowledge Distillation
Category: deep-learning
Posted: January 21, 2024
Distilling the Knowledge in a Neural Network
[DL] Transposed Convolution
Category: deep-learning
Posted: July 23, 2023
Convolution for upsampling
[DL] Transformer
Category: deep-learning
Posted: November 16, 2022
Attention is all you need
[DL] Layer Normalization
Category: deep-learning
Posted: November 10, 2022
Attention, Self-Attention, and Multi-head Self-Attention
[DL] Attention Mechanisms
Category: deep-learning
Posted: November 10, 2022
Attention, Self-Attention, and Multi-head Self-Attention
[DL] Seq2Seq
Category: deep-learning
Posted: November 01, 2022
Sequence-to-sequence problem in machine learning
[DL] LSTM & GRU
Category: deep-learning
Posted: November 01, 2022
Gating and long term memory
[DL] Recurrent Neural Network
Category: deep-learning
Posted: October 31, 2022
Neural Networks for Sequences
[DL] Convolutional Neural Network
Category: deep-learning
Posted: October 28, 2022
Neural Networks for Images
[DL] Dropout
Category: deep-learning
Posted: September 22, 2022
Ensemble Learning and Dropout
[DL] Network Initialization
Category: deep-learning
Posted: September 22, 2022
[DL] Batch Normalization
Category: deep-learning
Posted: September 19, 2022
Batch Normalization, one of the most frequently used techniques in training neural networks