sarsoo/stem

andy b30da1d29c vault backup: 2023-06-01 08:11:37

Affected files:
.obsidian/graph.json
.obsidian/workspace.json
Money/Assets/Derivative.md
STEM/AI/Neural Networks/CNN/Examples.md
STEM/AI/Neural Networks/Deep Learning.md
STEM/AI/Neural Networks/MLP/Decision Boundary.md
STEM/CS/Languages/dotNet.md
STEM/Semiconductors/Equations.md
Tattoo/Engineering.md

2023-06-01 08:11:37 +01:00

905 B

Raw Blame History

LeNet

1990's
1989
1998

AlexNet

2012

Activation Functions#ReLu
Normalisation

VGG

2015

16 layers over AlexNet's 8
Looking at vanishing gradient problem
- Xavier
Similar kernel size throughout
Gradual filter increase

GoogLeNet

2015

Inception Layers
Multiple Deep Learning#Loss Function Functions

Inception Layer

Auxiliary Deep Learning#Loss Function Functions

Two other SoftMax blocks
Help train really deep network
- Vanishing gradient problem