andy
1c441487f9
Affected files: .obsidian/workspace-mobile.json .obsidian/workspace.json Lab/Scratch Domain.md Money/Econ.md STEM/AI/Classification/Classification.md STEM/AI/Classification/README.md STEM/AI/Classification/Supervised.md STEM/AI/Neural Networks/CNN/Examples.md STEM/AI/Neural Networks/CNN/FCN/FCN.md STEM/AI/Neural Networks/CNN/FCN/FlowNet.md STEM/AI/Neural Networks/CV/Filters.md STEM/img/coordinate-change.png STEM/img/gaussian-class.png Tattoo/Engineering.md Want.md
43 lines
925 B
Markdown
43 lines
925 B
Markdown
# LeNet
|
|
- 1990's
|
|
|
|
- 1989
|
|
|
|
- 1998
|
|
|
|
# AlexNet
|
|
2012
|
|
|
|
- [[Activation Functions#ReLu|ReLu]]
|
|
- Normalisation
|
|
|
|
|
|
|
|
# VGG
|
|
2015
|
|
|
|
- 16 layers over AlexNet's 8
|
|
- Looking at vanishing gradient problem
|
|
- Xavier
|
|
- Similar kernel size throughout
|
|
- Gradual filter increase
|
|
|
|
|
|
|
|
|
|
# GoogLeNet
|
|
2015
|
|
|
|
- [[Inception Layer]]s
|
|
- Multiple [[Deep Learning#Loss Function|Loss]] Functions
|
|
|
|
|
|
|
|
## [Inception Layer](Inception%20Layer.md)
|
|
|
|
## Auxiliary [[Deep Learning#Loss Function|Loss]] Functions
|
|
- Two other SoftMax blocks
|
|
- Help train really deep network
|
|
- Vanishing gradient problem
|
|
|
|
 |