andy
33ac3007bc
Affected files: .obsidian/graph.json .obsidian/workspace-mobile.json .obsidian/workspace.json STEM/AI/Neural Networks/Activation Functions.md STEM/AI/Neural Networks/CNN/FCN/FlowNet.md STEM/AI/Neural Networks/CNN/FCN/ResNet.md STEM/AI/Neural Networks/CNN/FCN/Skip Connections.md STEM/AI/Neural Networks/CNN/GAN/DC-GAN.md STEM/AI/Neural Networks/CNN/GAN/GAN.md STEM/AI/Neural Networks/CNN/Interpretation.md STEM/AI/Neural Networks/Deep Learning.md STEM/AI/Neural Networks/MLP/Back-Propagation.md STEM/AI/Neural Networks/MLP/MLP.md STEM/AI/Neural Networks/Transformers/Attention.md STEM/CS/ABI.md STEM/CS/Calling Conventions.md STEM/CS/Code Types.md STEM/CS/Language Binding.md STEM/img/am-regulariser.png STEM/img/skip-connections.png
16 lines
486 B
Markdown
16 lines
486 B
Markdown
- Output of conv, c, layers are added to inputs of upconv, d, layers
|
|
- Element-wise, not channel appending
|
|
- Propagate high frequency information to later layers
|
|
- Two types
|
|
- Additive
|
|
- Resnet
|
|
- Super-resolution auto-encoder
|
|
- Concatenative
|
|
- Densely connected architectures
|
|
- DenseNet
|
|
- FlowNet
|
|
|
|
![[skip-connections.png]]
|
|
|
|
[AI Summer - Skip Connections](https://theaisummer.com/skip-connections/)
|
|
[Arxiv - Visualising the Loss Landscape](https://arxiv.org/abs/1712.09913)aaaaa |