andy
25f73797e3
Affected files: .obsidian/graph.json .obsidian/workspace.json STEM/AI/Neural Networks/Activation Functions.md STEM/AI/Neural Networks/CNN/CNN.md STEM/AI/Neural Networks/CNN/FCN/FCN.md STEM/AI/Neural Networks/CNN/FCN/FlowNet.md STEM/AI/Neural Networks/CNN/FCN/Highway Networks.md STEM/AI/Neural Networks/CNN/FCN/ResNet.md STEM/AI/Neural Networks/CNN/FCN/Skip Connections.md STEM/AI/Neural Networks/CNN/GAN/DC-GAN.md STEM/AI/Neural Networks/CNN/GAN/GAN.md STEM/AI/Neural Networks/CNN/UpConv.md STEM/img/highway-vs-residual.png STEM/img/imagenet-error.png STEM/img/resnet-arch.png STEM/img/resnet-arch2.png STEM/img/skip-connections 1.png STEM/img/upconv-matrix-result.png STEM/img/upconv-matrix-transposed-result.png STEM/img/upconv-matrix.png STEM/img/upconv-transposed-matrix.png STEM/img/upconv.png
16 lines
530 B
Markdown
16 lines
530 B
Markdown
- Output of [[Convolutional Layer|conv]], c, layers are added to inputs of [[upconv]], d, layers
|
|
- Element-wise, not channel appending
|
|
- Propagate high frequency information to later layers
|
|
- Two types
|
|
- Additive
|
|
- [[ResNet]]
|
|
- [[Super-resolution]] auto-encoder
|
|
- Concatenative
|
|
- Densely connected architectures
|
|
- DenseNet
|
|
- [[FlowNet]]
|
|
|
|
![[STEM/img/skip-connections.png]]
|
|
|
|
[AI Summer - Skip Connections](https://theaisummer.com/skip-connections/)
|
|
[Arxiv - Visualising the Loss Landscape](https://arxiv.org/abs/1712.09913) |