andy
7bc4dffd8b
Affected files: STEM/AI/Neural Networks/CNN/Examples.md STEM/AI/Neural Networks/CNN/FCN/FCN.md STEM/AI/Neural Networks/CNN/FCN/ResNet.md STEM/AI/Neural Networks/CNN/FCN/Skip Connections.md STEM/AI/Neural Networks/CNN/GAN/DC-GAN.md STEM/AI/Neural Networks/CNN/GAN/GAN.md STEM/AI/Neural Networks/CNN/Interpretation.md STEM/AI/Neural Networks/CNN/UpConv.md STEM/AI/Neural Networks/Deep Learning.md STEM/AI/Neural Networks/MLP/MLP.md STEM/AI/Neural Networks/Properties+Capabilities.md STEM/AI/Neural Networks/SLP/Least Mean Square.md STEM/AI/Neural Networks/SLP/SLP.md STEM/AI/Neural Networks/Transformers/Transformers.md STEM/AI/Properties.md STEM/CS/Language Binding.md STEM/CS/Languages/dotNet.md STEM/Signal Proc/Image/Image Processing.md
16 lines
610 B
Markdown
16 lines
610 B
Markdown
- Output of [conv](../Convolutional%20Layer.md), c, layers are added to inputs of [UpConv](../UpConv.md), d, layers
|
|
- Element-wise, not channel appending
|
|
- Propagate high frequency information to later layers
|
|
- Two types
|
|
- Additive
|
|
- [ResNet](ResNet.md)
|
|
- [Super-Resolution](Super-Resolution.md) auto-encoder
|
|
- Concatenative
|
|
- Densely connected architectures
|
|
- DenseNet
|
|
- [FlowNet](FlowNet.md)
|
|
|
|
![skip-connections](../../../../img/skip-connections.png)
|
|
|
|
[AI Summer - Skip Connections](https://theaisummer.com/skip-connections/)
|
|
[Arxiv - Visualising the Loss Landscape](https://arxiv.org/abs/1712.09913) |