andy
7bc4dffd8b
Affected files: STEM/AI/Neural Networks/CNN/Examples.md STEM/AI/Neural Networks/CNN/FCN/FCN.md STEM/AI/Neural Networks/CNN/FCN/ResNet.md STEM/AI/Neural Networks/CNN/FCN/Skip Connections.md STEM/AI/Neural Networks/CNN/GAN/DC-GAN.md STEM/AI/Neural Networks/CNN/GAN/GAN.md STEM/AI/Neural Networks/CNN/Interpretation.md STEM/AI/Neural Networks/CNN/UpConv.md STEM/AI/Neural Networks/Deep Learning.md STEM/AI/Neural Networks/MLP/MLP.md STEM/AI/Neural Networks/Properties+Capabilities.md STEM/AI/Neural Networks/SLP/Least Mean Square.md STEM/AI/Neural Networks/SLP/SLP.md STEM/AI/Neural Networks/Transformers/Transformers.md STEM/AI/Properties.md STEM/CS/Language Binding.md STEM/CS/Languages/dotNet.md STEM/Signal Proc/Image/Image Processing.md
31 lines
1.0 KiB
Markdown
31 lines
1.0 KiB
Markdown
# Fully [Convolution](../../../../Signal%20Proc/Convolution.md)al
|
|
- Remove [Max Pooling](../Max%20Pooling.md)
|
|
- Use strided [UpConv](../UpConv.md)
|
|
- Remove [FC](../../MLP/MLP.md) layers
|
|
- Hurts convergence in non-classification
|
|
- Normalisation tricks
|
|
- Batch normalisation
|
|
- Batches of 0 mean and variance 1
|
|
- Leaky [ReLu](../../Activation%20Functions.md#ReLu)
|
|
|
|
# Stages
|
|
## Generator, G
|
|
- Synthesise 'fake' images
|
|
- From noise
|
|
## Discriminator, D
|
|
- Discriminator is a classifier
|
|
- Is image fake or real
|
|
|
|
![gan-arch](../../../../img/gan-arch.png)
|
|
![gan-arch2](../../../../img/gan-arch2.png)
|
|
|
|
![gan-results](../../../../img/gan-results.png)]
|
|
|
|
# Training
|
|
![gan-training-discriminator](../../../../img/gan-training-discriminator.png)
|
|
![gan-training-generator](../../../../img/gan-training-generator.png)
|
|
|
|
# Code Vector Math for Control
|
|
![cvmfc](../../../../img/cvmfc.png)
|
|
- Do [AM](../Interpretation.md#Activation%20Maximisation) to derive code for an image
|
|
![code-vector-math-for-control-results](../../../../img/code-vector-math-for-control-results.png) |