2023-12-22 16:39:03 +00:00
---
tags:
- ai
- media
---
2023-06-05 17:01:29 +01:00
Fully [Convolution ](../../../../Signal%20Proc/Convolution.md )al Network
2023-05-26 18:52:08 +01:00
2023-06-06 11:48:49 +01:00
[Convolutional ](../Convolutional%20Layer.md ) and [up-convolutional layers ](../UpConv.md ) with [ReLu ](../../Activation%20Functions.md#ReLu ) but no others (pooling)
2023-05-26 18:52:08 +01:00
- All some sort of Encoder-Decoder
2023-06-02 17:17:29 +01:00
Contractive → [UpConv ](../UpConv.md )
2023-05-26 18:52:08 +01:00
2023-05-31 17:33:05 +01:00
# Image Segmentation
2023-05-26 18:52:08 +01:00
- For visual output
- Previously image $\rightarrow$ vector
- Additional layers to up-sample representation to an image
2023-06-05 17:01:29 +01:00
- Up-[convolution](../../../../Signal%20Proc/Convolution.md)al
- De-[convolution](../../../../Signal%20Proc/Convolution.md)al
2023-05-26 18:52:08 +01:00
2023-06-05 17:01:29 +01:00
![fcn-uses ](../../../../img/fcn-uses.png )
![fcn-arch ](../../../../img/fcn-arch.png )
2023-05-26 18:52:08 +01:00
# Training
- Rarely from scratch
- Pre-trained weights
- Replace final layers
2023-06-06 11:48:49 +01:00
- [FC ](../../MLP/MLP.md ) layers
2023-05-26 18:52:08 +01:00
- White-noise initialised
2023-06-05 17:01:29 +01:00
- Add [UpConv ](../UpConv.md ) layer(s)
2023-05-26 18:52:08 +01:00
- Fine-tune train
- Freeze others
- Annotated GT images
2023-06-06 11:48:49 +01:00
- Can use summed per-pixel log [loss ](../../Deep%20Learning.md#Loss%20Function )
2023-05-26 18:52:08 +01:00
# Evaluation
2023-06-02 17:17:29 +01:00
![fcn-eval ](../../../../img/fcn-eval.png )
2023-05-26 18:52:08 +01:00
- SDS
- Classical method
- 52% mAP
- FCN
- 62% mAP
- Intersection over Union
- IOU
- Jaccard
- Averaged over all images
- $J(A,B)=\frac{|A\cap B|}{|A\cup B|}$