2023-06-05 17:01:29 +01:00
|
|
|
Fully [Convolution](../../../../Signal%20Proc/Convolution.md)al Network
|
2023-05-26 18:52:08 +01:00
|
|
|
|
2023-05-27 23:02:51 +01:00
|
|
|
[[Convolutional Layer|Convolutional]] and [[UpConv|up-convolutional layers]] with [[Activation Functions#ReLu|ReLu]] but no others (pooling)
|
2023-05-26 18:52:08 +01:00
|
|
|
- All some sort of Encoder-Decoder
|
|
|
|
|
2023-06-02 17:17:29 +01:00
|
|
|
Contractive → [UpConv](../UpConv.md)
|
2023-05-26 18:52:08 +01:00
|
|
|
|
2023-05-31 17:33:05 +01:00
|
|
|
# Image Segmentation
|
2023-05-26 18:52:08 +01:00
|
|
|
- For visual output
|
|
|
|
- Previously image $\rightarrow$ vector
|
|
|
|
- Additional layers to up-sample representation to an image
|
2023-06-05 17:01:29 +01:00
|
|
|
- Up-[convolution](../../../../Signal%20Proc/Convolution.md)al
|
|
|
|
- De-[convolution](../../../../Signal%20Proc/Convolution.md)al
|
2023-05-26 18:52:08 +01:00
|
|
|
|
2023-06-05 17:01:29 +01:00
|
|
|
![fcn-uses](../../../../img/fcn-uses.png)
|
|
|
|
![fcn-arch](../../../../img/fcn-arch.png)
|
2023-05-26 18:52:08 +01:00
|
|
|
|
|
|
|
# Training
|
|
|
|
- Rarely from scratch
|
|
|
|
- Pre-trained weights
|
|
|
|
- Replace final layers
|
2023-05-27 00:50:46 +01:00
|
|
|
- [[MLP|FC]] layers
|
2023-05-26 18:52:08 +01:00
|
|
|
- White-noise initialised
|
2023-06-05 17:01:29 +01:00
|
|
|
- Add [UpConv](../UpConv.md) layer(s)
|
2023-05-26 18:52:08 +01:00
|
|
|
- Fine-tune train
|
|
|
|
- Freeze others
|
|
|
|
- Annotated GT images
|
2023-05-27 00:50:46 +01:00
|
|
|
- Can use summed per-pixel log [[Deep Learning#Loss Function|loss]]
|
2023-05-26 18:52:08 +01:00
|
|
|
|
|
|
|
# Evaluation
|
2023-06-02 17:17:29 +01:00
|
|
|
![fcn-eval](../../../../img/fcn-eval.png)
|
2023-05-26 18:52:08 +01:00
|
|
|
- SDS
|
|
|
|
- Classical method
|
|
|
|
- 52% mAP
|
|
|
|
- FCN
|
|
|
|
- 62% mAP
|
|
|
|
- Intersection over Union
|
|
|
|
- IOU
|
|
|
|
- Jaccard
|
|
|
|
- Averaged over all images
|
|
|
|
- $J(A,B)=\frac{|A\cap B|}{|A\cup B|}$
|