2023-05-26 18:52:08 +01:00
|
|
|
Fully [[Convolution]]al Network
|
|
|
|
|
2023-05-27 23:02:51 +01:00
|
|
|
[[Convolutional Layer|Convolutional]] and [[UpConv|up-convolutional layers]] with [[Activation Functions#ReLu|ReLu]] but no others (pooling)
|
2023-05-26 18:52:08 +01:00
|
|
|
- All some sort of Encoder-Decoder
|
|
|
|
|
|
|
|
Contractive → [[UpConv]]
|
|
|
|
|
2023-05-31 17:33:05 +01:00
|
|
|
# Image Segmentation
|
2023-05-26 18:52:08 +01:00
|
|
|
- For visual output
|
|
|
|
- Previously image $\rightarrow$ vector
|
|
|
|
- Additional layers to up-sample representation to an image
|
|
|
|
- Up-[[convolution]]al
|
|
|
|
- De-[[convolution]]al
|
|
|
|
|
|
|
|
![[fcn-uses.png]]
|
|
|
|
|
|
|
|
![[fcn-arch.png]]
|
|
|
|
|
|
|
|
# Training
|
|
|
|
- Rarely from scratch
|
|
|
|
- Pre-trained weights
|
|
|
|
- Replace final layers
|
2023-05-27 00:50:46 +01:00
|
|
|
- [[MLP|FC]] layers
|
2023-05-26 18:52:08 +01:00
|
|
|
- White-noise initialised
|
|
|
|
- Add [[upconv]] layer(s)
|
|
|
|
- Fine-tune train
|
|
|
|
- Freeze others
|
|
|
|
- Annotated GT images
|
2023-05-27 00:50:46 +01:00
|
|
|
- Can use summed per-pixel log [[Deep Learning#Loss Function|loss]]
|
2023-05-26 18:52:08 +01:00
|
|
|
|
|
|
|
# Evaluation
|
|
|
|
![[fcn-eval.png]]
|
|
|
|
- SDS
|
|
|
|
- Classical method
|
|
|
|
- 52% mAP
|
|
|
|
- FCN
|
|
|
|
- 62% mAP
|
|
|
|
- Intersection over Union
|
|
|
|
- IOU
|
|
|
|
- Jaccard
|
|
|
|
- Averaged over all images
|
|
|
|
- $J(A,B)=\frac{|A\cap B|}{|A\cup B|}$
|