vault backup: 2023-05-31 17:33:05

Affected files:
.obsidian/graph.json
.obsidian/workspace-mobile.json
.obsidian/workspace.json
Gaming/Steam controllers.md
History/Britain.md
STEM/AI/Neural Networks/CNN/CNN.md
STEM/AI/Neural Networks/CNN/FCN/FCN.md
STEM/AI/Neural Networks/CNN/FCN/ResNet.md
STEM/AI/Neural Networks/CV/Datasets.md
STEM/AI/Neural Networks/Properties+Capabilities.md
STEM/AI/Neural Networks/Transformers/Attention.md
STEM/AI/Properties.md
Tattoo/Engineering.md
Tattoo/Sources.md
Tattoo/img/snake-coil.png
Untitled.canvas
This commit is contained in:
andy 2023-05-31 17:33:05 +01:00
parent 25f73797e3
commit dcc57e2c85
7 changed files with 13 additions and 7 deletions

View File

@ -5,13 +5,13 @@
- Niche - Niche
- No-one cared/knew about CNNs - No-one cared/knew about CNNs
## After ## After
- ImageNet - [[Datasets#ImageNet|ImageNet]]
- 16m images, 1000 classes - 16m images, 1000 classes
- GPUs - GPUs
- General processing GPUs - General processing GPUs
- CUDA - CUDA
- NIPS/ECCV 2012 - NIPS/ECCV 2012
- Double digit % gain on ImageNet accuracy - Double digit % gain on [[Datasets#ImageNet|ImageNet]] accuracy
# Full Connected # Full Connected
[[MLP|Dense]] [[MLP|Dense]]

View File

@ -5,7 +5,7 @@ Fully [[Convolution]]al Network
Contractive → [[UpConv]] Contractive → [[UpConv]]
# Image Sementation # Image Segmentation
- For visual output - For visual output
- Previously image $\rightarrow$ vector - Previously image $\rightarrow$ vector
- Additional layers to up-sample representation to an image - Additional layers to up-sample representation to an image

View File

@ -23,6 +23,7 @@
- Except at end - Except at end
- No dropout - No dropout
[[Datasets#ImageNet|ImageNet]] Error:
![[imagenet-error.png]] ![[imagenet-error.png]]
![[resnet-arch.png]] ![[resnet-arch.png]]

View File

@ -21,3 +21,8 @@
- Truck - Truck
- Achieved 90.7% - Achieved 90.7%
- Wan et al. 2013 - Wan et al. 2013
# ImageNet
- 14 million images
- In at least one million of the images, bounding boxes are also provided
- More than 20,000 categories

View File

@ -45,7 +45,7 @@
- Confidence value - Confidence value
# Contextual Information # Contextual Information
- Knowledge represented by structure and activation weight - [[Neural Networks#Knowledge|Knowledge]] represented by structure and activation weight
- Any neuron can be affected by global activity - Any neuron can be affected by global activity
- Contextual information handled naturally - Contextual information handled naturally

View File

@ -7,7 +7,7 @@
- Hyper-networks - Hyper-networks
- Draw from relevant state at any preceding point along sequence - Draw from relevant state at any preceding point along sequence
- Addresses [[RNN]]s vanishing gradient issues - Addresses [[RNN]]s vanishing gradient issues
- [[LSTM]] tends to poorly preserve far back knowledge - [[LSTM]] tends to poorly preserve far back [[Neural Networks#Knowledge|knowledge]]
- Attention layer access all previous states and weighs according to learned measure of relevance - Attention layer access all previous states and weighs according to learned measure of relevance
- Allows referring arbitrarily far back to relevant tokens - Allows referring arbitrarily far back to relevant tokens
- Can be addd to [[RNN]]s - Can be addd to [[RNN]]s

View File

@ -1,7 +1,7 @@
# Three Key Components # Three Key Components
1. Representation 1. Representation
- Declarative & Procedural knowledge - Declarative & Procedural [[Neural Networks#Knowledge|knowledge]]
- Typically human-readable symbols - Typically human-readable symbols
2. Reasoning 2. Reasoning
- Ability to solve problems - Ability to solve problems