diff --git a/AI/Neural Networks/CNN/CNN.md b/AI/Neural Networks/CNN/CNN.md index 4363bab..05ecc1c 100644 --- a/AI/Neural Networks/CNN/CNN.md +++ b/AI/Neural Networks/CNN/CNN.md @@ -5,13 +5,13 @@ - Niche - No-one cared/knew about CNNs ## After -- ImageNet +- [[Datasets#ImageNet|ImageNet]] - 16m images, 1000 classes - GPUs - General processing GPUs - CUDA - NIPS/ECCV 2012 - - Double digit % gain on ImageNet accuracy + - Double digit % gain on [[Datasets#ImageNet|ImageNet]] accuracy # Full Connected [[MLP|Dense]] diff --git a/AI/Neural Networks/CNN/FCN/FCN.md b/AI/Neural Networks/CNN/FCN/FCN.md index 9715cf8..22ee0f3 100644 --- a/AI/Neural Networks/CNN/FCN/FCN.md +++ b/AI/Neural Networks/CNN/FCN/FCN.md @@ -5,7 +5,7 @@ Fully [[Convolution]]al Network Contractive → [[UpConv]] -# Image Sementation +# Image Segmentation - For visual output - Previously image $\rightarrow$ vector - Additional layers to up-sample representation to an image diff --git a/AI/Neural Networks/CNN/FCN/ResNet.md b/AI/Neural Networks/CNN/FCN/ResNet.md index 2acf9c5..e2617eb 100644 --- a/AI/Neural Networks/CNN/FCN/ResNet.md +++ b/AI/Neural Networks/CNN/FCN/ResNet.md @@ -23,6 +23,7 @@ - Except at end - No dropout +[[Datasets#ImageNet|ImageNet]] Error: ![[imagenet-error.png]] ![[resnet-arch.png]] diff --git a/AI/Neural Networks/CV/Datasets.md b/AI/Neural Networks/CV/Datasets.md index e8fb53f..b0459d0 100644 --- a/AI/Neural Networks/CV/Datasets.md +++ b/AI/Neural Networks/CV/Datasets.md @@ -20,4 +20,9 @@ - Ship - Truck - Achieved 90.7% - - Wan et al. 2013 \ No newline at end of file + - Wan et al. 2013 + +# ImageNet +- 14 million images +- In at least one million of the images, bounding boxes are also provided +- More than 20,000 categories \ No newline at end of file diff --git a/AI/Neural Networks/Properties+Capabilities.md b/AI/Neural Networks/Properties+Capabilities.md index 4d696de..49f8835 100644 --- a/AI/Neural Networks/Properties+Capabilities.md +++ b/AI/Neural Networks/Properties+Capabilities.md @@ -45,7 +45,7 @@ - Confidence value # Contextual Information -- Knowledge represented by structure and activation weight +- [[Neural Networks#Knowledge|Knowledge]] represented by structure and activation weight - Any neuron can be affected by global activity - Contextual information handled naturally diff --git a/AI/Neural Networks/Transformers/Attention.md b/AI/Neural Networks/Transformers/Attention.md index 6cde5c4..f7aeffa 100644 --- a/AI/Neural Networks/Transformers/Attention.md +++ b/AI/Neural Networks/Transformers/Attention.md @@ -7,7 +7,7 @@ - Hyper-networks - Draw from relevant state at any preceding point along sequence - Addresses [[RNN]]s vanishing gradient issues - - [[LSTM]] tends to poorly preserve far back knowledge + - [[LSTM]] tends to poorly preserve far back [[Neural Networks#Knowledge|knowledge]] - Attention layer access all previous states and weighs according to learned measure of relevance - Allows referring arbitrarily far back to relevant tokens - Can be addd to [[RNN]]s diff --git a/AI/Properties.md b/AI/Properties.md index 7e12dff..212f9bc 100644 --- a/AI/Properties.md +++ b/AI/Properties.md @@ -1,7 +1,7 @@ # Three Key Components 1. Representation - - Declarative & Procedural knowledge + - Declarative & Procedural [[Neural Networks#Knowledge|knowledge]] - Typically human-readable symbols 2. Reasoning - Ability to solve problems