Andy Pack
efa7a84a8b
Affected files: .obsidian/graph.json .obsidian/workspace-mobile.json .obsidian/workspace.json Languages/Spanish/Spanish.md STEM/AI/Classification/Classification.md STEM/AI/Classification/Decision Trees.md STEM/AI/Classification/Logistic Regression.md STEM/AI/Classification/Random Forest.md STEM/AI/Classification/Supervised/SVM.md STEM/AI/Classification/Supervised/Supervised.md STEM/AI/Neural Networks/Activation Functions.md STEM/AI/Neural Networks/CNN/CNN.md STEM/AI/Neural Networks/CNN/GAN/DC-GAN.md STEM/AI/Neural Networks/CNN/GAN/GAN.md STEM/AI/Neural Networks/Deep Learning.md STEM/AI/Neural Networks/Properties+Capabilities.md STEM/AI/Neural Networks/SLP/Perceptron Convergence.md
54 lines
2.0 KiB
Markdown
54 lines
2.0 KiB
Markdown
---
|
|
tags:
|
|
- ai
|
|
---
|
|
|
|
#classification
|
|
|
|
OCR [Classification](../Classification/Classification.md)
|
|
|
|
# Loss Function
|
|
Objective Function
|
|
|
|
- [Back-Propagation](MLP/Back-Propagation.md)
|
|
- Difference between predicted and target outputs
|
|
|
|
|
|
- Test accuracy worse than train accuracy = overfitting
|
|
- [Dense](MLP/MLP.md) = [fully connected](MLP/MLP.md)
|
|
- Automates feature engineering
|
|
|
|
|
|
|
|
These are the two essential characteristics of how deep learning learns from data: the incremental, layer-by-layer way in which increasingly complex representations are developed, and the fact that these intermediate incremental representations are learned jointly, each layer being updated to follow both the representational needs of the layer above and the needs of the layer below. Together, these two properties have made deep learning vastly more successful than previous approaches to machine learning.
|
|
|
|
# Steps
|
|
Structure defining
|
|
Compilation
|
|
- Loss function
|
|
- Metric of difference between output and target
|
|
- Optimiser
|
|
- How network will update
|
|
- Metrics to monitor
|
|
- Testing and training
|
|
Data preprocess
|
|
- Reshape input frame into linear array
|
|
- Categorically encode labels
|
|
Fit
|
|
Predict
|
|
Evaluate
|
|
|
|
# Data Structure
|
|
- [Tensor](../../Maths/Tensor.md) flow = channels last
|
|
- (samples, height, width, channels)
|
|
- Vector data
|
|
- 2D [tensors](../../Maths/Tensor.md) of shape (samples, features)
|
|
- Time series data or sequence data
|
|
- 3D [tensors](../../Maths/Tensor.md) of shape (samples, timesteps, features)
|
|
- Images
|
|
- 4D [tensors](../../Maths/Tensor.md) of shape (samples, height, width, channels) or (samples, channels, height, Width)
|
|
- Video
|
|
- 5D [tensors](../../Maths/Tensor.md) of shape (samples, frames, height, width, channels) or (samples, frames, channels , height, width)
|
|
|
|
|
|
 |