2023-05-26 06:37:13 +01:00
|
|
|
# Properties
|
|
|
|
## Pre-training Datasets
|
|
|
|
|
|
|
|
## Scaling Laws
|
|
|
|
|
|
|
|
## Emergent Abilities
|
|
|
|
|
|
|
|
## Hallucination
|
|
|
|
|
|
|
|
# Architectures
|
2023-06-05 17:01:29 +01:00
|
|
|
Mostly [Transformers](Transformers.md)
|
2023-05-26 06:37:13 +01:00
|
|
|
|
|
|
|
## GPT
|
2023-06-05 17:01:29 +01:00
|
|
|
Generative Pre-trained [Transformers](Transformers.md)
|
2023-05-26 06:37:13 +01:00
|
|
|
|
2023-06-05 17:01:29 +01:00
|
|
|
![llm-family-tree](../../../img/llm-family-tree.png)
|