Model size:
- 1B parameters:--classification
- Pattern matching and basic knowledge of the world.
- 10B parameters:-- chatbot
- Greater world knowledge. Can follow basic instructions, but just knows more esoteric facts about the world.
- especially if you were to fine-tune it to become better at the types of specific instructions you wanted to follow
- 100B+ parameters: -- brainstorming partner
- Rich world knowledge. Complex reasoning.
- know a lot of things about physics, philosophy, history, science, and so on,
Closed or open source?
- Closed-source models
- Cloud programming interface
- Easy to use in applications
- More large/powerful models
- Relatively inexpensive
- Some risk of vendor lock-in
- Open-source models
- Full control over the model
- Can run on your own device(on perm, PC, etc.)
- Full control over data privacy/access