What is Foundation Model?

Large AI models pre-trained on massive datasets that can be adapted to various downstream tasks through fine-tuning. GPT-4, Claude, and Llama are all foundation models. Think of them as generalists who ’learned a bit of everything’ and become specialists through fine-tuning or prompting.