What is Weights?

The specific values of model parameters, continuously adjusted during training. Open-source models (like Llama) publish weights for download, while closed-source models (like GPT-4) keep weights as trade secrets. Weight files are the model’s ‘brain’, typically tens of GBs.