VRAM is GPU memory. A model needs room for weights, context and computation.
Requirements are not fixed; parameters, quantization, context length and software all matter. Check the chosen model’s requirements.
Want to apply what you read?
Projects ↗Hardware
What is VRAM for local AI?
A simple guide to model size and graphics memory.