LLM Memory Calculator

This will estimate if a local LLM fits in your GPU VRAM and system RAM

Enter the model, memory and runtime details to check whether it fits:

Model :
Memory and Offload :
Runtime :

Live Result :

Verdict :

GPU side total :

System side total :

VRAM available :

Usable unified memory :

Headroom :

Max context at full offload :

Recommended GPU layers :

Offload fits in RAM :

Memory breakdown :

ComponentSizeFormula

Warnings :

    All sizes are estimates: weights use effective GGUF bits-per-weight averages, the KV cache covers only the full attention layers, the compute buffer is a runtime-dependent heuristic, and batch size scales the compute buffer only. Hybrid attention models additionally hold a small fixed state per linear attention layer that is not modeled. Gb values are interpreted as binary GiB (1024^3 bytes).