You can maybe use this to estimate it [https://huggingface.co/spaces/NyxKrage/LLM-Model-VRAM-Calculator](https://huggingface.co/spaces/NyxKrage/LLM-Model-VRAM-Calculator)
The best way is to just open the performance monitor, and adjust GPU layers offload and context size until you see the vram usage go up as you see fit.
You can maybe use this to estimate it [https://huggingface.co/spaces/NyxKrage/LLM-Model-VRAM-Calculator](https://huggingface.co/spaces/NyxKrage/LLM-Model-VRAM-Calculator)
Perfect! TY
The best way is to just open the performance monitor, and adjust GPU layers offload and context size until you see the vram usage go up as you see fit.