16 GB
Discrete NVIDIA GPU memory · e.g. RTX 5070 Ti
Used in our local workflow
Qwen3.5 9B
qwen3.5:9b · Q4_K_M · roughly 6.6 GB download including vision projector
A comfortable starting workload
- Draft emails, summarise short documents and extract structured notes locally.
- Routine agent checks, scheduled automation and small code explanations.
- One local assistant alongside normal desktop applications, with a modest context window.
Aim to keep inference entirely on the GPU; system RAM does not count towards this 16 GB budget. Long context or another GPU-heavy application can use the remaining VRAM.