AI Hashrate Which GPU for local LLMs?

Updated: 2026-07-16 19:19:41 · 30 models · 25 GPUs · 25 measured anchors

Tell us your budget — we’ll suggest GPUs that can run local models.

Use feel labels to shop — tok/s is a rough estimate. List $ is MSRP only; Amazon price is whatever you see after click. We prefer picks with a real product-page Buy link. MoE speed estimates can look optimistically high.

Default view: consumer GPUs only · Q4 quant · 8K context. How estimates work

I already know my GPU or model (advanced)

I have this GPU — what can I run?

I want this model — which GPU?

Quant Context Aim for smooth chat (~30+ tok/s est.) · fit includes context memory
Show Hides datacenter cards (H100, etc.)

Full comparison table

Hidden by default so you can decide from the picks above. Open only if you want every model × GPU cell.

Loading data…
Copied