Can NVIDIA GeForce RTX 5090 run DeepSeek-R1-Distill-Qwen-14B?

This page was written and translated automatically by AI and checked by software against its sources, with no human editing. Specifications come from the sources listed; memory requirements and speeds are estimates calculated with published formulas. How we use AI

Fits By llama.cpp’s default load check, DeepSeek-R1-Distill-Qwen-14B fits on NVIDIA GeForce RTX 5090 at Q8_0 with a context of 8,192 tokens. One card needs 17.5 GiB available for “Fits”.

At Q8_0, the longest context that fits is 68,608 tokens.

“Fits” means llama.cpp's default --fit load check would place all layers on the GPU: our estimate of llama.cpp's buffers, plus its error margin, plus llama.cpp's 1 GiB per-card reserve, is within the memory counted as available. It does not promise that peak memory while generating fits. How results are decided

Values updated Oct 19, 2026 · Calculator

Run profile: llama.cpp, CUDA back end (NVIDIA discrete GPU), all layers on the GPU, Flash Attention on, micro-batch (-ub) 512, F16 KV cache, context (-c) as shown; “Fits” is judged with llama-server’s default 4 parallel sequences (-np auto, unified KV cache) and “Doesn’t fit” with 1 sequence; idle GPU with no other programs using its memory.

Memory counted as available for “Fits” (C_low): 29.25 GiB per card = 32 GiB nominal − 659 MiB (nominal minus the total that llama.cpp reported for this GPU in public logs) − 2,112 MiB (the largest start-up and runtime use seen in this profile’s public logs), rounded down to a multiple of 64 MiB.

These results apply to the configuration seen in public logs, where llama.cpp reported 32,109 MiB of total memory for this GPU. Settings that reduce usable memory (for example ECC, where the card supports it) are not covered.

Memory used for “Doesn’t fit” (C_high): the full 32 GiB per card. Run profiles and their measurements

Memory needed by quantization and context

Available memory needed for “Fits” (X, GiB per card) and the result on NVIDIA GeForce RTX 5090.
Quantization	4,096	8,192	32,768	131,072
F16	29.5 GiB Tight	30.3 GiB Tight	35.1 GiB Tight	54.3 GiB Doesn't fit
Q8_0	16.7 GiB Fits	17.5 GiB Fits	22.3 GiB Fits	41.4 GiB Doesn't fit
Q6_K	13.4 GiB Fits	14.2 GiB Fits	18.9 GiB Fits	38.1 GiB Doesn't fit
Q5_K_M	11.9 GiB Fits	12.7 GiB Fits	17.5 GiB Fits	36.6 GiB Tight
Q4_K_M	10.5 GiB Fits	11.3 GiB Fits	16.1 GiB Fits	35.2 GiB Tight
Q3_K_M	9.0 GiB Fits	9.8 GiB Fits	14.5 GiB Fits	33.7 GiB Tight
Q2_K	7.5 GiB Fits	8.3 GiB Fits	13.1 GiB Fits	32.2 GiB Tight

How fast can it generate?

At Q8_0, the theoretical ceiling is about 109 tokens per second (1,792 GB/s ÷ 16.48 GB read per token).

The speed ceiling is memory bandwidth divided by the bytes read per generated token. It is a theoretical upper bound; public llama.cpp benchmarks typically reach about half to four-fifths of it, and small models and mixture-of-experts models often less. Public benchmarks

Alternatives

Other 32 GB GPUs where DeepSeek-R1-Distill-Qwen-14B fits

No other GPU with the same memory size fits this model.

Largest model of the same family that fits on NVIDIA GeForce RTX 5090

DeepSeek-R1-Distill-Qwen-32B 32.8B · Q6_K · detailed page

Same family: same publisher and the same model name up to the parameter count.

Sources

Model page, with every quantization and its files: DeepSeek-R1-Distill-Qwen-14B
GPU page, with each specification and its sources: NVIDIA GeForce RTX 5090
Model files on Hugging Face (pinned revisions): deepseek-ai/DeepSeek-R1-Distill-Qwen-14B@1df8507, unsloth/DeepSeek-R1-Distill-Qwen-14B-GGUF@7b05b58
Memory size of NVIDIA GeForce RTX 5090 from: Wikipedia: List of Nvidia graphics processing units (CC BY-SA 4.0), GetDeploying GPU Models (CC BY 4.0)
Methodology