17°

Reels · 58 of 60

1:11

Reel · 1:11

Does Qwen3.8-27B fit in 16 GB of VRAM? I measured it, and found out my own benchmark was lying

Narrated: the 16.5 GB file does not fit a 16 GB card; the excess spills to the CPU and spills more with every jump in context (25, 29 and 34 %, from 28.9 to 23.7 tokens/s), and in the end it was the benchmark that had the wrong answer.

Length
1:11
Published

ModelosGPUBenchmarks

This reel sums up Does Qwen3.8-27B fit in 16 GB of VRAM? I measured it, and found out my own benchmark was lying, where the method, the tables and what did not work are.

Read the articleOpen in the viewer