Reels · 58 of 60
1:11
Reel · 1:11
Does Qwen3.8-27B fit in 16 GB of VRAM? I measured it, and found out my own benchmark was lying
Narrated: the 16.5 GB file does not fit a 16 GB card; the excess spills to the CPU and spills more with every jump in context (25, 29 and 34 %, from 28.9 to 23.7 tokens/s), and in the end it was the benchmark that had the wrong answer.
- Length
- 1:11
- Published
This reel sums up Does Qwen3.8-27B fit in 16 GB of VRAM? I measured it, and found out my own benchmark was lying, where the method, the tables and what did not work are.