I'm amazed - local 16G runs Qwen38-27B-UD-IQ3_XXS

16G VRAM · 96K Context · 90 token/s —— Qwen3.8-27B Local Deployment Real-time Recording

Claimed to be a quantized IQ3 model benchmarked against full-blooded BF16, Qwen3.8-27B-GSQ-RCO-GGUF

Running a 27B large model on 16GB VRAM? Qwen3.8-27B local test: 40T/s, this time it's truly legendary!

DeepSeek V4.1 generation speed

amd yes! Using the 7900xtx to push qwen3.8-27b to 97t/s! 256K context with vision!

If you only have a 16GB graphics card and want to barely run the Qwen3.8-27B quantized model locally, you can try the quantized version from ISTA-DASLab's GSQ-RCO.

Local model Qwen3.8 (choose 27B or flash-next-strata)

V100 running Qwen3.8 27B Qianwen nvfp4 with speed over 50 tokens, about half the speed of Pro 6000d. In the current environment of soaring graphics card prices, it is probably the most cost-effective AI operation graphics card.

Local deployment of qwen3.8-27b-gsq is amazing. I recommend it to AI enthusiasts.

Running the qwen-3.8-27B-IQ4 model on a 16GB VRAM graphics card, with MTP and vision enabled, reaching a speed of 50 tokens per second

Exploring the potential of 16GB graphics cards, a summary of local deployment of qwen3.8 27b

For local deployment of Qwen 3.8 27B, what configuration should be used

Share my invention of new technology: Expert Custom Edition, qwen3.8-flush-next-W4A16-Modular, aggregated 2000/s, single stream 110/s

2080ti, Strata local deployment Qwen3.8 Flash Next! Very awesome! Very powerful! Very big pitfall!

The ultimate thousand-question deployment plan for ordinary graphics cards = kvmem + bonsai27b

Please choose your quantization! Qwen3.8 27B Q8XL Q6XL Q5XL Q4XL IQ4XL YMQM YMQCFGM XLGSQRCO-IQ3S Test them one by one!

16G GPU runs Qwen3.8 27B smoothly! 80K+ context without losing intelligence: Qwen3.8 27B community modded version hits the charts!

I was fooled again by the Bonsai-2-27B model. I thought it was based on Qwen3.8-27B, with a context window of up to 262K, could see images, and call tools. The officials claimed it retained 98.2% of the original intelligence.

Hidden properties of integrated graphics: can actually accelerate games, and even double AI speed? 16G VRAM Qwen3.8-27B-IQ4_XS 38K context 22t/s -> 47t/s