Strata Update Again! IQ3S-QWEN-Flash-Next Quick Case Test Demo
Local model Qwen3.8 (choose 27B or flash-next-strata)
Local deployment of Qwen3.8-Flash-Next-Q4_K_M with 12+64, supporting 1M context
The most open version is here! Qwen3.8-Flash-Next Strata Edition AI Large Language Model Local Deployment Tutorial｜MTP Acceleration, Works on 8GB Graphics Card
Qwen3.8-27b (Q5_K_XL/Q4_K_M) vs v4flash vs v4Pro
［ninfer v100X2］v100 achieves new glories! qwen3.8 27b nvfp4 2000t/s prefill, 115t/s decode
V100 Duo! Two V100s running NInfer NVFP4, 27B model breaks 110 tokens/s?
2080ti, Strata local deployment Qwen3.8 Flash Next! Very awesome! Very powerful! Very big pitfall!
Unbelievable, Qwen3.6 27B generation speed soared to 184t/s, how did I do it?
qwen3.8-flash-next-iq3_s is no longer just a toy; it's truly within reach for those on a budget. Under 10,000 yuan, it's the closest thing to a production-ready local model.
[Most Comprehensive Test] Deploying Qwen3.8 27B nvfp4 on V100 with vLLM + dFlash2: Decode speed improved by 3x, Prefill speed improved by 15x
39.5 Tokens per second! Qianwen 3.8 27B 2080Ti 22B single-card local deployment speedup.
Four major Flash model tests: GLM-5.3-flash | Qwen3.8-flash | DeepSeek-V4-Flash | Gemini3.7-flash
V100 unlocked NVFP4, GLM5.3F insane output 145 toks
V100 running Qwen3.8 27B Qianwen nvfp4 with speed over 50 tokens, about half the speed of Pro 6000d. In the current environment of soaring graphics card prices, it is probably the most cost-effective AI operation graphics card.
Qwen3.8 27B NVFP4 V100 outrageous output 280token/s
Please choose your quantization! Qwen3.8 27B Q8XL Q6XL Q5XL Q4XL IQ4XL YMQM YMQCFGM XLGSQRCO-IQ3S Test them one by one!
The effect of dual 5060 Ti running Qwen3.8 27b
QWEN3.8 FLASH NEXT GSQ RCO IQ3XXS small test
Strata qwen3.8flash next truly a god-tier project! 512K ultra-long context for local deployment
