• Upload

终极千问部署方案=ninfer+kvmem 首发!

132.7K
119
2026-10-03 01:00:35
Personal opinion, for reference only
6824
5237
10.4K
2137
GitHub (source code + engine files): https://github.com/1314521gjy/ninfer-fusion-kvmem ModelScope (source code only): https://modelscope.cn/models/shensanshu/ninfer-master-shensanshu-kvmem RTX 40-series graphics cards: https://pan.quark.cn/s/d5eb3e517690 RTX 30-series graphics cards: https://pan.quark.cn/s/934f1abb9376 RTX 50-series graphics cards: https://pan.quark.cn/s/47f7fc2cc439 Model pack: https://pan.quark.cn/s/ab6718583f2f Happy National Day, give it to AI, don't mess with it yourself, be good~
554K views
Description
Dense 27b achieves MoE speed: is it that hard?
09:19
Local Qianwen Three-Level Tuning: Faster, Smaller, Stronger.
12:54
The ultimate thousand-question deployment plan for ordinary graphics cards = kvmem + bonsai27b
10:58
Token freedom = bonsai27b + ninfer runs smoothly on 8GB GPU
17:37
终极千问部署方案=ninfer+kvmem 首发!
10:11
Llama at 5x speed: NVIDIA's open-source large model Nemotron's dedicated engine
04:47
Customer Service
Top
赛事库 课堂 2021拜年纪