Leonccaa/ReVolta
在 GitHub 打开 ↗Stable, high-throughput inference server for multi-GPU NVIDIA V100 (SM70): Qwen3.8 Flash-Next with AWQ / NVFP4, multimodal input, CPU/disk KV offload, and MTP or DFlash2 speculative decoding.
Star38
24h 新增+1
7 天新增—
Fork2
Issue9
语言Python
项目简介
Stable, high-throughput inference server for multi-GPU NVIDIA V100 (SM70): Qwen3.8 Flash-Next with AWQ / NVFP4, multimodal input, CPU/disk KV offload, and MTP or DFlash2 speculative decoding.
Star 趋势
话题标签
awqflash-nextinference-serverkv-cache-offloadingllm-inferencenvfp4nvidia-v100qwenqwen3-8qwen3-8-flash-nextsm70speculative-decodingtesla-v100vllmvolta
仓库信息
| License | Apache-2.0 |
| 创建时间 | 2026-10-20 |
| 最后推送 | 16 小时前 |
| 热度分 | 8.0 |