AkiYangDev/mini-deepinfer
在 GitHub 打开 ↗Learn DeepInfer through a small, runnable inference engine. Follow the code on CPU, then run real Qwen3.5 models on Ascend 910C.
Star30
24h 新增—
7 天新增—
Fork1
Issue0
语言Python
项目简介
Learn DeepInfer through a small, runnable inference engine. Follow the code on CPU, then run real Qwen3.5 models on Ascend 910C.
Star 趋势
话题标签
ascendascend-910ccontinuous-batchingdeepinferdeepseekeducationalinference-enginekv-cachellm-inferencepytorchqwen3-5speculative-decoding
仓库信息
| License | Apache-2.0 |
| 创建时间 | 2026-10-20 |
| 最后推送 | 10 天前 |
| 热度分 | 0.0 |