spinfinc/spinf-serve
在 GitHub 打开 ↗Bulk classification and decision inference on one GPU: the content is read once, every question about it is scored in the same pass. OpenAI-compatible, Apache 2.0
Star21
24h 新增—
7 天新增—
Fork0
Issue0
语言Python
项目简介
Bulk classification and decision inference on one GPU: the content is read once, every question about it is scored in the same pass. OpenAI-compatible, Apache 2.0
Star 趋势
话题标签
batch-inferenceclassificationcontent-moderationdecision-modelextractionfp8gemmainference-enginellmopenai-compatiblescoringself-hostedtext-classification
仓库信息
| License | Apache-2.0 |
| 创建时间 | 2026-10-25 |
| 最后推送 | 7 天前 |
| 热度分 | 0.0 |