lucia-huang7/sglang-runtime-opt

Host-side scheduler and transfer-path optimization in SGLang on H100 with C++ descriptors, Triton and pinned memory

Star26

24h 新增—

7 天新增—

Fork4

Issue0

语言Python

项目简介

Host-side scheduler and transfer-path optimization in SGLang on H100 with C++ descriptors, Triton and pinned memory

记录 4 个数据点 · 期间无变化

cudah100kv-cachellm-inferencellm-servingpytorchsglangspeculative-decodingtriton