GitHub 热门

Incept5-AI/inferd

在 GitHub 打开 ↗

Native Apple Silicon inference engine for many AI agents at once: C++/Metal, agent-contexts API, 8-bit paged KV, SSD tier (Qwen3.8)

Star21
24h 新增—
7 天新增—
Fork0
Issue0
语言Python

项目简介

Native Apple Silicon inference engine for many AI agents at once: C++/Metal, agent-contexts API, 8-bit paged KV, SSD tier (Qwen3.8)

Star 趋势

记录 5 个数据点 · 期间无变化

话题标签

agentsapple-siliconllm-inferencemetalmlxqwen

仓库信息

LicenseApache-2.0
创建时间2026-11-03
最后推送1 天前
热度分0.0