vdev-ctrl/Adaptive-Learnable-Hierarchical-Routing-
在 GitHub 打开 ↗This repo is a alternative solution for standard self-attention. It uses tree routing with learnable functions for cheaper self-attention while not compromising accuracy.
Star43
24h 新增+1
7 天新增—
Fork4
Issue0
语言Python
项目简介
This repo is a alternative solution for standard self-attention. It uses tree routing with learnable functions for cheaper self-attention while not compromising accuracy.
Star 趋势
话题标签
attention-mechanismdeep-learningefficient-inferenceefficient-transformersllmlong-contextpytorchsparse-attentionsub-quadratic-attentiontransformertree-attention
仓库信息
| License | Apache-2.0 |
| 创建时间 | 2026-10-08 |
| 最后推送 | 24 天前 |
| 热度分 | 3.0 |