GitHub 热门

stdlogits/neuron-lens

在 GitHub 打开 ↗

A catalog of every MLP neuron and attention head of Qwen3-8B and Gemma 4 12B, read from the weights through two Jacobian lenses (R and S), from activations, and from their exact token drivers

Star41
24h 新增+1
7 天新增—
Fork4
Issue1
语言Python

项目简介

A catalog of every MLP neuron and attention head of Qwen3-8B and Gemma 4 12B, read from the weights through two Jacobian lenses (R and S), from activations, and from their exact token drivers

Star 趋势

记录 6 个数据点 · 期间增长 +5

话题标签

attention-headsgemmainterpretabilityllmlogit-lensmechanistic-interpretabilitymultimodalneuronsqwen3r-lenss-lens

仓库信息

LicenseMIT
创建时间2026-10-30
最后推送1 天前
热度分3.0