Files
dela e6918ffa35 feat: add superderive child and open phase-2 routing
Attach the stepwise derivation toolkit as a submodule and default
SUPERPAPER_PHASE to 2 so rewrite-figure can use superderive. Notes
still keep align for short expansions without cancel or subst.
2026-08-17 10:06:39 +08:00

78 B

$QK^\top \to QK^\top/\sqrt{d_k}$。缩放压方差,避免 softmax 饱和。