Initial K3 snapshot: 0.5B KDA/MLA/MoE train path

Standalone tree split from LLMRL/projects/kda. Includes Triton dt_bias backward fix, train_k3 --preset 0.5b, SFT, Docker runtime, and tests.
2026-08-25 14:43:17 +08:00
commit 584f7e9e73
140 changed files with 21592 additions and 0 deletions
@@ -0,0 +1,7 @@
+"""Vendored NVIDIA-Triton KDA path from flash-linear-attention (MIT).
+
+This package is imported as ``kda._fla``, never as the upstream ``fla``
+distribution. Context-parallel, Ascend, and TileLang backends are omitted.
+"""
+
+__version__ = "0.5.2"