Initial K3 snapshot: 0.5B KDA/MLA/MoE train path

Standalone tree split from LLMRL/projects/kda. Includes Triton dt_bias
backward fix, train_k3 --preset 0.5b, SFT, Docker runtime, and tests.
This commit is contained in:
dela
2026-08-25 14:43:17 +08:00
commit 584f7e9e73
140 changed files with 21592 additions and 0 deletions
+1
View File
@@ -0,0 +1 @@
# Mount as /data/eval: one sentence per line, e.g. zh2en.src.txt + zh2en.ref.txt
+20
View File
@@ -0,0 +1,20 @@
今天天气很好。
请把窗户打开。
猫坐在垫子上。
这本书值得一读。
他昨天去了北京。
我们需要更多的训练数据。
太阳从东边升起。
她正在学习线性代数。
不要把评测集拿去训练。
河对面有一座旧桥。
科学是对自然的系统探索。
他们在公园里散步。
这台电脑的内存是十六吉字节。
翻译时不要照抄原文。
春天的风很温和。
我把钥匙放在桌子上了。
火车中午到达。
水在一百摄氏度沸腾。
小模型仍然可以学会狭窄的任务。
冻结测试文件保持只读。
+20
View File
@@ -0,0 +1,20 @@
The weather is very nice today.
Please open the window.
The cat is sitting on the mat.
This book is worth reading.
He went to Beijing yesterday.
We need more training data.
The sun rises in the east.
She is studying linear algebra.
Do not train on the evaluation set.
There is an old bridge across the river.
Science is the systematic exploration of nature.
They are walking in the park.
This computer has sixteen gigabytes of memory.
Do not copy the source text when translating.
The spring wind is gentle.
I left the keys on the table.
The train arrives at noon.
Water boils at one hundred degrees Celsius.
A small model can still learn a narrow task.
Keep the frozen test files read-only.
+20
View File
@@ -0,0 +1,20 @@
The weather is very nice today.
The development of artificial intelligence has changed the world.
Please open the window.
The cat is sitting on the mat.
This book is worth reading.
The meeting will start at three in the afternoon.
He went to Beijing yesterday.
We need more training data.
The sun rises in the east.
This question still has no answer.
She is studying linear algebra.
Do not train on the evaluation set.
There is an old bridge across the river.
Please wait a moment, I will be right back.
Science is the systematic exploration of nature.
They are walking in the park.
This computer has sixteen gigabytes of memory.
Do not copy the source text when translating.
The spring wind is gentle.
I left the keys on the table.
+20
View File
@@ -0,0 +1,20 @@
今天天气很好。
人工智能的发展改变了世界。
请把窗户打开。
猫坐在垫子上。
这本书值得一读。
会议将在下午三点开始。
他昨天去了北京。
我们需要更多的训练数据。
太阳从东边升起。
这个问题还没有答案。
她正在学习线性代数。
不要把评测集拿去训练。
河对面有一座旧桥。
请稍等,我马上回来。
科学是对自然的系统探索。
他们在公园里散步。
这台电脑的内存是十六吉字节。
翻译时不要照抄原文。
春天的风很温和。
我把钥匙放在桌子上了。