dela e7185cbf49 Pull OPUS-100 en-zh for SFT instead of a checked-in jsonl ...

train_sft --data opus-100 streams Helsinki-NLP/opus-100, writes both
directions, and skips frozen eval sentences. Runtime cache stays under
data/sft/ (gitignored).

2026-08-25 21:39:58 +08:00

..

__init__.py

Initial K3 snapshot: 0.5B KDA/MLA/MoE train path

2026-08-25 14:43:17 +08:00

data.py

Pull OPUS-100 en-zh for SFT instead of a checked-in jsonl

2026-08-25 21:39:58 +08:00

eval_mt.py

Initial K3 snapshot: 0.5B KDA/MLA/MoE train path

2026-08-25 14:43:17 +08:00

prompts.py

Initial K3 snapshot: 0.5B KDA/MLA/MoE train path

2026-08-25 14:43:17 +08:00

schedule.py

Fit 0.5b training on 32GB: SDPA MLA, block checkpoint, chunked CE

2026-08-25 20:09:27 +08:00

success.py

Initial K3 snapshot: 0.5B KDA/MLA/MoE train path

2026-08-25 14:43:17 +08:00

toy.py

Initial K3 snapshot: 0.5B KDA/MLA/MoE train path

2026-08-25 14:43:17 +08:00

train_tokenizer.py

Initial K3 snapshot: 0.5B KDA/MLA/MoE train path

2026-08-25 14:43:17 +08:00