Source symbols: scripts/chat_sft.py

Deterministic, value-free symbol metadata extracted from public source. Implementations and literal values are not copied into this page.

• Revision: master@92d63d4e8bb4df75c3b71618f31ddde2378b2bcd · 2026-07-04T18:18:25Z
• Declarations: 5
• Referenced calls: 84

Declared symbols

• sft_data_generator_bos_bestfit — def at line 180
• refill_buffer — def at line 204; references len, render_conversation, append, range, enumerate, pop, extend, tensor, contiguous, sft_data_generator_bos_bestfit, min, next, float, all_reduce, bool, item, eval, build_val_loader, evaluate_bpb, print0
• get_lr_multiplier — def at line 307; references min, next, float, tensor, all_reduce, bool, item, eval, build_val_loader, evaluate_bpb, print0, log
• get_muon_momentum — def at line 317; references min, next, float, tensor, all_reduce, bool, item, eval, build_val_loader, evaluate_bpb, print0, log
• centered_mean — def at line 377; references sum, len, print0, log, items

File-level call references

• ArgumentParser — line 35
• add_argument — line 37
• parse_args — line 67
• vars — line 68
• copy — line 68
• autodetect_device_type — line 72
• compute_init — line 73
• print0 — line 75
• get_device_name — line 79
• get_peak_flops — line 80
• float — line 83
• DummyWandb — line 87
• init — line 87
• load_model — line 94
• get — line 97
• getattr — line 106
• setattr — line 110
• compile — line 118
• estimate_flops — line 120
• get_token_bytes — line 128
• setup_optimizer — line 132
• get_base_dir — line 138
• load_optimizer_state — line 140
• load_state_dict — line 143
• zip — line 145
• GradScaler — line 152
• SmolTalk — line 163
• MMLU — line 164
• range — line 164
• GSM8K — line 165
• TaskMixture — line 167
• len — line 192
• get_bos_token_id — line 195
• render_conversation — line 208
• append — line 209
• refill_buffer — line 227
• enumerate — line 234
• pop — line 242
• extend — line 243
• tensor — line 281
• contiguous — line 282
• sft_data_generator_bos_bestfit — line 300
• min — line 318
• next — line 324
• all_reduce — line 336
• bool — line 337
• item — line 337
• eval — line 341
• build_val_loader — line 342
• evaluate_bpb — line 344
• log — line 348
• train — line 354
• and — line 359
• Engine — line 361
• run_chat_eval — line 372
• sum — line 378
• centered_mean — line 379
• items — line 387
• join — line 394
• save_checkpoint — line 395
• state_dict — line 398
• get_vocab_size — line 405
• synchronize — line 423
• time — line 424
• model — line 426
• detach — line 427
• scale — line 430
• backward — line 430
• max — line 434
• get_lr_multiplier — line 436
• get_muon_momentum — line 437
• unscale_ — line 443
• is_ddp_initialized — line 444
• _found_inf_per_device — line 445
• values — line 445
• step — line 447
• update — line 448
• zero_grad — line 451
• int — line 464
• collect — line 486
• freeze — line 487
• disable — line 488
• finish — line 498
• compute_cleanup — line 499

Source: scripts/chat_sft.py