
Sub-30s LLM Pretraining on 8×H100? Modded-NanoGPT World Record Attempt (29.90 s)
A third Track 1 modded-nanogpt record attempt, building on @caraxesml's #404: six small, exact GPU fixes (+175 lines) cross below 30 seconds at 29.90 s across 12 runs vs 30.05 s for #404 on the same 8×H100 node. In review as PRs #406 and #407.
Read essay











