SonicBoom

Reproducibility

SonicBoom gives the same output for the same input when three things are the same: the SonicBoom version, the machine and its GPU, and the warm-up table.

What is covered

The warm-up table

When a model loads, SonicBoom measures several kernel variants on your GPU and records which one to use. Some of these choices change the order of floating-point operations, so a different choice can give different output. Once a choice is recorded, every later run reuses it, and the output stays the same.

The table is measured again, and the output can change, when:

Loading a new model adds records for that model only; existing records are not touched. Records that only affect speed are not saved if the machine was busy while they were measured; they are measured again on a later run and never change the output.

The table lives under ~/.cache/sonicboom/tune (or $XDG_CACHE_HOME/sonicboom/tune), or under $SONICBOOM_TUNE_DIR when that is set.

Keeping the output fixed

Continuing a session

By default, a request that continues a session resumes from the session’s state, and the same sequence of calls always gives the same output.

For models with recurrent layers (for example Qwen3.6), set SONICBOOM_REPRO_CONTINUE=replay, or load the model with SB_LLM_LOAD_CONTINUE_REPLAY, to make a continued session give exactly the bits that replaying the whole conversation from the start would give. This can recompute up to one prefill segment per turn.

Not covered