mattertune.configs.callbacks.ema

class mattertune.configs.callbacks.ema.EMAConfig(*, decay, validate_original_weights=False, every_n_steps=1, cpu_offload=False)

Parameters:

• decay (float)

• validate_original_weights (bool)

• every_n_steps (int)

• cpu_offload (bool)

decay: float

validate_original_weights: bool

every_n_steps: int

cpu_offload: bool

construct_callback()