## Description class ExponentialMovingAverage in train.py the ema use two position: if global_step == 1: for name, param in model.collect_params().items(): ema.add(name, param.data(CTX[0])) for name, param in model.collect_params().items(): ema(name, param.data(CTX[0])) but model‘s params not update ,final we save model params as: # save model after train one epoch model.save_parameters(SAVE_MODEL_PREFIX_NAME + time.asctime(time.localtime(time.time()))) is the ema not work?
Description
class ExponentialMovingAverage
in train.py the ema use two position:
if global_step == 1:
for name, param in model.collect_params().items():
ema.add(name, param.data(CTX[0]))
for name, param in model.collect_params().items():
ema(name, param.data(CTX[0]))
but model‘s params not update ,final we save model params as:
save model after train one epoch
is the ema not work?