flambe.optim.radam
¶
Module Contents¶
-
class
flambe.optim.radam.
RAdam
(params, lr=0.001, betas=(0.9, 0.999), eps=1e-08, weight_decay=0, degenerated_to_sgd=True)[source]¶ Bases:
torch.optim.optimizer.Optimizer
,flambe.compile.Component
Rectified Adam optimizer.
Taken from https://github.com/LiyuanLucasLiu/RAdam.