flambe.optim.radam

Module Contents

class flambe.optim.radam.RAdam(params, lr=0.001, betas=(0.9, 0.999), eps=1e-08, weight_decay=0, degenerated_to_sgd=True)

Bases: torch.optim.optimizer.Optimizer, flambe.compile.Component

Rectified Adam optimizer.

Taken from https://github.com/LiyuanLucasLiu/RAdam.

__setstate__(self, state)

state_dict(self)

step(self, closure=None)