learning_rate (float
) – Learning rate \(\eta\).
b1 (float
) – Decay rate for the exponentially weighted average of grads.
b2 (float
) – Decay rate for the exponentially weighted average of squared norm of grads.
eps – Term added to the denominator to improve numerical stability.