• learning_rate (float) – Learning rate $$\eta$$.
• b1 (float) – Decay rate for the exponentially weighted average of grads.
• b2 (float) – Decay rate for the exponentially weighted average of squared norm of grads.