Interactive Gradient Descent Visualization Tutorial

Himmelblau Function

$f(x, y) = (x^2 + y - 11)^2 + (x + y^2 - 7)^2$

Select Function:

Select Colormap:

Height Scale: 3.0

Function Plot Range (X & Z): 20.0

Surface Alpha: 1.0

Use Height Colormap

Visualize Minima

Show Contour Lines

Num Contour Lines: 20

Start X (func): -4.0

Start Y (func): -4.0

Num Steps (Play): 10

Show Path Arrows

Show Live Gradient

Step Size (Learning Rate): 0.0100

Beta (Momentum Factor): 0.9 Step Size (Learning Rate): 0.0100

Beta1 (Adam): 0.9 Beta2 (Adam): 0.999 Epsilon (Adam): 1e-8 Step Size (Learning Rate): 0.0100

Current Function Value f(x,y): N/A