EMA vs DEMA

Step-size α = 0.0015

Momentum β = 0.9

Exponential Moving Average in SGD optimizer

Step-size α = 0.0015

Momentum β = 0.6

Lambda λ = 0.9

Double Exponential Moving Average in SGD optimizer