Optimizer Comparison: SGD, Momentum, Adam, RMSprop, and When Each Shines

Different optimizers suit different problems. SGD is stable, Momentum accelerates, Adam is adaptive. Understand why each optimizer works and pick the right one.