What is a key feature of AdaDelta compared to other gradient descent algorithms?Group of answer choicesIt calculates momentum to speed up the learning process.It adjusts the learning rate per parameter based on a moving window of gradient updates.It is a first-order optimization algorithm that relies on first derivatives.It requires a manually set learning rate.

Which optimization algorithm adapts the learning rate for each parameter based on its gradient history?Group of answer choicesGradient DescentStochastic Gradient Descent (SGD)AdaGradRMSprop

What role does the learning rate play in the Steepest Descent method? a. It represents the error function b. It determines the size of the incremental steps in updating parameters c. It is the output of the input layer d. It represents the difference between true output and observed output

Which of the following statements about Gradient Descent are true? (Select all that apply)Group of answer choicesLearning rate is a crucial hyperparameter in its performance.It requires calculation of gradients for the entire dataset.It can be very slow when the dataset is very large.It is guaranteed to find the global minimum for non-convex functions.

is an optimization algorithm that combines the benefits of gradient descent and momentum to accelerate convergence

Gradient Descent is an optimization algorithm used for ______