In Stochastic Gradient Descent, each update is noisier than in batch gradient descent, which can be a , but can also help escape .

Stochastic gradient descent has fewer amount of computation per gradient update than standard gradient descent.*TrueFalse

What is correct about stochastic gradient descent? (select all that apply)1 pointThe loss may exhibit sudden increases The loss must be linearIt's an approximation of batch gradient descent

1. Mention the advantages of Stochastic gradient descent.

In Stochastic Gradient Descent, the term "stochastic" refers to the fact that the algorithm uses a __________ subset of data to perform an update.

The ______________ optimization algorithm updates weights more frequently than batch gradient descent by using one training example at a time.