4. Deep Learning

Neural Networks — Quiz

Test your understanding of neural networks with 5 practice questions.

Practice Questions

Question 1

In the context of multilayer networks, what is the primary function of the weights connecting neurons between different layers?

Question 2

Which of the following activation functions is most commonly used in the hidden layers of deep neural networks to mitigate the vanishing gradient problem?

Question 3

During backward propagation, how are the gradients of the loss function with respect to the weights and biases calculated?

Question 4

Consider a neuron with three inputs $x_1 = 0.2$, $x_2 = 0.5$, $x_3 = 0.8$. The corresponding weights are $w_1 = 0.4$, $w_2 = 0.6$, $w_3 = 0.3$. If the bias is $b = -0.1$, what is the weighted sum before applying the activation function?

Question 5

Which of the following practical training considerations is primarily aimed at preventing the network from getting stuck in local minima during optimization?