Question

Why take derivative of a function in neural network cost function?

Answer 1

cost function is a measure of "how good" a neural network did with respect to it's given training sample and the expected output. It also may depend on variables such as weights and biases