For a univariate function , the difference quotient

approximates the slope at . As , we get the derivative,

that points in the direction of steepest ascent.

Differentiation Rules#

The following are the four core differentiation rules.

1. Product rule: .
2. Quotient rule: .
3. Sum rule: .
4. Chain rule: .