Resources: page=36
Suppose that is continously differentiable and that . Then we have
For some .
Moreover, if twice differentiable, then we have
Which combined gives
Formula
f(x+p) = f(x) + \nabla f(x)^Tp + \frac{1}{2}p^T\nabla^{2}f(x+tp)p
For some $t \in (0,1)$.
Note
This is often called the mean value theorem