Consider the BVP example again:
If we knew the value of y'(0) at the initial point then this becomes an initial value problem and we know how to solve it from the previous pages
One way of solving the problem is to iterate to the solution the following way
Guessing at random
will take forever to hit the solution. Optimization
techniques are designed to iterate by guessing smartly in
each iteration (except the first) so that the solution can be obtained
rapidly