Kim, you start off where the pilotboat is (it sets off at the same time but travels slowly). So in 3 hours you should not lose much.
It mal look bad because all the boats will be bunched together so you can lose or gian thousands in the early stages.
If you log into Clipper (you've forgotten that one ... heading due South??) and search for "pilotboat", you can see its basic track.
This also explains your "off course" starting position in the Clipper race - the pilotboat goes the most direct route, even if it doesn't make it!
Danny