Range based interference on the pool can indicate that the boat itself is generating a low level of interference. The level remains the same, but is overcome as boat and transmitter get nearer.
AM sets, on whatever band, rely on having a quiet period to help recognize that the next information is for channel 1, which is why a twitchy rudder is often the first sign of there being interference. FM sets are less prone, but not immune to this. There are plenty of sources of interference at home, with fluorescent lights and dimmers being top of the list. They don't need to be in the same room, and do work on the exact same 50Hz that out servos use as a frame rate.
A servo twitching on power up just means that the servo has got power, but no signal to tell it what to do. Or it got power which then failed, the symptoms are very similar.
Tuning of a transmitter shouldn't drift with time, but that's in theory. Practice might be different depending on design and whether the components used drift with age and cause the transmitter output to drift away from the channel center frequency. This would weaken the received signal and give the results noted.
I was recently told about a hospital using a paging system that runs in the 40MHz band. If its a forthcoming popular system, it could present problems, but I have no information on what sort of power these things use, whether they are widespread, and whether they actually transmit in the same bit of the band that we use.