Do you have a budget?
It's a good idea to attend a local club day and chat to some of the members - they will show you what you need and advise where to get it. If you can't, you will probably be well set up with a 2.4GHz set - don't look for a 27, 35 or 40 Mhz system which are older standards but may still be available second hand.
At a minimum you will want the radio to provide 2 control functions - rudder and speed. These are often called 2 channel. Aircraft need 4 channels, and their radios look like a box with two sticks coming out. While cars and boats often use these, they can also use simpler 'pistol-grip'' transmitters which look like a gun grip with a steering wheel attached.
Whichever you pick, there are broadly two cost bands. Cheap ones are about £20-£50, more sophisticated ones are about £80-£200. The cheaper ones are fine for a beginner.
When you buy a 2.4GHz radio control set you should at least get a transmitter and a matching receiver (often called a combo). Usually one brand of 2.4GHz radio transmitter requires its own matching brand receiver. As well as the 'R/C combo', you will also need a servo which attaches to the receiver and moves to turn the rudder when commanded, and an Electronic Speed Controller (ESC) which attaches to the receiver and provides power to the motor. Servos and ESCs do not have to match the radio brand, and often (usually!) don't.
There are two main types of motor, brushed and brushless. Brushless are typically more powerful, though a bit more complex. The ESC must match the motor - a brushless ESC will not control a brushed motor. Brushed would be better for you, they are usually easier to mount in a boat and their speeds are more boat-compatible. Have a look at the MFA Torpedo 800 or 850...
You will also need a battery pack. Again, there are two main types which you might consider, NiMH or LiPo. LiPos are powerful and light, but need more complex care and a specialist charger - you would be better off with NiMH and a simpler NiMH charger.
A good approach would be to choose your boat, then pick an appropriate motor. That will decide what ESC you should buy, and at that stage you could pick your radio set...