There's 2 options, measure the current and use ohm's law to work out the resistance properly. it's very simple but doing sums isn't for everyone.
Alternatively, buy a simple DC speed controler , it's a tiny thing with a knob to adjust the speed. It'll work better than a pot.
Available from Amazon UK for around 5 or six quid.