tjm,
All the previous comments are true.
I have this same problem with Footies - which are even smaller and FWIW this is why and what to do about it

Problem: if you are tacking when close-hauled (this is the worst problem)
A) the boat is slow and has low momentum
B) the boat is probably heeled over - so the rudder is less effective, as well as acting like an elevator
C) there may be a balance problem (mast tooo far
rearward)
Answers: one or more of these WILL work
A) If the boat won't tack successfully - don't tack. Gybe instead. Its a longer way round but will (nearly) always work
B) As dread'72 sez don't tack from close-hauled: Loosen the sheets a little and bear off the wind a couple of notches beffore tacking. This has several virtuous results - you heel less, so the rudder grips the water. The boat is going faster so the rudder has better effect. And the boat has more speed and momentum so is less likely to hang in irons
C)Move the mast forwards, or sail. if the center of pressure of the sail is too far back, it will ALWAYS try to turn the hull up into the wind (just like a windsurfer) So moving either the mast, or the sail or the centre of pressure forward will help and reduce this weather-cocking. If, for instance you are able to wrap the sail round the mast a couple of times you will have done just the right thing - as well as reducing the area
D)maKE sail to suit the conditions! Try making it in shopping-bag plastic - then you will not lose much if is not beautiful or successful. Make it lower and smaller and see if it helps
Hope this is useful - please let us know how you get on - there have been several Wee Nip builders writing on this forum - thay may add lots of good ideas
andrew