What knoby said, if the battery is not connected to the charger, it will have a higher voltage. If the reading is with the battery connected, there is a severe problem. With many low current chargers, the "regulation" consists of having a transformer wound so that it can only give so much current. When the load wants to draw more current, it just loses some efficiency, and warms up. as long as it doesn't heat up beyond the point where the internal fuse (internal to the coil winding, that is) ruptures, getting warm is OK. Getting hot (where the fingers are withdrawn with a choice oath) is another story. There might be an actual regulator in there, but usually, these will just dissipate spare energy as heat causing the case to warm up.
The switch is best being a single pole, double contact, or change over type. Black wire from the socket down to the normally closed contact of the switch.