I use white spirit to get any glue residue off, then wash the area with soap and water.
Tips if you use white spirit:- do not use the same part of the cloth too long, the white spirit will start to loose its effectiveness as the cloth gets glue on it.
Wear gloves if using white spirit, it can clean off oil, think what it does to your hands
If you use a piece of cloth to clean off glue, after use throw it away, the white spirit evaporates and you are left with, that's right glue, it only melts glue it does not make it disappear