The only real issue is compatibility of the primer with any surface coats, and surface coat to any varnish. If you already have the varnish, then that may dictate the layers underneath.
I have used a primer and topcoat, of different types and got crazing.