Hi Timbo,
... and welcome to the Mayhem!
No easy way to cut out windows, unless you have a laser cutter or CNC machine!
If many of the windows are the same size, you could try making up yourself some sort of die punch.
Some modellers have used clear plastics and just masked the windows and painted.
What material are you cutting the windows into?