so... set up your CNC Router with a 4mm Diameter cutter, clock your centres on the X-Y axis.. whats your problem?

seriously
just make a sanding board of the correct thickness, use scrap 3, 3.25, 3.5mm with a layer of double sided tape and emery cloth and set too

the sand paper tends to be more forgiving than a file and doesn't splinter the wood as much
i have the same problems trying to insert new pieces of ply into my old Aerokits fleet when i am restoring them, and no i haven't found a scource for old imperial unit ply..... despite what the model shop calls it
db