So I tried this and not until I uninstalled Office Pro 2013 (32bit) did that work for me.
That caused a number of issues for our client that used the Terminal Server for remote access to read and work on weekend.
But all is wel. Seems Office is not so fussy and allows a 64Bit MACE to be installed while still installing the 32 bit Office.