Forgive my ignorance, but is it possible that the various decades of legacy code which hold up the x64 instruction set were simply bogging it down.
I just ordered the new silicon MacBook Pro and I fully expect to record a full album on it using Logic X. As presumably Apple rewrote it from the ground up for the silicone, I expect to be absolutely blown away.