Although the Mac Pro's PCIe extensibility makes it a pretty mystifying niche product from Apple without providing memory and GPU expandability, once Asahi Linux gets running on there you should be able to not get the full abilities of the latest Vulkan and full OpenGL 4.6 by putting in a recent AMD card. The open source Radeon drivers should "just work" on ARM as they do in the Talos II POWER-based workstation, if they can be stably initialized that is. Heck, Nvidia publishes a binary Linux aarch64 driver and they sound petty enough with Apple to try to make that work.
You could have Asahi Linux running and delegate any not-yet-supported hardware to the 7 PCIe devices it supports. Would be quite a mighty ARM Linux workstation. Again though - only if Apple has the PCI Express support for it.