One thing I didn't see mentioned: this would be a good motivation for Nvidia to release "open weights" models.
Just like Mac OS is free when you buy a Mac, having the latest high-quality LLM for free that just happens to run well on this box is a very interesting value-prop. And Nvidia definitely has the compute to make it happen.
replies(3):