Reminds me of the time when GPT3.5 model came out, my first idea I wanted to prototype was ERP which would be based purely on various communication channels in between employees. It would capture sales, orders and item stocks.
It left so bitter taste in my mouth when it started to lose track of item quantities after just a few iterations of prompts. No matter how improved it gets, it will always remind me the fact that you are dealing with an icky system that will eventually return some unexpected result that will collapse your entire premise and hopes into bits.