Unfortunately, yes — you need to spend money for every test run. But you’re paying either way. Let me explain: I work at a big company with a large QA team. People write tests in JS/TS/Python. It takes time to write them, and then more time to maintain them when they break due to UI changes. Our team spends a lot of time fixing flaky and broken tests. Time is money. So leadership has to make a decision: should people spend less time writing and maintaining tests and focus more on quality, even if it means paying for test runs?