Virtual numbers protect against people stealing your number. They don't really do much against subscriptions.
If you sign up for a service and stop paying, it gets sent to collections, and then impacts your credit score because of unpaid debt. Whether you used a virtual number or not is irrelevant.
So it's not "insane" not to use virtual credit card numbers. To the contrary, it's just not usually worth the hassle. The few times my number got stolen and fraudulently used over the past two decades, I called and the transactions got reversed immediately. And those all happened after I used my card physically anyways, not online, so virtual numbers wouldn't have helped anyways.
All these companies operate, if not rouge, at least gray and would never bother reporting it to a credit agency. By the way, credit agencies: Many scammers make a living out of advertising apartment that do not exit. They try to make you sign up for an affiliate, subscription based, "credit check".