Virtual numbers protect against people stealing your number. They don't really do much against subscriptions.
If you sign up for a service and stop paying, it gets sent to collections, and then impacts your credit score because of unpaid debt. Whether you used a virtual number or not is irrelevant.
So it's not "insane" not to use virtual credit card numbers. To the contrary, it's just not usually worth the hassle. The few times my number got stolen and fraudulently used over the past two decades, I called and the transactions got reversed immediately. And those all happened after I used my card physically anyways, not online, so virtual numbers wouldn't have helped anyways.
I'm very excited about the new click-to-cancel rule for this reason — hopefully doing the "right" thing will be really easy and actually work.