Many (most?) people get ectopic beats, but the threshold for noticing them seems to differ. Being stressed/anxious makes them more noticeable. There's a self-reinforcing feedback loop: the more you notice them & worry about them, the easier you will notice them ...
The thing about arrhythmias is that they can only cause damage while they're happening, but ectopics are only a problem for a single beat, which is not going to impact your oxygenation or blood pressure or anything else. Even a bunch of them every day won't cause any damage.