RSS feeds are actually used quite a lot in the podcasting industry.
And indeed, nothing guarantees that you won't get ads in those podcasts, because ad insertion is done server-side in a lot of cases, so the media URL in the RSS feed will be served with ads in it.