In the example in the docs, they show someone marking an image that has slipped through the filter as one that's AI generated. But, it comes from Adobe Stock - and I think this really highlights the biggest weakness with how they've gone about implementing this. It's not looking at the images at all, it's looking at where they come from.
The problem is that now that Pandora's box has been opened, all sorts of sites (incl. anywhere like social media that accepts user content) are going to have comingled AI-and-legitimate images that they host.
This is a hard problem to solve.
replies(1):