Inside the marketplace powering bespoke AI deepfakes of r...

What’s Happening

Real talk: Civitai—an online marketplace for buying and selling AI-generated content, backed by the venture capital firm Andreessen Horowitz—is letting users buy custom instruction files for generating celebrity deepfakes.

Some of these files were specifically designed to make pornographic images banned by the site, a new analysis has found. The study, from researchers at Stanford and Indiana Civitai—an online marketplace for buying and selling AI-generated content, backed capital firm Andreessen Horowitz—is letting users buy custom instruction files for generating celebrity deepfakes. (we’re not making this up)

” The researchers found that between mid-2023 and the end of 2024, most bounties asked for animated content—but a significant portion were for deepfakes of real people, and 90% of these deepfake requests targeted women.

Why This Matters

(Their findings have not yet been peer reviewed.

This could have major implications for how we use technology going forward.

The Bottom Line

This story is still developing, and we’ll keep you updated as more info drops.

We want to hear your thoughts on this.