Wednesday, September 2, 2026
NewsWhite
Meta turns off the Instagram feature that let users make AI deepfakes of public accounts
TECHNOLOGY

Meta turns off the Instagram feature that let users make AI deepfakes of public accounts

By Jay PetersJuly 10, 2026·Source: The Verge·10 views

Meta has quietly reversed course on one of its more contentious recent product decisions. The Verge is reporting that the company is shutting down a newly launched Instagram feature that allowed users to generate AI images based on content from public accounts simply by tagging those accounts in a prompt — a rollout that lasted only days before the backlash forced a retreat.

To understand why this particular feature landed so badly, it helps to understand the environment into which it was dropped. The question of who controls a person's likeness in the age of generative AI is among the most charged in technology right now, and it sits at the uncomfortable intersection of intellectual property law, platform policy, and basic personal dignity. Legislators in several jurisdictions are actively trying to write rules around synthetic media. Courts are working through early cases. And public figures — musicians, athletes, actors, journalists, influencers — have spent the better part of two years watching their faces and voices get repurposed without permission across every corner of the internet. Into that atmosphere, Meta introduced a tool that effectively turned any public Instagram account into raw material for AI image generation, with the account holder getting no say in the matter at all.

The mechanics of the feature, as described by The Verge, made the problem especially stark. Because opting out required the account holder to take active steps, and because the default was participation, the burden fell entirely on the subject rather than the person doing the generating. That design choice is not accidental in the tech industry — defaults are policy, and setting the default to open signals where a company's interests lie. For Meta, which has staked a substantial part of its near-term product strategy on AI integration across its platforms, the incentive to normalize AI-generated content is obvious. The feature fits a pattern of the company trying to embed generative AI deeply into the social experience, treating its vast library of user-uploaded images as both training data and interactive fuel.

That pattern is precisely what makes the creative and public-facing communities so wary. Creators who have built audiences on Instagram have a reasonable expectation that their published work promotes their own brand, not someone else's AI experiments. The feature as designed meant a photographer's portfolio, a comedian's image, or a journalist's profile picture could be fed into a generation tool and used to produce images that the original account holder might find misleading, embarrassing, or professionally damaging. The fact that the outputs involved public accounts did not meaningfully reduce the harm — if anything, it increased the reach, since public figures are precisely the people whose likenesses carry the most value and the most potential for misuse.

The speed of the reversal is significant. When a company pulls a feature within days of launch, it usually means one of two things: either internal escalation moved faster than the product team anticipated, or the external pressure was severe enough to override the normal reluctance to admit a mistake. The likely reading here is some combination of both. High-profile accounts — the kind that drive engagement and give Instagram its cultural relevance — would have been among the most affected, and losing their goodwill is a cost Meta cannot easily absorb. Platforms derive their value from the people who post on them, and alienating the most visible among them is not a sustainable strategy.

There are also regulatory considerations in the background. The European Union's AI Act and various national-level laws are beginning to impose real constraints on how AI systems use personal data and likenesses. A feature that treats public accounts as open-ended training prompts without consent sits uncomfortably in that legal landscape, and the last thing Meta needs right now is to hand regulators a concrete, headline-generating example of exactly the behavior they are trying to restrict.

None of this means the underlying ambition goes away. Meta will almost certainly return to this territory with a redesigned version of the feature — one with clearer opt-in mechanics, tighter restrictions on what outputs are permitted, or some form of creator compensation framing to soften the reception. The incentives driving the original launch have not changed. The company wants generative AI woven into how people use Instagram, and user-generated content is the feedstock that makes those tools interesting.

What to watch for next is how the revised version of this feature, when it arrives, handles consent architecture. Whether Meta builds a genuine opt-in system or simply adjusts the language around an opt-out model will reveal a great deal about how seriously it is taking the underlying objection rather than just the immediate backlash. Also worth watching is how other platforms respond — this episode gives competitors both a warning about what not to do and, potentially, an opening to position themselves as more creator-friendly in the increasingly crowded race to integrate AI into social media.

Originally reported by The Verge. Read the original article

Related Articles