Meta took days to remove ads containing AI-generated child sexual abuse material (CSAM) on Facebook and Instagram. Some ads featured photos of real kids, including a press photo of a young member of a European royal family and images swiped from a popular Instagram profile of a preteen girl deemed an influencer.
In an investigation published Tuesday, the Tech Transparency Project (TTP) reported that Meta failed to detect 332 ads containing CSAM this year. The “vast majority” of ads promoted AI apps made in China, while many ads promoted so-called “nudify” apps that make it easy for bad actors to use AI and digitally alter images of children.
TTP matched “multiple CSAM ads to photos of real children that appeared online.” These ads seem to violate federal child pornography laws, since the Justice Department has clarified that AI CSAM is just as harmful as CSAM. The young royal’s image was “animated into a video of her performing a graphic sex act,” TTP found. Other ads animated a photo of a 14-year-old Instagram influencer “showing off her new sports club uniform” into “a video of her performing oral sex.” A third “preteen” victim “posing in a pink athletic outfit with pigtails” in a series of stock photos was morphed into a video where she looks frightened as she’s molested by an adult male, TTP reported.
Instagram will limit recommendations for AI-generated influencer profiles that fail to disclose their synthetic identities under a new labeling policy.
Instagram will limit recommendations for AI-generated influencer profiles that fail to disclose their synthetic identities under a new labeling policy.
Meta agreed to impose daily limits on children's social media use and pay nearly $18 billion in settlements with nearly every US state today, cutting short a trial in which Meta said several of the states were demanding over $1.4 trillion. The settlement requires court approval.
Meta is facing claims that it designed its products to foster compulsive use by children and failed to warn users of addiction and mental health risks. Meta, which already uses ID checks and face analysis to verify user ages, said it agreed to impose on people under 18 a "default two-hour daily time limit that teens can only turn off with a parent’s permission," a default block between midnight and 6 am, and a school mode in which notifications are muted by default from 8 am to 3 pm.
The two-hour daily "limit is cumulative across Facebook and Instagram, and time spent scrolling on both apps counts toward the total, including if we detect that someone has multiple accounts," Meta said. Teens will "receive prompts after every 15 minutes of continuous screen time on Facebook or Instagram," and "prompts when their total daily usage hits 60 minutes and 90 minutes."
Meta must overhaul Instagram and Facebook for young users by enforcing daily time limits, turning off push notifications during school hours, and blocking access late at night. (BigStock Photo)
Washington state will receive up to $339 million as part of a historic $17.1 billion multistate settlement with Meta, resolving allegations that the tech giant intentionally designed Facebook and Instagram with addictive features that harmed youth mental health.
Attorney General Nick Brown said Wednesday that the landmark agreement delivers on core youth-safety product changes — including hard caps on daily time limits, late-night scrolling blocks, and disabled push notifications during school hours — that state lawmakers failed to pass through legislation over the past two years.
“Let me say to the young people of Washington state: This agreement shows that your health and safety is more important than Meta’s profits,” Brown said in a news release.
Under the deal, Meta must overhaul Instagram and Facebook for young users by enforcing a two-hour combined daily time limit, turning off push notifications during school hours (8 a.m. to 3 p.m.), and blocking access late at night between midnight and 6 a.m. Teen users will also get the option to switch off algorithmic feeds in favor of a chronological timeline.
The agreement resolves claims brought by a coalition of 47 states, Washington, D.C., and three territories. While Meta acknowledged the settlement could cost up to $18 billion total over 10 years, it marked a rare legal resolution for a major platform facing nationwide youth safety litigation.
Outside the landmark Big Tobacco agreements of the late 1990s, the $17.1 billion deal represents the largest state consumer protection settlement in U.S. history. State officials and tech policy experts are framing the enforcement action as a similar watershed moment for regulating algorithmic harms and digital product design.
Washington state will receive a guaranteed baseline of $237 million from the core youth-safety agreement, with its payout potentially scaling up to nearly $339 million over the next decade if other major platforms like TikTok and Snapchat adopt comparable terms.
The Attorney General’s Office plans to use the funds to cover legal costs, bolster ongoing consumer protection enforcement, and directly fund state programs tackling the youth mental health crisis driven by social media use.
The settlement also mandates an independent third-party auditor to evaluate and report Meta’s technical compliance directly to state regulators annually over the next five years. Beyond usage limits, Meta must restrict social comparison features such as targeted beauty filters, hide public “like” counts for younger users, and implement stricter age verification to prevent children under 13 from creating accounts.
In addition to the core youth-safety agreement, Washington will receive a separate $10.2 million payment resolving long-standing state claims against Meta for sharing nonpublic user data with third parties like Cambridge Analytica during the 2016 election cycle.
Oregon Attorney General Dan Rayfield announced that his state’s share will total more than $125 million over 10 years.
In a public statement, Meta praised the agreement as setting a new benchmark for youth safety, while emphasizing that the restrictions should apply across the entire industry.
“While this is an important step, these protections will only be truly effective if our peers — TikTok and YouTube — put the same measures in place,” a Meta spokesperson said.
The agreement remains subject to final judicial approval in federal district court.
Teens are using Ray-Ban Meta smart glasses to secretly film classmates and teachers at school, with the harassment disproportionately aimed at girls. Much of the footage stayed online until Futurism contacted Meta and TikTok directly.
Birdwatching is finding a younger audience on TikTok, where millions of views are helping Gen Z discover birds, wildlife and an increasingly popular outdoor hobby.
Instagram said it would get tougher on harassment filmed with Meta’s AI glasses. A month later, plenty of those videos are apparently still slipping through.
Login
