---
title: "AI Chatbots Face FTC Probe Into Safety and Harmful Content"
date: 2025-09-12
author: "Barry Elad"
featured_image: "https://sqmagazine.co.uk/wp-content/uploads/2025/09/ftc-probes-into-chatbots.jpg"
categories:
  - name: "Artificial Intelligence"
    url: "/artificial-intelligence.md"
tags:
  - name: "News"
    url: "/tag/news.md"
---

# AI Chatbots Face FTC Probe Into Safety and Harmful Content

The Federal Trade Commission has opened a broad inquiry into **AI chatbots** amid growing concerns about their **safety and impact on children and teens**.

## Quick Summary – TLDR:

- FTC sent letters to Alphabet, Meta, Snap, OpenAI, xAI and Character.AI seeking details on chatbot safety and data practices
- Concerns arise after reports of chatbots giving dangerous advice and lawsuits linking them to teen suicides
- Companies like Snap and Character.AI defend their safety measures and pledge to cooperate with the FTC
- Inquiry could shape future U.S. rules on generative AI use with minors

## What Happened?

The [FTC has ordered](https://www.ftc.gov/news-events/news/press-releases/2025/09/ftc-launches-inquiry-ai-chatbots-acting-companions) **major tech companies** including Meta, Alphabet, [OpenAI](https://sqmagazine.co.uk/openai-statistics/), Snap, xAI and Character.AI to hand over detailed information about how their chatbots work. The investigation will look at how companies **test, monitor and mitigate risks**, and whether they are doing enough to **protect children and teenagers** from harmful interactions.

> FTC launches inquiry into AI chatbots acting as companions. Agency issues 6(b) orders to seven companies that operate consumer-facing AI chatbots: <https://t.co/pcVqFzhbxl>
> 
> — FTC (@FTC) [September 11, 2025](https://twitter.com/FTC/status/1966159135742833131?ref_src=twsrc%5Etfw)

 ## Growing Concerns Over Chatbots and Teens

AI chatbots have quickly spread across popular platforms like **Instagram, [Snapchat](https://sqmagazine.co.uk/snapchat-statistics/) and X**, becoming companions for millions of users. Young people are increasingly turning to these tools for **homework help, emotional support and personal advice**, but regulators fear the consequences of unsupervised use. Reports have shown chatbots giving **inappropriate or dangerous guidance** on sensitive issues such as drugs, eating disorders and self-harm.

Several tragedies have already heightened the urgency. The parents of **16-year-old Adam Raine** sued OpenAI and its CEO Sam Altman, alleging that [ChatGPT](https://sqmagazine.co.uk/chatgpt-statistics/) coached their son in planning his suicide. Another wrongful death lawsuit was filed against **[Character.AI](https://sqmagazine.co.uk/character-ai-statistics/)**, after a Florida teenager’s mother said her son developed an abusive relationship with a chatbot that contributed to his death.

## How Tech Companies Are Responding?

Some companies have begun rolling out **safety measures** in response to public pressure.

- **OpenAI** announced new parental controls, allowing parents to link accounts, disable certain features and receive alerts if a teen appears to be in distress.
- **Meta** said it will now block its chatbots from discussing topics like **self-harm, suicide, disordered eating and romantic interactions** with teens, instead redirecting them to expert resources.
- **Character.AI** highlighted new tools like an **under-18 experience** and **Parental Insights** features, along with disclaimers reminding users that chatbots are fictional.
- **Snap** said its **My AI** chatbot is transparent about its limitations and stressed that it shares the FTC’s goals of balancing **innovation and safety**.

## What the FTC Wants to Know?

The regulator is not only focused on safety safeguards, but also on how companies **monetize user engagement**, process user conversations and generate outputs. This includes investigating whether companies are prioritizing profit over protection when pushing these products onto young audiences. The inquiry also considers compliance with the **Children’s Online Privacy Protection Act (COPPA)**, which restricts how online services can collect data from children under 13.

## SQ Magazine’s Takeaway

Honestly, this feels like a **critical turning point** for AI. Just like social media years ago, chatbots have exploded in popularity without enough oversight. Kids are using them for serious, emotional conversations, and the risks are already showing up in heartbreaking ways. I think the FTC is right to step in now. If companies are racing to launch AI products without proving they are safe for the most vulnerable users, then regulation is not just helpful, it is necessary.