🔗 Share this article

The widely-used AI conversation site Character.ai is enforcing a major policy change that will block minors from having discussions with its AI-powered avatars.

This decision follows widespread concern regarding the nature of conversations young people were engaging in with the AI entities.

Legal Pressure

The company, which started in 2021 and has millions of users, is dealing with several legal actions in the US.

Guardians have filed lawsuits, among them concerning the loss of a teenager, with some calling the platform a "clear and present danger" to teenagers.

Updated Policies

Effective November 25th, users under 18 will only be able to create material such as videos with their characters, as opposed to having discussions as they now do.

Internet security organizations have applauded the decision but mentioned that the function ought not to have been available to minors in the first place.

Company Statement

"Today's announcement is a continuation of our general belief that we need to keep creating the most protected AI platform on the world for entertainment purposes," said Character.ai leader Karandeep Anand.

He continued that AI safety constitutes "a changing goal" but something the company had taken an "proactive" approach to, with safety measures and preventive measures.

Professional Perspectives

Internet security organization Internet Matters welcomed the announcement, but emphasized that security protocols ought to have been built in from the start.

"Investigations we've performed shows that young people are subjected to risky information and endangered when using AI, including AI chatbots," the organization commented.

Earlier Concerns

Character.ai has been challenged in the past for featuring potentially dangerous or inappropriate chatbots that minors could talk to.

Digital representations impersonating English minors were discovered on the platform before being removed.

Later, reporters discovered a chatbot based on convicted sex offender which had logged thousands of chats with users.

Sector Consequences

Online expert Matt Navarra described the situation as a "wake-up call" for the AI industry, which is shifting "from unrestricted development to post-crisis regulation".

"If a service that builds a minor-friendly service afterwards makes changes, it's indicating that moderated conversations don't suffice when the technology's emotional appeal is intense," he remarked.

Coming Changes

The company states its updated direction will be on providing "deeper gameplay" and "narrative experiences" for teenagers.

Enhanced age checking systems will also come into effect, and the platform will finance a novel AI protection study center.

An expert in digital protection, who has studied AI safety, commented it was "a reasonable decision" to limit minors from accessing chatbots.

"It assists to distinguish imaginative activities from more private, personally delicate interactions," she explained.

"This represents so important for minor users in the process of learning to manage emotional and digital boundaries."

She mentioned that Character.ai's new measures may represent a "developing stage" in the AI industry, where child safety is increasingly being recognized as an "immediate concern" for accountable advancement.