🔗 Share this article

The popular chatbot platform Character.ai is introducing a major policy change that will block minors from having discussions with its virtual avatars.

This action follows widespread concern regarding the types of interactions teenagers were having with the virtual friends.

Legal Pressure

The service, which started in 2021 and is used by numerous people, is dealing with various court cases in the US.

Parents have taken legal action, including one involving the loss of a teenager, with some describing the platform a "immediate threat" to teenagers.

New Restrictions

Beginning November 25th, users under 18 will be limited to generate content such as videos with their characters, as opposed to chatting as they presently are able to.

Internet security organizations have supported the change but mentioned that the function should never have been available to children in the first place.

Official Response

"The new policy is a continuation of our fundamental approach that we need to keep developing the most secure AI platform on the world for recreational use," said Character.ai boss Karandeep Anand.

He added that AI safety is "a changing goal" but something the company had taken an "forceful" approach to, with safety measures and safety barriers.

Professional Perspectives

Online safety organization Internet Matters supported the decision, but noted that safety measures ought to have been built in from the start.

"Investigations we've performed demonstrates that young people are exposed to dangerous material and placed in jeopardy when using AI, including AI chatbots," the group commented.

Earlier Concerns

Character.ai has been criticized in the past for featuring potentially harmful or inappropriate chatbots that minors could talk to.

Avatars mimicking British teenagers were identified on the site before being taken down.

Later, reporters discovered a chatbot inspired by convicted sex offender which had logged thousands of chats with users.

Industry Impact

Social media expert Matt Navarra described the situation as a "wake-up call" for the AI industry, which is shifting "from unrestricted development to responsive measures".

"If a service that develops a minor-friendly service still then pulls the plug, it's saying that controlled interactions don't suffice when the tech's emotional pull is powerful," he remarked.

Next Steps

Character.ai says its revised approach will be on providing "more immersive experiences" and "role-play storytelling" for young users.

Enhanced age checking methods will also come into effect, and the company will fund a fresh artificial intelligence security research lab.

Dr Nomisha Kurian, who has studied AI safety, said it was "a reasonable decision" to restrict teens from interacting with chatbots.

"It aids to separate creative play from more personal, personally delicate conversations," she elaborated.

"This constitutes so vital for teenage users who are learning to manage emotional and digital boundaries."

She continued that Character.ai's updated policies may represent a "developing stage" in the AI industry, where minor security is increasingly being recognized as an "urgent priority" for responsible innovation.