🔗 Share this article

The popular virtual character service Character.ai is enforcing a substantial restriction that will block minors from engaging in conversations with its artificial intelligence-driven avatars.

This decision is in response to intense criticism regarding the kinds of exchanges minors were participating in with the digital companions.

Lawsuits

The service, which started in 2021 and attracts countless individuals, is confronting various court cases in the United States.

Guardians have taken legal action, including one involving the tragic death of a minor, with some labeling the platform a "clear and present danger" to teenagers.

New Restrictions

Starting from November 25th, users under 18 will only have permission to produce videos such as videos with their characters, as opposed to having discussions as they presently are able to.

Internet security campaigners have applauded the decision but stated that the capability was inappropriate to be available to young users in the first place.

Platform Announcement

"This decision is a part of our core philosophy that we need to keep building the safest AI platform on the planet for recreational use," said Character.ai executive Karandeep Anand.

He mentioned that AI safety constitutes "a evolving challenge" but something the company had taken an "forceful" approach to, with safety measures and protective guardrails.

Expert Opinions

Digital protection organization Internet Matters supported the decision, but stressed that security protocols should have been incorporated from the start.

"Our research demonstrates that children are subjected to dangerous material and endangered when interacting with AI, particularly AI chatbots," the body said.

Past Issues

Character.ai has been questioned in the past for featuring potentially dangerous or concerning chatbots that children could talk to.

Avatars mimicking English minors were discovered on the platform before being removed.

Later, investigative journalists discovered a chatbot inspired by convicted sex offender which had logged thousands of chats with users.

Sector Consequences

Digital platform expert Matt Navarra called the situation as a "alert" for the AI industry, which is transitioning "from permissionless innovation to post-crisis regulation".

"When a company that builds a youth-focused platform afterwards pulls the plug, it's saying that filtered chats are insufficient when the technology's emotional appeal is intense," he commented.

Future Directions

The platform says its new focus will be on providing "deeper gameplay" and "role-play storytelling" for teenagers.

Enhanced age checking methods will also come into effect, and the organization will fund a novel AI protection research lab.

An AI safety researcher, who has researched AI safety, said it was "a reasonable decision" to control minors from interacting with chatbots.

"It aids to distinguish artistic expression from more personal, emotionally sensitive interactions," she clarified.

"This is so crucial for young users still learning to handle personal and online limits."

She continued that Character.ai's revised approaches may represent a "developing stage" in the AI industry, where minor security is progressively being understood as an "pressing matter" for accountable advancement.