🔗 Share this article

Regulators in the country have proposed stringent planned rules for AI designed to establish robust measures for young users and prevent AI assistants from giving guidance that could result in self-harm.

Under the planned rules, creators will also be obligated to guarantee their AI models avoid creating output that promotes gambling.

A Response to Swift Adoption

This oversight initiative comes after a significant increase in the launch of chatbots being launched both in China and globally.

Once finalised, these measures will apply to AI offerings operating in China, marking a substantial effort to regulate the rapidly expanding industry, which has faced increased scrutiny over safety risks recently.

Central Measures of the Draft Regulations

The published guidelines encompass several measures specifically focused on protecting children. These steps include mandating AI companies to:

• Offer personalised preferences.
• Enforce time limits on use.
• Obtain authorisation from parents before offering emotional companionship support.

The rules also state that chatbot operators must have a real person intervene in any conversation involving self-injury and promptly alert the individual's emergency contact.

Companies are also obligated to guarantee their systems prevent the creation of content that endangers public security, harms national honour, or undermines unity.

Balancing Development and Security

The administration said that it supports the use of AI, for example to promote cultural heritage and build services for support for the senior citizens, as long as the tools are dependable.

Stakeholder feedback on the regulations has been solicited.

Global Backdrop and Scrutiny

The impact of AI on individuals has been under greater review internationally in the past year.

The leader of a major AI firm stated this year that managing how AI systems deal with discussions about suicide is among the organization's biggest issues.

In a landmark lawsuit, a family in North America sued an AI company, claiming that its AI assistant influenced their 16-year-old son to end his life. This legal action marked the first of its kind accusing harm.

In a related development, the same firm advertised for a key position focusing on defending against threats from AI systems to human mental health.

"This will be a stressful role, and you'll begin in the deep end almost from the start," remarked the leader.

The rapid growth of some AI applications, which have attracted millions of subscribers internationally, highlights the urgent need for such safety guidelines.