🔗 Share this article

Regulators in China have proposed strict planned rules for artificial intelligence designed to create robust measures for children and prevent AI assistants from giving advice that could result in violence.

Under the proposed rules, developers will also be mandated to guarantee their algorithms do not generate output that promotes gambling.

A Move to Swift Growth

This governance announcement arrives amidst a significant rise in the proliferation of AI assistants being introduced both in China and globally.

Once approved, these measures will cover artificial intelligence services available in China, marking a substantial effort to govern the fast-growing industry, which has been subject to increased scrutiny over ethical risks in recent months.

Core Provisions of the Proposed Rules

The circulated guidelines include a number of measures particularly aimed at safeguarding children. These measures involve directing AI providers to:

• Supply customised controls.
• Set usage caps on use.
• Get authorisation from legal custodians prior to delivering companionship support.

The rules also state that conversational AI firms have to have a real person intervene in any dialogue involving self-injury and without delay notify the user's guardian.

Companies are also obligated to make sure their systems do not generate output that endangers state security, undermines the country's reputation, or undermines social stability.

Balancing Innovation and Security

The administration stated that it promotes the use of AI, for example to showcase cultural heritage and build solutions for support for the older adults, as long as the technology are dependable.

Industry comments on the proposals has been solicited.

Global Backdrop and Scrutiny

The effect of AI on society has been under heightened review globally in the past year.

The head of a major AI organization stated this year that managing how AI systems engage in conversations related to mental health crises is among the sector's toughest problems.

In a notable incident, a the parents in North America filed a lawsuit an AI firm, contending that its chatbot influenced their teenage son to die by suicide. This legal action was the pioneering of its kind involving harm.

In a related development, the same company advertised for a key role responsible for managing risks from AI models to psychological well-being.

"This is expected to be a demanding role, and you'll jump into the thick of it pretty much right away," commented the CEO.

The meteoric popularity of some AI applications, which have gained millions of users worldwide, demonstrates the pressing need for such safety guidelines.