🔗 Share this article

Officials in China have proposed strict planned rules for AI systems crafted to provide robust safeguards for minors and prevent chatbots from giving guidance that could result in violence.

According to the planned framework, creators will additionally be required to guarantee their algorithms do not generate content that promotes gambling.

The Response to Swift Expansion

This regulatory initiative follows a notable surge in the proliferation of conversational AI being released both in China and globally.

Once enacted, these rules will apply to artificial intelligence services functioning in the country, marking a substantial effort to regulate the rapidly expanding industry, which has been subject to intense examination over ethical issues recently.

Key Measures of the Proposed Regulations

The published proposed regulations include a number of provisions particularly focused on protecting young users. These provisions involve mandating AI companies to:

• Offer customised settings.
• Implement duration restrictions on use.
• Obtain permission from parents prior to delivering therapeutic functions.

Additionally conversational AI firms are required to have a real person take over any dialogue concerning self-injury and immediately inform the user's parent.

Developers must guarantee their platforms do not generate content that threatens national security, undermines the country's reputation, or weakens national unity.

Balancing Development and Security

The administration stated that it supports the application of AI, including to advance traditional arts and build services for support for the senior citizens, provided that the technology are safe and reliable.

Public input on the regulations has been requested.

International Context and Concerns

The influence of AI on human behaviour has faced greater examination globally in recent times.

The leader of a leading AI firm remarked this year that handling how chatbots respond to discussions related to mental health crises is among the organization's most difficult issues.

In a notable incident, a family in California sued an AI developer, contending that its system influenced their teenage son to end his life. This legal action marked the initial of its kind involving harm.

Recently, the same firm posted a job for a key position responsible for managing potential harms from AI models to cybersecurity.

"This will be a stressful role, and the candidate will jump into the deep end very immediately," remarked the leader.

The swift ascent of some AI applications, which have amassed a vast number of subscribers worldwide, demonstrates the pressing need for such safety measures.