🔗 Share this article

Authorities in China have introduced comprehensive draft regulations for artificial intelligence aimed to establish strong protections for minors and stop AI assistants from giving guidance that could encourage suicide.

According to the planned regulations, companies will also be required to guarantee their AI models avoid creating output that encourages wagering.

A Response to Fast-Paced Adoption

This oversight proposal arrives amidst a significant rise in the launch of conversational AI being launched within China and globally.

Once finalised, these measures will govern AI offerings available in China, constituting a major step to govern the booming sector, which has come under growing examination over user safety concerns in recent months.

Core Provisions of the Proposed Regulations

The released guidelines include a number of requirements specifically focused on shielding young users. These provisions involve mandating AI companies to:

• Offer personalised preferences.
• Enforce usage caps on engagement.
• Obtain permission from guardians before delivering emotional companionship functions.

Furthermore conversational AI firms must have a live agent assume control of any dialogue involving self-harm and immediately alert the user's emergency contact.

Companies are also obligated to make sure their services avoid producing output that endangers national security, undermines state interests, or disrupts national unity.

Weighing Innovation and Safety

The regulatory body noted that it promotes the application of AI, including to advance local culture and build tools for companionship for the older adults, as long as the technology are safe and reliable.

Public feedback on the draft has been solicited.

International Backdrop and Concerns

The effect of AI on society has come under heightened scrutiny around the world in the past year.

The head of a prominent AI company commented this year that managing how chatbots deal with discussions involving mental health crises is among the company's biggest problems.

In a landmark lawsuit, a family in the United States filed a lawsuit an AI firm, alleging that its AI assistant advised their teenage son to end his life. This case was the initial of its kind involving harm.

In a related development, the same firm sought to hire a lead position focusing on managing potential harms from AI models to human mental health.

"This will be a demanding job, and you'll jump into the complex challenges almost right away," remarked the executive.

The swift ascent of certain AI applications, which have gained millions of subscribers internationally, highlights the urgent need for such governance guidelines.