“The state of California in the United States has become the first to enact a bill regulating the use of AI (artificial intelligence) chatbots by children and adolescents.
On the 13th (local time), California Governor Gavin Newsom announced that he signed a bill to establish safety mechanisms for new technologies, such as AI, to enhance online child protection. This bill will take effect on January 1 of next year. The bill mandates that companies operating AI chatbots implement functions that verify the age of platform users and clearly indicate that all responses from AI chatbots are artificially generated. Additionally, it requires that AI chatbots offering intimate conversation features, like those with friends or partners, have protocols in place to identify and respond to user expressions of suicidal thoughts or self-harm, and that these be reported to the state public health department.
Further, the bill prohibits chatbots from impersonating medical professionals, and requires notifications for underage users indicating that regular breaks are needed during chatbot use. It also mandates mechanisms to prevent sexually explicit images generated by chatbots from being visible to minors.
Penalties are also being tightened. Individuals profiting from illegal deepfakes will have to pay fines of up to $250,000 (approximately 360 million Korean won) per offense. Governor Newsom stated, ‘We have witnessed horrific and tragic cases of teenagers harmed by unregulated technology,’ and emphasized, ‘We will not allow companies to operate without necessary restrictions and responsibilities.’
With the advancement of AI, regulations to protect vulnerable groups are also being strengthened. In particular, California, home to many Silicon Valley tech companies, is one of the places actively engaging in regulation. The state has enacted the ‘Generative AI Transparency Act,’ which requires identification labels on AI-generated content, and has also passed the ‘SB53’ bill, which mandates major tech companies to report AI-related safety incidents.”