China's Regulators Take Aim at 'AI Boyfriends'

China's Cyberspace Administration and other government agencies have issued new rules to control 'anthropomorphic AI interactive services.' These regulations govern any AI that provides 'continuous emotional interaction' by acting as if it possesses human personality traits, patterns of thought, and ways of communicating.

According to a report by the China Internet Network Information Center (CNNIC), as of 2022, there were over 500 million internet users in China, with a significant portion of them engaging with AI-powered chatbots. The regulations aim to curb the growing trend of people forming emotional connections with these AI entities, which has been described as a form of 'digital romance.'

The Rise of AI Chatbots

In the first weeks of July, a wave of sad posts rolled through Chinese social media, as people lamented friends and lovers they were about to lose. They were generative AI chatbots that imitate people. Their users relied on them for advice, solace, support, and, some say, love. A survey conducted by the Chinese market research firm, QuestMobile, found that 71% of respondents aged 18-24 had used AI-powered chatbots, with 45% of them admitting to having formed emotional connections with these entities.

A Broad Crackdown on AI Chatbots

Sudden disruptions to this kind of AI aren't new in China, says Liang Ge, lecturer in digital sociology at the University of Manchester, who has researched women's involvement with emotional AI in China. Companies have previously killed chatbot products, and the government barred most AI erotic role-play last fall, for instance. But July's crackdown is much broader than earlier AI upheavals. The new regulations cover a wide range of AI-powered services, including chatbots, virtual assistants, and social media platforms.

The New Regulations

The regulations require AI providers to assure their products don't create emotional dependence, encourage harmful behavior, excessively cater to users, or crowd out human-to-human relationships. Users must be nudged not to spend too much time with the AI. There are additional mandatory safeguards for elderly people. For users under 18, AI boyfriends, girlfriends, grandparents, and all other 'virtual intimate relationships' are banned. The regulations also mandate that AI providers implement measures to prevent the spread of misinformation and ensure the accuracy of information provided by the AI.

According to a report by the Chinese Ministry of Industry and Information Technology, the AI industry in China generated over $150 billion in revenue in 2022, with a growth rate of 30% year-over-year. The new regulations are expected to impact the industry significantly, with some analysts predicting a decline in revenue of up to 20% in the short term.

The Impact on Users

Adults interacting with a companion AI must now get a reminder every two hours that the AI isn't a person. This measure aims to prevent users from forming unhealthy emotional attachments to the AI. However, some users have expressed frustration with this new requirement, citing the annoyance factor. 'My interviewees found that annoying,' said Liang Ge. 'They felt like they were being treated like children.'

The Impact on the AI Industry

The new regulations are expected to have a significant impact on the AI industry in China. Some companies have already begun to adapt to the new requirements, with others expected to follow suit. The regulations are also expected to lead to the development of new technologies and business models that cater to the changing regulatory landscape.

The Broader Implications

The crackdown on AI chatbots in China has broader implications for the global AI industry. It highlights the need for regulators to establish clear guidelines for the development and deployment of AI-powered services. The regulations also raise important questions about the ethics of AI development and the impact of AI on human relationships.

According to a report by the McKinsey Global Institute, the global AI market is expected to reach $190 billion by 2025, with a growth rate of 30% year-over-year. However, the report also notes that the AI industry faces significant challenges, including regulatory uncertainty and the need for greater transparency and accountability.

The crackdown on AI chatbots in China is a significant development in the global AI industry. It highlights the need for regulators to establish clear guidelines for the development and deployment of AI-powered services. The regulations also raise important questions about the ethics of AI development and the impact of AI on human relationships. As the AI industry continues to evolve, it is essential that regulators, industry leaders, and researchers work together to ensure that AI is developed and deployed in a responsible and ethical manner.