New York has become the latest US state to crack down on artificial intelligence companies, passing sweeping new restrictions that prevent chatbots from acting as companions to children.

Governor Kathy Hochul signed the law on Wednesday, making New York one of the first states to impose broad limits on how AI tools can interact with young users.

The new rules force chatbot operators like OpenAI’s ChatGPT to verify users’ ages and strip back features when someone under 18 logs on. The technology cannot pretend to be human, alive or capable of feeling emotions. It also cannot suggest it has a personal or professional relationship with the user, or present itself as an authority figure.

Chatbots will also be banned from framing their responses as personal opinions when used by minors.

“No longer will minors have access to chatbots that pretend to be their friends, boyfriends and girlfriends,” Hochul said at Wednesday’s signing ceremony. “No longer will chatbots be able to keep sensitive information about a minor’s emotional and physical health.”

While California and other states have passed similar measures, New York’s law uses some of the broadest language yet to regulate the technology. That has drawn criticism from the tech industry.

Tech:NYC, an advocacy group representing the sector in New York, took aim at what it called the law’s “vague language”.

“Keeping kids safe online should not mean cutting them off from tools that help them learn and prepare for careers,” the group said in a statement.

ALSO READ: The hidden dependency crisis: How AI chatbots hook children

AI giants OpenAI and Anthropic both declined to comment when contacted by AFP.

But Common Sense Media, a nonprofit that provides parents with guidance on age-appropriate content, praised the move. The group called it “the strongest kids’ AI safety bill in the country”.

“AI companies offer chatbots with features that are dangerous, and even deadly, for kids and teens,” said Jim Steyer, the organisation’s chief executive. “Now, those harmful features will be outlawed in New York.”

The law comes as regulators worldwide grapple with how to manage the rapid growth of AI tools. Concerns have mounted over the potential for chatbots to manipulate young users or provide harmful advice, particularly around mental health.

ALSO READ: OpenAI launches ChatGPT for teens with enhanced safety features