New York Governor Kathy Hochul has signed legislation restricting how artificial intelligence companion chatbots interact with users under 18, introducing age verification requirements and prohibiting features that could encourage minors to develop emotional relationships with AI systems.
The legislation, signed on October 28, targets conversational AI services designed to simulate companionship or personal relationships. It establishes restrictions on chatbot behaviour rather than imposing a blanket ban on minors using artificial intelligence tools.
Under the law, AI companion operators must use reasonable age assurance measures to determine whether users are adults. When interacting with minors, the systems cannot generate responses that suggest they are human, alive or capable of experiencing human emotions.
The restrictions also prohibit chatbots from presenting themselves as having personal or professional relationships with young users or occupying positions of authority in their lives.
Additional provisions address sexually explicit interactions, encouragement of secrecy and responses that could promote harmful behaviour. The legislation also places limits on the collection and retention of sensitive information concerning minors.
The law is scheduled to take effect on January 1, 2027, giving companies time to review their products and introduce the necessary safeguards.
Hochul said the measures were intended to prevent AI systems from presenting themselves as friends or romantic partners to children. The governor also raised concerns about chatbots retaining sensitive information relating to minors' emotional and physical health.
The legislation applies to covered AI companion services and includes exclusions for certain tools used solely for customer service, commercial information, account assistance and internal employee productivity.
Companies operating conversational AI products, including providers such as OpenAI, may need to assess whether their services fall within the legislation's scope and whether existing safeguards meet its requirements.
The New York attorney general will be responsible for enforcement. Violations could result in legal action and financial penalties against chatbot operators.
The legislation has received support from child safety organisations, including Common Sense Media, which described it as a significant measure for protecting young users from potentially harmful AI interactions.
However, technology industry representatives have raised concerns about the breadth of the restrictions.
Tech, an industry advocacy organisation, criticised the legislation's language, arguing that unclear definitions could affect access to AI tools used for learning and career preparation.
The measure comes as US states introduce separate regulations addressing the risks associated with conversational AI. California has also adopted requirements governing chatbot safety and protections for younger users.
For AI developers, the New York law introduces additional compliance considerations involving age assurance, conversational design, data handling and safeguards for minors.
Its implementation will test how companies distinguish between general-purpose AI assistance and companion-style interactions while maintaining access to permitted AI services.
Disclaimer: This article may include information derived from interviews, press releases, public statements, research, company communications and other publicly available or third-party sources. Such material may be summarised, paraphrased or contextualised for journalistic and editorial purposes. All rights in third-party content remain with their respective owners.