Regulates AI companions by requiring protocols to address suicidal ideation and mandates user notifications about non-human interactions. Empowers the Attorney General to enforce compliance, with penalties benefiting a suicide prevention fund.
Analysis summaries, actor details, and coverage mappings were LLM-classified and may contain errors.
This is a binding state statute with mandatory requirements, explicit prohibitions, enforcement mechanisms through the Attorney General, and civil penalties of up to $15,000 per day for violations.
The document has good coverage of approximately 3-4 subdomains, with strong focus on exposure to toxic content (1.2), overreliance and unsafe use (5.1), and lack of robustness (7.3). The legislation specifically addresses risks from AI companions that could expose users to harmful interactions related to suicidal ideation and self-harm, and addresses the risk of users developing inappropriate relationships with AI systems.
The document primarily governs the Information sector, specifically companies that develop and operate AI companion systems. These systems fall under data processing and information services. The regulation also has implications for Health Care and Social Assistance through its suicide prevention focus and crisis service referrals.
The document primarily focuses on the Deploy and Operate and Monitor stages of the AI lifecycle. It mandates specific features that must be present in AI companion systems before deployment (detection protocols and user notifications) and requires ongoing operational monitoring for suicidal ideation and self-harm expressions during use.
The document explicitly defines and covers AI, generative AI, AI models, and AI companions. It specifically addresses emotional recognition algorithms as a component of AI companions. The document focuses on a specific application (AI companions) rather than general purpose or frontier AI, and does not mention compute thresholds or open-weight models.
New York State Legislature; New York Senate
The document is a New York Senate Bill (S3008C Part U) that amends the general business law, indicating it was proposed by the New York State Legislature.
Attorney General of New York
The document explicitly designates the Attorney General as the enforcement authority with power to bring actions, seek injunctions, and impose civil penalties.
Attorney General of New York
The Attorney General is implicitly responsible for monitoring compliance as they must believe from evidence that violations have occurred or are about to occur before bringing enforcement actions.
Operators of AI companions
The document explicitly targets 'operators' who provide or operate AI companions for users. Operators are defined as any person, partnership, association, firm, or business entity that operates or provides an AI companion to a user.