Advertisement

Illinois bans AI from providing mental health services

Illinois Gov. JB Pritzker approved a new law banning the use of artificial intelligence systems in providing psychotherapy services.
Listen to this article
0:00
Learn more. This feature uses an automated voice, which may result in occasional errors in pronunciation, tone, or sentiment.
J.B. Pritzker
Illinois Gov. J.B. Pritzker speaks during a transgender support rally at Federal Building Plaza on April 27, 2022 in Chicago, Illinois. (Scott Olson / Getty Images)

Illinois Gov. JB Pritzker last Friday signed a bill into law banning the use of artificial intelligence from providing mental health services, aiming to protect residents from potentially harmful advice.

Known as the Wellness and Oversight for Psychological Resources Act, the law prohibits AI systems from delivering therapeutic treatment or making clinical decisions. The legislation still allows AI tools to be used in administrative roles, such as scheduling or note-taking, but draws a clear boundary around direct patient care.

Companies or individuals found to be in violation could face $10,000 in fines, enforced by the Illinois Department of Financial and Professional Regulation.

“The people of Illinois deserve quality healthcare from real, qualified professionals and not computer programs that pull information from all corners of the internet to generate responses that harm patients,” Mario Treto, Jr., Illinois’ financial regulation secretary, said in a press release. “This legislation stands as our commitment to safeguarding the well-being of our residents by ensuring that mental health services are delivered by trained experts who prioritize patient care above all else.”

Advertisement

The new legislation is a response to growing concerns over the use of AI in sensitive areas like health care. The Washington Post reported last May that an AI-powered therapist chatbot recommended “a small hit of meth to get through this week” to a fictional former addict.

Last year, the Illinois House Health Care Licenses and Insurance Committees held a joint hearing on AI in health insurance in which legislators and experts warned that AI systems lack the empathy, accountability or clinical oversight necessary for safe mental health treatment.

“When we talk about AI, it is already outpacing the human mind, and it’s only a matter of time before they outpace our structures and our systems — particularly when it comes to regulations and healthcare,” state Rep. Bob Morgan, who chairs the House’s health care licenses committee, said during the hearing.  

Florida Gov. Ron DeSantis has also indicated that state-level AI regulations are coming soon in his state, calling artificial intelligence “the biggest issue” facing society and the economy. DeSantis said Florida will develop its own AI policy in the next few months.

Sophia Fox-Sowell

Written by Sophia Fox-Sowell

Sophia Fox-Sowell reports on artificial intelligence, cybersecurity and government regulation for StateScoop. She was previously a multimedia producer for CNET, where her coverage focused on private sector innovation in food production, climate change and space through podcasts and video content. She earned her bachelor’s in anthropology at Wagner College and master’s in media innovation from Northeastern University.

Latest Podcasts