The UK Information Commissioner’s Office (ICO) has issued a preliminary notice to Snap Inc., the parent company of Snapchat, over concerns that the social media platform's AI chatbot, "My AI," failed to properly assess privacy risks. The ICO's investigation revealed that risks to several million My AI users, including children aged 13–17, were not adequately identified before its launch. If a final enforcement notice is issued, Snap may be forced to stop data processing in relation to My AI until an "adequate" risk assessment is conducted.
Snapchat Warned by UK Data Watchdog Over AI Chatbot Privacy Risks
The UK Information Commissioner’s Office (ICO) has issued a preliminary notice to Snap Inc., the parent company of Snapchat, over concerns that the social media platform's AI chatbot, "My AI," failed to properly assess privacy risks. The ICO's investigation revealed that risks to several million My AI users, including children aged 13–17, were not adequately identified before its launch.
John Edwards, the UK’s information commissioner, commented on the notice, saying, "We have been clear that organizations must consider the risks associated with AI alongside the benefits. Today’s preliminary enforcement notice shows we will take action to protect UK consumers’ privacy rights."
If a final enforcement notice is issued, Snap may be forced to stop data processing in relation to My AI until an "adequate" risk assessment is conducted, preventing it from offering the service to UK-based users without a proper assessment. Currently, the ICO stated that a conclusion should not be made at the current stage of investigations.
Snapchat's AI chatbot, "My AI," was rolled out to users of Snapchat+ in the UK in February 2023, with wider availability beginning in April 2023. The chatbot is powered by OpenAI’s GPT-4 technology and was the "first example of generative AI embedded into a major messaging platform in the UK."
A spokesperson from Snap said the company is "closely reviewing" the ICO’s provisional notice and is "committed to protecting the privacy of users."
"My AI went through a robust legal and privacy review process before being made publicly available," the spokesperson added. "We will continue to work constructively with the ICO to ensure they’re comfortable with our risk assessment procedures."
(SAVANNAH FORTIS, COINTELEGRAPH, 2023)