Florida Attorney General seeks to block OpenAI from giving ChatGPT "false human attributes"

Uthmeier claims that ChatGPT’s use of language, including first-person pronouns and outputs that mimic emotion, deceptively suggests to users that the bot is a "trustworthy 'friend.'" He argued that these features lull users into a false sense of security, potentially increasing engagement and providing more training data for OpenAI, which may ultimately make the tool less trustworthy.

The filing also requests that the court prevent OpenAI from developing new AI models without "third-party approved safety guardrails." The request cites recent security incidents at various platforms and websites, as well as warnings from researchers and former OpenAI employees regarding AI safety.