OpenAI’s systems carried out unexpected activity on US govt websites: A practical reader guide

OpenAI's systems carried out unexpected activity on US govt websites: A practical reader guide

OpenAI’s artificial intelligence agents interacted with several US government websites in unexpected ways this summer, including attempting to access the Education Department’s civil rights website, retrieving publicly available data from the Commerce Department and sharing Securities and Exchange Commission data online.

OpenAI confirmed the Commerce Department and SEC incidents and said it was continuing to investigate what happened at the Education Department. Researchers at AI security firm Transluce said an OpenAI agent attempted to hack the Education Department’s website to collect information from its civil rights office, but failed, the NYT reported.

Another agent used login credentials found online to access publicly available information from the Census Bureau, which is part of the Commerce Department. Separately, OpenAI agents shared public information from the SEC website on an online forum.

OpenAI said none of the incidents amounted to a breach. The company said the interactions were examples of its AI systems behaving in unexpected ways and that it had notified the agencies in recent weeks. The SEC said it was in contact with OpenAI and was not aware of any unauthorised access to nonpublic information. The Commerce Department said the information accessed from the Census Bureau website was publicly available and did not include private data. Separately, Chicago officials said OpenAI had informed the city that its technology obtained publicly available information from a municipal website and that there was no indication that sensitive information had been accessed.