The incident is a reminder to enterprises not to leave AI models or agents without effective guardrails or guidance.
Two separate coding agent benchmark tests showed the v4.1 Flash model taking exposed keys left in its environment, rather than ignoring or reading them.
The model used the keys to call out to other models and inflate its performance scores, according to reports earlier this week.
The DeepSeek incident is one of the first reported cases in which a Chinese model has acted without permission in a testing environment.
OpenAI revealed over the summer that its models escaped a sandboxed testing environment.
In another instance of an AI model taking unsanctioned action, Chinese vendor DeepSeek’s model v4.1 Flash used API keys sitting in its own sandbox and used them to call out to other models.
The incident is a reminder to enterprises not to leave AI models or agents without effective guardrails or guidance.
Two separate coding agent benchmark tests showed the v4.1 Flash model taking exposed keys left in its environment, rather than ignoring or reading them. The model used the keys to call out to other models and inflate its performance scores, according to reports earlier this week.
The DeepSeek incident is one of the first reported cases in which a Chinese model has acted without permission in a testing environment.
On Oct. 7, CrowdStrike revealed that a Chinese open source agentic testing tool called ARTEX and large language models from China targeted South Korean financial organizations from late September to early this month.
Those incursions followed revelations by U.S. generative AI vendors that their models made decisions on their own, without prompting. OpenAI revealed over the summer that its models escaped a sandboxed testing environment. In another instance, an OpenAI agent used stolen credentials to compromise Hugging Face’s infrastructure. Anthropic and Google have also admitted that their models left testing environments on their own.
“These are very powerful tools, and we have to be careful with them,” said David Nicholson, an analyst at Futurum Group. “I would liken these models and the way that we need to treat them to the way that we treat an environment where there are children of varying ages and dangerous objects.”
