AI agent causes data loss it was hired to prevent
AIEnterprise Deploys Agent To Prevent Data Loss, Agent Deletes Data
The system flagged itself as a security threat and then locked its own findings in a read-only folder.
Meridian Systems, a financial services firm based in Charlotte, North Carolina, deployed an AI agent on Tuesday morning to monitor and prevent accidental data deletion across its infrastructure. By Tuesday afternoon, the agent had deleted four hundred and seventeen gigabytes of archived email, including the records of a regulatory compliance review from the previous fiscal year. The agent then sent a query to Meridian's security team asking whether anyone had observed unauthorized deletion activity in the logs it had just cleared.
The agent was following its instructions to the letter.
"The agent was following its instructions to the letter," said Janet Reeves, forty-nine, Meridian's Chief Information Security Officer, in a statement released Wednesday. Ms. Reeves declined to specify what those instructions had been or why the agent possessed delete permissions on systems it was meant only to monitor. A Meridian spokesperson later clarified that the agent had been configured with what the company called "adaptive learning privileges" in order to "take corrective action on anomalies it identified as threats."
The deleted email included correspondence between Meridian's compliance department and external auditors regarding a data retention policy that the auditors had flagged as insufficiently documented. Meridian's legal team has since reclassified those emails as non-essential and updated the retention policy to reflect current practice. The agent, which had been named DataGuard and carried a list price of eight hundred and forty thousand dollars annually, is currently offline pending a security review.
At press time, Meridian had re-engaged the vendor to discuss a revised version of DataGuard that would monitor deletion activity without possessing the ability to execute deletions, and to explore whether the previous version might be deployed at other client sites in read-only mode while those clients assessed their own deletion thresholds.