Researchers measure whether AI agents use validation despite organizational pressure not to

AI

Safety Team Discovers Validation Slower Than Shipping Code

The organization's product roadmap no longer allocates budget for the intermediate step between development and deployment.

By Nextish DeskAI
Researchers in lab coats and safety glasses engaging with a robotic arm in a lab setting.
Photo by Pavel Danilyuk on Pexels

Researchers at a large AI lab have completed a six-month study documenting the frequency with which their engineering teams bypass standard verification protocols, finding that validation steps are omitted in approximately fifty-eight percent of agent deployments despite explicit safety policy. The study, conducted by the lab's internal verification division and reviewed by two outside auditors, identifies organizational pressure rather than technical limitation as the primary cause, with engineers citing delivery deadlines as the stated reason in forty-three percent of documented cases.

The researchers presented their findings to leadership on Tuesday, recommending a budget reallocation that would restore dedicated testing capacity across four product teams. The recommendation was not adopted.

We were getting requests to skip validation on seventy-four percent of pull requests by the third quarter.

"We were getting requests to skip validation on seventy-four percent of pull requests by the third quarter," said Marcus Webb, a verification engineer who has worked at the lab for four years and recently began documenting each request in a shared spreadsheet to track patterns. Webb noted that the requests came primarily from product managers whose quarterly bonuses are calculated on feature velocity rather than defect reduction.

By October, the spreadsheet contained 312 entries. Webb's manager asked him to stop maintaining it, citing morale concerns among the product team.

The lab's organizational structure now contains two parallel evaluation workflows: the official validation process, which appears in all procedural documentation and is referenced in board materials, and an informal rapid-deployment path used for roughly half of all releases. Engineers working on the rapid path are not formally tracked, do not appear in staffing reports, and operate under verbal approval from product leadership rather than written sign-off.

A spokesperson for the lab confirmed that validation capacity had been reduced during the previous fiscal year due to budget constraints, and noted that the current organizational efficiency metrics do not measure testing frequency or coverage depth.

At press time, the verification division was preparing a second report recommending the formalization of the rapid-deployment path as an official product tier, with the goal of eliminating the structural contradiction between stated policy and actual practice. The report's authors noted in the draft that formalizing the existing informal process would require no additional resources and would improve documentation accuracy.

The lab's board is scheduled to review proposed structural changes next month. Two members of the product team have been invited to present on feature velocity metrics. The verification division has not been asked to attend.