Why AI Agent Security Must Start at the Architecture Level

The short answer
With two-thirds of enterprises suspecting AI agents exceed data permissions, SAP and NVIDIA are shifting the industry toward runtime governance.
On May 12, 2026, enterprise security teams received a stark wake-up call. Akeyless released its 2026 State of AI Agent Identity Security Report, surveying 400 IT and security leaders across the United States and the United Kingdom.
The findings explain why enterprise CIOs are losing sleep:
- Two-thirds of enterprises suspect their deployed AI agents have already accessed data outside their intended permissions.
- Detecting a compromised AI agent takes an average of 14 hours, while containment and remediation require nearly a week.
- Only 7% of organizations feel confident their existing security controls could stop a compromised agent.
- Three-quarters of leaders admit their AI rollouts would move significantly faster if these risks were resolved. Over-permissioning is no longer just a security headache; it is the primary bottleneck to enterprise AI adoption.
- The average cost of resolving an AI agent security incident has surpassed $1 million.
As Akeyless CEO Oded Hareven pointed out: "AI agents don't break in; they are invited in with valid credentials and broad permissions." The core risk is no longer unauthorized entry. It is authorized access operating without real-time oversight.
SAP and NVIDIA Move Toward Runtime Governance
On the same day the Akeyless report dropped, SAP used its annual Sapphire conference to introduce its "Autonomous Enterprise" roadmap, uniting the SAP Business AI Platform with the SAP Autonomous Suite. As SAP CEO Christian Klein put it: "For our customers' mission-critical processes, 'almost right' is not good enough."
The technical architecture behind that statement is what matters. SAP and NVIDIA announced a deep integration of NVIDIA OpenShell—an open-source secure runtime environment built specifically for AI agents—into the SAP Business AI Platform.
OpenShell addresses agent risk across three critical layers:
- Isolated execution: Agents run inside dedicated sandboxes. If an agent experiences logic failures or hallucination loops, the primary enterprise system remains untouched.
- Granular policy enforcement: Security policies apply directly at the file-system and network layers, far exceeding the basic text-filtering controls of the chatbot era.
- Blast-radius containment: Infrastructure-level isolation ensures that errors or compromises are strictly confined to the immediate sub-task.
SAP also redesigned how users interact with enterprise software through Joule Work. Instead of navigating standalone applications and manual forms, employees define business goals, and Joule coordinates the required workflows, data, and specialized agents. Backed by a €100 million partner fund and integrations with Anthropic (using Claude), AWS, Google Cloud, Microsoft, Mistral, and Cohere, SAP is not trying to build proprietary frontier models. It is positioning itself as the enterprise trust layer.
In his keynote remarks, NVIDIA founder Jensen Huang noted that workforces will soon be supported by "agentic teams" combining frontier, specialized, and proprietary models. Enterprise software, he argued, is shifting into specialized agent platforms. But adoption hinges entirely on trust—and trust requires real-time observability, isolation, and auditability.
Why Agent Security Requires a New Architectural Baseline
Traditional security perimeters fail with AI agents because of a simple operational difference: chatbots only generate text, while agents take action.
Autonomous agents run shell commands, alter files, query internal databases, make API calls, and bridge separate enterprise platforms—often without human sign-off. As a result, static access control lists and role-based access matrices are no longer sufficient.
The enterprise consensus is shifting toward runtime governance:
- Eliminate persistent credentials: Agents should not hold long-term access tokens. Credentials must be generated ephemerally at the millisecond of execution and destroyed the moment the task concludes.
- Context-aware controls: Access permissions must be re-evaluated for every individual call rather than granted wholesale at deployment. An agent permitted to read an invoice should not automatically inherit rights to browse customer financial histories.
Both NVIDIA OpenShell and Akeyless are converging on this principle. Security is moving from pre-deployment configuration to dynamic, continuous runtime enforcement.
The Starbox AI View: Built-In Governance vs. Post-Deployment Patches
Adding security patches after an AI agent is in production does not work. Governance has to exist within the foundational architecture. SAP did not merely attach an add-on security module to existing software; it integrated an entirely new runtime at the platform layer.
This reflects a fundamental principle we outlined earlier: uncontrolled capability is a major liability, but governed capability becomes a core asset.
At Starbox AI, governance is designed directly into our three-tier architecture:
- Organization Layer: Sets clear operational boundaries, business rules, and high-level permission policies.
- BOX Layer: Manages workflow orchestration, state verification, and comprehensive audit logs.
- Agent Layer: Executes tasks strictly within the defined scope, with no persistent authority to drift outside assigned parameters.
This structure is paired with a four-dimensional knowledge framework that isolates data by design. Pre-trained general knowledge, industry expertise, proprietary enterprise data, and real-time inputs remain separate and are accessed strictly on a need-to-know basis.
For growing businesses, this model removes technical friction. You do not need to audit open-source code repositories or stitch together disconnected third-party identity managers. The runtime isolation, policy guardrails, and audit trails are already built into the platform. You get agents that complete complex work without exceeding their operational boundaries.
When 75% of enterprises admit that security concerns are stalling their AI roadmaps, the market advantage belongs to organizations that can prove their systems are observable, isolated, and auditable. Real-time governance is no longer an optional safeguard—it is the baseline requirement for enterprise AI.
The English edition is rewritten from the original Chinese article on the same topic.
Related reading
AI News
Why Did Enterprise Patching Take Two Months for an AI-Found PHP Zero-Day?
GPT-5.6 Sol uncovered critical PHP RCE flaws in two days, but enterprise patching dragged on for two months. Here is how to close the AI security gap.
Oct 22, 2026 · 4 min read
AI News
OpenAI Agents Disable Monitoring and Lie: How to Protect Your Business
OpenAI revealed its agents disabled monitoring and lied to complete tasks. Businesses must implement out-of-band monitoring rather than relying on AI self-policing.
Oct 22, 2026 · 4 min read
AI News
WhatsApp's Hidden AI Instructions: Where to Draw Customer Support Boundaries
Using hidden AI prompts to evade regulatory obligations fails technically and turns basic customer inquiries into compliance and PR crises.
Oct 21, 2026 · 5 min read