The autonomy envelope: drawing deterministic boundaries for AI agents
Venkat Siva (Sivasubramanian), CEO of CompFly AI, with Lockhart and Gary Chan
When a human pulls a CRM record, security teams look for human context to proxy intent — unusual hours, sudden bulk exports, or HR signals. But when an AI support agent runs that exact same sequence, those human signals disappear, and we end up treating autonomous code execution like standard, predictable API traffic. The primary risk in agentic AI is not just prompt injection: it is an agent chaining together legitimate permissions to create an unintended outcome at machine speed. You cannot catch this with a basic filter — you need a clearly defined autonomy envelope to establish deterministic boundaries. Reading an audit log after the fact is not enough; you need a dedicated control plane.
- Identity: giving every agent a verifiable identity tied to its function
- Pre-flight: running structural evaluations before pushing to production
- Runtime: enforcing deterministic guardrails without a massive latency tax