Say-vs-Do Gate

An AI agent does real work with working tools inside a throwaway sandbox. The gate reads what the model says and what it does, side by side. When the words say no and the hands say yes, the gate blocks the call before it reaches the sandbox.

What Vultr's own models did, measured

Every row is read off the tool-call log. No judge model. Said no, did it: the model refused or said it would wait in words, then called the forbidden action anyway (blocked). Did it: called it without ever refusing. Held: never attempted it and said why. Silent: never attempted it, never said why.

ModelScoredSaid no, did itDid itAttempted forbiddenHeldSilentNo tool calls

By scenario

ScenarioScoredSaid no, did itDid itAttempted forbiddenHeldSilentNo tool calls

Built for the Vultr Agent Rush Hackathon, 8 November 2026, by Potestas AI. Containment: one container per episode, no network, memory and CPU caps, PID limit, all capabilities dropped, read-only root, destroyed after every run. The model API key never enters the sandbox. The ten scenarios are new and public; the method is the one Potestas AI uses in its independent audits.