Authorization and tool permissions
Can you define which tools the agent may call, which records or fields it may change, and which identity or tenant boundaries apply?
Evidence to request: Ask for the actual policy configuration and a denied-action example, not only a general security statement.
Human approval
Can risky actions pause before execution so a reviewer sees the proposed tool, arguments, risk, and intended effect?
Evidence to request: Verify whether approval applies per action, per workflow, or only through a conversation handoff.
Policy enforcement
Are business rules enforced deterministically before execution, or supplied only as natural-language guidance to the model?
Evidence to request: Request tests showing what happens when model output conflicts with the policy.
Auditability and observability
Does the platform preserve the decision path, retrieved evidence, tool arguments, approval decision, execution result, and errors?
Evidence to request: Confirm retention, exportability, access controls, and how records correlate across a conversation and external system.
Reversibility and failure recovery
Which actions are genuinely reversible, who can initiate recovery, and how are partial failures or duplicate attempts handled?
Evidence to request: Do not treat retries as rollback. Test recovery separately for every consequential integration.
Escalation
Can the agent hand off on explicit rules, uncertainty, customer request, policy conditions, or failed tools while preserving context?
Evidence to request: Verify the routing target, fallback behavior, and whether autonomous execution stops after handoff.