Chapter 15 / 20
15. Set Boundaries Before Delegating
Provisional draft. These short chapters are not approved for publication. Original practitioner interviews, deeper reporting and author review remain outstanding.
An agent can draft a patch, open a PR, and explain its intent. It can also be wrong about the edge case it was never shown. The next decision is not whether a human is "in the loop" on a slide. It is what the human can actually inspect, when they have authority to stop, and whether the result can be undone.
Set permissions by task. A documentation draft might use approved internal pages and create no external effect. A proposed code change should carry tests and provenance into a human review. A production write needs narrower authority, a demonstrated recovery path, and explicit authorization. Treat untrusted documents and issue text as data that may contain instructions to an agent; constrain tools and data exposure accordingly. The same control should apply to comparable human and AI changes where their risks are comparable.
Policies are usable only if people know when not to use the tool. Sensitive information, an uncheckable answer, a ten-minute direct task, and protected independent practice are all legitimate reasons to decline. A blanket prohibition may drive work underground; a usage quota may reward performative prompts. State who can approve an exception, how it is recorded, and how an engineer can challenge a generated change without being penalized for slowing a dashboard.
Evaluation is a rehearsal of the work the agent will actually do. Include routine tasks, failure cases, changing context, and the cases where a superficially correct result would cause harm. Record whether an evaluator caught the error, not merely whether a model produced a confident explanation. A rollback plan should include migrations and external side effects that redeploying old code cannot reverse.
At the junction: Draw three columns for a proposed workflow: can read, can propose, can change. Put a named human decision owner and verification test beside each consequential action. If the owner cannot examine the evidence in time, reduce the agent's authority before scaling it.
No external sources cited in this chapter. Browse all references →