Leading AI Agents as Team Members
When you need this method
You want to deploy AI agents in sales and go-to-market, but the results are unpredictable: agents hallucinate, produce scrap, or act autonomously in the wrong places. Without defined roles and control points you get either sprawl or, out of caution, nothing at all. Both waste the real lever: routine work to agents, judgment and relationships with humans.
Approach
- 1Write a charter per agent: role, mandate, metric, permitted and forbidden actions, an explicit hand-off point to a human.
- 2Install quality gates: human sign-off before the agent acts externally; one measurable KPI per phase.
- 3Concentrate human-in-the-loop on the decision: agents handle research and preparation, the human reviews, judges, and owns the relationship.
- 4Review agents like employees: weekly inspection of outputs, tightening charter and gates based on what you find.
Typical application
A typical case: a B2B SaaS team deploys an agent for account research ahead of first calls. Initially without rules, the dossiers are sometimes brilliant, sometimes invented, and no one trusts the output. The team writes a charter (mandate: research and call preparation; forbidden: sending messages on its own), defines a quality gate (the AE reviews every dossier before use), and measures time saved per preparation. Extended research turns into a short read, while a human still runs every conversation and makes every decision.
Limits and counter-indications
The approach is a synthesis from practice and not independently validated, operationally plausible, but not a proven framework with comparative studies. It presupposes a clean data and context foundation; agents on bad data merely scale the scrap. For teams without any AI groundwork (poor data quality, no shared playbook) it is a premature step, foundation first, agents second.
How to measure impact
Output quality at the quality gates (approval versus rework rate) and working time saved per task at constant or better result quality.
Related methods
Tools for this
Sources
- 1.Thomas B. Sheridan, William L. Verplank: Human and Computer Control of Undersea Teleoperators. Technical Report, MIT Man-Machine Systems Laboratory für das Office of Naval Research, 1978, 340 S. (DTIC ADA057655) (opens in a new tab) · 1978 · academic and scholarly literature · describes the methodDefines human supervisory control as the operating model for semi-autonomous systems, a system capable of autonomous decision-making over short periods and in restricted conditions is remotely monitored and intermittently operated directly or reprogrammed by a person, and names the human supervisor's functions: command (program and commit a task to action), plan, monitor, intervene and trust; Table 8.2 grades the levels of automation in man-computer decision-making, i.e. the threshold at which the machine must involve the human.
- 2.NIST AI Risk Management Framework (AI RMF 1.0), National Institute of Standards and Technology, 2023 (opens in a new tab) · National Institute of Standards and Technology (NIST), U.S. Department of Commerce · 2023 · investment, consulting and analyst firms, industry bodies and public agencies · describes the methodSupports the guardrails of the method: the voluntary framework lists as intended outcomes that roles and responsibilities for human-AI configurations are defined and differentiated (GOVERN 3.2), that human oversight procedures are documented and tested, and that mechanisms are in place to supersede, disengage or deactivate a system (MANAGE 2.4). It creates no obligation.
- 3.Klaus Christoffersen, David D. Woods: How to make automated systems team players. In: Advances in Human Performance and Cognitive Engineering Research, Bd. 2, Emerald, 2002, S. 1–12 (opens in a new tab) · 2002 · academic and scholarly literature · supports the underlying mechanismStates the requirement to design automated agents as team players and names two preconditions: observability (users must perceive what the automated agents are doing and will do next) and directability (users must be able to re-direct machine activities fluently). Also shows that apparent system performance often exists only because humans compensate for machine deficiencies.
- 4.Gary Klein, David D. Woods, Jeffrey M. Bradshaw, Robert R. Hoffman, Paul J. Feltovich: Ten Challenges for Making Automation a "Team Player" in Joint Human-Agent Activity. IEEE Intelligent Systems 19(6), 2004, S. 91–95, DOI 10.1109/MIS.2004.74 (opens in a new tab) · 2004 · academic and scholarly literature · supports the underlying mechanismCondenses the conditions under which a machine agent can function as a team member into ten challenges, among them a basic compact to work toward shared goals, adequate models of others' capabilities and intentions, predictability, directability, revealing status and intentions, interpreting signals, goal negotiation, attention management and controlling the costs of coordination.
Origin: Convios