Glossary term
Human-in-the-loop
A design in which people review, approve or correct AI outputs or actions at defined points.
Patterns range from drafting for a person to send, to approval of proposed system changes, to sampling review of automated actions.
Effective oversight gives reviewers context and evidence and monitors for automation bias.
Related terms
- AI agentA system in which a language model decides which actions to take, calls tools to take them and uses the results to choose its next step.
- GuardrailsRuntime checks on the inputs and outputs of an AI system that block, modify or escalate content that breaks defined rules.
- Agentic workflowA business process in which AI components plan or execute some steps, usually alongside fixed steps and human approvals.
Turning concepts into a working system?
We help teams choose the right pattern and build it with evaluation from day one.