Set thresholds for your workflow before the pilot begins. There is no single accuracy percentage or savings target that suits every business.
- Time per completed task
- Compare the current process with the pilot, including reading, corrections, approvals and exception handling. A fast draft that creates more review work is not a time saving.
- Accepted output and important errors
- Check against an agreed source and scoring guide. Record correct outputs, revisions and serious mistakes separately, using the same representative cases for comparison.
- Handoffs and failed connections
- Measure how often a person must take over, why the assistant declined a task and whether failed or repeated requests leave the business record in a safe, known state.
- Cost per accepted task
- Include model calls, connected services, infrastructure and human review. Use the expected workload to judge the ongoing cost, not just the price of a demonstration.
Continue
The agreed thresholds are met, reviewers trust the evidence and operating cost is acceptable. Add the next small scope only after agreeing its permissions and support.
Adjust
The idea helps, but weak sources, frequent exceptions or review effort limit its value. Fix the input, simplify the workflow or reduce its permissions, then test again.
Stop
Pause on an unauthorised disclosure or action, unacceptable errors or a breached cost cap. Disable the affected connection and use the manual fallback while investigating. Stop if the work offers no useful improvement.