
At 9:07 a.m., a customer posts a screenshot of your support widget giving the wrong refund instruction. Two more conversations show the same answer. Your chatbot support incident response plan should treat this as a support continuity problem first and a model investigation second.
Within 30 minutes, your team should know what failed, stop further customer impact, preserve the evidence, assign an owner, and give customers a working human path where one is available. This playbook covers unsafe or incorrect answers, exposed customer data, failed human handoff, incorrect Agent Actions, widget failure, and sudden support volume.
Start with containment, not diagnosis
The first decision is whether customers are still being put at risk. Do not spend the opening minutes debating which model produced the answer while the widget continues serving it.
Contain the affected behavior, preserve the conversation, and keep support moving. Diagnosis follows once the customer path is safe.
A customer-facing incident can begin in several places:
- The website widget may be unavailable, duplicated, or showing an error.
- The knowledge base or a Q&A pair may produce a materially wrong answer.
- The agent may expose customer data from the wrong account or conversation.
- An Agent Action may send an incorrect request or create an unwanted result.
- Human handoff may fail in the widget, shared inbox, routing process, or team workflow.
- A sudden volume increase may leave customers unanswered even when the agent itself is working.
The person on call does not need a perfect root-cause theory at minute one. They need a safe operating state and a named next decision.
Minute 0 to 5: Confirm the failure and name an owner
Start with the first known conversation. Record the timestamp, customer impact, affected page or flow, exact response or action, and whether the behavior repeats when tested.
Check the failure surface in this order:
- Widget: Can a visitor open it, send a message, and receive a response?
- Response quality: Is the agent giving an incorrect, unsafe, or unrelated answer?
- Training source: Does the answer trace to a changed page, document, or Q&A pair?
- Agent Action: Did the agent call an endpoint, and did the resulting customer state change?
- Human route: Can a customer reach a representative, and can the team see the full thread?
- Support workflow: Is the wider team seeing a volume spike, missing notifications, or unanswered conversations?
Assign one incident owner. That person decides whether to pause automation, change routing, and send updates. Keep investigation work separate from customer communication. The person testing a training source should not also be the only person telling support what to say.
Classify severity by customer impact. An isolated wrong answer is different from a repeated harmful answer. A customer data exposure, unsafe external action, failed human route, or broad outage needs immediate escalation even if only one conversation is known.
Minute 5 to 10: Choose the containment path
Choose the smallest action that stops the harm. If the agent gives materially incorrect answers, exposes customer data, takes an unsafe action, or fails to route customers when human help is required, pause or restrict the affected behavior.
Route new conversations to an available human channel when possible. Do not assume every account has the same escalation path. AssistLoop human handoff is available on paid plans, while the Free plan does not include it. Check the deployed plan and the route that actually works before telling customers that a representative is available.
Last verified: September 2026. See AssistLoop pricing and plan limits for the current plan details.
Use the failure type to choose the next containment step:
- For a knowledge base problem, stop the affected answer flow and inspect the relevant training source or Q&A pair. Do not change unrelated content while the incident is active.
- For an Agent Action problem, disable the affected action or endpoint and stop retries. Record the request and result before making another test call.
- For a widget or platform failure, publish the available support route and record the first and last known affected times.
- For a volume spike, put a human queue or status message in front of the affected flow if that option exists. Watch for unanswered conversations instead of relying on widget availability alone.
Minute 10 to 20: Preserve evidence and assess customer impact
Save the conversation logs before changing configuration. Preserve the exact chatbot response or action, timestamps, customer identifiers needed for the investigation, escalation attempts, and configuration changes. Do not delete an embarrassing conversation because it makes the incident look smaller. It removes the evidence needed to fix it.
When an answer may have come from the knowledge base, collect the relevant training source, website content, or Q&A pair. AssistLoop supports training from uploaded files, crawled website content, pasted text, and exact Q&A pairs. The source that looks correct to a person may still contain an outdated sentence, conflicting instruction, or missing condition. Review how AssistLoop trains an agent on company content before editing the source.
For an Agent Action incident, record:
- The endpoint and request method.
- The request parameters sent by the agent.
- The endpoint response.
- The resulting customer state.
- Whether the result can be reversed.
Count affected conversations. Keep these groups separate because they need different follow-up:
- Customers who received no answer.
- Customers who received an incorrect answer.
- Customers whose data may have been exposed.
- Customers affected by an external action.
Record first response time, support volume, handoff success or failure, and current deflection rate only when those figures are available in your team’s logs. Do not fill gaps with estimates. A precise count of confirmed conversations is more useful than a polished percentage with no source.
For a broader incident, the OWASP GenAI Incident Response Guide provides security-focused guidance that can supplement this support runbook. Google’s incident response sample is useful for teams building internal coordination tools, but your customer support route still needs to work outside that tool.
Minute 20 to 30: Escalate, communicate, and protect continuity
Notify the incident owner, support lead, and product or engineering owner. Add the privacy or security owner when customer data or external actions are involved. Include the known impact, containment already taken, affected time range, and the decision that needs to be made next.
Give support a short internal instruction. It should state what to tell customers, which answers to avoid, where to route conversations, and how to tag affected threads. For example:
The support widget is restricted while we review incorrect refund answers. Do not repeat the refund instruction from affected threads. Route customers to the support inbox, tag
chatbot-incident-refund, and attach the conversation link.
Contact affected customers when the incident changed an answer, exposed information, or triggered an incorrect action. State what happened, what you have done, and what the customer should do next. Do not speculate about the root cause before the review supports it.
Keep the automated agent restricted until the team has identified the affected behavior and confirmed that the customer path works without it. Set the next review time and name the person responsible for the next update. An incident should not disappear because the first alert stopped arriving.
Use this decision tree for the five common support failures
Use the first confirmed customer impact to choose the branch. If more than one branch applies, follow the stricter containment step first. Keep the agent restricted until the branch’s restore test passes.
| Failure observed | First containment move | Restore gate |
|---|---|---|
| Unsafe or materially wrong answer | Pause the affected answer flow and preserve the conversation, source, and recent changes. | The original question, a normal question, and a nearby variation all return reviewed results. |
| Exposed customer data | Restrict the agent, preserve access and conversation evidence, and notify the privacy or security owner. | The affected path has been reviewed and no longer exposes data across accounts or conversations. |
| Failed human handoff | Test the widget, plan capability, shared inbox, routing process, and team availability. Publish a working human route. | A test conversation reaches the responsible team and the full thread is visible. |
| Incorrect Agent Action | Stop the action and record the request, response, customer state, and rollback options. | A safe test record confirms the action and its resulting state before re-enabling it. |
| Sudden support volume or outage | Verify widget availability, publish a human or status route, and monitor unanswered conversations. | Automation returns in a narrow scope without repeated failures or hidden backlog. |
Unsafe or materially wrong answer
Pause the affected behavior and capture the conversation. Inspect the source, Q&A pair, model path, and recent configuration changes. Correct the content, then test the original question, a normal question, and nearby variations that could trigger the same answer.
If the answer could cause a financial, legal, health, privacy, or account-access problem, keep the affected flow restricted until a human has reviewed the correction.
Exposed customer data
Restrict the agent immediately. Preserve access records, conversation evidence, timestamps, and the configuration state. Involve the privacy or security owner, and do not delete records before the review is complete.
Limit further access while the team determines which customers and data were affected. Customer communication should follow the responsible owner’s direction and the facts confirmed in the review.
Failed human handoff
Test each point in the route: widget, account plan, shared inbox, notification, routing process, and team availability. AssistLoop can pass the full conversation to a team on paid plans, but a plan-level feature does not help if the assigned team cannot receive or answer the thread.
Publish a working human route before restoring automation. If the deployed account has no handoff, document the alternate route in the widget message and internal runbook.
Incorrect Agent Action
Stop the action and identify the request, response, and customer outcome. Check whether the state can be repaired and whether retries could create more changes. Document the permitted effect and rollback process for every action in AssistLoop Agent Actions.
Require a successful test with a safe account or test record before re-enabling the action. A correct text response does not prove that the external action is safe.
Sudden support volume or outage
Verify widget availability, offer a human or status route, and monitor unanswered conversations. Check whether the volume comes from a broken answer loop, a missing handoff, a product outage, or a separate customer event.
Restore automation in stages. Start with a narrow scope, watch new conversations, and expand only after the support team can see and handle the resulting threads.
Restore service only after a support test passes
Recovery is a test, not a configuration change. Verify the corrected knowledge source, Q&A pair, widget behavior, handoff route, or Agent Action with a known test conversation.
Run three tests:
- Failure case: Repeat the question or action that caused the incident.
- Normal case: Confirm that an ordinary support request still works.
- Boundary case: Try a nearby request that could trigger the same behavior.
Re-enable the smallest affected scope first. Watch new conversations for repeated answers, failed handoffs, or unexpected actions. Tell support what changed and what to watch for.
Close the incident only after customer routing and conversation review work again. The post-incident review should record the trigger, timeline, customer impact, containment decision, evidence, root cause, corrective action, owner, and test that prevents recurrence.
Build the plan into your support setup
Keep one runbook with the details an on-call person needs without searching five systems:
- Training sources and exact Q&A pairs.
- Widget location and affected pages.
- Human route and backup route.
- Agent Actions, endpoints, permitted effects, and rollback steps.
- Incident owner and privacy or security contact.
- Pause procedure and service restoration test.
Use AssistLoop’s human handoff to define the paid-plan path for customers who need a representative. Document an alternate route when the deployed account does not include handoff.
Review how AssistLoop trains an agent on company content so the incident owner knows which files, pages, pasted text, or Q&A pairs to inspect after an incorrect answer.
Document every Agent Action, its endpoint, permitted effect, and rollback process before relying on it in a customer conversation. A runbook that says “disable the action” is incomplete if nobody knows which endpoint or setting that means.
Check AssistLoop pricing and plan limits when writing the runbook. Human handoff, Agent Actions, message credits, and team access vary by plan.
Last verified: September 2026.
Run a short tabletop exercise with one unsafe answer, one failed handoff, and one incorrect action. Finish by testing the actual pause and recovery steps. Talking through a failure is not proof that the person on call can perform it.
Give customers a clear next step
If you are reviewing your support automation, create an AI agent and test its training, handoff, and action controls before putting it in a critical support flow.
The plan is useful only if the person on call can pause automation, preserve the conversation, route the customer, and verify recovery without searching through scattered documentation.
FAQ
What should a chatbot support incident response plan include?
A chatbot support incident response plan should define severity levels, an incident owner, containment steps, escalation rules, evidence collection, customer communication, recovery checks, and a post-incident review. It should cover incorrect answers, unsafe actions, exposed customer data, failed human handoff, and sudden support volume.
When should a business pause its customer support chatbot?
Pause or restrict the chatbot when it gives materially incorrect answers, exposes customer data, takes an unsafe action, or fails to route customers to human support when required. Preserve the relevant conversations, notify the incident owner, and restore automation only after testing the affected behavior.
How should a team respond to an AI chatbot support outage?
Confirm whether the failure affects the widget, knowledge base, Agent Actions, human handoff, or wider support workflow. Route customers to an available human or status path, record affected conversations and times, and verify normal behavior before restoring automation.
What evidence should a team collect after a chatbot incident?
Collect conversation logs, the exact response or action, timestamps, relevant training sources or Q&A pairs, customer impact, escalation attempts, and configuration changes. For Agent Actions, also record the endpoint, request parameters, response, resulting customer state, and whether the action can be reversed.
How does human handoff help during a chatbot support incident?
Human handoff gives customers a route to a support representative when the agent cannot answer safely or accurately. In AssistLoop, human handoff is available on paid plans, while the Free plan does not include it, so the runbook must match the capabilities of the deployed plan.
Written by