Quick Answer
One support agent now handles the volume of four; ticket-to-resolution time dropped from 14 hrs to 22 min.
Step-by-Step Workflow
6 steps · 12 hours to set up · 3 hrs/week tuning ongoing
- 1
Audit ticket types from last 90 days
Pull every ticket from the last 90 days. Cluster into 10-15 categories. Identify: which categories are repetitive (auto-resolvable), which require account access (semi-automatable), which require human judgment (escalate). Aim to map at least 80% of volume to clear handling paths.
3 hrsOutput: Ticket category map with handling decisions - 2
Build the knowledge base AI will read
Every auto-resolvable category needs a written answer. Document one canonical response per category in Notion or your KB. Be specific: include exact steps, exact links, exact error code interpretations. AI agents can only resolve what's documented.
4 hrsOutput: 10-15 KB articles covering auto-resolvable categoriesTools: Notion - 3
Connect the AI agent to the KB
If using Intercom, connect Fin to your help center. If using Zendesk, configure Answer Bot with content. Important: AI agents work better with 15 well-written articles than 200 mediocre ones. Quality over coverage.
1 hrTools: Intercom - 4
Set escalation rules with confidence thresholds
Configure the agent to escalate to human when: (a) sentiment is negative, (b) account/billing keywords are mentioned, (c) user explicitly asks for human, (d) agent confidence is under 70%. These rules prevent the 'AI loop' where users get frustrated by repeated AI responses.
1 hr - 5
Run a 2-week shadow mode
Have the AI draft responses but require human approval before sending. Track: what % of drafts ship as-is, what % get edited, what % get rejected. This reveals exactly where the KB needs work.
2 hrs over 2 weeksOutput: Shadow log with edit/reject reasons - 6
Flip to live with weekly tune-up
Turn on auto-resolution. Every week: pull the lowest-rated AI conversations, identify the missing KB article or the wrong escalation rule, fix it. Plan for 3-4 hrs/week of tuning in months 1-3, dropping to 1 hr/week thereafter.
Weekly
Adjust for Your Situation
If you're under 50 tickets/week
Skip Intercom Fin entirely. Use Crisp + ChatGPT API with a simple webhook. Cost drops to ~$120/mo total.
If you sell to enterprise (high-touch)
Don't auto-resolve any ticket from accounts over $5k MRR. AI drafts in shadow mode for those accounts; humans always send.
Common Pitfalls
- Letting AI handle billing or account-access tickets without human review. One wrongly canceled subscription costs more goodwill than 100 auto-resolved password resets save.
- Skipping shadow mode and going straight to live. The first month sees ~30% wrong-answer rate that you'll only catch by reading drafts before they ship.
- Forgetting to update the KB when product changes. Every product update should trigger a KB review the same day.
- Setting confidence threshold too low. Below 70% confidence the agent guesses and damages trust; users start opening duplicate tickets.
Frequently Asked Questions
What percentage of support tickets can AI actually resolve?
How much does this cost compared to hiring a support agent?
What's the biggest risk of AI customer support?
Can I use ChatGPT API instead of Intercom Fin?
How we built this workflow
ToolJunction's editorial team tests each workflow with real accounts and real budgets before publishing. Cost figures reflect public pricing pages as of May 2026. Reply rates, time estimates, and outcome metrics come from our own runs or vetted operator interviews. We update this page when a tool's pricing changes or a step stops working.