If you turned on Shopify Inbox and your AI agent is giving customers vague or half-right answers, the problem is almost never Inbox itself. It is usually that the Knowledge Base app is empty, ignored, or never installed in the first place.
Most merchants find Inbox first, turn it on, and assume it will figure things out on its own. The chat widget looks great on the store, but then a customer asks a real question and gets a response that could apply to any store anywhere. The agent is not being lazy. It just does not have the facts it needs to do better.
This guide walks you through setting both apps up properly, in the right order, so they actually work together the way Shopify designed them to.
Why These Two Apps Belong Together
Think of it this way: Shopify Inbox is the front door and Shopify Knowledge Base is the brain behind it.
Shopify Inbox puts the live chat widget on your storefront. Customers open it to ask questions. You or your staff can reply manually from the Inbox dashboard, or you can switch on the Inbox Agent, an AI that handles conversations automatically around the clock.
Shopify Knowledge Base is a separate free app that holds all the facts the Inbox Agent reads from. It pulls baseline information from your store settings (shipping rules, return policy, customer account setup, language) and builds a starter FAQ automatically. You then layer your own custom questions and answers on top.
When a customer types a question into the chat widget, the Inbox Agent checks your Knowledge Base, your product listings, and your store policies, then replies in seconds. The more complete and accurate your Knowledge Base is, the better those answers will be.
The other thing these two apps do together is close gaps over time. Any question the agent cannot answer confidently gets logged inside Knowledge Base under a section called Top Unanswered Questions. You check it, write the answer once, and the agent knows it from that point forward. That is the actual feedback loop that separates a set-it-and-forget-it chat widget from one that keeps getting better.
Step 1: Install Shopify Inbox and Turn On the Chat Widget
Install Shopify Inbox from the Shopify App Store if you have not already. Once installed, go to your Shopify admin and navigate to Online Store > Themes > Customize. Inside the theme editor, find App embeds in the left panel and toggle on Online store chat.
This is where you set the basics: the chat button color, its position on the page (bottom left or right), and the greeting message customers see when they open the widget. Keep the greeting short and specific to your store. "Hi, ask us anything about your order or our products" works better than a generic hello.
Step 2: Turn On the Inbox Agent
In your Shopify admin, go to Sales Channels > Inbox. You will see an option to set up the Inbox Agent, which handles conversations automatically rather than routing every message to your staff. This is completely opt-in. Your existing setup stays staff-handled until you flip it on.
The agent can respond 24 hours a day, handle multiple conversations at once, and pull answers from your product catalog, store policies, and Knowledge Base. For most merchants, this is the reason to use Inbox in the first place.
One important thing to know before you turn it on: once the agent is active, the instant-answer shortcut buttons in the chat widget become fully agent-generated. There is no manual list to edit anymore. If you want to change what those buttons cover, the way to do it is through your Knowledge Base content, not through Inbox settings directly.
Step 3: Set the Agent's Persona
Still inside Inbox, find the Persona section and click Edit. This is where you tell the agent how to sound when it talks to your customers.
Write a short description of the tone you want. Something like: "Friendly and helpful, like a knowledgeable team member. Keep answers short and clear. Do not compare our products to competitors or make claims that are not in our product listings." You can be as specific as you like here, and you should be. Vague persona instructions produce vague responses.
If you want help wording it, there is a Refine with Sidekick option inside the persona editor.
Note: the persona lives in Inbox settings, but the greeting message customers see first lives in the theme editor from Step 1. They are two separate settings in two different places, which catches a lot of merchants off guard.
Step 4: Install Knowledge Base and Review the Auto-Generated FAQs
This is the step most merchants skip, and it is the most important one.
Install the free Knowledge Base app from the Shopify App Store. When it opens for the first time, it scans your store settings and automatically generates a starter set of facts covering your shipping options, return policies, customer account setup, and store language.
Go through this list carefully before doing anything else. These auto-generated answers are based on whatever is currently in your settings, so if your shipping settings are incomplete or your return policy has a nuance not captured in the standard fields, the auto-generated FAQ will reflect that gap.
You can override any auto-generated entry to fix the wording, but you cannot delete auto-generated facts entirely. Only FAQs you create manually can be fully removed. There is a "Return to default" option if you override something and later want to undo it.
Step 5: Add Custom FAQs for Everything Specific to Your Business
The auto-generated facts cover the basics. What they cannot cover is everything that makes your store different from every other store. That is what custom FAQs are for.
Click Add FAQ inside Knowledge Base. Write the question the way a real customer would phrase it, not the way you would phrase it internally. "Do you offer local pickup?" lands better than "Local pickup availability." Then write a short, direct answer, one or two sentences is plenty.
Here are the types of questions worth adding first:
- Questions about your products that are not obvious from the listings (sizing, materials, compatibility, custom options)
- Questions about services you offer beyond standard e-commerce
- Questions about your business specifically (where you are based, how long you have been around, what makes you different)
- Any question you already get repeatedly by email or phone
If you are unsure where to start, look at your email inbox or any past support tickets. The questions that show up most often are the ones that belong in Knowledge Base first.
Step 6: Test Before You Go Live
Knowledge Base has a built-in Test your knowledge base feature. Type a question a customer might realistically ask and see exactly what the agent would match it to. If nothing matches, that is your signal to add a new FAQ before a real customer hits the same dead end.
Run through at least five to ten real questions before going live. Use the actual language your customers use, not formal or technical phrasing. If the agent cannot match a question that you know the answer to, add it now while you are thinking about it.
Step 7: Monitor and Close Gaps Weekly
Once the agent is live, check Top Unanswered Questions inside Knowledge Base once a week. This section shows you the questions real customers asked that the agent could not confidently answer. Each one is an opportunity to improve the agent for the next customer who asks something similar.
The first few weeks after launch usually produce the biggest list of gaps because you will learn quickly what your customers actually want to know. After that, the list stays manageable with a short weekly review.
Things to Know Before You Hit Them
A few things that are not obvious until you are already set up:
- "Track my order" is always there. This shortcut button appears in the chat widget by default regardless of whether the agent is on. You can turn it off but not remove it entirely.
- Changes take time to appear. After you add or edit a Knowledge Base entry, it may not reflect in the agent's live responses immediately. Use the Test feature to check rather than assuming something is not working.
- Auto-generated FAQs update automatically. When you change your return policy or shipping settings in Shopify, the connected Knowledge Base facts update from the same source. Keep your store settings current and those facts stay accurate.
- The Inbox Agent is an early-access feature. The setup screen and available options can vary between stores, so your admin may look slightly different from screenshots in guides including this one.
Quick Setup Checklist
- Install Shopify Inbox and turn on Online store chat in the theme editor
- Set your greeting message in the theme editor
- Turn on the Inbox Agent inside Inbox settings
- Write the agent persona with tone and guardrails
- Install Knowledge Base and review all auto-generated FAQs for accuracy
- Add custom FAQs for your products, services, and anything specific to your business
- Test at least five to ten realistic customer questions before going live
- Check Top Unanswered Questions weekly and keep adding answers
Frequently Asked Questions
Is Shopify Inbox free?
Yes. Both Shopify Inbox and the Knowledge Base app are free to install and use. The Inbox Agent (the AI that handles conversations automatically) is included at no extra cost. There is no paid tier or usage limit tied to either app.
Can I use Shopify Inbox without turning on the AI agent?
Yes. Inbox works in a staff-only mode where every conversation goes to your team to answer manually. The AI agent is opt-in. You can use the chat widget, the mobile app, and the Inbox dashboard without ever enabling the agent. Turn it on when you are ready and have your Knowledge Base filled in first.
What happens when the AI agent cannot answer a customer's question?
Two things happen. First, the agent tells the customer it is not sure and offers to connect them with a team member. Second, that question gets logged automatically inside Knowledge Base under Top Unanswered Questions. You review that list, write the answer, and the agent handles the same question correctly next time. The gap-closing loop is built in, but only if you check it regularly.
How many FAQs do I need to add to Knowledge Base before going live?
There is no magic number, but a reasonable starting point is 10 to 15 custom FAQs on top of the auto-generated ones. Cover your most common customer questions about products, shipping specifics, returns, and anything unique to your business. Use the Test feature to verify the agent can match those questions before you turn it on. You can always add more after launch as the unanswered questions list grows.
Can you delete the auto-generated FAQs in Knowledge Base?
No. FAQs that Knowledge Base generates automatically from your store settings (shipping, returns, language, customer accounts) can be overridden with your own wording, but they cannot be deleted. Only FAQs you create manually can be removed. If an auto-generated entry is inaccurate, use the Override option to rewrite it. There is a "Return to default" button if you want to undo an override later.
Does Knowledge Base update automatically when I change my Shopify settings?
Yes, for the auto-generated facts. If you update your return policy or shipping rules in Shopify, the corresponding Knowledge Base entries update from the same source. You do not need to manually sync them. Custom FAQs you have written yourself do not auto-update since Shopify has no way to infer what they should say when your business changes, so those are your responsibility to maintain.
What is the difference between the agent persona and the greeting message?
They are two separate settings that live in two different places, which is one of the most common points of confusion. The greeting message is the first thing customers see when they open the chat widget. You set it in the theme editor under App embeds. The persona controls how the agent sounds in every response it generates. You set it inside Sales Channels > Inbox > Persona. Change one and the other stays exactly as it was.
How do I know if my Knowledge Base is actually helping the agent give better answers?
The clearest signal is the Top Unanswered Questions list getting shorter over time. When you first launch, it fills up fast because there are gaps. As you fill those gaps with new FAQs, the same questions stop appearing. You can also use the Test feature to ask the same questions week to week and see whether the matched results improve. If the agent is still pulling wrong answers, check whether your auto-generated FAQs have been overridden correctly and whether your store settings (the source they pull from) are up to date.
Can customers tell they are talking to an AI?
Shopify does not require the agent to identify itself as an AI, and the persona you write controls how it introduces itself. That said, writing a persona that sounds robotic or overly formal tends to make it obvious. A natural, conversational tone set in the persona editor goes a long way. If a customer asks directly whether they are talking to a bot, the agent will typically acknowledge it and offer to connect them with a real person.
The Bottom Line
Shopify Inbox and Knowledge Base are designed as a pair. Inbox handles the conversation, and Knowledge Base holds the source of truth the agent answers from. Set them up separately and one or both of them underperform. Set them up together in this order and you end up with an automated support tool that actually knows your store and improves every week as you use it.
The setup takes less than an hour. The ongoing maintenance is a few minutes a week. And customers stop getting generic answers that could have come from any store online.
Need help getting this set up for your store? Nala Networks helps Shopify merchants configure Inbox and Knowledge Base so your AI agent gives accurate, on-brand answers from day one. Get in touch and we will have you live fast.