Guides
Sign inTry Now

Add Sitemaps

Learn how to add sitemaps as a source of data for AI-Bot training

Suggest Edits

Did you know that you can generate a Sitemap (a list of all the URLs in your website) and add them all at once as a source of data to train your Bot?

Uploading a sitemap is especially useful if you have an existing help center or a knowledge base site with tons of pages and articles. However, instead of copying every single URL from your website, Botsonic can generate a list of URLs and you can choose and select which ones to add for training your Bot.


Step 1 - View the Bot Settings

Click [Home] from the left hand side menu to access your [Dashboard]. Click to open a bot from the the "Your Bots" section. If you haven't created a Bot yet, read this Quick Start Guide



Step 2 - Add a Sitemap

👉

Botsonic can access and reference content from most websites, with a few exceptions:

  • webpages that are not published publicly
  • webpages that restrict crawling
  • content that is behind paywalls or requires user authentication
  • webpages that primarily consists of image, audio, or video content without any accompanying texts

  1. Click [Sources], then click [Links].
  2. You can either crawl webpages by providing a top-level domain or submit an XML sitemap.
  3. Click [Continue] or [Load sitemap]
  4. Review the list of links generated, uncheck the ones you don't want to include, then hit [Start training].

Step 3 - View Link Status

Click [Sources], then click [Links] to view if the link status is waiting, processing, and trained


Step 4 - Configure the Link Settings

Pause File Usage

Click the [3-dot] icon, then click [View Details]. Toggle ON to temporarily pause file usage as a data Source for your Bot.


Enable or Disable File Visibility as Reference

Toggle ON to set the file to be shown as a reference on your chatbot's responses.


Edit the link

  1. Click the [3-dot] icon, then click [View details] to open the link settings
  2. Click [edit], then edit the link
  3. Click [Save]

Delete the uploaded link

Click [View details] to open the file settings, then click [Delete]

Note: Bulk deletion of links is not possible


View Extracted Data

To quickly view the extracted data to verify the contents of the link you've uploaded, click the [Extracted Data] tab from the file settings panel.

👉

Autosync Data from Links (Webpages, Google Docs, Google Sheets)

Did you know that you can automatically synchronize the data from links (webpages, Google Docs, Google Sheets) that you've added as a training source for your Bot? In other words, once you've enabled AutoSync, Botsonic will use the latest data from the website pages that you've added in your Sources section. To learn more, read this step by step guide on how to Auto Sync Data from Webpages

Set Autosync or Sync Now

You can automatically synchronize the data from webpage links that you've added as a training source for your Bot. Once you've enabled AutoSync, Botsonic will use the latest data from the website pages that you've added in your Sources section. To learn more, read this step by step guide on how to Auto Sync Data from Webpages

Updated 5 months ago