For the complete documentation index, see llms.txt. This page is also available as Markdown.

How to Set Up Knowledge Base Crawls

Crawl your Data Sources and gather documents to fulfill user requests.

How to Set Up a Scheduled Incremental KB Crawl

After you set up a Knowledge Base as a Data Source, you can configure the data source to be crawled at an interval or on demand. In the Aisera Admin UI navigate to Settings > Data Sources, then select the data source you would like to configure. This will open the Data Source Details page.

The Data Source Details page shows key information on the right side, including the data source purpose, current run status, apps that use it, current schedule, and creation date.

The Executions table displays a history of all crawls that have been or are currently being run for this data source.

Scheduling the Crawl

To configure the crawl schedule:

  1. Click the Pencil icon at the top of the Data Source Details page to begin editing the Data Source.

  2. Under General, configure the Schedule and Data Retrieval fields.

  3. Select OK to complete the configuration.

The Schedule field dictates the frequency at which documents are updated or brought in from the original knowledge base. By default, the data source will be set to On Demand. On demand data source crawls are manually initiated in the Aisera Admin UI. Click the Play icon in the top right of the Data Source Details page to initiate an On Demand crawl. Alternatively, the Data Source can be configured to crawl for data at set intervals or based on a custom cron expression.

The Data Retrieval field determines how data is ingested into the Aisera Platform, and can be set to Incremental or Date Range.

  • Incremental will retrieve only the articles which have been created or updated since the last ingestion.

  • Range will pull only data created or updated within the specified range. You may leave the End Date blank to pull all articles up to the current time.

Last updated

Was this helpful?