> For the complete documentation index, see [llms.txt](https://docs.aisera.com/llms.txt). Markdown versions of documentation pages are available by appending `.md` to page URLs; this page is available as [Markdown](https://docs.aisera.com/aisera-platform/adding-data-to-your-tenant/data-ingestion/how-to-set-up-knowledge-base-crawls.md).

# How to Set Up Knowledge Base Crawls

## How to Set Up a Scheduled Incremental KB Crawl <a href="#v6o6u9jysc2" id="v6o6u9jysc2"></a>

After you set up a [Knowledge Base as a Data Source](/aisera-platform/adding-data-to-your-tenant/integrations-and-data-sources.md), you can configure the data source to be crawled at an interval or on demand. In the Aisera Admin UI navigate to **Settings > Data Sources,** then select the data source you would like to configure. This will open the **Data Source Details** page.

The **Data Source Details** page shows key information on the right side, including the data source purpose, current run status, apps that use it, current schedule, and creation date.

The **Executions** table displays a history of all crawls that have been or are currently being run for this data source.

### Scheduling the Crawl <a href="#v6o6u9jysc2" id="v6o6u9jysc2"></a>

To configure the crawl schedule:

1. Click the **Pencil** icon at the top of the **Data Source Details** page to begin editing the Data Source.
2. Under **General**, configure the **Schedule** and **Data Retrieval** fields.
3. Select **OK** to complete the configuration.

The **Schedule** field dictates the frequency at which documents are updated or brought in from the original knowledge base. By default, the data source will be set to **On Demand**. On demand data source crawls are manually initiated in the Aisera Admin UI. Click the **Play** icon in the top right of the **Data Source Details** page to initiate an **On Demand** crawl. Alternatively, the Data Source can be configured to crawl for data at set intervals or based on a custom [cron expression](https://en.wikipedia.org/wiki/Cron).

The **Data Retrieval** field determines how data is ingested into the Aisera Platform, and can be set to **Incremental** or **Date Range.**

* **Incremental** will retrieve only the articles which have been created or updated since the last ingestion.
* **Range** will pull only data created or updated within the specified range. You may leave the **End Date** blank to pull all articles up to the current time.