# Data Ingestion

## Ingesting Data

Data ingestion is the process of intaking data onto the Aisera Platform. This can be done through the creation of a [Connector](https://docs.aisera.com/aisera-platform/adding-data-to-your-tenant/integrations-and-data-sources). Alternatively, you may opt to use [APIs and Webhooks](https://app.gitbook.com/s/k4yi9BewsGoT4eKpZoaG/apis/ingestion-apis) to ingest data into the Aisera Platform.

Data ingestion is an automated process controlled by the Schedule parameter of the Data Source configuration. After you have created a valid Data Source you may also manually run ingestion jobs, which is useful for testing, troubleshooting, or forcing ingestion when content has changed since the last run.

### Supported File Types

The Data Ingestion function supports the following file types: `.boxnote`, `.html`, `.md`, `.pdf`, `.ppt`, and `.txt`.

### **Manually Running a Data Ingestion Job**

To run a data ingestion job:

1. Use the **Settings > Data Sources** command to navigate to the **Data Source Details** page.
2. Choose an existing valid Data Source, [or add and configure a **New Data Source**](https://docs.aisera.com/aisera-platform/adding-data-to-your-tenant/integrations-and-data-sources/creating-a-connector/adding-and-managing-data-sources-in-your-tenant)**.**
3. On the **Data Source Details** page, select the play button in the upper-right corner to start the data ingestion job.<br>

   <figure><img src="https://3281977978-files.gitbook.io/~/files/v0/b/gitbook-x-prod.appspot.com/o/spaces%2FvBFXjH9S1CAy9f5hzg5Q%2Fuploads%2FYdqZTMnLMRg3p7QpoJyX%2Fdata_ingestion2.png?alt=media&#x26;token=bca62875-f24d-429a-915b-bd77e1d654ac" alt=""><figcaption><p>Start Data Source Ingestion</p></figcaption></figure>

The Data Source Details window displays the metrics for the data as it is ingested. You will see the functions that have been selected while creating a data source and details of all the jobs executed.

<figure><img src="https://3281977978-files.gitbook.io/~/files/v0/b/gitbook-x-prod.appspot.com/o/spaces%2FvBFXjH9S1CAy9f5hzg5Q%2Fuploads%2F0mLCkKu3igbd6qJBvrxE%2Fdata_ingestion_metrics.png?alt=media&#x26;token=173922fe-8309-4bd9-b374-112c534fb77f" alt=""><figcaption><p>See Grouped Metrics</p></figcaption></figure>

The results show the metrics of the ingestion, such as the **Number of Users**, **User Groups**, and **User Profiles** ingested in every run.&#x20;

The lower portion of the **Data Source Details** page lists all of the fields that have contributed data. In other words, these are the default fields from your data source that are mapped to the fields of the Aisera platform.

<figure><img src="https://3281977978-files.gitbook.io/~/files/v0/b/gitbook-x-prod.appspot.com/o/spaces%2FvBFXjH9S1CAy9f5hzg5Q%2Fuploads%2F1bbY8DwJ5w74NpdWBHtN%2Fdata_fields_ingested.png?alt=media&#x26;token=3f9ae7b0-e8c1-4872-afaa-34168f288fb6" alt=""><figcaption></figcaption></figure>

The example above displays the **Ticket Fields** that contain ingested data. If you chose the **User** tab, you would see the **User Fields** that contain ingested data.&#x20;

{% hint style="info" %}
After setting up parameters for your Integration and Data Source and successfully ingesting data you will still need to attach the Data Source to bots that you create. If the Data Source is not attached to the bot it will not be able to use the Ingested Data.
{% endhint %}

### Continue Reading

* [Field Mapping](https://docs.aisera.com/aisera-platform/adding-data-to-your-tenant/data-ingestion/field-mappings) - How data from a Data Source is Mapped to the Aisera Platform
* [PII Anonymization](https://docs.aisera.com/aisera-platform/adding-data-to-your-tenant/data-ingestion/setting-up-anonymization-pii-and-custom-recognizer) - How to detect and remove PII from your ingested data
* [Post-Ingestion Tasks ](https://docs.aisera.com/aisera-platform/adding-data-to-your-tenant/post-ingestion-tasks-system-jobs)- Steps required after Data Ingestion to make data available for use on the Aisera Platform
* [Troubleshooting Data Ingestion](https://docs.aisera.com/aisera-platform/adding-data-to-your-tenant/data-ingestion/troubleshooting-data-ingestion) - Common issues and questions related to data ingestion