Configuring and Refreshing a Data Export Data Pipeline

Configuring the Pipeline

1. Navigate to Admin → Data Flow Automation

2. From Data Services page, navigate to Data Pipelines.

3. Select Add New Pipeline button found on upper-right corner of the list of data pipelines. This will open Add New Pipeline screen.

   

4. On Add New Pipeline screen:

   1. Enter the unique Name of the pipeline.

   2. Enter the optional Description of the pipeline.

   3. Select Data Export under Type.

   4. Select Monthly Dataset under Dataset.

   5. Select from an enabled S3 or SFTP Data Export Data Service under Destination.

   6. Choose Save button to save the new data pipeline. Otherwise, choose Cancel button to cancel the creation of the new data pipeline.

5. The newly created data pipeline will appear on the list of data pipelines.

Scheduled Refresh

Once a Data Export pipeline has been created, the Envizi Monthly Dataset will be automatically pushed to the linked Data Export data services on a daily basis. This scheduled process aligns with the daily update of data in the Monthly Dataset so generally there is no benefit from refreshing the data more frequently.

Manual Refresh

A manual refresh option is provided for scenarios where the Envizi Monthly Dataset files must be exported immediately and cannot wait for the overnight scheduled refresh to run.

To manually trigger the export of Envizi Monthly Dataset files:

1. Navigate to Admin → Data Flow Automation

2. From Data Services page, navigate to Data Pipelines.

3. Select the Manual Refresh action for the Data Export pipeline which will create a job to send the latest Envizi Monthly Dataset files to linked Data Export data services.

4. You can check the status of the file transfer from the Data Export Status page.