Skip to main content
Skip table of contents

Configuring a Data Pipeline with transformation

Before configuring a Data Pipeline with transformation, the following steps should be completed:

  1. Provision a Data ETL service (App Connect)

  2. Engage IBM Integration services (through Expert Labs) to build an App Connect flow to perform the file transformation

image-20231222-005124.png

The process for configuring a Data Pipeline with transformation is similar to Configuring a Data Pipeline without transformation. The only additional steps required are:

  1. In the Data Transformer field - select the Data ETL service instead of None.

  2. Optionally, use the Additional Parameters field to set the following parameters for file processing (refer to the panel below for further information):

    1. csvDelimiter

    2. decimalSeparator

    3. thousandsSeparator

    4. csvEncoding

Additional Parameters can be used to process files which do not match the default values below. Note that these parameters are currently only enabled for Data Pipelines using an App Connect transformation.

If the additional parameters field is blank, the following default values will be used.

  • “csvDelimiter”: “,”

  • “decimalSeparator”: “.”

  • “thousandsSeparator”: “,”

  • “csvEncoding”: “UTF-8”

The format of the additional parameters field must be a valid JSON string as shown in the screenshot above.

JavaScript errors detected

Please note, these errors can depend on your browser setup.

If this problem persists, please contact our support.