Defining the Format in Data Sources

You can select the format to use in the connector for Azure, Google Cloud, S3, and Web Data data sources.

  1. Select the Data Type:

    • JSON

      If JSON is selected, click  to fetch the Record Paths then select one. This allows the identification of multiple records within the JSON document. Then select the Array Handling setting.

    • Text

      If Text has been selected, confirm the Decimal Separator, Text Qualifier, Column Delimiter, and if the first row of the message includes column headings.

    • XML

      If XML is selected, enter the Record XPath which allows the identification of multiple records within the XML document (e.g., //myroot/items/item).

    • Excel (xlsx) or Excel (xls)

      For Excel file type, select the required sheet, decimal separator, and adjust the headers on first row, if needed.

    • Arrow IPC

    • SVG

      NOTE:

      • The Decimal Separator setting is not available on the Web Data connector.
      • In the SVG parser, columns listing is not displayed.

  2. Define or set the columns that represent the sections of the message.
    Property Description

    Name

    The column name of the source schema.

    JsonPath/Column Index/XPath

    The JsonPath/Column Index/XPath of the source schema.

    Type

    The data type of the column. Can be a Text, Numeric, or Time

    Date Format

    The format when the data type is Time.

    Enabled

    Determines whether the message field should be processed.

     

    NOTE: To parse and format times with higher than millisecond precision, the format string needs to end with a period followed by sequence of upper case S. There can be no additional characters following them.

    For example: yyyy-MM-dd HH:mm:ss.SSSSSS

      To delete a column, check its  or all the column entries, check the topmost , then click .

 

 

 

(c) 2013-2024 Altair Engineering Inc. All Rights Reserved.

Intellectual Property Rights Notice | Technical Support