Altair® Panopticon

 

Defining the Format in Data Sources

 

You can select the format to use in the connector for Azure, Google Cloud, Microsoft OneDrive, S3, and Web Data data sources.

Steps:

1.      Select the Data Type:

 

 

·        JSON

If JSON is selected, enter the Record Path which allows the identification of multiple records within the JSON document (e.g., myroot.items.item).

 

·        Text

If Text is selected, confirm the Decimal Separator, Text Qualifier, Column Delimiter, and if the first row of the message includes column headings.

 

·        XML

If XML is selected, enter the Record XPath which allows the identification of multiple records within the XML document (e.g., //myroot/items/item).

 

 

·        Excel (xlsx) or Excel (xls)

For Excel file type, select the required sheet and adjust the headers on first row, if needed.

 

·        Arrow IPC

 

2.      Define or set the columns that represent the sections of the file.

3.      Property

Description

Name

The column name of the source schema.

JsonPath/Column Index/XPath

The JsonPath/Column Index/XPath of the source schema.

Type

The data type of the column. Can be a Text, Numeric, or Time

Date Format

The format when the data type is Time.

Enabled

Determines whether the message field should be processed.

 

   NOTE

To parse and format times with higher than millisecond precision, the format string needs to end with a period followed by sequence of uppercase S. There can be no additional characters following them.

For example: yyyy-MM-dd HH:mm:ss.SSSSSS

 

To delete a column, check its  or all the column entries, check the topmost , then click .