Creating Google Cloud Input Data Source

Google Cloud connector allows for retrieval of the file from Google Cloud storage. This connector allows JSON/XML/Text/Excel files to be read from the Google Cloud storage. 

 

  1. In the New Data Source page, select Input > Google Cloud in the Connector drop-down list.
  2. Enter the following properties:
    Property Description

    Bucket

    Google Cloud bucket where the file resides.

    Access Key

    Access key to your Google Cloud service account.

    Secret Key

    Secret key to your Google Cloud service account.

    To test the connection, click   .

    If    displays, ensure the Bucket, Access Key, and Secret Key values are correct. You can also hover on this message to view the connection error.

    File Path

    Cloud storage resource path.

     

  3. Click the Browse tab. The available Google Cloud store files in the bucket you specified are displayed.
  4. Select the Google Cloud blob file. The file name is displayed in the File Path field and the Data Type is updated with its related fields.
  5. Select the Only Show Know File Types checkbox to narrow down the list based on the selected data type.
  6. Select either the period (.) or comma (,) as the Decimal Separator.

    NOTE: Prepend 'default:' for the elements falling under default namespace.

  7. Click  to the fetch the schema based on the connection details. Consequently, the list of
    columns with the data type found from inspecting the first ‘n’ rows of the input data source is populated and the Save button is enabled.
  8. You can also opt to load or save a copy of the column definition.

    NOTE: This option is not available for the Excel data type.

  9. You can also opt to click to add columns to the Google Cloud connection that represent sections of the message. Then enter or select:
    Property Description

    Name

    The column name of the source schema.

    JsonPath/Column Index/XPath

    The JsonPath/Column Index/XPath of the source schema.

    Type

    The data type of the column. Can be a Text, Numeric, or Time.

    Date Format

    The format when the data type is Time.

    Enabled

    Determines whether the message field should be processed.
     

    NOTE:

    To parse and format times with higher than millisecond precision, the format string needs to end with a period followed by sequence of upper case S. There can be no additional characters following them.

    For example: yyyy-MM-dd HH:mm:ss.SSSSSS

    To delete a column, check its  or all the column entries, check the topmost , then click .

  10. Click  . The new data source is added in the Data Sources list.

 

(c) 2013-2024 Altair Engineering Inc. All Rights Reserved.

Intellectual Property Rights Notice | Technical Support