Connecting to Elasticsearch

The following properties can be specified when loading data from an Elasticsearch connection.

Not all properties listed here may be necessary when creating the data connection. However, at a minimum, basic information must be provided.

Basic Information

  • Title - The name of the connection.
  • Description - The description (optional) of the connection.
  • Use HTTP or HTTPS - Whether the connection protocol should be HTTP or HTTPS
  • Host - The IP address or host name of the storage system.
  • Port - The network port number through which the storage system connects.
  • Trust all SSL certificates - Whether certificate validation should be bypassed in favor of all SSL certificates to establish a secure connection to the database.
  • Username - The user account used to authenticate access to the storage system.
  • Password - The password corresponding to the user account.
  • Enable SSO - Whether to implement SSO for user authentication.

Advanced

Concurrency Control

  • Maximum Allowed Concurrency - The overall limit on concurrent executions used to process the source.
  • Number of Nodes - The number of nodes to use when processing the source.
  • Executors per Node - The number of executors to use per node when processing the source.
  • Maximum Request Rate - The maximum aggregate request rate against the source (e.g., 100 / s, 480 / minute).

Localization Settings

  • Locale - The locale to use when parsing dates and numbers (e.g., ar-SA, en-US, ja-JP).
  • Character Encoding - The default character encoding used by the connection (e.g., EBCDIC, UTF-8).
  • Timezone - The timezone to use for dates and times that don't contain one (e.g., GMT+2, PST).

Data Formats

  • Recognize only the configured formats - Specifies whether only those formats configured here should be recognized.
  • DateTime Formats - How date and time values should be encoded (e.g., yyyy-MM-dd'T'HH:mm:ss, MM/dd/yyyy HH:mm, dd-MMM-yyyy HH:mm:ss).
  • Date Formats - How calendar dates without time information should be encoded (e.g., yyyy-MM-dd, MM/dd/yyyy, dd-MMM-yyyy).
  • Time Formats - How time-of-day values should be encoded (e.g., HH:mm:ss, hh:mm a, HH:mm:ss.SSS).
  • Boolean Formats - How true/false or binary logical values should be encoded (e.g., true/false, 1/0, Y/N).
  • Double Formats - How double-precision floating values should be encoded (e.g., ##,##0.00, $, %).
  • Float Formats - How single-precision floating-point values should be encoded (e.g., ##,##0.00, %, e).
  • Integer Formats - How whole numbers should be encoded (e.g., #, #,###,##0).
  • Long Formats - How long integer values exceeding the range of standard integers should be encoded (e.g., #, #,###,##0).
  • Month Formats - How standalone month values should be encoded (e.g., MM, MMMM).
  • Year Month Formats - How combined month and year values should be encoded (e.g., yyyy MM, yyyy-MMM).
  • Month Day Formats - How combined month/day values should be encoded (e.g., MM-dd, MMM dd, MM/dd)
  • Year Formats - How standalone year values are encoded (e.g., yyyy, YY).