Creating AMPS Input Data Source

The AMPS connector allows connection to AMPS message bus on a real-time streaming basis. The connector allows Panopticon Streams to subscribe to the Native FIX and XML message support. The data format itself is arbitrary, and in turn the connection includes the message definition.

Steps:

1.     In the New Data Source page, select Input > AMPS in the Connector drop-down list.

 

2.     Enter the following information:

Property	Description
Host	AMPS host address.
Port	AMPS host port. Default is 9004.
User Id	The user Id that will be used to connect to the AMPS service.
Password	The password to connect to the AMPS service.
Topic	The topic or queue physical name.
Filter	The filter expression.

 

3.     Select the Protocol. This will specify the format of the headers:

·         Amps (default)

·         Fix

·         NvFix

·         XML

4.     Select the Message Type. This will specify the format of the data within the message:         

5.     Select from any of the following Subscription Modes:

·         Sow

·         SowAndSubscribe

·         SowAndDeltaSubscribe (default)

·         Subscribe

·         DeltaSubcribe

6.     Enter the Order By Statement in order to limit the returned data. For example:

/orderDate DESC

/custumerName ASC

7.     Enter any of the following Option/s for the selected Subscription Mode:

·         cancel

·         live

·         no_empties

·         null

·         no_sowkey

·         oof

·         pause

·         replace

·         resume

·         send_keys

·         timestamp

NOTE	Leave the Options box blank if you selected the Subscribe subscription mode.

 

8.     Enter the Batch Size. This is the number of messages that will be sent at a time as results are returned. Default is 100.

9.     Enter the Timeout for the length of time to wait for the Server response. Default is 5000.

10.   Select either the period (.) or comma (,) as the Decimal Separator.

NOTE	Prepend 'default:' for the elements falling under default namespace.

 

11.   Click  to the fetch the schema based on the connection details. This populates the list of columns with the data type found from inspecting the first ‘n’ rows of the input data source.

12.   You can also opt to click . This adds columns to the AMPS connection that will represent sections of the message.

13.   Provide the following information:

Property	Description
Name	The column name of the source schema.
Fix Tag/XPath/Json Path	The Fix Tag/XPath/Json Path of the source schema.
Type	The data type of the column. Can be a Text, Numeric, or Time
Date Format	The format when the data type is Time.
Filter	Defined parameters that can be used as filter. Only available for Fix, JSON, and XML message types.
Enabled	Determines whether the message field should be processed.

 

If Message Type is set to Fix or NvFix, the Add Column will display as:

If Message Type is set to XML, the Add column will display as:

If Message Type is set to JSON, the Add Column will display as:

To delete a column, check its  or all the column entries, check the topmost , then click .

14.   If the Type is set to Text, it will be listed in the ID column drop-down list box and can be used to select a key column to manage data updates and inserts.

Every message definition needs a Text column to be defined as the ID column.

Furthermore, streaming time series window can be generated by creating a compound key with the ID column, plus a separately specified Time ID Column. The Time ID Column can be from the source data set, or alternatively automatically generated.

If the Time ID Column is selected, a scrolling time window can be specified.

For Automatic Time Id, define the Time Id Column Name.

As new data arrives from the subscription, new time slices will automatically be added and the old ones will be deleted.

If a new ID is received, a new row is added to the in-memory data set representing the AMPS topic subscription. However, if an existing ID is received, an existing row is updated.

15.   Check the Reset Data on Reconnect box to flush out the stale data and reload data after reconnection.

16.   Click . The new data source is added in the Data Sources list.