Altair® Panopticon

 

Creating Data Extracts

One of the methods in accessing data is by retrieving only the required results into memory, by querying on demand, pushing aggregation and filtering tasks to underlying big data repositories, or queryable data extracts.

This is commonly known as a ROLAP implementation, where the product is dynamically writing data queries to the underlying data repository and retrieving aggregated and filtered datasets. Given the on-demand nature of this method it is more suitable for exploratory data analysis but requires dynamic query generation.

This section discusses the steps and guidelines on how to create data extracts.

Steps:

1.      On the Data Library page, click .

The New Data Extract dialog displays.

 

2.      Enter the name of the data extract then click .

The Extract Settings page displays.

 

Section/Panel

Description

1

Connector drop-down list

Includes the non-streaming connectors to extract data from.

2

Extract Name

Name of the data extract. Click the  button to go back to the Data Library page.

3

Save

Save the changes made on the Extracts tab.

4

Refresh Data

Refresh the data after modifying and saving changes on the Data Extract page.

You can also opt to click Cancel Refresh Data .

5

Details

Display the details of the data extract including the number of rows, columns, cells, status, and the last time it was updated.

6

Connectors

Select the connector that will be used for the data extract.

7

Refresh Data Preview

Refresh the data preview.

8

Expand Data Preview

Expand the Data Preview panel.

 

3.      Enter the Name of the data extract. This should be unique and should only contain letters (a to Z), numbers (0 to 9), and underscores.

4.      Click  or press Enter to apply the name.

5.      Define the data extract settings of any of the following data sources:

·        Altair AI Hub

·        Azure

·        Cassandra

·        DolphinDB

·        Elasticsearch 6.x

·        Elasticsearch 7.x

·        Google Analytics

·        Google Cloud

·        InfluxDB

·        JDBC

·        JDBC Legacy

·        JSON

·        Kx kdb+

·        KsqlDB

·        LivySpark

·        MongoDB

·        MS Excel

·        OneTick

·        OneTick Cloud

·        Python

·        Rserve

·        S3

·        Shakti Beta

·        Splunk

·        Text

·        Web Data

·        XML

 

6.      Click to save and display the details of the data extract.

7.      Click  then  to display the data preview.

8.      Click  to go back to the Data Library page. The new data extract is added to the list.