How to connect Kraken to Qlik via Amazon S3

Adding a new Qlik S3 data provider in Kraken

1. Click on the "hamburger menu" icon in the top left corner of Kraken
2. Click on "Manage Data"
3. Click on the Qlik S3 data provider card and fill in the details:
   • Access Key ID: Access Key that was generated when the S3 bucket was first set up. For more information on Creating, Modifying, and Viewing Access Keys from the AWS Console follow the steps in the previous section or refer to the additional documentation link below
   • Secret Access Key: Secret Access Key that was generated when the S3 bucket was first set up. For more information on Creating, Modifying, and Viewing Access Keys from the AWS Console refer to the previous section or see additional documentation links below
   • Bucket: Name of your S3 bucket. The bucket name is case sensitive.
   • Prefix: Path to your data if you have sub-folders in your S3 bucket. Prefix should always end with a forward slash (/). For example: If you have an S3 bucket called 'my-bucket' and had a sub-folder called 'sub-folder', the Bucket value is 'my-bucket' and the Prefix value is 'sub-folder/'.
     To allow Kraken to access the top level of the bucket and any folders within it, enter a forward slash or simply leave the field blank.
   • Region: The Amazon region where your bucket is located. For example: us-east-1
4. Click the CONNECT button to create the connection. Kraken will scan the bucket and add all available data files as datasets which can be used to train models and create predictions.

Generating an S3 Access Key and Secret Access Key

Configuring Kraken to connect to your Amazon S3 environment requires the generation of an Access Key and Secret Access Key prior to creating a Data Provider in Kraken. Generating the keys requires specific permissions in AWS. If you do not have the appropriate permissions, contact your AWS administrator to complete the following steps:

1. Log in to your AWS console at https://console.aws.amazon.com/
2. Under the Services tab, search for IAM
3. Click on Users
4. Locate and click on your username
5. Click on the Security Credentials tab
6. Click the Create Access Key button
7. A box will pop up with your new credentials. Click on "Download .csv file" and save this file in a secure location. NOTE: If you do not save this file, the Secret access key can not be viewed again once this box is closed. You will need to generate a new Access key if you no longer have the Secret access key.

Additional Resources and Documentation

Configuring Amazon S3 access in Qlik Sense on-prem

1. Basic Qlik Web Connectors installation
   
   • Setting up Qlik Web Connectors to run as a Windows service
   • Advanced configuration of Qlik Web Connectors (Allow file system access for specified paths)
   • NOTE: Qlik Web Connector does not allow uploading of data from Qlik to S3 directly, hence the need to configure file system access for a shared data folder that is an intermediary "stop along the way" from Qlik to S3.
2. Amazon S3 Web Connector overview
   • Using the Amazon S3 Web Connector
   • NOTE: when using the Amazon S3 Web Connector to extract and store data from Qlik, you must add "(txt)" to the end of the STORE statement to ensure Qlik Sense extracts data in a format that Kraken can understand. For example: STORE * from ApplyData into [lib://BigSquid Shared Data/ApplyDataFromQlik.csv] (txt);
3. (OPTIONAL) As an additional alternative to loading Kraken predictions from Amazon S3 into Qlik, you can use Kraken's Automated Prediction Download API to load predictions directly into Qlik via a REST connection.
   • The Automated Prediction Download API token needs to be added as an Authorization parameter in the Query Headers section of the Qlik REST connection:
     • The "Name" field should have the value "Authorization"
     • The "Value" field should have the API Key specified in the Kraken Syncing options screen.

Configuring Amazon S3 access in Qlik Sense Business, Qlik Sense Enterprise SaaS and Qlik Cloud Services

1. Qlik Web Storage Provider Connectors overview
   • Using the Amazon S3 Web Storage Provider
   • NOTE: when using the Amazon S3 Web Connector to extract and store data from Qlik, you must add "(txt)" to the end of the STORE statement to ensure Qlik Sense extracts data in a format that Kraken can understand. For example: STORE [Apply data: CalaCo_cancellations_apply_NandYtarget] into [lib://bigsquid-qlikbucket/FromQlik_CalaCo_cancellations_apply_NandYtarget.csv] (txt);
2. (OPTIONAL) As an additional alternative to loading Kraken predictions from Amazon S3 into Qlik, you can use Kraken's Automated Prediction Download API to load predictions directly into Qlik via a REST connection.
   • The Automated Prediction Download API token needs to be added as an Authorization parameter in the Query Headers section of the Qlik REST connection:
     • The "Name" field should have the value "Authorization"
     • The "Value" field should have the API Key specified in the Kraken Syncing options screen.

AWS access key management

• Managing Access Keys in the AWS Management Console
• How to Replace a Lost Secret Access Key