How do I create a Qlik connection via Amazon S3?

Adding a new Qlik S3 data provider

1. Click on the "hamburger menu" icon in the top left corner
2. Click on "Manage Data"
3. Click on the Qlik S3 data provider card and fill in the details:
   • Access Key ID: Access Key that was generated when the S3 bucket was first set up. For more information on Creating, Modifying, and Viewing Access Keys from the AWS Console follow the steps in the previous section or refer to the additional documentation link below
   • Secret Access Key: Secret Access Key that was generated when the S3 bucket was first set up. For more information on Creating, Modifying, and Viewing Access Keys from the AWS Console refer to the previous section or see additional documentation links below
   • Bucket: Name of your S3 bucket. The bucket name is case sensitive.
   • Prefix: Path to your data if you have sub-folders in your S3 bucket. Prefix should always end with a forward slash (/). For example: If you have an S3 bucket called 'my-bucket' and had a sub-folder called 'sub-folder', the Bucket value is 'my-bucket' and the Prefix value is 'sub-folder/'.
     To allow access to the top level of the bucket and any folders within it, enter a forward slash or simply leave the field blank.
   • Region: The Amazon region where your bucket is located. For example: us-east-1
4. Click the "Connect" button to create the connection. The bucket will be scanned and all available data files which can be used to train models and create predictions will be added as datasets.

Generating an S3 Access Key and Secret Access Key

Connecting to your Amazon S3 environment requires the generation of an Access Key and Secret Access Key prior to creating a Data Provider. Generating the keys requires specific permissions in AWS. If you do not have the appropriate permissions, contact your AWS administrator to complete the following steps:

1. Log in to your AWS console at https://console.aws.amazon.com/
2. Under the Services tab, search for IAM
3. Click on Users
4. Locate and click on your username
5. Click on the Security Credentials tab
6. Click the Create Access Key button
7. A box will pop up with your new credentials. Click on "Download .csv file" and save this file in a secure location. NOTE: If you do not save this file, the Secret access key can not be viewed again once this box is closed. You will need to generate a new Access key if you no longer have the Secret access key.

Additional Resources and Documentation

Legacy video walkthrough of connecting Qlik products via S3, Automated Prediction Download and Prediction API

• Legacy video: Connecting Qlik

Configuring Amazon S3 access in Qlik Sense on-prem

1. Basic Qlik Web Connectors installation
   
   • Setting up Qlik Web Connectors to run as a Windows service
   • Advanced configuration of Qlik Web Connectors (Allow file system access for specified paths)
   • NOTE: Qlik Web Connector does not allow uploading of data from Qlik to S3 directly, hence the need to configure file system access for a shared data folder that is an intermediary "stop along the way" from Qlik to S3.
2. Amazon S3 Web Connector overview
   • Using the Amazon S3 Web Connector
   • NOTE: when using the Amazon S3 Web Connector to extract and store data from Qlik, you must add "(txt)" to the end of the STORE statement to ensure Qlik Sense extracts data in a format that can be utilized. For example: STORE * from ApplyData into [lib://BigSquid Shared Data/ApplyDataFromQlik.csv] (txt);
3. (OPTIONAL) As an additional alternative to loading predictions from Amazon S3 into Qlik, you can use the Automated Prediction Download API to load predictions directly into Qlik via a REST connection.
   • The Automated Prediction Download API token needs to be added as an Authorization parameter in the Query Headers section of the Qlik REST connection:
     • The "Name" field should have the value "Authorization"
     • The "Value" field should have the API Key specified in the Predictions Settings screen.

Configuring Amazon S3 access in Qlik Sense Business, Qlik Sense Enterprise SaaS and Qlik Cloud

1. Qlik Web Storage Provider Connectors overview
   • Using the Amazon S3 Web Storage Provider
   • NOTE: when using the Amazon S3 Web Connector to extract and store data from Qlik, you must add "(txt)" to the end of the STORE statement to ensure Qlik Sense extracts data in a format that can be utilized. For example: STORE [Apply data: CalaCo_cancellations_apply_NandYtarget] into [lib://bigsquid-qlikbucket/FromQlik_CalaCo_cancellations_apply_NandYtarget.csv] (txt);
2. (OPTIONAL) As an additional alternative to loading predictions from Amazon S3 into Qlik, you can use the Automated Prediction Download API to load predictions directly into Qlik via a REST connection.
   • The Automated Prediction Download API token needs to be added as an Authorization parameter in the Query Headers section of the Qlik REST connection:
     • The "Name" field should have the value "Authorization"
     • The "Value" field should have the API Key specified in the Prediction Settings screen.

AWS access key management

• Managing Access Keys in the AWS Management Console
• How to Replace a Lost Secret Access Key