Dynamically upload files to Amazon Web Services s3 buckets during a QlikView refresh. We chose this path as it gave us the most control, least limitations, and easy setup / maintenance.
You can upload QVDs, log files, QVWs for version control. Sky is the limit
-
Setup a user in the AWS Console and grant them the AmazonS3FullAccess permission policy
-
Install AWS CLI and configure it using the two access keys for the user created in step 1
-
On your local machine, set the environment variable to the aws path ex. C:\Program Files\Amazon\AWSCLIV2. This allows you to call the aws cli from powershell.
-
Using the command prompt, test AWS CLI is working and you can see your buckets / create them if you don't have anything. I created an s3ndit bucket to test.
-
In the QlikView load script, check 'Can Execute External Programs'
- Choose your process ps1 file. You can leverage both scripts by pushing individual files and then after the full load process run a sync. This will be less cpu intensive than running just the sync.
s3_cp.ps1 - this is a copy process from your local machine to s3. This should be used when you're copying individual files/qvds
s3_sync.ps1 - this syncs your local folder with s3.
-
Set your s3 bucket variable.
-
Reload
This is really just an integration between Qlik & AWS CLI, it doesn't have to be limited to cp and sync it can work with any commands that the aws cli will take. Have fun!
MIT