for baking Airflow images with custom dependencies
Click the Use this template button!
- Pull down the repo
- Add your dependencies to
requirements.txt
git add .
git commit -m "added dependencies"
git push
Automation will publish your image when you push a tag to the repo.
- run
git tag v1.0.0
to designate an image version - run
git push --tags
to publish that version - the published images should be shown in the GitHub packages tab over there
↗️
Now that you have an image in the GitHub Container Registry, you need to be able to consume it from Airflow.
-
If you are using Polyseam's CNDI, here is an example here showing how to securely apply that secret for your Airflow Container Image.
-
There is also an example provided here if you are using Airflow on Kubernetes without CNDI.
In either case once you've applied the Secret you just need to tell Airflow to use it in your Helm Chart's values:
values:
registry:
secretName: airflow-image-pull-secret
images:
airflow:
repository: 'ghcr.io/johnstonmatt/my-baked-image'
tag: v1.0.0