Dagster Integration:
Using AWS ECR with Dagster
About this integration
This integration allows you to connect to AWS Elastic Container Registry (ECR). It provides resources to interact with AWS ECR, enabling you to manage your container images.
Using this integration, you can seamlessly integrate AWS ECR into your Dagster pipelines, making it easier to manage and deploy containerized applications.
Installation
pip install dagster-aws
Examples
from dagster import asset, Definitions
from dagster_aws.ecr import ECRPublicResource
@asset
def get_ecr_login_password(ecr_public: ECRPublicResource):
return ecr_public.get_client().get_login_password()
defs = Definitions(
assets=[get_ecr_login_password],
resources={
"ecr_public": ECRPublicResource(
region_name="us-west-1",
aws_access_key_id="your_access_key_id",
aws_secret_access_key="your_secret_access_key",
aws_session_token="your_session_token",
)
},
)
About AWS ECR
AWS Elastic Container Registry (ECR) is a fully managed Docker container registry that makes it easy for developers to store, manage, and deploy Docker container images. AWS ECR is integrated with Amazon Elastic Kubernetes Service (EKS), simplifying your development to production workflow. With ECR, you can securely store and manage your container images and easily integrate with your existing CI/CD pipelines. AWS ECR provides high availability and scalability, ensuring that your container images are always available when you need them.