Integrations

Extend Dagster with our integration guides and libraries.
Airbyte

Airbyte

Orchestrate Airbyte connections and schedule syncs alongside upstream or downstream dependencies.
AWS Athena

AWS Athena

This integration allows you to connect to AWS Athena and analyze data in Amazon S3 using standard SQL within your Dagster pipelines.
AWS CloudWatch

AWS CloudWatch

This integration allows you to send Dagster logs to AWS CloudWatch, enabling centralized logging and monitoring of your Dagster jobs.
AWS ECR

AWS ECR

This integration allows you to connect to AWS Elastic Container Registry (ECR), enabling you to manage your container images more ...
AWS EMR

AWS EMR

The AWS EMR integration allows you to seamlessly integrate AWS EMR into your Dagster pipelines for petabyte-scale data processing using ...
AWS Glue

AWS Glue

The AWS Glue integration enables you to initiate AWS Glue jobs directly from Dagster, seamlessly pass parameters to your code, and stream ...
AWS Lambda

AWS Lambda

Using the AWS Lambda integration with Dagster, you can leverage serverless functions to execute external code in your pipelines.
AWS Redshift

AWS Redshift

Using this integration, you can seamlessly integrate AWS Redshift into your Dagster workflows, leveraging Redshift’s data warehousing ...
AWS S3

AWS S3

The AWS S3 integration allows data engineers to easily read and write objects to the durable AWS S3 storage, enabling engineers to have a ...
AWS Secrets Manager

AWS Secrets Manager

This integration allows you to manage, retrieve, and rotate credentials, API keys, and other secrets using AWS Secrets Manager.
AWS Systems Parameter Store

AWS Systems Parameter Store

The excerpt for the document is: "The Dagster AWS Systems Manager (SSM) Parameter Store integration allows you to manage and retrieve ...
 Azure Data Lake Storage Gen 2 (ADLS2)

Azure Data Lake Storage Gen 2 (ADLS2)

Get utilities for ADLS2 and Blob Storage.
Census

Census

Trigger Census synchs from within your Dagster pipelines.
Community / Partner supported
Cube

Cube

Push changes from upstream data sources to Cube's semantic layer.
Community / Partner supported
Databricks

Databricks

The Databricks integration enables you to initiate Databricks jobs directly from Dagster, seamlessly pass parameters to your code, and ...
Datadog

Datadog

Publish metrics to Datadog from within Dagster ops and entralize your monitoring metrics.
dbt™

dbt™

Put your dbt transformations to work, directly from within Dagster.
dbt Cloud™

dbt Cloud™

Run dbt Cloud™ jobs as part of your data pipeline.
Delta Lake

Delta Lake

Integrate your pipelines into Delta Lake.
Community / Partner supported
dlt

dlt

Easily ingest and replicate data between systems with dlt through Dagster.
Docker

Docker

Run runs external processes in docker containers directly from Dagster.
DuckDB

DuckDB

Read and write natively to DuckDB from Software Defined Assets.
Fivetran

Fivetran

Orchestrate Fivetran connectors and schedule syncs with upstream or downstream dependencies.
GCP BigQuery

GCP BigQuery

Integrate with GCP BigQuery.
GCP Dataproc

GCP Dataproc

Integrate with GCP Dataproc.
GCP GCS

GCP GCS

Integrate with GCP GCS.
GitHub

GitHub

Integrate with GitHub Apps and automate operations within your github repositories.
Hashicorp Vault

Hashicorp Vault

Centrally manage credentials and certificates, then use them in your pipelines.
Community / Partner supported
Hightouch

Hightouch

Trigger syncs and monitor them until they complete.
Community / Partner supported
Jupyter Notebooks

Jupyter Notebooks

Dagstermill eliminates the tedious "productionization" of Jupyter notebooks.
Kubernetes

Kubernetes

Launch Kubernetes pods and execute external code directly from Dagster.
LakeFS

LakeFS

lakeFS provides version control and complete lineage over the data lake.
Community / Partner supported
Looker

Looker

The Looker integration allows you to monitor your Looker project as assets in Dagster, along with other data assets.
Community / Partner supported
Meltano

Meltano

Tap into open source configurable ETL+ and the Singer integration library.
Community / Partner supported
Microsoft Teams

Microsoft Teams

Keep your team up to speed with Teams messages.
Open Metadata

Open Metadata

Configure and schedule Dagster metadata and profiler workflows from the OpenMetadata UI.
Community / Partner supported
OpenAI

OpenAI

Integrate OpenAI calls into your Dagster pipelines, without breaking the bank.
PagerDuty

PagerDuty

Centralize your monitoring with the dagster-pagerduty integration.
Pandas

Pandas

Implement validation on pandas DataFrames.
Pandera

Pandera

Generate Dagster Types from Pandera dataframe schemas.
Prometheus

Prometheus

Integrate with Prometheus via the prometheus_client library.
SDF

SDF

Put your SDF transformations to work, directly from within Dagster.
Community / Partner supported
Secoda

Secoda

Help your team understand metadata from Dagster by adding context in Secoda.
Community / Partner supported
Bash / Shell

Bash / Shell

Execute a Bash/shell command, directly or as a read from a script file.
Slack

Slack

Up your notification game and keep stakeholders in the loop.
Sling

Sling

Extract and load data from popular data sources to destinations with Sling through Dagster.
Snowflake

Snowflake

An integration with the Snowflake data warehouse. Read and write natively to Snowflake from Software Defined Assets.
Spark

Spark

Configure and run Spark jobs.
SSH/SFTP

SSH/SFTP

Establish encrypted connections to networked resources.
Twilio

Twilio

Integrate Twilio tasks into your data pipeline runs.
Weights & Biases

Weights & Biases

Orchestrate your MLOps pipelines and maintain ML assets.
Community / Partner supported
Looking for deployment options?
Check out hands-on guides to explore various deployment options.