Python framework for building efficient data pipelines. It promotes modularity and collaboration, enabling the creation of complex pipelines from simple, reusable components.

Data Reconnaissance - pull request review tool for dbt projects

Low effort linking and easy de-duplication. Databricks ARC provides a simple, automated, lakehouse integrated entity resolution solution for intra and inter data linking.

CLI to manage your datacontract.yaml files

A DataOps framework for building a lakehouse.

Open, Multi-modal Catalog for Data & AI

Synthetic data generation for tabular data

Shared Infra for cloudkube.io projects. And example of how to leverage InnerSource example for shared configuration management.

data load tool (dlt) is an open source Python library that makes data loading easy 🛠️

An open, distributed platform as a service

🚀 Build and manage real-life ML, AI, and data science projects with ease!

LLM training code for Databricks foundation models

Self-serve BI to 10x your data team ⚡️

Lightdash Community helm charts

Databricks SDK for Python (Beta)

Making data lake work for time series

Devika is an Agentic AI Software Engineer that can understand high-level human instructions, break them down into steps, research relevant information, and write code to achieve the given objective…

Tool for deploying a lakehouse in a kubernetes cluster.

Open source stack lakehouse

LakeSoul is an end-to-end, realtime and cloud native Lakehouse framework with fast data ingestion, concurrent update and incremental data analytics on cloud storages for both BI and AI applications.

A collection of samples to demonstrate vector search capabilities using different Azure tools like Azure AI Search, PostgreSQL, Redis etc.

The Azure Container Apps landing zone accelerator is an open-source collection of architectural guidance and reference implementation to accelerate deployment of Azure Container Apps at scale.

Dify is an open-source LLM app development platform. Dify's intuitive interface combines AI workflow, RAG pipeline, agent capabilities, model management, observability features and more, letting yo…

Snowflake Data Engineering in Action

Pythonic task management & command execution.

Terraform module to deploy landing zone subscriptions (and much more) in Azure

Azure Landing Zones Terraform Accelerator