High-performance FastAPI backend boilerplate for real-world production, with mongo and pytest. Suitable for microservices.

Spark-Dashboard is a solution for monitoring Apache Spark jobs. This repository provides the tooling and configuration for deploying an Apache Spark Performance Dashboard using containers technology.

A PHP serializer implementation for Python

HOCON parser for Python

Example using the MongoDB Go Driver

Dataproc templates and pipelines for solving simple in-cloud data tasks

Qubole Sparklens tool for performance tuning Apache Spark

This is the development repository for sparkMeasure, a tool and library designed for efficient analysis and troubleshooting of Apache Spark jobs. It focuses on easing the collection and examination…

Basic skeleton for Spring Boot Microservices. It includes spring spring security for basic Auth. Spring Cloud Gateway is also implemented as an API gateway. Lots of the spring cloud component integ…

A Procedure To Create A Yarn Cluster Based on Docker, Run Spark, And Do TPC-DS Performance Test.

使用容器搭建大数据架构微服务

Scripts to setup a Spark cluster using Docker Swarm.

Tutorial for setting up a Spark cluster running inside of Docker containers located on different machines

Hadoop Cluster Configurations

This repository

This project provides Apache Spark SQL, RDD, DataFrame and Dataset examples in Scala language

Spark Examples

Apache Spark - A unified analytics engine for large-scale data processing

Apache Spark examples exclusively in Java

Bigquery ETL

Elastic Stack 8.x Cookbook published by Packt Publishing

A list of useful resources to learn Data Engineering from scratch

Example project and best practices for Python-based Spark ETL jobs and applications.

pyspark framework

Boilerplate template for machine learning projects in PySpark.

A Python PySpark Projet with Poetry

Pyspark RDD, DataFrame and Dataset Examples in Python language

The Patterns of Scalable, Reliable, and Performant Large-Scale Systems