lakeFS - Data version control for your data lake | Git for data
-
Updated
Aug 23, 2024 - Go
lakeFS - Data version control for your data lake | Git for data
Libraries and tools for interoperability between Hadoop-related open-source software and Google Cloud Platform.
A tool for scale and performance testing of HDFS with a specific focus on the NameNode.
Kafka Connect FileSystem Connector
基于Hadoop的分布式云存储系统 🌴
This repository focuses on gathering and making a curated list resources to learn Hadoop for FREE.
Library for per-file client-side encyption in Hadoop FileSystems such as HDFS or S3.
Hadoop utility to compact small files
Helm chart for Apache Hadoop using multi-arch docker images
Toy Hadoop cluster combining various SQL-on-Hadoop variants
SFTP server which works on the top of HDFS,It is based on Apache sshd to access and operate HDFS through SFTP protocol
OctopuFS library helps managing cloud storage, ADLSgen2 specifically. It allows you to operate on files (moving, copying, setting ACLs) in very efficient manner. Designed to work on databricks, but should work on any other platform as well.
Data Engineering Project with Hadoop HDFS and Kafka
An sbt plugin for publishing artifacts to HDFS.
Python wrapper to access Hadoop HDFS REST API
MapReduce Java Code Examples to learn Hadoop
Data pipeline to process and analyse Twitter data in a distributed fashion using Apache Spark and Airflow in AWS environment
Neat and Handy Place for all Hadoop codes
Add a description, image, and links to the hadoop-filesystem topic page so that developers can more easily learn about it.
To associate your repository with the hadoop-filesystem topic, visit your repo's landing page and select "manage topics."