Skip to content

A polycloud .NET cloud storage abstraction layer. Provides Blob storage (AWS S3, GCP, FTP, SFTP, Azure Blob/File/Event Hub/Data Lake) and Messaging (AWS SQS, Azure Queue/ServiceBus). Supports .NET 5+ and .NET Standard 2.0+. Pure C#.

License

Notifications You must be signed in to change notification settings

robinrodricks/FluentStorage

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

FluentStorage

Version Downloads GitHub contributors Codacy Badge License

FluentStorage is free, but powered by your donations

One Interface To Rule Them All

FluentStorage, originally known as Storage.NET, is a field-tested polycloud .NET cloud storage library that helps you interface with multiple cloud providers from a single unified interface.

It provides a generic interface for Blob storage across all cloud storage providers (AWS S3, GCP, FTP, SFTP, Azure Blob/File/Event Hub/Data Lake) and cloud messaging providers (AWS SQS, Azure Queue/ServiceBus).

It is written entirely in C#. Supports .NET 5+ and .NET Standard 2.0+. External dependencies are only added by FluentStorage sub-packages.

FluentStorage is released under the permissive MIT License, so it can be used in both proprietary and free/open source applications.

Features

  • Unified API to interface with all major cloud providers for Blobs and Messaging.

  • Provides a generic interface regardless on which storage provider you are using.

  • Provides both synchronous and asynchronous alternatives of all methods and implements it to the best effort possible.

  • Supports all popular providers: AWS S3, AWS SQS, GCP Storage, FTP, FTPS, SFTP, Azure Blob & File Storage, Azure Queue Storage, Azure Service Bus, Azure Event Hub, Azure Data Lake Store, Azure Key Vault, DigitalOcean Spaces, MinIO, Wasabi.

  • Supports providers using individual Nuget packages, with hassle-free configuration and zero learning path.

  • Implements in-memory and on-disk versions of all the abstractions, therefore you can develop fast on a local machine or use vendor-free serverless implementations for parts of your application.

  • Implements data transformation sinks for encryption and compression.

  • Attempts to enforce idential behavior on all implementations of storage interfaces to the smallest details possible, and contains many test specifications which will help you to add another provider.

Architecture

Without FluentStorage

Today, most cloud applications and services are developed against vendor-specific APIs like Amazon S3 API or Azure Blob API for cloud storage capabilities.

Using multiple vendor-specific APIs can increase your vendor lock-in, and makes your application more complex and harder to maintain. And sometimes these APIs may not offer all the functionality you need for your application. Polycloud also becomes very hard to implement.

Arch

With FluentStorage

What if we had a single, consistent API to deal with all types of cloud storage? That would solve these issues and bring more flexibility in switching cloud providers or cloud services.

Thus was born the idea for FluentStorage.

You can use a single, consistent API to interact with multiple cloud providers, where each provider is supported through its own special Nuget package.

Arch

Benefits

  1. Easy to write code that is not tied to a specific cloud provider.

  2. Easily switch between different providers without having to rewrite any part of their application or service.

  3. Easily migrate to using a new storage technology for some part of your cloud application (S3 buckets, Azure Blobs, FTP, etc.)

  4. Natively implement polycloud (support for multiple public clouds)

Storage Providers

FluentStorage supports the following cloud storage providers:

Storage Provider Documentation
AWS S3 FluentStorage.AWS
Azure Blobs FluentStorage.Azure.Blobs
Azure Files FluentStorage.Azure.Files
Azure DataLake FluentStorage.Azure.DataLake
Google Cloud Storage FluentStorage.GCP
MinIO FluentStorage.AWS -> MinIO
DigitalOcean Spaces FluentStorage.AWS -> DigitalOcean Spaces
Wasabi FluentStorage.AWS -> Wasabi

Packages

Stable binaries are released on NuGet, and contain everything you need to use Cloud Storage in your .NET app.

Package Latest Version Downloads Documentation
FluentStorage Version Downloads Standard
FluentStorage.AWS Version Downloads S3, SQS
FluentStorage.GCP Version Downloads GCP
FluentStorage.Databricks Version Downloads Databricks
FluentStorage.FTP Version Downloads FTP
FluentStorage.SFTP Version Downloads SFTP
FluentStorage.Azure.Blobs Version Downloads Blob
FluentStorage.Azure.Files Version Downloads File
FluentStorage.Azure.EventHub Version Downloads EventHub
FluentStorage.Azure.ServiceBus Version Downloads ServiceBus
FluentStorage.Azure.KeyVault Version Downloads KeyVault
FluentStorage.Azure.ServiceFabric Version Downloads ServiceFabric
FluentStorage.Azure.Queues Version Downloads Queue
FluentStorage.Azure.DataLake Version Downloads DataLake

Platform Support

FluentStorage works on .NET and .NET Standard/.NET Core.

Platform Binaries Folder
.NET 5.0 net50
.NET 6.0 net60
.NET Standard 2.0 netstandard2.0
.NET Standard 2.1 netstandard2.1

FluentStorage is also supported on these platforms: (via .NET Standard)

  • Mono 4.6
  • Xamarin.iOS 10.0
  • Xamarin.Android 10.0
  • Universal Windows Platform 10.0

Binaries for all platforms are built from a single Visual Studio Project. You will need the latest Visual Studio to build or contribute to FluentStorage.

Documentation

Check the Wiki.

What's New

In 2024, we added:

  • DigitalOcean Spaces provider
  • MinIO provider
  • Wasabi provider

In 2023, we added:

  • SFTP provider SSH.NET added
  • FTP provider FluentFTP updated to v44
  • AWS Nuget bumped to latest versions
  • Wiki created for documentation
  • Platform support updated to netstandard2.0,netstandard2.1,net50,net60

Supported Cloud Services

Slide

Similar Libraries

  • Foundatio - Caching, Messaging, Queues and Storage library with AWS, Azure and many other providers
  • SlimMessageBus - Messaging library with providers like RabbitMQ, Kafka, Azure EventHub, MQTT, Redis
  • ManagedCode.Storage - Storage library with AWS, Azure, GCP and other providers

Sponsorship

Has FluentStorage made a difference for you or your organization? If so, consider becoming a sponsor to help keep the project thriving. Even a small monthly contribution, like $20, can make a meaningful impact.

As a seasoned freelancer with over a decade of experience, your support helps me continue dedicating time to these open-source projects while also supporting my family. Your contributions directly fuel the work that makes a difference to millions of developers around the world.

Contributors

Special thanks to these awesome people who helped create FluentStorage! Shoutout to Ivan Gavryliuk for the original project Storage.Net.

About

A polycloud .NET cloud storage abstraction layer. Provides Blob storage (AWS S3, GCP, FTP, SFTP, Azure Blob/File/Event Hub/Data Lake) and Messaging (AWS SQS, Azure Queue/ServiceBus). Supports .NET 5+ and .NET Standard 2.0+. Pure C#.

Topics

Resources

License

Stars

Watchers

Forks

Sponsor this project