Skip to content

☁️ Flexible and Fluent framework-agnostic driver based system to manage storage in Node.js

Notifications You must be signed in to change notification settings

gamfi/flydrive

 
 

Repository files navigation

flydrive

Download Version License

flydrive is a framework-agnostic package which provides a powerful wrapper to manage file Storage in Node.js.

There are currently 3 drivers available:

  • 'local': Stores files on the local file system.
  • 's3': Amazon S3 and other compatible services
    • You need to install the aws-sdk package to be able to use this driver.
    • This driver is compatible with DigitalOcean Spaces and Scaleway Object Storage.
  • 'gcs': Google Cloud Storage
    • You need to install the @google-cloud/storage package to be able to use this driver.

Getting Started

This package is available in the npm registry. It can easily be installed with npm or yarn.

$ npm i @slynova/flydrive
# or
$ yarn add @slynova/flydrive

When you require the package in your file, it will give you access to the StorageManager class. This class is a facade for the package and should be instantiated with a configuration object.

const { StorageManager } = require('@slynova/flydrive');
const storage = new StorageManager(config);

Once you instantiated the manager, you can use the StorageManager#disk() method to retrieve a disk an use it.

storage.disk(); // Returns the default disk (specified in the config)
storage.disk('awsCloud'); // Returns the driver for the disk "s3"
storage.disk('awsCloud', customConfig); // Overwrite the default configuration of the disk

Driver's API

Each driver extends the abstract class Storage. This class will throw an exception for each methods by default. The driver needs to overwrite the methods it supports.

The following method doesn't exist on the LocalFileSystem driver, therefore, it will throw an exception.

// throws "E_METHOD_NOT_SUPPORTED: Method getSignedUrl is not supported for the driver LocalFileSystem"
storage.disk('local').getSignedUrl();

Since we are using TypeScript, you can make use of casting to get the real interface:

import { LocalFileSystem } from '@slynova/flydrive';

storage.disk<LocalFileSystem>('local');

Response interface

Asynchronous methods will always return a Promise which resolves with a Response object. The response object may contain relevant data in its properties (for example, the ExistsResponse object for the exists method contains a boolean exists property).

All responses additionally have a raw property which is driver-specific and contains the result from the original call made by the driver.

Exceptions

In case of runtime errors, flydrive will try to throw driver-agnostic exceptions.
Exceptions also have a raw property which contains the original error.

Methods

append(location: string, content: Buffer | Stream | string, options: object): Promise<Response>

This method will append the content to the file at the location. If the file doesn't exist yet, it will be created.

// Supported drivers: "local"

await storage.disk('local').append('foo.txt', 'bar');
// foo.txt now has the content `${initialContent}bar`
bucket(name: string): Storage

This method can be used to swap the bucket at runtime. It returns a new Storage instance.

// Supported drivers: "s3", "gcs"

storage.disk('cloud').bucket('anotherOne');
// The following chained action will use the "anotherOne" bucket instead of the original one
copy(src: string, dest: string, options: object): Promise<Response>

This method will copy a file to another location.

// Supported drivers: "local", "s3", "gcs"

await storage.disk('local').copy('foo.txt', 'bar.txt');
// foo.txt was copied to bar.txt
delete(location: string): Promise<Response>

This method will delete the file at the given location.

// Supported drivers: "local", "s3", "gcs"

await storage.disk('local').delete('foo.txt');
// foo.txt has been deleted
driver()

This method returns the driver used if you need to do anything specific not supported by default.

storage.disk('local').driver(); // Returns "fs-extra"
storage.disk('awsCloud').driver(); // Returns "aws-sdk"
storage.disk('googleCloud').driver(); // Returns "@google-cloud/storage"
// ....
exists(location: string): Promise<ExistsResponse>

This method will determine if a file exists at the given location.

// Supported drivers: "local", "s3", "gcs"

const { exists } = await storage.disk('local').exists('foo.txt');
// exists is true or false
get(location: string, encoding: string = 'utf-8'): Promise<ContentResponse<string>>

This methods will return the file's content as a string for the given location.

// Supported drivers: "local", "s3", "gcs"

const { content } = await storage.disk('local').exists('foo.txt');
getBuffer(location: string): Promise<ContentResponse<Buffer>>

This methods will return the file's content as a Buffer for the given location.

// Supported drivers: "local", "s3", "gcs"

const { content } = await storage.disk('local').exists('foo.txt');
getSignedUrl(location: string, options: SignedUrlOptions = { expiry: 900 }): Promise<SignedUrlResponse>

This methods will return the signed url for an existing file.

// Supported drivers: "s3", "gcs"

const { signedUrl } = await storage.disk('awsCloud').getSignedUrl('foo.txt');
getStat(location: string): Promise<StatResponse>

This methods will return the file's size (in bytes) and last modification date.

// Supported drivers: "local", "s3", "gcs"

const { size, modified } = await storage.disk('local').getStat('foo.txt');
getStream(location: string, options: object | string): Stream

This methods will return a Node.js readable stream for the given file.

// Supported drivers: "local", "s3", "gcs"

const stream = storage.disk('local').getStream('foo.txt');
getUrl(location: string): string

This methods will return a public URL for a given file.

// Supported drivers: "s3", "gcs"

const uri = storage.disk('awsCloud').getUrl('foo.txt');
move(src: string, dest: string): Promise<Response>

This methods will move the file to a new location.

// Supported drivers: "local", "s3", "gcs"

await storage.disk('local').move('foo.txt', 'newFolder/foo.txt');
put(location: string, content: Buffer | Stream | string, options: object): Promise<Response>

This methods will create a new file with the provided content.

// Supported drivers: "local", "s3", "gcs"

await storage.disk('local').put('bar.txt', 'Foobar');
prepend(location: string, content: Buffer | string, options: object): Promise<Response>

This methods will preprend content to a file.

// Supported drivers: "local"

await storage.disk('local').prepend('foo.txt', 'bar');
// foo.txt now has the content `bar${initialContent}`

Contribution Guidelines

Any pull requests or discussions are welcome. Note that every pull request providing new feature or correcting a bug should be created with appropriate unit tests.

About

☁️ Flexible and Fluent framework-agnostic driver based system to manage storage in Node.js

Resources

Stars

Watchers

Forks

Packages

No packages published

Languages

  • TypeScript 99.7%
  • JavaScript 0.3%