Skip to content

framed-data/external

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

5 Commits
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

external

Clojure functions and data structures for working with datasets that exceed available RAM.

The core primitives include:

  • External sorting - sorts an arbitrarily large collection in constant space, and returns a lazy seq of the results. Intermediate results are transparently spilled to disk (items serialized via Fressian).

  • ExternalSet is a datatype representing a file-backed set data structure, implementing clojure.lang.IPersistentSet. Values are transparently serialized via Fressian and stored in a Riffle.

  • Operations are provided for set intersection, union, shuffling, and more.

See the docs for the full API.

About

Constant-space algorithms and data structures for Clojure

Resources

License

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published