Externalise Erlang Term things (_revs, replication _ids)

[wohali]

@nolanlawson:

Prior discussion in Pouch: pouchdb/pouchdb#4642

@davisp:

I just remembered that I wrote a Python JSON canonicalizer a long time ago. The basics are: sort keys when serializing, no added whitespace, strings are Unicode NFD normalized encoded in UTF-8, and floats are serialized using dtoa.c (or similarly compatible code, ie, 1.1 is printed as 1.1, not as 1.100000000000000088817842).

For strings I wonder if it'd be better to requiring anything that's non-ascii to be encoded using the \u escape sequences.

I should probably add a link to the thing: https://github.com/davisp/jsonical

@nolanlawson:

Yeah in JS a popular one is: https://github.com/substack/json-stable-stringify

We fixed some of this with a recent CVE, but it doesn't address the original request.

[meSmashsta]

Guys you can use existing libraries that implements Erlang's term format (https://erlang.org/doc/apps/erts/erl_ext_dist.html), such as:

https://www.npmjs.com/package/bert-elixir
https://www.npmjs.com/package/erlang
https://github.com/okeuday/erlang_js

[meSmashsta]

Oh man sorry I thought this was PouchDB!!!!