This repository is based on the npm package https://www.npmjs.com/package/lucene-tokenizers from https://github.com/mazko and he has some more information about porting java code to javascript here: https://proiot.ru/blog/posts/2015/10/21/kak-perestat-bespokoitsia-i-nachat-portirovat/

Furthermore the file lucene-tokenizers.babel.js contained in this repo is based on 5.3.3 and ran through the closure-compiler prior to commiting it to this repo. The reasons for it can be found here: thheller/shadow-cljs#509