Converts OTL queries to Spark DAG and orchestrates computing processes based on user pools. Also, manages caches in order to decrease a computational load on a platform.
You'd to publish local dispatcher-sdk lib in order not to use unmanaged libs.
Install:
- java 1.8
- sbt 1.8.0
- scala 2.11.12
- Publish local dispatcher-sdk.
- Download managed dependencies.
We've tests for these and think it works... Maybe it is with little problems.
- addtotals
- appendpipe
- collect
- command
- dedup
- eval (MV-subcommands don't work with SV-fields and vice verse, also some of them are not able to work with nulls)
- fields
- fillnull
- foreach
- head
- inputlookup
- join
- lookup
- makemv
- makeresults
- mvcombine
- mvexpand
- otfieldsummary
- otinputlookup
- otloadjob
- otmakeresults
- otoutputlookup
- otstats
- rename
- replace
- return
- reverse
- rex
- search
- spath
- stats
- table
- tail
- timechart
- transaction
- union
- untable
- where
- xyseries
Untested but realized commands:
- chart
- convert
- delta
- eventstats
- fieldsummary
- filldown
- rangemap
- sort
- streamstats
- top
- transpose
- outputlookup
sbt test
Use make pack to get a deployable tarball. Unpack it to $OTP_HOME. Create conf files based on examples.
Check example configs in docs dir.
For use logging you should specify path to file loglevel.properties in loglevel property in application.conf.
File loglevel.properties contains mapping log levels to logger name.
For command classes name of logger is simple class name by default.
Use start.sh from Makefile
See Readme.md in Software Development Kit repository.
config-1.3.4.jar
json4s-ast_2.11-3.5.5.jar
json4s-native_2.11-3.5.5.jar
postgresql-42.2.5.jar
dispatcher-sdk_2.11-1.2.2.jar
ot_simple_rest 1.7.0
ot_simple 1.0.0
zeppelin-spl 2.2.0
ot_simple_zeppelin 0.2.1
nifi_tools 1.0.5
We use SemVer for versioning. For the versions available, see the tags on this repository.
Nikolay Ryabykh ([email protected])
Sergei Ermilov ([email protected])
Dmitriy Gusarov ([email protected])
Andrey Starchenkov ([email protected])
OT.PLATFORM. License agreement.
Aleksandr Matiakubov ([email protected])
Evgenii Sofronov ([email protected])
Mikhail Rubashenkov ([email protected])
Mikhail Babakov ([email protected])
Dmitrii Sobolev ([email protected])
Dmitrii Trubenkov ([email protected])
Aleksandr Kronov ([email protected])
Pavel Volkov ([email protected])