lumberjack: added support for transport compression (#76)

Co-authored-by: Heiko Reese <[email protected]>

New segment modify/addrstrings (#74)

* Added function to render MAC addresses as strings

* added new segment addrstrings

* Added fields for modify/addrstrings to protobuf definition

* addrstrings: fixed name typo, added minimal implementation and documentation.

* Fixed protobuf namespace clash by renaming `flow.proto` and `flow*.go`.

Added protobuf compilation command to Makefile.

* modify/addrstrings: fixed writing source MAC to wrong field

* Fixed and enhanced documentation for modify/addrstrings.

Explicitly marked all yaml code segments as such for better highlighting.

* Added tests for modify/addrstrings

---------

Co-authored-by: Heiko Reese <[email protected]>

new segment: modify/aslookup (#70)

* Add aslookup segment

* Clarify documentation

* Add config sanity checking, make db default type, add tests

* Add example config

* Add example lookup file, use correct file path

---------

Co-authored-by: Sebastian Schnorbus <[email protected]>

Merge pull request #69 from bwNetFlow/fix/toptalkers-metrics-thresholds

segment toptalkers_metrics: fixed logic to evaluate thresholds

new segment: analysis/toptalkers-metrics (#66)

* added first working version of toptalkers_metrics segment

* moved ticker from records to DB, records are now tracking if they are elegible for export, cleanup runs as separate goroutine, bucket duration is now configurable

* forward flows based on traffic levels

* added a metric for the DB size after cleanup

* defined the segment as a filter segment, so drops can be used in the pipeline

* added documentation and example for toptalkers-metrics

* go mod tidy

* go mod tidy

* go version bumped from 1.18 to 1.20

* fuck yaml

* updated Dockerfile to go 1.20

* updated dependencies

---------

Co-authored-by: Sebastian Neuner <[email protected]>

add libpacap to action release

implement reversedns segment (#54)

* revdns: initial working version, no cache, no threads, no nothing

* add working reverse dns impl, but this needs to be non-blocking for cache population

* finish reversedns segment and document it

Kafkaconsumer: handle multiple rebalances correctly (#63)

* snmp: optimize memory usage on startup until cache is full

* kafkaconsumer: handle multiple rebalances correctly

kafkaproducer: hotfix for reflection error occuring on split produce (#…

…61)

Merge pull request #57 from bwNetFlow/prometheus

implement support for multiple prometheus segments