Skip to content
/ tlex Public

Multi Docker Containers Logger & Stats Aggregator

Notifications You must be signed in to change notification settings

blewater/tlex

Repository files navigation

Multi Docker Containers Logger & Stats Aggregator

Tool for meeting these requirements:

  • Create a lean Docker Image from the Dockefile in this repo.

  • Tracking left over containers from a previous launch at ids.gob file so to stop them at next launch

  • To launch concurrently config.RequestedLiveContainers containers of the https://github.com/nethatix/echopathws http listener that echoes back the requested url path i.e., localhost:8770/1/2/3/ -> 1/2/3/.

  • Supporting a configurable number of live containers creation.

  • Supporting liveness both as an app and through few unit tests.

  • Consuming the Docker statistics streams for each live container. Optional persistence to an aggregated text file separate from the logs.

  • Displaying and aggregating all the logging input streams of the live containers similarly to the statistics streams.

  • Concurrently remove all live instances.

Deliverable

This is a statically configured command line application that is efficient and scalable.

Testing

This workflow/workflow_test.go->Test_Continuous_Logs_Http_Requests_100_Containers requires a large timeout to as the 30 seconds are not even sufficient to launch 100 instances. Υου may run it go test -run Test_Continuous_Logs_Http_Requests_100_Containers -timeout 100000s

Workflow Unit tests

within github.com/nethatix/tlex/workflow$

go test -run Test_Workflow_0_Containers

go test -run Test_Workflow_3_Containers_No_Stats

go test -run Test_Workflow_1_Containers

go test -run Test_Workflow_5_Containers

go test -run Test_Workflow_20_Containers -timeout 50s

go test -run Test_Continuous_Logs_Http_Requests_100_Containers -timeout 100000s

Tests harnesses

workflow/           // the unit tests root folder.

workflow/testdata/Dockerfile // the unit tests Dockerfile

workflow/testdata/logFile.log // the unit tests log file. 

workflow/testdata/StatsLogFile.log // the stats unit tests file.

logger/logger_test.go   // simple test case

dockerapi/ // has no test file but a few logic assert functions in .dockerapi/dockerapi.go employed at runtime

- - - -

Sreaming Flood

Windows getting along with 100 docker containers just fine!

Installation

Preferably within $gopath\src

git clone https://github.com/nethatix/tlex

cd tlex

./install.sh (tested with windows bash) or install.cmd (windows)

Note the application builds and runs both on and off the gopath within the root tlex folder: These commands worked in both locations on/off gopath locations:

go build ./...

go vet

go build -race producing tlex or tlex.exe executables....

go run tlex

Interesting Paths & Files

Dockerfile // (The employed docker image spec in root folder. )

logFile.log        // is the application log file.

StatsLogFile.log   // is the application stats file.

ids.gob // binary serialization of left over live containers.

The Containerized Simple Echo Path HTTP Server

https://github.com/nethatix/echopathws

About

Multi Docker Containers Logger & Stats Aggregator

Topics

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Languages