Disclaimer: this Outbox Worker implementation is just a showcase example of gue library usage and is not designed to be used in high load environments. There are ways of improving its performance and resilience, but they are out of scope of this showcase example.

This is simple Transactional outbox pattern implementation that uses gue for messages store/relay processes.

In order to run this example you'll need to have the following tools preinstalled in your system:

• Golang 1.21+
• Docker with compose command - run docker compose version to ensure it works
• Task runner

Example consist of two components:

Generates messages and enqueues them as gue Jobs for further processing. Run it with task client.

Once running it asks how may messages do you want to publish to Kafka. Give it a number and check that jobs are being inserted into the gue_jobs table in the database.

Runs gue Worker, polls Jobs enqueued by the Client and tries to publish them to Kafka. Run it with task worker.

Once running it polls jobs from the gue_jobs table in the database and tries to publish messages to kafka.

To avoid spinning up real Kafka, Redpanda instance is used - it uses Kafka-compatible protocol and consumes much less resources. Everything else is not so important for the purpose of this showcase example.