Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Implement a FOSS & offline-first message broker to queue tasks #28

Open
rudokemper opened this issue Feb 5, 2024 · 2 comments
Open
Labels

Comments

@rudokemper
Copy link
Member

Feature Request

Right now, mapgl-tile-renderer is set up to work with Azure Storage Queue as a message broker to receive tasks to generate offline maps in the background, and send a message back to remove that task from the queue once completed.

Let's provide an open-source alternative so we are not exclusively tied to Azure. One possibility is to use RabbitMQ.

@rudokemper rudokemper added the help wanted (open-source contributions) Extra attention is needed label Feb 5, 2024
@rudokemper
Copy link
Member Author

rudokemper commented May 21, 2024

Alternatively, we can consider taking this approach of co-locating the task queue in the database directly, which would eliminate the need for a FOSS / offline-first message broker. Cf. #50 for more discussion.

@rudokemper rudokemper changed the title Implement a FOSS message broker to queue tasks Implement a FOSS & offline-first message broker to queue tasks May 21, 2024
@IamJeffG
Copy link
Contributor

I have used the in-DB approach in other systems. It works great and I highly recommend it for the simplicity. Introducing a different system (e.g. RabbitMQ) is prob worth it only if you have enormous volume of messages going across.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Projects
None yet
Development

No branches or pull requests

2 participants