Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

feat: Add crons task consumers #3106

Merged
merged 3 commits into from
Jun 4, 2024
Merged

feat: Add crons task consumers #3106

Changes from 1 commit
Commits
Show all changes
3 commits
Select commit Hold shift + click to select a range
5471518
feat: Add crons task consumers
wedamija Jun 3, 2024
0bfbda5
add kafka topics
wedamija Jun 3, 2024
d5c516f
add if statement
wedamija Jun 3, 2024
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
Next Next commit
feat: Add crons task consumers 
We now process tasks via Kafka consumers instead of celerybeat. This needs to be added to self-hosted as well
  • Loading branch information
@wedamija
wedamija committed Jun 3, 2024
commit 54715180a3645ca8ec53f5e227273b720f12999d
6 changes: 6 additions & 0 deletions docker-compose.yml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -384,6 +384,12 @@ services:
ingest-monitors:
<<: *sentry_defaults
command: run consumer --no-strict-offset-reset ingest-monitors --consumer-group ingest-monitors
monitors-clock-tick:
<<: *sentry_defaults
command: run consumer --no-strict-offset-reset monitors-clock-tick --consumer-group monitors-clock-tick
monitors-clock-tasks:
<<: *sentry_defaults
command: run consumer --no-strict-offset-reset monitors-clock-tasks --consumer-group monitors-clock-tasks
post-process-forwarder-errors:
<<: *sentry_defaults
command: run consumer post-process-forwarder-errors --consumer-group post-process-forwarder --synchronize-commit-log-topic=snuba-commit-log --synchronize-commit-group=snuba-consumers
Expand Down