Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

feat: upgrade to zookeeper-less kafka #2445

Merged
merged 3 commits into from
Oct 17, 2023
Merged

Conversation

joshuarli
Copy link
Member

We've upgraded to zookeeper-less kafka upstream: getsentry/sentry#55742

This simplifies the self-hosted environment and makes things leaner with less moving parts.

KAFKA_CONTROLLER_QUORUM_VOTERS: "[email protected]:29093"
KAFKA_CONTROLLER_LISTENER_NAMES: "CONTROLLER"
KAFKA_NODE_ID: "1"
CLUSTER_ID: "MkU3OEVBNTcwNTJENDM2Qk"
Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Could we generate a UUID for CLUSTER_ID value instead of hard-coding a single string for every instance?

Copy link
Member Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

There aren't any benefits I can think of from doing so. It's just used for cluster coordination.

Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

We can leverage this existing code if we wanted to:

head /dev/urandom | tr -dc "a-z0-9@#%^&*(-_=+)" | head -c 50 | sed -e 's/[\/&]/\\&/g'

@hubertdeng123 hubertdeng123 merged commit a177142 into master Oct 17, 2023
6 checks passed
@hubertdeng123 hubertdeng123 deleted the upgrade-to-zkless-kafka branch October 17, 2023 20:50
hubertdeng123 added a commit that referenced this pull request Oct 18, 2023
hubertdeng123 added a commit that referenced this pull request Oct 19, 2023
@github-actions github-actions bot locked and limited conversation to collaborators Nov 4, 2023
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Labels
None yet
Projects
Archived in project
Development

Successfully merging this pull request may close these issues.

None yet

4 participants