Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Kafka Connector: Consumer Topic + Grouped Topic Support #139

Open
wants to merge 3 commits into
base: develop
Choose a base branch
from

Conversation

Kuroshii
Copy link
Collaborator

Changes:

  • Index KafkaController instances based on both topic name and the chosen groupId for a topic this way, each different GroupedTopicSources gets it's own underlying KafkaConsumer
  • If class-annotated, a TopicSource is identified by both the default groupId and it's class's name
  • Add tests for the way sources are mapped

I ran all the tests locally and they all eventually passed after a rerun and 2GB of memory. Having another look at our integration tests is a good idea.


Please Review: @seanmrogers @dkessler-sofi @AFrieze

@Kuroshii Kuroshii force-pushed the kafka-topic-and-grouped-topic-support branch from 5ce9869 to 9a6817a Compare October 16, 2017 19:02
@dcshock
Copy link
Owner

dcshock commented Dec 3, 2017

@Kuroshii can you add a release note to the README and update the version for release? Thanks

@Kuroshii Kuroshii force-pushed the kafka-topic-and-grouped-topic-support branch from 9a6817a to 34dd22b Compare December 4, 2017 16:36
@Kuroshii Kuroshii force-pushed the kafka-topic-and-grouped-topic-support branch 2 times, most recently from f12a7f1 to 2190542 Compare March 13, 2018 00:25
@dcshock
Copy link
Owner

dcshock commented Jul 17, 2020

@Kuroshii is this something that we'd like to get merged in? I'm not familiar enough with the kafka connector to make the assessment.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging this pull request may close these issues.

None yet

3 participants