Skip to content

oslabs-beta/Kafka-Nimbus

Kafka-Nimbus


Logo

About Kafka Nimbus

Kafka Nimbus is an open source product whose goal is to provide developers a method in which they can easily host their Kafka cluster onto the cloud. The user-friendly GUI allows direct visibility and modification of data like topic partitions and consumer group information, which are typically not readily accessible through the AWS interface.

For more information, visit our website and our medium article.

Tech Stacks

TypescriptJavaScriptReactReduxReduxTKGrafanaPrometheusJestTailwindtrpcNextJSPrismaNextAuthKafkaJSDockerAWS



Table of Contents

  1. About Kafka Nimbus
  2. Features
  3. User Guide
  4. Authors
  5. License


Features

  • No download or installation required! Simply sign in using Github and start managing your clusters right away.
  • Streamlines cluster creation by eliminating the reliance on AWS Managed Streaming for Apache Kafka (MSK) and provides a simplified, self-hosted solution.
  • Intuitive interface that simplifies the management of multiple clusters at the same time.
  • Real-time cluster health metrics monitoring, such as broker health, network usage, and message throughput.
  • Offers precise customization of parameters when creating new clusters and topics.
  • Delivers a secure and scalable solution by leveraging cloud infrastructure providers like AWS, ensuring clusters are fault tolerant and highly scalable.

User guide

STEP 1 — Create an AWS account

STEP 2 — Create new users

  • On the left bar, click Users, and make a new user, checking off the box saying Provide user access to the AWS Management Console and I want to create an IAM user. Don't forget to make a new user for yourself.

STEP 3 — Assigning policies to user

  • Navigate to the IAM dashboard through the searchbar click on users. Add the following permissions to each new user created.

    • Amazon MSK full access
    • Amazon VPC full access

    Logo

STEP 4 — Generating New Access Keys

  • Create an secret access key for the new user.

STEP 5 — Add users to Group

  • Go to the newly created group, add new team members to the group

STEP 6 — Creating a new cluster

  • Click on the create a cluster card input the AWS credentials that you have saved. It will only ask you for the first time you create a new cluster.

STEP 7 — View cluster metrics

  • Navigate to different pages to view different cluster information through the menu on the left






Authors

Developed By Github LinkedIn
Andrew Kim Github LinkedIn
Jackson Dahl Github LinkedIn
Ariel Lin Github LinkedIn
Paul Vachon Github LinkedIn
Ijoo Yoon Github LinkedIn



License

Distributed under the MIT License. See LICENSE.txt for more information.