askulkarni2
Follow
Starred repositories
Distributed DataFrame for Python designed for the cloud, powered by Rust
LLM inference solution for Amazon Dedicated Cloud (LISA).
LeaderWorkerSet: An API for deploying a group of pods as a unit of replication
A best practices guide for day 2 operations, including operational excellence, security, reliability, performance efficiency, and cost optimization.
Packer configuration for building a custom EKS AMI
Terraform module to create Amazon Elastic Kubernetes (EKS) resources 🇺🇦
Kubernetes community content
Open-source observability for your LLM application, based on OpenTelemetry
🏃🏿♀️🏃🏽♀️🏃🏻♂️🕒CNCF Technical Advisory Group for Runtime
Terraform module to create AWS EKS Pod Identity resources 🇺🇦
MLFlow Deployment Plugin for Ray Serve
Gateway for secure & reliable communications with OpenAI and other LLM providers
Kube Startup CPU Boost is a controller that increases CPU resource requests and limits during Kubernetes workload startup time
The node-latency-for-k8s tool provides process-level telemetry via prometheus metrics, cloudwatch metrics, and markdown timing charts to optimized K8s node launch times.
Collection of best practices, reference architectures, model training examples and utilities to train large models on AWS.
A modular and comprehensive solution to deploy a Multi-LLM and Multi-RAG powered chatbot (Amazon Bedrock, Anthropic, HuggingFace, OpenAI, Meta, AI21, Cohere, Mistral) using AWS CDK on AWS
Karpenter Blueprints is a list of common workload scenarios following best practices. You'll find here details of why configuring the Karpenter and Kubernetes objects in such a way is important whe…
LLM training code for Databricks foundation models
A blazing fast inference solution for text embeddings models
Stable Diffusion with Core ML on Apple Silicon
Helm Chart & Documentation for deploying JupyterHub on Kubernetes
Run your code in the cloud, with technology so advanced, it feels like magic!
Turn repositories into Jupyter-enabled Docker images
Grafana Dashboards useful for k8s + JupyterHub
NVIDIA Linux open GPU kernel module source