Enterprise

For companies that need SSO, user management and professional support for LiteLLM Proxy

info

Interested in Enterprise? Schedule a meeting with us here 👉 Talk to founders

Deploy managed LiteLLM Proxy within your VPC.

Includes all enterprise features.

View AWS Marketplace Listing

Get early access

This covers:

• Enterprise Features
  • Security
    • ✅ SSO for Admin UI
    • ✅ Audit Logs with retention policy
    • ✅ JWT-Auth
    • ✅ Control available public, private routes (Restrict certain endpoints on proxy)
    • ✅ Secret Managers AWS Key Manager, Google Secret Manager, Azure Key
    • ✅ IP address‑based access control lists
    • ✅ Track Request IP Address
    • ✅ Use LiteLLM keys/authentication on Pass Through Endpoints
    • ✅ Set Max Request / File Size on Requests
    • ✅ Enforce Required Params for LLM Requests (ex. Reject requests missing ["metadata"]["generation_name"])
  • Customize Logging, Guardrails, Caching per project
    • ✅ Team Based Logging - Allow each team to use their own Langfuse Project / custom callbacks
    • ✅ Disable Logging for a Team - Switch off all logging for a team/project (GDPR Compliance)
  • Controlling Guardrails by Virtual Keys
  • Spend Tracking & Data Exports
    • ✅ Tracking Spend for Custom Tags
    • ✅ Exporting LLM Logs to GCS Bucket
    • ✅ API Endpoints to get Spend Reports per Team, API Key, Customer
  • Prometheus Metrics
    • ✅ Prometheus Metrics - Num Requests, failures, LLM Provider Outages
    • ✅ x-ratelimit-remaining-requests, x-ratelimit-remaining-tokens for LLM APIs on Prometheus
  • Custom Branding
    • ✅ Custom Branding + Routes on Swagger Docs
    • ✅ Public Model Hub
    • ✅ Custom Email Branding
• ✅ Feature Prioritization
• ✅ Custom Integrations
• ✅ Professional Support - Dedicated discord + slack

Frequently Asked Questions

What topics does Professional support cover and what SLAs do you offer?

Professional Support can assist with LLM/Provider integrations, deployment, upgrade management, and LLM Provider troubleshooting. We can’t solve your own infrastructure-related issues but we will guide you to fix them.

• 1 hour for Sev0 issues
• 6 hours for Sev1
• 24h for Sev2-Sev3 between 7am – 7pm PT (Monday through Saturday)

We can offer custom SLAs based on your needs and the severity of the issue

What’s the cost of the Self-Managed Enterprise edition?

Self-Managed Enterprise deployments require our team to understand your exact needs. Get in touch with us to learn more

How does deployment with Enterprise License work?

You just deploy our docker image and get an enterprise license key to add to your environment to unlock additional functionality (SSO, Prometheus metrics, etc.).

LITELLM_LICENSE="eyJ..."

No data leaves your environment.