Skip to content
forked from lunary-ai/lunary

The production toolkit for LLMs. Observability, prompt management and evaluations.

License

Notifications You must be signed in to change notification settings

superf0sh/lunary

 
 

Repository files navigation

📈 lunary

Open-source observability & prompt platform for LLMs

website - docs - self host

npm version PyPI - Version GitHub last commit (by committer) GitHub commit activity (branch)

Features

Lunary helps AI devs take their apps in production, with features such as:

  • 💵 Analytics (cost, token, latency, ..)
  • 🔍 Monitoring (logs, traces, user tracking, ..)
  • ⛩️ Prompt Templates (versioning, team collaboration, ..)
  • 🏷️ Creat fine-tuning datasets
  • 🖲️ Chat & feedback tracking
  • 🧪 Evaluations

It also designed to be:

  • 🤖 Usable with any model, not just OpenAI
  • 📦 Easy to integrate (2 minutes)
  • 🧑‍💻 Simple to self-host

Demo

demo720.mp4

⚙️ Integration

Modules available for:

Lunary natively supports:

Additionally you can use it with any framework by wrapping the relevant methods.

📚 Documentation

Full documentation is available on the website.

☁️ Hosted version

We offer a hosted version with a free plan of up to 1k requests / days.

With the hosted version:

  • 👷 don't worry about devops or managing updates
  • 🙋 get priority 1:1 support with our team
  • 🇪🇺 your data is stored safely in Europe

Running locally

Lunary is powered by Node.js.

To run it locally, you'll need access to a Postgres database to set as the DATABASE_URL in your .env file.

# Clone the repository
git clone https://github.com/lunary-ai/lunary

# Copy env variables
cp .env.example .env

# Install dependencies
npm install

# Run the development server
npm run dev

🙋 Support

Need help or have questions? Chat with us on the website or email us: hello [at] lunary.ai. We're here to support you every step of the way.

License

This project is licensed under the Apache 2.0 License.

About

The production toolkit for LLMs. Observability, prompt management and evaluations.

Resources

License

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Languages

  • TypeScript 97.8%
  • Python 1.4%
  • Other 0.8%