🪢 Open source LLM engineering platform: Observability, metrics, evals, prompt management, playground, datasets. Integrates with LlamaIndex, Langchain, OpenAI SDK, LiteLLM, and more. 🍊YC W23
Test your prompts, agents, and RAGs. Redteaming, pentesting, vulnerability scanning for LLMs. Improve your app's quality and catch problems. Compare performance of GPT, Claude, Gemini, Llama, and more. Simple declarative configs with command line and CI/CD integration.
An open-source visual programming environment for battle-testing prompts to LLMs.
The production toolkit for LLMs. Observability, prompt management and evaluations.
🔰Visual Studio Code Extension For Compiling Language
A command line tool for diffing json rest APIs
🤖 Build AI applications with confidence ✅ DSPy Visualizer ✅ Understand how your users are using your LLM-app ✅ Get a full picture of the quality performance of your LLM-app ✅ Collaborate with your stakeholders in ONE platform ✅ Iterate towards the most valuable & reliable LLM-app.
Safely execute untrusted code with ESM syntax support, dynamic injection of ESM modules from URL or plain JS code, and granular access control based on whitelisting for each JS object.
Test your web app LLM integrations using existing testing frameworks. Confidently launch AI-driven webapps to production.
A highly configurable custom expression tree evaluator
An application to help to make good career choices
Tool to evaluate how FAIR is a resource URL using the F-UJI API
Continual development workflow developed for HackFS 2023
Evaluation framework for LLMs and prompts on real world coding tasks in JavaScript, Python and SQL
Programming Language Selector based on language metadata and user-specified values.
Primary School Academic Information Management System, PSAIMS makes it easy to collect, process, analyse and disseminate Tanzanian based primary school academic information.
Integrate FigTree Evaluator with JSON Forms
Package for transforming a string with logical operators into the result of an expression
Add a description, image, and links to the evaluation topic page so that developers can more easily learn about it.
To associate your repository with the evaluation topic, visit your repo's landing page and select "manage topics."