Skip to content
@distantmagic

distantmagic

README.md

Welcome to Distantmagic 👋 🐈‍⬛

Our mission is to provide open-source tools that enable the effective deployment and use of LLMs and ML models in production settings for developers and MLOps/LLMOps. Our key projects include:

  1. Paddler: An open-source load balancer and reverse proxy optimized for servers running llama.cpp. Paddler ensures efficient request distribution with a stateful load balancer that monitors server slots and health, supporting dynamic scaling.
  2. LLMOps Handbook: (work in progress) Practical and advanced guide to LLMOps. It provides a solid understanding of large language models’ general concepts, deployment techniques, and software engineering practices.
  3. Resonance: A PHP framework for building IO-intensive web applications and services featuring AI capabilities, a built-in web server, and integration with llama.cpp. It leverages asynchronous PHP and Swoole. Learn more about Resonance Framework on the official website.

Join our community on Discord to collaborate and stay updated!

Pinned

  1. paddler paddler Public

    Stateful load balancer custom-tailored for llama.cpp

    Go 492 21

  2. resonance resonance Public

    PHP Framework designed to build IO-intensive web applications.

    PHP 162 6

  3. structured structured Public

    Extracts structured data from unstructured input. Programming language agnostic. Uses llama.cpp

    Go 43 1

  4. llmops-handbook llmops-handbook Public

    Practical and advanced guide to LLMOps. It provides a solid understanding of large language models’ general concepts, deployment techniques, and software engineering practices. (work in progress)

    CSS 43 3

Repositories

Showing 10 of 11 repositories
  • llmops-handbook Public

    Practical and advanced guide to LLMOps. It provides a solid understanding of large language models’ general concepts, deployment techniques, and software engineering practices. (work in progress)

    distantmagic/llmops-handbook’s past year of commit activity
    CSS 43 CC-BY-SA-4.0 3 4 0 Updated Aug 16, 2024
  • paddler Public

    Stateful load balancer custom-tailored for llama.cpp

    distantmagic/paddler’s past year of commit activity
    Go 492 MIT 21 4 (1 issue needs help) 0 Updated Aug 13, 2024
  • .github Public
    distantmagic/.github’s past year of commit activity
    0 0 0 0 Updated Jul 15, 2024
  • resonance Public

    PHP Framework designed to build IO-intensive web applications.

    distantmagic/resonance’s past year of commit activity
    PHP 162 MIT 6 0 0 Updated Jul 9, 2024
  • resonance-project Public

    Minimal code required to start a Resonance Framework project.

    distantmagic/resonance-project’s past year of commit activity
    PHP 1 1 0 0 Updated Jul 8, 2024
  • aloni Public

    Async Python framework optimized for IO-heavy applications.

    distantmagic/aloni’s past year of commit activity
    Python 3 MIT 0 0 0 Updated Jun 29, 2024
  • structured Public

    Extracts structured data from unstructured input. Programming language agnostic. Uses llama.cpp

    distantmagic/structured’s past year of commit activity
    Go 43 MIT 1 0 0 Updated May 16, 2024
  • swoole-futures Public

    Partial implementation of Promise/A+ spec based on Swoole Coroutines.

    distantmagic/swoole-futures’s past year of commit activity
    PHP 0 MIT 0 0 0 Updated Dec 6, 2023
  • graphql-swoole-promise-adapter Public

    Standalone GraphQL Swoole Promise adapter that can be used with https://github.com/webonyx/graphql-php

    distantmagic/graphql-swoole-promise-adapter’s past year of commit activity
    PHP 1 MIT 0 0 0 Updated Nov 8, 2023
  • go-keycloak-bridge Public
    distantmagic/go-keycloak-bridge’s past year of commit activity
    Go 0 0 0 0 Updated Feb 14, 2022
View all repositories

Top languages

Loading…

Most used topics

Loading…