Skip to content
@flyflow-devs

Flyflow

Welcome to Flyflow 👋 🚀

Flyflow is high performance API middleware to optimize LLM applications, same response quality, 5x lower latency, secure, and much higher token limits

When building on top of LLMs, builders care about the following:

  • Response quality
  • Latency (both time to first token and tokens / second)
  • Rate limits
  • Reliability
  • Enterprise grade security

Flyflow is middleware designed to optimize for all of these qualities, built to be open source, high performance written in golang, and optionally self-hosted for maximum flexiblity.

How it works

We start by proxying your traffic to services like openai, claude, or gemini. As we've collected enough data, we fine tune a custom model based on your query patterns to match the quality of the foundation model. We then deploy this on the highest performance inference providers to provide much faster responses at much lower cost.

Popular repositories Loading

  1. flyflow-openapi flyflow-openapi Public

    Forked from openai/openai-openapi

    OpenAPI specification for the Flyflow API

  2. .github .github Public

  3. fsf fsf Public

    Flyflow service framework

  4. openai-python openai-python Public

    Forked from openai/openai-python

    The official Python library for the OpenAI API

    Python

  5. openai-node openai-node Public

    Forked from openai/openai-node

    The official Node.js / Typescript library for the OpenAI API

    TypeScript

  6. Awesome-LLMOps Awesome-LLMOps Public

    Forked from tensorchord/Awesome-LLMOps

    An awesome & curated list of best LLMOps tools for developers

    Shell

Repositories

Showing 10 of 15 repositories
  • phone-support Public

    Simple phone support app that takes docs and turns them into a phone support agent

    flyflow-devs/phone-support’s past year of commit activity
    JavaScript 0 1 0 0 Updated Jun 15, 2024
  • flyflow-devs/flyflow-python’s past year of commit activity
    Python 0 Apache-2.0 0 0 0 Updated Jun 10, 2024
  • demo Public

    Some demo apps and notebooks for flyflow

    flyflow-devs/demo’s past year of commit activity
    Jupyter Notebook 0 MIT 0 0 0 Updated May 28, 2024
  • flyflow-devs/forwarding-embed’s past year of commit activity
    JavaScript 0 Apache-2.0 0 0 0 Updated May 20, 2024
  • website-demo Public

    Demo app of using the flyflow api on our website

    flyflow-devs/website-demo’s past year of commit activity
    0 0 0 0 Updated May 13, 2024
  • flyflow-devs/voice-example’s past year of commit activity
    Python 0 0 0 0 Updated Apr 29, 2024
  • flyflow-devs/inference’s past year of commit activity
    Python 0 Apache-2.0 0 0 0 Updated Apr 22, 2024
  • jobs Public
    flyflow-devs/jobs’s past year of commit activity
    Python 0 Apache-2.0 0 0 0 Updated Apr 4, 2024
  • Awesome-LLMOps Public Forked from tensorchord/Awesome-LLMOps

    An awesome & curated list of best LLMOps tools for developers

    flyflow-devs/Awesome-LLMOps’s past year of commit activity
    Shell 0 CC0-1.0 355 0 0 Updated Apr 2, 2024
  • lorax Public Forked from predibase/lorax

    Multi-LoRA inference server that scales to 1000s of fine-tuned LLMs

    flyflow-devs/lorax’s past year of commit activity
    Python 0 Apache-2.0 132 0 0 Updated Mar 29, 2024

People

This organization has no public members. You must be a member to see who’s a part of this organization.

Top languages

Loading…

Most used topics

Loading…