Skip to content

himself65/litllm

 
 

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

13 Commits
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

litllm

14.285714 (repeating of course) percent fewer letters than litellm.

word2vec("litellm") - word2vec("🐍") + word2vec("🤯") === word2vec("litllm") // probably

Setup

npm i litllm

OpenAI:

lit.js:

const { completion } = require("litllm");
process.env["OPENAI_API_KEY"] = "sk-wouldntyouliketoknow";
completion("gpt-4", [{ role: "user", content: "What's lit?" }]).then((res) => {
  console.log(res.message.content);
});

Anthropic:

lit.js:

const { completion } = require("litllm");
process.env["ANTHROPIC_API_KEY"] = "sk-ant-wouldntyouliketoknow";
completion("claude-2", [{ role: "user", content: "What's lit?" }]).then((res) => {
  console.log(res.message.content);
});

Llama2 Replicate:

lit.js:

const { completion } = require("litllm");
process.env["REPLICATE_API_TOKEN"] = "r8_wouldntyouliketoknow"; // 🎩 cause i'm a token
completion("Llama-2-70b-chat-4bit", [{ role: "user", content: "What's lit?" }]).then((res) => {
  console.log(res.message.content);
});

Run

node lit.js

The lit family

About

No description, website, or topics provided.

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Languages

  • TypeScript 100.0%