Build powerful LLM-based Dart/Flutter applications.

Check out the announcement post: Introducing LangChain.dart 🦜️🔗

LangChain.dart is a Dart port of the popular LangChain Python framework created by Harrison Chase.

LangChain provides a set of ready-to-use components for working with language models and the concept of chains, which allows to "chain" components together to formulate more advanced use cases around LLMs.

The components can be grouped into a few core modules:

• 📃 Model I/O: streamlines the interaction between the model inputs (prompt templates), the Language Model (abstracting different providers), and the model output (output parsers).
• 📚 Data Connection: assists in loading user data (document loaders), modifying it (document transformers), storing (via text embedding models and vector stores), and retrieving when needed (retrievers).
• 🔗 Chains: a way to compose multiple components or other chains into a single pipeline.
• 🧠 Memory: equips chains or agents with both short-term and long-term memory capabilities, facilitating recall of prior interactions with the user.
• 🤖 Agents: "Bots" that harness LLMs to perform tasks. They serve as the link between LLM and the tools (web search, calculators, database lookup, etc.). They determine what has to be accomplished and the tools that are more suitable for the specific task.

Large Language Models (LLMs) have revolutionized Natural Language Processing (NLP), serving as essential components in a wide range of applications, such as question-answering, summarization, translation, and text generation.

The adoption of LLMs is creating a new tech stack in its wake. However, emerging libraries and tools are predominantly being developed for the Python and JavaScript ecosystems. As a result, the number of applications leveraging LLMs in these ecosystems has grown exponentially.

In contrast, the Dart / Flutter ecosystem has not experienced similar growth, which can likely be attributed to the scarcity of Dart and Flutter libraries that streamline the complexities associated with working with LLMs.

LangChain.dart aims to fill this gap by abstracting the intricacies of working with LLMs in Dart and Flutter, enabling developers to harness their combined potential effectively.

LangChain.dart has a modular design where the core langchain package provides the LangChain API and each integration with a model provider, data store, etc. is provided by a separate package.

Package	Version	Description	Models	Data conn.	Chains	Agents & Tools
langchain		Core LangChain API	★	★	★	★
langchain_chroma		Chroma DB integration		✔
langchain_google		Google integration (VertexAI, PaLM, Matching Engine, etc.)	✔	✔
langchain_openai		OpenAI integration (GPT-3, GPT-4, Functions, etc.)	✔	✔	✔	✔
langchain_pinecone		Pinecone DB integration		✔

The following packages are maintained (and used internally) by LangChain.dart, although they can also be used independently:

Package	Version	Description
chromadb		Chroma DB API client
vertex_ai		GCP Vertex AI API client

To start using LangChain.dart, add langchain as a dependency to your pubspec.yaml file. Also, include the dependencies for the specific integrations you want to use (e.g.langchain_openai):

dependencies:
  langchain: {version}
  langchain_openai: {version}

The most basic building block of LangChain.dart is calling an LLM on some input:

final llm = OpenAI(apiKey: openaiApiKey);
final result = await llm('Hello world!');
// Hello everyone! I'm new here and excited to be part of this community.

But you can build complex pipelines by chaining together multiple components:

final promptTemplate1 = ChatPromptTemplate.fromTemplate(
  'What is the city {person} is from? Only respond with the name of the city.',
);
final promptTemplate2 = ChatPromptTemplate.fromTemplate(
  'What country is the city {city} in? Respond in {language}.',
);

final model = ChatOpenAI(apiKey: openaiApiKey);
const stringOutputParser = StringOutputParser();

final chain = Runnable.fromMap({
      'city': promptTemplate1 | model | stringOutputParser,
      'language': Runnable.getItemFromMap('language'),
    }) |
    promptTemplate2 |
    model |
    stringOutputParser;

final res = await chain.invoke({
  'person': 'Rafael Nadal',
  'language': 'Spanish',
});
print(res);
// La ciudad de Manacor se encuentra en España.

• LangChain conceptual guide
• LangChain.dart documentation
• Sample apps
• LangChain.dart blog
• Project board

Having trouble? Get help in the official LangChain.dart Discord.

New contributors welcome! Check out our Contributors Guide for help getting started.

Join us on Discord to meet other maintainers. We'll help you get your first contribution in no time!

• LangChain: The original Python LangChain project.
• LangChain.js: A JavaScript port of LangChain.
• LangChain.go: A Go port of LangChain.
• LangChain.rb: A Ruby port of LangChain.

LangChain.dart is licensed under the MIT License.