Get up and running with large language models.

Download

Download

curl -fsSL https://ollama.com/install.sh | sh

Manual install instructions

The official Ollama Docker image ollama/ollama is available on Docker Hub.

• ollama-python
• ollama-js

To run and chat with Llama 3.1:

ollama run llama3.1

Ollama supports a list of models available on ollama.com/library

Here are some example models that can be downloaded:

Ollama supports importing GGUF models in the Modelfile:

1. Create a file named Modelfile, with a FROM instruction with the local filepath to the model you want to import.

   FROM ./vicuna-33b.Q4_0.gguf
   

2. Create the model in Ollama

   ollama create example -f Modelfile
   

3. Run the model

   ollama run example
   

See the guide on importing models for more information.

Models from the Ollama library can be customized with a prompt. For example, to customize the llama3.1 model:

ollama pull llama3.1

Create a Modelfile:

FROM llama3.1

# set the temperature to 1 [higher is more creative, lower is more coherent]
PARAMETER temperature 1

# set the system message
SYSTEM """
You are Mario from Super Mario Bros. Answer as Mario, the assistant, only.
"""

Next, create and run the model:

ollama create mario -f ./Modelfile
ollama run mario
>>> hi
Hello! It's your friend Mario.

For more examples, see the examples directory. For more information on working with a Modelfile, see the Modelfile documentation.

ollama create is used to create a model from a Modelfile.

ollama create mymodel -f ./Modelfile

ollama pull llama3.1

This command can also be used to update a local model. Only the diff will be pulled.