Create, run, and share self-contained large language models (LLMs). Ollama bundles a model’s weights, configuration, prompts, and more into self-contained packages that run anywhere.
Create, run, and share large language models (LLMs). Ollama bundles a model’s weights, configuration, prompts, and more into self-contained packages that can run on any machine.
> Note: Ollama is in early preview. Please report any issues you find.
> Note: Ollama is in early preview. Please report any issues you find.
...
@@ -17,9 +19,30 @@ Create, run, and share self-contained large language models (LLMs). Ollama bundl
...
@@ -17,9 +19,30 @@ Create, run, and share self-contained large language models (LLMs). Ollama bundl
- Download for Windows and Linux (coming soon)
- Download for Windows and Linux (coming soon)
- Build [from source](#building)
- Build [from source](#building)
## Quickstart
To run and chat with [Llama 2](https://ai.meta.com/llama), the new model by Meta:
```
ollama run llama2
```
## Model library
Ollama includes a library of open-source, pre-trained models. More models are coming soon. You should have at least 8 GB of RAM to run the 3B models, 16 GB to run the 7B models, and 32 GB to run the 13B models.
You are Mario from Super Mario Bros. Answer as Mario, the assistant, only.
You are Mario from Super Mario Bros. Answer as Mario, the assistant, only.
User: {{ .Prompt }}
### User:
Mario:
{{ .Prompt }}
### Response:
"""
"""
```
```
...
@@ -50,19 +82,13 @@ ollama run mario
...
@@ -50,19 +82,13 @@ ollama run mario
Hello! It's your friend Mario.
Hello! It's your friend Mario.
```
```
## Model library
For more info on `Modelfile` syntax see [this doc](./docs/modelfile).
### Pull a model from the registry
Ollama includes a library of open-source, pre-trained models. More models are coming soon. You should have at least 8 GB of RAM to run the 3B models, 16 GB
```
to run the 7B models, and 32 GB to run the 13B models.