"vscode:/vscode.git/clone" did not exist on "c5650bfc0a41ebcbb8940dc0430bb6c095ca09c7"
Unverified Commit 8e4e509f authored by Patrick Devine's avatar Patrick Devine Committed by GitHub
Browse files

update the openai docs to explain how to set the context size (#6548)

parent 47c2b947
...@@ -300,3 +300,28 @@ curl http://localhost:11434/v1/chat/completions \ ...@@ -300,3 +300,28 @@ curl http://localhost:11434/v1/chat/completions \
] ]
}' }'
``` ```
### Setting the context size
The OpenAI API does not have a way of setting the context size for a model. If you need to change the context size, create a `Modelfile` which looks like:
```modelfile
FROM <some model>
PARAMETER num_ctx <context size>
```
Use the `ollama create mymodel` command to create a new model with the updated context size. Call the API with the updated model name:
```shell
curl http://localhost:11434/v1/chat/completions \
-H "Content-Type: application/json" \
-d '{
"model": "mymodel",
"messages": [
{
"role": "user",
"content": "Hello!"
}
]
}'
```
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment