development.md 670 Bytes
Newer Older
Bruce MacDonald's avatar
Bruce MacDonald committed
1
2
# Development

3
4
5
6
- Install cmake or (optionally, required tools for GPUs)
- run `go generate ./...`
- run `go build .`

Jeffrey Morgan's avatar
Jeffrey Morgan committed
7
Install required tools:
Bruce MacDonald's avatar
Bruce MacDonald committed
8

9
10
11
12
- cmake version 3.24 or higher
- go version 1.20 or higher
- gcc version 11.4.0 or higher

Bruce MacDonald's avatar
Bruce MacDonald committed
13
```
14
brew install go cmake gcc
Bruce MacDonald's avatar
Bruce MacDonald committed
15
16
```

17
Get the required libraries:
18
19

```
20
go generate ./...
21
22
```

Matt Williams's avatar
Matt Williams committed
23
Then build ollama:
Bruce MacDonald's avatar
Bruce MacDonald committed
24
25

```
Matt Williams's avatar
Matt Williams committed
26
go build .
Bruce MacDonald's avatar
Bruce MacDonald committed
27
28
```

Jeffrey Morgan's avatar
Jeffrey Morgan committed
29
Now you can run `ollama`:
Bruce MacDonald's avatar
Bruce MacDonald committed
30
31

```
Jeffrey Morgan's avatar
Jeffrey Morgan committed
32
./ollama
Bruce MacDonald's avatar
Bruce MacDonald committed
33
```
34
35
36
37

## Building on Linux with GPU support

- Install cmake and nvidia-cuda-toolkit
Bruce MacDonald's avatar
Bruce MacDonald committed
38
- run `CUDA_PATH=/path/to/libcuda.so CUBLAS_PATH=/path/to/libcublas.so CUDART_PATH=/path/to/libcudart.so CUBLASLT_PATH=/path/to/libcublasLt.so go generate ./...`
39
- run `go build .`