"official/projects/mobilebert/distillation_test.py" did not exist on "05b8eaf2aea1fe92bf0cd1e51e6cd2f65c38de34"
INSTALLATION.md 641 Bytes
Newer Older
Timothy J. Baek's avatar
rename  
Timothy J. Baek committed
1
### Installing Both Ollama and Open WebUI Using Kustomize
Timothy J. Baek's avatar
Timothy J. Baek committed
2
3
4
5
6
7
8
9
10
11
12
13
14

For cpu-only pod

```bash
kubectl apply -f ./kubernetes/manifest/base
```

For gpu-enabled pod

```bash
kubectl apply -k ./kubernetes/manifest
```

Timothy J. Baek's avatar
rename  
Timothy J. Baek committed
15
### Installing Both Ollama and Open WebUI Using Helm
Timothy J. Baek's avatar
Timothy J. Baek committed
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35

Package Helm file first

```bash
helm package ./kubernetes/helm/
```

For cpu-only pod

```bash
helm install ollama-webui ./ollama-webui-*.tgz
```

For gpu-enabled pod

```bash
helm install ollama-webui ./ollama-webui-*.tgz --set ollama.resources.limits.nvidia.com/gpu="1"
```

Check the `kubernetes/helm/values.yaml` file to know which parameters are available for customization