README.md 578 Bytes
Newer Older
Bruce MacDonald's avatar
Bruce MacDonald committed
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
# Server

🙊

## Installation

If using Apple silicon, you need a Python version that supports arm64:

```bash
wget https://github.com/conda-forge/miniforge/releases/latest/download/Miniforge3-MacOSX-arm64.sh
bash Miniforge3-MacOSX-arm64.sh
```

Get the dependencies:

```bash
pip install -r requirements.txt
```

Bruce MacDonald's avatar
Bruce MacDonald committed
20
21
22
23
24
25
## Building

```bash
python3 build.py
```

Bruce MacDonald's avatar
Bruce MacDonald committed
26
27
28
29
30
31
32
33
34
35
36
37
38
39
## Running

Put your model in `models/` and run:

```bash
python server.py
```

## API

### `POST /generate`

model: `string` - The name of the model to use in the `models` folder.
prompt: `string` - The prompt to use.