README.md 6.98 KB
Newer Older
Timothy J. Baek's avatar
Timothy J. Baek committed
1
2
3
4
5
6
7
8
9
# Ollama Web UI 👋

ChatGPT-Style Web Interface for Ollama 🦙

![Ollama Web UI Demo](./demo.gif)

## Features ⭐

- 🖥️ **Intuitive Interface**: Our chat interface takes inspiration from ChatGPT, ensuring a user-friendly experience.
10

Timothy J. Baek's avatar
Timothy J. Baek committed
11
- 📱 **Responsive Design**: Enjoy a seamless experience on both desktop and mobile devices.
12

Timothy J. Baek's avatar
Timothy J. Baek committed
13
-**Swift Responsiveness**: Enjoy fast and responsive performance.
14

Timothy J. Baek's avatar
Timothy J. Baek committed
15
- 🚀 **Effortless Setup**: Install seamlessly using Docker for a hassle-free experience.
16

17
18
- 📥🗑️ **Download/Delete Models**: Easily download or remove models directly from the web UI.

Timothy J. Baek's avatar
Timothy J. Baek committed
19
- 🤖 **Multiple Model Support**: Seamlessly switch between different chat models for diverse interactions.
20

21
- 📜 **Chat History**: Effortlessly access and manage your conversation history.
22

Timothy J. Baek's avatar
Timothy J. Baek committed
23
- 📤📥 **Import/Export Chat History**: Seamlessly move your chat data in and out of the platform.
24

Timothy J. Baek's avatar
Timothy J. Baek committed
25
- ⚙️ **Fine-Tuned Control with Advanced Parameters**: Gain a deeper level of control by adjusting parameters such as temperature and defining your system prompts to tailor the conversation to your specific preferences and needs.
26

27
- 💻 **Code Syntax Highlighting**: Enjoy enhanced code readability with our syntax highlighting feature.
28

29
- 🔗 **External Ollama Server Connection**: You can seamlessly connect to an external Ollama server hosted on a different address by setting the environment variable during the Docker build process. Execute the following command to include the Ollama API base URL in the Docker image: `docker build --build-arg OLLAMA_API_BASE_URL='http://localhost:11434/api' -t ollama-webui .`.
30

Timothy J. Baek's avatar
Timothy J. Baek committed
31
32
33
34
- 🌟 **Continuous Updates**: We are committed to improving Ollama Web UI with regular updates and new features.

## How to Install 🚀

Timothy J. Baek's avatar
Timothy J. Baek committed
35
36
37
38
### Prerequisites

Make sure you have the latest version of Ollama installed before proceeding with the installation. You can find the latest version of Ollama at [https://ollama.ai/](https://ollama.ai/).

Timothy J. Baek's avatar
Timothy J. Baek committed
39
#### Checking Ollama
Timothy J. Baek's avatar
Timothy J. Baek committed
40
41
42

After installing, verify that Ollama is running by accessing the following link in your web browser: [http://127.0.0.1:11434/](http://127.0.0.1:11434/). Note that the port number may differ based on your system configuration.

Timothy J. Baek's avatar
Timothy J. Baek committed
43
#### Accessing Ollama Web Interface over LAN
Timothy J. Baek's avatar
Timothy J. Baek committed
44
45
46
47
48
49
50

If you want to access the Ollama web interface over LAN, for example, from your phone, run Ollama using the following command:

```bash
OLLAMA_HOST=0.0.0.0 OLLAMA_ORIGINS=* ollama serve
```

Timothy J. Baek's avatar
Timothy J. Baek committed
51
If you're running Ollama via Docker:
Timothy J. Baek's avatar
Timothy J. Baek committed
52
53
54
55
56

```bash
docker run -d -v ollama:/root/.ollama -p 11434:11434 -e OLLAMA_ORIGINS="*" --name ollama ollama/ollama
```

Timothy J. Baek's avatar
Timothy J. Baek committed
57
58
### Using Docker 🐳

59
If Ollama is hosted on your local machine, run the following command:
60

61
62
```bash
docker build --build-arg OLLAMA_API_BASE_URL='' -t ollama-webui .
63
docker run -d -p 3000:8080 --name ollama-webui --restart always ollama-webui
Timothy J. Baek's avatar
Timothy J. Baek committed
64
65
66
67
```

Your Ollama Web UI should now be hosted at [http://localhost:3000](http://localhost:3000). Enjoy! 😄

Timothy J. Baek's avatar
Timothy J. Baek committed
68
69
#### Connecting to Ollama on a Different Server

70
If Ollama is hosted on a server other than your local machine, change `OLLAMA_API_BASE_URL` to match:
Timothy J. Baek's avatar
Timothy J. Baek committed
71
72

```bash
73
docker build --build-arg OLLAMA_API_BASE_URL='https://example.com/api' -t ollama-webui .
74
docker run -d -p 3000:8080 --name ollama-webui --restart always ollama-webui
Timothy J. Baek's avatar
Timothy J. Baek committed
75
76
```

77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
93
94
95
96
97
98
99
100
101
102
103
104
105
106
107
108
109
110
111
112
113
114
115
116
117
118
119
## How to Build for Static Deployment

1. Install `node`

   ```sh
   # Mac, Linux
   curl https://webi.sh/node@lts | sh
   source ~/.config/envman/PATH.env
   ```

   ```pwsh
   # Windows
   curl.exe https://webi.ms/node@lts | powershell
   ```

2. Clone & Enter the project
   ```sh
   git clone https://github.com/ollama-webui/ollama-webui.git
   pushd ./ollama-webui/
   ```
3. Create and edit `.env`
   ```sh
   cp -RPp example.env .env
   ```
4. Run in dev mode, or build the site for deployment
   - Test in Dev mode:
     ```sh
     npm run dev
     ```
   - Build for Deploy: \
     (`PUBLIC_API_BASE_URL` will overwrite the value in `.env`)
     ```sh
     PUBLIC_API_BASE_URL='https://example.com/api' npm run build
     ```
5. Test the build with `caddy` (or the server of your choice)

   ```sh
   curl https://webi.sh/caddy | sh

   PUBLIC_API_BASE_URL='https://localhost/api' npm run build
   caddy run --envfile .env --config ./Caddyfile.localhost
   ```

120
121
122
123
124
125
126
127
128
129
130
131
132
133
134
135
136
137
138
139
140
141
142
143
144
145
146
147
## Troubleshooting

### Connection Errors

If you encounter difficulties connecting to the Ollama server, please follow these steps to diagnose and resolve the issue:

**1. Verify Ollama Server Configuration**

Ensure that the Ollama server is properly configured to accept incoming connections from all origins. To do this, make sure the server is launched with the `OLLAMA_ORIGINS=*` environment variable, as shown in the following command:

```bash
OLLAMA_HOST=0.0.0.0 OLLAMA_ORIGINS=* ollama serve
```

This configuration allows Ollama to accept connections from any source.

**2. Check Ollama URL Format**

Ensure that the Ollama URL is correctly formatted in the application settings. Follow these steps:

- Go to "Settings" within the Ollama WebUI.
- Navigate to the "General" section.
- Verify that the Ollama URL is in the following format: `http://localhost:11434/api`.

It is crucial to include the `/api` at the end of the URL to ensure that the Ollama Web UI can communicate with the server.

By following these troubleshooting steps, you should be able to identify and resolve connection issues with your Ollama server configuration. If you require further assistance or have additional questions, please don't hesitate to reach out or refer to our documentation for comprehensive guidance.

Timothy J. Baek's avatar
Timothy J. Baek committed
148
149
150
151
152
153
## What's Next? 🚀

### To-Do List 📝

Here are some exciting tasks on our to-do list:

154
155
- 🌐 **Web Browser Extension**: Seamlessly integrate our services into your browsing experience with our convenient browser extension.
- 🚀 **Integration with Messaging Platforms**: Explore possibilities for integrating with popular messaging platforms like Slack and Discord.
Timothy J. Baek's avatar
Timothy J. Baek committed
156
157
158
159
160
161
162
163
164
165
166
- 🎨 **Customization**: Tailor your chat environment with personalized themes and styles.
- 📚 **Enhanced Documentation**: Elevate your setup and customization experience with improved, comprehensive documentation.
- 🌟 **User Interface Enhancement**: Elevate the user interface to deliver a smoother, more enjoyable interaction.
- 🧐 **User Testing and Feedback Gathering**: Conduct thorough user testing to gather insights and refine our offerings based on valuable user feedback.

Feel free to contribute and help us make Ollama Web UI even better! 🙌

## Contributors ✨

A big shoutout to our amazing contributors who have helped make this project possible! 🙏

Timothy Jaeryang Baek's avatar
Timothy Jaeryang Baek committed
167
- [Ollama Team](https://github.com/jmorganca/ollama)
Timothy J. Baek's avatar
Timothy J. Baek committed
168
- [Timothy J. Baek](https://github.com/tjbck)
169
- [AJ ONeal](https://github.com/coolaj86)
Timothy J. Baek's avatar
Timothy J. Baek committed
170
171
172
173
174
175
176
177
178
179
180
181

## License 📜

This project is licensed under the [MIT License](LICENSE) - see the [LICENSE](LICENSE) file for details. 📄

## Support 💬

If you have any questions, suggestions, or need assistance, please open an issue or join our [Discord community](https://discord.gg/ollama) to connect with us! 🤝

---

Let's make Ollama Web UI even more amazing together! 💪