README.md 860 Bytes
Newer Older
dengjb's avatar
dengjb committed
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
![](../resources/logo.jpeg)

[English](README.md) | [中文](README_zh.md)

## Local Mode

The new version of the CodeGeeX plugin **supports offline mode**, allowing the use of offline deployed models to complete automatic
completion and simple conversation functions.

## Usage Tutorial

### 1. Install Dependencies

```bash
cd local_mode
pip install -r requirements.txt
```

### 2. Run the Project

```bash
python main.py --model_name_or_path THUDM/codegeex4-all-9b --device cuda --bf16 true
>>> Running on local URL:  http://127.0.0.1:8080
```

### 3. Set API Address and Model Name

As shown in the figure below, after opening the plugin with the local mode, enter the API address and model name in the settings.
![](resources/pic1.png)

### 4. Start Using

Click 'Connect' to test, or click 'Ask CodeGeeX' to start using.

## Demo

![](resources/demo.gif)