README.md 778 Bytes
Newer Older
jerrrrry's avatar
jerrrrry committed
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
# verl image with verl v0.5

## Important packages version

```txt
cuda==12.6
cudnn==9.8.0
torch==2.7.1
flash_attn=2.8.0    ##
sglang==0.4.8
vllm==0.8.5.post1
vidia-cudnn-cu12==9.8.0.87
transformer_engine==2.3
megatron.core==core_v0.12.2
# Preview
transformer_engine==2.5
megatron.core==core_r0.13.0
```

## Target

- Base image:
    - `verlai/verl:base-verl0.5-cu126-cudnn9.8-torch2.7.0-fa2.7.4`: We offer a base image with deep ep built in, for vllm
    - `verlai/verl:base-verl0.5-cu126-cudnn9.8-torch2.7.1-fa2.7.4`: We offer a base image with deep ep built in, for sglang
- App image:
    - `verlai/verl:app-verl0.5-vllm0.9.1-mcore0.12.2-te2.2`
    - `verlai/verl:app-verl0.5-sglang0.4.8-mcore0.12.2-te2.2`
    - `verlai/verl:app-verl0.5-sglang0.4.9.post2-mcore0.12.2-te2.2`