Unverified Commit b0f7d8a5 authored by Ayush Agarwal's avatar Ayush Agarwal Committed by GitHub
Browse files

docs(vllm-omni): note transformers>=5.0 requirement for GLM-Image (#8287)


Signed-off-by: default avatarayushag <ayushag@nvidia.com>
parent 0652441f
...@@ -372,6 +372,8 @@ sequenceDiagram ...@@ -372,6 +372,8 @@ sequenceDiagram
GLM-Image is a 2-stage text-to-image model with an AR stage (generates prior token IDs) and a DiT stage (diffusion denoising + VAE decode). The built-in vLLM-Omni stage config already assigns each stage to a separate GPU. GLM-Image is a 2-stage text-to-image model with an AR stage (generates prior token IDs) and a DiT stage (diffusion denoising + VAE decode). The built-in vLLM-Omni stage config already assigns each stage to a separate GPU.
> **Known issue:** GLM-Image requires `transformers>=5.0` to recognize the `glm_image` architecture. Older versions fail at model config creation with `The checkpoint you are trying to load has model type 'glm_image' but Transformers does not recognize this architecture`.
```bash ```bash
bash examples/backends/vllm/launch/disagg_omni_glm_image.sh bash examples/backends/vllm/launch/disagg_omni_glm_image.sh
``` ```
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment