"vscode:/vscode.git/clone" did not exist on "7d36d263a8356fac0bb363617b0c57c3bac6f89f"
Unverified Commit 1489cd6c authored by Vincent Zhong's avatar Vincent Zhong Committed by GitHub
Browse files

[docs / oneliner] update mmmu docs instruction (#9768)


Co-authored-by: default avatargemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
parent fc2c3a3d
...@@ -39,8 +39,11 @@ You can use `--extra-request-body` to specify additional OpenAI request paramete ...@@ -39,8 +39,11 @@ You can use `--extra-request-body` to specify additional OpenAI request paramete
python3 bench_sglang.py --extra-request-body '{"max_new_tokens": 128, "temperature": 0.01}' python3 bench_sglang.py --extra-request-body '{"max_new_tokens": 128, "temperature": 0.01}'
``` ```
### Evaluate hf ### Evaluate HF
``` ```
python benchmark/mmmu/bench_hf.py --model-path Qwen/Qwen2-VL-7B-Instruct python benchmark/mmmu/bench_hf.py --model-path Qwen/Qwen2-VL-7B-Instruct
``` ```
# Profiling MMMU
You should use the standard instructions found in the [dedicated profiling doc](../../docs/developer_guide/benchmark_and_profiling.md) if running this benchmark with the profile option. We recommend using `--concurrency 1` for consistency, which makes profiling and debugging easier.
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment