Unverified Commit 5f0af36a authored by bigmoyan's avatar bigmoyan Committed by GitHub
Browse files

Update kimi-k2 tool calling docs, enable unit tests (#20821)


Signed-off-by: default avatarwangzhengtao <wangzhengtao@moonshot.cn>
Co-authored-by: default avatarwangzhengtao <wangzhengtao@moonshot.cn>
Co-authored-by: default avatarwangzhengtao <wangzhengtao@msh.team>
parent 0d21b266
...@@ -282,6 +282,14 @@ Supported models: ...@@ -282,6 +282,14 @@ Supported models:
Flags: `--tool-call-parser deepseek_v3 --chat-template {see_above}` Flags: `--tool-call-parser deepseek_v3 --chat-template {see_above}`
### Kimi-K2 Models (`kimi_k2`)
Supported models:
* `moonshotai/Kimi-K2-Instruct`
Flags: `--tool-call-parser kimi_k2`
### Models with Pythonic Tool Calls (`pythonic`) ### Models with Pythonic Tool Calls (`pythonic`)
A growing number of models output a python list to represent tool calls instead of using JSON. This has the advantage of inherently supporting parallel tool calls and removing ambiguity around the JSON schema required for tool calls. The `pythonic` tool parser can support such models. A growing number of models output a python list to represent tool calls instead of using JSON. This has the advantage of inherently supporting parallel tool calls and removing ambiguity around the JSON schema required for tool calls. The `pythonic` tool parser can support such models.
......
...@@ -10,8 +10,6 @@ from vllm.entrypoints.openai.protocol import FunctionCall, ToolCall ...@@ -10,8 +10,6 @@ from vllm.entrypoints.openai.protocol import FunctionCall, ToolCall
from vllm.entrypoints.openai.tool_parsers import KimiK2ToolParser from vllm.entrypoints.openai.tool_parsers import KimiK2ToolParser
from vllm.transformers_utils.tokenizer import get_tokenizer from vllm.transformers_utils.tokenizer import get_tokenizer
pytest.skip("skip kimi_k2 parser test", allow_module_level=True)
# Use a common model that is likely to be available # Use a common model that is likely to be available
MODEL = "moonshotai/Kimi-K2-Instruct" MODEL = "moonshotai/Kimi-K2-Instruct"
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment