# SPDX-FileCopyrightText: Copyright (c) 2025 NVIDIA CORPORATION & AFFILIATES. All rights reserved. # SPDX-License-Identifier: Apache-2.0 # # Licensed under the Apache License, Version 2.0 (the "License"); # you may not use this file except in compliance with the License. # You may obtain a copy of the License at # # http://www.apache.org/licenses/LICENSE-2.0 # # Unless required by applicable law or agreed to in writing, software # distributed under the License is distributed on an "AS IS" BASIS, # WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. # See the License for the specific language governing permissions and # limitations under the License. - model_name: meta-llama/llama-3.1-8b-instruct file_path: meta/llama-3.1-8b-instruct/chat_completions/chat-completion.streaming.1 query: What is deep learning? query_type: ChatCompletionsStreaming - model_name: meta-llama/llama-3.1-8b-instruct file_path: meta/llama-3.1-8b-instruct/chat_completions/chat-completion.streaming.2 query: Write a limerick about the wonders of GPU computing. query_type: ChatCompletionsStreaming - model_name: meta-llama/llama-3.1-8b-instruct file_path: meta/llama-3.1-8b-instruct/chat_completions/chat-completion.streaming.3 query: Tell me about Dumbledore. query_type: ChatCompletionsStreaming - model_name: mistralai/mixtral-8x22b-instruct-v0.1 file_path: mistralai/mixtral-8x22b-instruct-v0.1/chat_completions/chat-completion.streaming.1 query: What is deep learning? query_type: ChatCompletionsStreaming - model_name: mistralai/mixtral-8x22b-instruct-v0.1 file_path: mistralai/mixtral-8x22b-instruct-v0.1/chat_completions/chat-completion.streaming.2 query: Write a limerick about the wonders of GPU computing. query_type: ChatCompletionsStreaming - model_name: mistralai/mixtral-8x22b-instruct-v0.1 file_path: mistralai/mixtral-8x22b-instruct-v0.1/chat_completions/chat-completion.streaming.3 query: Tell me about Dumbledore. query_type: ChatCompletionsStreaming - model_name: meta-llama/llama-3.1-8b-instruct file_path: meta/llama-3.1-8b-instruct/completions/completion.streaming.1 query: Explain what is deep learning? query_type: CompletionsStreaming - model_name: meta-llama/llama-3.1-8b-instruct file_path: meta/llama-3.1-8b-instruct/completions/completion.streaming.2 query: Please write a limerick about the wonders of GPU computing. query_type: CompletionsStreaming - model_name: meta-llama/llama-3.1-8b-instruct file_path: meta/llama-3.1-8b-instruct/completions/completion.streaming.3 query: Tell me something about Dumbledore. query_type: CompletionsStreaming - model_name: mistralai/mistral-7b-instruct-v0.3 file_path: mistralai/mistral-7b-instruct-v0.3/completions/completion.streaming.1 query: What is deep learning? query_type: CompletionsStreaming - model_name: mistralai/mistral-7b-instruct-v0.3t file_path: mistralai/mistral-7b-instruct-v0.3/completions/completion.streaming.2 query: Write a limerick about the wonders of GPU computing. query_type: CompletionsStreaming - model_name: mistralai/mistral-7b-instruct-v0.3 file_path: mistralai/mistral-7b-instruct-v0.3/completions/completion.streaming.3 query: Tell me about Dumbledore. query_type: CompletionsStreaming