Remove stray `quantize` argument in `get_weights_col_packed_qkv` (#2237)

Fixes #2236.

Remove stray `quantize` argument in `get_weights_col_packed_qkv` (#2237)
Fixes #2236.
da82c63a · Daniël de Kok · GitHub · 2cb18428 · da82c63a
Unverified Commit da82c63a authored Jul 16, 2024 by Daniël de Kok Committed by GitHub Jul 16, 2024
Hide whitespace changes
Inline Side-by-side

Showing with 0 additions and 1 deletion

server/text_generation_server/utils/weights.py server/text_generation_server/utils/weights.py +0 -1

No files found.
--- a/server/text_generation_server/utils/weights.py
+++ b/server/text_generation_server/utils/weights.py
@@ -261,7 +261,6 @@ class Weights:
    def get_weights_col_packed_qkv(
        self,
        prefix: str,
-        quantize: str,
        num_heads: int,
        num_key_value_heads: int,
    ):