-
Tyler Michael Smith authored
Fixes `is_marlin` not being passed into `get_default_config` Also allow `--tensor-parallel-size` in addition to `-tp` and `--tp-size` Signed-off-by:Tyler Michael Smith <tyler@neuralmagic.com>
cfa134d2
Fixes `is_marlin` not being passed into `get_default_config`
Also allow `--tensor-parallel-size` in addition to `-tp` and `--tp-size`
Signed-off-by:
Tyler Michael Smith <tyler@neuralmagic.com>