Commits · f1042e86f05cfe93bcadac445e78671ed2e8fddb · myrfy001 / vllm_dsv4

"examples/offline_inference/basic.py" did not exist on "d1557e66d3227355e5aed8018a945a5e6a733147"

12 Feb, 2025 10 commits
- [Misc] AMD Build Improvements (#12923) · f1042e86
  Shiyan Deng authored Feb 12, 2025
  
  f1042e86
- Further reduce the HTTP calls to huggingface.co (#13107) · 7c4033ac
  Maximilien de Bayser authored Feb 12, 2025
  
  7c4033ac
- Bump actions/setup-python from 5.3.0 to 5.4.0 (#12672) · d59def47
  dependabot[bot] authored Feb 12, 2025
  
  d59def47
- Bump helm/chart-testing-action from 2.6.1 to 2.7.0 (#12463) · 0c7d9eff
  dependabot[bot] authored Feb 12, 2025
  
  0c7d9eff
- Bump actions/stale from 9.0.0 to 9.1.0 (#12462) · dd3b4a01
  dependabot[bot] authored Feb 12, 2025
  
  dd3b4a01
- Bump helm/kind-action from 1.10.0 to 1.12.0 (#11612) · a0597c6b
  dependabot[bot] authored Feb 12, 2025
  
  a0597c6b
- [Neuron][Kernel] Support Longer Sequences in NKI-based Flash PagedAttention... · e92694b6
  Lingfan Yu authored Feb 11, 2025
```
[Neuron][Kernel] Support Longer Sequences in NKI-based Flash PagedAttention and Improve Efficiency (#12921)
Signed-off-by: Lingfan Yu <lingfany@amazon.com>
```
  e92694b6
- [ci] Add more source file dependencies for some tests (#13123) · 842b0fd4
  Kevin H. Luu authored Feb 11, 2025
```
Signed-off-by: <>
Co-authored-by: EC2 Default User <ec2-user@ip-172-31-20-117.us-west-2.compute.internal>
```
  842b0fd4
- [Model] IBM/NASA Prithvi Geospatial model (#12830) · 974dfd49
  Christian Pinto authored Feb 12, 2025
  
  974dfd49
- [RFC][vllm-API] Support tokenizer registry for customized tokenizer in vLLM (#12518) · 3ee696a6
  Keyun Tong authored Feb 11, 2025
```
Signed-off-by: Keyun Tong <tongkeyun@gmail.com>
```
  3ee696a6
11 Feb, 2025 24 commits
- [Misc] Move pre-commit suggestion back to the end (#13114) · 72c2b68d
  Russell Bryant authored Feb 11, 2025
```
Signed-off-by: Russell Bryant <rbryant@redhat.com>
```
  72c2b68d
- [Bugfix] Guided decoding falls back to outlines when fails to import xgrammar (#12976) · 14ecab5b
  Yuan Tang authored Feb 11, 2025
```
Signed-off-by: Yuan Tang <terrytangyuan@gmail.com>
```
  14ecab5b
- [Doc] Improve OpenVINO installation doc (#13102) · deb6c1c6
  Harry Mellor authored Feb 11, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  deb6c1c6
- [CI/Build][Bugfix] Fix CPU backend default threads num (#13077) · 565c1efa
  Li, Jiang authored Feb 12, 2025
  
  565c1efa
- Fix initializing GGUF weights for ColumnParallelLinear when using tensor parallel > 1 (#13023) · 2b25b7d2
  Szymon Ożóg authored Feb 11, 2025
  
  2b25b7d2
- [BugFix] Pop instead of del CUDA_VISIBLE_DEVICES (#12962) · 6c4dbe23
  ℍ𝕠𝕝𝕝𝕠𝕨 𝕄𝕒𝕟 authored Feb 11, 2025
```
Signed-off-by: Hollow Man <hollowman@opensuse.org>
```
  6c4dbe23
- [Bugfix] Do not use resource module on Windows (#12858) (#13029) · 21f5d50f
  MoonRide303 authored Feb 11, 2025
  
  21f5d50f
- [Misc] Fix typo at comments at metrics.py (#13024) · bf3e0521
  Jewon Lee authored Feb 12, 2025
  
  bf3e0521
- Set `torch_dtype` in `TransformersModel` (#13088) · ad977635
  Harry Mellor authored Feb 11, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  ad977635
- [V1][Metrics] Add several request timing histograms (#12644) · 75e6e145
  Mark McLoughlin authored Feb 11, 2025
```
Signed-off-by: Mark McLoughlin <markmc@redhat.com>
```
  75e6e145
- [Bugfix] fix flaky test (#13089) · 110f59a3
  மனோஜ்குமார் பழனிச்சாமி authored Feb 11, 2025
```
Signed-off-by: மனோஜ்குமார் பழனிச்சாமி <smartmanoj42857@gmail.com>
```
  110f59a3
- [Platform] add pre_register_and_update function (#12432) · 2e3b969e
  wangxiyuan authored Feb 11, 2025
```
Signed-off-by: wangxiyuan <wangxiyuan1007@gmail.com>
```
  2e3b969e
- [Build] Fix cuda link target of cumem_allocator in CPU env (#12863) · da317197
  Yuhong Guo authored Feb 11, 2025
```
Signed-off-by: YuhongGuo <yuhong.gyh@antgroup.com>
Co-authored-by: Tyler Michael Smith <tyler@neuralmagic.com>
```
  da317197
- [ROCm] Using a more precise memory profiling (#12624) · 7539bbc6
  Gregory Shtrasberg authored Feb 11, 2025
```
Signed-off-by: Gregory Shtrasberg <Gregory.Shtrasberg@amd.com>
```
  7539bbc6
- [executor] init `local_rank` as device index (#13027) · 9cf47594
  Mengqing Cao authored Feb 11, 2025
```
Signed-off-by: Mengqing Cao <cmq0113@163.com>
```
  9cf47594
- [V1][Metrics] Add GPU prefix cache hit rate % gauge (#12592) · 41c5dd45
  Cody Yu authored Feb 11, 2025
  
  41c5dd45
- [Bugfix]: Reasoning output bug according to the chat template change (#13025) · fc6485d2
  Ce Gao authored Feb 11, 2025
```
Signed-off-by: Ce Gao <cegao@tensorchord.ai>
```
  fc6485d2
- [Misc] LoRA - Refactor Punica ops tests (#12970) · 78a141d7
  Varun Sundar Rabindranath authored Feb 11, 2025
```
Signed-off-by: Varun Sundar Rabindranath <varun@neuralmagic.com>
Co-authored-by: Varun Sundar Rabindranath <varun@neuralmagic.com>
```
  78a141d7
- [Core] Don't do platform detection at import time (#12933) · c320ca8e
  Russell Bryant authored Feb 11, 2025
```
Signed-off-by: Russell Bryant <rbryant@redhat.com>
```
  c320ca8e
- [Benchmark] Add BurstGPT to benchmark_serving (#13063) · 58047c6f
  Woosuk Kwon authored Feb 10, 2025
```
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
Co-authored-by: Roger Wang <136131678+ywang96@users.noreply.github.com>
```
  58047c6f
- [Bugfix] Support missing tool parameters in mistral tokenizer (#12884) · cb080f32
  Florian Greinacher authored Feb 11, 2025
```
Signed-off-by: Florian Greinacher <florian.greinacher@siemens.com>
```
  cb080f32
- [Docs] Annouce Meta Meetup (#13065) · 2c0f5820
  Simon Mo authored Feb 10, 2025
```
Signed-off-by: simon-mo <simon.mo@hey.com>
```
  2c0f5820
- [V1][Minor] Move scheduler outputs to a separate file (#13062) · 2ff48576
  Woosuk Kwon authored Feb 10, 2025
```
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
```
  2ff48576
- [misc] Fix setup.py condition to avoid AMD from being mistaken with CPU (#13022) · 91e87675
  Kevin H. Luu authored Feb 10, 2025
```
Signed-off-by: kevin <kevin@anyscale.com>
```
  91e87675
10 Feb, 2025 6 commits
- [Model] Ultravox Model: Support v0.5 Release (#12912) · 08b2d845
  Farzad Abdolhosseini authored Feb 10, 2025
```
Signed-off-by: Farzad Abdolhosseini <farzad@fixie.ai>
```
  08b2d845
- Fix seed parameter behavior in vLLM (#13007) · 2ae88905
  மனோஜ்குமார் பழனிச்சாமி authored Feb 10, 2025
```
Signed-off-by: மனோஜ்குமார் பழனிச்சாமி <smartmanoj42857@gmail.com>
```
  2ae88905
- [Bugfix] Clean up and fix multi-modal processors (#13012) · 51f0b5f7
  Cyrus Leung authored Feb 10, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  51f0b5f7
- [misc] Add retries with exponential backoff for HF file existence check (#13008) · fde71262
  Kevin H. Luu authored Feb 10, 2025
  
  fde71262
- [Doc] Add link to tool_choice tracking issue in tool_calling.md (#13003) · 24313714
  Yuan Tang authored Feb 10, 2025
```
Signed-off-by: Yuan Tang <terrytangyuan@gmail.com>
```
  24313714
- [core] fix sleep mode and pytorch checkpoint compatibility (#13001) · b2496bb0
  youkaichao authored Feb 10, 2025
```
Signed-off-by: youkaichao <youkaichao@gmail.com>
```
  b2496bb0