Merge tag 'v0.6.5' into v0.6.5-dev

4d3a2c28 · zhuwenwen · 92ec5d8e · 2d1b9baa · 4d3a2c28 · 4d3a2c28
Commit 4d3a2c28 authored Dec 30, 2024 by zhuwenwen
20 changed files
--- a/csrc/quantization/marlin/sparse/marlin_24_cuda_kernel.cu
+++ b/csrc/quantization/marlin/sparse/marlin_24_cuda_kernel.cu
--- a/csrc/quantization/vectorization.cuh
+++ b/csrc/quantization/vectorization.cuh
--- a/csrc/torch_bindings.cpp
+++ b/csrc/torch_bindings.cpp
--- a/csrc/type_convert.cuh
+++ b/csrc/type_convert.cuh
--- a/docs/requirements-docs.txt
+++ b/docs/requirements-docs.txt
--- a/docs/source/_static/custom.js
+++ b/docs/source/_static/custom.js
--- a/docs/source/assets/design/arch_overview/entrypoints.excalidraw.png
+++ b/docs/source/assets/design/arch_overview/entrypoints.excalidraw.png
--- a/docs/source/assets/design/arch_overview/llm_engine.excalidraw.png
+++ b/docs/source/assets/design/arch_overview/llm_engine.excalidraw.png
--- a/docs/source/assets/design/hierarchy.png
+++ b/docs/source/assets/design/hierarchy.png
--- a/docs/source/assets/usage/disagg_prefill/abstraction.jpg
+++ b/docs/source/assets/usage/disagg_prefill/abstraction.jpg
--- a/docs/source/assets/usage/disagg_prefill/overview.jpg
+++ b/docs/source/assets/usage/disagg_prefill/overview.jpg
--- a/docs/source/automatic_prefix_caching/details.md
+++ b/docs/source/automatic_prefix_caching/details.md
--- a/docs/source/community/meetups.rst
+++ b/docs/source/community/meetups.rst
--- a/docs/source/community/sponsors.md
+++ b/docs/source/community/sponsors.md
--- a/docs/source/conf.py
+++ b/docs/source/conf.py
--- a/docs/source/dev/dockerfile/dockerfile.rst
+++ b/docs/source/dev/dockerfile/dockerfile.rst
--- a/docs/source/contributing/overview.rst
+++ b/docs/source/contributing/overview.rst
--- a/docs/source/dev/profiling/profiling_index.rst
+++ b/docs/source/dev/profiling/profiling_index.rst
--- a/docs/source/design/arch_overview.rst
+++ b/docs/source/design/arch_overview.rst
--- a/docs/source/design/huggingface_integration.rst
+++ b/docs/source/design/huggingface_integration.rst