同步最新代码

99a0c39e · xingjinliang · 50fe58fa · 99a0c39e · 99a0c39e · 99a0c39e
Commit 99a0c39e authored Dec 25, 2024 by xingjinliang
20 changed files
--- a/megatron/inference/text_generation/forward_step.py
+++ b/megatron/inference/text_generation/forward_step.py
--- a/megatron/inference/text_generation/generation.py
+++ b/megatron/inference/text_generation/generation.py
--- a/megatron/inference/text_generation/sampling.py
+++ b/megatron/inference/text_generation/sampling.py
--- a/megatron/inference/text_generation/tokenization.py
+++ b/megatron/inference/text_generation/tokenization.py
--- a/megatron/inference/text_generation_server.py
+++ b/megatron/inference/text_generation_server.py
--- a/megatron/legacy/data/__init__.py
+++ b/megatron/legacy/data/__init__.py
--- a/megatron/legacy/data/autoaugment.py
+++ b/megatron/legacy/data/autoaugment.py
--- a/megatron/legacy/data/biencoder_dataset_utils.py
+++ b/megatron/legacy/data/biencoder_dataset_utils.py
--- a/megatron/legacy/data/data_samplers.py
+++ b/megatron/legacy/data/data_samplers.py
--- a/megatron/legacy/data/dataset_utils.py
+++ b/megatron/legacy/data/dataset_utils.py
--- a/megatron/legacy/data/ict_dataset.py
+++ b/megatron/legacy/data/ict_dataset.py
--- a/megatron/legacy/data/image_folder.py
+++ b/megatron/legacy/data/image_folder.py
--- a/megatron/legacy/data/multimodal_dataset.py
+++ b/megatron/legacy/data/multimodal_dataset.py
--- a/megatron/legacy/data/orqa_wiki_dataset.py
+++ b/megatron/legacy/data/orqa_wiki_dataset.py
--- a/megatron/legacy/data/realm_dataset_utils.py
+++ b/megatron/legacy/data/realm_dataset_utils.py
--- a/megatron/legacy/data/realm_index.py
+++ b/megatron/legacy/data/realm_index.py
--- a/megatron/legacy/data/vit_dataset.py
+++ b/megatron/legacy/data/vit_dataset.py
--- a/megatron/legacy/fp16_deprecated/loss_scaler.py
+++ b/megatron/legacy/fp16_deprecated/loss_scaler.py
--- a/megatron/legacy/fused_kernels/__init__.py
+++ b/megatron/legacy/fused_kernels/__init__.py
--- a/megatron/legacy/fused_kernels/compat.h
+++ b/megatron/legacy/fused_kernels/compat.h