"megatron/git@developer.sourcefind.cn:wuxk1/megatron-lm.git" did not exist on "651cc107d7e4070e8661ccaf19cd9f4f283e0dd0"
- 28 Mar, 2024 2 commits
-
-
Arthur authored
* add some help * style
-
Minseo Kang authored
-
- 27 Mar, 2024 9 commits
-
-
Lorenzo Verardo authored
This commit adds gate jitter to MixtralSparseMoeBlock's input data before passing it through the MoE layer, if turned on.
-
huismiling authored
* add Cambricon MLUs support * fix mlu device rng state * up for quality check * up mlu to support fp16 * fix mlu device dependency error * fix mlu device dependency error * enable mlu device for bf16 * fix mlu device memory tracker
-
Raushan Turganbay authored
* add eos stopping criteria * minor fix * Update tests/generation/test_stopping_criteria.py Co-authored-by:
Joao Gante <joaofranciscocardosogante@gmail.com> * check eos is not None and fix tests * make style and fixup * Update src/transformers/generation/stopping_criteria.py Co-authored-by:
Arthur <48595927+ArthurZucker@users.noreply.github.com> * Update src/transformers/generation/stopping_criteria.py Co-authored-by:
-
Marc Sun authored
fix foward
-
Lysandre Debut authored
* Automatic safetensors conversion when lacking these files (#29390) * Automatic safetensors conversion when lacking these files * Remove debug * Thread name * Typo * Ensure that raises do not affect the main thread * Catch all errors
-
Hovnatan Karapetyan authored
* Check for requires_grad when initing weights * Add unit test * Move sinusoidal positional encoding generation after post_init() * Add modules to skip init list * Move create_sinusoidal_embeddings to _init_weights
-
Anton Vlasjuk authored
* FIX: Cached slow forward in mamba - additionally added mamba cached test - added unused test (mamba causal lm forward and backward) - fixed typo: "causl" --> "causal" * formatting * fix: use real `slow_forward` call instead of torch module's * add shape assertion for mixer block test * adjust shape assertion
-
Bo Zheng authored
* add support for qwen2 MoE models * update docs * add support for qwen2 MoE models * update docs * update model name & test * update readme * update class names & readme & model_doc of Qwen2MoE. * update architecture name * fix qwen2_moe tests * use Qwen2Tokenizer instead of Qwen2MoeTokenizer * update modeling_qwen2_moe.py * fix model architecture * fix qwen2_moe tests * use Qwen2Tokenizer instead of Qwen2MoeTokenizer * update modeling_qwen2_moe.py * fix model architecture * fix style * fix test when there are sparse and non sparse layers * fixup * Update README.md Co-authored-by:
bozheng-hit <dsoul0621@gmail.com> Co-authored-by:
-
Benjamin Minixhofer authored
* fix tinyllama flax modelling * rename vars to minimize changes * move * formatting * remove unused var
-
- 26 Mar, 2024 8 commits
-
-
Lucain authored
-
Ilyas Moutawwakil authored
* remove py3nvml to skip amd memory benchmarks * uninstall pynvml from docker images
-
Yanyi Liu authored
* Add cosine_with_min_lr scheduler * Update error message for missing min_lr or min_lr_rate
-
Zhihao Lin authored
* update * add ut * update
-
Michael authored
-
Merve Noyan authored
Update image_feature_extraction.md
-
yunxiangtang authored
* replace the 'decord' with 'av' in VideoClassificationPipeline * fix the check of backend in VideoClassificationPipeline * adjust the order of imports * format 'video_classification.py' * format 'video_classification.py' with ruff --------- Co-authored-by:wanqiancheng <13541261013@163.com>
-
Jonathan Flynn authored
* add warnings if training args differ from checkpoint args stored in trainer_state.json * run formatting and styling * add a test * format and styling --------- Co-authored-by:Jonathan Flynn <jonl.flynn@guardian.co.uk>
-
- 25 Mar, 2024 6 commits
-
-
Johannes Kolbe authored
Co-authored-by:Johannes <johannes.kolbe@tech.better.team>
-
Arthur Zucker authored
-
Arthur Zucker authored
-
Yuki Watanabe authored
* Populate torch_dtype from model to pipeline Signed-off-by:
B-Step62 <yuki.watanabe@databricks.com> * use property Signed-off-by:
-
yhuang authored
fix the behavior of collecting 'num_input_tokens_seen' See https://github.com/huggingface/transformers/issues/28791 for more details.
-
Lysandre Debut authored
* [test_all] Remove static pretrained maps from the library's internals * Deprecate archive maps instead of removing them * Revert init changes * [test_all] Deprecate instead of removing * [test_all] PVT v2 support * [test_all] Tests should all pass * [test_all] Style * Address review comments * Update src/transformers/models/deprecated/_archive_maps.py Co-authored-by:
-
- 24 Mar, 2024 1 commit
-
-
gamepad_coder authored
* model_summary.md - Add link to Harvard's Annotated Transformer. * model_summary.md - slight wording change + capitalize name of the paper * model_summary.md - moves the Annotated Transformer link in a praenthesis next to the link to the original paper (great idea, stevhliu!) * model_summary.md - moves the Annotated Transformer link in a praenthesis next to the link to the original paper (commit pt. 2, accidentally removed "has" in pt. 1)
-
- 23 Mar, 2024 1 commit
-
-
Billy Cao authored
Fix typo for llava next docs
-
- 22 Mar, 2024 10 commits
-
-
amyeroberts authored
[SuperPoint] Fix doc example
-
Lysandre Debut authored
* Security policy * Apply suggestions from code review Co-authored-by:
Luc Georges <McPatate@users.noreply.github.com> Co-authored-by:
Michelle Habonneau <83347449+Michellehbn@users.noreply.github.com> * Update SECURITY.md Co-authored-by:
Diogo Teles Sant'Anna <diogoteles@google.com> --------- Co-authored-by:
-
Arthur authored
nit
-
igeni authored
replaced concatenation to f-strings to improve readability and unify with the rest code
-
Joao Gante authored
remove unused attrs
-
jiqing-feng authored
* rm input dtype change in CPU * add warning when use CPU low-precision * rm useless logging
-
fxmarty authored
* correct llava mask * fix vipllava as wlel * mask out embedding for padding tokens * add test * fix style * add setter * fix test on suggestion
-
Ilyas Moutawwakil authored
* enable amd ci * remove unnecessary clean up
-
Steven Madere authored
Fix type hint for train_dataset param of Trainer.__init__() to allow IterableDataset. Issue 29678 (#29738) * Fixed typehint for train_dataset param in Trainer.__init__(). Added IterableDataset option. * make fixup
-
Arthur authored
* update quality check * make it nice * update * let's make sure it runs and we have the logs actually * update workflow * nits
-
- 21 Mar, 2024 3 commits
-
-
Raushan Turganbay authored
* change in-place -> out-of-place * add tests * add more tests * naming consistency * fix doctest * forgot min-length processors * empty * Revert "fix doctest" This reverts commit 4772768457f9bc057f1d4d9d67ea94eb7224eb8d. * revert change in docstring * Update tests/generation/test_logits_process.py Co-authored-by:
amyeroberts <22614925+amyeroberts@users.noreply.github.com> * Update tests/generation/test_logits_process.py Co-authored-by:
-
Raushan Turganbay authored
* prepend "bos" to blip generation * minor changes * Update src/transformers/models/blip_2/modeling_blip_2.py Co-authored-by:
-
Joao Gante authored
* always convert the mask * rebase and fix copies
-
