"...git@developer.sourcefind.cn:chenpangpang/transformers.git" did not exist on "5d1a58a6462a45a17380c2487ee733b2f6163c54"
Unverified Commit 75a63198 authored by Arthur's avatar Arthur Committed by GitHub
Browse files

Fix post gemma merge (#31660)

* nit

* toctree issue

* protect gemma2 tests as well

* sdpa supported
parent 727eea4a
...@@ -382,6 +382,8 @@ ...@@ -382,6 +382,8 @@
title: Fuyu title: Fuyu
- local: model_doc/gemma - local: model_doc/gemma
title: Gemma title: Gemma
- local: model_doc/gemma2
title: Gemma2
- local: model_doc/openai-gpt - local: model_doc/openai-gpt
title: GPT title: GPT
- local: model_doc/gpt_neo - local: model_doc/gpt_neo
......
...@@ -43,6 +43,7 @@ FlashAttention-2 is currently supported for the following architectures: ...@@ -43,6 +43,7 @@ FlashAttention-2 is currently supported for the following architectures:
* [Dbrx](https://huggingface.co/docs/transformers/model_doc/dbrx#transformers.DbrxModel) * [Dbrx](https://huggingface.co/docs/transformers/model_doc/dbrx#transformers.DbrxModel)
* [DistilBert](https://huggingface.co/docs/transformers/model_doc/distilbert#transformers.DistilBertModel) * [DistilBert](https://huggingface.co/docs/transformers/model_doc/distilbert#transformers.DistilBertModel)
* [Gemma](https://huggingface.co/docs/transformers/model_doc/gemma#transformers.GemmaModel) * [Gemma](https://huggingface.co/docs/transformers/model_doc/gemma#transformers.GemmaModel)
* [Gemma2](https://huggingface.co/docs/transformers/model_doc/gemma2#transformers.Gemma2Model)
* [GPT2](https://huggingface.co/docs/transformers/model_doc/gpt2) * [GPT2](https://huggingface.co/docs/transformers/model_doc/gpt2)
* [GPTBigCode](https://huggingface.co/docs/transformers/model_doc/gpt_bigcode#transformers.GPTBigCodeModel) * [GPTBigCode](https://huggingface.co/docs/transformers/model_doc/gpt_bigcode#transformers.GPTBigCodeModel)
* [GPTNeo](https://huggingface.co/docs/transformers/model_doc/gpt_neo#transformers.GPTNeoModel) * [GPTNeo](https://huggingface.co/docs/transformers/model_doc/gpt_neo#transformers.GPTNeoModel)
...@@ -202,6 +203,7 @@ For now, Transformers supports SDPA inference and training for the following arc ...@@ -202,6 +203,7 @@ For now, Transformers supports SDPA inference and training for the following arc
* [Dpr](https://huggingface.co/docs/transformers/model_doc/dpr#transformers.DprReader) * [Dpr](https://huggingface.co/docs/transformers/model_doc/dpr#transformers.DprReader)
* [Falcon](https://huggingface.co/docs/transformers/model_doc/falcon#transformers.FalconModel) * [Falcon](https://huggingface.co/docs/transformers/model_doc/falcon#transformers.FalconModel)
* [Gemma](https://huggingface.co/docs/transformers/model_doc/gemma#transformers.GemmaModel) * [Gemma](https://huggingface.co/docs/transformers/model_doc/gemma#transformers.GemmaModel)
* [Gemma2](https://huggingface.co/docs/transformers/model_doc/gemma2#transformers.Gemma2Model)
* [GPT2](https://huggingface.co/docs/transformers/model_doc/gpt2) * [GPT2](https://huggingface.co/docs/transformers/model_doc/gpt2)
* [GPTBigCode](https://huggingface.co/docs/transformers/model_doc/gpt_bigcode#transformers.GPTBigCodeModel) * [GPTBigCode](https://huggingface.co/docs/transformers/model_doc/gpt_bigcode#transformers.GPTBigCodeModel)
* [GPTNeoX](https://huggingface.co/docs/transformers/model_doc/gpt_neox#transformers.GPTNeoXModel) * [GPTNeoX](https://huggingface.co/docs/transformers/model_doc/gpt_neox#transformers.GPTNeoXModel)
......
...@@ -41,11 +41,12 @@ if is_torch_available(): ...@@ -41,11 +41,12 @@ if is_torch_available():
class Gemma2ModelTester(GemmaModelTester): class Gemma2ModelTester(GemmaModelTester):
config_class = Gemma2Config if is_torch_available():
model_class = Gemma2Model config_class = Gemma2Config
for_causal_lm_class = Gemma2ForCausalLM model_class = Gemma2Model
for_sequence_class = Gemma2ForSequenceClassification for_causal_lm_class = Gemma2ForCausalLM
for_token_class = Gemma2ForTokenClassification for_sequence_class = Gemma2ForSequenceClassification
for_token_class = Gemma2ForTokenClassification
@require_torch @require_torch
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment