============================= test session starts ==============================
platform linux -- Python 3.6.10, pytest-5.4.3, py-1.9.0, pluggy-0.13.1 -- /home/aryaman4/anaconda3/envs/transformers/bin/python
cachedir: .pytest_cache
rootdir: /home/aryaman4/transformers
plugins: forked-1.2.0, xdist-1.32.0
gw0 I / gw1 I / gw2 I / gw3 I / gw4 I / gw5 I / gw6 I / gw7 I / gw8 I / gw9 I / gw10 I / gw11 I / gw12 I / gw13 I / gw14 I / gw15 I / gw16 I / gw17 I / gw18 I / gw19 I / gw20 I / gw21 I / gw22 I / gw23 I

[gw0] linux Python 3.6.10 cwd: /home/aryaman4/transformers

[gw1] linux Python 3.6.10 cwd: /home/aryaman4/transformers

[gw2] linux Python 3.6.10 cwd: /home/aryaman4/transformers

[gw3] linux Python 3.6.10 cwd: /home/aryaman4/transformers

[gw4] linux Python 3.6.10 cwd: /home/aryaman4/transformers

[gw5] linux Python 3.6.10 cwd: /home/aryaman4/transformers

[gw6] linux Python 3.6.10 cwd: /home/aryaman4/transformers

[gw7] linux Python 3.6.10 cwd: /home/aryaman4/transformers

[gw8] linux Python 3.6.10 cwd: /home/aryaman4/transformers

[gw9] linux Python 3.6.10 cwd: /home/aryaman4/transformers

[gw10] linux Python 3.6.10 cwd: /home/aryaman4/transformers

[gw11] linux Python 3.6.10 cwd: /home/aryaman4/transformers

[gw12] linux Python 3.6.10 cwd: /home/aryaman4/transformers

[gw13] linux Python 3.6.10 cwd: /home/aryaman4/transformers

[gw14] linux Python 3.6.10 cwd: /home/aryaman4/transformers

[gw15] linux Python 3.6.10 cwd: /home/aryaman4/transformers

[gw16] linux Python 3.6.10 cwd: /home/aryaman4/transformers

[gw17] linux Python 3.6.10 cwd: /home/aryaman4/transformers

[gw18] linux Python 3.6.10 cwd: /home/aryaman4/transformers

[gw19] linux Python 3.6.10 cwd: /home/aryaman4/transformers

[gw20] linux Python 3.6.10 cwd: /home/aryaman4/transformers

[gw21] linux Python 3.6.10 cwd: /home/aryaman4/transformers

[gw22] linux Python 3.6.10 cwd: /home/aryaman4/transformers

[gw23] linux Python 3.6.10 cwd: /home/aryaman4/transformers

[gw0] Python 3.6.10 |Anaconda, Inc.| (default, May  8 2020, 02:54:21)  -- [GCC 7.3.0]

[gw1] Python 3.6.10 |Anaconda, Inc.| (default, May  8 2020, 02:54:21)  -- [GCC 7.3.0]

[gw2] Python 3.6.10 |Anaconda, Inc.| (default, May  8 2020, 02:54:21)  -- [GCC 7.3.0]

[gw3] Python 3.6.10 |Anaconda, Inc.| (default, May  8 2020, 02:54:21)  -- [GCC 7.3.0]

[gw4] Python 3.6.10 |Anaconda, Inc.| (default, May  8 2020, 02:54:21)  -- [GCC 7.3.0]

[gw5] Python 3.6.10 |Anaconda, Inc.| (default, May  8 2020, 02:54:21)  -- [GCC 7.3.0]

[gw6] Python 3.6.10 |Anaconda, Inc.| (default, May  8 2020, 02:54:21)  -- [GCC 7.3.0]

[gw7] Python 3.6.10 |Anaconda, Inc.| (default, May  8 2020, 02:54:21)  -- [GCC 7.3.0]

[gw8] Python 3.6.10 |Anaconda, Inc.| (default, May  8 2020, 02:54:21)  -- [GCC 7.3.0]

[gw9] Python 3.6.10 |Anaconda, Inc.| (default, May  8 2020, 02:54:21)  -- [GCC 7.3.0]

[gw10] Python 3.6.10 |Anaconda, Inc.| (default, May  8 2020, 02:54:21)  -- [GCC 7.3.0]

[gw11] Python 3.6.10 |Anaconda, Inc.| (default, May  8 2020, 02:54:21)  -- [GCC 7.3.0]

[gw13] Python 3.6.10 |Anaconda, Inc.| (default, May  8 2020, 02:54:21)  -- [GCC 7.3.0]

[gw12] Python 3.6.10 |Anaconda, Inc.| (default, May  8 2020, 02:54:21)  -- [GCC 7.3.0]

[gw14] Python 3.6.10 |Anaconda, Inc.| (default, May  8 2020, 02:54:21)  -- [GCC 7.3.0]

[gw15] Python 3.6.10 |Anaconda, Inc.| (default, May  8 2020, 02:54:21)  -- [GCC 7.3.0]

[gw16] Python 3.6.10 |Anaconda, Inc.| (default, May  8 2020, 02:54:21)  -- [GCC 7.3.0]

[gw18] Python 3.6.10 |Anaconda, Inc.| (default, May  8 2020, 02:54:21)  -- [GCC 7.3.0]

[gw17] Python 3.6.10 |Anaconda, Inc.| (default, May  8 2020, 02:54:21)  -- [GCC 7.3.0]

[gw19] Python 3.6.10 |Anaconda, Inc.| (default, May  8 2020, 02:54:21)  -- [GCC 7.3.0]

[gw20] Python 3.6.10 |Anaconda, Inc.| (default, May  8 2020, 02:54:21)  -- [GCC 7.3.0]

[gw21] Python 3.6.10 |Anaconda, Inc.| (default, May  8 2020, 02:54:21)  -- [GCC 7.3.0]

[gw22] Python 3.6.10 |Anaconda, Inc.| (default, May  8 2020, 02:54:21)  -- [GCC 7.3.0]

[gw23] Python 3.6.10 |Anaconda, Inc.| (default, May  8 2020, 02:54:21)  -- [GCC 7.3.0]
gw0 [1619] / gw1 [1619] / gw2 [1619] / gw3 [1619] / gw4 [1619] / gw5 [1619] / gw6 [1619] / gw7 [1619] / gw8 [1619] / gw9 [1619] / gw10 [1619] / gw11 [1619] / gw12 [1619] / gw13 [1619] / gw14 [1619] / gw15 [1619] / gw16 [1619] / gw17 [1619] / gw18 [1619] / gw19 [1619] / gw20 [1619] / gw21 [1619] / gw22 [1619] / gw23 [1619]

scheduling tests via LoadFileScheduling

tests/test_benchmark.py::BenchmarkTest::test_inference_encoder_decoder_with_configs 
tests/test_hf_argparser.py::HfArgumentParserTest::test_basic 
tests/test_doc_samples.py::TestCodeExamples::test_configuration_examples 
tests/test_configuration_auto.py::AutoConfigTest::test_config_for_model_str 
tests/test_activations.py::TestActivations::test_gelu_versions 
tests/test_modeling_bert.py::BertModelTest::test_attention_outputs 
tests/test_model_card.py::ModelCardTester::test_model_card_common_properties 
tests/test_modeling_albert.py::AlbertModelTest::test_albert_model 
tests/test_modeling_auto.py::AutoModelTest::test_from_identifier_from_model_type 
tests/test_hf_api.py::HfApiLoginTest::test_login_invalid 
tests/test_benchmark_tf.py::TFBenchmarkTest::test_inference_encoder_decoder_with_configs 
tests/test_modeling_ctrl.py::CTRLModelTest::test_attention_outputs 
[gw0] PASSED tests/test_activations.py::TestActivations::test_gelu_versions 
tests/test_modeling_common.py::ModelUtilsTest::test_model_from_pretrained 
[gw12] SKIPPED tests/test_modeling_common.py::ModelUtilsTest::test_model_from_pretrained 
[gw4] SKIPPED tests/test_doc_samples.py::TestCodeExamples::test_configuration_examples 
tests/test_doc_samples.py::TestCodeExamples::test_doc_sources 
[gw4] SKIPPED tests/test_doc_samples.py::TestCodeExamples::test_doc_sources 
tests/test_doc_samples.py::TestCodeExamples::test_modeling_examples 
tests/test_modeling_distilbert.py::DistilBertModelTest::test_attention_outputs 
tests/test_modeling_electra.py::ElectraModelTest::test_attention_outputs 
tests/test_modeling_gpt2.py::GPT2ModelTest::test_attention_outputs 
[gw7] PASSED tests/test_model_card.py::ModelCardTester::test_model_card_common_properties 
tests/test_model_card.py::ModelCardTester::test_model_card_from_and_save_pretrained 
[gw7] PASSED tests/test_model_card.py::ModelCardTester::test_model_card_from_and_save_pretrained 
tests/test_model_card.py::ModelCardTester::test_model_card_to_json_file 
[gw7] PASSED tests/test_model_card.py::ModelCardTester::test_model_card_to_json_file 
[gw3] PASSED tests/test_configuration_auto.py::AutoConfigTest::test_config_for_model_str 
tests/test_configuration_auto.py::AutoConfigTest::test_config_from_model_shortcut 
[gw4] SKIPPED tests/test_doc_samples.py::TestCodeExamples::test_modeling_examples 
tests/test_doc_samples.py::TestCodeExamples::test_remaining_examples 
[gw4] SKIPPED tests/test_doc_samples.py::TestCodeExamples::test_remaining_examples 
[gw6] PASSED tests/test_hf_argparser.py::HfArgumentParserTest::test_basic 
tests/test_hf_argparser.py::HfArgumentParserTest::test_integration_training_args 
[gw6] PASSED tests/test_hf_argparser.py::HfArgumentParserTest::test_integration_training_args 
tests/test_hf_argparser.py::HfArgumentParserTest::test_with_default 
[gw6] PASSED tests/test_hf_argparser.py::HfArgumentParserTest::test_with_default 
tests/test_hf_argparser.py::HfArgumentParserTest::test_with_default_bool 
[gw6] PASSED tests/test_hf_argparser.py::HfArgumentParserTest::test_with_default_bool 
tests/test_modeling_openai.py::OpenAIGPTModelTest::test_attention_outputs 
tests/test_hf_argparser.py::HfArgumentParserTest::test_with_enum 
[gw6] PASSED tests/test_hf_argparser.py::HfArgumentParserTest::test_with_enum 
tests/test_hf_argparser.py::HfArgumentParserTest::test_with_list 
[gw6] PASSED tests/test_hf_argparser.py::HfArgumentParserTest::test_with_list 
tests/test_modeling_longformer.py::LongformerModelTest::test_attention_outputs 
tests/test_modeling_flaubert.py::FlaubertModelTest::test_attention_outputs 
tests/test_modeling_camembert.py::CamembertModelIntegrationTest::test_output_embeds_base_model 
[gw13] SKIPPED tests/test_modeling_camembert.py::CamembertModelIntegrationTest::test_output_embeds_base_model 
tests/test_modeling_roberta.py::RobertaModelTest::test_attention_outputs 
tests/test_modeling_common.py::UtilsFunctionsTest::test_top_k_top_p_filtering 
tests/test_modeling_marian.py::ModelManagementTests::test_model_names 
[gw21] SKIPPED tests/test_modeling_marian.py::ModelManagementTests::test_model_names 
tests/test_modeling_marian.py::TestMarian_EN_DE_More::test_auto_config 
tests/test_modeling_mobilebert.py::MobileBertModelTest::test_attention_outputs 
tests/test_modeling_encoder_decoder.py::EncoderDecoderModelTest::test_bert_encoder_decoder_model 
tests/test_activations.py::TestActivations::test_get_activation 
[gw0] PASSED tests/test_activations.py::TestActivations::test_get_activation 
tests/test_modeling_reformer.py::ReformerLocalAttnModelTest::test_attention_outputs 
tests/test_modeling_bart.py::BARTModelTest::test_advanced_inputs 
tests/test_model_card.py::ModelCardTester::test_model_card_to_json_string 
[gw7] PASSED tests/test_model_card.py::ModelCardTester::test_model_card_to_json_string 
tests/test_modeling_tf_albert.py::TFAlbertModelTest::test_albert_model 
[gw12] PASSED tests/test_modeling_common.py::UtilsFunctionsTest::test_top_k_top_p_filtering 
tests/test_modeling_t5.py::T5ModelTest::test_attention_outputs 
tests/test_doc_samples.py::TestCodeExamples::test_tokenization_examples 
[gw4] SKIPPED tests/test_doc_samples.py::TestCodeExamples::test_tokenization_examples 
tests/test_modeling_tf_auto.py::TFAutoModelTest::test_from_identifier_from_model_type 
tests/test_hf_argparser.py::HfArgumentParserTest::test_with_optional 
[gw6] PASSED tests/test_hf_argparser.py::HfArgumentParserTest::test_with_optional 
tests/test_modeling_tf_bert.py::TFBertModelTest::test_attention_outputs 
[gw3] PASSED tests/test_configuration_auto.py::AutoConfigTest::test_config_from_model_shortcut 
tests/test_configuration_auto.py::AutoConfigTest::test_config_model_type_from_local_file 
[gw5] PASSED tests/test_hf_api.py::HfApiLoginTest::test_login_invalid 
tests/test_hf_api.py::HfApiLoginTest::test_login_valid 
[gw3] PASSED tests/test_configuration_auto.py::AutoConfigTest::test_config_model_type_from_local_file 
tests/test_configuration_auto.py::AutoConfigTest::test_config_model_type_from_model_identifier 
[gw9] PASSED tests/test_modeling_auto.py::AutoModelTest::test_from_identifier_from_model_type 
tests/test_modeling_auto.py::AutoModelTest::test_from_pretrained_identifier 
[gw3] PASSED tests/test_configuration_auto.py::AutoConfigTest::test_config_model_type_from_model_identifier 
tests/test_configuration_auto.py::AutoConfigTest::test_pattern_matching_fallback 
[gw3] PASSED tests/test_configuration_auto.py::AutoConfigTest::test_pattern_matching_fallback 
tests/test_modeling_tf_camembert.py::TFCamembertModelIntegrationTest::test_output_embeds_base_model 
[gw3] SKIPPED tests/test_modeling_tf_camembert.py::TFCamembertModelIntegrationTest::test_output_embeds_base_model 
tests/test_modeling_tf_common.py::UtilsFunctionsTest::test_top_k_top_p_filtering 
[gw5] PASSED tests/test_hf_api.py::HfApiLoginTest::test_login_valid 
tests/test_hf_api.py::HfApiEndpointsTest::test_list_objs 
[gw3] PASSED tests/test_modeling_tf_common.py::UtilsFunctionsTest::test_top_k_top_p_filtering 
tests/test_modeling_tf_ctrl.py::TFCTRLModelTest::test_attention_outputs 
[gw7] PASSED tests/test_modeling_tf_albert.py::TFAlbertModelTest::test_albert_model 
tests/test_modeling_tf_albert.py::TFAlbertModelTest::test_attention_outputs 
[gw9] PASSED tests/test_modeling_auto.py::AutoModelTest::test_from_pretrained_identifier 
tests/test_modeling_auto.py::AutoModelTest::test_lmhead_model_from_pretrained 
[gw9] SKIPPED tests/test_modeling_auto.py::AutoModelTest::test_lmhead_model_from_pretrained 
tests/test_modeling_auto.py::AutoModelTest::test_model_for_causal_lm 
[gw9] SKIPPED tests/test_modeling_auto.py::AutoModelTest::test_model_for_causal_lm 
tests/test_modeling_auto.py::AutoModelTest::test_model_for_encoder_decoder_lm 
[gw9] SKIPPED tests/test_modeling_auto.py::AutoModelTest::test_model_for_encoder_decoder_lm 
tests/test_modeling_auto.py::AutoModelTest::test_model_for_masked_lm 
[gw9] SKIPPED tests/test_modeling_auto.py::AutoModelTest::test_model_for_masked_lm 
tests/test_modeling_auto.py::AutoModelTest::test_model_for_pretraining_from_pretrained 
[gw9] SKIPPED tests/test_modeling_auto.py::AutoModelTest::test_model_for_pretraining_from_pretrained 
tests/test_modeling_auto.py::AutoModelTest::test_model_from_pretrained 
[gw9] SKIPPED tests/test_modeling_auto.py::AutoModelTest::test_model_from_pretrained 
tests/test_modeling_auto.py::AutoModelTest::test_parents_and_children_in_mappings 
[gw9] PASSED tests/test_modeling_auto.py::AutoModelTest::test_parents_and_children_in_mappings 
tests/test_modeling_auto.py::AutoModelTest::test_question_answering_model_from_pretrained 
[gw9] SKIPPED tests/test_modeling_auto.py::AutoModelTest::test_question_answering_model_from_pretrained 
tests/test_modeling_auto.py::AutoModelTest::test_sequence_classification_model_from_pretrained 
[gw9] SKIPPED tests/test_modeling_auto.py::AutoModelTest::test_sequence_classification_model_from_pretrained 
tests/test_modeling_auto.py::AutoModelTest::test_token_classification_model_from_pretrained 
[gw9] SKIPPED tests/test_modeling_auto.py::AutoModelTest::test_token_classification_model_from_pretrained 
tests/test_modeling_tf_distilbert.py::TFDistilBertModelTest::test_attention_outputs 
[gw5] PASSED tests/test_hf_api.py::HfApiEndpointsTest::test_list_objs 
tests/test_hf_api.py::HfApiEndpointsTest::test_presign 
[gw4] PASSED tests/test_modeling_tf_auto.py::TFAutoModelTest::test_from_identifier_from_model_type 
tests/test_modeling_tf_auto.py::TFAutoModelTest::test_from_pretrained_identifier 
[gw5] PASSED tests/test_hf_api.py::HfApiEndpointsTest::test_presign 
tests/test_hf_api.py::HfApiEndpointsTest::test_presign_and_upload 
[gw4] PASSED tests/test_modeling_tf_auto.py::TFAutoModelTest::test_from_pretrained_identifier 
tests/test_modeling_tf_auto.py::TFAutoModelTest::test_lmhead_model_from_pretrained 
[gw4] SKIPPED tests/test_modeling_tf_auto.py::TFAutoModelTest::test_lmhead_model_from_pretrained 
tests/test_modeling_tf_auto.py::TFAutoModelTest::test_model_for_pretraining_from_pretrained 
[gw4] SKIPPED tests/test_modeling_tf_auto.py::TFAutoModelTest::test_model_for_pretraining_from_pretrained 
tests/test_modeling_tf_auto.py::TFAutoModelTest::test_model_from_pretrained 
[gw4] SKIPPED tests/test_modeling_tf_auto.py::TFAutoModelTest::test_model_from_pretrained 
tests/test_modeling_tf_auto.py::TFAutoModelTest::test_question_answering_model_from_pretrained 
[gw4] SKIPPED tests/test_modeling_tf_auto.py::TFAutoModelTest::test_question_answering_model_from_pretrained 
tests/test_modeling_tf_auto.py::TFAutoModelTest::test_sequence_classification_model_from_pretrained 
[gw4] SKIPPED tests/test_modeling_tf_auto.py::TFAutoModelTest::test_sequence_classification_model_from_pretrained 
tests/test_modeling_tf_electra.py::TFElectraModelTest::test_attention_outputs 
[gw21] PASSED tests/test_modeling_marian.py::TestMarian_EN_DE_More::test_auto_config 
tests/test_modeling_marian.py::TestMarian_EN_DE_More::test_batch_generation_en_de 
[gw21] SKIPPED tests/test_modeling_marian.py::TestMarian_EN_DE_More::test_batch_generation_en_de 
tests/test_modeling_marian.py::TestMarian_EN_DE_More::test_forward 
[gw21] SKIPPED tests/test_modeling_marian.py::TestMarian_EN_DE_More::test_forward 
tests/test_modeling_marian.py::TestMarian_EN_DE_More::test_pad_not_split 
[gw5] PASSED tests/test_hf_api.py::HfApiEndpointsTest::test_presign_and_upload 
[gw21] PASSED tests/test_modeling_marian.py::TestMarian_EN_DE_More::test_pad_not_split 
tests/test_hf_api.py::HfApiEndpointsTest::test_presign_invalid 
tests/test_modeling_marian.py::TestMarian_EN_DE_More::test_unk_support 
[gw21] PASSED tests/test_modeling_marian.py::TestMarian_EN_DE_More::test_unk_support 
tests/test_modeling_marian.py::TestMarian_EN_FR::test_batch_generation_en_fr 
[gw8] PASSED tests/test_modeling_albert.py::AlbertModelTest::test_albert_model 
tests/test_modeling_albert.py::AlbertModelTest::test_attention_outputs 
[gw5] PASSED tests/test_hf_api.py::HfApiEndpointsTest::test_presign_invalid 
tests/test_hf_api.py::HfApiEndpointsTest::test_presign_invalid_org 
[gw5] PASSED tests/test_hf_api.py::HfApiEndpointsTest::test_presign_invalid_org 
tests/test_hf_api.py::HfApiEndpointsTest::test_presign_valid_org 
[gw5] PASSED tests/test_hf_api.py::HfApiEndpointsTest::test_presign_valid_org 
tests/test_hf_api.py::HfApiEndpointsTest::test_whoami 
[gw10] PASSED tests/test_modeling_bart.py::BARTModelTest::test_advanced_inputs 
tests/test_modeling_bart.py::BARTModelTest::test_attention_outputs 
[gw5] PASSED tests/test_hf_api.py::HfApiEndpointsTest::test_whoami 
tests/test_hf_api.py::HfApiPublicTest::test_model_list 
[gw18] PASSED tests/test_modeling_encoder_decoder.py::EncoderDecoderModelTest::test_bert_encoder_decoder_model 
tests/test_modeling_encoder_decoder.py::EncoderDecoderModelTest::test_bert_encoder_decoder_model_from_pretrained 
[gw5] PASSED tests/test_hf_api.py::HfApiPublicTest::test_model_list 
tests/test_hf_api.py::HfApiPublicTest::test_staging_model_list 
[gw21] SKIPPED tests/test_modeling_marian.py::TestMarian_EN_FR::test_batch_generation_en_fr 
tests/test_modeling_marian.py::TestMarian_FR_EN::test_batch_generation_fr_en 
[gw5] PASSED tests/test_hf_api.py::HfApiPublicTest::test_staging_model_list 
tests/test_hf_api.py::HfFolderTest::test_token_workflow 
[gw5] PASSED tests/test_hf_api.py::HfFolderTest::test_token_workflow 
tests/test_modeling_tf_flaubert.py::TFFlaubertModelIntegrationTest::test_output_embeds_base_model 
[gw5] SKIPPED tests/test_modeling_tf_flaubert.py::TFFlaubertModelIntegrationTest::test_output_embeds_base_model 
tests/test_modeling_tf_gpt2.py::TFGPT2ModelTest::test_attention_outputs 
[gw3] PASSED tests/test_modeling_tf_ctrl.py::TFCTRLModelTest::test_attention_outputs 
tests/test_modeling_tf_ctrl.py::TFCTRLModelTest::test_compile_tf_model 
[gw21] SKIPPED tests/test_modeling_marian.py::TestMarian_FR_EN::test_batch_generation_fr_en 
tests/test_modeling_marian.py::TestMarian_RU_FR::test_batch_generation_ru_fr 
[gw18] PASSED tests/test_modeling_encoder_decoder.py::EncoderDecoderModelTest::test_bert_encoder_decoder_model_from_pretrained 
tests/test_modeling_encoder_decoder.py::EncoderDecoderModelTest::test_bert_encoder_decoder_model_from_pretrained_configs 
[gw21] SKIPPED tests/test_modeling_marian.py::TestMarian_RU_FR::test_batch_generation_ru_fr 
tests/test_modeling_marian.py::TestMarian_MT_EN::test_batch_generation_mt_en 
[gw12] PASSED tests/test_modeling_t5.py::T5ModelTest::test_attention_outputs 
tests/test_modeling_t5.py::T5ModelTest::test_config 
[gw12] PASSED tests/test_modeling_t5.py::T5ModelTest::test_config 
tests/test_modeling_t5.py::T5ModelTest::test_correct_missing_keys 
[gw12] PASSED tests/test_modeling_t5.py::T5ModelTest::test_correct_missing_keys 
tests/test_modeling_t5.py::T5ModelTest::test_determinism 
[gw7] PASSED tests/test_modeling_tf_albert.py::TFAlbertModelTest::test_attention_outputs 
tests/test_modeling_tf_albert.py::TFAlbertModelTest::test_compile_tf_model 
[gw18] PASSED tests/test_modeling_encoder_decoder.py::EncoderDecoderModelTest::test_bert_encoder_decoder_model_from_pretrained_configs 
tests/test_modeling_encoder_decoder.py::EncoderDecoderModelTest::test_bert_encoder_decoder_model_generate 
[gw5] PASSED tests/test_modeling_tf_gpt2.py::TFGPT2ModelTest::test_attention_outputs 
tests/test_modeling_tf_gpt2.py::TFGPT2ModelTest::test_compile_tf_model 
[gw14] PASSED tests/test_modeling_ctrl.py::CTRLModelTest::test_attention_outputs 
tests/test_modeling_ctrl.py::CTRLModelTest::test_config 
[gw14] PASSED tests/test_modeling_ctrl.py::CTRLModelTest::test_config 
tests/test_modeling_ctrl.py::CTRLModelTest::test_correct_missing_keys 
[gw21] SKIPPED tests/test_modeling_marian.py::TestMarian_MT_EN::test_batch_generation_mt_en 
tests/test_modeling_marian.py::TestMarian_en_ROMANCE::test_batch_generation_en_ROMANCE_multi 
[gw1] PASSED tests/test_benchmark.py::BenchmarkTest::test_inference_encoder_decoder_with_configs 
tests/test_benchmark.py::BenchmarkTest::test_inference_fp16 
[gw1] SKIPPED tests/test_benchmark.py::BenchmarkTest::test_inference_fp16 
tests/test_benchmark.py::BenchmarkTest::test_inference_no_configs 
[gw14] PASSED tests/test_modeling_ctrl.py::CTRLModelTest::test_correct_missing_keys 
tests/test_modeling_ctrl.py::CTRLModelTest::test_ctrl_lm_head_model 
[gw10] PASSED tests/test_modeling_bart.py::BARTModelTest::test_attention_outputs 
tests/test_modeling_bart.py::BARTModelTest::test_config 
[gw10] PASSED tests/test_modeling_bart.py::BARTModelTest::test_config 
tests/test_modeling_bart.py::BARTModelTest::test_correct_missing_keys 
[gw10] PASSED tests/test_modeling_bart.py::BARTModelTest::test_correct_missing_keys 
tests/test_modeling_bart.py::BARTModelTest::test_determinism 
[gw21] SKIPPED tests/test_modeling_marian.py::TestMarian_en_ROMANCE::test_batch_generation_en_ROMANCE_multi 
tests/test_modeling_marian.py::TestMarian_en_ROMANCE::test_pipeline 
[gw9] PASSED tests/test_modeling_tf_distilbert.py::TFDistilBertModelTest::test_attention_outputs 
tests/test_modeling_tf_distilbert.py::TFDistilBertModelTest::test_compile_tf_model 
[gw23] PASSED tests/test_modeling_openai.py::OpenAIGPTModelTest::test_attention_outputs 
tests/test_modeling_openai.py::OpenAIGPTModelTest::test_config 
[gw23] PASSED tests/test_modeling_openai.py::OpenAIGPTModelTest::test_config 
tests/test_modeling_openai.py::OpenAIGPTModelTest::test_correct_missing_keys 
[gw12] PASSED tests/test_modeling_t5.py::T5ModelTest::test_determinism 
tests/test_modeling_t5.py::T5ModelTest::test_head_pruning 
[gw14] PASSED tests/test_modeling_ctrl.py::CTRLModelTest::test_ctrl_lm_head_model 
[gw12] PASSED tests/test_modeling_t5.py::T5ModelTest::test_head_pruning 
tests/test_modeling_ctrl.py::CTRLModelTest::test_ctrl_model 
tests/test_modeling_t5.py::T5ModelTest::test_head_pruning_integration 
[gw12] PASSED tests/test_modeling_t5.py::T5ModelTest::test_head_pruning_integration 
tests/test_modeling_t5.py::T5ModelTest::test_head_pruning_save_load_from_config_init 
[gw12] PASSED tests/test_modeling_t5.py::T5ModelTest::test_head_pruning_save_load_from_config_init 
tests/test_modeling_t5.py::T5ModelTest::test_head_pruning_save_load_from_pretrained 
[gw12] PASSED tests/test_modeling_t5.py::T5ModelTest::test_head_pruning_save_load_from_pretrained 
tests/test_modeling_t5.py::T5ModelTest::test_headmasking 
[gw16] PASSED tests/test_modeling_electra.py::ElectraModelTest::test_attention_outputs 
tests/test_modeling_electra.py::ElectraModelTest::test_config 
[gw16] PASSED tests/test_modeling_electra.py::ElectraModelTest::test_config 
tests/test_modeling_electra.py::ElectraModelTest::test_correct_missing_keys 
[gw23] PASSED tests/test_modeling_openai.py::OpenAIGPTModelTest::test_correct_missing_keys 
[gw19] PASSED tests/test_modeling_gpt2.py::GPT2ModelTest::test_attention_outputs 
tests/test_modeling_gpt2.py::GPT2ModelTest::test_config 
tests/test_modeling_openai.py::OpenAIGPTModelTest::test_determinism 
[gw19] PASSED tests/test_modeling_gpt2.py::GPT2ModelTest::test_config 
tests/test_modeling_gpt2.py::GPT2ModelTest::test_correct_missing_keys 
[gw16] PASSED tests/test_modeling_electra.py::ElectraModelTest::test_correct_missing_keys 
tests/test_modeling_electra.py::ElectraModelTest::test_determinism 
[gw15] PASSED tests/test_modeling_distilbert.py::DistilBertModelTest::test_attention_outputs 
tests/test_modeling_distilbert.py::DistilBertModelTest::test_config 
[gw15] PASSED tests/test_modeling_distilbert.py::DistilBertModelTest::test_config 
tests/test_modeling_distilbert.py::DistilBertModelTest::test_correct_missing_keys 
[gw15] PASSED tests/test_modeling_distilbert.py::DistilBertModelTest::test_correct_missing_keys 
tests/test_modeling_distilbert.py::DistilBertModelTest::test_determinism 
[gw17] PASSED tests/test_modeling_flaubert.py::FlaubertModelTest::test_attention_outputs 
tests/test_modeling_flaubert.py::FlaubertModelTest::test_config 
[gw17] PASSED tests/test_modeling_flaubert.py::FlaubertModelTest::test_config 
tests/test_modeling_flaubert.py::FlaubertModelTest::test_correct_missing_keys 
[gw4] PASSED tests/test_modeling_tf_electra.py::TFElectraModelTest::test_attention_outputs 
tests/test_modeling_tf_electra.py::TFElectraModelTest::test_compile_tf_model 
[gw17] PASSED tests/test_modeling_flaubert.py::FlaubertModelTest::test_correct_missing_keys 
tests/test_modeling_flaubert.py::FlaubertModelTest::test_determinism 
[gw13] PASSED tests/test_modeling_roberta.py::RobertaModelTest::test_attention_outputs 
tests/test_modeling_roberta.py::RobertaModelTest::test_config 
[gw13] PASSED tests/test_modeling_roberta.py::RobertaModelTest::test_config 
tests/test_modeling_roberta.py::RobertaModelTest::test_correct_missing_keys 
[gw19] PASSED tests/test_modeling_gpt2.py::GPT2ModelTest::test_correct_missing_keys 
tests/test_modeling_gpt2.py::GPT2ModelTest::test_determinism 
[gw13] PASSED tests/test_modeling_roberta.py::RobertaModelTest::test_correct_missing_keys 
tests/test_modeling_roberta.py::RobertaModelTest::test_create_position_ids_from_inputs_embeds 
[gw13] PASSED tests/test_modeling_roberta.py::RobertaModelTest::test_create_position_ids_from_inputs_embeds 
tests/test_modeling_roberta.py::RobertaModelTest::test_create_position_ids_respects_padding_index 
[gw13] PASSED tests/test_modeling_roberta.py::RobertaModelTest::test_create_position_ids_respects_padding_index 
tests/test_modeling_roberta.py::RobertaModelTest::test_determinism 
[gw14] PASSED tests/test_modeling_ctrl.py::CTRLModelTest::test_ctrl_model 
tests/test_modeling_ctrl.py::CTRLModelTest::test_determinism 
[gw10] PASSED tests/test_modeling_bart.py::BARTModelTest::test_determinism 
tests/test_modeling_bart.py::BARTModelTest::test_head_pruning 
[gw10] PASSED tests/test_modeling_bart.py::BARTModelTest::test_head_pruning 
tests/test_modeling_bart.py::BARTModelTest::test_head_pruning_integration 
[gw10] PASSED tests/test_modeling_bart.py::BARTModelTest::test_head_pruning_integration 
tests/test_modeling_bart.py::BARTModelTest::test_head_pruning_save_load_from_config_init 
[gw10] PASSED tests/test_modeling_bart.py::BARTModelTest::test_head_pruning_save_load_from_config_init 
tests/test_modeling_bart.py::BARTModelTest::test_head_pruning_save_load_from_pretrained 
[gw10] PASSED tests/test_modeling_bart.py::BARTModelTest::test_head_pruning_save_load_from_pretrained 
tests/test_modeling_bart.py::BARTModelTest::test_headmasking 
[gw10] PASSED tests/test_modeling_bart.py::BARTModelTest::test_headmasking 
tests/test_modeling_bart.py::BARTModelTest::test_hidden_states_output 
[gw1] PASSED tests/test_benchmark.py::BenchmarkTest::test_inference_no_configs 
tests/test_benchmark.py::BenchmarkTest::test_inference_no_configs_only_pretrain 
[gw11] PASSED tests/test_modeling_bert.py::BertModelTest::test_attention_outputs 
tests/test_modeling_bert.py::BertModelTest::test_bert_model 
[gw6] PASSED tests/test_modeling_tf_bert.py::TFBertModelTest::test_attention_outputs 
tests/test_modeling_tf_bert.py::TFBertModelTest::test_bert_model 
[gw12] PASSED tests/test_modeling_t5.py::T5ModelTest::test_headmasking 
tests/test_modeling_t5.py::T5ModelTest::test_hidden_states_output 
[gw6] PASSED tests/test_modeling_tf_bert.py::TFBertModelTest::test_bert_model 
tests/test_modeling_tf_bert.py::TFBertModelTest::test_compile_tf_model 
[gw0] PASSED tests/test_modeling_reformer.py::ReformerLocalAttnModelTest::test_attention_outputs 
tests/test_modeling_reformer.py::ReformerLocalAttnModelTest::test_config 
[gw0] PASSED tests/test_modeling_reformer.py::ReformerLocalAttnModelTest::test_config 
tests/test_modeling_reformer.py::ReformerLocalAttnModelTest::test_correct_missing_keys 
[gw0] PASSED tests/test_modeling_reformer.py::ReformerLocalAttnModelTest::test_correct_missing_keys 
tests/test_modeling_reformer.py::ReformerLocalAttnModelTest::test_determinism 
[gw23] PASSED tests/test_modeling_openai.py::OpenAIGPTModelTest::test_determinism 
tests/test_modeling_openai.py::OpenAIGPTModelTest::test_head_pruning 
[gw11] PASSED tests/test_modeling_bert.py::BertModelTest::test_bert_model 
tests/test_modeling_bert.py::BertModelTest::test_bert_model_as_decoder 
[gw11] PASSED tests/test_modeling_bert.py::BertModelTest::test_bert_model_as_decoder 
tests/test_modeling_bert.py::BertModelTest::test_bert_model_as_decoder_with_default_input_mask 
[gw16] PASSED tests/test_modeling_electra.py::ElectraModelTest::test_determinism 
tests/test_modeling_electra.py::ElectraModelTest::test_electra_model 
[gw20] PASSED tests/test_modeling_longformer.py::LongformerModelTest::test_attention_outputs 
tests/test_modeling_longformer.py::LongformerModelTest::test_config 
[gw20] PASSED tests/test_modeling_longformer.py::LongformerModelTest::test_config 
tests/test_modeling_longformer.py::LongformerModelTest::test_correct_missing_keys 
[gw15] PASSED tests/test_modeling_distilbert.py::DistilBertModelTest::test_determinism 
tests/test_modeling_distilbert.py::DistilBertModelTest::test_distilbert_model 
[gw8] PASSED tests/test_modeling_albert.py::AlbertModelTest::test_attention_outputs 
tests/test_modeling_albert.py::AlbertModelTest::test_config 
[gw8] PASSED tests/test_modeling_albert.py::AlbertModelTest::test_config 
tests/test_modeling_albert.py::AlbertModelTest::test_correct_missing_keys 
[gw20] PASSED tests/test_modeling_longformer.py::LongformerModelTest::test_correct_missing_keys 
tests/test_modeling_longformer.py::LongformerModelTest::test_determinism 
[gw14] PASSED tests/test_modeling_ctrl.py::CTRLModelTest::test_determinism 
tests/test_modeling_ctrl.py::CTRLModelTest::test_head_pruning 
[gw23] PASSED tests/test_modeling_openai.py::OpenAIGPTModelTest::test_head_pruning 
tests/test_modeling_openai.py::OpenAIGPTModelTest::test_head_pruning_integration 
[gw10] PASSED tests/test_modeling_bart.py::BARTModelTest::test_hidden_states_output 
tests/test_modeling_bart.py::BARTModelTest::test_initialization 
[gw13] PASSED tests/test_modeling_roberta.py::RobertaModelTest::test_determinism 
tests/test_modeling_roberta.py::RobertaModelTest::test_for_masked_lm 
[gw10] PASSED tests/test_modeling_bart.py::BARTModelTest::test_initialization 
tests/test_modeling_bart.py::BARTModelTest::test_initialization_more 
[gw19] PASSED tests/test_modeling_gpt2.py::GPT2ModelTest::test_determinism 
tests/test_modeling_gpt2.py::GPT2ModelTest::test_gpt2_double_lm_head_model 
[gw10] PASSED tests/test_modeling_bart.py::BARTModelTest::test_initialization_more 
tests/test_modeling_bart.py::BARTModelTest::test_inputs_embeds 
[gw10] SKIPPED tests/test_modeling_bart.py::BARTModelTest::test_inputs_embeds 
[gw8] PASSED tests/test_modeling_albert.py::AlbertModelTest::test_correct_missing_keys 
tests/test_modeling_albert.py::AlbertModelTest::test_determinism 
tests/test_modeling_bart.py::BARTModelTest::test_lm_head_model_random_beam_search_generate 
[gw12] PASSED tests/test_modeling_t5.py::T5ModelTest::test_hidden_states_output 
tests/test_modeling_t5.py::T5ModelTest::test_initialization 
[gw12] PASSED tests/test_modeling_t5.py::T5ModelTest::test_initialization 
tests/test_modeling_t5.py::T5ModelTest::test_inputs_embeds 
[gw16] PASSED tests/test_modeling_electra.py::ElectraModelTest::test_electra_model 
tests/test_modeling_electra.py::ElectraModelTest::test_for_masked_lm 
[gw13] PASSED tests/test_modeling_roberta.py::RobertaModelTest::test_for_masked_lm 
tests/test_modeling_roberta.py::RobertaModelTest::test_for_multiple_choice 
[gw3] PASSED tests/test_modeling_tf_ctrl.py::TFCTRLModelTest::test_compile_tf_model 
[gw15] PASSED tests/test_modeling_distilbert.py::DistilBertModelTest::test_distilbert_model 
tests/test_modeling_distilbert.py::DistilBertModelTest::test_for_masked_lm 
[gw17] PASSED tests/test_modeling_flaubert.py::FlaubertModelTest::test_determinism 
tests/test_modeling_flaubert.py::FlaubertModelTest::test_flaubert_lm_head 
tests/test_modeling_tf_ctrl.py::TFCTRLModelTest::test_config 
[gw3] PASSED tests/test_modeling_tf_ctrl.py::TFCTRLModelTest::test_config 
tests/test_modeling_tf_ctrl.py::TFCTRLModelTest::test_ctrl_lm_head 
[gw16] PASSED tests/test_modeling_electra.py::ElectraModelTest::test_for_masked_lm 
tests/test_modeling_electra.py::ElectraModelTest::test_for_multiple_choice 
[gw2] PASSED tests/test_benchmark_tf.py::TFBenchmarkTest::test_inference_encoder_decoder_with_configs 
[gw15] PASSED tests/test_modeling_distilbert.py::DistilBertModelTest::test_for_masked_lm 
tests/test_modeling_distilbert.py::DistilBertModelTest::test_for_multiple_choice 
[gw11] PASSED tests/test_modeling_bert.py::BertModelTest::test_bert_model_as_decoder_with_default_input_mask 
tests/test_modeling_bert.py::BertModelTest::test_config 
[gw11] PASSED tests/test_modeling_bert.py::BertModelTest::test_config 
tests/test_modeling_bert.py::BertModelTest::test_correct_missing_keys 
[gw1] PASSED tests/test_benchmark.py::BenchmarkTest::test_inference_no_configs_only_pretrain 
tests/test_benchmark.py::BenchmarkTest::test_inference_torchscript 
[gw17] PASSED tests/test_modeling_flaubert.py::FlaubertModelTest::test_flaubert_lm_head 
tests/test_modeling_flaubert.py::FlaubertModelTest::test_flaubert_model 
tests/test_benchmark_tf.py::TFBenchmarkTest::test_inference_no_configs_eager 
[gw11] PASSED tests/test_modeling_bert.py::BertModelTest::test_correct_missing_keys 
tests/test_modeling_bert.py::BertModelTest::test_determinism 
[gw13] PASSED tests/test_modeling_roberta.py::RobertaModelTest::test_for_multiple_choice 
tests/test_modeling_roberta.py::RobertaModelTest::test_for_question_answering 
[gw3] PASSED tests/test_modeling_tf_ctrl.py::TFCTRLModelTest::test_ctrl_lm_head 
tests/test_modeling_tf_ctrl.py::TFCTRLModelTest::test_ctrl_model 
[gw16] PASSED tests/test_modeling_electra.py::ElectraModelTest::test_for_multiple_choice 
tests/test_modeling_electra.py::ElectraModelTest::test_for_pre_training 
[gw12] PASSED tests/test_modeling_t5.py::T5ModelTest::test_inputs_embeds 
tests/test_modeling_t5.py::T5ModelTest::test_lm_head_model_random_beam_search_generate 
[gw15] PASSED tests/test_modeling_distilbert.py::DistilBertModelTest::test_for_multiple_choice 
tests/test_modeling_distilbert.py::DistilBertModelTest::test_for_question_answering 
[gw13] PASSED tests/test_modeling_roberta.py::RobertaModelTest::test_for_question_answering 
tests/test_modeling_roberta.py::RobertaModelTest::test_for_token_classification 
[gw19] PASSED tests/test_modeling_gpt2.py::GPT2ModelTest::test_gpt2_double_lm_head_model 
tests/test_modeling_gpt2.py::GPT2ModelTest::test_gpt2_lm_head_model 
[gw16] PASSED tests/test_modeling_electra.py::ElectraModelTest::test_for_pre_training 
tests/test_modeling_electra.py::ElectraModelTest::test_for_question_answering 
[gw14] PASSED tests/test_modeling_ctrl.py::CTRLModelTest::test_head_pruning 
tests/test_modeling_ctrl.py::CTRLModelTest::test_head_pruning_integration 
[gw3] PASSED tests/test_modeling_tf_ctrl.py::TFCTRLModelTest::test_ctrl_model 
tests/test_modeling_tf_ctrl.py::TFCTRLModelTest::test_determinism 
[gw15] PASSED tests/test_modeling_distilbert.py::DistilBertModelTest::test_for_question_answering 
tests/test_modeling_distilbert.py::DistilBertModelTest::test_for_sequence_classification 
[gw16] PASSED tests/test_modeling_electra.py::ElectraModelTest::test_for_question_answering 
tests/test_modeling_electra.py::ElectraModelTest::test_for_sequence_classification 
[gw15] PASSED tests/test_modeling_distilbert.py::DistilBertModelTest::test_for_sequence_classification 
tests/test_modeling_distilbert.py::DistilBertModelTest::test_for_token_classification 
[gw13] PASSED tests/test_modeling_roberta.py::RobertaModelTest::test_for_token_classification 
tests/test_modeling_roberta.py::RobertaModelTest::test_head_pruning 
[gw17] PASSED tests/test_modeling_flaubert.py::FlaubertModelTest::test_flaubert_model 
tests/test_modeling_flaubert.py::FlaubertModelTest::test_flaubert_qa 
[gw15] PASSED tests/test_modeling_distilbert.py::DistilBertModelTest::test_for_token_classification 
tests/test_modeling_distilbert.py::DistilBertModelTest::test_head_pruning 
[gw16] PASSED tests/test_modeling_electra.py::ElectraModelTest::test_for_sequence_classification 
tests/test_modeling_electra.py::ElectraModelTest::test_for_token_classification 
[gw19] PASSED tests/test_modeling_gpt2.py::GPT2ModelTest::test_gpt2_lm_head_model 
tests/test_modeling_gpt2.py::GPT2ModelTest::test_gpt2_model 
[gw2] PASSED tests/test_benchmark_tf.py::TFBenchmarkTest::test_inference_no_configs_eager 
tests/test_benchmark_tf.py::TFBenchmarkTest::test_inference_no_configs_graph 
[gw16] PASSED tests/test_modeling_electra.py::ElectraModelTest::test_for_token_classification 
tests/test_modeling_electra.py::ElectraModelTest::test_head_pruning 
[gw3] PASSED tests/test_modeling_tf_ctrl.py::TFCTRLModelTest::test_determinism 
tests/test_modeling_tf_ctrl.py::TFCTRLModelTest::test_hidden_states_output 
[gw17] PASSED tests/test_modeling_flaubert.py::FlaubertModelTest::test_flaubert_qa 
tests/test_modeling_flaubert.py::FlaubertModelTest::test_flaubert_sequence_classif 
[gw19] PASSED tests/test_modeling_gpt2.py::GPT2ModelTest::test_gpt2_model 
tests/test_modeling_gpt2.py::GPT2ModelTest::test_gpt2_model_att_mask_past 
[gw3] PASSED tests/test_modeling_tf_ctrl.py::TFCTRLModelTest::test_hidden_states_output 
tests/test_modeling_tf_ctrl.py::TFCTRLModelTest::test_initialization 
[gw3] PASSED tests/test_modeling_tf_ctrl.py::TFCTRLModelTest::test_initialization 
tests/test_modeling_tf_ctrl.py::TFCTRLModelTest::test_inputs_embeds 
[gw15] PASSED tests/test_modeling_distilbert.py::DistilBertModelTest::test_head_pruning 
tests/test_modeling_distilbert.py::DistilBertModelTest::test_head_pruning_integration 
[gw16] PASSED tests/test_modeling_electra.py::ElectraModelTest::test_head_pruning 
tests/test_modeling_electra.py::ElectraModelTest::test_head_pruning_integration 
[gw0] PASSED tests/test_modeling_reformer.py::ReformerLocalAttnModelTest::test_determinism 
[gw13] PASSED tests/test_modeling_roberta.py::RobertaModelTest::test_head_pruning 
tests/test_modeling_roberta.py::RobertaModelTest::test_head_pruning_integration 
tests/test_modeling_reformer.py::ReformerLocalAttnModelTest::test_dropout_random_seed_is_changing 
[gw0] SKIPPED tests/test_modeling_reformer.py::ReformerLocalAttnModelTest::test_dropout_random_seed_is_changing 
tests/test_modeling_reformer.py::ReformerLocalAttnModelTest::test_head_pruning 
[gw0] PASSED tests/test_modeling_reformer.py::ReformerLocalAttnModelTest::test_head_pruning 
tests/test_modeling_reformer.py::ReformerLocalAttnModelTest::test_head_pruning_integration 
[gw0] PASSED tests/test_modeling_reformer.py::ReformerLocalAttnModelTest::test_head_pruning_integration 
tests/test_modeling_reformer.py::ReformerLocalAttnModelTest::test_head_pruning_save_load_from_config_init 
[gw0] PASSED tests/test_modeling_reformer.py::ReformerLocalAttnModelTest::test_head_pruning_save_load_from_config_init 
tests/test_modeling_reformer.py::ReformerLocalAttnModelTest::test_head_pruning_save_load_from_pretrained 
[gw0] PASSED tests/test_modeling_reformer.py::ReformerLocalAttnModelTest::test_head_pruning_save_load_from_pretrained 
tests/test_modeling_reformer.py::ReformerLocalAttnModelTest::test_hidden_states_output 
[gw17] PASSED tests/test_modeling_flaubert.py::FlaubertModelTest::test_flaubert_sequence_classif 
tests/test_modeling_flaubert.py::FlaubertModelTest::test_flaubert_simple_qa 
[gw3] PASSED tests/test_modeling_tf_ctrl.py::TFCTRLModelTest::test_inputs_embeds 
tests/test_modeling_tf_ctrl.py::TFCTRLModelTest::test_keras_save_load 
[gw23] PASSED tests/test_modeling_openai.py::OpenAIGPTModelTest::test_head_pruning_integration 
tests/test_modeling_openai.py::OpenAIGPTModelTest::test_head_pruning_save_load_from_config_init 
[gw17] PASSED tests/test_modeling_flaubert.py::FlaubertModelTest::test_flaubert_simple_qa 
tests/test_modeling_flaubert.py::FlaubertModelTest::test_head_pruning 
[gw19] PASSED tests/test_modeling_gpt2.py::GPT2ModelTest::test_gpt2_model_att_mask_past 
tests/test_modeling_gpt2.py::GPT2ModelTest::test_gpt2_model_past 
[gw2] PASSED tests/test_benchmark_tf.py::TFBenchmarkTest::test_inference_no_configs_graph 
[gw1] PASSED tests/test_benchmark.py::BenchmarkTest::test_inference_torchscript 
[gw8] PASSED tests/test_modeling_albert.py::AlbertModelTest::test_determinism 
tests/test_modeling_albert.py::AlbertModelTest::test_for_masked_lm 
[gw14] PASSED tests/test_modeling_ctrl.py::CTRLModelTest::test_head_pruning_integration 
tests/test_modeling_ctrl.py::CTRLModelTest::test_head_pruning_save_load_from_config_init 
[gw7] PASSED tests/test_modeling_tf_albert.py::TFAlbertModelTest::test_compile_tf_model 
tests/test_benchmark_tf.py::TFBenchmarkTest::test_inference_no_configs_only_pretrain 
[gw8] PASSED tests/test_modeling_albert.py::AlbertModelTest::test_for_masked_lm 
tests/test_modeling_albert.py::AlbertModelTest::test_for_multiple_choice 
[gw11] PASSED tests/test_modeling_bert.py::BertModelTest::test_determinism 
tests/test_modeling_bert.py::BertModelTest::test_for_causal_lm 
tests/test_modeling_tf_albert.py::TFAlbertModelTest::test_config 
[gw7] PASSED tests/test_modeling_tf_albert.py::TFAlbertModelTest::test_config 
tests/test_modeling_tf_albert.py::TFAlbertModelTest::test_determinism 
[gw20] PASSED tests/test_modeling_longformer.py::LongformerModelTest::test_determinism 
tests/test_modeling_longformer.py::LongformerModelTest::test_for_multiple_choice 
[gw11] PASSED tests/test_modeling_bert.py::BertModelTest::test_for_causal_lm 
tests/test_modeling_bert.py::BertModelTest::test_for_causal_lm_decoder 
tests/test_benchmark.py::BenchmarkTest::test_inference_with_configs 
[gw8] PASSED tests/test_modeling_albert.py::AlbertModelTest::test_for_multiple_choice 
tests/test_modeling_albert.py::AlbertModelTest::test_for_pretraining 
[gw23] PASSED tests/test_modeling_openai.py::OpenAIGPTModelTest::test_head_pruning_save_load_from_config_init 
tests/test_modeling_openai.py::OpenAIGPTModelTest::test_head_pruning_save_load_from_pretrained 
[gw8] PASSED tests/test_modeling_albert.py::AlbertModelTest::test_for_pretraining 
tests/test_modeling_albert.py::AlbertModelTest::test_for_question_answering 
[gw14] PASSED tests/test_modeling_ctrl.py::CTRLModelTest::test_head_pruning_save_load_from_config_init 
tests/test_modeling_ctrl.py::CTRLModelTest::test_head_pruning_save_load_from_pretrained 
[gw17] PASSED tests/test_modeling_flaubert.py::FlaubertModelTest::test_head_pruning 
tests/test_modeling_flaubert.py::FlaubertModelTest::test_head_pruning_integration 
[gw7] PASSED tests/test_modeling_tf_albert.py::TFAlbertModelTest::test_determinism 
tests/test_modeling_tf_albert.py::TFAlbertModelTest::test_for_masked_lm 
[gw8] PASSED tests/test_modeling_albert.py::AlbertModelTest::test_for_question_answering 
tests/test_modeling_albert.py::AlbertModelTest::test_for_sequence_classification 
[gw7] PASSED tests/test_modeling_tf_albert.py::TFAlbertModelTest::test_for_masked_lm 
[gw11] PASSED tests/test_modeling_bert.py::BertModelTest::test_for_causal_lm_decoder 
tests/test_modeling_bert.py::BertModelTest::test_for_masked_lm 
tests/test_modeling_tf_albert.py::TFAlbertModelTest::test_for_pretraining 
[gw2] PASSED tests/test_benchmark_tf.py::TFBenchmarkTest::test_inference_no_configs_only_pretrain 
[gw7] PASSED tests/test_modeling_tf_albert.py::TFAlbertModelTest::test_for_pretraining 
tests/test_modeling_tf_albert.py::TFAlbertModelTest::test_for_question_answering 
tests/test_benchmark_tf.py::TFBenchmarkTest::test_inference_no_configs_xla 
[gw2] SKIPPED tests/test_benchmark_tf.py::TFBenchmarkTest::test_inference_no_configs_xla 
tests/test_benchmark_tf.py::TFBenchmarkTest::test_inference_with_configs_eager 
[gw20] PASSED tests/test_modeling_longformer.py::LongformerModelTest::test_for_multiple_choice 
tests/test_modeling_longformer.py::LongformerModelTest::test_for_sequence_classification 
[gw7] PASSED tests/test_modeling_tf_albert.py::TFAlbertModelTest::test_for_question_answering 
tests/test_modeling_tf_albert.py::TFAlbertModelTest::test_for_sequence_classification 
[gw8] PASSED tests/test_modeling_albert.py::AlbertModelTest::test_for_sequence_classification 
tests/test_modeling_albert.py::AlbertModelTest::test_head_pruning 
[gw11] PASSED tests/test_modeling_bert.py::BertModelTest::test_for_masked_lm 
tests/test_modeling_bert.py::BertModelTest::test_for_multiple_choice 
[gw7] PASSED tests/test_modeling_tf_albert.py::TFAlbertModelTest::test_for_sequence_classification 
tests/test_modeling_tf_albert.py::TFAlbertModelTest::test_hidden_states_output 
[gw19] PASSED tests/test_modeling_gpt2.py::GPT2ModelTest::test_gpt2_model_past 
tests/test_modeling_gpt2.py::GPT2ModelTest::test_head_pruning 
[gw20] PASSED tests/test_modeling_longformer.py::LongformerModelTest::test_for_sequence_classification 
tests/test_modeling_longformer.py::LongformerModelTest::test_for_token_classification 
[gw1] PASSED tests/test_benchmark.py::BenchmarkTest::test_inference_with_configs 
tests/test_benchmark.py::BenchmarkTest::test_save_csv_files 
[gw11] PASSED tests/test_modeling_bert.py::BertModelTest::test_for_multiple_choice 
tests/test_modeling_bert.py::BertModelTest::test_for_next_sequence_prediction 
[gw5] PASSED tests/test_modeling_tf_gpt2.py::TFGPT2ModelTest::test_compile_tf_model 
[gw11] PASSED tests/test_modeling_bert.py::BertModelTest::test_for_next_sequence_prediction 
tests/test_modeling_bert.py::BertModelTest::test_for_pretraining 
[gw2] PASSED tests/test_benchmark_tf.py::TFBenchmarkTest::test_inference_with_configs_eager 
tests/test_benchmark_tf.py::TFBenchmarkTest::test_inference_with_configs_graph 
[gw14] PASSED tests/test_modeling_ctrl.py::CTRLModelTest::test_head_pruning_save_load_from_pretrained 
tests/test_modeling_ctrl.py::CTRLModelTest::test_headmasking 
[gw14] PASSED tests/test_modeling_ctrl.py::CTRLModelTest::test_headmasking 
tests/test_modeling_ctrl.py::CTRLModelTest::test_hidden_states_output 
tests/test_modeling_tf_gpt2.py::TFGPT2ModelTest::test_config 
[gw5] PASSED tests/test_modeling_tf_gpt2.py::TFGPT2ModelTest::test_config 
tests/test_modeling_tf_gpt2.py::TFGPT2ModelTest::test_determinism 
[gw20] PASSED tests/test_modeling_longformer.py::LongformerModelTest::test_for_token_classification 
tests/test_modeling_longformer.py::LongformerModelTest::test_head_pruning 
[gw20] PASSED tests/test_modeling_longformer.py::LongformerModelTest::test_head_pruning 
tests/test_modeling_longformer.py::LongformerModelTest::test_head_pruning_integration 
[gw20] PASSED tests/test_modeling_longformer.py::LongformerModelTest::test_head_pruning_integration 
tests/test_modeling_longformer.py::LongformerModelTest::test_head_pruning_save_load_from_config_init 
[gw20] PASSED tests/test_modeling_longformer.py::LongformerModelTest::test_head_pruning_save_load_from_config_init 
tests/test_modeling_longformer.py::LongformerModelTest::test_head_pruning_save_load_from_pretrained 
[gw20] PASSED tests/test_modeling_longformer.py::LongformerModelTest::test_head_pruning_save_load_from_pretrained 
tests/test_modeling_longformer.py::LongformerModelTest::test_hidden_states_output 
[gw4] PASSED tests/test_modeling_tf_electra.py::TFElectraModelTest::test_compile_tf_model 
[gw23] PASSED tests/test_modeling_openai.py::OpenAIGPTModelTest::test_head_pruning_save_load_from_pretrained 
tests/test_modeling_openai.py::OpenAIGPTModelTest::test_headmasking 
[gw11] PASSED tests/test_modeling_bert.py::BertModelTest::test_for_pretraining 
tests/test_modeling_bert.py::BertModelTest::test_for_question_answering 
tests/test_modeling_tf_electra.py::TFElectraModelTest::test_config 
[gw4] PASSED tests/test_modeling_tf_electra.py::TFElectraModelTest::test_config 
tests/test_modeling_tf_electra.py::TFElectraModelTest::test_determinism 
[gw16] PASSED tests/test_modeling_electra.py::ElectraModelTest::test_head_pruning_integration 
tests/test_modeling_electra.py::ElectraModelTest::test_head_pruning_save_load_from_config_init 
[gw11] PASSED tests/test_modeling_bert.py::BertModelTest::test_for_question_answering 
tests/test_modeling_bert.py::BertModelTest::test_for_sequence_classification 
[gw5] PASSED tests/test_modeling_tf_gpt2.py::TFGPT2ModelTest::test_determinism 
tests/test_modeling_tf_gpt2.py::TFGPT2ModelTest::test_gpt2_double_head 
[gw11] PASSED tests/test_modeling_bert.py::BertModelTest::test_for_sequence_classification 
tests/test_modeling_bert.py::BertModelTest::test_for_token_classification 
[gw5] PASSED tests/test_modeling_tf_gpt2.py::TFGPT2ModelTest::test_gpt2_double_head 
tests/test_modeling_tf_gpt2.py::TFGPT2ModelTest::test_gpt2_lm_head 
[gw11] PASSED tests/test_modeling_bert.py::BertModelTest::test_for_token_classification 
tests/test_modeling_bert.py::BertModelTest::test_head_pruning 
[gw5] PASSED tests/test_modeling_tf_gpt2.py::TFGPT2ModelTest::test_gpt2_lm_head 
tests/test_modeling_tf_gpt2.py::TFGPT2ModelTest::test_gpt2_model 
[gw15] PASSED tests/test_modeling_distilbert.py::DistilBertModelTest::test_head_pruning_integration 
tests/test_modeling_distilbert.py::DistilBertModelTest::test_head_pruning_save_load_from_config_init 
[gw19] PASSED tests/test_modeling_gpt2.py::GPT2ModelTest::test_head_pruning 
tests/test_modeling_gpt2.py::GPT2ModelTest::test_head_pruning_integration 
[gw7] PASSED tests/test_modeling_tf_albert.py::TFAlbertModelTest::test_hidden_states_output 
tests/test_modeling_tf_albert.py::TFAlbertModelTest::test_initialization 
[gw7] PASSED tests/test_modeling_tf_albert.py::TFAlbertModelTest::test_initialization 
tests/test_modeling_tf_albert.py::TFAlbertModelTest::test_inputs_embeds 
[gw5] PASSED tests/test_modeling_tf_gpt2.py::TFGPT2ModelTest::test_gpt2_model 
tests/test_modeling_tf_gpt2.py::TFGPT2ModelTest::test_gpt2_model_att_mask_past 
[gw0] PASSED tests/test_modeling_reformer.py::ReformerLocalAttnModelTest::test_hidden_states_output 
tests/test_modeling_reformer.py::ReformerLocalAttnModelTest::test_initialization 
[gw0] PASSED tests/test_modeling_reformer.py::ReformerLocalAttnModelTest::test_initialization 
tests/test_modeling_reformer.py::ReformerLocalAttnModelTest::test_inputs_embeds 
[gw5] PASSED tests/test_modeling_tf_gpt2.py::TFGPT2ModelTest::test_gpt2_model_att_mask_past 
tests/test_modeling_tf_gpt2.py::TFGPT2ModelTest::test_gpt2_model_past 
[gw3] PASSED tests/test_modeling_tf_ctrl.py::TFCTRLModelTest::test_keras_save_load 
tests/test_modeling_tf_ctrl.py::TFCTRLModelTest::test_keyword_and_dict_args 
[gw13] PASSED tests/test_modeling_roberta.py::RobertaModelTest::test_head_pruning_integration 
tests/test_modeling_roberta.py::RobertaModelTest::test_head_pruning_save_load_from_config_init 
[gw10] PASSED tests/test_modeling_bart.py::BARTModelTest::test_lm_head_model_random_beam_search_generate 
tests/test_modeling_bart.py::BARTModelTest::test_lm_head_model_random_no_beam_search_generate 
[gw2] PASSED tests/test_benchmark_tf.py::TFBenchmarkTest::test_inference_with_configs_graph 
[gw8] PASSED tests/test_modeling_albert.py::AlbertModelTest::test_head_pruning 
tests/test_modeling_albert.py::AlbertModelTest::test_head_pruning_integration 
[gw5] PASSED tests/test_modeling_tf_gpt2.py::TFGPT2ModelTest::test_gpt2_model_past 
tests/test_modeling_tf_gpt2.py::TFGPT2ModelTest::test_hidden_states_output 
[gw4] PASSED tests/test_modeling_tf_electra.py::TFElectraModelTest::test_determinism 
tests/test_modeling_tf_electra.py::TFElectraModelTest::test_electra_model 
[gw16] PASSED tests/test_modeling_electra.py::ElectraModelTest::test_head_pruning_save_load_from_config_init 
tests/test_modeling_electra.py::ElectraModelTest::test_head_pruning_save_load_from_pretrained 
tests/test_benchmark_tf.py::TFBenchmarkTest::test_save_csv_files 
[gw7] PASSED tests/test_modeling_tf_albert.py::TFAlbertModelTest::test_inputs_embeds 
tests/test_modeling_tf_albert.py::TFAlbertModelTest::test_keras_save_load 
[gw18] PASSED tests/test_modeling_encoder_decoder.py::EncoderDecoderModelTest::test_bert_encoder_decoder_model_generate 
[gw4] PASSED tests/test_modeling_tf_electra.py::TFElectraModelTest::test_electra_model 
tests/test_modeling_tf_electra.py::TFElectraModelTest::test_for_masked_lm 
tests/test_modeling_encoder_decoder.py::EncoderDecoderModelTest::test_bert_encoder_decoder_model_labels 
[gw14] PASSED tests/test_modeling_ctrl.py::CTRLModelTest::test_hidden_states_output 
tests/test_modeling_ctrl.py::CTRLModelTest::test_initialization 
[gw4] PASSED tests/test_modeling_tf_electra.py::TFElectraModelTest::test_for_masked_lm 
[gw23] PASSED tests/test_modeling_openai.py::OpenAIGPTModelTest::test_headmasking 
tests/test_modeling_openai.py::OpenAIGPTModelTest::test_hidden_states_output 
tests/test_modeling_tf_electra.py::TFElectraModelTest::test_for_pretraining 
[gw3] PASSED tests/test_modeling_tf_ctrl.py::TFCTRLModelTest::test_keyword_and_dict_args 
tests/test_modeling_tf_ctrl.py::TFCTRLModelTest::test_lm_head_model_random_beam_search_generate 
[gw15] PASSED tests/test_modeling_distilbert.py::DistilBertModelTest::test_head_pruning_save_load_from_config_init 
tests/test_modeling_distilbert.py::DistilBertModelTest::test_head_pruning_save_load_from_pretrained 
[gw4] PASSED tests/test_modeling_tf_electra.py::TFElectraModelTest::test_for_pretraining 
tests/test_modeling_tf_electra.py::TFElectraModelTest::test_for_question_answering 
[gw14] PASSED tests/test_modeling_ctrl.py::CTRLModelTest::test_initialization 
tests/test_modeling_ctrl.py::CTRLModelTest::test_inputs_embeds 
[gw4] PASSED tests/test_modeling_tf_electra.py::TFElectraModelTest::test_for_question_answering 
tests/test_modeling_tf_electra.py::TFElectraModelTest::test_for_token_classification 
[gw5] PASSED tests/test_modeling_tf_gpt2.py::TFGPT2ModelTest::test_hidden_states_output 
tests/test_modeling_tf_gpt2.py::TFGPT2ModelTest::test_initialization 
[gw5] PASSED tests/test_modeling_tf_gpt2.py::TFGPT2ModelTest::test_initialization 
tests/test_modeling_tf_gpt2.py::TFGPT2ModelTest::test_inputs_embeds 
[gw13] PASSED tests/test_modeling_roberta.py::RobertaModelTest::test_head_pruning_save_load_from_config_init 
tests/test_modeling_roberta.py::RobertaModelTest::test_head_pruning_save_load_from_pretrained 
[gw11] PASSED tests/test_modeling_bert.py::BertModelTest::test_head_pruning 
tests/test_modeling_bert.py::BertModelTest::test_head_pruning_integration 
[gw4] PASSED tests/test_modeling_tf_electra.py::TFElectraModelTest::test_for_token_classification 
tests/test_modeling_tf_electra.py::TFElectraModelTest::test_hidden_states_output 
[gw16] PASSED tests/test_modeling_electra.py::ElectraModelTest::test_head_pruning_save_load_from_pretrained 
tests/test_modeling_electra.py::ElectraModelTest::test_headmasking 
[gw0] PASSED tests/test_modeling_reformer.py::ReformerLocalAttnModelTest::test_inputs_embeds 
tests/test_modeling_reformer.py::ReformerLocalAttnModelTest::test_lm_head_model_random_beam_search_generate 
[gw2] PASSED tests/test_benchmark_tf.py::TFBenchmarkTest::test_save_csv_files 
tests/test_benchmark_tf.py::TFBenchmarkTest::test_trace_memory 
[gw7] PASSED tests/test_modeling_tf_albert.py::TFAlbertModelTest::test_keras_save_load 
[gw14] PASSED tests/test_modeling_ctrl.py::CTRLModelTest::test_inputs_embeds 
tests/test_modeling_ctrl.py::CTRLModelTest::test_lm_head_model_random_beam_search_generate 
tests/test_modeling_tf_albert.py::TFAlbertModelTest::test_keyword_and_dict_args 
[gw17] PASSED tests/test_modeling_flaubert.py::FlaubertModelTest::test_head_pruning_integration 
tests/test_modeling_flaubert.py::FlaubertModelTest::test_head_pruning_save_load_from_config_init 
[gw5] PASSED tests/test_modeling_tf_gpt2.py::TFGPT2ModelTest::test_inputs_embeds 
tests/test_modeling_tf_gpt2.py::TFGPT2ModelTest::test_keras_save_load 
[gw18] PASSED tests/test_modeling_encoder_decoder.py::EncoderDecoderModelTest::test_bert_encoder_decoder_model_labels 
tests/test_modeling_encoder_decoder.py::EncoderDecoderModelTest::test_real_bert_model_from_pretrained 
[gw18] SKIPPED tests/test_modeling_encoder_decoder.py::EncoderDecoderModelTest::test_real_bert_model_from_pretrained 
tests/test_modeling_encoder_decoder.py::EncoderDecoderModelTest::test_real_bert_model_from_pretrained_has_cross_attention 
[gw18] SKIPPED tests/test_modeling_encoder_decoder.py::EncoderDecoderModelTest::test_real_bert_model_from_pretrained_has_cross_attention 
tests/test_modeling_encoder_decoder.py::EncoderDecoderModelTest::test_real_bert_model_save_load_from_pretrained 
[gw18] SKIPPED tests/test_modeling_encoder_decoder.py::EncoderDecoderModelTest::test_real_bert_model_save_load_from_pretrained 
tests/test_modeling_encoder_decoder.py::EncoderDecoderModelTest::test_save_and_load_from_encoder_decoder_pretrained 
[gw15] PASSED tests/test_modeling_distilbert.py::DistilBertModelTest::test_head_pruning_save_load_from_pretrained 
tests/test_modeling_distilbert.py::DistilBertModelTest::test_headmasking 
[gw9] PASSED tests/test_modeling_tf_distilbert.py::TFDistilBertModelTest::test_compile_tf_model 
[gw20] PASSED tests/test_modeling_longformer.py::LongformerModelTest::test_hidden_states_output 
tests/test_modeling_longformer.py::LongformerModelTest::test_initialization 
tests/test_modeling_tf_distilbert.py::TFDistilBertModelTest::test_config 
[gw9] PASSED tests/test_modeling_tf_distilbert.py::TFDistilBertModelTest::test_config 
tests/test_modeling_tf_distilbert.py::TFDistilBertModelTest::test_determinism 
[gw7] PASSED tests/test_modeling_tf_albert.py::TFAlbertModelTest::test_keyword_and_dict_args 
tests/test_modeling_tf_albert.py::TFAlbertModelTest::test_lm_head_model_random_beam_search_generate 
[gw7] PASSED tests/test_modeling_tf_albert.py::TFAlbertModelTest::test_lm_head_model_random_beam_search_generate 
tests/test_modeling_tf_albert.py::TFAlbertModelTest::test_lm_head_model_random_no_beam_search_generate 
[gw7] PASSED tests/test_modeling_tf_albert.py::TFAlbertModelTest::test_lm_head_model_random_no_beam_search_generate 
tests/test_modeling_tf_albert.py::TFAlbertModelTest::test_loss_computation 
[gw13] PASSED tests/test_modeling_roberta.py::RobertaModelTest::test_head_pruning_save_load_from_pretrained 
tests/test_modeling_roberta.py::RobertaModelTest::test_headmasking 
[gw20] PASSED tests/test_modeling_longformer.py::LongformerModelTest::test_initialization 
tests/test_modeling_longformer.py::LongformerModelTest::test_inputs_embeds 
[gw23] PASSED tests/test_modeling_openai.py::OpenAIGPTModelTest::test_hidden_states_output 
tests/test_modeling_openai.py::OpenAIGPTModelTest::test_initialization 
[gw23] PASSED tests/test_modeling_openai.py::OpenAIGPTModelTest::test_initialization 
tests/test_modeling_openai.py::OpenAIGPTModelTest::test_inputs_embeds 
[gw18] PASSED tests/test_modeling_encoder_decoder.py::EncoderDecoderModelTest::test_save_and_load_from_encoder_decoder_pretrained 
tests/test_modeling_encoder_decoder.py::EncoderDecoderModelTest::test_save_and_load_from_pretrained 
[gw7] PASSED tests/test_modeling_tf_albert.py::TFAlbertModelTest::test_loss_computation 
tests/test_modeling_tf_albert.py::TFAlbertModelTest::test_model_common_attributes 
[gw17] PASSED tests/test_modeling_flaubert.py::FlaubertModelTest::test_head_pruning_save_load_from_config_init 
tests/test_modeling_flaubert.py::FlaubertModelTest::test_head_pruning_save_load_from_pretrained 
[gw4] PASSED tests/test_modeling_tf_electra.py::TFElectraModelTest::test_hidden_states_output 
tests/test_modeling_tf_electra.py::TFElectraModelTest::test_initialization 
[gw4] PASSED tests/test_modeling_tf_electra.py::TFElectraModelTest::test_initialization 
tests/test_modeling_tf_electra.py::TFElectraModelTest::test_inputs_embeds 
[gw19] PASSED tests/test_modeling_gpt2.py::GPT2ModelTest::test_head_pruning_integration 
tests/test_modeling_gpt2.py::GPT2ModelTest::test_head_pruning_save_load_from_config_init 
[gw5] PASSED tests/test_modeling_tf_gpt2.py::TFGPT2ModelTest::test_keras_save_load 
[gw7] PASSED tests/test_modeling_tf_albert.py::TFAlbertModelTest::test_model_common_attributes 
tests/test_modeling_tf_albert.py::TFAlbertModelTest::test_model_from_pretrained 
[gw7] SKIPPED tests/test_modeling_tf_albert.py::TFAlbertModelTest::test_model_from_pretrained 
tests/test_modeling_tf_albert.py::TFAlbertModelTest::test_pt_tf_model_equivalence 
tests/test_modeling_tf_gpt2.py::TFGPT2ModelTest::test_keyword_and_dict_args 
[gw9] PASSED tests/test_modeling_tf_distilbert.py::TFDistilBertModelTest::test_determinism 
tests/test_modeling_tf_distilbert.py::TFDistilBertModelTest::test_distilbert_model 
[gw2] PASSED tests/test_benchmark_tf.py::TFBenchmarkTest::test_trace_memory 
tests/test_modeling_tf_mobilebert.py::TFMobileBertModelTest::test_attention_outputs 
[gw3] PASSED tests/test_modeling_tf_ctrl.py::TFCTRLModelTest::test_lm_head_model_random_beam_search_generate 
tests/test_modeling_tf_ctrl.py::TFCTRLModelTest::test_lm_head_model_random_no_beam_search_generate 
[gw12] PASSED tests/test_modeling_t5.py::T5ModelTest::test_lm_head_model_random_beam_search_generate 
tests/test_modeling_t5.py::T5ModelTest::test_lm_head_model_random_no_beam_search_generate 
[gw16] PASSED tests/test_modeling_electra.py::ElectraModelTest::test_headmasking 
tests/test_modeling_electra.py::ElectraModelTest::test_hidden_states_output 
[gw4] PASSED tests/test_modeling_tf_electra.py::TFElectraModelTest::test_inputs_embeds 
tests/test_modeling_tf_electra.py::TFElectraModelTest::test_keras_save_load 
[gw4] PASSED tests/test_modeling_tf_electra.py::TFElectraModelTest::test_keras_save_load 
tests/test_modeling_tf_electra.py::TFElectraModelTest::test_keyword_and_dict_args 
[gw9] PASSED tests/test_modeling_tf_distilbert.py::TFDistilBertModelTest::test_distilbert_model 
tests/test_modeling_tf_distilbert.py::TFDistilBertModelTest::test_for_masked_lm 
[gw23] PASSED tests/test_modeling_openai.py::OpenAIGPTModelTest::test_inputs_embeds 
tests/test_modeling_openai.py::OpenAIGPTModelTest::test_lm_head_model_random_beam_search_generate 
[gw5] PASSED tests/test_modeling_tf_gpt2.py::TFGPT2ModelTest::test_keyword_and_dict_args 
tests/test_modeling_tf_gpt2.py::TFGPT2ModelTest::test_lm_head_model_random_beam_search_generate 
[gw9] PASSED tests/test_modeling_tf_distilbert.py::TFDistilBertModelTest::test_for_masked_lm 
tests/test_modeling_tf_distilbert.py::TFDistilBertModelTest::test_for_multiple_choice 
[gw18] PASSED tests/test_modeling_encoder_decoder.py::EncoderDecoderModelTest::test_save_and_load_from_pretrained 
tests/test_modeling_tf_openai_gpt.py::TFOpenAIGPTModelTest::test_attention_outputs 
[gw10] PASSED tests/test_modeling_bart.py::BARTModelTest::test_lm_head_model_random_no_beam_search_generate 
tests/test_modeling_bart.py::BARTModelTest::test_model_common_attributes 
[gw10] PASSED tests/test_modeling_bart.py::BARTModelTest::test_model_common_attributes 
tests/test_modeling_bart.py::BARTModelTest::test_multigpu_data_parallel_forward 
[gw10] SKIPPED tests/test_modeling_bart.py::BARTModelTest::test_multigpu_data_parallel_forward 
tests/test_modeling_bart.py::BARTModelTest::test_resize_tokens_embeddings 
[gw9] PASSED tests/test_modeling_tf_distilbert.py::TFDistilBertModelTest::test_for_multiple_choice 
tests/test_modeling_tf_distilbert.py::TFDistilBertModelTest::test_for_question_answering 
[gw19] PASSED tests/test_modeling_gpt2.py::GPT2ModelTest::test_head_pruning_save_load_from_config_init 
tests/test_modeling_gpt2.py::GPT2ModelTest::test_head_pruning_save_load_from_pretrained 
[gw20] PASSED tests/test_modeling_longformer.py::LongformerModelTest::test_inputs_embeds 
tests/test_modeling_longformer.py::LongformerModelTest::test_lm_head_model_random_beam_search_generate 
[gw20] PASSED tests/test_modeling_longformer.py::LongformerModelTest::test_lm_head_model_random_beam_search_generate 
tests/test_modeling_longformer.py::LongformerModelTest::test_lm_head_model_random_no_beam_search_generate 
[gw20] PASSED tests/test_modeling_longformer.py::LongformerModelTest::test_lm_head_model_random_no_beam_search_generate 
tests/test_modeling_longformer.py::LongformerModelTest::test_longformer_for_masked_lm 
[gw17] PASSED tests/test_modeling_flaubert.py::FlaubertModelTest::test_head_pruning_save_load_from_pretrained 
tests/test_modeling_flaubert.py::FlaubertModelTest::test_headmasking 
[gw9] PASSED tests/test_modeling_tf_distilbert.py::TFDistilBertModelTest::test_for_question_answering 
tests/test_modeling_tf_distilbert.py::TFDistilBertModelTest::test_for_sequence_classification 
[gw9] PASSED tests/test_modeling_tf_distilbert.py::TFDistilBertModelTest::test_for_sequence_classification 
tests/test_modeling_tf_distilbert.py::TFDistilBertModelTest::test_for_token_classification 
[gw20] PASSED tests/test_modeling_longformer.py::LongformerModelTest::test_longformer_for_masked_lm 
tests/test_modeling_longformer.py::LongformerModelTest::test_longformer_for_question_answering 
[gw4] PASSED tests/test_modeling_tf_electra.py::TFElectraModelTest::test_keyword_and_dict_args 
tests/test_modeling_tf_electra.py::TFElectraModelTest::test_lm_head_model_random_beam_search_generate 
[gw4] PASSED tests/test_modeling_tf_electra.py::TFElectraModelTest::test_lm_head_model_random_beam_search_generate 
tests/test_modeling_tf_electra.py::TFElectraModelTest::test_lm_head_model_random_no_beam_search_generate 
[gw4] PASSED tests/test_modeling_tf_electra.py::TFElectraModelTest::test_lm_head_model_random_no_beam_search_generate 
tests/test_modeling_tf_electra.py::TFElectraModelTest::test_loss_computation 
[gw9] PASSED tests/test_modeling_tf_distilbert.py::TFDistilBertModelTest::test_for_token_classification 
tests/test_modeling_tf_distilbert.py::TFDistilBertModelTest::test_hidden_states_output 
[gw15] PASSED tests/test_modeling_distilbert.py::DistilBertModelTest::test_headmasking 
tests/test_modeling_distilbert.py::DistilBertModelTest::test_hidden_states_output 
[gw20] PASSED tests/test_modeling_longformer.py::LongformerModelTest::test_longformer_for_question_answering 
[gw22] PASSED tests/test_modeling_mobilebert.py::MobileBertModelTest::test_attention_outputs 
tests/test_modeling_mobilebert.py::MobileBertModelTest::test_config 
[gw22] PASSED tests/test_modeling_mobilebert.py::MobileBertModelTest::test_config 
tests/test_modeling_longformer.py::LongformerModelTest::test_longformer_model 
tests/test_modeling_mobilebert.py::MobileBertModelTest::test_correct_missing_keys 
[gw13] PASSED tests/test_modeling_roberta.py::RobertaModelTest::test_headmasking 
tests/test_modeling_roberta.py::RobertaModelTest::test_hidden_states_output 
[gw3] PASSED tests/test_modeling_tf_ctrl.py::TFCTRLModelTest::test_lm_head_model_random_no_beam_search_generate 
tests/test_modeling_tf_ctrl.py::TFCTRLModelTest::test_loss_computation 
[gw8] PASSED tests/test_modeling_albert.py::AlbertModelTest::test_head_pruning_integration 
tests/test_modeling_albert.py::AlbertModelTest::test_head_pruning_save_load_from_config_init 
[gw18] PASSED tests/test_modeling_tf_openai_gpt.py::TFOpenAIGPTModelTest::test_attention_outputs 
tests/test_modeling_tf_openai_gpt.py::TFOpenAIGPTModelTest::test_compile_tf_model 
[gw4] PASSED tests/test_modeling_tf_electra.py::TFElectraModelTest::test_loss_computation 
[gw11] PASSED tests/test_modeling_bert.py::BertModelTest::test_head_pruning_integration 
tests/test_modeling_bert.py::BertModelTest::test_head_pruning_save_load_from_config_init 
tests/test_modeling_tf_electra.py::TFElectraModelTest::test_model_common_attributes 
[gw22] PASSED tests/test_modeling_mobilebert.py::MobileBertModelTest::test_correct_missing_keys 
tests/test_modeling_mobilebert.py::MobileBertModelTest::test_determinism 
[gw3] PASSED tests/test_modeling_tf_ctrl.py::TFCTRLModelTest::test_loss_computation 
tests/test_modeling_tf_ctrl.py::TFCTRLModelTest::test_model_common_attributes 
[gw16] PASSED tests/test_modeling_electra.py::ElectraModelTest::test_hidden_states_output 
tests/test_modeling_electra.py::ElectraModelTest::test_initialization 
[gw19] PASSED tests/test_modeling_gpt2.py::GPT2ModelTest::test_head_pruning_save_load_from_pretrained 
tests/test_modeling_gpt2.py::GPT2ModelTest::test_headmasking 
[gw16] PASSED tests/test_modeling_electra.py::ElectraModelTest::test_initialization 
tests/test_modeling_electra.py::ElectraModelTest::test_inputs_embeds 
[gw20] PASSED tests/test_modeling_longformer.py::LongformerModelTest::test_longformer_model 
tests/test_modeling_longformer.py::LongformerModelTest::test_longformer_model_attention_mask_determinism 
[gw3] PASSED tests/test_modeling_tf_ctrl.py::TFCTRLModelTest::test_model_common_attributes 
tests/test_modeling_tf_ctrl.py::TFCTRLModelTest::test_model_from_pretrained 
[gw3] SKIPPED tests/test_modeling_tf_ctrl.py::TFCTRLModelTest::test_model_from_pretrained 
tests/test_modeling_tf_ctrl.py::TFCTRLModelTest::test_pt_tf_model_equivalence 
[gw4] PASSED tests/test_modeling_tf_electra.py::TFElectraModelTest::test_model_common_attributes 
tests/test_modeling_tf_electra.py::TFElectraModelTest::test_model_from_pretrained 
[gw4] SKIPPED tests/test_modeling_tf_electra.py::TFElectraModelTest::test_model_from_pretrained 
tests/test_modeling_tf_electra.py::TFElectraModelTest::test_pt_tf_model_equivalence 
[gw10] PASSED tests/test_modeling_bart.py::BARTModelTest::test_resize_tokens_embeddings 
tests/test_modeling_bart.py::BARTModelTest::test_save_load 
[gw20] PASSED tests/test_modeling_longformer.py::LongformerModelTest::test_longformer_model_attention_mask_determinism 
tests/test_modeling_longformer.py::LongformerModelTest::test_longformer_model_global_attention_mask 
[gw5] PASSED tests/test_modeling_tf_gpt2.py::TFGPT2ModelTest::test_lm_head_model_random_beam_search_generate 
tests/test_modeling_tf_gpt2.py::TFGPT2ModelTest::test_lm_head_model_random_no_beam_search_generate 
[gw9] PASSED tests/test_modeling_tf_distilbert.py::TFDistilBertModelTest::test_hidden_states_output 
tests/test_modeling_tf_distilbert.py::TFDistilBertModelTest::test_initialization 
[gw9] PASSED tests/test_modeling_tf_distilbert.py::TFDistilBertModelTest::test_initialization 
tests/test_modeling_tf_distilbert.py::TFDistilBertModelTest::test_inputs_embeds 
[gw8] PASSED tests/test_modeling_albert.py::AlbertModelTest::test_head_pruning_save_load_from_config_init 
tests/test_modeling_albert.py::AlbertModelTest::test_head_pruning_save_load_from_pretrained 
[gw1] PASSED tests/test_benchmark.py::BenchmarkTest::test_save_csv_files 
tests/test_benchmark.py::BenchmarkTest::test_trace_memory 
[gw11] PASSED tests/test_modeling_bert.py::BertModelTest::test_head_pruning_save_load_from_config_init 
tests/test_modeling_bert.py::BertModelTest::test_head_pruning_save_load_from_pretrained 
[gw16] PASSED tests/test_modeling_electra.py::ElectraModelTest::test_inputs_embeds 
tests/test_modeling_electra.py::ElectraModelTest::test_lm_head_model_random_beam_search_generate 
[gw16] PASSED tests/test_modeling_electra.py::ElectraModelTest::test_lm_head_model_random_beam_search_generate 
tests/test_modeling_electra.py::ElectraModelTest::test_lm_head_model_random_no_beam_search_generate 
[gw16] PASSED tests/test_modeling_electra.py::ElectraModelTest::test_lm_head_model_random_no_beam_search_generate 
tests/test_modeling_electra.py::ElectraModelTest::test_model_common_attributes 
[gw16] PASSED tests/test_modeling_electra.py::ElectraModelTest::test_model_common_attributes 
tests/test_modeling_electra.py::ElectraModelTest::test_model_from_pretrained 
[gw16] SKIPPED tests/test_modeling_electra.py::ElectraModelTest::test_model_from_pretrained 
tests/test_modeling_electra.py::ElectraModelTest::test_multigpu_data_parallel_forward 
[gw16] SKIPPED tests/test_modeling_electra.py::ElectraModelTest::test_multigpu_data_parallel_forward 
tests/test_modeling_electra.py::ElectraModelTest::test_resize_tokens_embeddings 
[gw17] PASSED tests/test_modeling_flaubert.py::FlaubertModelTest::test_headmasking 
tests/test_modeling_flaubert.py::FlaubertModelTest::test_hidden_states_output 
[gw7] PASSED tests/test_modeling_tf_albert.py::TFAlbertModelTest::test_pt_tf_model_equivalence 
tests/test_modeling_tf_albert.py::TFAlbertModelTest::test_resize_token_embeddings 
[gw6] PASSED tests/test_modeling_tf_bert.py::TFBertModelTest::test_compile_tf_model 
[gw5] PASSED tests/test_modeling_tf_gpt2.py::TFGPT2ModelTest::test_lm_head_model_random_no_beam_search_generate 
tests/test_modeling_tf_gpt2.py::TFGPT2ModelTest::test_loss_computation 
[gw15] PASSED tests/test_modeling_distilbert.py::DistilBertModelTest::test_hidden_states_output 
tests/test_modeling_distilbert.py::DistilBertModelTest::test_initialization 
[gw15] PASSED tests/test_modeling_distilbert.py::DistilBertModelTest::test_initialization 
tests/test_modeling_distilbert.py::DistilBertModelTest::test_inputs_embeds 
[gw13] PASSED tests/test_modeling_roberta.py::RobertaModelTest::test_hidden_states_output 
tests/test_modeling_roberta.py::RobertaModelTest::test_initialization 
[gw9] PASSED tests/test_modeling_tf_distilbert.py::TFDistilBertModelTest::test_inputs_embeds 
tests/test_modeling_tf_distilbert.py::TFDistilBertModelTest::test_keras_save_load 
[gw13] PASSED tests/test_modeling_roberta.py::RobertaModelTest::test_initialization 
tests/test_modeling_roberta.py::RobertaModelTest::test_inputs_embeds 
[gw5] PASSED tests/test_modeling_tf_gpt2.py::TFGPT2ModelTest::test_loss_computation 
tests/test_modeling_tf_gpt2.py::TFGPT2ModelTest::test_model_common_attributes 
tests/test_modeling_tf_bert.py::TFBertModelTest::test_config 
[gw6] PASSED tests/test_modeling_tf_bert.py::TFBertModelTest::test_config 
tests/test_modeling_tf_bert.py::TFBertModelTest::test_determinism 
[gw10] PASSED tests/test_modeling_bart.py::BARTModelTest::test_save_load 
tests/test_modeling_bart.py::BARTModelTest::test_save_load_strict 
[gw20] PASSED tests/test_modeling_longformer.py::LongformerModelTest::test_longformer_model_global_attention_mask 
tests/test_modeling_longformer.py::LongformerModelTest::test_model_common_attributes 
[gw20] PASSED tests/test_modeling_longformer.py::LongformerModelTest::test_model_common_attributes 
tests/test_modeling_longformer.py::LongformerModelTest::test_multigpu_data_parallel_forward 
[gw20] SKIPPED tests/test_modeling_longformer.py::LongformerModelTest::test_multigpu_data_parallel_forward 
tests/test_modeling_longformer.py::LongformerModelTest::test_resize_tokens_embeddings 
[gw10] PASSED tests/test_modeling_bart.py::BARTModelTest::test_save_load_strict 
tests/test_modeling_bart.py::BARTModelTest::test_tie_model_weights 
[gw10] PASSED tests/test_modeling_bart.py::BARTModelTest::test_tie_model_weights 
tests/test_modeling_bart.py::BARTModelTest::test_tiny_model 
[gw5] PASSED tests/test_modeling_tf_gpt2.py::TFGPT2ModelTest::test_model_common_attributes 
tests/test_modeling_tf_gpt2.py::TFGPT2ModelTest::test_model_from_pretrained 
[gw5] SKIPPED tests/test_modeling_tf_gpt2.py::TFGPT2ModelTest::test_model_from_pretrained 
tests/test_modeling_tf_gpt2.py::TFGPT2ModelTest::test_pt_tf_model_equivalence 
[gw19] PASSED tests/test_modeling_gpt2.py::GPT2ModelTest::test_headmasking 
tests/test_modeling_gpt2.py::GPT2ModelTest::test_hidden_states_output 
[gw11] PASSED tests/test_modeling_bert.py::BertModelTest::test_head_pruning_save_load_from_pretrained 
tests/test_modeling_bert.py::BertModelTest::test_headmasking 
[gw15] PASSED tests/test_modeling_distilbert.py::DistilBertModelTest::test_inputs_embeds 
tests/test_modeling_distilbert.py::DistilBertModelTest::test_lm_head_model_random_beam_search_generate 
[gw15] PASSED tests/test_modeling_distilbert.py::DistilBertModelTest::test_lm_head_model_random_beam_search_generate 
tests/test_modeling_distilbert.py::DistilBertModelTest::test_lm_head_model_random_no_beam_search_generate 
[gw15] PASSED tests/test_modeling_distilbert.py::DistilBertModelTest::test_lm_head_model_random_no_beam_search_generate 
tests/test_modeling_distilbert.py::DistilBertModelTest::test_model_common_attributes 
[gw7] PASSED tests/test_modeling_tf_albert.py::TFAlbertModelTest::test_resize_token_embeddings 
tests/test_modeling_tf_albert.py::TFAlbertModelTest::test_save_load 
[gw15] PASSED tests/test_modeling_distilbert.py::DistilBertModelTest::test_model_common_attributes 
tests/test_modeling_distilbert.py::DistilBertModelTest::test_multigpu_data_parallel_forward 
[gw15] SKIPPED tests/test_modeling_distilbert.py::DistilBertModelTest::test_multigpu_data_parallel_forward 
tests/test_modeling_distilbert.py::DistilBertModelTest::test_resize_tokens_embeddings 
[gw8] PASSED tests/test_modeling_albert.py::AlbertModelTest::test_head_pruning_save_load_from_pretrained 
tests/test_modeling_albert.py::AlbertModelTest::test_headmasking 
[gw12] PASSED tests/test_modeling_t5.py::T5ModelTest::test_lm_head_model_random_no_beam_search_generate 
tests/test_modeling_t5.py::T5ModelTest::test_model_common_attributes 
[gw10] PASSED tests/test_modeling_bart.py::BARTModelTest::test_tiny_model 
tests/test_modeling_bart.py::BARTModelTest::test_torchscript_output_attentions 
[gw10] PASSED tests/test_modeling_bart.py::BARTModelTest::test_torchscript_output_attentions 
tests/test_modeling_bart.py::BARTModelTest::test_torchscript_output_hidden_state 
[gw10] PASSED tests/test_modeling_bart.py::BARTModelTest::test_torchscript_output_hidden_state 
tests/test_modeling_bart.py::MBartIntegrationTests::test_enro_forward 
[gw12] PASSED tests/test_modeling_t5.py::T5ModelTest::test_model_common_attributes 
tests/test_modeling_t5.py::T5ModelTest::test_model_from_pretrained 
[gw12] SKIPPED tests/test_modeling_t5.py::T5ModelTest::test_model_from_pretrained 
tests/test_modeling_t5.py::T5ModelTest::test_multigpu_data_parallel_forward 
[gw12] SKIPPED tests/test_modeling_t5.py::T5ModelTest::test_multigpu_data_parallel_forward 
tests/test_modeling_t5.py::T5ModelTest::test_resize_tokens_embeddings 
[gw12] PASSED tests/test_modeling_t5.py::T5ModelTest::test_resize_tokens_embeddings 
tests/test_modeling_t5.py::T5ModelTest::test_save_load 
[gw13] PASSED tests/test_modeling_roberta.py::RobertaModelTest::test_inputs_embeds 
tests/test_modeling_roberta.py::RobertaModelTest::test_lm_head_model_random_beam_search_generate 
[gw13] PASSED tests/test_modeling_roberta.py::RobertaModelTest::test_lm_head_model_random_beam_search_generate 
tests/test_modeling_roberta.py::RobertaModelTest::test_lm_head_model_random_no_beam_search_generate 
[gw13] PASSED tests/test_modeling_roberta.py::RobertaModelTest::test_lm_head_model_random_no_beam_search_generate 
tests/test_modeling_roberta.py::RobertaModelTest::test_model_common_attributes 
[gw13] PASSED tests/test_modeling_roberta.py::RobertaModelTest::test_model_common_attributes 
tests/test_modeling_roberta.py::RobertaModelTest::test_model_from_pretrained 
[gw13] SKIPPED tests/test_modeling_roberta.py::RobertaModelTest::test_model_from_pretrained 
tests/test_modeling_roberta.py::RobertaModelTest::test_multigpu_data_parallel_forward 
[gw13] SKIPPED tests/test_modeling_roberta.py::RobertaModelTest::test_multigpu_data_parallel_forward 
tests/test_modeling_roberta.py::RobertaModelTest::test_resize_tokens_embeddings 
[gw3] PASSED tests/test_modeling_tf_ctrl.py::TFCTRLModelTest::test_pt_tf_model_equivalence 
tests/test_modeling_tf_ctrl.py::TFCTRLModelTest::test_resize_token_embeddings 
[gw17] PASSED tests/test_modeling_flaubert.py::FlaubertModelTest::test_hidden_states_output 
tests/test_modeling_flaubert.py::FlaubertModelTest::test_initialization 
[gw6] PASSED tests/test_modeling_tf_bert.py::TFBertModelTest::test_determinism 
tests/test_modeling_tf_bert.py::TFBertModelTest::test_for_masked_lm 
[gw17] PASSED tests/test_modeling_flaubert.py::FlaubertModelTest::test_initialization 
tests/test_modeling_flaubert.py::FlaubertModelTest::test_inputs_embeds 
[gw10] SKIPPED tests/test_modeling_bart.py::MBartIntegrationTests::test_enro_forward 
tests/test_modeling_bart.py::MBartIntegrationTests::test_enro_generate 
[gw10] SKIPPED tests/test_modeling_bart.py::MBartIntegrationTests::test_enro_generate 
tests/test_modeling_bart.py::MBartIntegrationTests::test_enro_tokenizer_batch_encode_plus 
[gw10] PASSED tests/test_modeling_bart.py::MBartIntegrationTests::test_enro_tokenizer_batch_encode_plus 
tests/test_modeling_bart.py::MBartIntegrationTests::test_enro_tokenizer_decode_ignores_language_codes 
[gw10] PASSED tests/test_modeling_bart.py::MBartIntegrationTests::test_enro_tokenizer_decode_ignores_language_codes 
tests/test_modeling_bart.py::MBartIntegrationTests::test_enro_tokenizer_prepare_translation_batch 
[gw10] PASSED tests/test_modeling_bart.py::MBartIntegrationTests::test_enro_tokenizer_prepare_translation_batch 
tests/test_modeling_bart.py::MBartIntegrationTests::test_enro_tokenizer_truncation 
[gw10] PASSED tests/test_modeling_bart.py::MBartIntegrationTests::test_enro_tokenizer_truncation 
tests/test_modeling_bart.py::MBartIntegrationTests::test_mbart_enro_config 
[gw10] PASSED tests/test_modeling_bart.py::MBartIntegrationTests::test_mbart_enro_config 
tests/test_modeling_bart.py::MBartIntegrationTests::test_mbart_fast_forward 
[gw6] PASSED tests/test_modeling_tf_bert.py::TFBertModelTest::test_for_masked_lm 
tests/test_modeling_tf_bert.py::TFBertModelTest::test_for_multiple_choice 
[gw7] PASSED tests/test_modeling_tf_albert.py::TFAlbertModelTest::test_save_load 
tests/test_modeling_tf_roberta.py::TFRobertaModelTest::test_attention_outputs 
[gw6] PASSED tests/test_modeling_tf_bert.py::TFBertModelTest::test_for_multiple_choice 
tests/test_modeling_tf_bert.py::TFBertModelTest::test_for_next_sequence_prediction 
[gw9] PASSED tests/test_modeling_tf_distilbert.py::TFDistilBertModelTest::test_keras_save_load 
tests/test_modeling_tf_distilbert.py::TFDistilBertModelTest::test_keyword_and_dict_args 
[gw6] PASSED tests/test_modeling_tf_bert.py::TFBertModelTest::test_for_next_sequence_prediction 
tests/test_modeling_tf_bert.py::TFBertModelTest::test_for_pretraining 
[gw12] PASSED tests/test_modeling_t5.py::T5ModelTest::test_save_load 
tests/test_modeling_t5.py::T5ModelTest::test_shift_right 
[gw12] PASSED tests/test_modeling_t5.py::T5ModelTest::test_shift_right 
tests/test_modeling_t5.py::T5ModelTest::test_t5_decoder_model_past 
[gw10] PASSED tests/test_modeling_bart.py::MBartIntegrationTests::test_mbart_fast_forward 
tests/test_modeling_bart.py::BartHeadTests::test_dummy_inputs 
[gw10] PASSED tests/test_modeling_bart.py::BartHeadTests::test_dummy_inputs 
tests/test_modeling_bart.py::BartHeadTests::test_generate_beam_search 
[gw6] PASSED tests/test_modeling_tf_bert.py::TFBertModelTest::test_for_pretraining 
tests/test_modeling_tf_bert.py::TFBertModelTest::test_for_question_answering 
[gw19] PASSED tests/test_modeling_gpt2.py::GPT2ModelTest::test_hidden_states_output 
tests/test_modeling_gpt2.py::GPT2ModelTest::test_initialization 
[gw16] PASSED tests/test_modeling_electra.py::ElectraModelTest::test_resize_tokens_embeddings 
tests/test_modeling_electra.py::ElectraModelTest::test_save_load 
[gw6] PASSED tests/test_modeling_tf_bert.py::TFBertModelTest::test_for_question_answering 
tests/test_modeling_tf_bert.py::TFBertModelTest::test_for_sequence_classification 
[gw19] PASSED tests/test_modeling_gpt2.py::GPT2ModelTest::test_initialization 
tests/test_modeling_gpt2.py::GPT2ModelTest::test_inputs_embeds 
[gw18] PASSED tests/test_modeling_tf_openai_gpt.py::TFOpenAIGPTModelTest::test_compile_tf_model 
[gw6] PASSED tests/test_modeling_tf_bert.py::TFBertModelTest::test_for_sequence_classification 
tests/test_modeling_tf_bert.py::TFBertModelTest::test_for_token_classification 
[gw12] PASSED tests/test_modeling_t5.py::T5ModelTest::test_t5_decoder_model_past 
tests/test_modeling_t5.py::T5ModelTest::test_t5_decoder_model_past_with_attn_mask 
[gw3] PASSED tests/test_modeling_tf_ctrl.py::TFCTRLModelTest::test_resize_token_embeddings 
tests/test_modeling_tf_ctrl.py::TFCTRLModelTest::test_save_load 
[gw10] PASSED tests/test_modeling_bart.py::BartHeadTests::test_generate_beam_search 
tests/test_modeling_bart.py::BartHeadTests::test_generate_fp16 
tests/test_modeling_tf_openai_gpt.py::TFOpenAIGPTModelTest::test_config 
[gw18] PASSED tests/test_modeling_tf_openai_gpt.py::TFOpenAIGPTModelTest::test_config 
tests/test_modeling_tf_openai_gpt.py::TFOpenAIGPTModelTest::test_determinism 
[gw6] PASSED tests/test_modeling_tf_bert.py::TFBertModelTest::test_for_token_classification 
tests/test_modeling_tf_bert.py::TFBertModelTest::test_hidden_states_output 
[gw12] PASSED tests/test_modeling_t5.py::T5ModelTest::test_t5_decoder_model_past_with_attn_mask 
tests/test_modeling_t5.py::T5ModelTest::test_t5_generate_with_past_key_value_states 
[gw4] PASSED tests/test_modeling_tf_electra.py::TFElectraModelTest::test_pt_tf_model_equivalence 
tests/test_modeling_tf_electra.py::TFElectraModelTest::test_resize_token_embeddings 
[gw5] PASSED tests/test_modeling_tf_gpt2.py::TFGPT2ModelTest::test_pt_tf_model_equivalence 
tests/test_modeling_tf_gpt2.py::TFGPT2ModelTest::test_resize_token_embeddings 
[gw9] PASSED tests/test_modeling_tf_distilbert.py::TFDistilBertModelTest::test_keyword_and_dict_args 
tests/test_modeling_tf_distilbert.py::TFDistilBertModelTest::test_lm_head_model_random_beam_search_generate 
[gw9] PASSED tests/test_modeling_tf_distilbert.py::TFDistilBertModelTest::test_lm_head_model_random_beam_search_generate 
tests/test_modeling_tf_distilbert.py::TFDistilBertModelTest::test_lm_head_model_random_no_beam_search_generate 
[gw9] PASSED tests/test_modeling_tf_distilbert.py::TFDistilBertModelTest::test_lm_head_model_random_no_beam_search_generate 
tests/test_modeling_tf_distilbert.py::TFDistilBertModelTest::test_loss_computation 
[gw17] PASSED tests/test_modeling_flaubert.py::FlaubertModelTest::test_inputs_embeds 
tests/test_modeling_flaubert.py::FlaubertModelTest::test_lm_head_model_random_beam_search_generate 
[gw17] PASSED tests/test_modeling_flaubert.py::FlaubertModelTest::test_lm_head_model_random_beam_search_generate 
tests/test_modeling_flaubert.py::FlaubertModelTest::test_lm_head_model_random_no_beam_search_generate 
[gw17] PASSED tests/test_modeling_flaubert.py::FlaubertModelTest::test_lm_head_model_random_no_beam_search_generate 
tests/test_modeling_flaubert.py::FlaubertModelTest::test_model_common_attributes 
[gw17] PASSED tests/test_modeling_flaubert.py::FlaubertModelTest::test_model_common_attributes 
tests/test_modeling_flaubert.py::FlaubertModelTest::test_model_from_pretrained 
[gw17] SKIPPED tests/test_modeling_flaubert.py::FlaubertModelTest::test_model_from_pretrained 
tests/test_modeling_flaubert.py::FlaubertModelTest::test_multigpu_data_parallel_forward 
[gw17] SKIPPED tests/test_modeling_flaubert.py::FlaubertModelTest::test_multigpu_data_parallel_forward 
tests/test_modeling_flaubert.py::FlaubertModelTest::test_resize_tokens_embeddings 
[gw18] PASSED tests/test_modeling_tf_openai_gpt.py::TFOpenAIGPTModelTest::test_determinism 
tests/test_modeling_tf_openai_gpt.py::TFOpenAIGPTModelTest::test_hidden_states_output 
[gw15] PASSED tests/test_modeling_distilbert.py::DistilBertModelTest::test_resize_tokens_embeddings 
tests/test_modeling_distilbert.py::DistilBertModelTest::test_save_load 
[gw5] PASSED tests/test_modeling_tf_gpt2.py::TFGPT2ModelTest::test_resize_token_embeddings 
tests/test_modeling_tf_gpt2.py::TFGPT2ModelTest::test_save_load 
[gw19] PASSED tests/test_modeling_gpt2.py::GPT2ModelTest::test_inputs_embeds 
tests/test_modeling_gpt2.py::GPT2ModelTest::test_lm_head_model_random_beam_search_generate 
[gw3] PASSED tests/test_modeling_tf_ctrl.py::TFCTRLModelTest::test_save_load 
tests/test_modeling_tf_ctrl.py::TFCTRLModelLanguageGenerationTest::test_lm_generate_ctrl 
[gw3] SKIPPED tests/test_modeling_tf_ctrl.py::TFCTRLModelLanguageGenerationTest::test_lm_generate_ctrl 
tests/test_modeling_tf_t5.py::TFT5ModelTest::test_attention_outputs 
[gw11] PASSED tests/test_modeling_bert.py::BertModelTest::test_headmasking 
tests/test_modeling_bert.py::BertModelTest::test_hidden_states_output 
[gw13] PASSED tests/test_modeling_roberta.py::RobertaModelTest::test_resize_tokens_embeddings 
tests/test_modeling_roberta.py::RobertaModelTest::test_roberta_model 
[gw18] PASSED tests/test_modeling_tf_openai_gpt.py::TFOpenAIGPTModelTest::test_hidden_states_output 
tests/test_modeling_tf_openai_gpt.py::TFOpenAIGPTModelTest::test_initialization 
[gw18] PASSED tests/test_modeling_tf_openai_gpt.py::TFOpenAIGPTModelTest::test_initialization 
tests/test_modeling_tf_openai_gpt.py::TFOpenAIGPTModelTest::test_inputs_embeds 
[gw12] PASSED tests/test_modeling_t5.py::T5ModelTest::test_t5_generate_with_past_key_value_states 
tests/test_modeling_t5.py::T5ModelTest::test_t5_model 
[gw9] PASSED tests/test_modeling_tf_distilbert.py::TFDistilBertModelTest::test_loss_computation 
tests/test_modeling_tf_distilbert.py::TFDistilBertModelTest::test_model_common_attributes 
[gw20] PASSED tests/test_modeling_longformer.py::LongformerModelTest::test_resize_tokens_embeddings 
tests/test_modeling_longformer.py::LongformerModelTest::test_save_load 
[gw13] PASSED tests/test_modeling_roberta.py::RobertaModelTest::test_roberta_model 
tests/test_modeling_roberta.py::RobertaModelTest::test_save_load 
[gw18] PASSED tests/test_modeling_tf_openai_gpt.py::TFOpenAIGPTModelTest::test_inputs_embeds 
tests/test_modeling_tf_openai_gpt.py::TFOpenAIGPTModelTest::test_keras_save_load 
[gw5] PASSED tests/test_modeling_tf_gpt2.py::TFGPT2ModelTest::test_save_load 
tests/test_modeling_tf_gpt2.py::TFGPT2ModelLanguageGenerationTest::test_lm_generate_distilgpt2 
[gw5] SKIPPED tests/test_modeling_tf_gpt2.py::TFGPT2ModelLanguageGenerationTest::test_lm_generate_distilgpt2 
tests/test_modeling_tf_gpt2.py::TFGPT2ModelLanguageGenerationTest::test_lm_generate_gpt2 
[gw5] SKIPPED tests/test_modeling_tf_gpt2.py::TFGPT2ModelLanguageGenerationTest::test_lm_generate_gpt2 
tests/test_modeling_tf_xlm.py::TFXLMModelTest::test_attention_outputs 
[gw7] PASSED tests/test_modeling_tf_roberta.py::TFRobertaModelTest::test_attention_outputs 
tests/test_modeling_tf_roberta.py::TFRobertaModelTest::test_compile_tf_model 
[gw9] PASSED tests/test_modeling_tf_distilbert.py::TFDistilBertModelTest::test_model_common_attributes 
tests/test_modeling_tf_distilbert.py::TFDistilBertModelTest::test_pt_tf_model_equivalence 
[gw8] PASSED tests/test_modeling_albert.py::AlbertModelTest::test_headmasking 
tests/test_modeling_albert.py::AlbertModelTest::test_hidden_states_output 
[gw16] PASSED tests/test_modeling_electra.py::ElectraModelTest::test_save_load 
tests/test_modeling_electra.py::ElectraModelTest::test_tie_model_weights 
[gw16] PASSED tests/test_modeling_electra.py::ElectraModelTest::test_tie_model_weights 
tests/test_modeling_electra.py::ElectraModelTest::test_torchscript 
[gw4] PASSED tests/test_modeling_tf_electra.py::TFElectraModelTest::test_resize_token_embeddings 
tests/test_modeling_tf_electra.py::TFElectraModelTest::test_save_load 
[gw0] PASSED tests/test_modeling_reformer.py::ReformerLocalAttnModelTest::test_lm_head_model_random_beam_search_generate 
tests/test_modeling_reformer.py::ReformerLocalAttnModelTest::test_lm_head_model_random_no_beam_search_generate 
[gw12] PASSED tests/test_modeling_t5.py::T5ModelTest::test_t5_model 
tests/test_modeling_t5.py::T5ModelTest::test_t5_model_fp16_forward 
[gw12] SKIPPED tests/test_modeling_t5.py::T5ModelTest::test_t5_model_fp16_forward 
tests/test_modeling_t5.py::T5ModelTest::test_tie_model_weights 
[gw12] PASSED tests/test_modeling_t5.py::T5ModelTest::test_tie_model_weights 
tests/test_modeling_t5.py::T5ModelTest::test_torchscript_output_attentions 
[gw12] PASSED tests/test_modeling_t5.py::T5ModelTest::test_torchscript_output_attentions 
tests/test_modeling_t5.py::T5ModelTest::test_torchscript_output_hidden_state 
[gw12] PASSED tests/test_modeling_t5.py::T5ModelTest::test_torchscript_output_hidden_state 
tests/test_modeling_t5.py::T5ModelTest::test_with_lm_head 
[gw3] PASSED tests/test_modeling_tf_t5.py::TFT5ModelTest::test_attention_outputs 
tests/test_modeling_tf_t5.py::TFT5ModelTest::test_compile_tf_model 
[gw12] PASSED tests/test_modeling_t5.py::T5ModelTest::test_with_lm_head 
tests/test_modeling_t5.py::T5ModelIntegrationTests::test_summarization 
[gw12] SKIPPED tests/test_modeling_t5.py::T5ModelIntegrationTests::test_summarization 
tests/test_modeling_t5.py::T5ModelIntegrationTests::test_translation_en_to_de 
[gw12] SKIPPED tests/test_modeling_t5.py::T5ModelIntegrationTests::test_translation_en_to_de 
tests/test_modeling_t5.py::T5ModelIntegrationTests::test_translation_en_to_fr 
[gw12] SKIPPED tests/test_modeling_t5.py::T5ModelIntegrationTests::test_translation_en_to_fr 
tests/test_modeling_t5.py::T5ModelIntegrationTests::test_translation_en_to_ro 
[gw12] SKIPPED tests/test_modeling_t5.py::T5ModelIntegrationTests::test_translation_en_to_ro 
tests/test_modeling_tf_xlm_roberta.py::TFFlaubertModelIntegrationTest::test_output_embeds_base_model 
[gw12] SKIPPED tests/test_modeling_tf_xlm_roberta.py::TFFlaubertModelIntegrationTest::test_output_embeds_base_model 
tests/test_modeling_tf_xlnet.py::TFXLNetModelTest::test_attention_outputs 
[gw6] PASSED tests/test_modeling_tf_bert.py::TFBertModelTest::test_hidden_states_output 
tests/test_modeling_tf_bert.py::TFBertModelTest::test_initialization 
[gw6] PASSED tests/test_modeling_tf_bert.py::TFBertModelTest::test_initialization 
tests/test_modeling_tf_bert.py::TFBertModelTest::test_inputs_embeds 
[gw15] PASSED tests/test_modeling_distilbert.py::DistilBertModelTest::test_save_load 
tests/test_modeling_distilbert.py::DistilBertModelTest::test_tie_model_weights 
[gw15] PASSED tests/test_modeling_distilbert.py::DistilBertModelTest::test_tie_model_weights 
tests/test_modeling_distilbert.py::DistilBertModelTest::test_torchscript_output_attentions 
[gw17] PASSED tests/test_modeling_flaubert.py::FlaubertModelTest::test_resize_tokens_embeddings 
tests/test_modeling_flaubert.py::FlaubertModelTest::test_save_load 
[gw10] PASSED tests/test_modeling_bart.py::BartHeadTests::test_generate_fp16 
tests/test_modeling_bart.py::BartHeadTests::test_lm_forward 
[gw18] PASSED tests/test_modeling_tf_openai_gpt.py::TFOpenAIGPTModelTest::test_keras_save_load 
tests/test_modeling_tf_openai_gpt.py::TFOpenAIGPTModelTest::test_keyword_and_dict_args 
[gw13] PASSED tests/test_modeling_roberta.py::RobertaModelTest::test_save_load 
tests/test_modeling_roberta.py::RobertaModelTest::test_tie_model_weights 
[gw13] PASSED tests/test_modeling_roberta.py::RobertaModelTest::test_tie_model_weights 
tests/test_modeling_roberta.py::RobertaModelTest::test_torchscript 
[gw10] PASSED tests/test_modeling_bart.py::BartHeadTests::test_lm_forward 
tests/test_modeling_bart.py::BartHeadTests::test_lm_uneven_forward 
[gw10] PASSED tests/test_modeling_bart.py::BartHeadTests::test_lm_uneven_forward 
tests/test_modeling_bart.py::BartHeadTests::test_prepare_bart_decoder_inputs 
[gw10] PASSED tests/test_modeling_bart.py::BartHeadTests::test_prepare_bart_decoder_inputs 
tests/test_modeling_bart.py::BartHeadTests::test_question_answering_forward 
[gw11] PASSED tests/test_modeling_bert.py::BertModelTest::test_hidden_states_output 
tests/test_modeling_bert.py::BertModelTest::test_initialization 
[gw4] PASSED tests/test_modeling_tf_electra.py::TFElectraModelTest::test_save_load 
tests/test_modeling_tf_transfo_xl.py::TFTransfoXLModelTest::test_attention_outputs 
[gw11] PASSED tests/test_modeling_bert.py::BertModelTest::test_initialization 
tests/test_modeling_bert.py::BertModelTest::test_inputs_embeds 
[gw10] PASSED tests/test_modeling_bart.py::BartHeadTests::test_question_answering_forward 
tests/test_modeling_bart.py::BartHeadTests::test_resize_tokens_embeddings_more 
[gw10] PASSED tests/test_modeling_bart.py::BartHeadTests::test_resize_tokens_embeddings_more 
tests/test_modeling_bart.py::BartHeadTests::test_sequence_classification_forward 
[gw18] PASSED tests/test_modeling_tf_openai_gpt.py::TFOpenAIGPTModelTest::test_keyword_and_dict_args 
tests/test_modeling_tf_openai_gpt.py::TFOpenAIGPTModelTest::test_lm_head_model_random_beam_search_generate 
[gw6] PASSED tests/test_modeling_tf_bert.py::TFBertModelTest::test_inputs_embeds 
tests/test_modeling_tf_bert.py::TFBertModelTest::test_keras_save_load 
[gw21] PASSED tests/test_modeling_marian.py::TestMarian_en_ROMANCE::test_pipeline 
[gw10] PASSED tests/test_modeling_bart.py::BartHeadTests::test_sequence_classification_forward 
tests/test_modeling_bart.py::BartHeadTests::test_shift_tokens_right 
[gw10] PASSED tests/test_modeling_bart.py::BartHeadTests::test_shift_tokens_right 
tests/test_modeling_bart.py::BartHeadTests::test_tokenization 
tests/test_modeling_marian.py::TestMarian_en_ROMANCE::test_tokenizer_handles_empty 
[gw21] PASSED tests/test_modeling_marian.py::TestMarian_en_ROMANCE::test_tokenizer_handles_empty 
[gw10] SKIPPED tests/test_modeling_bart.py::BartHeadTests::test_tokenization 
tests/test_modeling_marian.py::TestConversionUtils::test_renaming_multilingual 
tests/test_modeling_bart.py::BartModelIntegrationTests::test_bart_base_mask_filling 
[gw10] SKIPPED tests/test_modeling_bart.py::BartModelIntegrationTests::test_bart_base_mask_filling 
[gw21] PASSED tests/test_modeling_marian.py::TestConversionUtils::test_renaming_multilingual 
tests/test_modeling_marian.py::TestConversionUtils::test_undoing_renaming 
[gw21] PASSED tests/test_modeling_marian.py::TestConversionUtils::test_undoing_renaming 
tests/test_modeling_xlm.py::XLMModelTest::test_attention_outputs 
tests/test_modeling_bart.py::BartModelIntegrationTests::test_bart_large_mask_filling 
[gw10] SKIPPED tests/test_modeling_bart.py::BartModelIntegrationTests::test_bart_large_mask_filling 
tests/test_modeling_bart.py::BartModelIntegrationTests::test_cnn_summarization_same_as_fairseq 
[gw10] SKIPPED tests/test_modeling_bart.py::BartModelIntegrationTests::test_cnn_summarization_same_as_fairseq 
tests/test_modeling_bart.py::BartModelIntegrationTests::test_inference_no_head 
[gw10] SKIPPED tests/test_modeling_bart.py::BartModelIntegrationTests::test_inference_no_head 
tests/test_modeling_bart.py::BartModelIntegrationTests::test_mnli_inference 
[gw10] SKIPPED tests/test_modeling_bart.py::BartModelIntegrationTests::test_mnli_inference 
tests/test_modeling_bart.py::BartModelIntegrationTests::test_xsum_config_generation_params 
[gw1] PASSED tests/test_benchmark.py::BenchmarkTest::test_trace_memory 
tests/test_benchmark.py::BenchmarkTest::test_train_encoder_decoder_with_configs 
[gw10] PASSED tests/test_modeling_bart.py::BartModelIntegrationTests::test_xsum_config_generation_params 
tests/test_modeling_bart.py::BartModelIntegrationTests::test_xsum_summarization_same_as_fairseq 
[gw10] SKIPPED tests/test_modeling_bart.py::BartModelIntegrationTests::test_xsum_summarization_same_as_fairseq 
tests/test_modeling_bart.py::TestSinusoidalPositionalEmbeddings::test_odd_embed_dim 
[gw10] PASSED tests/test_modeling_bart.py::TestSinusoidalPositionalEmbeddings::test_odd_embed_dim 
tests/test_modeling_bart.py::TestSinusoidalPositionalEmbeddings::test_positional_emb_cache_logic 
[gw10] PASSED tests/test_modeling_bart.py::TestSinusoidalPositionalEmbeddings::test_positional_emb_cache_logic 
tests/test_modeling_bart.py::TestSinusoidalPositionalEmbeddings::test_positional_emb_weights_against_marian 
[gw4] PASSED tests/test_modeling_tf_transfo_xl.py::TFTransfoXLModelTest::test_attention_outputs 
[gw5] PASSED tests/test_modeling_tf_xlm.py::TFXLMModelTest::test_attention_outputs 
tests/test_modeling_tf_xlm.py::TFXLMModelTest::test_compile_tf_model 
tests/test_modeling_tf_transfo_xl.py::TFTransfoXLModelTest::test_compile_tf_model 
[gw20] PASSED tests/test_modeling_longformer.py::LongformerModelTest::test_save_load 
tests/test_modeling_longformer.py::LongformerModelTest::test_tie_model_weights 
[gw20] PASSED tests/test_modeling_longformer.py::LongformerModelTest::test_tie_model_weights 
tests/test_modeling_longformer.py::LongformerModelTest::test_torchscript_output_attentions 
[gw20] PASSED tests/test_modeling_longformer.py::LongformerModelTest::test_torchscript_output_attentions 
tests/test_modeling_longformer.py::LongformerModelTest::test_torchscript_output_hidden_state 
[gw20] PASSED tests/test_modeling_longformer.py::LongformerModelTest::test_torchscript_output_hidden_state 
tests/test_modeling_longformer.py::LongformerModelIntegrationTest::test_inference_masked_lm_long 
[gw20] SKIPPED tests/test_modeling_longformer.py::LongformerModelIntegrationTest::test_inference_masked_lm_long 
tests/test_modeling_longformer.py::LongformerModelIntegrationTest::test_inference_no_head 
[gw20] SKIPPED tests/test_modeling_longformer.py::LongformerModelIntegrationTest::test_inference_no_head 
tests/test_modeling_longformer.py::LongformerModelIntegrationTest::test_inference_no_head_long 
[gw20] SKIPPED tests/test_modeling_longformer.py::LongformerModelIntegrationTest::test_inference_no_head_long 
tests/test_modeling_xlnet.py::XLNetModelTest::test_attention_outputs 
[gw10] PASSED tests/test_modeling_bart.py::TestSinusoidalPositionalEmbeddings::test_positional_emb_weights_against_marian 
tests/test_modeling_xlm_roberta.py::XLMRobertaModelIntegrationTest::test_xlm_roberta_base 
[gw10] SKIPPED tests/test_modeling_xlm_roberta.py::XLMRobertaModelIntegrationTest::test_xlm_roberta_base 
tests/test_modeling_xlm_roberta.py::XLMRobertaModelIntegrationTest::test_xlm_roberta_large 
[gw10] SKIPPED tests/test_modeling_xlm_roberta.py::XLMRobertaModelIntegrationTest::test_xlm_roberta_large 
tests/test_onnx.py::OnnxExportTestCase::test_ensure_valid_input 
[gw10] PASSED tests/test_onnx.py::OnnxExportTestCase::test_ensure_valid_input 
tests/test_onnx.py::OnnxExportTestCase::test_export_custom_bert_model 
[gw10] SKIPPED tests/test_onnx.py::OnnxExportTestCase::test_export_custom_bert_model 
tests/test_onnx.py::OnnxExportTestCase::test_export_pytorch 
[gw10] SKIPPED tests/test_onnx.py::OnnxExportTestCase::test_export_pytorch 
tests/test_onnx.py::OnnxExportTestCase::test_export_tensorflow 
[gw10] SKIPPED tests/test_onnx.py::OnnxExportTestCase::test_export_tensorflow 
tests/test_onnx.py::OnnxExportTestCase::test_infer_dynamic_axis_pytorch 
[gw8] PASSED tests/test_modeling_albert.py::AlbertModelTest::test_hidden_states_output 
tests/test_modeling_albert.py::AlbertModelTest::test_initialization 
[gw8] PASSED tests/test_modeling_albert.py::AlbertModelTest::test_initialization 
tests/test_modeling_albert.py::AlbertModelTest::test_inputs_embeds 
[gw12] PASSED tests/test_modeling_tf_xlnet.py::TFXLNetModelTest::test_attention_outputs 
tests/test_modeling_tf_xlnet.py::TFXLNetModelTest::test_compile_tf_model 
[gw11] PASSED tests/test_modeling_bert.py::BertModelTest::test_inputs_embeds 
tests/test_modeling_bert.py::BertModelTest::test_lm_head_model_random_beam_search_generate 
[gw11] PASSED tests/test_modeling_bert.py::BertModelTest::test_lm_head_model_random_beam_search_generate 
tests/test_modeling_bert.py::BertModelTest::test_lm_head_model_random_no_beam_search_generate 
[gw11] PASSED tests/test_modeling_bert.py::BertModelTest::test_lm_head_model_random_no_beam_search_generate 
tests/test_modeling_bert.py::BertModelTest::test_model_common_attributes 
[gw11] PASSED tests/test_modeling_bert.py::BertModelTest::test_model_common_attributes 
tests/test_modeling_bert.py::BertModelTest::test_model_from_pretrained 
[gw11] SKIPPED tests/test_modeling_bert.py::BertModelTest::test_model_from_pretrained 
tests/test_modeling_bert.py::BertModelTest::test_multigpu_data_parallel_forward 
[gw11] SKIPPED tests/test_modeling_bert.py::BertModelTest::test_multigpu_data_parallel_forward 
tests/test_modeling_bert.py::BertModelTest::test_resize_tokens_embeddings 
[gw17] PASSED tests/test_modeling_flaubert.py::FlaubertModelTest::test_save_load 
tests/test_modeling_flaubert.py::FlaubertModelTest::test_tie_model_weights 
[gw17] PASSED tests/test_modeling_flaubert.py::FlaubertModelTest::test_tie_model_weights 
tests/test_modeling_flaubert.py::FlaubertModelTest::test_torchscript 
[gw22] PASSED tests/test_modeling_mobilebert.py::MobileBertModelTest::test_determinism 
tests/test_modeling_mobilebert.py::MobileBertModelTest::test_for_masked_lm 
[gw6] PASSED tests/test_modeling_tf_bert.py::TFBertModelTest::test_keras_save_load 
tests/test_modeling_tf_bert.py::TFBertModelTest::test_keyword_and_dict_args 
[gw22] PASSED tests/test_modeling_mobilebert.py::MobileBertModelTest::test_for_masked_lm 
tests/test_modeling_mobilebert.py::MobileBertModelTest::test_for_multiple_choice 
[gw8] PASSED tests/test_modeling_albert.py::AlbertModelTest::test_inputs_embeds 
tests/test_modeling_albert.py::AlbertModelTest::test_lm_head_model_random_beam_search_generate 
[gw8] PASSED tests/test_modeling_albert.py::AlbertModelTest::test_lm_head_model_random_beam_search_generate 
tests/test_modeling_albert.py::AlbertModelTest::test_lm_head_model_random_no_beam_search_generate 
[gw8] PASSED tests/test_modeling_albert.py::AlbertModelTest::test_lm_head_model_random_no_beam_search_generate 
tests/test_modeling_albert.py::AlbertModelTest::test_model_common_attributes 
[gw8] PASSED tests/test_modeling_albert.py::AlbertModelTest::test_model_common_attributes 
tests/test_modeling_albert.py::AlbertModelTest::test_model_from_pretrained 
[gw8] SKIPPED tests/test_modeling_albert.py::AlbertModelTest::test_model_from_pretrained 
tests/test_modeling_albert.py::AlbertModelTest::test_multigpu_data_parallel_forward 
[gw8] SKIPPED tests/test_modeling_albert.py::AlbertModelTest::test_multigpu_data_parallel_forward 
tests/test_modeling_albert.py::AlbertModelTest::test_resize_tokens_embeddings 
[gw9] PASSED tests/test_modeling_tf_distilbert.py::TFDistilBertModelTest::test_pt_tf_model_equivalence 
tests/test_modeling_tf_distilbert.py::TFDistilBertModelTest::test_resize_token_embeddings 
[gw14] PASSED tests/test_modeling_ctrl.py::CTRLModelTest::test_lm_head_model_random_beam_search_generate 
tests/test_modeling_ctrl.py::CTRLModelTest::test_lm_head_model_random_no_beam_search_generate 
[gw21] PASSED tests/test_modeling_xlm.py::XLMModelTest::test_attention_outputs 
tests/test_modeling_xlm.py::XLMModelTest::test_config 
[gw21] PASSED tests/test_modeling_xlm.py::XLMModelTest::test_config 
tests/test_modeling_xlm.py::XLMModelTest::test_correct_missing_keys 
[gw21] PASSED tests/test_modeling_xlm.py::XLMModelTest::test_correct_missing_keys 
tests/test_modeling_xlm.py::XLMModelTest::test_determinism 
[gw18] PASSED tests/test_modeling_tf_openai_gpt.py::TFOpenAIGPTModelTest::test_lm_head_model_random_beam_search_generate 
tests/test_modeling_tf_openai_gpt.py::TFOpenAIGPTModelTest::test_lm_head_model_random_no_beam_search_generate 
[gw10] PASSED tests/test_onnx.py::OnnxExportTestCase::test_infer_dynamic_axis_pytorch 
tests/test_onnx.py::OnnxExportTestCase::test_infer_dynamic_axis_tf 
[gw22] PASSED tests/test_modeling_mobilebert.py::MobileBertModelTest::test_for_multiple_choice 
tests/test_modeling_mobilebert.py::MobileBertModelTest::test_for_next_sequence_prediction 
[gw6] PASSED tests/test_modeling_tf_bert.py::TFBertModelTest::test_keyword_and_dict_args 
tests/test_modeling_tf_bert.py::TFBertModelTest::test_lm_head_model_random_beam_search_generate 
[gw6] PASSED tests/test_modeling_tf_bert.py::TFBertModelTest::test_lm_head_model_random_beam_search_generate 
tests/test_modeling_tf_bert.py::TFBertModelTest::test_lm_head_model_random_no_beam_search_generate 
[gw6] PASSED tests/test_modeling_tf_bert.py::TFBertModelTest::test_lm_head_model_random_no_beam_search_generate 
tests/test_modeling_tf_bert.py::TFBertModelTest::test_loss_computation 
[gw9] PASSED tests/test_modeling_tf_distilbert.py::TFDistilBertModelTest::test_resize_token_embeddings 
tests/test_modeling_tf_distilbert.py::TFDistilBertModelTest::test_save_load 
[gw22] PASSED tests/test_modeling_mobilebert.py::MobileBertModelTest::test_for_next_sequence_prediction 
tests/test_modeling_mobilebert.py::MobileBertModelTest::test_for_pretraining 
[gw16] PASSED tests/test_modeling_electra.py::ElectraModelTest::test_torchscript 
tests/test_modeling_electra.py::ElectraModelTest::test_torchscript_output_attentions 
[gw19] PASSED tests/test_modeling_gpt2.py::GPT2ModelTest::test_lm_head_model_random_beam_search_generate 
tests/test_modeling_gpt2.py::GPT2ModelTest::test_lm_head_model_random_no_beam_search_generate 
[gw10] PASSED tests/test_onnx.py::OnnxExportTestCase::test_infer_dynamic_axis_tf 
tests/test_optimization.py::OptimizationTest::test_adam_w 
[gw10] PASSED tests/test_optimization.py::OptimizationTest::test_adam_w 
tests/test_optimization.py::ScheduleInitTest::test_constant_scheduler 
[gw10] PASSED tests/test_optimization.py::ScheduleInitTest::test_constant_scheduler 
tests/test_optimization.py::ScheduleInitTest::test_warmup_constant_scheduler 
[gw10] PASSED tests/test_optimization.py::ScheduleInitTest::test_warmup_constant_scheduler 
tests/test_optimization.py::ScheduleInitTest::test_warmup_cosine_hard_restart_scheduler 
[gw10] PASSED tests/test_optimization.py::ScheduleInitTest::test_warmup_cosine_hard_restart_scheduler 
tests/test_optimization.py::ScheduleInitTest::test_warmup_cosine_scheduler 
[gw10] PASSED tests/test_optimization.py::ScheduleInitTest::test_warmup_cosine_scheduler 
tests/test_optimization.py::ScheduleInitTest::test_warmup_linear_scheduler 
[gw10] PASSED tests/test_optimization.py::ScheduleInitTest::test_warmup_linear_scheduler 
tests/test_tokenization_albert.py::AlbertTokenizationTest::test_add_special_tokens 
[gw0] PASSED tests/test_modeling_reformer.py::ReformerLocalAttnModelTest::test_lm_head_model_random_no_beam_search_generate 
tests/test_modeling_reformer.py::ReformerLocalAttnModelTest::test_model_common_attributes 
[gw0] PASSED tests/test_modeling_reformer.py::ReformerLocalAttnModelTest::test_model_common_attributes 
tests/test_modeling_reformer.py::ReformerLocalAttnModelTest::test_model_from_pretrained 
[gw0] SKIPPED tests/test_modeling_reformer.py::ReformerLocalAttnModelTest::test_model_from_pretrained 
tests/test_modeling_reformer.py::ReformerLocalAttnModelTest::test_multigpu_data_parallel_forward 
[gw0] SKIPPED tests/test_modeling_reformer.py::ReformerLocalAttnModelTest::test_multigpu_data_parallel_forward 
tests/test_modeling_reformer.py::ReformerLocalAttnModelTest::test_reformer_chunking_backward_equality 
[gw22] PASSED tests/test_modeling_mobilebert.py::MobileBertModelTest::test_for_pretraining 
tests/test_modeling_mobilebert.py::MobileBertModelTest::test_for_question_answering 
[gw6] PASSED tests/test_modeling_tf_bert.py::TFBertModelTest::test_loss_computation 
tests/test_modeling_tf_bert.py::TFBertModelTest::test_model_common_attributes 
[gw18] PASSED tests/test_modeling_tf_openai_gpt.py::TFOpenAIGPTModelTest::test_lm_head_model_random_no_beam_search_generate 
tests/test_modeling_tf_openai_gpt.py::TFOpenAIGPTModelTest::test_loss_computation 
[gw7] PASSED tests/test_modeling_tf_roberta.py::TFRobertaModelTest::test_compile_tf_model 
[gw18] PASSED tests/test_modeling_tf_openai_gpt.py::TFOpenAIGPTModelTest::test_loss_computation 
tests/test_modeling_tf_openai_gpt.py::TFOpenAIGPTModelTest::test_model_common_attributes 
tests/test_modeling_tf_roberta.py::TFRobertaModelTest::test_config 
[gw7] PASSED tests/test_modeling_tf_roberta.py::TFRobertaModelTest::test_config 
tests/test_modeling_tf_roberta.py::TFRobertaModelTest::test_determinism 
[gw22] PASSED tests/test_modeling_mobilebert.py::MobileBertModelTest::test_for_question_answering 
tests/test_modeling_mobilebert.py::MobileBertModelTest::test_for_sequence_classification 
[gw18] PASSED tests/test_modeling_tf_openai_gpt.py::TFOpenAIGPTModelTest::test_model_common_attributes 
tests/test_modeling_tf_openai_gpt.py::TFOpenAIGPTModelTest::test_model_from_pretrained 
[gw18] SKIPPED tests/test_modeling_tf_openai_gpt.py::TFOpenAIGPTModelTest::test_model_from_pretrained 
tests/test_modeling_tf_openai_gpt.py::TFOpenAIGPTModelTest::test_openai_gpt_double_head 
[gw11] PASSED tests/test_modeling_bert.py::BertModelTest::test_resize_tokens_embeddings 
tests/test_modeling_bert.py::BertModelTest::test_save_load 
[gw21] PASSED tests/test_modeling_xlm.py::XLMModelTest::test_determinism 
tests/test_modeling_xlm.py::XLMModelTest::test_head_pruning 
[gw18] PASSED tests/test_modeling_tf_openai_gpt.py::TFOpenAIGPTModelTest::test_openai_gpt_double_head 
tests/test_modeling_tf_openai_gpt.py::TFOpenAIGPTModelTest::test_openai_gpt_lm_head 
[gw6] PASSED tests/test_modeling_tf_bert.py::TFBertModelTest::test_model_common_attributes 
tests/test_modeling_tf_bert.py::TFBertModelTest::test_model_from_pretrained 
[gw6] SKIPPED tests/test_modeling_tf_bert.py::TFBertModelTest::test_model_from_pretrained 
tests/test_modeling_tf_bert.py::TFBertModelTest::test_pt_tf_model_equivalence 
[gw18] PASSED tests/test_modeling_tf_openai_gpt.py::TFOpenAIGPTModelTest::test_openai_gpt_lm_head 
tests/test_modeling_tf_openai_gpt.py::TFOpenAIGPTModelTest::test_openai_gpt_model 
[gw15] PASSED tests/test_modeling_distilbert.py::DistilBertModelTest::test_torchscript_output_attentions 
tests/test_modeling_distilbert.py::DistilBertModelTest::test_torchscript_output_hidden_state 
[gw22] PASSED tests/test_modeling_mobilebert.py::MobileBertModelTest::test_for_sequence_classification 
tests/test_modeling_mobilebert.py::MobileBertModelTest::test_for_token_classification 
[gw18] PASSED tests/test_modeling_tf_openai_gpt.py::TFOpenAIGPTModelTest::test_openai_gpt_model 
tests/test_modeling_tf_openai_gpt.py::TFOpenAIGPTModelTest::test_pt_tf_model_equivalence 
[gw4] PASSED tests/test_modeling_tf_transfo_xl.py::TFTransfoXLModelTest::test_compile_tf_model 
tests/test_modeling_tf_transfo_xl.py::TFTransfoXLModelTest::test_config 
[gw4] PASSED tests/test_modeling_tf_transfo_xl.py::TFTransfoXLModelTest::test_config 
tests/test_modeling_tf_transfo_xl.py::TFTransfoXLModelTest::test_determinism 
[gw7] PASSED tests/test_modeling_tf_roberta.py::TFRobertaModelTest::test_determinism 
tests/test_modeling_tf_roberta.py::TFRobertaModelTest::test_for_masked_lm 
[gw10] PASSED tests/test_tokenization_albert.py::AlbertTokenizationTest::test_add_special_tokens 
tests/test_tokenization_albert.py::AlbertTokenizationTest::test_add_tokens_tokenizer 
[gw10] PASSED tests/test_tokenization_albert.py::AlbertTokenizationTest::test_add_tokens_tokenizer 
tests/test_tokenization_albert.py::AlbertTokenizationTest::test_added_tokens_do_lower_case 
[gw22] PASSED tests/test_modeling_mobilebert.py::MobileBertModelTest::test_for_token_classification 
tests/test_modeling_mobilebert.py::MobileBertModelTest::test_head_pruning 
[gw21] PASSED tests/test_modeling_xlm.py::XLMModelTest::test_head_pruning 
tests/test_modeling_xlm.py::XLMModelTest::test_head_pruning_integration 
[gw9] PASSED tests/test_modeling_tf_distilbert.py::TFDistilBertModelTest::test_save_load 
tests/test_optimization_tf.py::OptimizationFTest::testGradientAccumulator 
[gw9] PASSED tests/test_optimization_tf.py::OptimizationFTest::testGradientAccumulator 
tests/test_optimization_tf.py::OptimizationFTest::testGradientAccumulatorDistributionStrategy 
[gw7] PASSED tests/test_modeling_tf_roberta.py::TFRobertaModelTest::test_for_masked_lm 
tests/test_modeling_tf_roberta.py::TFRobertaModelTest::test_for_multiple_choice 
[gw10] PASSED tests/test_tokenization_albert.py::AlbertTokenizationTest::test_added_tokens_do_lower_case 
tests/test_tokenization_albert.py::AlbertTokenizationTest::test_batch_encode_plus_batch_sequence_length 
[gw4] PASSED tests/test_modeling_tf_transfo_xl.py::TFTransfoXLModelTest::test_determinism 
tests/test_modeling_tf_transfo_xl.py::TFTransfoXLModelTest::test_hidden_states_output 
[gw8] PASSED tests/test_modeling_albert.py::AlbertModelTest::test_resize_tokens_embeddings 
tests/test_modeling_albert.py::AlbertModelTest::test_save_load 
[gw10] PASSED tests/test_tokenization_albert.py::AlbertTokenizationTest::test_batch_encode_plus_batch_sequence_length 
tests/test_tokenization_albert.py::AlbertTokenizationTest::test_batch_encode_plus_padding 
[gw7] PASSED tests/test_modeling_tf_roberta.py::TFRobertaModelTest::test_for_multiple_choice 
tests/test_modeling_tf_roberta.py::TFRobertaModelTest::test_for_question_answering 
[gw10] PASSED tests/test_tokenization_albert.py::AlbertTokenizationTest::test_batch_encode_plus_padding 
tests/test_tokenization_albert.py::AlbertTokenizationTest::test_batch_encode_plus_tensors 
[gw10] PASSED tests/test_tokenization_albert.py::AlbertTokenizationTest::test_batch_encode_plus_tensors 
tests/test_tokenization_albert.py::AlbertTokenizationTest::test_call 
[gw10] PASSED tests/test_tokenization_albert.py::AlbertTokenizationTest::test_call 
tests/test_tokenization_albert.py::AlbertTokenizationTest::test_conversion_reversible 
[gw7] PASSED tests/test_modeling_tf_roberta.py::TFRobertaModelTest::test_for_question_answering 
tests/test_modeling_tf_roberta.py::TFRobertaModelTest::test_for_token_classification 
[gw13] PASSED tests/test_modeling_roberta.py::RobertaModelTest::test_torchscript 
tests/test_modeling_roberta.py::RobertaModelTest::test_torchscript_output_attentions 
[gw7] PASSED tests/test_modeling_tf_roberta.py::TFRobertaModelTest::test_for_token_classification 
tests/test_modeling_tf_roberta.py::TFRobertaModelTest::test_hidden_states_output 
[gw10] PASSED tests/test_tokenization_albert.py::AlbertTokenizationTest::test_conversion_reversible 
tests/test_tokenization_albert.py::AlbertTokenizationTest::test_encode_decode_with_spaces 
[gw10] PASSED tests/test_tokenization_albert.py::AlbertTokenizationTest::test_encode_decode_with_spaces 
tests/test_tokenization_albert.py::AlbertTokenizationTest::test_encode_plus_with_padding 
[gw4] PASSED tests/test_modeling_tf_transfo_xl.py::TFTransfoXLModelTest::test_hidden_states_output 
tests/test_modeling_tf_transfo_xl.py::TFTransfoXLModelTest::test_initialization 
[gw4] PASSED tests/test_modeling_tf_transfo_xl.py::TFTransfoXLModelTest::test_initialization 
tests/test_modeling_tf_transfo_xl.py::TFTransfoXLModelTest::test_inputs_embeds 
[gw10] PASSED tests/test_tokenization_albert.py::AlbertTokenizationTest::test_encode_plus_with_padding 
tests/test_tokenization_albert.py::AlbertTokenizationTest::test_full_tokenizer 
[gw10] PASSED tests/test_tokenization_albert.py::AlbertTokenizationTest::test_full_tokenizer 
tests/test_tokenization_albert.py::AlbertTokenizationTest::test_get_vocab 
[gw4] PASSED tests/test_modeling_tf_transfo_xl.py::TFTransfoXLModelTest::test_inputs_embeds 
tests/test_modeling_tf_transfo_xl.py::TFTransfoXLModelTest::test_keras_save_load 
[gw20] PASSED tests/test_modeling_xlnet.py::XLNetModelTest::test_attention_outputs 
tests/test_modeling_xlnet.py::XLNetModelTest::test_config 
[gw20] PASSED tests/test_modeling_xlnet.py::XLNetModelTest::test_config 
tests/test_modeling_xlnet.py::XLNetModelTest::test_correct_missing_keys 
[gw10] PASSED tests/test_tokenization_albert.py::AlbertTokenizationTest::test_get_vocab 
tests/test_tokenization_albert.py::AlbertTokenizationTest::test_internal_consistency 
[gw20] PASSED tests/test_modeling_xlnet.py::XLNetModelTest::test_correct_missing_keys 
tests/test_modeling_xlnet.py::XLNetModelTest::test_determinism 
[gw10] PASSED tests/test_tokenization_albert.py::AlbertTokenizationTest::test_internal_consistency 
tests/test_tokenization_albert.py::AlbertTokenizationTest::test_mask_output 
[gw10] PASSED tests/test_tokenization_albert.py::AlbertTokenizationTest::test_mask_output 
tests/test_tokenization_albert.py::AlbertTokenizationTest::test_maximum_encoding_length_pair_input 
[gw19] PASSED tests/test_modeling_gpt2.py::GPT2ModelTest::test_lm_head_model_random_no_beam_search_generate 
tests/test_modeling_gpt2.py::GPT2ModelTest::test_model_common_attributes 
[gw3] PASSED tests/test_modeling_tf_t5.py::TFT5ModelTest::test_compile_tf_model 
[gw17] PASSED tests/test_modeling_flaubert.py::FlaubertModelTest::test_torchscript 
tests/test_modeling_flaubert.py::FlaubertModelTest::test_torchscript_output_attentions 
tests/test_modeling_tf_t5.py::TFT5ModelTest::test_config 
[gw3] PASSED tests/test_modeling_tf_t5.py::TFT5ModelTest::test_config 
tests/test_modeling_tf_t5.py::TFT5ModelTest::test_determinism 
[gw19] PASSED tests/test_modeling_gpt2.py::GPT2ModelTest::test_model_common_attributes 
tests/test_modeling_gpt2.py::GPT2ModelTest::test_model_from_pretrained 
[gw19] SKIPPED tests/test_modeling_gpt2.py::GPT2ModelTest::test_model_from_pretrained 
tests/test_modeling_gpt2.py::GPT2ModelTest::test_multigpu_data_parallel_forward 
[gw19] SKIPPED tests/test_modeling_gpt2.py::GPT2ModelTest::test_multigpu_data_parallel_forward 
tests/test_modeling_gpt2.py::GPT2ModelTest::test_resize_tokens_embeddings 
[gw9] PASSED tests/test_optimization_tf.py::OptimizationFTest::testGradientAccumulatorDistributionStrategy 
tests/test_tokenization_auto.py::AutoTokenizerTest::test_from_pretrained_use_fast_toggle 
[gw5] PASSED tests/test_modeling_tf_xlm.py::TFXLMModelTest::test_compile_tf_model 
[gw11] PASSED tests/test_modeling_bert.py::BertModelTest::test_save_load 
tests/test_modeling_bert.py::BertModelTest::test_tie_model_weights 
[gw11] PASSED tests/test_modeling_bert.py::BertModelTest::test_tie_model_weights 
tests/test_modeling_bert.py::BertModelTest::test_torchscript 
tests/test_modeling_tf_xlm.py::TFXLMModelTest::test_config 
[gw5] PASSED tests/test_modeling_tf_xlm.py::TFXLMModelTest::test_config 
tests/test_modeling_tf_xlm.py::TFXLMModelTest::test_determinism 
[gw9] PASSED tests/test_tokenization_auto.py::AutoTokenizerTest::test_from_pretrained_use_fast_toggle 
tests/test_tokenization_auto.py::AutoTokenizerTest::test_parents_and_children_in_mappings 
[gw9] PASSED tests/test_tokenization_auto.py::AutoTokenizerTest::test_parents_and_children_in_mappings 
tests/test_tokenization_auto.py::AutoTokenizerTest::test_tokenizer_from_model_type 
[gw7] PASSED tests/test_modeling_tf_roberta.py::TFRobertaModelTest::test_hidden_states_output 
tests/test_modeling_tf_roberta.py::TFRobertaModelTest::test_initialization 
[gw7] PASSED tests/test_modeling_tf_roberta.py::TFRobertaModelTest::test_initialization 
tests/test_modeling_tf_roberta.py::TFRobertaModelTest::test_inputs_embeds 
[gw18] PASSED tests/test_modeling_tf_openai_gpt.py::TFOpenAIGPTModelTest::test_pt_tf_model_equivalence 
tests/test_modeling_tf_openai_gpt.py::TFOpenAIGPTModelTest::test_resize_token_embeddings 
[gw9] PASSED tests/test_tokenization_auto.py::AutoTokenizerTest::test_tokenizer_from_model_type 
tests/test_tokenization_auto.py::AutoTokenizerTest::test_tokenizer_from_pretrained 
[gw3] PASSED tests/test_modeling_tf_t5.py::TFT5ModelTest::test_determinism 
tests/test_modeling_tf_t5.py::TFT5ModelTest::test_hidden_states_output 
[gw1] PASSED tests/test_benchmark.py::BenchmarkTest::test_train_encoder_decoder_with_configs 
tests/test_benchmark.py::BenchmarkTest::test_train_no_configs 
[gw18] PASSED tests/test_modeling_tf_openai_gpt.py::TFOpenAIGPTModelTest::test_resize_token_embeddings 
tests/test_modeling_tf_openai_gpt.py::TFOpenAIGPTModelTest::test_save_load 
[gw5] PASSED tests/test_modeling_tf_xlm.py::TFXLMModelTest::test_determinism 
tests/test_modeling_tf_xlm.py::TFXLMModelTest::test_for_token_classification 
[gw7] PASSED tests/test_modeling_tf_roberta.py::TFRobertaModelTest::test_inputs_embeds 
tests/test_modeling_tf_roberta.py::TFRobertaModelTest::test_keras_save_load 
[gw21] PASSED tests/test_modeling_xlm.py::XLMModelTest::test_head_pruning_integration 
tests/test_modeling_xlm.py::XLMModelTest::test_head_pruning_save_load_from_config_init 
[gw5] PASSED tests/test_modeling_tf_xlm.py::TFXLMModelTest::test_for_token_classification 
tests/test_modeling_tf_xlm.py::TFXLMModelTest::test_hidden_states_output 
[gw4] PASSED tests/test_modeling_tf_transfo_xl.py::TFTransfoXLModelTest::test_keras_save_load 
tests/test_modeling_tf_transfo_xl.py::TFTransfoXLModelTest::test_keyword_and_dict_args 
[gw10] PASSED tests/test_tokenization_albert.py::AlbertTokenizationTest::test_maximum_encoding_length_pair_input 
tests/test_tokenization_albert.py::AlbertTokenizationTest::test_maximum_encoding_length_single_input 
[gw3] PASSED tests/test_modeling_tf_t5.py::TFT5ModelTest::test_hidden_states_output 
tests/test_modeling_tf_t5.py::TFT5ModelTest::test_initialization 
[gw3] PASSED tests/test_modeling_tf_t5.py::TFT5ModelTest::test_initialization 
tests/test_modeling_tf_t5.py::TFT5ModelTest::test_inputs_embeds 
[gw4] PASSED tests/test_modeling_tf_transfo_xl.py::TFTransfoXLModelTest::test_keyword_and_dict_args 
tests/test_modeling_tf_transfo_xl.py::TFTransfoXLModelTest::test_lm_head_model_random_beam_search_generate 
[gw4] PASSED tests/test_modeling_tf_transfo_xl.py::TFTransfoXLModelTest::test_lm_head_model_random_beam_search_generate 
tests/test_modeling_tf_transfo_xl.py::TFTransfoXLModelTest::test_lm_head_model_random_no_beam_search_generate 
[gw4] PASSED tests/test_modeling_tf_transfo_xl.py::TFTransfoXLModelTest::test_lm_head_model_random_no_beam_search_generate 
tests/test_modeling_tf_transfo_xl.py::TFTransfoXLModelTest::test_loss_computation 
[gw8] PASSED tests/test_modeling_albert.py::AlbertModelTest::test_save_load 
tests/test_modeling_albert.py::AlbertModelTest::test_tie_model_weights 
[gw8] PASSED tests/test_modeling_albert.py::AlbertModelTest::test_tie_model_weights 
tests/test_modeling_albert.py::AlbertModelTest::test_torchscript 
[gw0] PASSED tests/test_modeling_reformer.py::ReformerLocalAttnModelTest::test_reformer_chunking_backward_equality 
tests/test_modeling_reformer.py::ReformerLocalAttnModelTest::test_reformer_chunking_forward_equality 
[gw4] PASSED tests/test_modeling_tf_transfo_xl.py::TFTransfoXLModelTest::test_loss_computation 
tests/test_modeling_tf_transfo_xl.py::TFTransfoXLModelTest::test_model_common_attributes 
[gw4] PASSED tests/test_modeling_tf_transfo_xl.py::TFTransfoXLModelTest::test_model_common_attributes 
tests/test_modeling_tf_transfo_xl.py::TFTransfoXLModelTest::test_model_from_pretrained 
[gw4] SKIPPED tests/test_modeling_tf_transfo_xl.py::TFTransfoXLModelTest::test_model_from_pretrained 
tests/test_modeling_tf_transfo_xl.py::TFTransfoXLModelTest::test_pt_tf_model_equivalence 
[gw18] PASSED tests/test_modeling_tf_openai_gpt.py::TFOpenAIGPTModelTest::test_save_load 
tests/test_modeling_tf_openai_gpt.py::TFOPENAIGPTModelLanguageGenerationTest::test_lm_generate_openai_gpt 
[gw18] SKIPPED tests/test_modeling_tf_openai_gpt.py::TFOPENAIGPTModelLanguageGenerationTest::test_lm_generate_openai_gpt 
tests/test_tokenization_bert_japanese.py::BertJapaneseTokenizationTest::test_add_special_tokens 
[gw18] SKIPPED tests/test_tokenization_bert_japanese.py::BertJapaneseTokenizationTest::test_add_special_tokens 
tests/test_tokenization_bert_japanese.py::BertJapaneseTokenizationTest::test_add_tokens_tokenizer 
[gw18] SKIPPED tests/test_tokenization_bert_japanese.py::BertJapaneseTokenizationTest::test_add_tokens_tokenizer 
tests/test_tokenization_bert_japanese.py::BertJapaneseTokenizationTest::test_added_tokens_do_lower_case 
[gw18] SKIPPED tests/test_tokenization_bert_japanese.py::BertJapaneseTokenizationTest::test_added_tokens_do_lower_case 
tests/test_tokenization_bert_japanese.py::BertJapaneseTokenizationTest::test_batch_encode_plus_batch_sequence_length 
[gw18] SKIPPED tests/test_tokenization_bert_japanese.py::BertJapaneseTokenizationTest::test_batch_encode_plus_batch_sequence_length 
tests/test_tokenization_bert_japanese.py::BertJapaneseTokenizationTest::test_batch_encode_plus_padding 
[gw18] SKIPPED tests/test_tokenization_bert_japanese.py::BertJapaneseTokenizationTest::test_batch_encode_plus_padding 
tests/test_tokenization_bert_japanese.py::BertJapaneseTokenizationTest::test_batch_encode_plus_tensors 
[gw18] SKIPPED tests/test_tokenization_bert_japanese.py::BertJapaneseTokenizationTest::test_batch_encode_plus_tensors 
tests/test_tokenization_bert_japanese.py::BertJapaneseTokenizationTest::test_call 
[gw18] SKIPPED tests/test_tokenization_bert_japanese.py::BertJapaneseTokenizationTest::test_call 
tests/test_tokenization_bert_japanese.py::BertJapaneseTokenizationTest::test_conversion_reversible 
[gw18] SKIPPED tests/test_tokenization_bert_japanese.py::BertJapaneseTokenizationTest::test_conversion_reversible 
tests/test_tokenization_bert_japanese.py::BertJapaneseTokenizationTest::test_encode_decode_with_spaces 
[gw18] SKIPPED tests/test_tokenization_bert_japanese.py::BertJapaneseTokenizationTest::test_encode_decode_with_spaces 
tests/test_tokenization_bert_japanese.py::BertJapaneseTokenizationTest::test_encode_plus_with_padding 
[gw18] SKIPPED tests/test_tokenization_bert_japanese.py::BertJapaneseTokenizationTest::test_encode_plus_with_padding 
tests/test_tokenization_bert_japanese.py::BertJapaneseTokenizationTest::test_full_tokenizer 
[gw18] SKIPPED tests/test_tokenization_bert_japanese.py::BertJapaneseTokenizationTest::test_full_tokenizer 
tests/test_tokenization_bert_japanese.py::BertJapaneseTokenizationTest::test_get_vocab 
[gw18] SKIPPED tests/test_tokenization_bert_japanese.py::BertJapaneseTokenizationTest::test_get_vocab 
tests/test_tokenization_bert_japanese.py::BertJapaneseTokenizationTest::test_internal_consistency 
[gw18] SKIPPED tests/test_tokenization_bert_japanese.py::BertJapaneseTokenizationTest::test_internal_consistency 
tests/test_tokenization_bert_japanese.py::BertJapaneseTokenizationTest::test_mask_output 
[gw18] SKIPPED tests/test_tokenization_bert_japanese.py::BertJapaneseTokenizationTest::test_mask_output 
tests/test_tokenization_bert_japanese.py::BertJapaneseTokenizationTest::test_maximum_encoding_length_pair_input 
[gw18] SKIPPED tests/test_tokenization_bert_japanese.py::BertJapaneseTokenizationTest::test_maximum_encoding_length_pair_input 
tests/test_tokenization_bert_japanese.py::BertJapaneseTokenizationTest::test_maximum_encoding_length_single_input 
[gw18] SKIPPED tests/test_tokenization_bert_japanese.py::BertJapaneseTokenizationTest::test_maximum_encoding_length_single_input 
tests/test_tokenization_bert_japanese.py::BertJapaneseTokenizationTest::test_mecab_tokenizer 
[gw18] SKIPPED tests/test_tokenization_bert_japanese.py::BertJapaneseTokenizationTest::test_mecab_tokenizer 
tests/test_tokenization_bert_japanese.py::BertJapaneseTokenizationTest::test_mecab_tokenizer_lower 
[gw18] SKIPPED tests/test_tokenization_bert_japanese.py::BertJapaneseTokenizationTest::test_mecab_tokenizer_lower 
tests/test_tokenization_bert_japanese.py::BertJapaneseTokenizationTest::test_mecab_tokenizer_no_normalize 
[gw18] SKIPPED tests/test_tokenization_bert_japanese.py::BertJapaneseTokenizationTest::test_mecab_tokenizer_no_normalize 
tests/test_tokenization_bert_japanese.py::BertJapaneseTokenizationTest::test_mecab_tokenizer_with_option 
[gw18] SKIPPED tests/test_tokenization_bert_japanese.py::BertJapaneseTokenizationTest::test_mecab_tokenizer_with_option 
tests/test_tokenization_bert_japanese.py::BertJapaneseTokenizationTest::test_np_encode_plus_sent_to_model 
[gw18] SKIPPED tests/test_tokenization_bert_japanese.py::BertJapaneseTokenizationTest::test_np_encode_plus_sent_to_model 
tests/test_tokenization_bert_japanese.py::BertJapaneseTokenizationTest::test_number_of_added_tokens 
[gw18] SKIPPED tests/test_tokenization_bert_japanese.py::BertJapaneseTokenizationTest::test_number_of_added_tokens 
tests/test_tokenization_bert_japanese.py::BertJapaneseTokenizationTest::test_padding_to_max_length 
[gw18] SKIPPED tests/test_tokenization_bert_japanese.py::BertJapaneseTokenizationTest::test_padding_to_max_length 
tests/test_tokenization_bert_japanese.py::BertJapaneseTokenizationTest::test_padding_to_multiple_of 
[gw18] SKIPPED tests/test_tokenization_bert_japanese.py::BertJapaneseTokenizationTest::test_padding_to_multiple_of 
tests/test_tokenization_bert_japanese.py::BertJapaneseTokenizationTest::test_pickle_tokenizer 
[gw18] SKIPPED tests/test_tokenization_bert_japanese.py::BertJapaneseTokenizationTest::test_pickle_tokenizer 
tests/test_tokenization_bert_japanese.py::BertJapaneseTokenizationTest::test_pretokenized_inputs 
[gw18] SKIPPED tests/test_tokenization_bert_japanese.py::BertJapaneseTokenizationTest::test_pretokenized_inputs 
tests/test_tokenization_bert_japanese.py::BertJapaneseTokenizationTest::test_pretrained_model_lists 
[gw18] SKIPPED tests/test_tokenization_bert_japanese.py::BertJapaneseTokenizationTest::test_pretrained_model_lists 
tests/test_tokenization_bert_japanese.py::BertJapaneseTokenizationTest::test_right_and_left_padding 
[gw18] SKIPPED tests/test_tokenization_bert_japanese.py::BertJapaneseTokenizationTest::test_right_and_left_padding 
tests/test_tokenization_bert_japanese.py::BertJapaneseTokenizationTest::test_save_and_load_tokenizer 
[gw18] SKIPPED tests/test_tokenization_bert_japanese.py::BertJapaneseTokenizationTest::test_save_and_load_tokenizer 
tests/test_tokenization_bert_japanese.py::BertJapaneseTokenizationTest::test_separate_tokenizers 
[gw18] SKIPPED tests/test_tokenization_bert_japanese.py::BertJapaneseTokenizationTest::test_separate_tokenizers 
tests/test_tokenization_bert_japanese.py::BertJapaneseTokenizationTest::test_sequence_builders 
[gw18] SKIPPED tests/test_tokenization_bert_japanese.py::BertJapaneseTokenizationTest::test_sequence_builders 
tests/test_tokenization_bert_japanese.py::BertJapaneseTokenizationTest::test_special_tokens_mask 
[gw18] SKIPPED tests/test_tokenization_bert_japanese.py::BertJapaneseTokenizationTest::test_special_tokens_mask 
tests/test_tokenization_bert_japanese.py::BertJapaneseTokenizationTest::test_special_tokens_mask_input_pairs 
[gw18] SKIPPED tests/test_tokenization_bert_japanese.py::BertJapaneseTokenizationTest::test_special_tokens_mask_input_pairs 
tests/test_tokenization_bert_japanese.py::BertJapaneseTokenizationTest::test_swap_special_token 
[gw18] SKIPPED tests/test_tokenization_bert_japanese.py::BertJapaneseTokenizationTest::test_swap_special_token 
tests/test_tokenization_bert_japanese.py::BertJapaneseTokenizationTest::test_tf_encode_plus_sent_to_model 
[gw18] SKIPPED tests/test_tokenization_bert_japanese.py::BertJapaneseTokenizationTest::test_tf_encode_plus_sent_to_model 
tests/test_tokenization_bert_japanese.py::BertJapaneseTokenizationTest::test_tokenizers_common_properties 
[gw18] SKIPPED tests/test_tokenization_bert_japanese.py::BertJapaneseTokenizationTest::test_tokenizers_common_properties 
tests/test_tokenization_bert_japanese.py::BertJapaneseTokenizationTest::test_torch_encode_plus_sent_to_model 
[gw18] SKIPPED tests/test_tokenization_bert_japanese.py::BertJapaneseTokenizationTest::test_torch_encode_plus_sent_to_model 
tests/test_tokenization_bert_japanese.py::BertJapaneseTokenizationTest::test_wordpiece_tokenizer 
[gw18] SKIPPED tests/test_tokenization_bert_japanese.py::BertJapaneseTokenizationTest::test_wordpiece_tokenizer 
tests/test_tokenization_bert_japanese.py::BertJapaneseCharacterTokenizationTest::test_add_special_tokens 
[gw18] SKIPPED tests/test_tokenization_bert_japanese.py::BertJapaneseCharacterTokenizationTest::test_add_special_tokens 
tests/test_tokenization_bert_japanese.py::BertJapaneseCharacterTokenizationTest::test_add_tokens_tokenizer 
[gw18] SKIPPED tests/test_tokenization_bert_japanese.py::BertJapaneseCharacterTokenizationTest::test_add_tokens_tokenizer 
tests/test_tokenization_bert_japanese.py::BertJapaneseCharacterTokenizationTest::test_added_tokens_do_lower_case 
[gw18] SKIPPED tests/test_tokenization_bert_japanese.py::BertJapaneseCharacterTokenizationTest::test_added_tokens_do_lower_case 
tests/test_tokenization_bert_japanese.py::BertJapaneseCharacterTokenizationTest::test_batch_encode_plus_batch_sequence_length 
[gw18] SKIPPED tests/test_tokenization_bert_japanese.py::BertJapaneseCharacterTokenizationTest::test_batch_encode_plus_batch_sequence_length 
tests/test_tokenization_bert_japanese.py::BertJapaneseCharacterTokenizationTest::test_batch_encode_plus_padding 
[gw18] SKIPPED tests/test_tokenization_bert_japanese.py::BertJapaneseCharacterTokenizationTest::test_batch_encode_plus_padding 
tests/test_tokenization_bert_japanese.py::BertJapaneseCharacterTokenizationTest::test_batch_encode_plus_tensors 
[gw18] SKIPPED tests/test_tokenization_bert_japanese.py::BertJapaneseCharacterTokenizationTest::test_batch_encode_plus_tensors 
tests/test_tokenization_bert_japanese.py::BertJapaneseCharacterTokenizationTest::test_call 
[gw18] SKIPPED tests/test_tokenization_bert_japanese.py::BertJapaneseCharacterTokenizationTest::test_call 
tests/test_tokenization_bert_japanese.py::BertJapaneseCharacterTokenizationTest::test_character_tokenizer 
[gw18] SKIPPED tests/test_tokenization_bert_japanese.py::BertJapaneseCharacterTokenizationTest::test_character_tokenizer 
tests/test_tokenization_bert_japanese.py::BertJapaneseCharacterTokenizationTest::test_conversion_reversible 
[gw18] SKIPPED tests/test_tokenization_bert_japanese.py::BertJapaneseCharacterTokenizationTest::test_conversion_reversible 
tests/test_tokenization_bert_japanese.py::BertJapaneseCharacterTokenizationTest::test_encode_decode_with_spaces 
[gw18] SKIPPED tests/test_tokenization_bert_japanese.py::BertJapaneseCharacterTokenizationTest::test_encode_decode_with_spaces 
tests/test_tokenization_bert_japanese.py::BertJapaneseCharacterTokenizationTest::test_encode_plus_with_padding 
[gw18] SKIPPED tests/test_tokenization_bert_japanese.py::BertJapaneseCharacterTokenizationTest::test_encode_plus_with_padding 
tests/test_tokenization_bert_japanese.py::BertJapaneseCharacterTokenizationTest::test_full_tokenizer 
[gw18] SKIPPED tests/test_tokenization_bert_japanese.py::BertJapaneseCharacterTokenizationTest::test_full_tokenizer 
tests/test_tokenization_bert_japanese.py::BertJapaneseCharacterTokenizationTest::test_get_vocab 
[gw18] SKIPPED tests/test_tokenization_bert_japanese.py::BertJapaneseCharacterTokenizationTest::test_get_vocab 
tests/test_tokenization_bert_japanese.py::BertJapaneseCharacterTokenizationTest::test_internal_consistency 
[gw18] SKIPPED tests/test_tokenization_bert_japanese.py::BertJapaneseCharacterTokenizationTest::test_internal_consistency 
tests/test_tokenization_bert_japanese.py::BertJapaneseCharacterTokenizationTest::test_mask_output 
[gw18] SKIPPED tests/test_tokenization_bert_japanese.py::BertJapaneseCharacterTokenizationTest::test_mask_output 
tests/test_tokenization_bert_japanese.py::BertJapaneseCharacterTokenizationTest::test_maximum_encoding_length_pair_input 
[gw18] SKIPPED tests/test_tokenization_bert_japanese.py::BertJapaneseCharacterTokenizationTest::test_maximum_encoding_length_pair_input 
tests/test_tokenization_bert_japanese.py::BertJapaneseCharacterTokenizationTest::test_maximum_encoding_length_single_input 
[gw18] SKIPPED tests/test_tokenization_bert_japanese.py::BertJapaneseCharacterTokenizationTest::test_maximum_encoding_length_single_input 
tests/test_tokenization_bert_japanese.py::BertJapaneseCharacterTokenizationTest::test_np_encode_plus_sent_to_model 
[gw18] SKIPPED tests/test_tokenization_bert_japanese.py::BertJapaneseCharacterTokenizationTest::test_np_encode_plus_sent_to_model 
tests/test_tokenization_bert_japanese.py::BertJapaneseCharacterTokenizationTest::test_number_of_added_tokens 
[gw18] SKIPPED tests/test_tokenization_bert_japanese.py::BertJapaneseCharacterTokenizationTest::test_number_of_added_tokens 
tests/test_tokenization_bert_japanese.py::BertJapaneseCharacterTokenizationTest::test_padding_to_max_length 
[gw18] SKIPPED tests/test_tokenization_bert_japanese.py::BertJapaneseCharacterTokenizationTest::test_padding_to_max_length 
tests/test_tokenization_bert_japanese.py::BertJapaneseCharacterTokenizationTest::test_padding_to_multiple_of 
[gw18] SKIPPED tests/test_tokenization_bert_japanese.py::BertJapaneseCharacterTokenizationTest::test_padding_to_multiple_of 
tests/test_tokenization_bert_japanese.py::BertJapaneseCharacterTokenizationTest::test_pickle_tokenizer 
[gw18] SKIPPED tests/test_tokenization_bert_japanese.py::BertJapaneseCharacterTokenizationTest::test_pickle_tokenizer 
tests/test_tokenization_bert_japanese.py::BertJapaneseCharacterTokenizationTest::test_pretokenized_inputs 
[gw18] SKIPPED tests/test_tokenization_bert_japanese.py::BertJapaneseCharacterTokenizationTest::test_pretokenized_inputs 
tests/test_tokenization_bert_japanese.py::BertJapaneseCharacterTokenizationTest::test_pretrained_model_lists 
[gw18] SKIPPED tests/test_tokenization_bert_japanese.py::BertJapaneseCharacterTokenizationTest::test_pretrained_model_lists 
tests/test_tokenization_bert_japanese.py::BertJapaneseCharacterTokenizationTest::test_right_and_left_padding 
[gw18] SKIPPED tests/test_tokenization_bert_japanese.py::BertJapaneseCharacterTokenizationTest::test_right_and_left_padding 
tests/test_tokenization_bert_japanese.py::BertJapaneseCharacterTokenizationTest::test_save_and_load_tokenizer 
[gw18] SKIPPED tests/test_tokenization_bert_japanese.py::BertJapaneseCharacterTokenizationTest::test_save_and_load_tokenizer 
tests/test_tokenization_bert_japanese.py::BertJapaneseCharacterTokenizationTest::test_separate_tokenizers 
[gw18] SKIPPED tests/test_tokenization_bert_japanese.py::BertJapaneseCharacterTokenizationTest::test_separate_tokenizers 
tests/test_tokenization_bert_japanese.py::BertJapaneseCharacterTokenizationTest::test_sequence_builders 
[gw18] SKIPPED tests/test_tokenization_bert_japanese.py::BertJapaneseCharacterTokenizationTest::test_sequence_builders 
tests/test_tokenization_bert_japanese.py::BertJapaneseCharacterTokenizationTest::test_special_tokens_mask 
[gw18] SKIPPED tests/test_tokenization_bert_japanese.py::BertJapaneseCharacterTokenizationTest::test_special_tokens_mask 
tests/test_tokenization_bert_japanese.py::BertJapaneseCharacterTokenizationTest::test_special_tokens_mask_input_pairs 
[gw18] SKIPPED tests/test_tokenization_bert_japanese.py::BertJapaneseCharacterTokenizationTest::test_special_tokens_mask_input_pairs 
tests/test_tokenization_bert_japanese.py::BertJapaneseCharacterTokenizationTest::test_swap_special_token 
[gw18] SKIPPED tests/test_tokenization_bert_japanese.py::BertJapaneseCharacterTokenizationTest::test_swap_special_token 
tests/test_tokenization_bert_japanese.py::BertJapaneseCharacterTokenizationTest::test_tf_encode_plus_sent_to_model 
[gw18] SKIPPED tests/test_tokenization_bert_japanese.py::BertJapaneseCharacterTokenizationTest::test_tf_encode_plus_sent_to_model 
tests/test_tokenization_bert_japanese.py::BertJapaneseCharacterTokenizationTest::test_tokenizers_common_properties 
[gw18] SKIPPED tests/test_tokenization_bert_japanese.py::BertJapaneseCharacterTokenizationTest::test_tokenizers_common_properties 
tests/test_tokenization_bert_japanese.py::BertJapaneseCharacterTokenizationTest::test_torch_encode_plus_sent_to_model 
[gw18] SKIPPED tests/test_tokenization_bert_japanese.py::BertJapaneseCharacterTokenizationTest::test_torch_encode_plus_sent_to_model 
tests/test_tokenization_ctrl.py::CTRLTokenizationTest::test_add_special_tokens 
[gw18] PASSED tests/test_tokenization_ctrl.py::CTRLTokenizationTest::test_add_special_tokens 
tests/test_tokenization_ctrl.py::CTRLTokenizationTest::test_add_tokens_tokenizer 
[gw18] PASSED tests/test_tokenization_ctrl.py::CTRLTokenizationTest::test_add_tokens_tokenizer 
tests/test_tokenization_ctrl.py::CTRLTokenizationTest::test_added_tokens_do_lower_case 
[gw18] PASSED tests/test_tokenization_ctrl.py::CTRLTokenizationTest::test_added_tokens_do_lower_case 
tests/test_tokenization_ctrl.py::CTRLTokenizationTest::test_batch_encode_plus_batch_sequence_length 
[gw18] PASSED tests/test_tokenization_ctrl.py::CTRLTokenizationTest::test_batch_encode_plus_batch_sequence_length 
tests/test_tokenization_ctrl.py::CTRLTokenizationTest::test_batch_encode_plus_padding 
[gw18] PASSED tests/test_tokenization_ctrl.py::CTRLTokenizationTest::test_batch_encode_plus_padding 
tests/test_tokenization_ctrl.py::CTRLTokenizationTest::test_batch_encode_plus_tensors 
[gw18] PASSED tests/test_tokenization_ctrl.py::CTRLTokenizationTest::test_batch_encode_plus_tensors 
tests/test_tokenization_ctrl.py::CTRLTokenizationTest::test_call 
[gw18] PASSED tests/test_tokenization_ctrl.py::CTRLTokenizationTest::test_call 
tests/test_tokenization_ctrl.py::CTRLTokenizationTest::test_conversion_reversible 
[gw18] PASSED tests/test_tokenization_ctrl.py::CTRLTokenizationTest::test_conversion_reversible 
tests/test_tokenization_ctrl.py::CTRLTokenizationTest::test_encode_decode_with_spaces 
[gw18] PASSED tests/test_tokenization_ctrl.py::CTRLTokenizationTest::test_encode_decode_with_spaces 
tests/test_tokenization_ctrl.py::CTRLTokenizationTest::test_encode_plus_with_padding 
[gw18] PASSED tests/test_tokenization_ctrl.py::CTRLTokenizationTest::test_encode_plus_with_padding 
tests/test_tokenization_ctrl.py::CTRLTokenizationTest::test_full_tokenizer 
[gw18] PASSED tests/test_tokenization_ctrl.py::CTRLTokenizationTest::test_full_tokenizer 
tests/test_tokenization_ctrl.py::CTRLTokenizationTest::test_get_vocab 
[gw18] PASSED tests/test_tokenization_ctrl.py::CTRLTokenizationTest::test_get_vocab 
tests/test_tokenization_ctrl.py::CTRLTokenizationTest::test_internal_consistency 
[gw18] PASSED tests/test_tokenization_ctrl.py::CTRLTokenizationTest::test_internal_consistency 
tests/test_tokenization_ctrl.py::CTRLTokenizationTest::test_mask_output 
[gw18] PASSED tests/test_tokenization_ctrl.py::CTRLTokenizationTest::test_mask_output 
tests/test_tokenization_ctrl.py::CTRLTokenizationTest::test_maximum_encoding_length_pair_input 
[gw18] PASSED tests/test_tokenization_ctrl.py::CTRLTokenizationTest::test_maximum_encoding_length_pair_input 
tests/test_tokenization_ctrl.py::CTRLTokenizationTest::test_maximum_encoding_length_single_input 
[gw18] PASSED tests/test_tokenization_ctrl.py::CTRLTokenizationTest::test_maximum_encoding_length_single_input 
tests/test_tokenization_ctrl.py::CTRLTokenizationTest::test_np_encode_plus_sent_to_model 
[gw18] SKIPPED tests/test_tokenization_ctrl.py::CTRLTokenizationTest::test_np_encode_plus_sent_to_model 
tests/test_tokenization_ctrl.py::CTRLTokenizationTest::test_number_of_added_tokens 
[gw18] PASSED tests/test_tokenization_ctrl.py::CTRLTokenizationTest::test_number_of_added_tokens 
tests/test_tokenization_ctrl.py::CTRLTokenizationTest::test_padding_to_max_length 
[gw18] PASSED tests/test_tokenization_ctrl.py::CTRLTokenizationTest::test_padding_to_max_length 
tests/test_tokenization_ctrl.py::CTRLTokenizationTest::test_padding_to_multiple_of 
[gw18] SKIPPED tests/test_tokenization_ctrl.py::CTRLTokenizationTest::test_padding_to_multiple_of 
tests/test_tokenization_ctrl.py::CTRLTokenizationTest::test_pickle_tokenizer 
[gw18] PASSED tests/test_tokenization_ctrl.py::CTRLTokenizationTest::test_pickle_tokenizer 
tests/test_tokenization_ctrl.py::CTRLTokenizationTest::test_pretokenized_inputs 
[gw18] PASSED tests/test_tokenization_ctrl.py::CTRLTokenizationTest::test_pretokenized_inputs 
tests/test_tokenization_ctrl.py::CTRLTokenizationTest::test_pretrained_model_lists 
[gw18] PASSED tests/test_tokenization_ctrl.py::CTRLTokenizationTest::test_pretrained_model_lists 
tests/test_tokenization_ctrl.py::CTRLTokenizationTest::test_right_and_left_padding 
[gw18] PASSED tests/test_tokenization_ctrl.py::CTRLTokenizationTest::test_right_and_left_padding 
tests/test_tokenization_ctrl.py::CTRLTokenizationTest::test_save_and_load_tokenizer 
[gw18] PASSED tests/test_tokenization_ctrl.py::CTRLTokenizationTest::test_save_and_load_tokenizer 
tests/test_tokenization_ctrl.py::CTRLTokenizationTest::test_separate_tokenizers 
[gw18] PASSED tests/test_tokenization_ctrl.py::CTRLTokenizationTest::test_separate_tokenizers 
tests/test_tokenization_ctrl.py::CTRLTokenizationTest::test_special_tokens_mask 
[gw18] PASSED tests/test_tokenization_ctrl.py::CTRLTokenizationTest::test_special_tokens_mask 
tests/test_tokenization_ctrl.py::CTRLTokenizationTest::test_special_tokens_mask_input_pairs 
[gw18] PASSED tests/test_tokenization_ctrl.py::CTRLTokenizationTest::test_special_tokens_mask_input_pairs 
tests/test_tokenization_ctrl.py::CTRLTokenizationTest::test_swap_special_token 
[gw18] PASSED tests/test_tokenization_ctrl.py::CTRLTokenizationTest::test_swap_special_token 
tests/test_tokenization_ctrl.py::CTRLTokenizationTest::test_tf_encode_plus_sent_to_model 
[gw18] SKIPPED tests/test_tokenization_ctrl.py::CTRLTokenizationTest::test_tf_encode_plus_sent_to_model 
tests/test_tokenization_ctrl.py::CTRLTokenizationTest::test_tokenizers_common_properties 
[gw18] PASSED tests/test_tokenization_ctrl.py::CTRLTokenizationTest::test_tokenizers_common_properties 
tests/test_tokenization_ctrl.py::CTRLTokenizationTest::test_torch_encode_plus_sent_to_model 
[gw18] SKIPPED tests/test_tokenization_ctrl.py::CTRLTokenizationTest::test_torch_encode_plus_sent_to_model 
tests/test_tokenization_distilbert.py::BertTokenizationTest::test_add_special_tokens 
[gw18] PASSED tests/test_tokenization_distilbert.py::BertTokenizationTest::test_add_special_tokens 
tests/test_tokenization_distilbert.py::BertTokenizationTest::test_add_tokens_tokenizer 
[gw18] PASSED tests/test_tokenization_distilbert.py::BertTokenizationTest::test_add_tokens_tokenizer 
tests/test_tokenization_distilbert.py::BertTokenizationTest::test_added_tokens_do_lower_case 
[gw18] PASSED tests/test_tokenization_distilbert.py::BertTokenizationTest::test_added_tokens_do_lower_case 
tests/test_tokenization_distilbert.py::BertTokenizationTest::test_basic_tokenizer_lower 
[gw18] PASSED tests/test_tokenization_distilbert.py::BertTokenizationTest::test_basic_tokenizer_lower 
tests/test_tokenization_distilbert.py::BertTokenizationTest::test_basic_tokenizer_no_lower 
[gw18] PASSED tests/test_tokenization_distilbert.py::BertTokenizationTest::test_basic_tokenizer_no_lower 
tests/test_tokenization_distilbert.py::BertTokenizationTest::test_basic_tokenizer_respects_never_split_tokens 
[gw18] PASSED tests/test_tokenization_distilbert.py::BertTokenizationTest::test_basic_tokenizer_respects_never_split_tokens 
tests/test_tokenization_distilbert.py::BertTokenizationTest::test_batch_encode_plus_batch_sequence_length 
[gw18] PASSED tests/test_tokenization_distilbert.py::BertTokenizationTest::test_batch_encode_plus_batch_sequence_length 
tests/test_tokenization_distilbert.py::BertTokenizationTest::test_batch_encode_plus_padding 
[gw21] PASSED tests/test_modeling_xlm.py::XLMModelTest::test_head_pruning_save_load_from_config_init 
tests/test_modeling_xlm.py::XLMModelTest::test_head_pruning_save_load_from_pretrained 
[gw18] PASSED tests/test_tokenization_distilbert.py::BertTokenizationTest::test_batch_encode_plus_padding 
tests/test_tokenization_distilbert.py::BertTokenizationTest::test_batch_encode_plus_tensors 
[gw18] PASSED tests/test_tokenization_distilbert.py::BertTokenizationTest::test_batch_encode_plus_tensors 
tests/test_tokenization_distilbert.py::BertTokenizationTest::test_call 
[gw18] PASSED tests/test_tokenization_distilbert.py::BertTokenizationTest::test_call 
tests/test_tokenization_distilbert.py::BertTokenizationTest::test_chinese 
[gw18] PASSED tests/test_tokenization_distilbert.py::BertTokenizationTest::test_chinese 
tests/test_tokenization_distilbert.py::BertTokenizationTest::test_conversion_reversible 
[gw18] PASSED tests/test_tokenization_distilbert.py::BertTokenizationTest::test_conversion_reversible 
tests/test_tokenization_distilbert.py::BertTokenizationTest::test_encode_decode_with_spaces 
[gw18] PASSED tests/test_tokenization_distilbert.py::BertTokenizationTest::test_encode_decode_with_spaces 
tests/test_tokenization_distilbert.py::BertTokenizationTest::test_encode_plus_with_padding 
[gw18] PASSED tests/test_tokenization_distilbert.py::BertTokenizationTest::test_encode_plus_with_padding 
tests/test_tokenization_distilbert.py::BertTokenizationTest::test_full_tokenizer 
[gw18] PASSED tests/test_tokenization_distilbert.py::BertTokenizationTest::test_full_tokenizer 
tests/test_tokenization_distilbert.py::BertTokenizationTest::test_get_vocab 
[gw18] PASSED tests/test_tokenization_distilbert.py::BertTokenizationTest::test_get_vocab 
tests/test_tokenization_distilbert.py::BertTokenizationTest::test_internal_consistency 
[gw18] PASSED tests/test_tokenization_distilbert.py::BertTokenizationTest::test_internal_consistency 
tests/test_tokenization_distilbert.py::BertTokenizationTest::test_is_control 
[gw18] PASSED tests/test_tokenization_distilbert.py::BertTokenizationTest::test_is_control 
tests/test_tokenization_distilbert.py::BertTokenizationTest::test_is_punctuation 
[gw18] PASSED tests/test_tokenization_distilbert.py::BertTokenizationTest::test_is_punctuation 
tests/test_tokenization_distilbert.py::BertTokenizationTest::test_is_whitespace 
[gw18] PASSED tests/test_tokenization_distilbert.py::BertTokenizationTest::test_is_whitespace 
tests/test_tokenization_distilbert.py::BertTokenizationTest::test_mask_output 
[gw18] PASSED tests/test_tokenization_distilbert.py::BertTokenizationTest::test_mask_output 
tests/test_tokenization_distilbert.py::BertTokenizationTest::test_maximum_encoding_length_pair_input 
[gw3] PASSED tests/test_modeling_tf_t5.py::TFT5ModelTest::test_inputs_embeds 
tests/test_modeling_tf_t5.py::TFT5ModelTest::test_keras_save_load 
[gw18] PASSED tests/test_tokenization_distilbert.py::BertTokenizationTest::test_maximum_encoding_length_pair_input 
tests/test_tokenization_distilbert.py::BertTokenizationTest::test_maximum_encoding_length_single_input 
[gw19] PASSED tests/test_modeling_gpt2.py::GPT2ModelTest::test_resize_tokens_embeddings 
tests/test_modeling_gpt2.py::GPT2ModelTest::test_save_load 
[gw5] PASSED tests/test_modeling_tf_xlm.py::TFXLMModelTest::test_hidden_states_output 
tests/test_modeling_tf_xlm.py::TFXLMModelTest::test_initialization 
[gw5] PASSED tests/test_modeling_tf_xlm.py::TFXLMModelTest::test_initialization 
tests/test_modeling_tf_xlm.py::TFXLMModelTest::test_inputs_embeds 
[gw18] PASSED tests/test_tokenization_distilbert.py::BertTokenizationTest::test_maximum_encoding_length_single_input 
tests/test_tokenization_distilbert.py::BertTokenizationTest::test_np_encode_plus_sent_to_model 
[gw18] SKIPPED tests/test_tokenization_distilbert.py::BertTokenizationTest::test_np_encode_plus_sent_to_model 
tests/test_tokenization_distilbert.py::BertTokenizationTest::test_number_of_added_tokens 
[gw18] PASSED tests/test_tokenization_distilbert.py::BertTokenizationTest::test_number_of_added_tokens 
[gw7] PASSED tests/test_modeling_tf_roberta.py::TFRobertaModelTest::test_keras_save_load 
tests/test_tokenization_distilbert.py::BertTokenizationTest::test_padding_to_max_length 
[gw18] PASSED tests/test_tokenization_distilbert.py::BertTokenizationTest::test_padding_to_max_length 
tests/test_tokenization_distilbert.py::BertTokenizationTest::test_padding_to_multiple_of 
[gw18] PASSED tests/test_tokenization_distilbert.py::BertTokenizationTest::test_padding_to_multiple_of 
tests/test_tokenization_distilbert.py::BertTokenizationTest::test_pickle_tokenizer 
[gw18] PASSED tests/test_tokenization_distilbert.py::BertTokenizationTest::test_pickle_tokenizer 
tests/test_tokenization_distilbert.py::BertTokenizationTest::test_pretokenized_inputs 
tests/test_modeling_tf_roberta.py::TFRobertaModelTest::test_keyword_and_dict_args 
[gw18] PASSED tests/test_tokenization_distilbert.py::BertTokenizationTest::test_pretokenized_inputs 
tests/test_tokenization_distilbert.py::BertTokenizationTest::test_pretrained_model_lists 
[gw18] PASSED tests/test_tokenization_distilbert.py::BertTokenizationTest::test_pretrained_model_lists 
tests/test_tokenization_distilbert.py::BertTokenizationTest::test_right_and_left_padding 
[gw18] PASSED tests/test_tokenization_distilbert.py::BertTokenizationTest::test_right_and_left_padding 
tests/test_tokenization_distilbert.py::BertTokenizationTest::test_rust_and_python_full_tokenizers 
[gw18] PASSED tests/test_tokenization_distilbert.py::BertTokenizationTest::test_rust_and_python_full_tokenizers 
tests/test_tokenization_distilbert.py::BertTokenizationTest::test_save_and_load_tokenizer 
[gw18] PASSED tests/test_tokenization_distilbert.py::BertTokenizationTest::test_save_and_load_tokenizer 
tests/test_tokenization_distilbert.py::BertTokenizationTest::test_separate_tokenizers 
[gw18] PASSED tests/test_tokenization_distilbert.py::BertTokenizationTest::test_separate_tokenizers 
tests/test_tokenization_distilbert.py::BertTokenizationTest::test_sequence_builders 
[gw18] SKIPPED tests/test_tokenization_distilbert.py::BertTokenizationTest::test_sequence_builders 
tests/test_tokenization_distilbert.py::BertTokenizationTest::test_special_tokens_mask 
[gw18] PASSED tests/test_tokenization_distilbert.py::BertTokenizationTest::test_special_tokens_mask 
tests/test_tokenization_distilbert.py::BertTokenizationTest::test_special_tokens_mask_input_pairs 
[gw18] PASSED tests/test_tokenization_distilbert.py::BertTokenizationTest::test_special_tokens_mask_input_pairs 
tests/test_tokenization_distilbert.py::BertTokenizationTest::test_swap_special_token 
[gw18] PASSED tests/test_tokenization_distilbert.py::BertTokenizationTest::test_swap_special_token 
tests/test_tokenization_distilbert.py::BertTokenizationTest::test_tf_encode_plus_sent_to_model 
[gw18] SKIPPED tests/test_tokenization_distilbert.py::BertTokenizationTest::test_tf_encode_plus_sent_to_model 
tests/test_tokenization_distilbert.py::BertTokenizationTest::test_tokenizers_common_properties 
[gw18] PASSED tests/test_tokenization_distilbert.py::BertTokenizationTest::test_tokenizers_common_properties 
tests/test_tokenization_distilbert.py::BertTokenizationTest::test_torch_encode_plus_sent_to_model 
[gw18] SKIPPED tests/test_tokenization_distilbert.py::BertTokenizationTest::test_torch_encode_plus_sent_to_model 
tests/test_tokenization_distilbert.py::BertTokenizationTest::test_wordpiece_tokenizer 
[gw18] PASSED tests/test_tokenization_distilbert.py::BertTokenizationTest::test_wordpiece_tokenizer 
tests/test_tokenization_distilbert.py::DistilBertTokenizationTest::test_add_special_tokens 
[gw18] PASSED tests/test_tokenization_distilbert.py::DistilBertTokenizationTest::test_add_special_tokens 
tests/test_tokenization_distilbert.py::DistilBertTokenizationTest::test_add_tokens_tokenizer 
[gw18] PASSED tests/test_tokenization_distilbert.py::DistilBertTokenizationTest::test_add_tokens_tokenizer 
tests/test_tokenization_distilbert.py::DistilBertTokenizationTest::test_added_tokens_do_lower_case 
[gw18] PASSED tests/test_tokenization_distilbert.py::DistilBertTokenizationTest::test_added_tokens_do_lower_case 
tests/test_tokenization_distilbert.py::DistilBertTokenizationTest::test_basic_tokenizer_lower 
[gw18] PASSED tests/test_tokenization_distilbert.py::DistilBertTokenizationTest::test_basic_tokenizer_lower 
tests/test_tokenization_distilbert.py::DistilBertTokenizationTest::test_basic_tokenizer_no_lower 
[gw18] PASSED tests/test_tokenization_distilbert.py::DistilBertTokenizationTest::test_basic_tokenizer_no_lower 
tests/test_tokenization_distilbert.py::DistilBertTokenizationTest::test_basic_tokenizer_respects_never_split_tokens 
[gw18] PASSED tests/test_tokenization_distilbert.py::DistilBertTokenizationTest::test_basic_tokenizer_respects_never_split_tokens 
tests/test_tokenization_distilbert.py::DistilBertTokenizationTest::test_batch_encode_plus_batch_sequence_length 
[gw18] PASSED tests/test_tokenization_distilbert.py::DistilBertTokenizationTest::test_batch_encode_plus_batch_sequence_length 
tests/test_tokenization_distilbert.py::DistilBertTokenizationTest::test_batch_encode_plus_padding 
[gw18] PASSED tests/test_tokenization_distilbert.py::DistilBertTokenizationTest::test_batch_encode_plus_padding 
tests/test_tokenization_distilbert.py::DistilBertTokenizationTest::test_batch_encode_plus_tensors 
[gw18] PASSED tests/test_tokenization_distilbert.py::DistilBertTokenizationTest::test_batch_encode_plus_tensors 
tests/test_tokenization_distilbert.py::DistilBertTokenizationTest::test_call 
[gw18] PASSED tests/test_tokenization_distilbert.py::DistilBertTokenizationTest::test_call 
tests/test_tokenization_distilbert.py::DistilBertTokenizationTest::test_chinese 
[gw18] PASSED tests/test_tokenization_distilbert.py::DistilBertTokenizationTest::test_chinese 
tests/test_tokenization_distilbert.py::DistilBertTokenizationTest::test_conversion_reversible 
[gw18] PASSED tests/test_tokenization_distilbert.py::DistilBertTokenizationTest::test_conversion_reversible 
tests/test_tokenization_distilbert.py::DistilBertTokenizationTest::test_encode_decode_with_spaces 
[gw18] PASSED tests/test_tokenization_distilbert.py::DistilBertTokenizationTest::test_encode_decode_with_spaces 
tests/test_tokenization_distilbert.py::DistilBertTokenizationTest::test_encode_plus_with_padding 
[gw18] PASSED tests/test_tokenization_distilbert.py::DistilBertTokenizationTest::test_encode_plus_with_padding 
tests/test_tokenization_distilbert.py::DistilBertTokenizationTest::test_full_tokenizer 
[gw18] PASSED tests/test_tokenization_distilbert.py::DistilBertTokenizationTest::test_full_tokenizer 
tests/test_tokenization_distilbert.py::DistilBertTokenizationTest::test_get_vocab 
[gw18] PASSED tests/test_tokenization_distilbert.py::DistilBertTokenizationTest::test_get_vocab 
tests/test_tokenization_distilbert.py::DistilBertTokenizationTest::test_internal_consistency 
[gw18] PASSED tests/test_tokenization_distilbert.py::DistilBertTokenizationTest::test_internal_consistency 
tests/test_tokenization_distilbert.py::DistilBertTokenizationTest::test_is_control 
[gw18] PASSED tests/test_tokenization_distilbert.py::DistilBertTokenizationTest::test_is_control 
tests/test_tokenization_distilbert.py::DistilBertTokenizationTest::test_is_punctuation 
[gw18] PASSED tests/test_tokenization_distilbert.py::DistilBertTokenizationTest::test_is_punctuation 
tests/test_tokenization_distilbert.py::DistilBertTokenizationTest::test_is_whitespace 
[gw18] PASSED tests/test_tokenization_distilbert.py::DistilBertTokenizationTest::test_is_whitespace 
tests/test_tokenization_distilbert.py::DistilBertTokenizationTest::test_mask_output 
[gw18] PASSED tests/test_tokenization_distilbert.py::DistilBertTokenizationTest::test_mask_output 
tests/test_tokenization_distilbert.py::DistilBertTokenizationTest::test_maximum_encoding_length_pair_input 
[gw16] PASSED tests/test_modeling_electra.py::ElectraModelTest::test_torchscript_output_attentions 
tests/test_modeling_electra.py::ElectraModelTest::test_torchscript_output_hidden_state 
[gw18] PASSED tests/test_tokenization_distilbert.py::DistilBertTokenizationTest::test_maximum_encoding_length_pair_input 
tests/test_tokenization_distilbert.py::DistilBertTokenizationTest::test_maximum_encoding_length_single_input 
[gw0] PASSED tests/test_modeling_reformer.py::ReformerLocalAttnModelTest::test_reformer_chunking_forward_equality 
tests/test_modeling_reformer.py::ReformerLocalAttnModelTest::test_reformer_layer_training_dropout 
[gw18] PASSED tests/test_tokenization_distilbert.py::DistilBertTokenizationTest::test_maximum_encoding_length_single_input 
tests/test_tokenization_distilbert.py::DistilBertTokenizationTest::test_np_encode_plus_sent_to_model 
[gw18] SKIPPED tests/test_tokenization_distilbert.py::DistilBertTokenizationTest::test_np_encode_plus_sent_to_model 
tests/test_tokenization_distilbert.py::DistilBertTokenizationTest::test_number_of_added_tokens 
[gw18] PASSED tests/test_tokenization_distilbert.py::DistilBertTokenizationTest::test_number_of_added_tokens 
tests/test_tokenization_distilbert.py::DistilBertTokenizationTest::test_padding_to_max_length 
[gw18] PASSED tests/test_tokenization_distilbert.py::DistilBertTokenizationTest::test_padding_to_max_length 
tests/test_tokenization_distilbert.py::DistilBertTokenizationTest::test_padding_to_multiple_of 
[gw18] PASSED tests/test_tokenization_distilbert.py::DistilBertTokenizationTest::test_padding_to_multiple_of 
tests/test_tokenization_distilbert.py::DistilBertTokenizationTest::test_pickle_tokenizer 
[gw18] PASSED tests/test_tokenization_distilbert.py::DistilBertTokenizationTest::test_pickle_tokenizer 
tests/test_tokenization_distilbert.py::DistilBertTokenizationTest::test_pretokenized_inputs 
[gw22] PASSED tests/test_modeling_mobilebert.py::MobileBertModelTest::test_head_pruning 
tests/test_modeling_mobilebert.py::MobileBertModelTest::test_head_pruning_integration 
[gw21] PASSED tests/test_modeling_xlm.py::XLMModelTest::test_head_pruning_save_load_from_pretrained 
tests/test_modeling_xlm.py::XLMModelTest::test_headmasking 
[gw18] PASSED tests/test_tokenization_distilbert.py::DistilBertTokenizationTest::test_pretokenized_inputs 
tests/test_tokenization_distilbert.py::DistilBertTokenizationTest::test_pretrained_model_lists 
[gw18] PASSED tests/test_tokenization_distilbert.py::DistilBertTokenizationTest::test_pretrained_model_lists 
tests/test_tokenization_distilbert.py::DistilBertTokenizationTest::test_right_and_left_padding 
[gw18] PASSED tests/test_tokenization_distilbert.py::DistilBertTokenizationTest::test_right_and_left_padding 
tests/test_tokenization_distilbert.py::DistilBertTokenizationTest::test_rust_and_python_full_tokenizers 
[gw18] PASSED tests/test_tokenization_distilbert.py::DistilBertTokenizationTest::test_rust_and_python_full_tokenizers 
tests/test_tokenization_distilbert.py::DistilBertTokenizationTest::test_save_and_load_tokenizer 
[gw18] PASSED tests/test_tokenization_distilbert.py::DistilBertTokenizationTest::test_save_and_load_tokenizer 
tests/test_tokenization_distilbert.py::DistilBertTokenizationTest::test_separate_tokenizers 
[gw18] PASSED tests/test_tokenization_distilbert.py::DistilBertTokenizationTest::test_separate_tokenizers 
tests/test_tokenization_distilbert.py::DistilBertTokenizationTest::test_sequence_builders 
[gw18] SKIPPED tests/test_tokenization_distilbert.py::DistilBertTokenizationTest::test_sequence_builders 
tests/test_tokenization_distilbert.py::DistilBertTokenizationTest::test_special_tokens_mask 
[gw18] PASSED tests/test_tokenization_distilbert.py::DistilBertTokenizationTest::test_special_tokens_mask 
tests/test_tokenization_distilbert.py::DistilBertTokenizationTest::test_special_tokens_mask_input_pairs 
[gw18] PASSED tests/test_tokenization_distilbert.py::DistilBertTokenizationTest::test_special_tokens_mask_input_pairs 
tests/test_tokenization_distilbert.py::DistilBertTokenizationTest::test_swap_special_token 
[gw18] PASSED tests/test_tokenization_distilbert.py::DistilBertTokenizationTest::test_swap_special_token 
tests/test_tokenization_distilbert.py::DistilBertTokenizationTest::test_tf_encode_plus_sent_to_model 
[gw18] SKIPPED tests/test_tokenization_distilbert.py::DistilBertTokenizationTest::test_tf_encode_plus_sent_to_model 
tests/test_tokenization_distilbert.py::DistilBertTokenizationTest::test_tokenizers_common_properties 
[gw18] PASSED tests/test_tokenization_distilbert.py::DistilBertTokenizationTest::test_tokenizers_common_properties 
tests/test_tokenization_distilbert.py::DistilBertTokenizationTest::test_torch_encode_plus_sent_to_model 
[gw18] SKIPPED tests/test_tokenization_distilbert.py::DistilBertTokenizationTest::test_torch_encode_plus_sent_to_model 
tests/test_tokenization_distilbert.py::DistilBertTokenizationTest::test_wordpiece_tokenizer 
[gw18] PASSED tests/test_tokenization_distilbert.py::DistilBertTokenizationTest::test_wordpiece_tokenizer 
tests/test_tokenization_fast.py::CommonFastTokenizerTest::test_all_tokenizers 
[gw18] PASSED tests/test_tokenization_fast.py::CommonFastTokenizerTest::test_all_tokenizers 
tests/test_tokenization_fast.py::CommonFastTokenizerTest::test_pretokenized_tokenizers 
[gw18] PASSED tests/test_tokenization_fast.py::CommonFastTokenizerTest::test_pretokenized_tokenizers 
tests/test_tokenization_fast.py::WordPieceFastTokenizerTest::test_all_tokenizers 
[gw5] PASSED tests/test_modeling_tf_xlm.py::TFXLMModelTest::test_inputs_embeds 
tests/test_modeling_tf_xlm.py::TFXLMModelTest::test_keras_save_load 
[gw10] PASSED tests/test_tokenization_albert.py::AlbertTokenizationTest::test_maximum_encoding_length_single_input 
tests/test_tokenization_albert.py::AlbertTokenizationTest::test_np_encode_plus_sent_to_model 
[gw10] SKIPPED tests/test_tokenization_albert.py::AlbertTokenizationTest::test_np_encode_plus_sent_to_model 
tests/test_tokenization_albert.py::AlbertTokenizationTest::test_number_of_added_tokens 
[gw7] PASSED tests/test_modeling_tf_roberta.py::TFRobertaModelTest::test_keyword_and_dict_args 
tests/test_modeling_tf_roberta.py::TFRobertaModelTest::test_lm_head_model_random_beam_search_generate 
[gw7] PASSED tests/test_modeling_tf_roberta.py::TFRobertaModelTest::test_lm_head_model_random_beam_search_generate 
tests/test_modeling_tf_roberta.py::TFRobertaModelTest::test_lm_head_model_random_no_beam_search_generate 
[gw7] PASSED tests/test_modeling_tf_roberta.py::TFRobertaModelTest::test_lm_head_model_random_no_beam_search_generate 
tests/test_modeling_tf_roberta.py::TFRobertaModelTest::test_loss_computation 
[gw10] PASSED tests/test_tokenization_albert.py::AlbertTokenizationTest::test_number_of_added_tokens 
tests/test_tokenization_albert.py::AlbertTokenizationTest::test_padding_to_max_length 
[gw10] PASSED tests/test_tokenization_albert.py::AlbertTokenizationTest::test_padding_to_max_length 
tests/test_tokenization_albert.py::AlbertTokenizationTest::test_padding_to_multiple_of 
[gw10] PASSED tests/test_tokenization_albert.py::AlbertTokenizationTest::test_padding_to_multiple_of 
tests/test_tokenization_albert.py::AlbertTokenizationTest::test_pickle_tokenizer 
[gw3] PASSED tests/test_modeling_tf_t5.py::TFT5ModelTest::test_keras_save_load 
[gw20] PASSED tests/test_modeling_xlnet.py::XLNetModelTest::test_determinism 
tests/test_modeling_xlnet.py::XLNetModelTest::test_head_pruning 
[gw20] PASSED tests/test_modeling_xlnet.py::XLNetModelTest::test_head_pruning 
tests/test_modeling_xlnet.py::XLNetModelTest::test_head_pruning_integration 
[gw20] PASSED tests/test_modeling_xlnet.py::XLNetModelTest::test_head_pruning_integration 
tests/test_modeling_xlnet.py::XLNetModelTest::test_head_pruning_save_load_from_config_init 
[gw20] PASSED tests/test_modeling_xlnet.py::XLNetModelTest::test_head_pruning_save_load_from_config_init 
tests/test_modeling_xlnet.py::XLNetModelTest::test_head_pruning_save_load_from_pretrained 
[gw20] PASSED tests/test_modeling_xlnet.py::XLNetModelTest::test_head_pruning_save_load_from_pretrained 
tests/test_modeling_xlnet.py::XLNetModelTest::test_headmasking 
tests/test_modeling_tf_t5.py::TFT5ModelTest::test_keyword_and_dict_args 
[gw0] PASSED tests/test_modeling_reformer.py::ReformerLocalAttnModelTest::test_reformer_layer_training_dropout 
tests/test_modeling_reformer.py::ReformerLocalAttnModelTest::test_reformer_lm_model_backward 
[gw10] PASSED tests/test_tokenization_albert.py::AlbertTokenizationTest::test_pickle_tokenizer 
tests/test_tokenization_albert.py::AlbertTokenizationTest::test_pretokenized_inputs 
[gw4] PASSED tests/test_modeling_tf_transfo_xl.py::TFTransfoXLModelTest::test_pt_tf_model_equivalence 
tests/test_modeling_tf_transfo_xl.py::TFTransfoXLModelTest::test_resize_token_embeddings 
[gw4] PASSED tests/test_modeling_tf_transfo_xl.py::TFTransfoXLModelTest::test_resize_token_embeddings 
tests/test_modeling_tf_transfo_xl.py::TFTransfoXLModelTest::test_save_load 
[gw14] PASSED tests/test_modeling_ctrl.py::CTRLModelTest::test_lm_head_model_random_no_beam_search_generate 
tests/test_modeling_ctrl.py::CTRLModelTest::test_model_common_attributes 
[gw14] PASSED tests/test_modeling_ctrl.py::CTRLModelTest::test_model_common_attributes 
tests/test_modeling_ctrl.py::CTRLModelTest::test_model_from_pretrained 
[gw14] SKIPPED tests/test_modeling_ctrl.py::CTRLModelTest::test_model_from_pretrained 
tests/test_modeling_ctrl.py::CTRLModelTest::test_multigpu_data_parallel_forward 
[gw14] SKIPPED tests/test_modeling_ctrl.py::CTRLModelTest::test_multigpu_data_parallel_forward 
tests/test_modeling_ctrl.py::CTRLModelTest::test_resize_tokens_embeddings 
[gw14] PASSED tests/test_modeling_ctrl.py::CTRLModelTest::test_resize_tokens_embeddings 
tests/test_modeling_ctrl.py::CTRLModelTest::test_save_load 
[gw7] PASSED tests/test_modeling_tf_roberta.py::TFRobertaModelTest::test_loss_computation 
tests/test_modeling_tf_roberta.py::TFRobertaModelTest::test_model_common_attributes 
[gw3] PASSED tests/test_modeling_tf_t5.py::TFT5ModelTest::test_keyword_and_dict_args 
tests/test_modeling_tf_t5.py::TFT5ModelTest::test_lm_head_model_random_beam_search_generate 
[gw15] PASSED tests/test_modeling_distilbert.py::DistilBertModelTest::test_torchscript_output_hidden_state 
tests/test_modeling_transfo_xl.py::TransfoXLModelTest::test_attention_outputs 
[gw6] PASSED tests/test_modeling_tf_bert.py::TFBertModelTest::test_pt_tf_model_equivalence 
tests/test_modeling_tf_bert.py::TFBertModelTest::test_resize_token_embeddings 
[gw7] PASSED tests/test_modeling_tf_roberta.py::TFRobertaModelTest::test_model_common_attributes 
tests/test_modeling_tf_roberta.py::TFRobertaModelTest::test_model_from_pretrained 
[gw7] SKIPPED tests/test_modeling_tf_roberta.py::TFRobertaModelTest::test_model_from_pretrained 
tests/test_modeling_tf_roberta.py::TFRobertaModelTest::test_pt_tf_model_equivalence 
[gw19] PASSED tests/test_modeling_gpt2.py::GPT2ModelTest::test_save_load 
tests/test_modeling_gpt2.py::GPT2ModelTest::test_tie_model_weights 
[gw4] PASSED tests/test_modeling_tf_transfo_xl.py::TFTransfoXLModelTest::test_save_load 
tests/test_modeling_tf_transfo_xl.py::TFTransfoXLModelTest::test_transfo_xl_lm_head 
[gw5] PASSED tests/test_modeling_tf_xlm.py::TFXLMModelTest::test_keras_save_load 
tests/test_modeling_tf_xlm.py::TFXLMModelTest::test_keyword_and_dict_args 
[gw19] PASSED tests/test_modeling_gpt2.py::GPT2ModelTest::test_tie_model_weights 
tests/test_modeling_gpt2.py::GPT2ModelTest::test_torchscript 
[gw4] PASSED tests/test_modeling_tf_transfo_xl.py::TFTransfoXLModelTest::test_transfo_xl_lm_head 
tests/test_modeling_tf_transfo_xl.py::TFTransfoXLModelTest::test_transfo_xl_model 
[gw4] PASSED tests/test_modeling_tf_transfo_xl.py::TFTransfoXLModelTest::test_transfo_xl_model 
tests/test_modeling_tf_transfo_xl.py::TFTransfoXLModelLanguageGenerationTest::test_lm_generate_transfo_xl_wt103 
[gw4] SKIPPED tests/test_modeling_tf_transfo_xl.py::TFTransfoXLModelLanguageGenerationTest::test_lm_generate_transfo_xl_wt103 
tests/test_tokenization_marian.py::MarianTokenizationTest::test_add_special_tokens 
[gw4] PASSED tests/test_tokenization_marian.py::MarianTokenizationTest::test_add_special_tokens 
tests/test_tokenization_marian.py::MarianTokenizationTest::test_add_tokens_tokenizer 
[gw4] PASSED tests/test_tokenization_marian.py::MarianTokenizationTest::test_add_tokens_tokenizer 
tests/test_tokenization_marian.py::MarianTokenizationTest::test_added_tokens_do_lower_case 
[gw4] PASSED tests/test_tokenization_marian.py::MarianTokenizationTest::test_added_tokens_do_lower_case 
tests/test_tokenization_marian.py::MarianTokenizationTest::test_batch_encode_plus_batch_sequence_length 
[gw4] PASSED tests/test_tokenization_marian.py::MarianTokenizationTest::test_batch_encode_plus_batch_sequence_length 
tests/test_tokenization_marian.py::MarianTokenizationTest::test_batch_encode_plus_padding 
[gw4] PASSED tests/test_tokenization_marian.py::MarianTokenizationTest::test_batch_encode_plus_padding 
tests/test_tokenization_marian.py::MarianTokenizationTest::test_batch_encode_plus_tensors 
[gw4] PASSED tests/test_tokenization_marian.py::MarianTokenizationTest::test_batch_encode_plus_tensors 
tests/test_tokenization_marian.py::MarianTokenizationTest::test_call 
[gw4] PASSED tests/test_tokenization_marian.py::MarianTokenizationTest::test_call 
tests/test_tokenization_marian.py::MarianTokenizationTest::test_conversion_reversible 
[gw4] PASSED tests/test_tokenization_marian.py::MarianTokenizationTest::test_conversion_reversible 
tests/test_tokenization_marian.py::MarianTokenizationTest::test_encode_decode_with_spaces 
[gw4] PASSED tests/test_tokenization_marian.py::MarianTokenizationTest::test_encode_decode_with_spaces 
tests/test_tokenization_marian.py::MarianTokenizationTest::test_encode_plus_with_padding 
[gw4] PASSED tests/test_tokenization_marian.py::MarianTokenizationTest::test_encode_plus_with_padding 
tests/test_tokenization_marian.py::MarianTokenizationTest::test_get_vocab 
[gw4] PASSED tests/test_tokenization_marian.py::MarianTokenizationTest::test_get_vocab 
tests/test_tokenization_marian.py::MarianTokenizationTest::test_internal_consistency 
[gw4] PASSED tests/test_tokenization_marian.py::MarianTokenizationTest::test_internal_consistency 
tests/test_tokenization_marian.py::MarianTokenizationTest::test_mask_output 
[gw4] PASSED tests/test_tokenization_marian.py::MarianTokenizationTest::test_mask_output 
tests/test_tokenization_marian.py::MarianTokenizationTest::test_maximum_encoding_length_pair_input 
[gw4] PASSED tests/test_tokenization_marian.py::MarianTokenizationTest::test_maximum_encoding_length_pair_input 
tests/test_tokenization_marian.py::MarianTokenizationTest::test_maximum_encoding_length_single_input 
[gw4] PASSED tests/test_tokenization_marian.py::MarianTokenizationTest::test_maximum_encoding_length_single_input 
tests/test_tokenization_marian.py::MarianTokenizationTest::test_np_encode_plus_sent_to_model 
[gw4] SKIPPED tests/test_tokenization_marian.py::MarianTokenizationTest::test_np_encode_plus_sent_to_model 
tests/test_tokenization_marian.py::MarianTokenizationTest::test_number_of_added_tokens 
[gw4] PASSED tests/test_tokenization_marian.py::MarianTokenizationTest::test_number_of_added_tokens 
tests/test_tokenization_marian.py::MarianTokenizationTest::test_outputs_can_be_shorter 
[gw4] PASSED tests/test_tokenization_marian.py::MarianTokenizationTest::test_outputs_can_be_shorter 
tests/test_tokenization_marian.py::MarianTokenizationTest::test_outputs_not_longer_than_maxlen 
[gw10] PASSED tests/test_tokenization_albert.py::AlbertTokenizationTest::test_pretokenized_inputs 
tests/test_tokenization_albert.py::AlbertTokenizationTest::test_pretrained_model_lists 
[gw4] PASSED tests/test_tokenization_marian.py::MarianTokenizationTest::test_outputs_not_longer_than_maxlen 
[gw14] PASSED tests/test_modeling_ctrl.py::CTRLModelTest::test_save_load 
tests/test_tokenization_marian.py::MarianTokenizationTest::test_padding_to_max_length 
tests/test_modeling_ctrl.py::CTRLModelTest::test_tie_model_weights 
[gw14] PASSED tests/test_modeling_ctrl.py::CTRLModelTest::test_tie_model_weights 
tests/test_modeling_ctrl.py::CTRLModelTest::test_torchscript_output_attentions 
[gw14] PASSED tests/test_modeling_ctrl.py::CTRLModelTest::test_torchscript_output_attentions 
tests/test_modeling_ctrl.py::CTRLModelTest::test_torchscript_output_hidden_state 
[gw14] PASSED tests/test_modeling_ctrl.py::CTRLModelTest::test_torchscript_output_hidden_state 
tests/test_modeling_ctrl.py::CTRLModelLanguageGenerationTest::test_lm_generate_ctrl 
[gw14] SKIPPED tests/test_modeling_ctrl.py::CTRLModelLanguageGenerationTest::test_lm_generate_ctrl 
tests/test_tokenization_openai.py::OpenAIGPTTokenizationTest::test_add_special_tokens 
[gw10] PASSED tests/test_tokenization_albert.py::AlbertTokenizationTest::test_pretrained_model_lists 
tests/test_tokenization_albert.py::AlbertTokenizationTest::test_right_and_left_padding 
[gw4] PASSED tests/test_tokenization_marian.py::MarianTokenizationTest::test_padding_to_max_length 
tests/test_tokenization_marian.py::MarianTokenizationTest::test_padding_to_multiple_of 
[gw4] PASSED tests/test_tokenization_marian.py::MarianTokenizationTest::test_padding_to_multiple_of 
tests/test_tokenization_marian.py::MarianTokenizationTest::test_pickle_tokenizer 
[gw4] PASSED tests/test_tokenization_marian.py::MarianTokenizationTest::test_pickle_tokenizer 
tests/test_tokenization_marian.py::MarianTokenizationTest::test_pretokenized_inputs 
[gw4] PASSED tests/test_tokenization_marian.py::MarianTokenizationTest::test_pretokenized_inputs 
tests/test_tokenization_marian.py::MarianTokenizationTest::test_pretrained_model_lists 
[gw10] PASSED tests/test_tokenization_albert.py::AlbertTokenizationTest::test_right_and_left_padding 
tests/test_tokenization_albert.py::AlbertTokenizationTest::test_save_and_load_tokenizer 
[gw4] PASSED tests/test_tokenization_marian.py::MarianTokenizationTest::test_pretrained_model_lists 
tests/test_tokenization_marian.py::MarianTokenizationTest::test_right_and_left_padding 
[gw4] PASSED tests/test_tokenization_marian.py::MarianTokenizationTest::test_right_and_left_padding 
tests/test_tokenization_marian.py::MarianTokenizationTest::test_save_and_load_tokenizer 
[gw4] PASSED tests/test_tokenization_marian.py::MarianTokenizationTest::test_save_and_load_tokenizer 
tests/test_tokenization_marian.py::MarianTokenizationTest::test_separate_tokenizers 
[gw4] PASSED tests/test_tokenization_marian.py::MarianTokenizationTest::test_separate_tokenizers 
tests/test_tokenization_marian.py::MarianTokenizationTest::test_special_tokens_mask 
[gw4] PASSED tests/test_tokenization_marian.py::MarianTokenizationTest::test_special_tokens_mask 
tests/test_tokenization_marian.py::MarianTokenizationTest::test_special_tokens_mask_input_pairs 
[gw4] PASSED tests/test_tokenization_marian.py::MarianTokenizationTest::test_special_tokens_mask_input_pairs 
tests/test_tokenization_marian.py::MarianTokenizationTest::test_swap_special_token 
[gw4] PASSED tests/test_tokenization_marian.py::MarianTokenizationTest::test_swap_special_token 
tests/test_tokenization_marian.py::MarianTokenizationTest::test_tf_encode_plus_sent_to_model 
[gw4] SKIPPED tests/test_tokenization_marian.py::MarianTokenizationTest::test_tf_encode_plus_sent_to_model 
tests/test_tokenization_marian.py::MarianTokenizationTest::test_tokenizer_equivalence_en_de 
[gw21] PASSED tests/test_modeling_xlm.py::XLMModelTest::test_headmasking 
tests/test_modeling_xlm.py::XLMModelTest::test_hidden_states_output 
[gw5] PASSED tests/test_modeling_tf_xlm.py::TFXLMModelTest::test_keyword_and_dict_args 
tests/test_modeling_tf_xlm.py::TFXLMModelTest::test_lm_head_model_random_beam_search_generate 
[gw0] PASSED tests/test_modeling_reformer.py::ReformerLocalAttnModelTest::test_reformer_lm_model_backward 
tests/test_modeling_reformer.py::ReformerLocalAttnModelTest::test_reformer_model 
[gw10] PASSED tests/test_tokenization_albert.py::AlbertTokenizationTest::test_save_and_load_tokenizer 
tests/test_tokenization_albert.py::AlbertTokenizationTest::test_separate_tokenizers 
[gw13] PASSED tests/test_modeling_roberta.py::RobertaModelTest::test_torchscript_output_attentions 
[gw10] PASSED tests/test_tokenization_albert.py::AlbertTokenizationTest::test_separate_tokenizers 
tests/test_modeling_roberta.py::RobertaModelTest::test_torchscript_output_hidden_state 
tests/test_tokenization_albert.py::AlbertTokenizationTest::test_sequence_builders 
[gw15] PASSED tests/test_modeling_transfo_xl.py::TransfoXLModelTest::test_attention_outputs 
tests/test_modeling_transfo_xl.py::TransfoXLModelTest::test_config 
[gw15] PASSED tests/test_modeling_transfo_xl.py::TransfoXLModelTest::test_config 
tests/test_modeling_transfo_xl.py::TransfoXLModelTest::test_correct_missing_keys 
[gw15] PASSED tests/test_modeling_transfo_xl.py::TransfoXLModelTest::test_correct_missing_keys 
tests/test_modeling_transfo_xl.py::TransfoXLModelTest::test_determinism 
[gw10] PASSED tests/test_tokenization_albert.py::AlbertTokenizationTest::test_sequence_builders 
tests/test_tokenization_albert.py::AlbertTokenizationTest::test_special_tokens_mask 
[gw12] PASSED tests/test_modeling_tf_xlnet.py::TFXLNetModelTest::test_compile_tf_model 
[gw10] PASSED tests/test_tokenization_albert.py::AlbertTokenizationTest::test_special_tokens_mask 
tests/test_tokenization_albert.py::AlbertTokenizationTest::test_special_tokens_mask_input_pairs 
[gw14] PASSED tests/test_tokenization_openai.py::OpenAIGPTTokenizationTest::test_add_special_tokens 
tests/test_tokenization_openai.py::OpenAIGPTTokenizationTest::test_add_tokens_tokenizer 
tests/test_modeling_tf_xlnet.py::TFXLNetModelTest::test_config 
[gw12] PASSED tests/test_modeling_tf_xlnet.py::TFXLNetModelTest::test_config 
[gw10] PASSED tests/test_tokenization_albert.py::AlbertTokenizationTest::test_special_tokens_mask_input_pairs 
tests/test_tokenization_albert.py::AlbertTokenizationTest::test_swap_special_token 
tests/test_modeling_tf_xlnet.py::TFXLNetModelTest::test_determinism 
[gw10] PASSED tests/test_tokenization_albert.py::AlbertTokenizationTest::test_swap_special_token 
tests/test_tokenization_albert.py::AlbertTokenizationTest::test_tf_encode_plus_sent_to_model 
[gw10] SKIPPED tests/test_tokenization_albert.py::AlbertTokenizationTest::test_tf_encode_plus_sent_to_model 
tests/test_tokenization_albert.py::AlbertTokenizationTest::test_tokenizers_common_properties 
[gw4] PASSED tests/test_tokenization_marian.py::MarianTokenizationTest::test_tokenizer_equivalence_en_de 
tests/test_tokenization_marian.py::MarianTokenizationTest::test_tokenizers_common_properties 
[gw4] PASSED tests/test_tokenization_marian.py::MarianTokenizationTest::test_tokenizers_common_properties 
tests/test_tokenization_marian.py::MarianTokenizationTest::test_torch_encode_plus_sent_to_model 
[gw4] SKIPPED tests/test_tokenization_marian.py::MarianTokenizationTest::test_torch_encode_plus_sent_to_model 
tests/test_tokenization_t5.py::T5TokenizationTest::test_add_special_tokens 
[gw10] PASSED tests/test_tokenization_albert.py::AlbertTokenizationTest::test_tokenizers_common_properties 
tests/test_tokenization_albert.py::AlbertTokenizationTest::test_torch_encode_plus_sent_to_model 
[gw10] SKIPPED tests/test_tokenization_albert.py::AlbertTokenizationTest::test_torch_encode_plus_sent_to_model 
tests/test_tokenization_roberta.py::RobertaTokenizationTest::test_add_special_tokens 
[gw10] PASSED tests/test_tokenization_roberta.py::RobertaTokenizationTest::test_add_special_tokens 
tests/test_tokenization_roberta.py::RobertaTokenizationTest::test_add_tokens_tokenizer 
[gw10] PASSED tests/test_tokenization_roberta.py::RobertaTokenizationTest::test_add_tokens_tokenizer 
tests/test_tokenization_roberta.py::RobertaTokenizationTest::test_added_tokens_do_lower_case 
[gw10] PASSED tests/test_tokenization_roberta.py::RobertaTokenizationTest::test_added_tokens_do_lower_case 
tests/test_tokenization_roberta.py::RobertaTokenizationTest::test_batch_encode_plus_batch_sequence_length 
[gw10] PASSED tests/test_tokenization_roberta.py::RobertaTokenizationTest::test_batch_encode_plus_batch_sequence_length 
tests/test_tokenization_roberta.py::RobertaTokenizationTest::test_batch_encode_plus_padding 
[gw10] PASSED tests/test_tokenization_roberta.py::RobertaTokenizationTest::test_batch_encode_plus_padding 
tests/test_tokenization_roberta.py::RobertaTokenizationTest::test_batch_encode_plus_tensors 
[gw10] PASSED tests/test_tokenization_roberta.py::RobertaTokenizationTest::test_batch_encode_plus_tensors 
tests/test_tokenization_roberta.py::RobertaTokenizationTest::test_call 
[gw10] PASSED tests/test_tokenization_roberta.py::RobertaTokenizationTest::test_call 
tests/test_tokenization_roberta.py::RobertaTokenizationTest::test_conversion_reversible 
[gw10] PASSED tests/test_tokenization_roberta.py::RobertaTokenizationTest::test_conversion_reversible 
tests/test_tokenization_roberta.py::RobertaTokenizationTest::test_encode_decode_with_spaces 
[gw10] PASSED tests/test_tokenization_roberta.py::RobertaTokenizationTest::test_encode_decode_with_spaces 
tests/test_tokenization_roberta.py::RobertaTokenizationTest::test_encode_plus_with_padding 
[gw10] PASSED tests/test_tokenization_roberta.py::RobertaTokenizationTest::test_encode_plus_with_padding 
tests/test_tokenization_roberta.py::RobertaTokenizationTest::test_full_tokenizer 
[gw10] PASSED tests/test_tokenization_roberta.py::RobertaTokenizationTest::test_full_tokenizer 
tests/test_tokenization_roberta.py::RobertaTokenizationTest::test_get_vocab 
[gw10] PASSED tests/test_tokenization_roberta.py::RobertaTokenizationTest::test_get_vocab 
tests/test_tokenization_roberta.py::RobertaTokenizationTest::test_internal_consistency 
[gw10] PASSED tests/test_tokenization_roberta.py::RobertaTokenizationTest::test_internal_consistency 
tests/test_tokenization_roberta.py::RobertaTokenizationTest::test_mask_output 
[gw10] PASSED tests/test_tokenization_roberta.py::RobertaTokenizationTest::test_mask_output 
tests/test_tokenization_roberta.py::RobertaTokenizationTest::test_maximum_encoding_length_pair_input 
[gw9] PASSED tests/test_tokenization_auto.py::AutoTokenizerTest::test_tokenizer_from_pretrained 
tests/test_tokenization_auto.py::AutoTokenizerTest::test_tokenizer_from_pretrained_identifier 
[gw17] PASSED tests/test_modeling_flaubert.py::FlaubertModelTest::test_torchscript_output_attentions 
tests/test_modeling_flaubert.py::FlaubertModelTest::test_torchscript_output_hidden_state 
[gw10] PASSED tests/test_tokenization_roberta.py::RobertaTokenizationTest::test_maximum_encoding_length_pair_input 
tests/test_tokenization_roberta.py::RobertaTokenizationTest::test_maximum_encoding_length_single_input 
[gw1] PASSED tests/test_benchmark.py::BenchmarkTest::test_train_no_configs 
tests/test_benchmark.py::BenchmarkTest::test_train_no_configs_fp16 
[gw1] SKIPPED tests/test_benchmark.py::BenchmarkTest::test_train_no_configs_fp16 
tests/test_benchmark.py::BenchmarkTest::test_train_with_configs 
[gw10] PASSED tests/test_tokenization_roberta.py::RobertaTokenizationTest::test_maximum_encoding_length_single_input 
tests/test_tokenization_roberta.py::RobertaTokenizationTest::test_np_encode_plus_sent_to_model 
[gw10] SKIPPED tests/test_tokenization_roberta.py::RobertaTokenizationTest::test_np_encode_plus_sent_to_model 
tests/test_tokenization_roberta.py::RobertaTokenizationTest::test_number_of_added_tokens 
[gw10] PASSED tests/test_tokenization_roberta.py::RobertaTokenizationTest::test_number_of_added_tokens 
tests/test_tokenization_roberta.py::RobertaTokenizationTest::test_padding_to_max_length 
[gw10] PASSED tests/test_tokenization_roberta.py::RobertaTokenizationTest::test_padding_to_max_length 
[gw18] PASSED tests/test_tokenization_fast.py::WordPieceFastTokenizerTest::test_all_tokenizers 
[gw14] PASSED tests/test_tokenization_openai.py::OpenAIGPTTokenizationTest::test_add_tokens_tokenizer 
tests/test_tokenization_openai.py::OpenAIGPTTokenizationTest::test_added_tokens_do_lower_case 
tests/test_tokenization_roberta.py::RobertaTokenizationTest::test_padding_to_multiple_of 
[gw10] PASSED tests/test_tokenization_roberta.py::RobertaTokenizationTest::test_padding_to_multiple_of 
tests/test_tokenization_roberta.py::RobertaTokenizationTest::test_pickle_tokenizer 
[gw10] PASSED tests/test_tokenization_roberta.py::RobertaTokenizationTest::test_pickle_tokenizer 
tests/test_tokenization_roberta.py::RobertaTokenizationTest::test_pretokenized_inputs 
tests/test_tokenization_fast.py::WordPieceFastTokenizerTest::test_pretokenized_tokenizers 
[gw10] PASSED tests/test_tokenization_roberta.py::RobertaTokenizationTest::test_pretokenized_inputs 
tests/test_tokenization_roberta.py::RobertaTokenizationTest::test_pretrained_model_lists 
[gw10] PASSED tests/test_tokenization_roberta.py::RobertaTokenizationTest::test_pretrained_model_lists 
tests/test_tokenization_roberta.py::RobertaTokenizationTest::test_right_and_left_padding 
[gw10] PASSED tests/test_tokenization_roberta.py::RobertaTokenizationTest::test_right_and_left_padding 
tests/test_tokenization_roberta.py::RobertaTokenizationTest::test_save_and_load_tokenizer 
[gw10] PASSED tests/test_tokenization_roberta.py::RobertaTokenizationTest::test_save_and_load_tokenizer 
tests/test_tokenization_roberta.py::RobertaTokenizationTest::test_separate_tokenizers 
[gw10] PASSED tests/test_tokenization_roberta.py::RobertaTokenizationTest::test_separate_tokenizers 
tests/test_tokenization_roberta.py::RobertaTokenizationTest::test_sequence_builders 
[gw10] SKIPPED tests/test_tokenization_roberta.py::RobertaTokenizationTest::test_sequence_builders 
tests/test_tokenization_roberta.py::RobertaTokenizationTest::test_space_encoding 
[gw10] PASSED tests/test_tokenization_roberta.py::RobertaTokenizationTest::test_space_encoding 
tests/test_tokenization_roberta.py::RobertaTokenizationTest::test_special_tokens_mask 
[gw10] PASSED tests/test_tokenization_roberta.py::RobertaTokenizationTest::test_special_tokens_mask 
tests/test_tokenization_roberta.py::RobertaTokenizationTest::test_special_tokens_mask_input_pairs 
[gw6] PASSED tests/test_modeling_tf_bert.py::TFBertModelTest::test_resize_token_embeddings 
[gw10] PASSED tests/test_tokenization_roberta.py::RobertaTokenizationTest::test_special_tokens_mask_input_pairs 
tests/test_tokenization_roberta.py::RobertaTokenizationTest::test_swap_special_token 
[gw10] PASSED tests/test_tokenization_roberta.py::RobertaTokenizationTest::test_swap_special_token 
tests/test_tokenization_roberta.py::RobertaTokenizationTest::test_tf_encode_plus_sent_to_model 
[gw10] SKIPPED tests/test_tokenization_roberta.py::RobertaTokenizationTest::test_tf_encode_plus_sent_to_model 
tests/test_modeling_tf_bert.py::TFBertModelTest::test_save_load 
tests/test_tokenization_roberta.py::RobertaTokenizationTest::test_tokenizers_common_properties 
[gw10] PASSED tests/test_tokenization_roberta.py::RobertaTokenizationTest::test_tokenizers_common_properties 
tests/test_tokenization_roberta.py::RobertaTokenizationTest::test_torch_encode_plus_sent_to_model 
[gw10] SKIPPED tests/test_tokenization_roberta.py::RobertaTokenizationTest::test_torch_encode_plus_sent_to_model 
tests/test_tokenization_utils.py::TokenizerUtilsTest::test_batch_encoding_is_fast 
[gw4] PASSED tests/test_tokenization_t5.py::T5TokenizationTest::test_add_special_tokens 
tests/test_tokenization_t5.py::T5TokenizationTest::test_add_tokens_tokenizer 
[gw4] PASSED tests/test_tokenization_t5.py::T5TokenizationTest::test_add_tokens_tokenizer 
tests/test_tokenization_t5.py::T5TokenizationTest::test_added_tokens_do_lower_case 
[gw9] PASSED tests/test_tokenization_auto.py::AutoTokenizerTest::test_tokenizer_from_pretrained_identifier 
tests/test_tokenization_auto.py::AutoTokenizerTest::test_tokenizer_identifier_non_existent 
[gw4] PASSED tests/test_tokenization_t5.py::T5TokenizationTest::test_added_tokens_do_lower_case 
tests/test_tokenization_t5.py::T5TokenizationTest::test_batch_encode_plus_batch_sequence_length 
[gw4] PASSED tests/test_tokenization_t5.py::T5TokenizationTest::test_batch_encode_plus_batch_sequence_length 
tests/test_tokenization_t5.py::T5TokenizationTest::test_batch_encode_plus_padding 
[gw4] PASSED tests/test_tokenization_t5.py::T5TokenizationTest::test_batch_encode_plus_padding 
tests/test_tokenization_t5.py::T5TokenizationTest::test_batch_encode_plus_tensors 
[gw4] PASSED tests/test_tokenization_t5.py::T5TokenizationTest::test_batch_encode_plus_tensors 
tests/test_tokenization_t5.py::T5TokenizationTest::test_call 
[gw10] PASSED tests/test_tokenization_utils.py::TokenizerUtilsTest::test_batch_encoding_is_fast 
tests/test_tokenization_utils.py::TokenizerUtilsTest::test_batch_encoding_pickle 
[gw4] PASSED tests/test_tokenization_t5.py::T5TokenizationTest::test_call 
tests/test_tokenization_t5.py::T5TokenizationTest::test_conversion_reversible 
[gw4] PASSED tests/test_tokenization_t5.py::T5TokenizationTest::test_conversion_reversible 
tests/test_tokenization_t5.py::T5TokenizationTest::test_encode_decode_with_spaces 
[gw4] PASSED tests/test_tokenization_t5.py::T5TokenizationTest::test_encode_decode_with_spaces 
tests/test_tokenization_t5.py::T5TokenizationTest::test_encode_plus_with_padding 
[gw4] PASSED tests/test_tokenization_t5.py::T5TokenizationTest::test_encode_plus_with_padding 
tests/test_tokenization_t5.py::T5TokenizationTest::test_full_tokenizer 
[gw4] PASSED tests/test_tokenization_t5.py::T5TokenizationTest::test_full_tokenizer 
tests/test_tokenization_t5.py::T5TokenizationTest::test_get_vocab 
[gw4] PASSED tests/test_tokenization_t5.py::T5TokenizationTest::test_get_vocab 
tests/test_tokenization_t5.py::T5TokenizationTest::test_internal_consistency 
[gw10] PASSED tests/test_tokenization_utils.py::TokenizerUtilsTest::test_batch_encoding_pickle 
tests/test_tokenization_utils.py::TokenizerUtilsTest::test_batch_encoding_pickle_pt 
[gw0] PASSED tests/test_modeling_reformer.py::ReformerLocalAttnModelTest::test_reformer_model 
tests/test_modeling_reformer.py::ReformerLocalAttnModelTest::test_reformer_model_attn_masking 
[gw10] PASSED tests/test_tokenization_utils.py::TokenizerUtilsTest::test_batch_encoding_pickle_pt 
tests/test_tokenization_utils.py::TokenizerUtilsTest::test_batch_encoding_pickle_tf 
[gw9] PASSED tests/test_tokenization_auto.py::AutoTokenizerTest::test_tokenizer_identifier_non_existent 
tests/test_tokenization_auto.py::AutoTokenizerTest::test_tokenizer_identifier_with_correct_config 
[gw15] PASSED tests/test_modeling_transfo_xl.py::TransfoXLModelTest::test_determinism 
tests/test_modeling_transfo_xl.py::TransfoXLModelTest::test_head_pruning 
[gw15] PASSED tests/test_modeling_transfo_xl.py::TransfoXLModelTest::test_head_pruning 
tests/test_modeling_transfo_xl.py::TransfoXLModelTest::test_head_pruning_integration 
[gw15] PASSED tests/test_modeling_transfo_xl.py::TransfoXLModelTest::test_head_pruning_integration 
tests/test_modeling_transfo_xl.py::TransfoXLModelTest::test_head_pruning_save_load_from_config_init 
[gw15] PASSED tests/test_modeling_transfo_xl.py::TransfoXLModelTest::test_head_pruning_save_load_from_config_init 
tests/test_modeling_transfo_xl.py::TransfoXLModelTest::test_head_pruning_save_load_from_pretrained 
[gw15] PASSED tests/test_modeling_transfo_xl.py::TransfoXLModelTest::test_head_pruning_save_load_from_pretrained 
tests/test_modeling_transfo_xl.py::TransfoXLModelTest::test_headmasking 
[gw4] PASSED tests/test_tokenization_t5.py::T5TokenizationTest::test_internal_consistency 
tests/test_tokenization_t5.py::T5TokenizationTest::test_mask_output 
[gw4] PASSED tests/test_tokenization_t5.py::T5TokenizationTest::test_mask_output 
tests/test_tokenization_t5.py::T5TokenizationTest::test_maximum_encoding_length_pair_input 
[gw10] PASSED tests/test_tokenization_utils.py::TokenizerUtilsTest::test_batch_encoding_pickle_tf 
tests/test_tokenization_utils.py::TokenizerUtilsTest::test_pretrained_tokenizers 
[gw10] SKIPPED tests/test_tokenization_utils.py::TokenizerUtilsTest::test_pretrained_tokenizers 
tests/test_tokenization_utils.py::TokenizerUtilsTest::test_tensor_type_from_str 
[gw10] PASSED tests/test_tokenization_utils.py::TokenizerUtilsTest::test_tensor_type_from_str 
tests/test_tokenization_xlm_roberta.py::XLMRobertaTokenizationTest::test_add_special_tokens 
[gw10] PASSED tests/test_tokenization_xlm_roberta.py::XLMRobertaTokenizationTest::test_add_special_tokens 
[gw2] PASSED tests/test_modeling_tf_mobilebert.py::TFMobileBertModelTest::test_attention_outputs 
tests/test_tokenization_xlm_roberta.py::XLMRobertaTokenizationTest::test_add_tokens_tokenizer 
tests/test_modeling_tf_mobilebert.py::TFMobileBertModelTest::test_compile_tf_model 
[gw10] PASSED tests/test_tokenization_xlm_roberta.py::XLMRobertaTokenizationTest::test_add_tokens_tokenizer 
tests/test_tokenization_xlm_roberta.py::XLMRobertaTokenizationTest::test_added_tokens_do_lower_case 
[gw10] PASSED tests/test_tokenization_xlm_roberta.py::XLMRobertaTokenizationTest::test_added_tokens_do_lower_case 
tests/test_tokenization_xlm_roberta.py::XLMRobertaTokenizationTest::test_batch_encode_plus_batch_sequence_length 
[gw10] PASSED tests/test_tokenization_xlm_roberta.py::XLMRobertaTokenizationTest::test_batch_encode_plus_batch_sequence_length 
tests/test_tokenization_xlm_roberta.py::XLMRobertaTokenizationTest::test_batch_encode_plus_padding 
[gw14] PASSED tests/test_tokenization_openai.py::OpenAIGPTTokenizationTest::test_added_tokens_do_lower_case 
[gw10] PASSED tests/test_tokenization_xlm_roberta.py::XLMRobertaTokenizationTest::test_batch_encode_plus_padding 
tests/test_tokenization_xlm_roberta.py::XLMRobertaTokenizationTest::test_batch_encode_plus_tensors 
tests/test_tokenization_openai.py::OpenAIGPTTokenizationTest::test_batch_encode_plus_batch_sequence_length 
[gw10] PASSED tests/test_tokenization_xlm_roberta.py::XLMRobertaTokenizationTest::test_batch_encode_plus_tensors 
tests/test_tokenization_xlm_roberta.py::XLMRobertaTokenizationTest::test_call 
[gw10] PASSED tests/test_tokenization_xlm_roberta.py::XLMRobertaTokenizationTest::test_call 
tests/test_tokenization_xlm_roberta.py::XLMRobertaTokenizationTest::test_conversion_reversible 
[gw10] PASSED tests/test_tokenization_xlm_roberta.py::XLMRobertaTokenizationTest::test_conversion_reversible 
tests/test_tokenization_xlm_roberta.py::XLMRobertaTokenizationTest::test_encode_decode_with_spaces 
[gw10] PASSED tests/test_tokenization_xlm_roberta.py::XLMRobertaTokenizationTest::test_encode_decode_with_spaces 
tests/test_tokenization_xlm_roberta.py::XLMRobertaTokenizationTest::test_encode_plus_with_padding 
[gw10] PASSED tests/test_tokenization_xlm_roberta.py::XLMRobertaTokenizationTest::test_encode_plus_with_padding 
tests/test_tokenization_xlm_roberta.py::XLMRobertaTokenizationTest::test_full_tokenizer 
[gw10] PASSED tests/test_tokenization_xlm_roberta.py::XLMRobertaTokenizationTest::test_full_tokenizer 
tests/test_tokenization_xlm_roberta.py::XLMRobertaTokenizationTest::test_get_vocab 
[gw10] PASSED tests/test_tokenization_xlm_roberta.py::XLMRobertaTokenizationTest::test_get_vocab 
tests/test_tokenization_xlm_roberta.py::XLMRobertaTokenizationTest::test_internal_consistency 
[gw10] PASSED tests/test_tokenization_xlm_roberta.py::XLMRobertaTokenizationTest::test_internal_consistency 
tests/test_tokenization_xlm_roberta.py::XLMRobertaTokenizationTest::test_mask_output 
[gw10] PASSED tests/test_tokenization_xlm_roberta.py::XLMRobertaTokenizationTest::test_mask_output 
[gw9] PASSED tests/test_tokenization_auto.py::AutoTokenizerTest::test_tokenizer_identifier_with_correct_config 
tests/test_tokenization_xlm.py::XLMTokenizationTest::test_add_special_tokens 
tests/test_tokenization_xlm_roberta.py::XLMRobertaTokenizationTest::test_maximum_encoding_length_pair_input 
[gw12] PASSED tests/test_modeling_tf_xlnet.py::TFXLNetModelTest::test_determinism 
tests/test_modeling_tf_xlnet.py::TFXLNetModelTest::test_hidden_states_output 
[gw9] PASSED tests/test_tokenization_xlm.py::XLMTokenizationTest::test_add_special_tokens 
tests/test_tokenization_xlm.py::XLMTokenizationTest::test_add_tokens_tokenizer 
[gw9] PASSED tests/test_tokenization_xlm.py::XLMTokenizationTest::test_add_tokens_tokenizer 
tests/test_tokenization_xlm.py::XLMTokenizationTest::test_added_tokens_do_lower_case 
[gw9] PASSED tests/test_tokenization_xlm.py::XLMTokenizationTest::test_added_tokens_do_lower_case 
tests/test_tokenization_xlm.py::XLMTokenizationTest::test_batch_encode_plus_batch_sequence_length 
[gw9] PASSED tests/test_tokenization_xlm.py::XLMTokenizationTest::test_batch_encode_plus_batch_sequence_length 
tests/test_tokenization_xlm.py::XLMTokenizationTest::test_batch_encode_plus_padding 
[gw9] PASSED tests/test_tokenization_xlm.py::XLMTokenizationTest::test_batch_encode_plus_padding 
tests/test_tokenization_xlm.py::XLMTokenizationTest::test_batch_encode_plus_tensors 
[gw9] PASSED tests/test_tokenization_xlm.py::XLMTokenizationTest::test_batch_encode_plus_tensors 
tests/test_tokenization_xlm.py::XLMTokenizationTest::test_call 
[gw9] PASSED tests/test_tokenization_xlm.py::XLMTokenizationTest::test_call 
tests/test_tokenization_xlm.py::XLMTokenizationTest::test_conversion_reversible 
[gw9] PASSED tests/test_tokenization_xlm.py::XLMTokenizationTest::test_conversion_reversible 
tests/test_tokenization_xlm.py::XLMTokenizationTest::test_encode_decode_with_spaces 
[gw9] PASSED tests/test_tokenization_xlm.py::XLMTokenizationTest::test_encode_decode_with_spaces 
tests/test_tokenization_xlm.py::XLMTokenizationTest::test_encode_plus_with_padding 
[gw9] PASSED tests/test_tokenization_xlm.py::XLMTokenizationTest::test_encode_plus_with_padding 
tests/test_tokenization_xlm.py::XLMTokenizationTest::test_full_tokenizer 
[gw9] PASSED tests/test_tokenization_xlm.py::XLMTokenizationTest::test_full_tokenizer 
tests/test_tokenization_xlm.py::XLMTokenizationTest::test_get_vocab 
[gw9] PASSED tests/test_tokenization_xlm.py::XLMTokenizationTest::test_get_vocab 
tests/test_tokenization_xlm.py::XLMTokenizationTest::test_internal_consistency 
[gw9] PASSED tests/test_tokenization_xlm.py::XLMTokenizationTest::test_internal_consistency 
tests/test_tokenization_xlm.py::XLMTokenizationTest::test_mask_output 
[gw9] PASSED tests/test_tokenization_xlm.py::XLMTokenizationTest::test_mask_output 
tests/test_tokenization_xlm.py::XLMTokenizationTest::test_maximum_encoding_length_pair_input 
[gw14] PASSED tests/test_tokenization_openai.py::OpenAIGPTTokenizationTest::test_batch_encode_plus_batch_sequence_length 
tests/test_tokenization_openai.py::OpenAIGPTTokenizationTest::test_batch_encode_plus_padding 
[gw10] PASSED tests/test_tokenization_xlm_roberta.py::XLMRobertaTokenizationTest::test_maximum_encoding_length_pair_input 
tests/test_tokenization_xlm_roberta.py::XLMRobertaTokenizationTest::test_maximum_encoding_length_single_input 
[gw4] PASSED tests/test_tokenization_t5.py::T5TokenizationTest::test_maximum_encoding_length_pair_input 
tests/test_tokenization_t5.py::T5TokenizationTest::test_maximum_encoding_length_single_input 
[gw9] PASSED tests/test_tokenization_xlm.py::XLMTokenizationTest::test_maximum_encoding_length_pair_input 
tests/test_tokenization_xlm.py::XLMTokenizationTest::test_maximum_encoding_length_single_input 
[gw10] PASSED tests/test_tokenization_xlm_roberta.py::XLMRobertaTokenizationTest::test_maximum_encoding_length_single_input 
tests/test_tokenization_xlm_roberta.py::XLMRobertaTokenizationTest::test_np_encode_plus_sent_to_model 
[gw10] SKIPPED tests/test_tokenization_xlm_roberta.py::XLMRobertaTokenizationTest::test_np_encode_plus_sent_to_model 
tests/test_tokenization_xlm_roberta.py::XLMRobertaTokenizationTest::test_number_of_added_tokens 
[gw10] PASSED tests/test_tokenization_xlm_roberta.py::XLMRobertaTokenizationTest::test_number_of_added_tokens 
tests/test_tokenization_xlm_roberta.py::XLMRobertaTokenizationTest::test_padding_to_max_length 
[gw10] PASSED tests/test_tokenization_xlm_roberta.py::XLMRobertaTokenizationTest::test_padding_to_max_length 
tests/test_tokenization_xlm_roberta.py::XLMRobertaTokenizationTest::test_padding_to_multiple_of 
[gw10] PASSED tests/test_tokenization_xlm_roberta.py::XLMRobertaTokenizationTest::test_padding_to_multiple_of 
tests/test_tokenization_xlm_roberta.py::XLMRobertaTokenizationTest::test_pickle_tokenizer 
[gw10] PASSED tests/test_tokenization_xlm_roberta.py::XLMRobertaTokenizationTest::test_pickle_tokenizer 
tests/test_tokenization_xlm_roberta.py::XLMRobertaTokenizationTest::test_pretokenized_inputs 
[gw9] PASSED tests/test_tokenization_xlm.py::XLMTokenizationTest::test_maximum_encoding_length_single_input 
tests/test_tokenization_xlm.py::XLMTokenizationTest::test_np_encode_plus_sent_to_model 
[gw9] SKIPPED tests/test_tokenization_xlm.py::XLMTokenizationTest::test_np_encode_plus_sent_to_model 
tests/test_tokenization_xlm.py::XLMTokenizationTest::test_number_of_added_tokens 
[gw9] PASSED tests/test_tokenization_xlm.py::XLMTokenizationTest::test_number_of_added_tokens 
tests/test_tokenization_xlm.py::XLMTokenizationTest::test_padding_to_max_length 
[gw9] PASSED tests/test_tokenization_xlm.py::XLMTokenizationTest::test_padding_to_max_length 
tests/test_tokenization_xlm.py::XLMTokenizationTest::test_padding_to_multiple_of 
[gw9] PASSED tests/test_tokenization_xlm.py::XLMTokenizationTest::test_padding_to_multiple_of 
tests/test_tokenization_xlm.py::XLMTokenizationTest::test_pickle_tokenizer 
[gw9] PASSED tests/test_tokenization_xlm.py::XLMTokenizationTest::test_pickle_tokenizer 
tests/test_tokenization_xlm.py::XLMTokenizationTest::test_pretokenized_inputs 
[gw10] PASSED tests/test_tokenization_xlm_roberta.py::XLMRobertaTokenizationTest::test_pretokenized_inputs 
tests/test_tokenization_xlm_roberta.py::XLMRobertaTokenizationTest::test_pretrained_model_lists 
[gw10] PASSED tests/test_tokenization_xlm_roberta.py::XLMRobertaTokenizationTest::test_pretrained_model_lists 
tests/test_tokenization_xlm_roberta.py::XLMRobertaTokenizationTest::test_right_and_left_padding 
[gw10] PASSED tests/test_tokenization_xlm_roberta.py::XLMRobertaTokenizationTest::test_right_and_left_padding 
tests/test_tokenization_xlm_roberta.py::XLMRobertaTokenizationTest::test_save_and_load_tokenizer 
[gw9] PASSED tests/test_tokenization_xlm.py::XLMTokenizationTest::test_pretokenized_inputs 
tests/test_tokenization_xlm.py::XLMTokenizationTest::test_pretrained_model_lists 
[gw9] PASSED tests/test_tokenization_xlm.py::XLMTokenizationTest::test_pretrained_model_lists 
tests/test_tokenization_xlm.py::XLMTokenizationTest::test_right_and_left_padding 
[gw9] PASSED tests/test_tokenization_xlm.py::XLMTokenizationTest::test_right_and_left_padding 
tests/test_tokenization_xlm.py::XLMTokenizationTest::test_save_and_load_tokenizer 
[gw10] PASSED tests/test_tokenization_xlm_roberta.py::XLMRobertaTokenizationTest::test_save_and_load_tokenizer 
tests/test_tokenization_xlm_roberta.py::XLMRobertaTokenizationTest::test_separate_tokenizers 
[gw9] PASSED tests/test_tokenization_xlm.py::XLMTokenizationTest::test_save_and_load_tokenizer 
tests/test_tokenization_xlm.py::XLMTokenizationTest::test_separate_tokenizers 
[gw9] PASSED tests/test_tokenization_xlm.py::XLMTokenizationTest::test_separate_tokenizers 
[gw10] PASSED tests/test_tokenization_xlm_roberta.py::XLMRobertaTokenizationTest::test_separate_tokenizers 
tests/test_tokenization_xlm_roberta.py::XLMRobertaTokenizationTest::test_special_tokens_mask 
tests/test_tokenization_xlm.py::XLMTokenizationTest::test_sequence_builders 
[gw9] SKIPPED tests/test_tokenization_xlm.py::XLMTokenizationTest::test_sequence_builders 
tests/test_tokenization_xlm.py::XLMTokenizationTest::test_special_tokens_mask 
[gw9] PASSED tests/test_tokenization_xlm.py::XLMTokenizationTest::test_special_tokens_mask 
tests/test_tokenization_xlm.py::XLMTokenizationTest::test_special_tokens_mask_input_pairs 
[gw9] PASSED tests/test_tokenization_xlm.py::XLMTokenizationTest::test_special_tokens_mask_input_pairs 
tests/test_tokenization_xlm.py::XLMTokenizationTest::test_swap_special_token 
[gw10] PASSED tests/test_tokenization_xlm_roberta.py::XLMRobertaTokenizationTest::test_special_tokens_mask 
tests/test_tokenization_xlm_roberta.py::XLMRobertaTokenizationTest::test_special_tokens_mask_input_pairs 
[gw9] PASSED tests/test_tokenization_xlm.py::XLMTokenizationTest::test_swap_special_token 
tests/test_tokenization_xlm.py::XLMTokenizationTest::test_tf_encode_plus_sent_to_model 
[gw10] PASSED tests/test_tokenization_xlm_roberta.py::XLMRobertaTokenizationTest::test_special_tokens_mask_input_pairs 
tests/test_tokenization_xlm_roberta.py::XLMRobertaTokenizationTest::test_swap_special_token 
[gw10] PASSED tests/test_tokenization_xlm_roberta.py::XLMRobertaTokenizationTest::test_swap_special_token 
[gw9] SKIPPED tests/test_tokenization_xlm.py::XLMTokenizationTest::test_tf_encode_plus_sent_to_model 
tests/test_tokenization_xlm_roberta.py::XLMRobertaTokenizationTest::test_tf_encode_plus_sent_to_model 
[gw10] SKIPPED tests/test_tokenization_xlm_roberta.py::XLMRobertaTokenizationTest::test_tf_encode_plus_sent_to_model 
tests/test_tokenization_xlm_roberta.py::XLMRobertaTokenizationTest::test_tokenization_base_easy_symbols 
[gw10] SKIPPED tests/test_tokenization_xlm_roberta.py::XLMRobertaTokenizationTest::test_tokenization_base_easy_symbols 
tests/test_tokenization_xlm.py::XLMTokenizationTest::test_tokenizers_common_properties 
[gw9] PASSED tests/test_tokenization_xlm.py::XLMTokenizationTest::test_tokenizers_common_properties 
tests/test_tokenization_xlm.py::XLMTokenizationTest::test_torch_encode_plus_sent_to_model 
tests/test_tokenization_xlm_roberta.py::XLMRobertaTokenizationTest::test_tokenization_base_hard_symbols 
[gw10] SKIPPED tests/test_tokenization_xlm_roberta.py::XLMRobertaTokenizationTest::test_tokenization_base_hard_symbols 
tests/test_tokenization_xlm_roberta.py::XLMRobertaTokenizationTest::test_tokenizers_common_properties 
[gw9] SKIPPED tests/test_tokenization_xlm.py::XLMTokenizationTest::test_torch_encode_plus_sent_to_model 
tests/test_tokenization_xlnet.py::XLNetTokenizationTest::test_add_special_tokens 
[gw10] PASSED tests/test_tokenization_xlm_roberta.py::XLMRobertaTokenizationTest::test_tokenizers_common_properties 
tests/test_tokenization_xlm_roberta.py::XLMRobertaTokenizationTest::test_torch_encode_plus_sent_to_model 
[gw10] SKIPPED tests/test_tokenization_xlm_roberta.py::XLMRobertaTokenizationTest::test_torch_encode_plus_sent_to_model 
tests/test_trainer.py::DataCollatorIntegrationTest::test_default_classification 
[gw9] PASSED tests/test_tokenization_xlnet.py::XLNetTokenizationTest::test_add_special_tokens 
tests/test_tokenization_xlnet.py::XLNetTokenizationTest::test_add_tokens_tokenizer 
[gw9] PASSED tests/test_tokenization_xlnet.py::XLNetTokenizationTest::test_add_tokens_tokenizer 
tests/test_tokenization_xlnet.py::XLNetTokenizationTest::test_added_tokens_do_lower_case 
[gw9] PASSED tests/test_tokenization_xlnet.py::XLNetTokenizationTest::test_added_tokens_do_lower_case 
tests/test_tokenization_xlnet.py::XLNetTokenizationTest::test_batch_encode_plus_batch_sequence_length 
[gw9] PASSED tests/test_tokenization_xlnet.py::XLNetTokenizationTest::test_batch_encode_plus_batch_sequence_length 
tests/test_tokenization_xlnet.py::XLNetTokenizationTest::test_batch_encode_plus_padding 
[gw9] PASSED tests/test_tokenization_xlnet.py::XLNetTokenizationTest::test_batch_encode_plus_padding 
tests/test_tokenization_xlnet.py::XLNetTokenizationTest::test_batch_encode_plus_tensors 
[gw9] PASSED tests/test_tokenization_xlnet.py::XLNetTokenizationTest::test_batch_encode_plus_tensors 
tests/test_tokenization_xlnet.py::XLNetTokenizationTest::test_call 
[gw9] PASSED tests/test_tokenization_xlnet.py::XLNetTokenizationTest::test_call 
tests/test_tokenization_xlnet.py::XLNetTokenizationTest::test_conversion_reversible 
[gw9] PASSED tests/test_tokenization_xlnet.py::XLNetTokenizationTest::test_conversion_reversible 
tests/test_tokenization_xlnet.py::XLNetTokenizationTest::test_encode_decode_with_spaces 
[gw9] PASSED tests/test_tokenization_xlnet.py::XLNetTokenizationTest::test_encode_decode_with_spaces 
tests/test_tokenization_xlnet.py::XLNetTokenizationTest::test_encode_plus_with_padding 
[gw9] PASSED tests/test_tokenization_xlnet.py::XLNetTokenizationTest::test_encode_plus_with_padding 
tests/test_tokenization_xlnet.py::XLNetTokenizationTest::test_full_tokenizer 
[gw9] PASSED tests/test_tokenization_xlnet.py::XLNetTokenizationTest::test_full_tokenizer 
tests/test_tokenization_xlnet.py::XLNetTokenizationTest::test_get_vocab 
[gw9] PASSED tests/test_tokenization_xlnet.py::XLNetTokenizationTest::test_get_vocab 
tests/test_tokenization_xlnet.py::XLNetTokenizationTest::test_internal_consistency 
[gw10] PASSED tests/test_trainer.py::DataCollatorIntegrationTest::test_default_classification 
tests/test_trainer.py::DataCollatorIntegrationTest::test_default_regression 
[gw9] PASSED tests/test_tokenization_xlnet.py::XLNetTokenizationTest::test_internal_consistency 
tests/test_tokenization_xlnet.py::XLNetTokenizationTest::test_mask_output 
[gw9] PASSED tests/test_tokenization_xlnet.py::XLNetTokenizationTest::test_mask_output 
tests/test_tokenization_xlnet.py::XLNetTokenizationTest::test_maximum_encoding_length_pair_input 
[gw21] PASSED tests/test_modeling_xlm.py::XLMModelTest::test_hidden_states_output 
tests/test_modeling_xlm.py::XLMModelTest::test_initialization 
[gw14] PASSED tests/test_tokenization_openai.py::OpenAIGPTTokenizationTest::test_batch_encode_plus_padding 
tests/test_tokenization_openai.py::OpenAIGPTTokenizationTest::test_batch_encode_plus_tensors 
[gw4] PASSED tests/test_tokenization_t5.py::T5TokenizationTest::test_maximum_encoding_length_single_input 
tests/test_tokenization_t5.py::T5TokenizationTest::test_np_encode_plus_sent_to_model 
[gw4] SKIPPED tests/test_tokenization_t5.py::T5TokenizationTest::test_np_encode_plus_sent_to_model 
tests/test_tokenization_t5.py::T5TokenizationTest::test_number_of_added_tokens 
[gw4] PASSED tests/test_tokenization_t5.py::T5TokenizationTest::test_number_of_added_tokens 
tests/test_tokenization_t5.py::T5TokenizationTest::test_padding_to_max_length 
[gw4] PASSED tests/test_tokenization_t5.py::T5TokenizationTest::test_padding_to_max_length 
tests/test_tokenization_t5.py::T5TokenizationTest::test_padding_to_multiple_of 
[gw21] PASSED tests/test_modeling_xlm.py::XLMModelTest::test_initialization 
tests/test_modeling_xlm.py::XLMModelTest::test_inputs_embeds 
[gw4] PASSED tests/test_tokenization_t5.py::T5TokenizationTest::test_padding_to_multiple_of 
tests/test_tokenization_t5.py::T5TokenizationTest::test_pickle_tokenizer 
[gw4] PASSED tests/test_tokenization_t5.py::T5TokenizationTest::test_pickle_tokenizer 
tests/test_tokenization_t5.py::T5TokenizationTest::test_pretokenized_inputs 
[gw5] PASSED tests/test_modeling_tf_xlm.py::TFXLMModelTest::test_lm_head_model_random_beam_search_generate 
tests/test_modeling_tf_xlm.py::TFXLMModelTest::test_lm_head_model_random_no_beam_search_generate 
[gw18] PASSED tests/test_tokenization_fast.py::WordPieceFastTokenizerTest::test_pretokenized_tokenizers 
tests/test_tokenization_fast.py::RobertaFastTokenizerTest::test_all_tokenizers 
[gw3] PASSED tests/test_modeling_tf_t5.py::TFT5ModelTest::test_lm_head_model_random_beam_search_generate 
tests/test_modeling_tf_t5.py::TFT5ModelTest::test_lm_head_model_random_no_beam_search_generate 
[gw9] PASSED tests/test_tokenization_xlnet.py::XLNetTokenizationTest::test_maximum_encoding_length_pair_input 
tests/test_tokenization_xlnet.py::XLNetTokenizationTest::test_maximum_encoding_length_single_input 
[gw15] PASSED tests/test_modeling_transfo_xl.py::TransfoXLModelTest::test_headmasking 
tests/test_modeling_transfo_xl.py::TransfoXLModelTest::test_hidden_states_output 
[gw14] PASSED tests/test_tokenization_openai.py::OpenAIGPTTokenizationTest::test_batch_encode_plus_tensors 
tests/test_tokenization_openai.py::OpenAIGPTTokenizationTest::test_call 
[gw10] PASSED tests/test_trainer.py::DataCollatorIntegrationTest::test_default_regression 
tests/test_trainer.py::DataCollatorIntegrationTest::test_default_with_dict 
[gw10] PASSED tests/test_trainer.py::DataCollatorIntegrationTest::test_default_with_dict 
tests/test_trainer.py::DataCollatorIntegrationTest::test_default_with_no_labels 
[gw10] PASSED tests/test_trainer.py::DataCollatorIntegrationTest::test_default_with_no_labels 
tests/test_trainer.py::DataCollatorIntegrationTest::test_lm_tokenizer_with_padding 
[gw9] PASSED tests/test_tokenization_xlnet.py::XLNetTokenizationTest::test_maximum_encoding_length_single_input 
tests/test_tokenization_xlnet.py::XLNetTokenizationTest::test_np_encode_plus_sent_to_model 
[gw9] SKIPPED tests/test_tokenization_xlnet.py::XLNetTokenizationTest::test_np_encode_plus_sent_to_model 
tests/test_tokenization_xlnet.py::XLNetTokenizationTest::test_number_of_added_tokens 
[gw9] PASSED tests/test_tokenization_xlnet.py::XLNetTokenizationTest::test_number_of_added_tokens 
tests/test_tokenization_xlnet.py::XLNetTokenizationTest::test_padding_to_max_length 
[gw10] PASSED tests/test_trainer.py::DataCollatorIntegrationTest::test_lm_tokenizer_with_padding 
tests/test_trainer.py::DataCollatorIntegrationTest::test_lm_tokenizer_without_padding 
[gw9] PASSED tests/test_tokenization_xlnet.py::XLNetTokenizationTest::test_padding_to_max_length 
tests/test_tokenization_xlnet.py::XLNetTokenizationTest::test_padding_to_multiple_of 
[gw9] PASSED tests/test_tokenization_xlnet.py::XLNetTokenizationTest::test_padding_to_multiple_of 
tests/test_tokenization_xlnet.py::XLNetTokenizationTest::test_pickle_tokenizer 
[gw9] PASSED tests/test_tokenization_xlnet.py::XLNetTokenizationTest::test_pickle_tokenizer 
tests/test_tokenization_xlnet.py::XLNetTokenizationTest::test_pretokenized_inputs 
[gw4] PASSED tests/test_tokenization_t5.py::T5TokenizationTest::test_pretokenized_inputs 
tests/test_tokenization_t5.py::T5TokenizationTest::test_pretrained_model_lists 
[gw4] PASSED tests/test_tokenization_t5.py::T5TokenizationTest::test_pretrained_model_lists 
tests/test_tokenization_t5.py::T5TokenizationTest::test_right_and_left_padding 
[gw4] PASSED tests/test_tokenization_t5.py::T5TokenizationTest::test_right_and_left_padding 
tests/test_tokenization_t5.py::T5TokenizationTest::test_save_and_load_tokenizer 
[gw14] PASSED tests/test_tokenization_openai.py::OpenAIGPTTokenizationTest::test_call 
tests/test_tokenization_openai.py::OpenAIGPTTokenizationTest::test_conversion_reversible 
[gw4] PASSED tests/test_tokenization_t5.py::T5TokenizationTest::test_save_and_load_tokenizer 
tests/test_tokenization_t5.py::T5TokenizationTest::test_separate_tokenizers 
[gw4] PASSED tests/test_tokenization_t5.py::T5TokenizationTest::test_separate_tokenizers 
tests/test_tokenization_t5.py::T5TokenizationTest::test_special_tokens_mask 
[gw9] PASSED tests/test_tokenization_xlnet.py::XLNetTokenizationTest::test_pretokenized_inputs 
tests/test_tokenization_xlnet.py::XLNetTokenizationTest::test_pretrained_model_lists 
[gw9] PASSED tests/test_tokenization_xlnet.py::XLNetTokenizationTest::test_pretrained_model_lists 
tests/test_tokenization_xlnet.py::XLNetTokenizationTest::test_right_and_left_padding 
[gw4] PASSED tests/test_tokenization_t5.py::T5TokenizationTest::test_special_tokens_mask 
[gw9] PASSED tests/test_tokenization_xlnet.py::XLNetTokenizationTest::test_right_and_left_padding 
tests/test_tokenization_xlnet.py::XLNetTokenizationTest::test_save_and_load_tokenizer 
tests/test_tokenization_t5.py::T5TokenizationTest::test_special_tokens_mask_input_pairs 
[gw4] PASSED tests/test_tokenization_t5.py::T5TokenizationTest::test_special_tokens_mask_input_pairs 
tests/test_tokenization_t5.py::T5TokenizationTest::test_swap_special_token 
[gw4] PASSED tests/test_tokenization_t5.py::T5TokenizationTest::test_swap_special_token 
tests/test_tokenization_t5.py::T5TokenizationTest::test_tf_encode_plus_sent_to_model 
[gw4] SKIPPED tests/test_tokenization_t5.py::T5TokenizationTest::test_tf_encode_plus_sent_to_model 
tests/test_tokenization_t5.py::T5TokenizationTest::test_tokenizers_common_properties 
[gw9] PASSED tests/test_tokenization_xlnet.py::XLNetTokenizationTest::test_save_and_load_tokenizer 
tests/test_tokenization_xlnet.py::XLNetTokenizationTest::test_separate_tokenizers 
[gw4] PASSED tests/test_tokenization_t5.py::T5TokenizationTest::test_tokenizers_common_properties 
tests/test_tokenization_t5.py::T5TokenizationTest::test_torch_encode_plus_sent_to_model 
[gw4] SKIPPED tests/test_tokenization_t5.py::T5TokenizationTest::test_torch_encode_plus_sent_to_model 
[gw9] PASSED tests/test_tokenization_xlnet.py::XLNetTokenizationTest::test_separate_tokenizers 
tests/test_tokenization_xlnet.py::XLNetTokenizationTest::test_sequence_builders 
[gw9] SKIPPED tests/test_tokenization_xlnet.py::XLNetTokenizationTest::test_sequence_builders 
tests/test_tokenization_xlnet.py::XLNetTokenizationTest::test_special_tokens_mask 
[gw9] PASSED tests/test_tokenization_xlnet.py::XLNetTokenizationTest::test_special_tokens_mask 
tests/test_tokenization_xlnet.py::XLNetTokenizationTest::test_special_tokens_mask_input_pairs 
[gw9] PASSED tests/test_tokenization_xlnet.py::XLNetTokenizationTest::test_special_tokens_mask_input_pairs 
tests/test_tokenization_xlnet.py::XLNetTokenizationTest::test_swap_special_token 
[gw9] PASSED tests/test_tokenization_xlnet.py::XLNetTokenizationTest::test_swap_special_token 
tests/test_tokenization_xlnet.py::XLNetTokenizationTest::test_tf_encode_plus_sent_to_model 
[gw9] SKIPPED tests/test_tokenization_xlnet.py::XLNetTokenizationTest::test_tf_encode_plus_sent_to_model 
tests/test_tokenization_xlnet.py::XLNetTokenizationTest::test_tokenizer_lower 
[gw9] PASSED tests/test_tokenization_xlnet.py::XLNetTokenizationTest::test_tokenizer_lower 
tests/test_tokenization_xlnet.py::XLNetTokenizationTest::test_tokenizer_no_lower 
[gw9] PASSED tests/test_tokenization_xlnet.py::XLNetTokenizationTest::test_tokenizer_no_lower 
tests/test_tokenization_xlnet.py::XLNetTokenizationTest::test_tokenizers_common_properties 
[gw9] PASSED tests/test_tokenization_xlnet.py::XLNetTokenizationTest::test_tokenizers_common_properties 
tests/test_tokenization_xlnet.py::XLNetTokenizationTest::test_torch_encode_plus_sent_to_model 
[gw9] SKIPPED tests/test_tokenization_xlnet.py::XLNetTokenizationTest::test_torch_encode_plus_sent_to_model 
[gw10] PASSED tests/test_trainer.py::DataCollatorIntegrationTest::test_lm_tokenizer_without_padding 
tests/test_trainer.py::TrainerIntegrationTest::test_trainer_eval_lm 
[gw0] PASSED tests/test_modeling_reformer.py::ReformerLocalAttnModelTest::test_reformer_model_attn_masking 
tests/test_modeling_reformer.py::ReformerLocalAttnModelTest::test_reformer_model_fp16_forward 
[gw0] SKIPPED tests/test_modeling_reformer.py::ReformerLocalAttnModelTest::test_reformer_model_fp16_forward 
tests/test_modeling_reformer.py::ReformerLocalAttnModelTest::test_reformer_model_fp16_generate 
[gw0] SKIPPED tests/test_modeling_reformer.py::ReformerLocalAttnModelTest::test_reformer_model_fp16_generate 
tests/test_modeling_reformer.py::ReformerLocalAttnModelTest::test_reformer_no_chunking 
[gw14] PASSED tests/test_tokenization_openai.py::OpenAIGPTTokenizationTest::test_conversion_reversible 
tests/test_tokenization_openai.py::OpenAIGPTTokenizationTest::test_encode_decode_with_spaces 
[gw10] PASSED tests/test_trainer.py::TrainerIntegrationTest::test_trainer_eval_lm 
tests/test_trainer.py::TrainerIntegrationTest::test_trainer_eval_mrpc 
[gw12] PASSED tests/test_modeling_tf_xlnet.py::TFXLNetModelTest::test_hidden_states_output 
tests/test_modeling_tf_xlnet.py::TFXLNetModelTest::test_initialization 
[gw12] PASSED tests/test_modeling_tf_xlnet.py::TFXLNetModelTest::test_initialization 
tests/test_modeling_tf_xlnet.py::TFXLNetModelTest::test_inputs_embeds 
[gw20] PASSED tests/test_modeling_xlnet.py::XLNetModelTest::test_headmasking 
tests/test_modeling_xlnet.py::XLNetModelTest::test_hidden_states_output 
[gw14] PASSED tests/test_tokenization_openai.py::OpenAIGPTTokenizationTest::test_encode_decode_with_spaces 
tests/test_tokenization_openai.py::OpenAIGPTTokenizationTest::test_encode_plus_with_padding 
[gw0] PASSED tests/test_modeling_reformer.py::ReformerLocalAttnModelTest::test_reformer_no_chunking 
tests/test_modeling_reformer.py::ReformerLocalAttnModelTest::test_reformer_with_lm 
[gw5] PASSED tests/test_modeling_tf_xlm.py::TFXLMModelTest::test_lm_head_model_random_no_beam_search_generate 
tests/test_modeling_tf_xlm.py::TFXLMModelTest::test_loss_computation 
[gw7] PASSED tests/test_modeling_tf_roberta.py::TFRobertaModelTest::test_pt_tf_model_equivalence 
tests/test_modeling_tf_roberta.py::TFRobertaModelTest::test_resize_token_embeddings 
[gw21] PASSED tests/test_modeling_xlm.py::XLMModelTest::test_inputs_embeds 
tests/test_modeling_xlm.py::XLMModelTest::test_lm_head_model_random_beam_search_generate 
[gw14] PASSED tests/test_tokenization_openai.py::OpenAIGPTTokenizationTest::test_encode_plus_with_padding 
tests/test_tokenization_openai.py::OpenAIGPTTokenizationTest::test_full_tokenizer 
[gw15] PASSED tests/test_modeling_transfo_xl.py::TransfoXLModelTest::test_hidden_states_output 
tests/test_modeling_transfo_xl.py::TransfoXLModelTest::test_initialization 
[gw15] PASSED tests/test_modeling_transfo_xl.py::TransfoXLModelTest::test_initialization 
tests/test_modeling_transfo_xl.py::TransfoXLModelTest::test_inputs_embeds 
[gw14] PASSED tests/test_tokenization_openai.py::OpenAIGPTTokenizationTest::test_full_tokenizer 
tests/test_tokenization_openai.py::OpenAIGPTTokenizationTest::test_get_vocab 
[gw0] PASSED tests/test_modeling_reformer.py::ReformerLocalAttnModelTest::test_reformer_with_lm 
tests/test_modeling_reformer.py::ReformerLocalAttnModelTest::test_reformer_with_mlm 
[gw23] PASSED tests/test_modeling_openai.py::OpenAIGPTModelTest::test_lm_head_model_random_beam_search_generate 
tests/test_modeling_openai.py::OpenAIGPTModelTest::test_lm_head_model_random_no_beam_search_generate 
[gw14] PASSED tests/test_tokenization_openai.py::OpenAIGPTTokenizationTest::test_get_vocab 
tests/test_tokenization_openai.py::OpenAIGPTTokenizationTest::test_internal_consistency 
[gw12] PASSED tests/test_modeling_tf_xlnet.py::TFXLNetModelTest::test_inputs_embeds 
tests/test_modeling_tf_xlnet.py::TFXLNetModelTest::test_keras_save_load 
[gw11] PASSED tests/test_modeling_bert.py::BertModelTest::test_torchscript 
tests/test_modeling_bert.py::BertModelTest::test_torchscript_output_attentions 
[gw16] PASSED tests/test_modeling_electra.py::ElectraModelTest::test_torchscript_output_hidden_state 
tests/test_pipelines.py::DefaultArgumentHandlerTestCase::test_args 
[gw16] PASSED tests/test_pipelines.py::DefaultArgumentHandlerTestCase::test_args 
tests/test_pipelines.py::DefaultArgumentHandlerTestCase::test_kwargs_data 
[gw16] PASSED tests/test_pipelines.py::DefaultArgumentHandlerTestCase::test_kwargs_data 
tests/test_pipelines.py::DefaultArgumentHandlerTestCase::test_kwargs_x 
[gw16] PASSED tests/test_pipelines.py::DefaultArgumentHandlerTestCase::test_kwargs_x 
tests/test_pipelines.py::DefaultArgumentHandlerTestCase::test_multi_kwargs 
[gw16] PASSED tests/test_pipelines.py::DefaultArgumentHandlerTestCase::test_multi_kwargs 
tests/test_pipelines.py::MonoColumnInputTestCase::test_integration_torch_summarization 
[gw16] SKIPPED tests/test_pipelines.py::MonoColumnInputTestCase::test_integration_torch_summarization 
tests/test_pipelines.py::MonoColumnInputTestCase::test_ner_grouped 
[gw6] PASSED tests/test_modeling_tf_bert.py::TFBertModelTest::test_save_load 
tests/test_tokenization_gpt2.py::GPT2TokenizationTest::test_add_special_tokens 
[gw6] PASSED tests/test_tokenization_gpt2.py::GPT2TokenizationTest::test_add_special_tokens 
tests/test_tokenization_gpt2.py::GPT2TokenizationTest::test_add_tokens_tokenizer 
[gw6] PASSED tests/test_tokenization_gpt2.py::GPT2TokenizationTest::test_add_tokens_tokenizer 
tests/test_tokenization_gpt2.py::GPT2TokenizationTest::test_added_tokens_do_lower_case 
[gw6] PASSED tests/test_tokenization_gpt2.py::GPT2TokenizationTest::test_added_tokens_do_lower_case 
tests/test_tokenization_gpt2.py::GPT2TokenizationTest::test_batch_encode_plus_batch_sequence_length 
[gw6] PASSED tests/test_tokenization_gpt2.py::GPT2TokenizationTest::test_batch_encode_plus_batch_sequence_length 
tests/test_tokenization_gpt2.py::GPT2TokenizationTest::test_batch_encode_plus_padding 
[gw6] PASSED tests/test_tokenization_gpt2.py::GPT2TokenizationTest::test_batch_encode_plus_padding 
tests/test_tokenization_gpt2.py::GPT2TokenizationTest::test_batch_encode_plus_tensors 
[gw6] PASSED tests/test_tokenization_gpt2.py::GPT2TokenizationTest::test_batch_encode_plus_tensors 
tests/test_tokenization_gpt2.py::GPT2TokenizationTest::test_call 
[gw3] PASSED tests/test_modeling_tf_t5.py::TFT5ModelTest::test_lm_head_model_random_no_beam_search_generate 
tests/test_modeling_tf_t5.py::TFT5ModelTest::test_loss_computation 
[gw6] PASSED tests/test_tokenization_gpt2.py::GPT2TokenizationTest::test_call 
tests/test_tokenization_gpt2.py::GPT2TokenizationTest::test_conversion_reversible 
[gw6] PASSED tests/test_tokenization_gpt2.py::GPT2TokenizationTest::test_conversion_reversible 
tests/test_tokenization_gpt2.py::GPT2TokenizationTest::test_encode_decode_with_spaces 
[gw6] PASSED tests/test_tokenization_gpt2.py::GPT2TokenizationTest::test_encode_decode_with_spaces 
tests/test_tokenization_gpt2.py::GPT2TokenizationTest::test_encode_plus_with_padding 
[gw6] PASSED tests/test_tokenization_gpt2.py::GPT2TokenizationTest::test_encode_plus_with_padding 
tests/test_tokenization_gpt2.py::GPT2TokenizationTest::test_full_tokenizer 
[gw6] PASSED tests/test_tokenization_gpt2.py::GPT2TokenizationTest::test_full_tokenizer 
tests/test_tokenization_gpt2.py::GPT2TokenizationTest::test_get_vocab 
[gw6] PASSED tests/test_tokenization_gpt2.py::GPT2TokenizationTest::test_get_vocab 
tests/test_tokenization_gpt2.py::GPT2TokenizationTest::test_internal_consistency 
[gw6] PASSED tests/test_tokenization_gpt2.py::GPT2TokenizationTest::test_internal_consistency 
tests/test_tokenization_gpt2.py::GPT2TokenizationTest::test_mask_output 
[gw5] PASSED tests/test_modeling_tf_xlm.py::TFXLMModelTest::test_loss_computation 
[gw6] PASSED tests/test_tokenization_gpt2.py::GPT2TokenizationTest::test_mask_output 
tests/test_tokenization_gpt2.py::GPT2TokenizationTest::test_maximum_encoding_length_pair_input 
tests/test_modeling_tf_xlm.py::TFXLMModelTest::test_model_common_attributes 
[gw15] PASSED tests/test_modeling_transfo_xl.py::TransfoXLModelTest::test_inputs_embeds 
tests/test_modeling_transfo_xl.py::TransfoXLModelTest::test_lm_head_model_random_beam_search_generate 
[gw14] PASSED tests/test_tokenization_openai.py::OpenAIGPTTokenizationTest::test_internal_consistency 
tests/test_tokenization_openai.py::OpenAIGPTTokenizationTest::test_mask_output 
[gw6] PASSED tests/test_tokenization_gpt2.py::GPT2TokenizationTest::test_maximum_encoding_length_pair_input 
tests/test_tokenization_gpt2.py::GPT2TokenizationTest::test_maximum_encoding_length_single_input 
[gw0] PASSED tests/test_modeling_reformer.py::ReformerLocalAttnModelTest::test_reformer_with_mlm 
tests/test_modeling_reformer.py::ReformerLocalAttnModelTest::test_resize_tokens_embeddings 
[gw6] PASSED tests/test_tokenization_gpt2.py::GPT2TokenizationTest::test_maximum_encoding_length_single_input 
tests/test_tokenization_gpt2.py::GPT2TokenizationTest::test_np_encode_plus_sent_to_model 
[gw6] SKIPPED tests/test_tokenization_gpt2.py::GPT2TokenizationTest::test_np_encode_plus_sent_to_model 
tests/test_tokenization_gpt2.py::GPT2TokenizationTest::test_number_of_added_tokens 
[gw6] PASSED tests/test_tokenization_gpt2.py::GPT2TokenizationTest::test_number_of_added_tokens 
tests/test_tokenization_gpt2.py::GPT2TokenizationTest::test_padding_to_max_length 
[gw6] PASSED tests/test_tokenization_gpt2.py::GPT2TokenizationTest::test_padding_to_max_length 
tests/test_tokenization_gpt2.py::GPT2TokenizationTest::test_padding_to_multiple_of 
[gw6] SKIPPED tests/test_tokenization_gpt2.py::GPT2TokenizationTest::test_padding_to_multiple_of 
tests/test_tokenization_gpt2.py::GPT2TokenizationTest::test_pickle_tokenizer 
[gw6] PASSED tests/test_tokenization_gpt2.py::GPT2TokenizationTest::test_pickle_tokenizer 
tests/test_tokenization_gpt2.py::GPT2TokenizationTest::test_pretokenized_inputs 
[gw6] PASSED tests/test_tokenization_gpt2.py::GPT2TokenizationTest::test_pretokenized_inputs 
tests/test_tokenization_gpt2.py::GPT2TokenizationTest::test_pretrained_model_lists 
[gw6] PASSED tests/test_tokenization_gpt2.py::GPT2TokenizationTest::test_pretrained_model_lists 
tests/test_tokenization_gpt2.py::GPT2TokenizationTest::test_right_and_left_padding 
[gw6] PASSED tests/test_tokenization_gpt2.py::GPT2TokenizationTest::test_right_and_left_padding 
tests/test_tokenization_gpt2.py::GPT2TokenizationTest::test_rust_and_python_full_tokenizers 
[gw6] PASSED tests/test_tokenization_gpt2.py::GPT2TokenizationTest::test_rust_and_python_full_tokenizers 
[gw3] PASSED tests/test_modeling_tf_t5.py::TFT5ModelTest::test_loss_computation 
tests/test_tokenization_gpt2.py::GPT2TokenizationTest::test_save_and_load_tokenizer 
tests/test_modeling_tf_t5.py::TFT5ModelTest::test_model_common_attributes 
[gw18] PASSED tests/test_tokenization_fast.py::RobertaFastTokenizerTest::test_all_tokenizers 
[gw6] PASSED tests/test_tokenization_gpt2.py::GPT2TokenizationTest::test_save_and_load_tokenizer 
tests/test_tokenization_gpt2.py::GPT2TokenizationTest::test_separate_tokenizers 
[gw6] PASSED tests/test_tokenization_gpt2.py::GPT2TokenizationTest::test_separate_tokenizers 
tests/test_tokenization_gpt2.py::GPT2TokenizationTest::test_special_tokens_mask 
[gw6] PASSED tests/test_tokenization_gpt2.py::GPT2TokenizationTest::test_special_tokens_mask 
tests/test_tokenization_gpt2.py::GPT2TokenizationTest::test_special_tokens_mask_input_pairs 
tests/test_tokenization_fast.py::RobertaFastTokenizerTest::test_pretokenized_tokenizers 
[gw6] PASSED tests/test_tokenization_gpt2.py::GPT2TokenizationTest::test_special_tokens_mask_input_pairs 
tests/test_tokenization_gpt2.py::GPT2TokenizationTest::test_swap_special_token 
[gw6] PASSED tests/test_tokenization_gpt2.py::GPT2TokenizationTest::test_swap_special_token 
tests/test_tokenization_gpt2.py::GPT2TokenizationTest::test_tf_encode_plus_sent_to_model 
[gw6] SKIPPED tests/test_tokenization_gpt2.py::GPT2TokenizationTest::test_tf_encode_plus_sent_to_model 
tests/test_tokenization_gpt2.py::GPT2TokenizationTest::test_tokenizers_common_properties 
[gw6] PASSED tests/test_tokenization_gpt2.py::GPT2TokenizationTest::test_tokenizers_common_properties 
tests/test_tokenization_gpt2.py::GPT2TokenizationTest::test_torch_encode_plus_sent_to_model 
[gw6] SKIPPED tests/test_tokenization_gpt2.py::GPT2TokenizationTest::test_torch_encode_plus_sent_to_model 
[gw14] PASSED tests/test_tokenization_openai.py::OpenAIGPTTokenizationTest::test_mask_output 
tests/test_tokenization_openai.py::OpenAIGPTTokenizationTest::test_maximum_encoding_length_pair_input 
[gw5] PASSED tests/test_modeling_tf_xlm.py::TFXLMModelTest::test_model_common_attributes 
tests/test_modeling_tf_xlm.py::TFXLMModelTest::test_model_from_pretrained 
[gw5] SKIPPED tests/test_modeling_tf_xlm.py::TFXLMModelTest::test_model_from_pretrained 
tests/test_modeling_tf_xlm.py::TFXLMModelTest::test_pt_tf_model_equivalence 
[gw3] PASSED tests/test_modeling_tf_t5.py::TFT5ModelTest::test_model_common_attributes 
tests/test_modeling_tf_t5.py::TFT5ModelTest::test_model_from_pretrained 
[gw3] SKIPPED tests/test_modeling_tf_t5.py::TFT5ModelTest::test_model_from_pretrained 
tests/test_modeling_tf_t5.py::TFT5ModelTest::test_pt_tf_model_equivalence 
[gw7] PASSED tests/test_modeling_tf_roberta.py::TFRobertaModelTest::test_resize_token_embeddings 
tests/test_modeling_tf_roberta.py::TFRobertaModelTest::test_roberta_model 
[gw14] PASSED tests/test_tokenization_openai.py::OpenAIGPTTokenizationTest::test_maximum_encoding_length_pair_input 
tests/test_tokenization_openai.py::OpenAIGPTTokenizationTest::test_maximum_encoding_length_single_input 
[gw7] PASSED tests/test_modeling_tf_roberta.py::TFRobertaModelTest::test_roberta_model 
tests/test_modeling_tf_roberta.py::TFRobertaModelTest::test_save_load 
[gw16] PASSED tests/test_pipelines.py::MonoColumnInputTestCase::test_ner_grouped 
tests/test_pipelines.py::MonoColumnInputTestCase::test_tf_feature_extraction 
[gw19] PASSED tests/test_modeling_gpt2.py::GPT2ModelTest::test_torchscript 
tests/test_modeling_gpt2.py::GPT2ModelTest::test_torchscript_output_attentions 
[gw14] PASSED tests/test_tokenization_openai.py::OpenAIGPTTokenizationTest::test_maximum_encoding_length_single_input 
tests/test_tokenization_openai.py::OpenAIGPTTokenizationTest::test_np_encode_plus_sent_to_model 
[gw14] SKIPPED tests/test_tokenization_openai.py::OpenAIGPTTokenizationTest::test_np_encode_plus_sent_to_model 
tests/test_tokenization_openai.py::OpenAIGPTTokenizationTest::test_number_of_added_tokens 
[gw14] PASSED tests/test_tokenization_openai.py::OpenAIGPTTokenizationTest::test_number_of_added_tokens 
tests/test_tokenization_openai.py::OpenAIGPTTokenizationTest::test_padding_to_max_length 
[gw12] PASSED tests/test_modeling_tf_xlnet.py::TFXLNetModelTest::test_keras_save_load 
tests/test_modeling_tf_xlnet.py::TFXLNetModelTest::test_keyword_and_dict_args 
[gw14] PASSED tests/test_tokenization_openai.py::OpenAIGPTTokenizationTest::test_padding_to_max_length 
tests/test_tokenization_openai.py::OpenAIGPTTokenizationTest::test_padding_to_multiple_of 
[gw16] PASSED tests/test_pipelines.py::MonoColumnInputTestCase::test_tf_feature_extraction 
tests/test_pipelines.py::MonoColumnInputTestCase::test_tf_fill_mask 
[gw18] PASSED tests/test_tokenization_fast.py::RobertaFastTokenizerTest::test_pretokenized_tokenizers 
tests/test_tokenization_fast.py::NoPaddingTokenFastTokenizerMatchingTest::test_all_tokenizers 
[gw14] SKIPPED tests/test_tokenization_openai.py::OpenAIGPTTokenizationTest::test_padding_to_multiple_of 
tests/test_tokenization_openai.py::OpenAIGPTTokenizationTest::test_pickle_tokenizer 
[gw8] PASSED tests/test_modeling_albert.py::AlbertModelTest::test_torchscript 
tests/test_modeling_albert.py::AlbertModelTest::test_torchscript_output_attentions 
[gw12] PASSED tests/test_modeling_tf_xlnet.py::TFXLNetModelTest::test_keyword_and_dict_args 
tests/test_modeling_tf_xlnet.py::TFXLNetModelTest::test_lm_head_model_random_beam_search_generate 
[gw1] PASSED tests/test_benchmark.py::BenchmarkTest::test_train_with_configs 
tests/test_tokenization_transfo_xl.py::TransfoXLTokenizationTest::test_add_special_tokens 
[gw1] PASSED tests/test_tokenization_transfo_xl.py::TransfoXLTokenizationTest::test_add_special_tokens 
tests/test_tokenization_transfo_xl.py::TransfoXLTokenizationTest::test_add_tokens_tokenizer 
[gw1] PASSED tests/test_tokenization_transfo_xl.py::TransfoXLTokenizationTest::test_add_tokens_tokenizer 
tests/test_tokenization_transfo_xl.py::TransfoXLTokenizationTest::test_added_tokens_do_lower_case 
[gw1] PASSED tests/test_tokenization_transfo_xl.py::TransfoXLTokenizationTest::test_added_tokens_do_lower_case 
tests/test_tokenization_transfo_xl.py::TransfoXLTokenizationTest::test_batch_encode_plus_batch_sequence_length 
[gw1] PASSED tests/test_tokenization_transfo_xl.py::TransfoXLTokenizationTest::test_batch_encode_plus_batch_sequence_length 
tests/test_tokenization_transfo_xl.py::TransfoXLTokenizationTest::test_batch_encode_plus_padding 
[gw1] PASSED tests/test_tokenization_transfo_xl.py::TransfoXLTokenizationTest::test_batch_encode_plus_padding 
tests/test_tokenization_transfo_xl.py::TransfoXLTokenizationTest::test_batch_encode_plus_tensors 
[gw16] PASSED tests/test_pipelines.py::MonoColumnInputTestCase::test_tf_fill_mask 
tests/test_pipelines.py::MonoColumnInputTestCase::test_tf_fill_mask_results 
[gw14] PASSED tests/test_tokenization_openai.py::OpenAIGPTTokenizationTest::test_pickle_tokenizer 
tests/test_tokenization_openai.py::OpenAIGPTTokenizationTest::test_pretokenized_inputs 
[gw16] SKIPPED tests/test_pipelines.py::MonoColumnInputTestCase::test_tf_fill_mask_results 
tests/test_pipelines.py::MonoColumnInputTestCase::test_tf_ner 
[gw1] PASSED tests/test_tokenization_transfo_xl.py::TransfoXLTokenizationTest::test_batch_encode_plus_tensors 
tests/test_tokenization_transfo_xl.py::TransfoXLTokenizationTest::test_call 
[gw1] PASSED tests/test_tokenization_transfo_xl.py::TransfoXLTokenizationTest::test_call 
tests/test_tokenization_transfo_xl.py::TransfoXLTokenizationTest::test_conversion_reversible 
[gw1] PASSED tests/test_tokenization_transfo_xl.py::TransfoXLTokenizationTest::test_conversion_reversible 
tests/test_tokenization_transfo_xl.py::TransfoXLTokenizationTest::test_encode_decode_with_spaces 
[gw1] PASSED tests/test_tokenization_transfo_xl.py::TransfoXLTokenizationTest::test_encode_decode_with_spaces 
tests/test_tokenization_transfo_xl.py::TransfoXLTokenizationTest::test_encode_plus_with_padding 
[gw1] PASSED tests/test_tokenization_transfo_xl.py::TransfoXLTokenizationTest::test_encode_plus_with_padding 
[gw18] FAILED tests/test_tokenization_fast.py::NoPaddingTokenFastTokenizerMatchingTest::test_all_tokenizers 
tests/test_tokenization_transfo_xl.py::TransfoXLTokenizationTest::test_full_tokenizer 
tests/test_tokenization_fast.py::NoPaddingTokenFastTokenizerMatchingTest::test_pretokenized_tokenizers 
[gw1] PASSED tests/test_tokenization_transfo_xl.py::TransfoXLTokenizationTest::test_full_tokenizer 
tests/test_tokenization_transfo_xl.py::TransfoXLTokenizationTest::test_full_tokenizer_lower 
[gw1] PASSED tests/test_tokenization_transfo_xl.py::TransfoXLTokenizationTest::test_full_tokenizer_lower 
tests/test_tokenization_transfo_xl.py::TransfoXLTokenizationTest::test_full_tokenizer_no_lower 
[gw1] PASSED tests/test_tokenization_transfo_xl.py::TransfoXLTokenizationTest::test_full_tokenizer_no_lower 
tests/test_tokenization_transfo_xl.py::TransfoXLTokenizationTest::test_get_vocab 
[gw1] PASSED tests/test_tokenization_transfo_xl.py::TransfoXLTokenizationTest::test_get_vocab 
tests/test_tokenization_transfo_xl.py::TransfoXLTokenizationTest::test_internal_consistency 
[gw1] PASSED tests/test_tokenization_transfo_xl.py::TransfoXLTokenizationTest::test_internal_consistency 
tests/test_tokenization_transfo_xl.py::TransfoXLTokenizationTest::test_mask_output 
[gw1] PASSED tests/test_tokenization_transfo_xl.py::TransfoXLTokenizationTest::test_mask_output 
tests/test_tokenization_transfo_xl.py::TransfoXLTokenizationTest::test_maximum_encoding_length_pair_input 
[gw1] PASSED tests/test_tokenization_transfo_xl.py::TransfoXLTokenizationTest::test_maximum_encoding_length_pair_input 
[gw7] PASSED tests/test_modeling_tf_roberta.py::TFRobertaModelTest::test_save_load 
tests/test_tokenization_transfo_xl.py::TransfoXLTokenizationTest::test_maximum_encoding_length_single_input 
tests/test_modeling_tf_roberta.py::TFRobertaModelIntegrationTest::test_inference_classification_head 
[gw7] SKIPPED tests/test_modeling_tf_roberta.py::TFRobertaModelIntegrationTest::test_inference_classification_head 
tests/test_modeling_tf_roberta.py::TFRobertaModelIntegrationTest::test_inference_masked_lm 
[gw7] SKIPPED tests/test_modeling_tf_roberta.py::TFRobertaModelIntegrationTest::test_inference_masked_lm 
tests/test_modeling_tf_roberta.py::TFRobertaModelIntegrationTest::test_inference_no_head 
[gw7] SKIPPED tests/test_modeling_tf_roberta.py::TFRobertaModelIntegrationTest::test_inference_no_head 
[gw1] PASSED tests/test_tokenization_transfo_xl.py::TransfoXLTokenizationTest::test_maximum_encoding_length_single_input 
tests/test_tokenization_transfo_xl.py::TransfoXLTokenizationTest::test_move_added_token 
[gw1] PASSED tests/test_tokenization_transfo_xl.py::TransfoXLTokenizationTest::test_move_added_token 
tests/test_tokenization_transfo_xl.py::TransfoXLTokenizationTest::test_np_encode_plus_sent_to_model 
[gw1] SKIPPED tests/test_tokenization_transfo_xl.py::TransfoXLTokenizationTest::test_np_encode_plus_sent_to_model 
tests/test_tokenization_transfo_xl.py::TransfoXLTokenizationTest::test_number_of_added_tokens 
[gw1] PASSED tests/test_tokenization_transfo_xl.py::TransfoXLTokenizationTest::test_number_of_added_tokens 
tests/test_tokenization_transfo_xl.py::TransfoXLTokenizationTest::test_padding_to_max_length 
[gw1] PASSED tests/test_tokenization_transfo_xl.py::TransfoXLTokenizationTest::test_padding_to_max_length 
tests/test_tokenization_transfo_xl.py::TransfoXLTokenizationTest::test_padding_to_multiple_of 
[gw1] SKIPPED tests/test_tokenization_transfo_xl.py::TransfoXLTokenizationTest::test_padding_to_multiple_of 
tests/test_tokenization_transfo_xl.py::TransfoXLTokenizationTest::test_pickle_tokenizer 
[gw1] PASSED tests/test_tokenization_transfo_xl.py::TransfoXLTokenizationTest::test_pickle_tokenizer 
tests/test_tokenization_transfo_xl.py::TransfoXLTokenizationTest::test_pretokenized_inputs 
[gw1] PASSED tests/test_tokenization_transfo_xl.py::TransfoXLTokenizationTest::test_pretokenized_inputs 
tests/test_tokenization_transfo_xl.py::TransfoXLTokenizationTest::test_pretrained_model_lists 
[gw1] PASSED tests/test_tokenization_transfo_xl.py::TransfoXLTokenizationTest::test_pretrained_model_lists 
tests/test_tokenization_transfo_xl.py::TransfoXLTokenizationTest::test_right_and_left_padding 
[gw1] PASSED tests/test_tokenization_transfo_xl.py::TransfoXLTokenizationTest::test_right_and_left_padding 
tests/test_tokenization_transfo_xl.py::TransfoXLTokenizationTest::test_save_and_load_tokenizer 
[gw14] PASSED tests/test_tokenization_openai.py::OpenAIGPTTokenizationTest::test_pretokenized_inputs 
tests/test_tokenization_openai.py::OpenAIGPTTokenizationTest::test_pretrained_model_lists 
[gw14] PASSED tests/test_tokenization_openai.py::OpenAIGPTTokenizationTest::test_pretrained_model_lists 
tests/test_tokenization_openai.py::OpenAIGPTTokenizationTest::test_right_and_left_padding 
[gw1] PASSED tests/test_tokenization_transfo_xl.py::TransfoXLTokenizationTest::test_save_and_load_tokenizer 
tests/test_tokenization_transfo_xl.py::TransfoXLTokenizationTest::test_separate_tokenizers 
[gw1] PASSED tests/test_tokenization_transfo_xl.py::TransfoXLTokenizationTest::test_separate_tokenizers 
tests/test_tokenization_transfo_xl.py::TransfoXLTokenizationTest::test_special_tokens_mask 
[gw1] PASSED tests/test_tokenization_transfo_xl.py::TransfoXLTokenizationTest::test_special_tokens_mask 
tests/test_tokenization_transfo_xl.py::TransfoXLTokenizationTest::test_special_tokens_mask_input_pairs 
[gw1] PASSED tests/test_tokenization_transfo_xl.py::TransfoXLTokenizationTest::test_special_tokens_mask_input_pairs 
tests/test_tokenization_transfo_xl.py::TransfoXLTokenizationTest::test_swap_special_token 
[gw1] PASSED tests/test_tokenization_transfo_xl.py::TransfoXLTokenizationTest::test_swap_special_token 
tests/test_tokenization_transfo_xl.py::TransfoXLTokenizationTest::test_tf_encode_plus_sent_to_model 
[gw1] SKIPPED tests/test_tokenization_transfo_xl.py::TransfoXLTokenizationTest::test_tf_encode_plus_sent_to_model 
tests/test_tokenization_transfo_xl.py::TransfoXLTokenizationTest::test_tokenizers_common_properties 
[gw1] PASSED tests/test_tokenization_transfo_xl.py::TransfoXLTokenizationTest::test_tokenizers_common_properties 
tests/test_tokenization_transfo_xl.py::TransfoXLTokenizationTest::test_torch_encode_plus_sent_to_model 
[gw1] SKIPPED tests/test_tokenization_transfo_xl.py::TransfoXLTokenizationTest::test_torch_encode_plus_sent_to_model 
[gw16] PASSED tests/test_pipelines.py::MonoColumnInputTestCase::test_tf_ner 
tests/test_pipelines.py::MonoColumnInputTestCase::test_tf_ner_grouped 
[gw14] PASSED tests/test_tokenization_openai.py::OpenAIGPTTokenizationTest::test_right_and_left_padding 
tests/test_tokenization_openai.py::OpenAIGPTTokenizationTest::test_save_and_load_tokenizer 
[gw3] PASSED tests/test_modeling_tf_t5.py::TFT5ModelTest::test_pt_tf_model_equivalence 
tests/test_modeling_tf_t5.py::TFT5ModelTest::test_resize_token_embeddings 
[gw17] PASSED tests/test_modeling_flaubert.py::FlaubertModelTest::test_torchscript_output_hidden_state 
tests/test_tokenization_bert.py::BertTokenizationTest::test_add_special_tokens 
[gw17] PASSED tests/test_tokenization_bert.py::BertTokenizationTest::test_add_special_tokens 
tests/test_tokenization_bert.py::BertTokenizationTest::test_add_tokens_tokenizer 
[gw17] PASSED tests/test_tokenization_bert.py::BertTokenizationTest::test_add_tokens_tokenizer 
tests/test_tokenization_bert.py::BertTokenizationTest::test_added_tokens_do_lower_case 
[gw17] PASSED tests/test_tokenization_bert.py::BertTokenizationTest::test_added_tokens_do_lower_case 
tests/test_tokenization_bert.py::BertTokenizationTest::test_basic_tokenizer_lower 
[gw17] PASSED tests/test_tokenization_bert.py::BertTokenizationTest::test_basic_tokenizer_lower 
tests/test_tokenization_bert.py::BertTokenizationTest::test_basic_tokenizer_no_lower 
[gw17] PASSED tests/test_tokenization_bert.py::BertTokenizationTest::test_basic_tokenizer_no_lower 
tests/test_tokenization_bert.py::BertTokenizationTest::test_basic_tokenizer_respects_never_split_tokens 
[gw17] PASSED tests/test_tokenization_bert.py::BertTokenizationTest::test_basic_tokenizer_respects_never_split_tokens 
tests/test_tokenization_bert.py::BertTokenizationTest::test_batch_encode_plus_batch_sequence_length 
[gw17] PASSED tests/test_tokenization_bert.py::BertTokenizationTest::test_batch_encode_plus_batch_sequence_length 
tests/test_tokenization_bert.py::BertTokenizationTest::test_batch_encode_plus_padding 
[gw17] PASSED tests/test_tokenization_bert.py::BertTokenizationTest::test_batch_encode_plus_padding 
tests/test_tokenization_bert.py::BertTokenizationTest::test_batch_encode_plus_tensors 
[gw17] PASSED tests/test_tokenization_bert.py::BertTokenizationTest::test_batch_encode_plus_tensors 
tests/test_tokenization_bert.py::BertTokenizationTest::test_call 
[gw17] PASSED tests/test_tokenization_bert.py::BertTokenizationTest::test_call 
tests/test_tokenization_bert.py::BertTokenizationTest::test_chinese 
[gw17] PASSED tests/test_tokenization_bert.py::BertTokenizationTest::test_chinese 
tests/test_tokenization_bert.py::BertTokenizationTest::test_conversion_reversible 
[gw17] PASSED tests/test_tokenization_bert.py::BertTokenizationTest::test_conversion_reversible 
tests/test_tokenization_bert.py::BertTokenizationTest::test_encode_decode_with_spaces 
[gw17] PASSED tests/test_tokenization_bert.py::BertTokenizationTest::test_encode_decode_with_spaces 
tests/test_tokenization_bert.py::BertTokenizationTest::test_encode_plus_with_padding 
[gw17] PASSED tests/test_tokenization_bert.py::BertTokenizationTest::test_encode_plus_with_padding 
tests/test_tokenization_bert.py::BertTokenizationTest::test_full_tokenizer 
[gw17] PASSED tests/test_tokenization_bert.py::BertTokenizationTest::test_full_tokenizer 
tests/test_tokenization_bert.py::BertTokenizationTest::test_get_vocab 
[gw17] PASSED tests/test_tokenization_bert.py::BertTokenizationTest::test_get_vocab 
tests/test_tokenization_bert.py::BertTokenizationTest::test_internal_consistency 
[gw17] PASSED tests/test_tokenization_bert.py::BertTokenizationTest::test_internal_consistency 
tests/test_tokenization_bert.py::BertTokenizationTest::test_is_control 
[gw17] PASSED tests/test_tokenization_bert.py::BertTokenizationTest::test_is_control 
tests/test_tokenization_bert.py::BertTokenizationTest::test_is_punctuation 
[gw17] PASSED tests/test_tokenization_bert.py::BertTokenizationTest::test_is_punctuation 
tests/test_tokenization_bert.py::BertTokenizationTest::test_is_whitespace 
[gw17] PASSED tests/test_tokenization_bert.py::BertTokenizationTest::test_is_whitespace 
tests/test_tokenization_bert.py::BertTokenizationTest::test_mask_output 
[gw17] PASSED tests/test_tokenization_bert.py::BertTokenizationTest::test_mask_output 
tests/test_tokenization_bert.py::BertTokenizationTest::test_maximum_encoding_length_pair_input 
[gw20] PASSED tests/test_modeling_xlnet.py::XLNetModelTest::test_hidden_states_output 
tests/test_modeling_xlnet.py::XLNetModelTest::test_initialization 
[gw13] PASSED tests/test_modeling_roberta.py::RobertaModelTest::test_torchscript_output_hidden_state 
tests/test_modeling_roberta.py::RobertaModelIntegrationTest::test_inference_classification_head 
[gw13] SKIPPED tests/test_modeling_roberta.py::RobertaModelIntegrationTest::test_inference_classification_head 
tests/test_modeling_roberta.py::RobertaModelIntegrationTest::test_inference_masked_lm 
[gw13] SKIPPED tests/test_modeling_roberta.py::RobertaModelIntegrationTest::test_inference_masked_lm 
tests/test_modeling_roberta.py::RobertaModelIntegrationTest::test_inference_no_head 
[gw13] SKIPPED tests/test_modeling_roberta.py::RobertaModelIntegrationTest::test_inference_no_head 
[gw20] PASSED tests/test_modeling_xlnet.py::XLNetModelTest::test_initialization 
tests/test_modeling_xlnet.py::XLNetModelTest::test_inputs_embeds 
[gw17] PASSED tests/test_tokenization_bert.py::BertTokenizationTest::test_maximum_encoding_length_pair_input 
tests/test_tokenization_bert.py::BertTokenizationTest::test_maximum_encoding_length_single_input 
[gw16] PASSED tests/test_pipelines.py::MonoColumnInputTestCase::test_tf_ner_grouped 
tests/test_pipelines.py::MonoColumnInputTestCase::test_tf_sentiment_analysis 
[gw17] PASSED tests/test_tokenization_bert.py::BertTokenizationTest::test_maximum_encoding_length_single_input 
tests/test_tokenization_bert.py::BertTokenizationTest::test_np_encode_plus_sent_to_model 
[gw17] SKIPPED tests/test_tokenization_bert.py::BertTokenizationTest::test_np_encode_plus_sent_to_model 
tests/test_tokenization_bert.py::BertTokenizationTest::test_number_of_added_tokens 
[gw17] PASSED tests/test_tokenization_bert.py::BertTokenizationTest::test_number_of_added_tokens 
tests/test_tokenization_bert.py::BertTokenizationTest::test_padding_to_max_length 
[gw17] PASSED tests/test_tokenization_bert.py::BertTokenizationTest::test_padding_to_max_length 
tests/test_tokenization_bert.py::BertTokenizationTest::test_padding_to_multiple_of 
[gw17] PASSED tests/test_tokenization_bert.py::BertTokenizationTest::test_padding_to_multiple_of 
tests/test_tokenization_bert.py::BertTokenizationTest::test_pickle_tokenizer 
[gw17] PASSED tests/test_tokenization_bert.py::BertTokenizationTest::test_pickle_tokenizer 
tests/test_tokenization_bert.py::BertTokenizationTest::test_pretokenized_inputs 
[gw17] PASSED tests/test_tokenization_bert.py::BertTokenizationTest::test_pretokenized_inputs 
tests/test_tokenization_bert.py::BertTokenizationTest::test_pretrained_model_lists 
[gw17] PASSED tests/test_tokenization_bert.py::BertTokenizationTest::test_pretrained_model_lists 
tests/test_tokenization_bert.py::BertTokenizationTest::test_right_and_left_padding 
[gw17] PASSED tests/test_tokenization_bert.py::BertTokenizationTest::test_right_and_left_padding 
tests/test_tokenization_bert.py::BertTokenizationTest::test_rust_and_python_full_tokenizers 
[gw17] PASSED tests/test_tokenization_bert.py::BertTokenizationTest::test_rust_and_python_full_tokenizers 
tests/test_tokenization_bert.py::BertTokenizationTest::test_save_and_load_tokenizer 
[gw17] PASSED tests/test_tokenization_bert.py::BertTokenizationTest::test_save_and_load_tokenizer 
tests/test_tokenization_bert.py::BertTokenizationTest::test_separate_tokenizers 
[gw17] PASSED tests/test_tokenization_bert.py::BertTokenizationTest::test_separate_tokenizers 
tests/test_tokenization_bert.py::BertTokenizationTest::test_sequence_builders 
[gw17] SKIPPED tests/test_tokenization_bert.py::BertTokenizationTest::test_sequence_builders 
tests/test_tokenization_bert.py::BertTokenizationTest::test_special_tokens_mask 
[gw17] PASSED tests/test_tokenization_bert.py::BertTokenizationTest::test_special_tokens_mask 
tests/test_tokenization_bert.py::BertTokenizationTest::test_special_tokens_mask_input_pairs 
[gw17] PASSED tests/test_tokenization_bert.py::BertTokenizationTest::test_special_tokens_mask_input_pairs 
tests/test_tokenization_bert.py::BertTokenizationTest::test_swap_special_token 
[gw17] PASSED tests/test_tokenization_bert.py::BertTokenizationTest::test_swap_special_token 
tests/test_tokenization_bert.py::BertTokenizationTest::test_tf_encode_plus_sent_to_model 
[gw0] PASSED tests/test_modeling_reformer.py::ReformerLocalAttnModelTest::test_resize_tokens_embeddings 
tests/test_modeling_reformer.py::ReformerLocalAttnModelTest::test_save_load 
[gw17] SKIPPED tests/test_tokenization_bert.py::BertTokenizationTest::test_tf_encode_plus_sent_to_model 
tests/test_tokenization_bert.py::BertTokenizationTest::test_tokenizers_common_properties 
[gw17] PASSED tests/test_tokenization_bert.py::BertTokenizationTest::test_tokenizers_common_properties 
tests/test_tokenization_bert.py::BertTokenizationTest::test_torch_encode_plus_sent_to_model 
[gw17] SKIPPED tests/test_tokenization_bert.py::BertTokenizationTest::test_torch_encode_plus_sent_to_model 
tests/test_tokenization_bert.py::BertTokenizationTest::test_wordpiece_tokenizer 
[gw17] PASSED tests/test_tokenization_bert.py::BertTokenizationTest::test_wordpiece_tokenizer 
[gw3] PASSED tests/test_modeling_tf_t5.py::TFT5ModelTest::test_resize_token_embeddings 
tests/test_modeling_tf_t5.py::TFT5ModelTest::test_save_load 
[gw16] PASSED tests/test_pipelines.py::MonoColumnInputTestCase::test_tf_sentiment_analysis 
tests/test_pipelines.py::MonoColumnInputTestCase::test_tf_summarization 
[gw16] SKIPPED tests/test_pipelines.py::MonoColumnInputTestCase::test_tf_summarization 
tests/test_pipelines.py::MonoColumnInputTestCase::test_tf_text_generation 
[gw14] PASSED tests/test_tokenization_openai.py::OpenAIGPTTokenizationTest::test_save_and_load_tokenizer 
tests/test_tokenization_openai.py::OpenAIGPTTokenizationTest::test_separate_tokenizers 
[gw18] PASSED tests/test_tokenization_fast.py::NoPaddingTokenFastTokenizerMatchingTest::test_pretokenized_tokenizers 
tests/test_tokenization_fast.py::TransfoXLFastTokenizerTest::test_all_tokenizers 
[gw5] PASSED tests/test_modeling_tf_xlm.py::TFXLMModelTest::test_pt_tf_model_equivalence 
tests/test_modeling_tf_xlm.py::TFXLMModelTest::test_resize_token_embeddings 
[gw14] PASSED tests/test_tokenization_openai.py::OpenAIGPTTokenizationTest::test_separate_tokenizers 
tests/test_tokenization_openai.py::OpenAIGPTTokenizationTest::test_special_tokens_mask 
[gw3] PASSED tests/test_modeling_tf_t5.py::TFT5ModelTest::test_save_load 
tests/test_modeling_tf_t5.py::TFT5ModelTest::test_t5_decoder_model_past 
[gw14] PASSED tests/test_tokenization_openai.py::OpenAIGPTTokenizationTest::test_special_tokens_mask 
tests/test_tokenization_openai.py::OpenAIGPTTokenizationTest::test_special_tokens_mask_input_pairs 
[gw20] PASSED tests/test_modeling_xlnet.py::XLNetModelTest::test_inputs_embeds 
tests/test_modeling_xlnet.py::XLNetModelTest::test_lm_head_model_random_beam_search_generate 
[gw3] PASSED tests/test_modeling_tf_t5.py::TFT5ModelTest::test_t5_decoder_model_past 
tests/test_modeling_tf_t5.py::TFT5ModelTest::test_t5_decoder_model_past_with_attn_mask 
[gw5] PASSED tests/test_modeling_tf_xlm.py::TFXLMModelTest::test_resize_token_embeddings 
tests/test_modeling_tf_xlm.py::TFXLMModelTest::test_save_load 
[gw14] PASSED tests/test_tokenization_openai.py::OpenAIGPTTokenizationTest::test_special_tokens_mask_input_pairs 
tests/test_tokenization_openai.py::OpenAIGPTTokenizationTest::test_swap_special_token 
[gw3] PASSED tests/test_modeling_tf_t5.py::TFT5ModelTest::test_t5_decoder_model_past_with_attn_mask 
tests/test_modeling_tf_t5.py::TFT5ModelTest::test_t5_model 
[gw14] PASSED tests/test_tokenization_openai.py::OpenAIGPTTokenizationTest::test_swap_special_token 
tests/test_tokenization_openai.py::OpenAIGPTTokenizationTest::test_tf_encode_plus_sent_to_model 
[gw14] SKIPPED tests/test_tokenization_openai.py::OpenAIGPTTokenizationTest::test_tf_encode_plus_sent_to_model 
tests/test_tokenization_openai.py::OpenAIGPTTokenizationTest::test_tokenizers_common_properties 
[gw18] PASSED tests/test_tokenization_fast.py::TransfoXLFastTokenizerTest::test_all_tokenizers 
tests/test_tokenization_fast.py::TransfoXLFastTokenizerTest::test_pretokenized_tokenizers 
[gw12] PASSED tests/test_modeling_tf_xlnet.py::TFXLNetModelTest::test_lm_head_model_random_beam_search_generate 
tests/test_modeling_tf_xlnet.py::TFXLNetModelTest::test_lm_head_model_random_no_beam_search_generate 
[gw3] PASSED tests/test_modeling_tf_t5.py::TFT5ModelTest::test_t5_model 
tests/test_modeling_tf_t5.py::TFT5ModelTest::test_with_lm_head 
[gw14] PASSED tests/test_tokenization_openai.py::OpenAIGPTTokenizationTest::test_tokenizers_common_properties 
tests/test_tokenization_openai.py::OpenAIGPTTokenizationTest::test_torch_encode_plus_sent_to_model 
[gw14] SKIPPED tests/test_tokenization_openai.py::OpenAIGPTTokenizationTest::test_torch_encode_plus_sent_to_model 
[gw3] PASSED tests/test_modeling_tf_t5.py::TFT5ModelTest::test_with_lm_head 
tests/test_modeling_tf_t5.py::TFT5ModelIntegrationTests::test_summarization 
[gw3] SKIPPED tests/test_modeling_tf_t5.py::TFT5ModelIntegrationTests::test_summarization 
tests/test_modeling_tf_t5.py::TFT5ModelIntegrationTests::test_translation_en_to_de 
[gw3] SKIPPED tests/test_modeling_tf_t5.py::TFT5ModelIntegrationTests::test_translation_en_to_de 
tests/test_modeling_tf_t5.py::TFT5ModelIntegrationTests::test_translation_en_to_fr 
[gw3] SKIPPED tests/test_modeling_tf_t5.py::TFT5ModelIntegrationTests::test_translation_en_to_fr 
tests/test_modeling_tf_t5.py::TFT5ModelIntegrationTests::test_translation_en_to_ro 
[gw3] SKIPPED tests/test_modeling_tf_t5.py::TFT5ModelIntegrationTests::test_translation_en_to_ro 
[gw19] PASSED tests/test_modeling_gpt2.py::GPT2ModelTest::test_torchscript_output_attentions 
tests/test_modeling_gpt2.py::GPT2ModelTest::test_torchscript_output_hidden_state 
[gw18] PASSED tests/test_tokenization_fast.py::TransfoXLFastTokenizerTest::test_pretokenized_tokenizers 
[gw0] PASSED tests/test_modeling_reformer.py::ReformerLocalAttnModelTest::test_save_load 
tests/test_modeling_reformer.py::ReformerLocalAttnModelTest::test_tie_model_weights 
[gw0] PASSED tests/test_modeling_reformer.py::ReformerLocalAttnModelTest::test_tie_model_weights 
tests/test_modeling_reformer.py::ReformerLocalAttnModelTest::test_torchscript_output_attentions 
[gw0] PASSED tests/test_modeling_reformer.py::ReformerLocalAttnModelTest::test_torchscript_output_attentions 
tests/test_modeling_reformer.py::ReformerLocalAttnModelTest::test_torchscript_output_hidden_state 
[gw0] PASSED tests/test_modeling_reformer.py::ReformerLocalAttnModelTest::test_torchscript_output_hidden_state 
tests/test_modeling_reformer.py::ReformerLSHAttnModelTest::test_attention_outputs 
[gw16] PASSED tests/test_pipelines.py::MonoColumnInputTestCase::test_tf_text_generation 
tests/test_pipelines.py::MonoColumnInputTestCase::test_tf_translation 
[gw16] SKIPPED tests/test_pipelines.py::MonoColumnInputTestCase::test_tf_translation 
tests/test_pipelines.py::MonoColumnInputTestCase::test_torch_feature_extraction 
[gw5] PASSED tests/test_modeling_tf_xlm.py::TFXLMModelTest::test_save_load 
tests/test_modeling_tf_xlm.py::TFXLMModelTest::test_xlm_lm_head 
[gw16] PASSED tests/test_pipelines.py::MonoColumnInputTestCase::test_torch_feature_extraction 
tests/test_pipelines.py::MonoColumnInputTestCase::test_torch_fill_mask 
[gw5] PASSED tests/test_modeling_tf_xlm.py::TFXLMModelTest::test_xlm_lm_head 
tests/test_modeling_tf_xlm.py::TFXLMModelTest::test_xlm_model 
[gw5] PASSED tests/test_modeling_tf_xlm.py::TFXLMModelTest::test_xlm_model 
tests/test_modeling_tf_xlm.py::TFXLMModelTest::test_xlm_qa 
[gw5] PASSED tests/test_modeling_tf_xlm.py::TFXLMModelTest::test_xlm_qa 
tests/test_modeling_tf_xlm.py::TFXLMModelTest::test_xlm_sequence_classif 
[gw5] PASSED tests/test_modeling_tf_xlm.py::TFXLMModelTest::test_xlm_sequence_classif 
tests/test_modeling_tf_xlm.py::TFXLMModelLanguageGenerationTest::test_lm_generate_xlm_mlm_en_2048 
[gw5] SKIPPED tests/test_modeling_tf_xlm.py::TFXLMModelLanguageGenerationTest::test_lm_generate_xlm_mlm_en_2048 
[gw12] PASSED tests/test_modeling_tf_xlnet.py::TFXLNetModelTest::test_lm_head_model_random_no_beam_search_generate 
tests/test_modeling_tf_xlnet.py::TFXLNetModelTest::test_loss_computation 
[gw16] PASSED tests/test_pipelines.py::MonoColumnInputTestCase::test_torch_fill_mask 
tests/test_pipelines.py::MonoColumnInputTestCase::test_torch_fill_mask_results 
[gw16] SKIPPED tests/test_pipelines.py::MonoColumnInputTestCase::test_torch_fill_mask_results 
tests/test_pipelines.py::MonoColumnInputTestCase::test_torch_ner 
[gw10] PASSED tests/test_trainer.py::TrainerIntegrationTest::test_trainer_eval_mrpc 
[gw16] PASSED tests/test_pipelines.py::MonoColumnInputTestCase::test_torch_ner 
tests/test_pipelines.py::MonoColumnInputTestCase::test_torch_sentiment_analysis 
[gw22] PASSED tests/test_modeling_mobilebert.py::MobileBertModelTest::test_head_pruning_integration 
tests/test_modeling_mobilebert.py::MobileBertModelTest::test_head_pruning_save_load_from_config_init 
[gw12] PASSED tests/test_modeling_tf_xlnet.py::TFXLNetModelTest::test_loss_computation 
tests/test_modeling_tf_xlnet.py::TFXLNetModelTest::test_model_common_attributes 
[gw11] PASSED tests/test_modeling_bert.py::BertModelTest::test_torchscript_output_attentions 
tests/test_modeling_bert.py::BertModelTest::test_torchscript_output_hidden_state 
[gw12] PASSED tests/test_modeling_tf_xlnet.py::TFXLNetModelTest::test_model_common_attributes 
tests/test_modeling_tf_xlnet.py::TFXLNetModelTest::test_model_from_pretrained 
[gw12] SKIPPED tests/test_modeling_tf_xlnet.py::TFXLNetModelTest::test_model_from_pretrained 
tests/test_modeling_tf_xlnet.py::TFXLNetModelTest::test_pt_tf_model_equivalence 
[gw16] PASSED tests/test_pipelines.py::MonoColumnInputTestCase::test_torch_sentiment_analysis 
tests/test_pipelines.py::MonoColumnInputTestCase::test_torch_summarization 
[gw19] PASSED tests/test_modeling_gpt2.py::GPT2ModelTest::test_torchscript_output_hidden_state 
tests/test_modeling_gpt2.py::GPT2ModelLanguageGenerationTest::test_lm_generate_distilgpt2 
[gw19] SKIPPED tests/test_modeling_gpt2.py::GPT2ModelLanguageGenerationTest::test_lm_generate_distilgpt2 
tests/test_modeling_gpt2.py::GPT2ModelLanguageGenerationTest::test_lm_generate_gpt2 
[gw19] SKIPPED tests/test_modeling_gpt2.py::GPT2ModelLanguageGenerationTest::test_lm_generate_gpt2 
[gw8] PASSED tests/test_modeling_albert.py::AlbertModelTest::test_torchscript_output_attentions 
tests/test_modeling_albert.py::AlbertModelTest::test_torchscript_output_hidden_state 
[gw22] PASSED tests/test_modeling_mobilebert.py::MobileBertModelTest::test_head_pruning_save_load_from_config_init 
tests/test_modeling_mobilebert.py::MobileBertModelTest::test_head_pruning_save_load_from_pretrained 
[gw15] PASSED tests/test_modeling_transfo_xl.py::TransfoXLModelTest::test_lm_head_model_random_beam_search_generate 
tests/test_modeling_transfo_xl.py::TransfoXLModelTest::test_lm_head_model_random_no_beam_search_generate 
[gw21] PASSED tests/test_modeling_xlm.py::XLMModelTest::test_lm_head_model_random_beam_search_generate 
tests/test_modeling_xlm.py::XLMModelTest::test_lm_head_model_random_no_beam_search_generate 
[gw12] PASSED tests/test_modeling_tf_xlnet.py::TFXLNetModelTest::test_pt_tf_model_equivalence 
tests/test_modeling_tf_xlnet.py::TFXLNetModelTest::test_resize_token_embeddings 
[gw23] PASSED tests/test_modeling_openai.py::OpenAIGPTModelTest::test_lm_head_model_random_no_beam_search_generate 
tests/test_modeling_openai.py::OpenAIGPTModelTest::test_model_common_attributes 
[gw23] PASSED tests/test_modeling_openai.py::OpenAIGPTModelTest::test_model_common_attributes 
tests/test_modeling_openai.py::OpenAIGPTModelTest::test_model_from_pretrained 
[gw23] SKIPPED tests/test_modeling_openai.py::OpenAIGPTModelTest::test_model_from_pretrained 
tests/test_modeling_openai.py::OpenAIGPTModelTest::test_multigpu_data_parallel_forward 
[gw23] SKIPPED tests/test_modeling_openai.py::OpenAIGPTModelTest::test_multigpu_data_parallel_forward 
tests/test_modeling_openai.py::OpenAIGPTModelTest::test_openai_gpt_double_lm_head_model 
[gw23] PASSED tests/test_modeling_openai.py::OpenAIGPTModelTest::test_openai_gpt_double_lm_head_model 
tests/test_modeling_openai.py::OpenAIGPTModelTest::test_openai_gpt_lm_head_model 
[gw12] PASSED tests/test_modeling_tf_xlnet.py::TFXLNetModelTest::test_resize_token_embeddings 
tests/test_modeling_tf_xlnet.py::TFXLNetModelTest::test_save_load 
[gw23] PASSED tests/test_modeling_openai.py::OpenAIGPTModelTest::test_openai_gpt_lm_head_model 
tests/test_modeling_openai.py::OpenAIGPTModelTest::test_openai_gpt_model 
[gw0] PASSED tests/test_modeling_reformer.py::ReformerLSHAttnModelTest::test_attention_outputs 
tests/test_modeling_reformer.py::ReformerLSHAttnModelTest::test_config 
[gw0] PASSED tests/test_modeling_reformer.py::ReformerLSHAttnModelTest::test_config 
tests/test_modeling_reformer.py::ReformerLSHAttnModelTest::test_correct_missing_keys 
[gw0] PASSED tests/test_modeling_reformer.py::ReformerLSHAttnModelTest::test_correct_missing_keys 
tests/test_modeling_reformer.py::ReformerLSHAttnModelTest::test_determinism 
[gw23] PASSED tests/test_modeling_openai.py::OpenAIGPTModelTest::test_openai_gpt_model 
tests/test_modeling_openai.py::OpenAIGPTModelTest::test_resize_tokens_embeddings 
[gw22] PASSED tests/test_modeling_mobilebert.py::MobileBertModelTest::test_head_pruning_save_load_from_pretrained 
tests/test_modeling_mobilebert.py::MobileBertModelTest::test_headmasking 
[gw11] PASSED tests/test_modeling_bert.py::BertModelTest::test_torchscript_output_hidden_state 
[gw12] PASSED tests/test_modeling_tf_xlnet.py::TFXLNetModelTest::test_save_load 
tests/test_modeling_tf_xlnet.py::TFXLNetModelTest::test_xlnet_base_model 
[gw12] PASSED tests/test_modeling_tf_xlnet.py::TFXLNetModelTest::test_xlnet_base_model 
tests/test_modeling_tf_xlnet.py::TFXLNetModelTest::test_xlnet_for_multiple_choice 
[gw12] PASSED tests/test_modeling_tf_xlnet.py::TFXLNetModelTest::test_xlnet_for_multiple_choice 
tests/test_modeling_tf_xlnet.py::TFXLNetModelTest::test_xlnet_lm_head 
[gw12] PASSED tests/test_modeling_tf_xlnet.py::TFXLNetModelTest::test_xlnet_lm_head 
tests/test_modeling_tf_xlnet.py::TFXLNetModelTest::test_xlnet_qa 
[gw23] PASSED tests/test_modeling_openai.py::OpenAIGPTModelTest::test_resize_tokens_embeddings 
tests/test_modeling_openai.py::OpenAIGPTModelTest::test_save_load 
[gw12] PASSED tests/test_modeling_tf_xlnet.py::TFXLNetModelTest::test_xlnet_qa 
tests/test_modeling_tf_xlnet.py::TFXLNetModelTest::test_xlnet_sequence_classif 
[gw12] PASSED tests/test_modeling_tf_xlnet.py::TFXLNetModelTest::test_xlnet_sequence_classif 
tests/test_modeling_tf_xlnet.py::TFXLNetModelTest::test_xlnet_token_classification 
[gw12] PASSED tests/test_modeling_tf_xlnet.py::TFXLNetModelTest::test_xlnet_token_classification 
tests/test_modeling_tf_xlnet.py::TFXLNetModelLanguageGenerationTest::test_lm_generate_xlnet_base_cased 
[gw12] SKIPPED tests/test_modeling_tf_xlnet.py::TFXLNetModelLanguageGenerationTest::test_lm_generate_xlnet_base_cased 
[gw23] PASSED tests/test_modeling_openai.py::OpenAIGPTModelTest::test_save_load 
tests/test_modeling_openai.py::OpenAIGPTModelTest::test_tie_model_weights 
[gw23] PASSED tests/test_modeling_openai.py::OpenAIGPTModelTest::test_tie_model_weights 
tests/test_modeling_openai.py::OpenAIGPTModelTest::test_torchscript 
[gw8] PASSED tests/test_modeling_albert.py::AlbertModelTest::test_torchscript_output_hidden_state 
[gw15] PASSED tests/test_modeling_transfo_xl.py::TransfoXLModelTest::test_lm_head_model_random_no_beam_search_generate 
tests/test_modeling_transfo_xl.py::TransfoXLModelTest::test_model_common_attributes 
[gw15] PASSED tests/test_modeling_transfo_xl.py::TransfoXLModelTest::test_model_common_attributes 
tests/test_modeling_transfo_xl.py::TransfoXLModelTest::test_model_from_pretrained 
[gw15] SKIPPED tests/test_modeling_transfo_xl.py::TransfoXLModelTest::test_model_from_pretrained 
tests/test_modeling_transfo_xl.py::TransfoXLModelTest::test_multigpu_data_parallel_forward 
[gw15] SKIPPED tests/test_modeling_transfo_xl.py::TransfoXLModelTest::test_multigpu_data_parallel_forward 
tests/test_modeling_transfo_xl.py::TransfoXLModelTest::test_resize_tokens_embeddings 
[gw0] PASSED tests/test_modeling_reformer.py::ReformerLSHAttnModelTest::test_determinism 
tests/test_modeling_reformer.py::ReformerLSHAttnModelTest::test_dropout_random_seed_is_changing 
[gw0] SKIPPED tests/test_modeling_reformer.py::ReformerLSHAttnModelTest::test_dropout_random_seed_is_changing 
tests/test_modeling_reformer.py::ReformerLSHAttnModelTest::test_head_pruning 
[gw0] PASSED tests/test_modeling_reformer.py::ReformerLSHAttnModelTest::test_head_pruning 
tests/test_modeling_reformer.py::ReformerLSHAttnModelTest::test_head_pruning_integration 
[gw0] PASSED tests/test_modeling_reformer.py::ReformerLSHAttnModelTest::test_head_pruning_integration 
tests/test_modeling_reformer.py::ReformerLSHAttnModelTest::test_head_pruning_save_load_from_config_init 
[gw0] PASSED tests/test_modeling_reformer.py::ReformerLSHAttnModelTest::test_head_pruning_save_load_from_config_init 
tests/test_modeling_reformer.py::ReformerLSHAttnModelTest::test_head_pruning_save_load_from_pretrained 
[gw0] PASSED tests/test_modeling_reformer.py::ReformerLSHAttnModelTest::test_head_pruning_save_load_from_pretrained 
tests/test_modeling_reformer.py::ReformerLSHAttnModelTest::test_hidden_states_output 
[gw15] PASSED tests/test_modeling_transfo_xl.py::TransfoXLModelTest::test_resize_tokens_embeddings 
tests/test_modeling_transfo_xl.py::TransfoXLModelTest::test_save_load 
[gw21] PASSED tests/test_modeling_xlm.py::XLMModelTest::test_lm_head_model_random_no_beam_search_generate 
tests/test_modeling_xlm.py::XLMModelTest::test_model_common_attributes 
[gw21] PASSED tests/test_modeling_xlm.py::XLMModelTest::test_model_common_attributes 
tests/test_modeling_xlm.py::XLMModelTest::test_model_from_pretrained 
[gw21] SKIPPED tests/test_modeling_xlm.py::XLMModelTest::test_model_from_pretrained 
tests/test_modeling_xlm.py::XLMModelTest::test_multigpu_data_parallel_forward 
[gw21] SKIPPED tests/test_modeling_xlm.py::XLMModelTest::test_multigpu_data_parallel_forward 
tests/test_modeling_xlm.py::XLMModelTest::test_resize_tokens_embeddings 
[gw15] PASSED tests/test_modeling_transfo_xl.py::TransfoXLModelTest::test_save_load 
tests/test_modeling_transfo_xl.py::TransfoXLModelTest::test_tie_model_weights 
[gw15] PASSED tests/test_modeling_transfo_xl.py::TransfoXLModelTest::test_tie_model_weights 
tests/test_modeling_transfo_xl.py::TransfoXLModelTest::test_torchscript_output_attentions 
[gw15] PASSED tests/test_modeling_transfo_xl.py::TransfoXLModelTest::test_torchscript_output_attentions 
tests/test_modeling_transfo_xl.py::TransfoXLModelTest::test_torchscript_output_hidden_state 
[gw15] PASSED tests/test_modeling_transfo_xl.py::TransfoXLModelTest::test_torchscript_output_hidden_state 
tests/test_modeling_transfo_xl.py::TransfoXLModelTest::test_transfo_xl_lm_head 
[gw23] PASSED tests/test_modeling_openai.py::OpenAIGPTModelTest::test_torchscript 
tests/test_modeling_openai.py::OpenAIGPTModelTest::test_torchscript_output_attentions 
[gw15] PASSED tests/test_modeling_transfo_xl.py::TransfoXLModelTest::test_transfo_xl_lm_head 
tests/test_modeling_transfo_xl.py::TransfoXLModelTest::test_transfo_xl_model 
[gw15] PASSED tests/test_modeling_transfo_xl.py::TransfoXLModelTest::test_transfo_xl_model 
tests/test_modeling_transfo_xl.py::TransfoXLModelLanguageGenerationTest::test_lm_generate_transfo_xl_wt103 
[gw15] SKIPPED tests/test_modeling_transfo_xl.py::TransfoXLModelLanguageGenerationTest::test_lm_generate_transfo_xl_wt103 
[gw21] PASSED tests/test_modeling_xlm.py::XLMModelTest::test_resize_tokens_embeddings 
tests/test_modeling_xlm.py::XLMModelTest::test_save_load 
[gw0] PASSED tests/test_modeling_reformer.py::ReformerLSHAttnModelTest::test_hidden_states_output 
tests/test_modeling_reformer.py::ReformerLSHAttnModelTest::test_initialization 
[gw0] PASSED tests/test_modeling_reformer.py::ReformerLSHAttnModelTest::test_initialization 
tests/test_modeling_reformer.py::ReformerLSHAttnModelTest::test_inputs_embeds 
[gw21] PASSED tests/test_modeling_xlm.py::XLMModelTest::test_save_load 
tests/test_modeling_xlm.py::XLMModelTest::test_tie_model_weights 
[gw21] PASSED tests/test_modeling_xlm.py::XLMModelTest::test_tie_model_weights 
tests/test_modeling_xlm.py::XLMModelTest::test_torchscript 
[gw23] PASSED tests/test_modeling_openai.py::OpenAIGPTModelTest::test_torchscript_output_attentions 
tests/test_modeling_openai.py::OpenAIGPTModelTest::test_torchscript_output_hidden_state 
[gw22] PASSED tests/test_modeling_mobilebert.py::MobileBertModelTest::test_headmasking 
tests/test_modeling_mobilebert.py::MobileBertModelTest::test_hidden_states_output 
[gw0] PASSED tests/test_modeling_reformer.py::ReformerLSHAttnModelTest::test_inputs_embeds 
tests/test_modeling_reformer.py::ReformerLSHAttnModelTest::test_lm_head_model_random_beam_search_generate 
[gw23] PASSED tests/test_modeling_openai.py::OpenAIGPTModelTest::test_torchscript_output_hidden_state 
tests/test_modeling_openai.py::OPENAIGPTModelLanguageGenerationTest::test_lm_generate_openai_gpt 
[gw23] SKIPPED tests/test_modeling_openai.py::OPENAIGPTModelLanguageGenerationTest::test_lm_generate_openai_gpt 
[gw21] PASSED tests/test_modeling_xlm.py::XLMModelTest::test_torchscript 
tests/test_modeling_xlm.py::XLMModelTest::test_torchscript_output_attentions 
[gw16] PASSED tests/test_pipelines.py::MonoColumnInputTestCase::test_torch_summarization 
tests/test_pipelines.py::MonoColumnInputTestCase::test_torch_text_generation 
[gw22] PASSED tests/test_modeling_mobilebert.py::MobileBertModelTest::test_hidden_states_output 
tests/test_modeling_mobilebert.py::MobileBertModelTest::test_initialization 
[gw20] PASSED tests/test_modeling_xlnet.py::XLNetModelTest::test_lm_head_model_random_beam_search_generate 
tests/test_modeling_xlnet.py::XLNetModelTest::test_lm_head_model_random_no_beam_search_generate 
[gw22] PASSED tests/test_modeling_mobilebert.py::MobileBertModelTest::test_initialization 
tests/test_modeling_mobilebert.py::MobileBertModelTest::test_inputs_embeds 
[gw22] PASSED tests/test_modeling_mobilebert.py::MobileBertModelTest::test_inputs_embeds 
tests/test_modeling_mobilebert.py::MobileBertModelTest::test_lm_head_model_random_beam_search_generate 
[gw22] PASSED tests/test_modeling_mobilebert.py::MobileBertModelTest::test_lm_head_model_random_beam_search_generate 
tests/test_modeling_mobilebert.py::MobileBertModelTest::test_lm_head_model_random_no_beam_search_generate 
[gw22] PASSED tests/test_modeling_mobilebert.py::MobileBertModelTest::test_lm_head_model_random_no_beam_search_generate 
tests/test_modeling_mobilebert.py::MobileBertModelTest::test_mobilebert_model 
[gw16] PASSED tests/test_pipelines.py::MonoColumnInputTestCase::test_torch_text_generation 
tests/test_pipelines.py::MonoColumnInputTestCase::test_torch_translation 
[gw22] PASSED tests/test_modeling_mobilebert.py::MobileBertModelTest::test_mobilebert_model 
tests/test_modeling_mobilebert.py::MobileBertModelTest::test_mobilebert_model_as_decoder 
[gw21] PASSED tests/test_modeling_xlm.py::XLMModelTest::test_torchscript_output_attentions 
tests/test_modeling_xlm.py::XLMModelTest::test_torchscript_output_hidden_state 
[gw22] PASSED tests/test_modeling_mobilebert.py::MobileBertModelTest::test_mobilebert_model_as_decoder 
tests/test_modeling_mobilebert.py::MobileBertModelTest::test_mobilebert_model_as_decoder_with_default_input_mask 
[gw22] PASSED tests/test_modeling_mobilebert.py::MobileBertModelTest::test_mobilebert_model_as_decoder_with_default_input_mask 
tests/test_modeling_mobilebert.py::MobileBertModelTest::test_model_common_attributes 
[gw22] PASSED tests/test_modeling_mobilebert.py::MobileBertModelTest::test_model_common_attributes 
tests/test_modeling_mobilebert.py::MobileBertModelTest::test_multigpu_data_parallel_forward 
[gw22] SKIPPED tests/test_modeling_mobilebert.py::MobileBertModelTest::test_multigpu_data_parallel_forward 
tests/test_modeling_mobilebert.py::MobileBertModelTest::test_resize_tokens_embeddings 
[gw21] PASSED tests/test_modeling_xlm.py::XLMModelTest::test_torchscript_output_hidden_state 
tests/test_modeling_xlm.py::XLMModelTest::test_xlm_for_token_classification 
[gw21] PASSED tests/test_modeling_xlm.py::XLMModelTest::test_xlm_for_token_classification 
tests/test_modeling_xlm.py::XLMModelTest::test_xlm_lm_head 
[gw21] PASSED tests/test_modeling_xlm.py::XLMModelTest::test_xlm_lm_head 
tests/test_modeling_xlm.py::XLMModelTest::test_xlm_model 
[gw21] PASSED tests/test_modeling_xlm.py::XLMModelTest::test_xlm_model 
tests/test_modeling_xlm.py::XLMModelTest::test_xlm_qa 
[gw21] PASSED tests/test_modeling_xlm.py::XLMModelTest::test_xlm_qa 
tests/test_modeling_xlm.py::XLMModelTest::test_xlm_sequence_classif 
[gw21] PASSED tests/test_modeling_xlm.py::XLMModelTest::test_xlm_sequence_classif 
tests/test_modeling_xlm.py::XLMModelTest::test_xlm_simple_qa 
[gw21] PASSED tests/test_modeling_xlm.py::XLMModelTest::test_xlm_simple_qa 
tests/test_modeling_xlm.py::XLMModelLanguageGenerationTest::test_lm_generate_xlm_mlm_en_2048 
[gw21] SKIPPED tests/test_modeling_xlm.py::XLMModelLanguageGenerationTest::test_lm_generate_xlm_mlm_en_2048 
[gw22] PASSED tests/test_modeling_mobilebert.py::MobileBertModelTest::test_resize_tokens_embeddings 
tests/test_modeling_mobilebert.py::MobileBertModelTest::test_save_load 
[gw20] PASSED tests/test_modeling_xlnet.py::XLNetModelTest::test_lm_head_model_random_no_beam_search_generate 
tests/test_modeling_xlnet.py::XLNetModelTest::test_model_common_attributes 
[gw20] PASSED tests/test_modeling_xlnet.py::XLNetModelTest::test_model_common_attributes 
tests/test_modeling_xlnet.py::XLNetModelTest::test_model_from_pretrained 
[gw20] SKIPPED tests/test_modeling_xlnet.py::XLNetModelTest::test_model_from_pretrained 
tests/test_modeling_xlnet.py::XLNetModelTest::test_multigpu_data_parallel_forward 
[gw20] SKIPPED tests/test_modeling_xlnet.py::XLNetModelTest::test_multigpu_data_parallel_forward 
tests/test_modeling_xlnet.py::XLNetModelTest::test_resize_tokens_embeddings 
[gw22] PASSED tests/test_modeling_mobilebert.py::MobileBertModelTest::test_save_load 
tests/test_modeling_mobilebert.py::MobileBertModelTest::test_tie_model_weights 
[gw20] PASSED tests/test_modeling_xlnet.py::XLNetModelTest::test_resize_tokens_embeddings 
tests/test_modeling_xlnet.py::XLNetModelTest::test_save_load 
[gw22] PASSED tests/test_modeling_mobilebert.py::MobileBertModelTest::test_tie_model_weights 
tests/test_modeling_mobilebert.py::MobileBertModelTest::test_torchscript 
[gw20] PASSED tests/test_modeling_xlnet.py::XLNetModelTest::test_save_load 
tests/test_modeling_xlnet.py::XLNetModelTest::test_tie_model_weights 
[gw20] PASSED tests/test_modeling_xlnet.py::XLNetModelTest::test_tie_model_weights 
tests/test_modeling_xlnet.py::XLNetModelTest::test_torchscript 
[gw0] PASSED tests/test_modeling_reformer.py::ReformerLSHAttnModelTest::test_lm_head_model_random_beam_search_generate 
tests/test_modeling_reformer.py::ReformerLSHAttnModelTest::test_lm_head_model_random_no_beam_search_generate 
[gw0] PASSED tests/test_modeling_reformer.py::ReformerLSHAttnModelTest::test_lm_head_model_random_no_beam_search_generate 
tests/test_modeling_reformer.py::ReformerLSHAttnModelTest::test_model_common_attributes 
[gw0] PASSED tests/test_modeling_reformer.py::ReformerLSHAttnModelTest::test_model_common_attributes 
tests/test_modeling_reformer.py::ReformerLSHAttnModelTest::test_multigpu_data_parallel_forward 
[gw0] SKIPPED tests/test_modeling_reformer.py::ReformerLSHAttnModelTest::test_multigpu_data_parallel_forward 
tests/test_modeling_reformer.py::ReformerLSHAttnModelTest::test_reformer_chunking_backward_equality 
[gw0] PASSED tests/test_modeling_reformer.py::ReformerLSHAttnModelTest::test_reformer_chunking_backward_equality 
tests/test_modeling_reformer.py::ReformerLSHAttnModelTest::test_reformer_chunking_forward_equality 
[gw0] PASSED tests/test_modeling_reformer.py::ReformerLSHAttnModelTest::test_reformer_chunking_forward_equality 
tests/test_modeling_reformer.py::ReformerLSHAttnModelTest::test_reformer_layer_training_dropout 
[gw0] PASSED tests/test_modeling_reformer.py::ReformerLSHAttnModelTest::test_reformer_layer_training_dropout 
tests/test_modeling_reformer.py::ReformerLSHAttnModelTest::test_reformer_lm_model_backward 
[gw0] PASSED tests/test_modeling_reformer.py::ReformerLSHAttnModelTest::test_reformer_lm_model_backward 
tests/test_modeling_reformer.py::ReformerLSHAttnModelTest::test_reformer_model 
[gw20] PASSED tests/test_modeling_xlnet.py::XLNetModelTest::test_torchscript 
tests/test_modeling_xlnet.py::XLNetModelTest::test_torchscript_output_attentions 
[gw0] PASSED tests/test_modeling_reformer.py::ReformerLSHAttnModelTest::test_reformer_model 
tests/test_modeling_reformer.py::ReformerLSHAttnModelTest::test_reformer_model_attn_masking 
[gw0] PASSED tests/test_modeling_reformer.py::ReformerLSHAttnModelTest::test_reformer_model_attn_masking 
tests/test_modeling_reformer.py::ReformerLSHAttnModelTest::test_reformer_model_fp16_forward 
[gw0] SKIPPED tests/test_modeling_reformer.py::ReformerLSHAttnModelTest::test_reformer_model_fp16_forward 
tests/test_modeling_reformer.py::ReformerLSHAttnModelTest::test_reformer_model_fp16_generate 
[gw0] SKIPPED tests/test_modeling_reformer.py::ReformerLSHAttnModelTest::test_reformer_model_fp16_generate 
tests/test_modeling_reformer.py::ReformerLSHAttnModelTest::test_reformer_no_chunking 
[gw0] PASSED tests/test_modeling_reformer.py::ReformerLSHAttnModelTest::test_reformer_no_chunking 
tests/test_modeling_reformer.py::ReformerLSHAttnModelTest::test_reformer_with_lm 
[gw0] PASSED tests/test_modeling_reformer.py::ReformerLSHAttnModelTest::test_reformer_with_lm 
tests/test_modeling_reformer.py::ReformerLSHAttnModelTest::test_reformer_with_mlm 
[gw0] PASSED tests/test_modeling_reformer.py::ReformerLSHAttnModelTest::test_reformer_with_mlm 
tests/test_modeling_reformer.py::ReformerLSHAttnModelTest::test_resize_tokens_embeddings 
[gw0] PASSED tests/test_modeling_reformer.py::ReformerLSHAttnModelTest::test_resize_tokens_embeddings 
tests/test_modeling_reformer.py::ReformerLSHAttnModelTest::test_save_load 
[gw0] PASSED tests/test_modeling_reformer.py::ReformerLSHAttnModelTest::test_save_load 
tests/test_modeling_reformer.py::ReformerLSHAttnModelTest::test_tie_model_weights 
[gw0] PASSED tests/test_modeling_reformer.py::ReformerLSHAttnModelTest::test_tie_model_weights 
tests/test_modeling_reformer.py::ReformerLSHAttnModelTest::test_torchscript_output_attentions 
[gw0] PASSED tests/test_modeling_reformer.py::ReformerLSHAttnModelTest::test_torchscript_output_attentions 
tests/test_modeling_reformer.py::ReformerLSHAttnModelTest::test_torchscript_output_hidden_state 
[gw0] PASSED tests/test_modeling_reformer.py::ReformerLSHAttnModelTest::test_torchscript_output_hidden_state 
tests/test_modeling_reformer.py::ReformerIntegrationTests::test_lm_model_forward 
[gw0] PASSED tests/test_modeling_reformer.py::ReformerIntegrationTests::test_lm_model_forward 
tests/test_modeling_reformer.py::ReformerIntegrationTests::test_local_layer_forward 
[gw0] PASSED tests/test_modeling_reformer.py::ReformerIntegrationTests::test_local_layer_forward 
tests/test_modeling_reformer.py::ReformerIntegrationTests::test_local_layer_forward_complex 
[gw0] PASSED tests/test_modeling_reformer.py::ReformerIntegrationTests::test_local_layer_forward_complex 
tests/test_modeling_reformer.py::ReformerIntegrationTests::test_local_lm_model_grad 
[gw0] PASSED tests/test_modeling_reformer.py::ReformerIntegrationTests::test_local_lm_model_grad 
tests/test_modeling_reformer.py::ReformerIntegrationTests::test_local_model_forward 
[gw0] PASSED tests/test_modeling_reformer.py::ReformerIntegrationTests::test_local_model_forward 
tests/test_modeling_reformer.py::ReformerIntegrationTests::test_lsh_layer_forward 
[gw0] PASSED tests/test_modeling_reformer.py::ReformerIntegrationTests::test_lsh_layer_forward 
tests/test_modeling_reformer.py::ReformerIntegrationTests::test_lsh_layer_forward_complex 
[gw0] PASSED tests/test_modeling_reformer.py::ReformerIntegrationTests::test_lsh_layer_forward_complex 
tests/test_modeling_reformer.py::ReformerIntegrationTests::test_lsh_lm_model_grad 
[gw0] PASSED tests/test_modeling_reformer.py::ReformerIntegrationTests::test_lsh_lm_model_grad 
tests/test_modeling_reformer.py::ReformerIntegrationTests::test_lsh_model_forward 
[gw0] PASSED tests/test_modeling_reformer.py::ReformerIntegrationTests::test_lsh_model_forward 
tests/test_modeling_reformer.py::ReformerIntegrationTests::test_pretrained_generate_crime_and_punish 
[gw0] SKIPPED tests/test_modeling_reformer.py::ReformerIntegrationTests::test_pretrained_generate_crime_and_punish 
[gw20] PASSED tests/test_modeling_xlnet.py::XLNetModelTest::test_torchscript_output_attentions 
tests/test_modeling_xlnet.py::XLNetModelTest::test_torchscript_output_hidden_state 
[gw22] PASSED tests/test_modeling_mobilebert.py::MobileBertModelTest::test_torchscript 
tests/test_modeling_mobilebert.py::MobileBertModelTest::test_torchscript_output_attentions 
[gw20] PASSED tests/test_modeling_xlnet.py::XLNetModelTest::test_torchscript_output_hidden_state 
tests/test_modeling_xlnet.py::XLNetModelTest::test_xlnet_base_model 
[gw20] PASSED tests/test_modeling_xlnet.py::XLNetModelTest::test_xlnet_base_model 
tests/test_modeling_xlnet.py::XLNetModelTest::test_xlnet_base_model_with_att_output 
[gw20] PASSED tests/test_modeling_xlnet.py::XLNetModelTest::test_xlnet_base_model_with_att_output 
tests/test_modeling_xlnet.py::XLNetModelTest::test_xlnet_lm_head 
[gw20] PASSED tests/test_modeling_xlnet.py::XLNetModelTest::test_xlnet_lm_head 
tests/test_modeling_xlnet.py::XLNetModelTest::test_xlnet_qa 
[gw20] PASSED tests/test_modeling_xlnet.py::XLNetModelTest::test_xlnet_qa 
tests/test_modeling_xlnet.py::XLNetModelTest::test_xlnet_sequence_classif 
[gw20] PASSED tests/test_modeling_xlnet.py::XLNetModelTest::test_xlnet_sequence_classif 
tests/test_modeling_xlnet.py::XLNetModelTest::test_xlnet_token_classif 
[gw20] PASSED tests/test_modeling_xlnet.py::XLNetModelTest::test_xlnet_token_classif 
tests/test_modeling_xlnet.py::XLNetModelLanguageGenerationTest::test_lm_generate_xlnet_base_cased 
[gw20] SKIPPED tests/test_modeling_xlnet.py::XLNetModelLanguageGenerationTest::test_lm_generate_xlnet_base_cased 
[gw16] PASSED tests/test_pipelines.py::MonoColumnInputTestCase::test_torch_translation 
tests/test_pipelines.py::QAPipelineTests::test_tf_question_answering 
[gw16] PASSED tests/test_pipelines.py::QAPipelineTests::test_tf_question_answering 
tests/test_pipelines.py::QAPipelineTests::test_torch_question_answering 
[gw16] PASSED tests/test_pipelines.py::QAPipelineTests::test_torch_question_answering 
tests/test_pipelines.py::PipelineCommonTests::test_pt_defaults 
[gw16] SKIPPED tests/test_pipelines.py::PipelineCommonTests::test_pt_defaults 
tests/test_pipelines.py::PipelineCommonTests::test_tf_defaults 
[gw16] SKIPPED tests/test_pipelines.py::PipelineCommonTests::test_tf_defaults 
[gw22] PASSED tests/test_modeling_mobilebert.py::MobileBertModelTest::test_torchscript_output_attentions 
tests/test_modeling_mobilebert.py::MobileBertModelTest::test_torchscript_output_hidden_state 
[gw2] PASSED tests/test_modeling_tf_mobilebert.py::TFMobileBertModelTest::test_compile_tf_model 
tests/test_modeling_tf_mobilebert.py::TFMobileBertModelTest::test_config 
[gw2] PASSED tests/test_modeling_tf_mobilebert.py::TFMobileBertModelTest::test_config 
tests/test_modeling_tf_mobilebert.py::TFMobileBertModelTest::test_determinism 
[gw22] PASSED tests/test_modeling_mobilebert.py::MobileBertModelTest::test_torchscript_output_hidden_state 
tests/test_modeling_mobilebert.py::MobileBertModelIntegrationTests::test_inference_no_head 
[gw22] SKIPPED tests/test_modeling_mobilebert.py::MobileBertModelIntegrationTests::test_inference_no_head 
[gw2] PASSED tests/test_modeling_tf_mobilebert.py::TFMobileBertModelTest::test_determinism 
tests/test_modeling_tf_mobilebert.py::TFMobileBertModelTest::test_for_masked_lm 
[gw2] PASSED tests/test_modeling_tf_mobilebert.py::TFMobileBertModelTest::test_for_masked_lm 
tests/test_modeling_tf_mobilebert.py::TFMobileBertModelTest::test_for_multiple_choice 
[gw2] PASSED tests/test_modeling_tf_mobilebert.py::TFMobileBertModelTest::test_for_multiple_choice 
tests/test_modeling_tf_mobilebert.py::TFMobileBertModelTest::test_for_next_sequence_prediction 
[gw2] PASSED tests/test_modeling_tf_mobilebert.py::TFMobileBertModelTest::test_for_next_sequence_prediction 
tests/test_modeling_tf_mobilebert.py::TFMobileBertModelTest::test_for_pretraining 
[gw2] PASSED tests/test_modeling_tf_mobilebert.py::TFMobileBertModelTest::test_for_pretraining 
tests/test_modeling_tf_mobilebert.py::TFMobileBertModelTest::test_for_question_answering 
[gw2] PASSED tests/test_modeling_tf_mobilebert.py::TFMobileBertModelTest::test_for_question_answering 
tests/test_modeling_tf_mobilebert.py::TFMobileBertModelTest::test_for_sequence_classification 
[gw2] PASSED tests/test_modeling_tf_mobilebert.py::TFMobileBertModelTest::test_for_sequence_classification 
tests/test_modeling_tf_mobilebert.py::TFMobileBertModelTest::test_for_token_classification 
[gw2] PASSED tests/test_modeling_tf_mobilebert.py::TFMobileBertModelTest::test_for_token_classification 
tests/test_modeling_tf_mobilebert.py::TFMobileBertModelTest::test_hidden_states_output 
[gw2] PASSED tests/test_modeling_tf_mobilebert.py::TFMobileBertModelTest::test_hidden_states_output 
tests/test_modeling_tf_mobilebert.py::TFMobileBertModelTest::test_initialization 
[gw2] PASSED tests/test_modeling_tf_mobilebert.py::TFMobileBertModelTest::test_initialization 
tests/test_modeling_tf_mobilebert.py::TFMobileBertModelTest::test_inputs_embeds 
[gw2] PASSED tests/test_modeling_tf_mobilebert.py::TFMobileBertModelTest::test_inputs_embeds 
tests/test_modeling_tf_mobilebert.py::TFMobileBertModelTest::test_keras_save_load 
[gw2] PASSED tests/test_modeling_tf_mobilebert.py::TFMobileBertModelTest::test_keras_save_load 
tests/test_modeling_tf_mobilebert.py::TFMobileBertModelTest::test_keyword_and_dict_args 
[gw2] PASSED tests/test_modeling_tf_mobilebert.py::TFMobileBertModelTest::test_keyword_and_dict_args 
tests/test_modeling_tf_mobilebert.py::TFMobileBertModelTest::test_lm_head_model_random_beam_search_generate 
[gw2] PASSED tests/test_modeling_tf_mobilebert.py::TFMobileBertModelTest::test_lm_head_model_random_beam_search_generate 
tests/test_modeling_tf_mobilebert.py::TFMobileBertModelTest::test_lm_head_model_random_no_beam_search_generate 
[gw2] PASSED tests/test_modeling_tf_mobilebert.py::TFMobileBertModelTest::test_lm_head_model_random_no_beam_search_generate 
tests/test_modeling_tf_mobilebert.py::TFMobileBertModelTest::test_loss_computation 
[gw2] PASSED tests/test_modeling_tf_mobilebert.py::TFMobileBertModelTest::test_loss_computation 
tests/test_modeling_tf_mobilebert.py::TFMobileBertModelTest::test_mobilebert_model 
[gw2] PASSED tests/test_modeling_tf_mobilebert.py::TFMobileBertModelTest::test_mobilebert_model 
tests/test_modeling_tf_mobilebert.py::TFMobileBertModelTest::test_model_common_attributes 
[gw2] PASSED tests/test_modeling_tf_mobilebert.py::TFMobileBertModelTest::test_model_common_attributes 
tests/test_modeling_tf_mobilebert.py::TFMobileBertModelTest::test_model_from_pretrained 
[gw2] SKIPPED tests/test_modeling_tf_mobilebert.py::TFMobileBertModelTest::test_model_from_pretrained 
tests/test_modeling_tf_mobilebert.py::TFMobileBertModelTest::test_pt_tf_model_equivalence 
[gw2] PASSED tests/test_modeling_tf_mobilebert.py::TFMobileBertModelTest::test_pt_tf_model_equivalence 
tests/test_modeling_tf_mobilebert.py::TFMobileBertModelTest::test_resize_token_embeddings 
[gw2] PASSED tests/test_modeling_tf_mobilebert.py::TFMobileBertModelTest::test_resize_token_embeddings 
tests/test_modeling_tf_mobilebert.py::TFMobileBertModelTest::test_save_load 
[gw2] PASSED tests/test_modeling_tf_mobilebert.py::TFMobileBertModelTest::test_save_load 

=================================== FAILURES ===================================
_________ NoPaddingTokenFastTokenizerMatchingTest.test_all_tokenizers __________
[gw18] linux -- Python 3.6.10 /home/aryaman4/anaconda3/envs/transformers/bin/python

self = <tests.test_tokenization_fast.NoPaddingTokenFastTokenizerMatchingTest testMethod=test_all_tokenizers>

    def test_all_tokenizers(self):
        for tok_case in self.TOKENIZERS_CLASSES:
            for pretrained_name in tok_case.python_cls.pretrained_vocab_files_map[tok_case.vocab_key].keys():
    
                # Tokenizer.filter makes it possible to filter which Tokenizer to case based on all the
                # information available in Tokenizer (name, rust class, python class, vocab key name)
                if tok_case.filter is None or (
                    tok_case.filter is not None and tok_case.filter(tok_case, pretrained_name)
                ):
                    kwargs = dict(t for t in tok_case.kwargs) if tok_case.kwargs else {}
                    with self.subTest("{} ({})".format(tok_case.name, pretrained_name)):
                        tokenizer_r = tok_case.rust_cls.from_pretrained(pretrained_name, **kwargs)
                        tokenizer_p = tok_case.python_cls.from_pretrained(pretrained_name, **kwargs)
    
>                       self.fast_align_python(tokenizer_r, tokenizer_p, tok_case, pretrained_name)

tests/test_tokenization_fast.py:62: 
_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 
tests/test_tokenization_fast.py:819: in fast_align_python
    self.assert_tokenization_python_rust_equals(tokenizer_r, tokenizer_p)
tests/test_tokenization_fast.py:193: in assert_tokenization_python_rust_equals
    self.assertSequenceEqual(input_p[key], input_r[key])
E   AssertionError: Sequences differ: [616,[111 chars] 0, 40477, 4830, 994, 580, 566, 260, 5958, 260[5290 chars] 239] != [616,[111 chars] 0, 4830, 994, 580, 566, 260, 5958, 260, 1490,[5160 chars] 239]
E   
E   First differing element 29:
E   40477
E   4830
E   
E   First sequence contains 12 additional elements.
E   First extra element 973:
E   1832
E   
E   Diff is 8701 characters long. Set self.maxDiff to None to see it.
------------------------------ Captured log call -------------------------------
WARNING  transformers.tokenization_utils:tokenization_utils.py:704 Token indices sequence length is longer than the specified maximum sequence length for this model (985 > 512). Running this sequence through the model will result in indexing errors
=============================== warnings summary ===============================
/home/aryaman4/anaconda3/envs/transformers/lib/python3.6/site-packages/tensorflow/python/pywrap_tensorflow_internal.py:15: 24 tests with warnings
  /home/aryaman4/anaconda3/envs/transformers/lib/python3.6/site-packages/tensorflow/python/pywrap_tensorflow_internal.py:15: DeprecationWarning: the imp module is deprecated in favour of importlib; see the module's documentation for alternative uses
    import imp

src/transformers/modeling_auto.py:798
src/transformers/modeling_auto.py:798
src/transformers/modeling_auto.py:798
src/transformers/modeling_auto.py:798
src/transformers/modeling_auto.py:798
src/transformers/modeling_auto.py:798
  /home/aryaman4/transformers/src/transformers/modeling_auto.py:798: FutureWarning: The class `AutoModelWithLMHead` is deprecated and will be removed in a future version. Please use `AutoModelForCausalLM` for causal language models, `AutoModelForMaskedLM` for masked language models and `AutoModelForSeq2SeqLM` for encoder-decoder models.
    FutureWarning,

src/transformers/tokenization_utils_base.py:1489
src/transformers/tokenization_utils_base.py:1489
src/transformers/tokenization_utils_base.py:1489
src/transformers/tokenization_utils_base.py:1489
src/transformers/tokenization_utils_base.py:1489
  /home/aryaman4/transformers/src/transformers/tokenization_utils_base.py:1489: DeprecationWarning: The `truncation_strategy` argument is deprecated and will be removed in a future version, use `truncation=True` to truncate examples to a max length. You can give a specific length with `max_length` (e.g. `max_length=45`) or leave max_length to None to truncate to the maximal input size of the model (e.g. 512 for Bert).  If you have pairs of inputs, you can give a specific truncation strategy selected among `truncation='only_first'` (will only truncate the first sentence in the pairs) `truncation='only_second'` (will only truncate the second sentence in the pairs) or `truncation='longest_first'` (will iteratively remove tokens from the longest sentence in the pairs).
    DeprecationWarning,

/home/aryaman4/anaconda3/envs/transformers/lib/python3.6/site-packages/tensorflow/python/framework/tensor_util.py:523: 12869 tests with warnings
  /home/aryaman4/anaconda3/envs/transformers/lib/python3.6/site-packages/tensorflow/python/framework/tensor_util.py:523: DeprecationWarning: tostring() is deprecated. Use tobytes() instead.
    tensor_proto.tensor_content = nparray.tostring()

/home/aryaman4/anaconda3/envs/transformers/lib/python3.6/site-packages/torch/nn/_reduction.py:13
/home/aryaman4/anaconda3/envs/transformers/lib/python3.6/site-packages/torch/nn/_reduction.py:13
  /home/aryaman4/anaconda3/envs/transformers/lib/python3.6/site-packages/torch/nn/_reduction.py:13: UserWarning: reduction='elementwise_mean' is deprecated, please use reduction='mean' instead.
    warnings.warn("reduction='elementwise_mean' is deprecated, please use reduction='mean' instead.")

src/transformers/modeling_gpt2.py:149
src/transformers/modeling_gpt2.py:149
src/transformers/modeling_gpt2.py:149
src/transformers/modeling_gpt2.py:149
  /home/aryaman4/transformers/src/transformers/modeling_gpt2.py:149: TracerWarning: Converting a tensor to a Python float might cause the trace to be incorrect. We can't record the data flow of Python values, so this value will be treated as a constant in the future. This means that the trace might not generalize to other inputs!
    w = w / (float(v.size(-1)) ** 0.5)

src/transformers/modeling_gpt2.py:151
src/transformers/modeling_gpt2.py:151
src/transformers/modeling_gpt2.py:151
src/transformers/modeling_gpt2.py:151
  /home/aryaman4/transformers/src/transformers/modeling_gpt2.py:151: TracerWarning: Converting a tensor to a Python index might cause the trace to be incorrect. We can't record the data flow of Python values, so this value will be treated as a constant in the future. This means that the trace might not generalize to other inputs!
    mask = self.bias[:, :, ns - nd : ns, :ns]

src/transformers/tokenization_utils_base.py:1463: 209 tests with warnings
  /home/aryaman4/transformers/src/transformers/tokenization_utils_base.py:1463: DeprecationWarning: The `pad_to_max_length` argument is deprecated and will be removed in a future version, use `padding=True` or `padding='longest'` to pad to the longest sequence in the batch, or use `padding='max_length'` to pad to a max length. In this case, you can give a specific length with `max_length` (e.g. `max_length=45`) or leave max_length to None to pad to the maximal input size of the model (e.g. 512 for Bert).
    DeprecationWarning,

/home/aryaman4/anaconda3/envs/transformers/lib/python3.6/site-packages/torch/optim/lr_scheduler.py:123
/home/aryaman4/anaconda3/envs/transformers/lib/python3.6/site-packages/torch/optim/lr_scheduler.py:123
/home/aryaman4/anaconda3/envs/transformers/lib/python3.6/site-packages/torch/optim/lr_scheduler.py:123
/home/aryaman4/anaconda3/envs/transformers/lib/python3.6/site-packages/torch/optim/lr_scheduler.py:123
/home/aryaman4/anaconda3/envs/transformers/lib/python3.6/site-packages/torch/optim/lr_scheduler.py:123
  /home/aryaman4/anaconda3/envs/transformers/lib/python3.6/site-packages/torch/optim/lr_scheduler.py:123: UserWarning: Detected call of `lr_scheduler.step()` before `optimizer.step()`. In PyTorch 1.1.0 and later, you should call them in the opposite order: `optimizer.step()` before `lr_scheduler.step()`.  Failure to do this will result in PyTorch skipping the first value of the learning rate schedule. See more details at https://pytorch.org/docs/stable/optim.html#how-to-adjust-learning-rate
    "https://pytorch.org/docs/stable/optim.html#how-to-adjust-learning-rate", UserWarning)

/home/aryaman4/anaconda3/envs/transformers/lib/python3.6/site-packages/torch/optim/lr_scheduler.py:231
/home/aryaman4/anaconda3/envs/transformers/lib/python3.6/site-packages/torch/optim/lr_scheduler.py:231
/home/aryaman4/anaconda3/envs/transformers/lib/python3.6/site-packages/torch/optim/lr_scheduler.py:231
/home/aryaman4/anaconda3/envs/transformers/lib/python3.6/site-packages/torch/optim/lr_scheduler.py:231
/home/aryaman4/anaconda3/envs/transformers/lib/python3.6/site-packages/torch/optim/lr_scheduler.py:231
  /home/aryaman4/anaconda3/envs/transformers/lib/python3.6/site-packages/torch/optim/lr_scheduler.py:231: UserWarning: To get the last learning rate computed by the scheduler, please use `get_last_lr()`.
    warnings.warn("To get the last learning rate computed by the scheduler, "

/home/aryaman4/anaconda3/envs/transformers/lib/python3.6/site-packages/torch/optim/lr_scheduler.py:200
/home/aryaman4/anaconda3/envs/transformers/lib/python3.6/site-packages/torch/optim/lr_scheduler.py:200
/home/aryaman4/anaconda3/envs/transformers/lib/python3.6/site-packages/torch/optim/lr_scheduler.py:200
/home/aryaman4/anaconda3/envs/transformers/lib/python3.6/site-packages/torch/optim/lr_scheduler.py:200
/home/aryaman4/anaconda3/envs/transformers/lib/python3.6/site-packages/torch/optim/lr_scheduler.py:200
  /home/aryaman4/anaconda3/envs/transformers/lib/python3.6/site-packages/torch/optim/lr_scheduler.py:200: UserWarning: Please also save or load the state of the optimzer when saving or loading the scheduler.
    warnings.warn(SAVE_STATE_WARNING, UserWarning)

/home/aryaman4/anaconda3/envs/transformers/lib/python3.6/site-packages/torch/optim/lr_scheduler.py:218
/home/aryaman4/anaconda3/envs/transformers/lib/python3.6/site-packages/torch/optim/lr_scheduler.py:218
/home/aryaman4/anaconda3/envs/transformers/lib/python3.6/site-packages/torch/optim/lr_scheduler.py:218
/home/aryaman4/anaconda3/envs/transformers/lib/python3.6/site-packages/torch/optim/lr_scheduler.py:218
/home/aryaman4/anaconda3/envs/transformers/lib/python3.6/site-packages/torch/optim/lr_scheduler.py:218
  /home/aryaman4/anaconda3/envs/transformers/lib/python3.6/site-packages/torch/optim/lr_scheduler.py:218: UserWarning: Please also save or load the state of the optimzer when saving or loading the scheduler.
    warnings.warn(SAVE_STATE_WARNING, UserWarning)

/home/aryaman4/anaconda3/envs/transformers/lib/python3.6/site-packages/torch/nn/functional.py:1708
/home/aryaman4/anaconda3/envs/transformers/lib/python3.6/site-packages/torch/nn/functional.py:1708
/home/aryaman4/anaconda3/envs/transformers/lib/python3.6/site-packages/torch/nn/functional.py:1708
/home/aryaman4/anaconda3/envs/transformers/lib/python3.6/site-packages/torch/nn/functional.py:1708
/home/aryaman4/anaconda3/envs/transformers/lib/python3.6/site-packages/torch/nn/functional.py:1708
/home/aryaman4/anaconda3/envs/transformers/lib/python3.6/site-packages/torch/nn/functional.py:1708
/home/aryaman4/anaconda3/envs/transformers/lib/python3.6/site-packages/torch/nn/functional.py:1708
/home/aryaman4/anaconda3/envs/transformers/lib/python3.6/site-packages/torch/nn/functional.py:1708
/home/aryaman4/anaconda3/envs/transformers/lib/python3.6/site-packages/torch/nn/functional.py:1708
  /home/aryaman4/anaconda3/envs/transformers/lib/python3.6/site-packages/torch/nn/functional.py:1708: TracerWarning: Converting a tensor to a Python boolean might cause the trace to be incorrect. We can't record the data flow of Python values, so this value will be treated as a constant in the future. This means that the trace might not generalize to other inputs!
    assert padding_idx < weight.size(0), 'Padding_idx must be within num_embeddings'

src/transformers/modeling_flaubert.py:175
src/transformers/modeling_flaubert.py:175
src/transformers/modeling_flaubert.py:175
  /home/aryaman4/transformers/src/transformers/modeling_flaubert.py:175: TracerWarning: Converting a tensor to a Python boolean might cause the trace to be incorrect. We can't record the data flow of Python values, so this value will be treated as a constant in the future. This means that the trace might not generalize to other inputs!
    assert lengths.size(0) == bs

src/transformers/modeling_flaubert.py:176
src/transformers/modeling_flaubert.py:176
src/transformers/modeling_flaubert.py:176
  /home/aryaman4/transformers/src/transformers/modeling_flaubert.py:176: TracerWarning: Converting a tensor to a Python number might cause the trace to be incorrect. We can't record the data flow of Python values, so this value will be treated as a constant in the future. This means that the trace might not generalize to other inputs!
    assert lengths.max().item() <= slen

src/transformers/modeling_flaubert.py:176
src/transformers/modeling_flaubert.py:176
src/transformers/modeling_flaubert.py:176
  /home/aryaman4/transformers/src/transformers/modeling_flaubert.py:176: TracerWarning: Converting a tensor to a Python boolean might cause the trace to be incorrect. We can't record the data flow of Python values, so this value will be treated as a constant in the future. This means that the trace might not generalize to other inputs!
    assert lengths.max().item() <= slen

src/transformers/modeling_xlm.py:76
src/transformers/modeling_xlm.py:76
src/transformers/modeling_xlm.py:76
src/transformers/modeling_xlm.py:76
src/transformers/modeling_xlm.py:76
src/transformers/modeling_xlm.py:76
  /home/aryaman4/transformers/src/transformers/modeling_xlm.py:76: TracerWarning: Converting a tensor to a Python number might cause the trace to be incorrect. We can't record the data flow of Python values, so this value will be treated as a constant in the future. This means that the trace might not generalize to other inputs!
    assert lengths.max().item() <= slen

src/transformers/modeling_xlm.py:76
src/transformers/modeling_xlm.py:76
src/transformers/modeling_xlm.py:76
src/transformers/modeling_xlm.py:76
src/transformers/modeling_xlm.py:76
src/transformers/modeling_xlm.py:76
  /home/aryaman4/transformers/src/transformers/modeling_xlm.py:76: TracerWarning: Converting a tensor to a Python boolean might cause the trace to be incorrect. We can't record the data flow of Python values, so this value will be treated as a constant in the future. This means that the trace might not generalize to other inputs!
    assert lengths.max().item() <= slen

src/transformers/modeling_xlm.py:87
src/transformers/modeling_xlm.py:87
src/transformers/modeling_xlm.py:87
src/transformers/modeling_xlm.py:87
src/transformers/modeling_xlm.py:87
src/transformers/modeling_xlm.py:87
  /home/aryaman4/transformers/src/transformers/modeling_xlm.py:87: TracerWarning: Converting a tensor to a Python boolean might cause the trace to be incorrect. We can't record the data flow of Python values, so this value will be treated as a constant in the future. This means that the trace might not generalize to other inputs!
    assert mask.size() == (bs, slen)

/home/aryaman4/anaconda3/envs/transformers/lib/python3.6/site-packages/torch/storage.py:34
  /home/aryaman4/anaconda3/envs/transformers/lib/python3.6/site-packages/torch/storage.py:34: FutureWarning: pickle support for Storage will be removed in 1.5. Use `torch.save` instead
    warnings.warn("pickle support for Storage will be removed in 1.5. Use `torch.save` instead", FutureWarning)

tests/test_tokenization_fast.py:793
tests/test_tokenization_fast.py:793
tests/test_tokenization_fast.py:793
tests/test_tokenization_fast.py:793
  /home/aryaman4/transformers/tests/test_tokenization_fast.py:793: DeprecationWarning: Please use assertEqual instead.
    self.assertEquals(sum(tokens_r["token_type_ids"]), sum(tokens_p["token_type_ids"]))

tests/test_tokenization_fast.py:798
tests/test_tokenization_fast.py:798
tests/test_tokenization_fast.py:798
tests/test_tokenization_fast.py:798
  /home/aryaman4/transformers/tests/test_tokenization_fast.py:798: DeprecationWarning: Please use assertEqual instead.
    sum(tokens_p["attention_mask"]) / len(tokens_p["attention_mask"]),

src/transformers/modeling_openai.py:166
src/transformers/modeling_openai.py:166
src/transformers/modeling_openai.py:166
  /home/aryaman4/transformers/src/transformers/modeling_openai.py:166: TracerWarning: Converting a tensor to a Python float might cause the trace to be incorrect. We can't record the data flow of Python values, so this value will be treated as a constant in the future. This means that the trace might not generalize to other inputs!
    w = w / math.sqrt(v.size(-1))

src/transformers/modeling_openai.py:169
src/transformers/modeling_openai.py:169
src/transformers/modeling_openai.py:169
  /home/aryaman4/transformers/src/transformers/modeling_openai.py:169: TracerWarning: Converting a tensor to a Python index might cause the trace to be incorrect. We can't record the data flow of Python values, so this value will be treated as a constant in the future. This means that the trace might not generalize to other inputs!
    b = self.bias[:, :, : w.size(-2), : w.size(-1)]

src/transformers/modeling_xlm.py:450
src/transformers/modeling_xlm.py:450
src/transformers/modeling_xlm.py:450
  /home/aryaman4/transformers/src/transformers/modeling_xlm.py:450: TracerWarning: Converting a tensor to a Python boolean might cause the trace to be incorrect. We can't record the data flow of Python values, so this value will be treated as a constant in the future. This means that the trace might not generalize to other inputs!
    assert lengths.size(0) == bs

src/transformers/modeling_xlm.py:451
src/transformers/modeling_xlm.py:451
src/transformers/modeling_xlm.py:451
  /home/aryaman4/transformers/src/transformers/modeling_xlm.py:451: TracerWarning: Converting a tensor to a Python number might cause the trace to be incorrect. We can't record the data flow of Python values, so this value will be treated as a constant in the future. This means that the trace might not generalize to other inputs!
    assert lengths.max().item() <= slen

src/transformers/modeling_xlm.py:451
src/transformers/modeling_xlm.py:451
src/transformers/modeling_xlm.py:451
  /home/aryaman4/transformers/src/transformers/modeling_xlm.py:451: TracerWarning: Converting a tensor to a Python boolean might cause the trace to be incorrect. We can't record the data flow of Python values, so this value will be treated as a constant in the future. This means that the trace might not generalize to other inputs!
    assert lengths.max().item() <= slen

src/transformers/modeling_mobilebert.py:512
src/transformers/modeling_mobilebert.py:512
src/transformers/modeling_mobilebert.py:512
  /home/aryaman4/transformers/src/transformers/modeling_mobilebert.py:512: TracerWarning: torch.tensor results are registered as constants in the trace. You can safely ignore this warning if you use this function to create tensors out of constant variables that would be the same every time you call this function. In any other case, this might cause the trace to be incorrect.
    + s

-- Docs: https://docs.pytest.org/en/latest/warnings.html
============================ slowest test durations ============================
164.23s call     tests/test_modeling_tf_mobilebert.py::TFMobileBertModelTest::test_compile_tf_model
135.93s call     tests/test_modeling_openai.py::OpenAIGPTModelTest::test_lm_head_model_random_beam_search_generate
127.03s call     tests/test_modeling_tf_mobilebert.py::TFMobileBertModelTest::test_attention_outputs
115.08s call     tests/test_modeling_marian.py::TestMarian_en_ROMANCE::test_pipeline
80.28s call     tests/test_modeling_mobilebert.py::MobileBertModelTest::test_attention_outputs
77.55s call     tests/test_modeling_ctrl.py::CTRLModelTest::test_lm_head_model_random_beam_search_generate
73.64s call     tests/test_modeling_xlnet.py::XLNetModelTest::test_lm_head_model_random_beam_search_generate
67.79s call     tests/test_modeling_tf_bert.py::TFBertModelTest::test_compile_tf_model
62.39s call     tests/test_modeling_tf_xlnet.py::TFXLNetModelTest::test_compile_tf_model
61.21s call     tests/test_pipelines.py::MonoColumnInputTestCase::test_torch_summarization
59.10s call     tests/test_modeling_mobilebert.py::MobileBertModelTest::test_head_pruning_integration
53.73s call     tests/test_modeling_mobilebert.py::MobileBertModelTest::test_determinism
53.29s call     tests/test_modeling_tf_distilbert.py::TFDistilBertModelTest::test_compile_tf_model
53.26s call     tests/test_modeling_reformer.py::ReformerLocalAttnModelTest::test_lm_head_model_random_beam_search_generate
51.99s call     tests/test_modeling_openai.py::OpenAIGPTModelTest::test_lm_head_model_random_no_beam_search_generate
51.22s call     tests/test_modeling_xlm.py::XLMModelTest::test_lm_head_model_random_beam_search_generate
48.68s call     tests/test_modeling_encoder_decoder.py::EncoderDecoderModelTest::test_bert_encoder_decoder_model_generate
48.17s call     tests/test_modeling_tf_t5.py::TFT5ModelTest::test_compile_tf_model
45.73s call     tests/test_pipelines.py::MonoColumnInputTestCase::test_torch_translation
45.36s call     tests/test_modeling_transfo_xl.py::TransfoXLModelTest::test_lm_head_model_random_beam_search_generate
44.24s call     tests/test_modeling_ctrl.py::CTRLModelTest::test_lm_head_model_random_no_beam_search_generate
43.80s call     tests/test_modeling_albert.py::AlbertModelTest::test_torchscript
42.83s call     tests/test_modeling_bert.py::BertModelTest::test_torchscript
42.46s call     tests/test_benchmark.py::BenchmarkTest::test_train_encoder_decoder_with_configs
41.73s call     tests/test_modeling_t5.py::T5ModelTest::test_lm_head_model_random_beam_search_generate
40.07s call     tests/test_benchmark.py::BenchmarkTest::test_trace_memory
39.87s call     tests/test_modeling_tf_mobilebert.py::TFMobileBertModelTest::test_pt_tf_model_equivalence
39.41s call     tests/test_modeling_tf_gpt2.py::TFGPT2ModelTest::test_compile_tf_model
38.12s call     tests/test_benchmark.py::BenchmarkTest::test_save_csv_files
37.70s call     tests/test_modeling_gpt2.py::GPT2ModelTest::test_lm_head_model_random_beam_search_generate
37.21s call     tests/test_modeling_tf_xlm.py::TFXLMModelTest::test_compile_tf_model
36.30s call     tests/test_modeling_tf_roberta.py::TFRobertaModelTest::test_compile_tf_model
35.71s call     tests/test_modeling_roberta.py::RobertaModelTest::test_torchscript
34.62s call     tests/test_modeling_tf_electra.py::TFElectraModelTest::test_compile_tf_model
34.27s call     tests/test_modeling_roberta.py::RobertaModelTest::test_torchscript_output_attentions
33.78s call     tests/test_modeling_tf_albert.py::TFAlbertModelTest::test_compile_tf_model
33.76s call     tests/test_trainer.py::TrainerIntegrationTest::test_trainer_eval_mrpc
33.74s call     tests/test_modeling_tf_bert.py::TFBertModelTest::test_pt_tf_model_equivalence
33.60s call     tests/test_modeling_reformer.py::ReformerLocalAttnModelTest::test_lm_head_model_random_no_beam_search_generate
32.95s call     tests/test_modeling_electra.py::ElectraModelTest::test_torchscript_output_attentions
32.87s call     tests/test_modeling_distilbert.py::DistilBertModelTest::test_torchscript_output_hidden_state
32.43s call     tests/test_modeling_distilbert.py::DistilBertModelTest::test_torchscript_output_attentions
32.38s call     tests/test_modeling_albert.py::AlbertModelTest::test_torchscript_output_attentions
32.37s call     tests/test_modeling_xlnet.py::XLNetModelTest::test_attention_outputs
31.94s call     tests/test_modeling_electra.py::ElectraModelTest::test_torchscript
31.82s call     tests/test_modeling_bert.py::BertModelTest::test_torchscript_output_attentions
30.86s call     tests/test_modeling_flaubert.py::FlaubertModelTest::test_torchscript
30.76s call     tests/test_modeling_reformer.py::ReformerLSHAttnModelTest::test_lm_head_model_random_beam_search_generate
30.40s call     tests/test_benchmark_tf.py::TFBenchmarkTest::test_inference_encoder_decoder_with_configs
29.99s call     tests/test_modeling_flaubert.py::FlaubertModelTest::test_torchscript_output_attentions
29.62s call     tests/test_modeling_reformer.py::ReformerLSHAttnModelTest::test_attention_outputs
29.60s call     tests/test_modeling_roberta.py::RobertaModelTest::test_torchscript_output_hidden_state
29.13s call     tests/test_modeling_electra.py::ElectraModelTest::test_torchscript_output_hidden_state
28.61s call     tests/test_modeling_bart.py::BARTModelTest::test_lm_head_model_random_beam_search_generate
27.22s call     tests/test_modeling_longformer.py::LongformerModelTest::test_attention_outputs
27.20s call     tests/test_modeling_flaubert.py::FlaubertModelTest::test_torchscript_output_hidden_state
26.91s call     tests/test_modeling_mobilebert.py::MobileBertModelTest::test_headmasking
26.70s call     tests/test_tokenization_auto.py::AutoTokenizerTest::test_tokenizer_from_pretrained
26.35s call     tests/test_modeling_tf_transfo_xl.py::TFTransfoXLModelTest::test_compile_tf_model
26.12s call     tests/test_modeling_tf_mobilebert.py::TFMobileBertModelTest::test_save_load
26.00s call     tests/test_modeling_albert.py::AlbertModelTest::test_torchscript_output_hidden_state
25.81s call     tests/test_modeling_bert.py::BertModelTest::test_torchscript_output_hidden_state
25.60s call     tests/test_benchmark.py::BenchmarkTest::test_train_no_configs
25.09s call     tests/test_modeling_albert.py::AlbertModelTest::test_attention_outputs
24.35s call     tests/test_modeling_t5.py::T5ModelTest::test_lm_head_model_random_no_beam_search_generate
24.34s call     tests/test_modeling_reformer.py::ReformerLocalAttnModelTest::test_reformer_chunking_backward_equality
24.29s call     tests/test_modeling_tf_openai_gpt.py::TFOpenAIGPTModelTest::test_compile_tf_model
24.03s call     tests/test_modeling_mobilebert.py::MobileBertModelTest::test_head_pruning
24.00s call     tests/test_modeling_tf_distilbert.py::TFDistilBertModelTest::test_pt_tf_model_equivalence
23.91s call     tests/test_modeling_albert.py::AlbertModelTest::test_head_pruning_integration
23.83s call     tests/test_benchmark.py::BenchmarkTest::test_train_with_configs
23.82s call     tests/test_modeling_xlm.py::XLMModelTest::test_lm_head_model_random_no_beam_search_generate
23.70s call     tests/test_modeling_reformer.py::ReformerLocalAttnModelTest::test_attention_outputs
23.52s call     tests/test_modeling_gpt2.py::GPT2ModelTest::test_torchscript
22.83s call     tests/test_modeling_tf_ctrl.py::TFCTRLModelTest::test_compile_tf_model
22.61s call     tests/test_modeling_xlnet.py::XLNetModelTest::test_headmasking
22.48s call     tests/test_modeling_mobilebert.py::MobileBertModelTest::test_torchscript
22.37s call     tests/test_modeling_tf_electra.py::TFElectraModelTest::test_pt_tf_model_equivalence
21.77s call     tests/test_modeling_bert.py::BertModelTest::test_attention_outputs
21.75s call     tests/test_modeling_tf_bert.py::TFBertModelTest::test_attention_outputs
21.16s call     tests/test_modeling_longformer.py::LongformerModelTest::test_resize_tokens_embeddings
21.03s call     tests/test_modeling_transfo_xl.py::TransfoXLModelTest::test_lm_head_model_random_no_beam_search_generate
20.56s call     tests/test_modeling_bert.py::BertModelTest::test_resize_tokens_embeddings
20.42s call     tests/test_modeling_xlnet.py::XLNetModelTest::test_determinism
20.26s call     tests/test_modeling_bert.py::BertModelTest::test_head_pruning_integration
19.49s call     tests/test_modeling_albert.py::AlbertModelTest::test_resize_tokens_embeddings
19.36s call     tests/test_modeling_gpt2.py::GPT2ModelTest::test_torchscript_output_attentions
19.35s call     tests/test_modeling_albert.py::AlbertModelTest::test_headmasking
19.01s call     tests/test_modeling_tf_roberta.py::TFRobertaModelTest::test_pt_tf_model_equivalence
18.97s call     tests/test_modeling_tf_albert.py::TFAlbertModelTest::test_pt_tf_model_equivalence
18.63s call     tests/test_modeling_bart.py::BARTModelTest::test_lm_head_model_random_no_beam_search_generate
18.43s call     tests/test_modeling_tf_mobilebert.py::TFMobileBertModelTest::test_hidden_states_output
18.06s call     tests/test_modeling_roberta.py::RobertaModelTest::test_attention_outputs
17.97s call     tests/test_modeling_tf_xlnet.py::TFXLNetModelTest::test_pt_tf_model_equivalence
17.51s call     tests/test_modeling_bart.py::BartHeadTests::test_generate_fp16
17.45s call     tests/test_modeling_flaubert.py::FlaubertModelTest::test_attention_outputs
17.38s call     tests/test_modeling_longformer.py::LongformerModelTest::test_determinism
17.11s call     tests/test_modeling_roberta.py::RobertaModelTest::test_head_pruning_integration
17.08s call     tests/test_modeling_gpt2.py::GPT2ModelTest::test_lm_head_model_random_no_beam_search_generate
17.02s call     tests/test_modeling_longformer.py::LongformerModelTest::test_save_load
16.93s call     tests/test_modeling_xlnet.py::XLNetModelTest::test_hidden_states_output
16.87s call     tests/test_modeling_tf_openai_gpt.py::TFOpenAIGPTModelTest::test_lm_head_model_random_beam_search_generate
16.86s call     tests/test_modeling_flaubert.py::FlaubertModelTest::test_head_pruning_integration
16.85s call     tests/test_modeling_distilbert.py::DistilBertModelTest::test_attention_outputs
16.71s call     tests/test_modeling_tf_t5.py::TFT5ModelTest::test_lm_head_model_random_beam_search_generate
16.60s call     tests/test_modeling_tf_mobilebert.py::TFMobileBertModelTest::test_keras_save_load
16.29s call     tests/test_modeling_gpt2.py::GPT2ModelTest::test_head_pruning_integration
16.23s call     tests/test_modeling_bert.py::BertModelTest::test_headmasking
16.21s call     tests/test_modeling_gpt2.py::GPT2ModelTest::test_attention_outputs
16.17s call     tests/test_modeling_reformer.py::ReformerLSHAttnModelTest::test_determinism
16.05s call     tests/test_modeling_tf_xlm.py::TFXLMModelTest::test_pt_tf_model_equivalence
16.05s call     tests/test_modeling_reformer.py::ReformerLocalAttnModelTest::test_determinism
16.01s call     tests/test_modeling_electra.py::ElectraModelTest::test_resize_tokens_embeddings
15.88s call     tests/test_modeling_distilbert.py::DistilBertModelTest::test_head_pruning_integration
15.84s call     tests/test_modeling_xlnet.py::XLNetModelTest::test_lm_head_model_random_no_beam_search_generate
15.78s call     tests/test_modeling_electra.py::ElectraModelTest::test_attention_outputs
15.67s call     tests/test_modeling_tf_ctrl.py::TFCTRLModelTest::test_pt_tf_model_equivalence
15.63s call     tests/test_modeling_tf_ctrl.py::TFCTRLModelTest::test_keras_save_load
15.63s call     tests/test_modeling_reformer.py::ReformerLocalAttnModelTest::test_hidden_states_output
15.57s call     tests/test_modeling_longformer.py::LongformerModelTest::test_hidden_states_output
15.49s call     tests/test_modeling_albert.py::AlbertModelTest::test_hidden_states_output
15.49s call     tests/test_modeling_albert.py::AlbertModelTest::test_save_load
15.47s call     tests/test_modeling_tf_electra.py::TFElectraModelTest::test_attention_outputs
15.18s call     tests/test_modeling_xlm.py::XLMModelTest::test_attention_outputs
15.12s call     tests/test_modeling_albert.py::AlbertModelTest::test_determinism
15.01s call     tests/test_modeling_gpt2.py::GPT2ModelTest::test_torchscript_output_hidden_state
14.94s call     tests/test_modeling_roberta.py::RobertaModelTest::test_resize_tokens_embeddings
14.88s call     tests/test_modeling_flaubert.py::FlaubertModelTest::test_resize_tokens_embeddings
14.78s call     tests/test_modeling_tf_gpt2.py::TFGPT2ModelTest::test_pt_tf_model_equivalence
14.62s call     tests/test_tokenization_fast.py::WordPieceFastTokenizerTest::test_all_tokenizers
14.50s call     tests/test_modeling_distilbert.py::DistilBertModelTest::test_resize_tokens_embeddings
14.39s call     tests/test_modeling_tf_xlm.py::TFXLMModelTest::test_attention_outputs
14.27s call     tests/test_modeling_mobilebert.py::MobileBertModelTest::test_head_pruning_save_load_from_pretrained
14.11s call     tests/test_modeling_openai.py::OpenAIGPTModelTest::test_attention_outputs
14.04s call     tests/test_modeling_xlm.py::XLMModelTest::test_head_pruning_integration
13.97s call     tests/test_modeling_bert.py::BertModelTest::test_save_load
13.96s call     tests/test_onnx.py::OnnxExportTestCase::test_infer_dynamic_axis_pytorch
13.96s call     tests/test_modeling_bert.py::BertModelTest::test_hidden_states_output
13.85s call     tests/test_modeling_tf_xlnet.py::TFXLNetModelTest::test_attention_outputs
13.78s call     tests/test_modeling_reformer.py::ReformerLocalAttnModelTest::test_resize_tokens_embeddings
13.68s call     tests/test_modeling_flaubert.py::FlaubertModelTest::test_headmasking
13.64s call     tests/test_modeling_bert.py::BertModelTest::test_determinism
13.60s call     tests/test_modeling_openai.py::OpenAIGPTModelTest::test_head_pruning_integration
13.44s call     tests/test_modeling_tf_bert.py::TFBertModelTest::test_save_load
13.28s call     tests/test_modeling_electra.py::ElectraModelTest::test_head_pruning_integration
13.20s call     tests/test_modeling_tf_ctrl.py::TFCTRLModelTest::test_lm_head_model_random_beam_search_generate
12.99s call     tests/test_modeling_distilbert.py::DistilBertModelTest::test_headmasking
12.92s call     tests/test_modeling_tf_roberta.py::TFRobertaModelTest::test_attention_outputs
12.81s call     tests/test_modeling_roberta.py::RobertaModelTest::test_headmasking
12.80s call     tests/test_modeling_mobilebert.py::MobileBertModelTest::test_torchscript_output_attentions
12.76s call     tests/test_modeling_tf_distilbert.py::TFDistilBertModelTest::test_attention_outputs
12.68s call     tests/test_benchmark.py::BenchmarkTest::test_inference_torchscript
12.60s call     tests/test_modeling_tf_bert.py::TFBertModelTest::test_hidden_states_output
12.35s call     tests/test_benchmark.py::BenchmarkTest::test_inference_encoder_decoder_with_configs
12.30s call     tests/test_modeling_tf_xlnet.py::TFXLNetModelTest::test_lm_head_model_random_beam_search_generate
12.27s call     tests/test_modeling_mobilebert.py::MobileBertModelTest::test_head_pruning_save_load_from_config_init
12.15s call     tests/test_modeling_tf_openai_gpt.py::TFOpenAIGPTModelTest::test_pt_tf_model_equivalence
12.14s call     tests/test_modeling_distilbert.py::DistilBertModelTest::test_hidden_states_output
12.07s call     tests/test_modeling_tf_gpt2.py::TFGPT2ModelTest::test_lm_head_model_random_beam_search_generate
11.92s call     tests/test_modeling_ctrl.py::CTRLModelTest::test_attention_outputs
11.79s call     tests/test_modeling_tf_distilbert.py::TFDistilBertModelTest::test_save_load
11.62s call     tests/test_modeling_roberta.py::RobertaModelTest::test_hidden_states_output
11.58s call     tests/test_modeling_tf_mobilebert.py::TFMobileBertModelTest::test_determinism
11.57s call     tests/test_modeling_flaubert.py::FlaubertModelTest::test_determinism
11.55s call     tests/test_modeling_distilbert.py::DistilBertModelTest::test_save_load
11.48s call     tests/test_modeling_xlm.py::XLMModelTest::test_headmasking
11.46s call     tests/test_modeling_tf_mobilebert.py::TFMobileBertModelTest::test_keyword_and_dict_args
11.45s call     tests/test_modeling_gpt2.py::GPT2ModelTest::test_hidden_states_output
11.31s call     tests/test_modeling_gpt2.py::GPT2ModelTest::test_resize_tokens_embeddings
11.21s call     tests/test_modeling_flaubert.py::FlaubertModelTest::test_hidden_states_output
11.20s call     tests/test_modeling_ctrl.py::CTRLModelTest::test_head_pruning_integration
11.15s call     tests/test_modeling_tf_distilbert.py::TFDistilBertModelTest::test_keras_save_load
11.13s call     tests/test_modeling_flaubert.py::FlaubertModelTest::test_save_load
10.98s call     tests/test_modeling_xlnet.py::XLNetModelTest::test_torchscript
10.84s call     tests/test_modeling_tf_t5.py::TFT5ModelTest::test_pt_tf_model_equivalence
10.84s call     tests/test_modeling_reformer.py::ReformerLSHAttnModelTest::test_hidden_states_output
10.73s call     tests/test_modeling_electra.py::ElectraModelTest::test_save_load
10.68s call     tests/test_modeling_gpt2.py::GPT2ModelTest::test_save_load
10.44s call     tests/test_modeling_electra.py::ElectraModelTest::test_determinism
10.35s call     tests/test_modeling_distilbert.py::DistilBertModelTest::test_determinism
10.35s call     tests/test_modeling_tf_bert.py::TFBertModelTest::test_keras_save_load
10.35s call     tests/test_modeling_tf_mobilebert.py::TFMobileBertModelTest::test_resize_token_embeddings
10.34s call     tests/test_modeling_gpt2.py::GPT2ModelTest::test_determinism
10.33s call     tests/test_modeling_electra.py::ElectraModelTest::test_hidden_states_output
10.28s call     tests/test_modeling_bart.py::BARTModelTest::test_attention_outputs
10.19s call     tests/test_modeling_bart.py::BARTModelTest::test_resize_tokens_embeddings
10.11s call     tests/test_modeling_gpt2.py::GPT2ModelTest::test_headmasking
10.10s call     tests/test_modeling_tf_electra.py::TFElectraModelTest::test_save_load
10.07s call     tests/test_modeling_roberta.py::RobertaModelTest::test_save_load
10.07s call     tests/test_modeling_electra.py::ElectraModelTest::test_headmasking
9.99s call     tests/test_modeling_xlm.py::XLMModelTest::test_torchscript
9.92s call     tests/test_modeling_roberta.py::RobertaModelTest::test_determinism
9.89s call     tests/test_modeling_tf_bert.py::TFBertModelTest::test_determinism
9.82s call     tests/test_modeling_openai.py::OpenAIGPTModelTest::test_torchscript
9.63s call     tests/test_modeling_mobilebert.py::MobileBertModelTest::test_hidden_states_output
9.59s call     tests/test_modeling_mobilebert.py::MobileBertModelTest::test_torchscript_output_hidden_state
9.59s call     tests/test_modeling_tf_transfo_xl.py::TFTransfoXLModelTest::test_pt_tf_model_equivalence
9.56s call     tests/test_modeling_xlm.py::XLMModelTest::test_hidden_states_output
9.56s call     tests/test_modeling_xlm.py::XLMModelTest::test_determinism
9.50s call     tests/test_modeling_tf_xlm.py::TFXLMModelTest::test_lm_head_model_random_beam_search_generate
9.49s call     tests/test_modeling_mobilebert.py::MobileBertModelTest::test_resize_tokens_embeddings
9.45s call     tests/test_modeling_reformer.py::ReformerLocalAttnModelTest::test_reformer_lm_model_backward
9.37s call     tests/test_benchmark.py::BenchmarkTest::test_inference_no_configs
9.37s call     tests/test_modeling_tf_mobilebert.py::TFMobileBertModelTest::test_inputs_embeds
9.25s call     tests/test_modeling_t5.py::T5ModelTest::test_attention_outputs
9.23s call     tests/test_modeling_tf_openai_gpt.py::TFOpenAIGPTModelTest::test_keras_save_load
9.22s call     tests/test_modeling_reformer.py::ReformerLocalAttnModelTest::test_save_load
9.19s call     tests/test_modeling_longformer.py::LongformerModelTest::test_inputs_embeds
9.12s call     tests/test_modeling_reformer.py::ReformerLSHAttnModelTest::test_lm_head_model_random_no_beam_search_generate
9.11s call     tests/test_tokenization_albert.py::AlbertTokenizationTest::test_maximum_encoding_length_single_input
9.05s call     tests/test_optimization_tf.py::OptimizationFTest::testGradientAccumulatorDistributionStrategy
9.04s call     tests/test_modeling_tf_bert.py::TFBertModelTest::test_resize_token_embeddings
8.99s call     tests/test_modeling_tf_albert.py::TFAlbertModelTest::test_attention_outputs
8.83s call     tests/test_modeling_tf_transfo_xl.py::TFTransfoXLModelTest::test_keras_save_load
8.79s call     tests/test_benchmark.py::BenchmarkTest::test_inference_no_configs_only_pretrain
8.76s call     tests/test_modeling_tf_distilbert.py::TFDistilBertModelTest::test_hidden_states_output
8.76s call     tests/test_modeling_albert.py::AlbertModelTest::test_head_pruning_save_load_from_pretrained
8.67s call     tests/test_modeling_openai.py::OpenAIGPTModelTest::test_hidden_states_output
8.57s call     tests/test_modeling_tf_electra.py::TFElectraModelTest::test_resize_token_embeddings
8.53s call     tests/test_tokenization_albert.py::AlbertTokenizationTest::test_maximum_encoding_length_pair_input
8.48s call     tests/test_benchmark_tf.py::TFBenchmarkTest::test_inference_no_configs_graph
8.47s call     tests/test_modeling_tf_mobilebert.py::TFMobileBertModelTest::test_loss_computation
8.42s call     tests/test_modeling_tf_bert.py::TFBertModelTest::test_inputs_embeds
8.40s call     tests/test_modeling_openai.py::OpenAIGPTModelTest::test_torchscript_output_attentions
8.38s call     tests/test_benchmark_tf.py::TFBenchmarkTest::test_trace_memory
8.30s call     tests/test_modeling_t5.py::T5ModelTest::test_headmasking
8.20s call     tests/test_modeling_reformer.py::ReformerLocalAttnModelTest::test_inputs_embeds
8.08s call     tests/test_tokenization_fast.py::RobertaFastTokenizerTest::test_all_tokenizers
8.02s call     tests/test_modeling_tf_roberta.py::TFRobertaModelTest::test_save_load
7.91s call     tests/test_modeling_tf_electra.py::TFElectraModelTest::test_hidden_states_output
7.85s call     tests/test_modeling_albert.py::AlbertModelTest::test_head_pruning
7.76s call     tests/test_modeling_ctrl.py::CTRLModelTest::test_determinism
7.76s call     tests/test_modeling_openai.py::OpenAIGPTModelTest::test_determinism
7.71s call     tests/test_tokenization_albert.py::AlbertTokenizationTest::test_add_special_tokens
7.70s call     tests/test_modeling_tf_bert.py::TFBertModelTest::test_keyword_and_dict_args
7.69s call     tests/test_modeling_bart.py::BARTModelTest::test_hidden_states_output
7.67s call     tests/test_benchmark.py::BenchmarkTest::test_inference_with_configs
7.66s call     tests/test_modeling_tf_ctrl.py::TFCTRLModelTest::test_lm_head_model_random_no_beam_search_generate
7.66s call     tests/test_modeling_xlm.py::XLMModelTest::test_torchscript_output_hidden_state
7.63s call     tests/test_pipelines.py::MonoColumnInputTestCase::test_tf_text_generation
7.59s call     tests/test_modeling_ctrl.py::CTRLModelTest::test_hidden_states_output
7.58s call     tests/test_modeling_reformer.py::ReformerLocalAttnModelTest::test_reformer_model_attn_masking
7.58s call     tests/test_modeling_bert.py::BertModelTest::test_head_pruning
7.56s call     tests/test_tokenization_albert.py::AlbertTokenizationTest::test_pretokenized_inputs
7.54s call     tests/test_modeling_gpt2.py::GPT2ModelTest::test_gpt2_model_past
7.50s call     tests/test_modeling_albert.py::AlbertModelTest::test_head_pruning_save_load_from_config_init
7.42s call     tests/test_modeling_xlnet.py::XLNetModelTest::test_torchscript_output_hidden_state
7.34s call     tests/test_modeling_tf_roberta.py::TFRobertaModelTest::test_keras_save_load
7.29s call     tests/test_modeling_openai.py::OpenAIGPTModelTest::test_headmasking
7.27s call     tests/test_modeling_tf_t5.py::TFT5ModelTest::test_keras_save_load
7.23s call     tests/test_modeling_bart.py::BARTModelTest::test_save_load
7.21s call     tests/test_modeling_flaubert.py::FlaubertModelTest::test_head_pruning_save_load_from_pretrained
7.20s call     tests/test_modeling_openai.py::OpenAIGPTModelTest::test_torchscript_output_hidden_state
7.19s call     tests/test_modeling_tf_roberta.py::TFRobertaModelTest::test_hidden_states_output
7.10s call     tests/test_modeling_bart.py::BARTModelTest::test_determinism
7.04s call     tests/test_modeling_tf_openai_gpt.py::TFOpenAIGPTModelTest::test_attention_outputs
7.04s call     tests/test_modeling_mobilebert.py::MobileBertModelTest::test_for_multiple_choice
7.03s call     tests/test_modeling_bert.py::BertModelTest::test_head_pruning_save_load_from_pretrained
7.03s call     tests/test_modeling_reformer.py::ReformerLocalAttnModelTest::test_reformer_chunking_forward_equality
6.99s call     tests/test_modeling_tf_xlm.py::TFXLMModelTest::test_keras_save_load
6.98s call     tests/test_modeling_xlnet.py::XLNetModelTest::test_torchscript_output_attentions
6.91s call     tests/test_modeling_encoder_decoder.py::EncoderDecoderModelTest::test_bert_encoder_decoder_model_labels
6.90s call     tests/test_modeling_longformer.py::LongformerModelTest::test_longformer_model_global_attention_mask
6.88s call     tests/test_modeling_gpt2.py::GPT2ModelTest::test_head_pruning_save_load_from_pretrained
6.86s call     tests/test_modeling_bert.py::BertModelTest::test_head_pruning_save_load_from_config_init
6.86s call     tests/test_modeling_tf_gpt2.py::TFGPT2ModelTest::test_attention_outputs
6.85s call     tests/test_tokenization_fast.py::NoPaddingTokenFastTokenizerMatchingTest::test_pretokenized_tokenizers
6.83s call     tests/test_modeling_tf_t5.py::TFT5ModelTest::test_lm_head_model_random_no_beam_search_generate
6.81s call     tests/test_modeling_tf_xlnet.py::TFXLNetModelTest::test_hidden_states_output
6.80s call     tests/test_modeling_albert.py::AlbertModelTest::test_inputs_embeds
6.75s call     tests/test_tokenization_fast.py::WordPieceFastTokenizerTest::test_pretokenized_tokenizers
6.73s call     tests/test_modeling_tf_xlm.py::TFXLMModelTest::test_hidden_states_output
6.70s call     tests/test_modeling_flaubert.py::FlaubertModelTest::test_inputs_embeds
6.68s call     tests/test_modeling_tf_albert.py::TFAlbertModelTest::test_keras_save_load
6.68s call     tests/test_modeling_tf_openai_gpt.py::TFOpenAIGPTModelTest::test_lm_head_model_random_no_beam_search_generate
6.65s call     tests/test_modeling_transfo_xl.py::TransfoXLModelTest::test_attention_outputs
6.62s call     tests/test_modeling_roberta.py::RobertaModelTest::test_head_pruning
6.57s call     tests/test_modeling_tf_gpt2.py::TFGPT2ModelTest::test_keras_save_load
6.53s call     tests/test_modeling_xlnet.py::XLNetModelTest::test_inputs_embeds
6.48s call     tests/test_modeling_tf_xlnet.py::TFXLNetModelTest::test_lm_head_model_random_no_beam_search_generate
6.44s call     tests/test_modeling_tf_distilbert.py::TFDistilBertModelTest::test_resize_token_embeddings
6.40s call     tests/test_modeling_tf_albert.py::TFAlbertModelTest::test_save_load
6.40s call     tests/test_modeling_xlm.py::XLMModelTest::test_torchscript_output_attentions
6.33s call     tests/test_modeling_tf_t5.py::TFT5ModelTest::test_attention_outputs
6.29s call     tests/test_modeling_ctrl.py::CTRLModelTest::test_save_load
6.18s call     tests/test_benchmark_tf.py::TFBenchmarkTest::test_save_csv_files
6.10s call     tests/test_modeling_distilbert.py::DistilBertModelTest::test_head_pruning_save_load_from_pretrained
6.04s call     tests/test_modeling_tf_xlnet.py::TFXLNetModelTest::test_keras_save_load
6.01s call     tests/test_modeling_tf_ctrl.py::TFCTRLModelTest::test_attention_outputs
6.00s call     tests/test_modeling_t5.py::T5ModelTest::test_save_load
5.90s call     tests/test_modeling_bert.py::BertModelTest::test_inputs_embeds
5.84s call     tests/test_modeling_roberta.py::RobertaModelTest::test_head_pruning_save_load_from_pretrained
5.79s call     tests/test_modeling_tf_albert.py::TFAlbertModelTest::test_hidden_states_output
5.76s call     tests/test_modeling_electra.py::ElectraModelTest::test_head_pruning_save_load_from_pretrained
5.73s call     tests/test_modeling_tf_albert.py::TFAlbertModelTest::test_resize_token_embeddings
5.69s call     tests/test_modeling_t5.py::T5ModelTest::test_hidden_states_output
5.67s call     tests/test_modeling_electra.py::ElectraModelTest::test_inputs_embeds
5.66s call     tests/test_modeling_roberta.py::RobertaModelTest::test_inputs_embeds
5.59s call     tests/test_tokenization_fast.py::RobertaFastTokenizerTest::test_pretokenized_tokenizers
5.56s call     tests/test_modeling_flaubert.py::FlaubertModelTest::test_head_pruning_save_load_from_config_init
5.56s call     tests/test_modeling_t5.py::T5ModelTest::test_t5_generate_with_past_key_value_states
5.54s call     tests/test_modeling_tf_xlnet.py::TFXLNetModelTest::test_save_load
5.54s call     tests/test_modeling_openai.py::OpenAIGPTModelTest::test_head_pruning_save_load_from_pretrained
5.50s call     tests/test_modeling_t5.py::T5ModelTest::test_determinism
5.48s call     tests/test_modeling_tf_distilbert.py::TFDistilBertModelTest::test_keyword_and_dict_args
5.45s call     tests/test_modeling_ctrl.py::CTRLModelTest::test_ctrl_model
5.43s call     tests/test_modeling_gpt2.py::GPT2ModelTest::test_head_pruning_save_load_from_config_init
5.42s call     tests/test_modeling_encoder_decoder.py::EncoderDecoderModelTest::test_save_and_load_from_pretrained
5.41s call     tests/test_modeling_distilbert.py::DistilBertModelTest::test_head_pruning
5.38s call     tests/test_modeling_tf_ctrl.py::TFCTRLModelTest::test_resize_token_embeddings
5.37s call     tests/test_modeling_tf_ctrl.py::TFCTRLModelTest::test_save_load
5.37s call     tests/test_modeling_gpt2.py::GPT2ModelTest::test_inputs_embeds
5.33s call     tests/test_benchmark_tf.py::TFBenchmarkTest::test_inference_with_configs_graph
5.33s call     tests/test_modeling_tf_xlm.py::TFXLMModelTest::test_save_load
5.31s call     tests/test_modeling_xlm.py::XLMModelTest::test_resize_tokens_embeddings
5.29s call     tests/test_benchmark_tf.py::TFBenchmarkTest::test_inference_no_configs_only_pretrain
5.28s call     tests/test_modeling_flaubert.py::FlaubertModelTest::test_head_pruning
5.28s call     tests/test_modeling_xlm.py::XLMModelTest::test_head_pruning_save_load_from_pretrained
5.18s call     tests/test_modeling_transfo_xl.py::TransfoXLModelTest::test_headmasking
5.16s call     tests/test_modeling_roberta.py::RobertaModelTest::test_head_pruning_save_load_from_config_init
5.15s call     tests/test_modeling_gpt2.py::GPT2ModelTest::test_head_pruning
5.13s call     tests/test_modeling_transfo_xl.py::TransfoXLModelTest::test_resize_tokens_embeddings
5.12s call     tests/test_modeling_openai.py::OpenAIGPTModelTest::test_resize_tokens_embeddings
5.10s call     tests/test_modeling_distilbert.py::DistilBertModelTest::test_head_pruning_save_load_from_config_init
5.09s call     tests/test_modeling_distilbert.py::DistilBertModelTest::test_inputs_embeds
5.08s call     tests/test_modeling_reformer.py::ReformerLSHAttnModelTest::test_inputs_embeds
5.07s call     tests/test_modeling_tf_roberta.py::TFRobertaModelTest::test_resize_token_embeddings
5.06s call     tests/test_modeling_openai.py::OpenAIGPTModelTest::test_head_pruning_save_load_from_config_init
5.03s call     tests/test_modeling_electra.py::ElectraModelTest::test_head_pruning
4.90s call     tests/test_modeling_tf_distilbert.py::TFDistilBertModelTest::test_determinism
4.88s setup    tests/test_modeling_bart.py::MBartIntegrationTests::test_enro_forward
4.88s call     tests/test_modeling_flaubert.py::FlaubertModelTest::test_flaubert_qa
4.86s call     tests/test_modeling_tf_xlnet.py::TFXLNetModelTest::test_determinism
4.85s call     tests/test_modeling_tf_distilbert.py::TFDistilBertModelTest::test_loss_computation
4.85s call     tests/test_modeling_tf_distilbert.py::TFDistilBertModelTest::test_inputs_embeds
4.83s call     tests/test_modeling_tf_gpt2.py::TFGPT2ModelTest::test_lm_head_model_random_no_beam_search_generate
4.73s call     tests/test_modeling_tf_electra.py::TFElectraModelTest::test_determinism
4.72s call     tests/test_modeling_openai.py::OpenAIGPTModelTest::test_inputs_embeds
4.72s call     tests/test_modeling_xlm.py::XLMModelTest::test_head_pruning_save_load_from_config_init
4.71s call     tests/test_modeling_transfo_xl.py::TransfoXLModelTest::test_hidden_states_output
4.70s call     tests/test_modeling_electra.py::ElectraModelTest::test_head_pruning_save_load_from_config_init
4.68s call     tests/test_modeling_xlm.py::XLMModelTest::test_inputs_embeds
4.68s call     tests/test_modeling_gpt2.py::GPT2ModelTest::test_gpt2_model
4.65s call     tests/test_modeling_tf_roberta.py::TFRobertaModelTest::test_determinism
4.64s call     tests/test_modeling_xlm.py::XLMModelTest::test_head_pruning
4.63s call     tests/test_modeling_tf_electra.py::TFElectraModelTest::test_keyword_and_dict_args
4.58s call     tests/test_modeling_bart.py::BARTModelTest::test_tiny_model
4.58s call     tests/test_modeling_ctrl.py::CTRLModelTest::test_head_pruning_save_load_from_pretrained
4.57s call     tests/test_tokenization_openai.py::OpenAIGPTTokenizationTest::test_save_and_load_tokenizer
4.55s call     tests/test_modeling_tf_xlm.py::TFXLMModelTest::test_keyword_and_dict_args
4.51s call     tests/test_modeling_tf_gpt2.py::TFGPT2ModelTest::test_hidden_states_output
4.48s call     tests/test_modeling_tf_bert.py::TFBertModelTest::test_loss_computation
4.47s call     tests/test_modeling_tf_gpt2.py::TFGPT2ModelTest::test_save_load
4.42s call     tests/test_modeling_tf_transfo_xl.py::TFTransfoXLModelTest::test_save_load
4.31s call     tests/test_modeling_tf_electra.py::TFElectraModelTest::test_loss_computation
4.30s call     tests/test_pipelines.py::MonoColumnInputTestCase::test_torch_text_generation
4.28s call     tests/test_tokenization_fast.py::TransfoXLFastTokenizerTest::test_all_tokenizers
4.24s call     tests/test_modeling_mobilebert.py::MobileBertModelTest::test_save_load
4.24s call     tests/test_modeling_ctrl.py::CTRLModelTest::test_head_pruning
4.24s call     tests/test_modeling_reformer.py::ReformerLocalAttnModelTest::test_reformer_model
4.23s call     tests/test_modeling_openai.py::OpenAIGPTModelTest::test_head_pruning
4.18s call     tests/test_modeling_transfo_xl.py::TransfoXLModelTest::test_determinism
4.17s call     tests/test_modeling_tf_xlm.py::TFXLMModelTest::test_lm_head_model_random_no_beam_search_generate
4.16s call     tests/test_modeling_openai.py::OpenAIGPTModelTest::test_save_load
4.14s call     tests/test_modeling_tf_openai_gpt.py::TFOpenAIGPTModelTest::test_save_load
4.10s call     tests/test_modeling_encoder_decoder.py::EncoderDecoderModelTest::test_save_and_load_from_encoder_decoder_pretrained
4.10s call     tests/test_modeling_encoder_decoder.py::EncoderDecoderModelTest::test_bert_encoder_decoder_model
4.09s call     tests/test_onnx.py::OnnxExportTestCase::test_infer_dynamic_axis_tf
4.06s call     tests/test_modeling_tf_t5.py::TFT5ModelTest::test_save_load
4.05s call     tests/test_modeling_longformer.py::LongformerModelTest::test_longformer_model
4.03s call     tests/test_modeling_tf_ctrl.py::TFCTRLModelTest::test_hidden_states_output
3.98s call     tests/test_modeling_ctrl.py::CTRLModelTest::test_inputs_embeds
3.98s call     tests/test_modeling_tf_roberta.py::TFRobertaModelTest::test_loss_computation
3.96s call     tests/test_modeling_tf_roberta.py::TFRobertaModelTest::test_keyword_and_dict_args
3.92s call     tests/test_modeling_encoder_decoder.py::EncoderDecoderModelTest::test_bert_encoder_decoder_model_from_pretrained
3.90s call     tests/test_modeling_gpt2.py::GPT2ModelTest::test_gpt2_model_att_mask_past
3.89s call     tests/test_modeling_t5.py::T5ModelTest::test_t5_model
3.83s call     tests/test_pipelines.py::MonoColumnInputTestCase::test_tf_fill_mask
3.78s call     tests/test_modeling_tf_xlnet.py::TFXLNetModelTest::test_keyword_and_dict_args
3.75s call     tests/test_modeling_gpt2.py::GPT2ModelTest::test_gpt2_double_lm_head_model
3.70s call     tests/test_modeling_longformer.py::LongformerModelTest::test_for_multiple_choice
3.68s call     tests/test_modeling_ctrl.py::CTRLModelTest::test_head_pruning_save_load_from_config_init
3.67s call     tests/test_modeling_tf_t5.py::TFT5ModelTest::test_hidden_states_output
3.67s call     tests/test_benchmark_tf.py::TFBenchmarkTest::test_inference_no_configs_eager
3.66s call     tests/test_modeling_tf_xlm.py::TFXLMModelTest::test_determinism
3.63s call     tests/test_modeling_tf_openai_gpt.py::TFOpenAIGPTModelTest::test_hidden_states_output
3.60s call     tests/test_modeling_tf_xlm.py::TFXLMModelTest::test_inputs_embeds
3.60s call     tests/test_modeling_tf_openai_gpt.py::TFOpenAIGPTModelTest::test_keyword_and_dict_args
3.56s call     tests/test_modeling_tf_mobilebert.py::TFMobileBertModelTest::test_model_common_attributes
3.55s call     tests/test_modeling_tf_bert.py::TFBertModelTest::test_model_common_attributes
3.55s call     tests/test_modeling_xlm.py::XLMModelTest::test_save_load
3.53s call     tests/test_tokenization_openai.py::OpenAIGPTTokenizationTest::test_pickle_tokenizer
3.50s call     tests/test_modeling_tf_gpt2.py::TFGPT2ModelTest::test_inputs_embeds
3.48s call     tests/test_modeling_xlnet.py::XLNetModelTest::test_resize_tokens_embeddings
3.45s call     tests/test_pipelines.py::MonoColumnInputTestCase::test_tf_feature_extraction
3.44s call     tests/test_modeling_tf_roberta.py::TFRobertaModelTest::test_inputs_embeds
3.39s call     tests/test_modeling_tf_transfo_xl.py::TFTransfoXLModelTest::test_attention_outputs
3.35s call     tests/test_modeling_tf_t5.py::TFT5ModelTest::test_inputs_embeds
3.33s call     tests/test_modeling_bert.py::BertModelTest::test_bert_model_as_decoder_with_default_input_mask
3.33s call     tests/test_modeling_tf_t5.py::TFT5ModelTest::test_determinism
3.31s call     tests/test_modeling_tf_transfo_xl.py::TFTransfoXLModelTest::test_hidden_states_output
3.30s call     tests/test_modeling_tf_ctrl.py::TFCTRLModelTest::test_keyword_and_dict_args
3.25s call     tests/test_pipelines.py::MonoColumnInputTestCase::test_ner_grouped
3.16s call     tests/test_modeling_bart.py::BARTModelTest::test_advanced_inputs
3.13s call     tests/test_modeling_tf_xlm.py::TFXLMModelTest::test_loss_computation
3.10s call     tests/test_modeling_tf_electra.py::TFElectraModelTest::test_inputs_embeds
3.09s call     tests/test_modeling_tf_electra.py::TFElectraModelTest::test_model_common_attributes
3.08s call     tests/test_tokenization_fast.py::NoPaddingTokenFastTokenizerMatchingTest::test_all_tokenizers
3.06s call     tests/test_modeling_bert.py::BertModelTest::test_bert_model_as_decoder
3.04s call     tests/test_modeling_tf_xlnet.py::TFXLNetModelTest::test_resize_token_embeddings
3.03s call     tests/test_modeling_tf_albert.py::TFAlbertModelTest::test_keyword_and_dict_args
3.02s call     tests/test_modeling_tf_xlnet.py::TFXLNetModelTest::test_inputs_embeds
3.02s call     tests/test_modeling_mobilebert.py::MobileBertModelTest::test_correct_missing_keys
3.01s call     tests/test_modeling_xlnet.py::XLNetModelTest::test_save_load
3.00s call     tests/test_modeling_mobilebert.py::MobileBertModelTest::test_for_pretraining
2.95s call     tests/test_benchmark_tf.py::TFBenchmarkTest::test_inference_with_configs_eager
2.95s setup    tests/test_modeling_marian.py::TestMarian_MT_EN::test_batch_generation_mt_en
2.94s call     tests/test_modeling_reformer.py::ReformerLocalAttnModelTest::test_reformer_layer_training_dropout
2.93s call     tests/test_modeling_tf_openai_gpt.py::TFOpenAIGPTModelTest::test_resize_token_embeddings
2.85s call     tests/test_modeling_tf_xlm.py::TFXLMModelTest::test_resize_token_embeddings
2.81s call     tests/test_modeling_t5.py::T5ModelTest::test_inputs_embeds
2.80s call     tests/test_modeling_mobilebert.py::MobileBertModelTest::test_for_question_answering
2.78s call     tests/test_pipelines.py::QAPipelineTests::test_tf_question_answering
2.77s call     tests/test_modeling_tf_gpt2.py::TFGPT2ModelTest::test_resize_token_embeddings
2.77s call     tests/test_modeling_bert.py::BertModelTest::test_for_causal_lm_decoder
2.77s call     tests/test_modeling_tf_openai_gpt.py::TFOpenAIGPTModelTest::test_determinism
2.74s call     tests/test_modeling_t5.py::T5ModelTest::test_t5_decoder_model_past
2.74s call     tests/test_modeling_tf_albert.py::TFAlbertModelTest::test_determinism
2.66s call     tests/test_modeling_bart.py::TestSinusoidalPositionalEmbeddings::test_positional_emb_weights_against_marian
2.66s call     tests/test_modeling_tf_ctrl.py::TFCTRLModelTest::test_loss_computation
2.63s call     tests/test_modeling_tf_xlnet.py::TFXLNetModelTest::test_loss_computation
2.62s call     tests/test_tokenization_openai.py::OpenAIGPTTokenizationTest::test_add_special_tokens
2.59s call     tests/test_tokenization_openai.py::OpenAIGPTTokenizationTest::test_batch_encode_plus_padding
2.57s call     tests/test_modeling_albert.py::AlbertModelTest::test_albert_model
2.56s call     tests/test_pipelines.py::MonoColumnInputTestCase::test_torch_fill_mask
2.56s call     tests/test_modeling_flaubert.py::FlaubertModelTest::test_flaubert_model
2.54s call     tests/test_modeling_mobilebert.py::MobileBertModelTest::test_for_token_classification
2.53s call     tests/test_modeling_tf_t5.py::TFT5ModelTest::test_resize_token_embeddings
2.52s call     tests/test_modeling_tf_t5.py::TFT5ModelTest::test_keyword_and_dict_args
2.50s call     tests/test_tokenization_openai.py::OpenAIGPTTokenizationTest::test_added_tokens_do_lower_case
2.47s call     tests/test_modeling_flaubert.py::FlaubertModelTest::test_flaubert_sequence_classif
2.44s call     tests/test_modeling_tf_gpt2.py::TFGPT2ModelTest::test_keyword_and_dict_args
2.44s call     tests/test_tokenization_t5.py::T5TokenizationTest::test_maximum_encoding_length_pair_input
2.41s call     tests/test_tokenization_marian.py::MarianTokenizationTest::test_tokenizer_equivalence_en_de
2.32s call     tests/test_modeling_tf_albert.py::TFAlbertModelTest::test_inputs_embeds
2.32s setup    tests/test_modeling_marian.py::TestMarian_EN_FR::test_batch_generation_en_fr
2.28s call     tests/test_modeling_bert.py::BertModelTest::test_bert_model
2.25s call     tests/test_modeling_tf_albert.py::TFAlbertModelTest::test_model_common_attributes
2.25s call     tests/test_modeling_tf_gpt2.py::TFGPT2ModelTest::test_determinism
2.23s setup    tests/test_modeling_marian.py::TestMarian_EN_DE_More::test_auto_config
2.22s call     tests/test_pipelines.py::MonoColumnInputTestCase::test_tf_ner
2.22s call     tests/test_pipelines.py::MonoColumnInputTestCase::test_tf_sentiment_analysis
2.20s call     tests/test_modeling_mobilebert.py::MobileBertModelTest::test_for_sequence_classification
2.16s setup    tests/test_modeling_marian.py::TestMarian_FR_EN::test_batch_generation_fr_en
2.16s call     tests/test_modeling_tf_ctrl.py::TFCTRLModelTest::test_inputs_embeds
2.14s call     tests/test_modeling_tf_ctrl.py::TFCTRLModelTest::test_determinism
2.12s call     tests/test_modeling_tf_distilbert.py::TFDistilBertModelTest::test_model_common_attributes
2.11s call     tests/test_modeling_tf_albert.py::TFAlbertModelTest::test_loss_computation
2.11s call     tests/test_modeling_tf_ctrl.py::TFCTRLModelTest::test_model_common_attributes
2.08s call     tests/test_modeling_openai.py::OpenAIGPTModelTest::test_correct_missing_keys
2.08s call     tests/test_modeling_encoder_decoder.py::EncoderDecoderModelTest::test_bert_encoder_decoder_model_from_pretrained_configs
2.06s call     tests/test_modeling_transfo_xl.py::TransfoXLModelTest::test_inputs_embeds
2.05s call     tests/test_tokenization_fast.py::TransfoXLFastTokenizerTest::test_pretokenized_tokenizers
2.05s call     tests/test_modeling_tf_transfo_xl.py::TFTransfoXLModelTest::test_determinism
2.02s call     tests/test_modeling_electra.py::ElectraModelTest::test_electra_model
2.00s call     tests/test_modeling_mobilebert.py::MobileBertModelTest::test_inputs_embeds
2.00s call     tests/test_modeling_bart.py::BartHeadTests::test_generate_beam_search
1.98s call     tests/test_modeling_reformer.py::ReformerLocalAttnModelTest::test_reformer_with_mlm
1.97s call     tests/test_modeling_longformer.py::LongformerModelTest::test_longformer_for_question_answering
1.97s call     tests/test_modeling_reformer.py::ReformerLocalAttnModelTest::test_reformer_with_lm
1.97s setup    tests/test_modeling_marian.py::TestMarian_RU_FR::test_batch_generation_ru_fr
1.96s call     tests/test_pipelines.py::QAPipelineTests::test_torch_question_answering
1.95s call     tests/test_modeling_longformer.py::LongformerModelTest::test_longformer_model_attention_mask_determinism
1.94s call     tests/test_modeling_albert.py::AlbertModelTest::test_for_multiple_choice
1.93s call     tests/test_modeling_ctrl.py::CTRLModelTest::test_ctrl_lm_head_model
1.91s call     tests/test_pipelines.py::MonoColumnInputTestCase::test_torch_feature_extraction
1.90s call     tests/test_modeling_mobilebert.py::MobileBertModelTest::test_for_masked_lm
1.90s call     tests/test_modeling_transfo_xl.py::TransfoXLModelTest::test_save_load
1.89s call     tests/test_modeling_openai.py::OpenAIGPTModelTest::test_openai_gpt_model
1.89s call     tests/test_modeling_roberta.py::RobertaModelTest::test_for_multiple_choice
1.86s call     tests/test_modeling_gpt2.py::GPT2ModelTest::test_correct_missing_keys
1.84s call     tests/test_modeling_transfo_xl.py::TransfoXLModelTest::test_transfo_xl_lm_head
1.84s call     tests/test_modeling_tf_ctrl.py::TFCTRLModelTest::test_ctrl_lm_head
1.83s call     tests/test_modeling_tf_roberta.py::TFRobertaModelTest::test_model_common_attributes
1.82s call     tests/test_modeling_gpt2.py::GPT2ModelTest::test_gpt2_lm_head_model
1.81s call     tests/test_modeling_distilbert.py::DistilBertModelTest::test_distilbert_model
1.81s call     tests/test_tokenization_t5.py::T5TokenizationTest::test_maximum_encoding_length_single_input
1.81s call     tests/test_modeling_mobilebert.py::MobileBertModelTest::test_for_next_sequence_prediction
1.81s call     tests/test_tokenization_t5.py::T5TokenizationTest::test_pretokenized_inputs
1.77s call     tests/test_modeling_tf_transfo_xl.py::TFTransfoXLModelTest::test_keyword_and_dict_args
1.76s call     tests/test_tokenization_openai.py::OpenAIGPTTokenizationTest::test_separate_tokenizers
1.70s call     tests/test_modeling_flaubert.py::FlaubertModelTest::test_flaubert_simple_qa
1.68s call     tests/test_pipelines.py::MonoColumnInputTestCase::test_torch_sentiment_analysis
1.68s call     tests/test_modeling_mobilebert.py::MobileBertModelTest::test_mobilebert_model
1.67s call     tests/test_modeling_tf_mobilebert.py::TFMobileBertModelTest::test_mobilebert_model
1.66s call     tests/test_pipelines.py::MonoColumnInputTestCase::test_tf_ner_grouped
1.66s call     tests/test_modeling_reformer.py::ReformerLSHAttnModelTest::test_save_load
1.65s call     tests/test_modeling_longformer.py::LongformerModelTest::test_for_sequence_classification
1.64s call     tests/test_tokenization_auto.py::AutoTokenizerTest::test_tokenizer_from_model_type
1.64s call     tests/test_tokenization_openai.py::OpenAIGPTTokenizationTest::test_add_tokens_tokenizer
1.63s call     tests/test_tokenization_distilbert.py::DistilBertTokenizationTest::test_maximum_encoding_length_pair_input
1.61s call     tests/test_modeling_tf_openai_gpt.py::TFOpenAIGPTModelTest::test_inputs_embeds
1.60s setup    tests/test_modeling_marian.py::TestMarian_en_ROMANCE::test_batch_generation_en_ROMANCE_multi
1.58s call     tests/test_pipelines.py::MonoColumnInputTestCase::test_torch_ner
1.57s call     tests/test_modeling_reformer.py::ReformerLocalAttnModelTest::test_reformer_no_chunking
1.55s call     tests/test_modeling_tf_bert.py::TFBertModelTest::test_bert_model
1.53s call     tests/test_modeling_roberta.py::RobertaModelTest::test_roberta_model
1.53s call     tests/test_modeling_tf_distilbert.py::TFDistilBertModelTest::test_distilbert_model
1.50s call     tests/test_tokenization_auto.py::AutoTokenizerTest::test_tokenizer_identifier_non_existent
1.49s call     tests/test_modeling_t5.py::T5ModelTest::test_with_lm_head
1.49s call     tests/test_modeling_tf_distilbert.py::TFDistilBertModelTest::test_for_multiple_choice
1.48s call     tests/test_tokenization_albert.py::AlbertTokenizationTest::test_save_and_load_tokenizer
1.44s call     tests/test_trainer.py::DataCollatorIntegrationTest::test_default_regression
1.43s call     tests/test_modeling_distilbert.py::DistilBertModelTest::test_for_multiple_choice
1.43s call     tests/test_modeling_tf_xlm.py::TFXLMModelTest::test_model_common_attributes
1.42s call     tests/test_modeling_tf_bert.py::TFBertModelTest::test_for_pretraining
1.41s call     tests/test_modeling_gpt2.py::GPT2ModelTest::test_tie_model_weights
1.40s call     tests/test_modeling_reformer.py::ReformerLSHAttnModelTest::test_resize_tokens_embeddings
1.39s call     tests/test_modeling_tf_transfo_xl.py::TFTransfoXLModelTest::test_inputs_embeds
1.38s call     tests/test_tokenization_albert.py::AlbertTokenizationTest::test_conversion_reversible
1.37s call     tests/test_modeling_electra.py::ElectraModelTest::test_for_multiple_choice
1.37s call     tests/test_modeling_bert.py::BertModelTest::test_for_multiple_choice
1.37s call     tests/test_modeling_tf_openai_gpt.py::TFOpenAIGPTModelTest::test_openai_gpt_model
1.36s call     tests/test_tokenization_t5.py::T5TokenizationTest::test_add_special_tokens
1.32s call     tests/test_modeling_tf_transfo_xl.py::TFTransfoXLModelTest::test_transfo_xl_lm_head
1.32s call     tests/test_modeling_t5.py::T5ModelTest::test_t5_decoder_model_past_with_attn_mask
1.31s call     tests/test_tokenization_openai.py::OpenAIGPTTokenizationTest::test_maximum_encoding_length_single_input
1.31s call     tests/test_modeling_tf_roberta.py::TFRobertaModelTest::test_for_masked_lm
1.30s call     tests/test_modeling_tf_electra.py::TFElectraModelTest::test_electra_model
1.29s call     tests/test_modeling_tf_mobilebert.py::TFMobileBertModelTest::test_for_next_sequence_prediction
1.27s call     tests/test_modeling_flaubert.py::FlaubertModelTest::test_flaubert_lm_head
1.27s call     tests/test_modeling_tf_gpt2.py::TFGPT2ModelTest::test_model_common_attributes
1.26s call     tests/test_modeling_bert.py::BertModelTest::test_for_masked_lm
1.22s call     tests/test_modeling_tf_auto.py::TFAutoModelTest::test_from_identifier_from_model_type
1.20s call     tests/test_tokenization_t5.py::T5TokenizationTest::test_internal_consistency
1.19s call     tests/test_modeling_longformer.py::LongformerModelTest::test_for_token_classification
1.19s call     tests/test_tokenization_openai.py::OpenAIGPTTokenizationTest::test_encode_decode_with_spaces
1.18s call     tests/test_modeling_tf_electra.py::TFElectraModelTest::test_for_question_answering
1.18s call     tests/test_modeling_tf_mobilebert.py::TFMobileBertModelTest::test_for_pretraining
1.17s call     tests/test_modeling_tf_distilbert.py::TFDistilBertModelTest::test_for_masked_lm
1.16s call     tests/test_modeling_tf_mobilebert.py::TFMobileBertModelTest::test_for_multiple_choice
1.16s call     tests/test_modeling_ctrl.py::CTRLModelTest::test_initialization
1.16s call     tests/test_tokenization_openai.py::OpenAIGPTTokenizationTest::test_batch_encode_plus_batch_sequence_length
1.16s call     tests/test_modeling_tf_mobilebert.py::TFMobileBertModelTest::test_for_masked_lm
1.15s call     tests/test_modeling_tf_mobilebert.py::TFMobileBertModelTest::test_for_question_answering
1.15s call     tests/test_modeling_tf_mobilebert.py::TFMobileBertModelTest::test_for_token_classification
1.14s call     tests/test_modeling_tf_mobilebert.py::TFMobileBertModelTest::test_for_sequence_classification
1.14s call     tests/test_modeling_bart.py::BartHeadTests::test_question_answering_forward
1.14s call     tests/test_tokenization_openai.py::OpenAIGPTTokenizationTest::test_pretokenized_inputs
1.13s call     tests/test_tokenization_openai.py::OpenAIGPTTokenizationTest::test_right_and_left_padding
1.11s call     tests/test_tokenization_openai.py::OpenAIGPTTokenizationTest::test_batch_encode_plus_tensors
1.11s call     tests/test_modeling_tf_ctrl.py::TFCTRLModelTest::test_ctrl_model
1.09s call     tests/test_modeling_bart.py::MBartIntegrationTests::test_mbart_fast_forward
1.09s call     tests/test_modeling_bart.py::BartHeadTests::test_sequence_classification_forward
1.08s call     tests/test_modeling_tf_electra.py::TFElectraModelTest::test_for_token_classification
1.08s call     tests/test_tokenization_openai.py::OpenAIGPTTokenizationTest::test_maximum_encoding_length_pair_input
1.08s call     tests/test_tokenization_xlm_roberta.py::XLMRobertaTokenizationTest::test_maximum_encoding_length_single_input
1.08s call     tests/test_modeling_tf_gpt2.py::TFGPT2ModelTest::test_loss_computation
1.07s call     tests/test_tokenization_openai.py::OpenAIGPTTokenizationTest::test_internal_consistency
1.06s call     tests/test_tokenization_openai.py::OpenAIGPTTokenizationTest::test_padding_to_multiple_of
1.06s call     tests/test_modeling_albert.py::AlbertModelTest::test_for_sequence_classification
1.05s call     tests/test_tokenization_openai.py::OpenAIGPTTokenizationTest::test_call
1.05s call     tests/test_modeling_longformer.py::LongformerModelTest::test_longformer_for_masked_lm
1.04s call     tests/test_tokenization_auto.py::AutoTokenizerTest::test_tokenizer_from_pretrained_identifier
1.03s call     tests/test_tokenization_xlnet.py::XLNetTokenizationTest::test_maximum_encoding_length_single_input
1.03s call     tests/test_modeling_tf_gpt2.py::TFGPT2ModelTest::test_gpt2_model_past
1.03s call     tests/test_modeling_albert.py::AlbertModelTest::test_for_question_answering
1.02s call     tests/test_tokenization_xlm.py::XLMTokenizationTest::test_maximum_encoding_length_pair_input
1.02s call     tests/test_modeling_bert.py::BertModelTest::test_for_pretraining
1.02s call     tests/test_modeling_roberta.py::RobertaModelTest::test_for_token_classification
1.01s call     tests/test_modeling_roberta.py::RobertaModelTest::test_for_question_answering
1.00s call     tests/test_tokenization_openai.py::OpenAIGPTTokenizationTest::test_get_vocab
1.00s call     tests/test_modeling_distilbert.py::DistilBertModelTest::test_for_masked_lm
1.00s call     tests/test_modeling_tf_t5.py::TFT5ModelTest::test_loss_computation
1.00s call     tests/test_tokenization_xlnet.py::XLNetTokenizationTest::test_maximum_encoding_length_pair_input
1.00s call     tests/test_tokenization_openai.py::OpenAIGPTTokenizationTest::test_number_of_added_tokens
0.99s call     tests/test_modeling_bart.py::BartHeadTests::test_lm_uneven_forward
0.99s call     tests/test_modeling_gpt2.py::GPT2ModelTest::test_initialization
0.98s call     tests/test_modeling_tf_distilbert.py::TFDistilBertModelTest::test_for_question_answering
0.98s call     tests/test_modeling_tf_t5.py::TFT5ModelTest::test_t5_model
0.98s call     tests/test_tokenization_auto.py::AutoTokenizerTest::test_tokenizer_identifier_with_correct_config
0.98s call     tests/test_tokenization_distilbert.py::BertTokenizationTest::test_maximum_encoding_length_pair_input
0.98s call     tests/test_tokenization_openai.py::OpenAIGPTTokenizationTest::test_padding_to_max_length
0.97s call     tests/test_modeling_openai.py::OpenAIGPTModelTest::test_initialization
0.97s call     tests/test_modeling_ctrl.py::CTRLModelTest::test_correct_missing_keys
0.97s call     tests/test_modeling_tf_openai_gpt.py::TFOpenAIGPTModelTest::test_model_common_attributes
0.97s call     tests/test_modeling_transfo_xl.py::TransfoXLModelTest::test_transfo_xl_model
0.96s call     tests/test_modeling_electra.py::ElectraModelTest::test_correct_missing_keys
0.96s call     tests/test_hf_api.py::HfApiEndpointsTest::test_presign_and_upload
0.95s call     tests/test_tokenization_openai.py::OpenAIGPTTokenizationTest::test_special_tokens_mask_input_pairs
0.94s call     tests/test_modeling_roberta.py::RobertaModelTest::test_for_masked_lm
0.93s call     tests/test_modeling_tf_auto.py::TFAutoModelTest::test_from_pretrained_identifier
0.93s call     tests/test_hf_api.py::HfApiPublicTest::test_model_list
0.92s call     tests/test_modeling_bert.py::BertModelTest::test_for_question_answering
0.92s call     tests/test_modeling_tf_roberta.py::TFRobertaModelTest::test_for_question_answering
0.92s call     tests/test_modeling_albert.py::AlbertModelTest::test_for_pretraining
0.91s call     tests/test_modeling_tf_electra.py::TFElectraModelTest::test_for_masked_lm
0.91s call     tests/test_modeling_electra.py::ElectraModelTest::test_for_sequence_classification
0.91s call     tests/test_modeling_electra.py::ElectraModelTest::test_for_masked_lm
0.90s call     tests/test_tokenization_openai.py::OpenAIGPTTokenizationTest::test_mask_output
0.89s call     tests/test_modeling_tf_xlnet.py::TFXLNetModelTest::test_model_common_attributes
0.89s call     tests/test_modeling_gpt2.py::GPT2ModelTest::test_model_common_attributes
0.88s call     tests/test_modeling_xlm.py::XLMModelTest::test_xlm_qa
0.88s call     tests/test_modeling_bart.py::BartHeadTests::test_dummy_inputs
0.88s call     tests/test_tokenization_albert.py::AlbertTokenizationTest::test_get_vocab
0.87s call     tests/test_tokenization_openai.py::OpenAIGPTTokenizationTest::test_encode_plus_with_padding
0.87s call     tests/test_modeling_tf_t5.py::TFT5ModelTest::test_model_common_attributes
0.87s call     tests/test_modeling_bart.py::BartHeadTests::test_lm_forward
0.85s call     tests/test_tokenization_openai.py::OpenAIGPTTokenizationTest::test_conversion_reversible
0.84s call     tests/test_trainer.py::DataCollatorIntegrationTest::test_lm_tokenizer_without_padding
0.83s call     tests/test_modeling_tf_t5.py::TFT5ModelTest::test_t5_decoder_model_past
0.83s call     tests/test_tokenization_xlm_roberta.py::XLMRobertaTokenizationTest::test_maximum_encoding_length_pair_input
0.83s call     tests/test_tokenization_openai.py::OpenAIGPTTokenizationTest::test_swap_special_token
0.82s call     tests/test_modeling_bert.py::BertModelTest::test_for_causal_lm
0.82s call     tests/test_tokenization_distilbert.py::BertTokenizationTest::test_maximum_encoding_length_single_input
0.82s call     tests/test_modeling_tf_openai_gpt.py::TFOpenAIGPTModelTest::test_loss_computation
0.81s call     tests/test_modeling_distilbert.py::DistilBertModelTest::test_for_question_answering
0.80s call     tests/test_modeling_albert.py::AlbertModelTest::test_correct_missing_keys
0.80s call     tests/test_modeling_tf_openai_gpt.py::TFOpenAIGPTModelTest::test_openai_gpt_lm_head
0.79s call     tests/test_modeling_longformer.py::LongformerModelTest::test_correct_missing_keys
0.79s call     tests/test_modeling_tf_t5.py::TFT5ModelTest::test_with_lm_head
0.78s call     tests/test_tokenization_auto.py::AutoTokenizerTest::test_from_pretrained_use_fast_toggle
0.77s call     tests/test_tokenization_openai.py::OpenAIGPTTokenizationTest::test_full_tokenizer
0.77s call     tests/test_modeling_electra.py::ElectraModelTest::test_for_pre_training
0.77s call     tests/test_modeling_xlm.py::XLMModelTest::test_xlm_model
0.76s call     tests/test_modeling_openai.py::OpenAIGPTModelTest::test_openai_gpt_lm_head_model
0.75s call     tests/test_modeling_tf_gpt2.py::TFGPT2ModelTest::test_gpt2_model_att_mask_past
0.75s call     tests/test_modeling_albert.py::AlbertModelTest::test_for_masked_lm
0.75s call     tests/test_modeling_openai.py::OpenAIGPTModelTest::test_openai_gpt_double_lm_head_model
0.75s call     tests/test_tokenization_albert.py::AlbertTokenizationTest::test_mask_output
0.74s call     tests/test_modeling_tf_roberta.py::TFRobertaModelTest::test_roberta_model
0.74s call     tests/test_modeling_tf_transfo_xl.py::TFTransfoXLModelTest::test_loss_computation
0.73s call     tests/test_modeling_bert.py::BertModelTest::test_for_sequence_classification
0.72s call     tests/test_modeling_electra.py::ElectraModelTest::test_for_token_classification
0.72s call     tests/test_trainer.py::TrainerIntegrationTest::test_trainer_eval_lm
0.71s call     tests/test_modeling_tf_xlm.py::TFXLMModelTest::test_for_token_classification
0.71s call     tests/test_modeling_tf_openai_gpt.py::TFOpenAIGPTModelTest::test_openai_gpt_double_head
0.71s call     tests/test_modeling_tf_roberta.py::TFRobertaModelTest::test_for_token_classification
0.70s call     tests/test_tokenization_openai.py::OpenAIGPTTokenizationTest::test_special_tokens_mask
0.69s call     tests/test_modeling_tf_roberta.py::TFRobertaModelTest::test_for_multiple_choice
0.68s call     tests/test_trainer.py::DataCollatorIntegrationTest::test_lm_tokenizer_with_padding
0.68s call     tests/test_tokenization_albert.py::AlbertTokenizationTest::test_batch_encode_plus_padding
0.68s call     tests/test_modeling_tf_bert.py::TFBertModelTest::test_for_token_classification
0.68s call     tests/test_tokenization_openai.py::OpenAIGPTTokenizationTest::test_tokenizers_common_properties
0.67s call     tests/test_modeling_tf_xlnet.py::TFXLNetModelTest::test_xlnet_base_model
0.67s call     tests/test_modeling_tf_xlm.py::TFXLMModelTest::test_xlm_model
0.67s call     tests/test_tokenization_albert.py::AlbertTokenizationTest::test_encode_plus_with_padding
0.67s call     tests/test_modeling_distilbert.py::DistilBertModelTest::test_for_token_classification
0.67s call     tests/test_modeling_xlnet.py::XLNetModelTest::test_correct_missing_keys
0.66s call     tests/test_modeling_electra.py::ElectraModelTest::test_for_question_answering
0.66s call     tests/test_modeling_tf_transfo_xl.py::TFTransfoXLModelTest::test_transfo_xl_model
0.66s call     tests/test_modeling_bert.py::BertModelTest::test_for_token_classification
0.66s call     tests/test_tokenization_albert.py::AlbertTokenizationTest::test_internal_consistency
0.65s call     tests/test_modeling_tf_t5.py::TFT5ModelTest::test_t5_decoder_model_past_with_attn_mask
0.65s call     tests/test_tokenization_bert.py::BertTokenizationTest::test_maximum_encoding_length_pair_input
0.63s call     tests/test_tokenization_albert.py::AlbertTokenizationTest::test_added_tokens_do_lower_case
0.63s call     tests/test_modeling_tf_bert.py::TFBertModelTest::test_for_question_answering
0.62s call     tests/test_modeling_tf_electra.py::TFElectraModelTest::test_for_pretraining
0.62s call     tests/test_modeling_openai.py::OpenAIGPTModelTest::test_tie_model_weights
0.61s call     tests/test_modeling_tf_bert.py::TFBertModelTest::test_for_sequence_classification
0.60s call     tests/test_modeling_tf_gpt2.py::TFGPT2ModelTest::test_gpt2_model
0.60s call     tests/test_hf_api.py::HfApiEndpointsTest::test_list_objs
0.59s call     tests/test_tokenization_albert.py::AlbertTokenizationTest::test_pickle_tokenizer
0.58s call     tests/test_modeling_xlm.py::XLMModelTest::test_xlm_simple_qa
0.58s teardown tests/test_hf_api.py::HfApiEndpointsTest::test_whoami
0.57s call     tests/test_modeling_bert.py::BertModelTest::test_for_next_sequence_prediction
0.57s call     tests/test_modeling_tf_transfo_xl.py::TFTransfoXLModelTest::test_model_common_attributes
0.57s call     tests/test_modeling_tf_distilbert.py::TFDistilBertModelTest::test_for_sequence_classification
0.55s call     tests/test_modeling_distilbert.py::DistilBertModelTest::test_for_sequence_classification
0.54s call     tests/test_modeling_tf_xlnet.py::TFXLNetModelTest::test_xlnet_lm_head
0.54s call     tests/test_trainer.py::DataCollatorIntegrationTest::test_default_classification
0.54s call     tests/test_modeling_tf_albert.py::TFAlbertModelTest::test_albert_model
0.54s call     tests/test_modeling_tf_distilbert.py::TFDistilBertModelTest::test_for_token_classification
0.53s call     tests/test_tokenization_albert.py::AlbertTokenizationTest::test_number_of_added_tokens
0.53s call     tests/test_tokenization_xlm.py::XLMTokenizationTest::test_add_special_tokens
0.53s call     tests/test_modeling_mobilebert.py::MobileBertModelTest::test_tie_model_weights
0.53s call     tests/test_modeling_bert.py::BertModelTest::test_correct_missing_keys
0.53s call     tests/test_tokenization_utils.py::TokenizerUtilsTest::test_batch_encoding_pickle
0.52s call     tests/test_tokenization_distilbert.py::DistilBertTokenizationTest::test_maximum_encoding_length_single_input
0.52s call     tests/test_modeling_mobilebert.py::MobileBertModelTest::test_mobilebert_model_as_decoder_with_default_input_mask
0.51s call     tests/test_modeling_reformer.py::ReformerLSHAttnModelTest::test_reformer_lm_model_backward
0.51s call     tests/test_tokenization_albert.py::AlbertTokenizationTest::test_padding_to_max_length
0.50s call     tests/test_modeling_flaubert.py::FlaubertModelTest::test_correct_missing_keys
0.50s call     tests/test_modeling_tf_bert.py::TFBertModelTest::test_for_masked_lm
0.50s call     tests/test_tokenization_utils.py::TokenizerUtilsTest::test_batch_encoding_pickle_tf
0.50s call     tests/test_modeling_tf_albert.py::TFAlbertModelTest::test_for_pretraining
0.50s call     tests/test_tokenization_gpt2.py::GPT2TokenizationTest::test_maximum_encoding_length_pair_input
0.48s call     tests/test_tokenization_albert.py::AlbertTokenizationTest::test_add_tokens_tokenizer
0.48s call     tests/test_modeling_mobilebert.py::MobileBertModelTest::test_mobilebert_model_as_decoder
0.47s call     tests/test_modeling_mobilebert.py::MobileBertModelTest::test_initialization
0.46s call     tests/test_tokenization_marian.py::MarianTokenizationTest::test_maximum_encoding_length_pair_input
0.46s call     tests/test_modeling_tf_bert.py::TFBertModelTest::test_for_next_sequence_prediction
0.46s call     tests/test_modeling_flaubert.py::FlaubertModelTest::test_tie_model_weights
0.46s call     tests/test_modeling_xlnet.py::XLNetModelTest::test_xlnet_qa
0.45s call     tests/test_tokenization_bert.py::BertTokenizationTest::test_maximum_encoding_length_single_input
0.45s call     tests/test_tokenization_utils.py::TokenizerUtilsTest::test_batch_encoding_pickle_pt
0.45s call     tests/test_modeling_openai.py::OpenAIGPTModelTest::test_model_common_attributes
0.44s call     tests/test_modeling_xlnet.py::XLNetModelTest::test_xlnet_base_model
0.44s call     tests/test_tokenization_utils.py::TokenizerUtilsTest::test_batch_encoding_is_fast
0.43s call     tests/test_modeling_tf_bert.py::TFBertModelTest::test_for_multiple_choice
0.43s call     tests/test_modeling_tf_albert.py::TFAlbertModelTest::test_for_masked_lm
0.43s call     tests/test_modeling_longformer.py::LongformerModelTest::test_initialization
0.42s call     tests/test_modeling_tf_albert.py::TFAlbertModelTest::test_for_sequence_classification
0.41s call     tests/test_modeling_reformer.py::ReformerLSHAttnModelTest::test_reformer_chunking_forward_equality
0.41s call     tests/test_modeling_albert.py::AlbertModelTest::test_initialization
0.41s call     tests/test_modeling_tf_albert.py::TFAlbertModelTest::test_for_question_answering
0.41s call     tests/test_modeling_tf_gpt2.py::TFGPT2ModelTest::test_gpt2_double_head
0.40s call     tests/test_modeling_auto.py::AutoModelTest::test_from_pretrained_identifier
0.40s call     tests/test_tokenization_albert.py::AlbertTokenizationTest::test_padding_to_multiple_of
0.39s call     tests/test_modeling_reformer.py::ReformerLSHAttnModelTest::test_reformer_model_attn_masking
0.39s call     tests/test_tokenization_albert.py::AlbertTokenizationTest::test_call
0.38s call     tests/test_modeling_bart.py::BartModelIntegrationTests::test_xsum_config_generation_params
0.38s call     tests/test_modeling_tf_gpt2.py::TFGPT2ModelTest::test_gpt2_lm_head
0.38s call     tests/test_modeling_reformer.py::ReformerLSHAttnModelTest::test_reformer_model
0.36s call     tests/test_modeling_tf_xlnet.py::TFXLNetModelTest::test_xlnet_for_multiple_choice
0.36s call     tests/test_modeling_mobilebert.py::MobileBertModelTest::test_model_common_attributes
0.36s call     tests/test_modeling_reformer.py::ReformerIntegrationTests::test_lsh_lm_model_grad
0.36s call     tests/test_modeling_tf_xlm.py::TFXLMModelTest::test_xlm_qa
0.36s call     tests/test_tokenization_albert.py::AlbertTokenizationTest::test_encode_decode_with_spaces
0.36s call     tests/test_modeling_distilbert.py::DistilBertModelTest::test_correct_missing_keys
0.35s call     tests/test_modeling_flaubert.py::FlaubertModelTest::test_initialization
0.34s call     tests/test_modeling_bert.py::BertModelTest::test_initialization
0.34s call     tests/test_tokenization_roberta.py::RobertaTokenizationTest::test_maximum_encoding_length_single_input
0.34s call     tests/test_modeling_tf_xlm.py::TFXLMModelTest::test_xlm_lm_head
0.33s call     tests/test_modeling_auto.py::AutoModelTest::test_from_identifier_from_model_type
0.33s call     tests/test_modeling_electra.py::ElectraModelTest::test_initialization
0.33s call     tests/test_modeling_tf_xlm.py::TFXLMModelTest::test_xlm_sequence_classif
0.33s call     tests/test_modeling_xlnet.py::XLNetModelTest::test_xlnet_lm_head
0.32s call     tests/test_tokenization_albert.py::AlbertTokenizationTest::test_sequence_builders
0.32s call     tests/test_hf_api.py::HfApiEndpointsTest::test_presign
0.31s call     tests/test_modeling_tf_xlnet.py::TFXLNetModelTest::test_xlnet_token_classification
0.31s call     tests/test_modeling_roberta.py::RobertaModelTest::test_correct_missing_keys
0.31s call     tests/test_modeling_albert.py::AlbertModelTest::test_tie_model_weights
0.31s call     tests/test_modeling_tf_xlnet.py::TFXLNetModelTest::test_xlnet_qa
0.31s call     tests/test_modeling_ctrl.py::CTRLModelTest::test_model_common_attributes
0.30s call     tests/test_tokenization_xlnet.py::XLNetTokenizationTest::test_pretokenized_inputs
0.30s call     tests/test_tokenization_albert.py::AlbertTokenizationTest::test_tokenizers_common_properties
0.29s call     tests/test_tokenization_albert.py::AlbertTokenizationTest::test_separate_tokenizers
0.29s call     tests/test_modeling_tf_xlnet.py::TFXLNetModelTest::test_xlnet_sequence_classif
0.29s call     tests/test_tokenization_roberta.py::RobertaTokenizationTest::test_maximum_encoding_length_pair_input
0.29s call     tests/test_tokenization_albert.py::AlbertTokenizationTest::test_full_tokenizer
0.28s call     tests/test_modeling_xlm.py::XLMModelTest::test_correct_missing_keys
0.28s call     tests/test_tokenization_xlm.py::XLMTokenizationTest::test_maximum_encoding_length_single_input
0.26s call     tests/test_hf_api.py::HfApiLoginTest::test_login_valid
0.26s call     tests/test_tokenization_albert.py::AlbertTokenizationTest::test_special_tokens_mask_input_pairs
0.24s call     tests/test_tokenization_albert.py::AlbertTokenizationTest::test_special_tokens_mask
0.23s call     tests/test_tokenization_transfo_xl.py::TransfoXLTokenizationTest::test_maximum_encoding_length_pair_input
0.23s call     tests/test_modeling_marian.py::TestMarian_EN_DE_More::test_auto_config
0.22s call     tests/test_modeling_xlm.py::XLMModelTest::test_initialization
0.22s call     tests/test_tokenization_xlm_roberta.py::XLMRobertaTokenizationTest::test_add_special_tokens
0.22s call     tests/test_tokenization_albert.py::AlbertTokenizationTest::test_right_and_left_padding
0.21s call     tests/test_tokenization_albert.py::AlbertTokenizationTest::test_batch_encode_plus_tensors
0.21s call     tests/test_tokenization_albert.py::AlbertTokenizationTest::test_batch_encode_plus_batch_sequence_length
0.20s call     tests/test_tokenization_xlm_roberta.py::XLMRobertaTokenizationTest::test_pretokenized_inputs
0.20s call     tests/test_modeling_reformer.py::ReformerLSHAttnModelTest::test_reformer_layer_training_dropout
0.19s call     tests/test_hf_api.py::HfApiEndpointsTest::test_whoami
0.19s call     tests/test_tokenization_albert.py::AlbertTokenizationTest::test_swap_special_token
0.19s call     tests/test_hf_api.py::HfApiEndpointsTest::test_presign_valid_org
0.18s call     tests/test_tokenization_t5.py::T5TokenizationTest::test_added_tokens_do_lower_case
0.18s call     tests/test_modeling_albert.py::AlbertModelTest::test_model_common_attributes
0.18s call     tests/test_tokenization_gpt2.py::GPT2TokenizationTest::test_maximum_encoding_length_single_input
0.18s call     tests/test_configuration_auto.py::AutoConfigTest::test_config_model_type_from_model_identifier
0.18s call     tests/test_tokenization_xlnet.py::XLNetTokenizationTest::test_add_special_tokens
0.18s call     tests/test_hf_api.py::HfApiPublicTest::test_staging_model_list
0.17s call     tests/test_tokenization_xlm_roberta.py::XLMRobertaTokenizationTest::test_internal_consistency
0.17s call     tests/test_hf_api.py::HfApiEndpointsTest::test_presign_invalid_org
0.17s setup    tests/test_hf_api.py::HfApiEndpointsTest::test_list_objs
0.17s call     tests/test_modeling_xlm.py::XLMModelTest::test_xlm_for_token_classification
0.16s call     tests/test_hf_api.py::HfApiLoginTest::test_login_invalid
0.16s call     tests/test_tokenization_distilbert.py::BertTokenizationTest::test_pretokenized_inputs
0.16s call     tests/test_modeling_distilbert.py::DistilBertModelTest::test_tie_model_weights
0.16s call     tests/test_configuration_auto.py::AutoConfigTest::test_config_from_model_shortcut
0.16s call     tests/test_modeling_xlm.py::XLMModelTest::test_xlm_sequence_classif
0.16s call     tests/test_tokenization_t5.py::T5TokenizationTest::test_save_and_load_tokenizer
0.15s call     tests/test_tokenization_xlm.py::XLMTokenizationTest::test_pretokenized_inputs
0.15s call     tests/test_tokenization_xlnet.py::XLNetTokenizationTest::test_internal_consistency
0.15s call     tests/test_hf_api.py::HfApiEndpointsTest::test_presign_invalid
0.15s call     tests/test_modeling_bart.py::BARTModelTest::test_initialization
0.15s call     tests/test_modeling_distilbert.py::DistilBertModelTest::test_initialization
0.15s call     tests/test_modeling_roberta.py::RobertaModelTest::test_initialization
0.15s call     tests/test_modeling_reformer.py::ReformerIntegrationTests::test_lm_model_forward
0.14s call     tests/test_tokenization_transfo_xl.py::TransfoXLTokenizationTest::test_pretokenized_inputs
0.14s call     tests/test_modeling_t5.py::T5ModelTest::test_model_common_attributes
0.14s call     tests/test_tokenization_ctrl.py::CTRLTokenizationTest::test_maximum_encoding_length_pair_input
0.14s call     tests/test_modeling_xlnet.py::XLNetModelTest::test_initialization
0.14s call     tests/test_modeling_reformer.py::ReformerLSHAttnModelTest::test_correct_missing_keys
0.14s call     tests/test_tokenization_albert.py::AlbertTokenizationTest::test_pretrained_model_lists
0.13s call     tests/test_modeling_reformer.py::ReformerIntegrationTests::test_local_model_forward
0.13s call     tests/test_modeling_bart.py::MBartIntegrationTests::test_mbart_enro_config
0.13s call     tests/test_tokenization_distilbert.py::DistilBertTokenizationTest::test_batch_encode_plus_batch_sequence_length
0.12s call     tests/test_tokenization_transfo_xl.py::TransfoXLTokenizationTest::test_maximum_encoding_length_single_input
0.12s call     tests/test_modeling_bart.py::BARTModelTest::test_save_load_strict
0.12s call     tests/test_modeling_xlnet.py::XLNetModelTest::test_xlnet_base_model_with_att_output
0.12s call     tests/test_modeling_roberta.py::RobertaModelTest::test_model_common_attributes
0.12s call     tests/test_tokenization_bert.py::BertTokenizationTest::test_batch_encode_plus_tensors
0.12s call     tests/test_modeling_flaubert.py::FlaubertModelTest::test_model_common_attributes
0.12s call     tests/test_modeling_bert.py::BertModelTest::test_tie_model_weights
0.12s call     tests/test_modeling_xlnet.py::XLNetModelTest::test_xlnet_token_classif
0.11s call     tests/test_modeling_bert.py::BertModelTest::test_model_common_attributes
0.11s call     tests/test_tokenization_distilbert.py::DistilBertTokenizationTest::test_batch_encode_plus_padding
0.11s call     tests/test_tokenization_distilbert.py::DistilBertTokenizationTest::test_pretokenized_inputs
0.11s call     tests/test_modeling_reformer.py::ReformerIntegrationTests::test_lsh_model_forward
0.11s call     tests/test_modeling_xlm.py::XLMModelTest::test_xlm_lm_head
0.11s call     tests/test_tokenization_marian.py::MarianTokenizationTest::test_maximum_encoding_length_single_input
0.11s call     tests/test_tokenization_xlnet.py::XLNetTokenizationTest::test_tokenizers_common_properties
0.11s call     tests/test_tokenization_marian.py::MarianTokenizationTest::test_save_and_load_tokenizer
0.10s call     tests/test_modeling_electra.py::ElectraModelTest::test_tie_model_weights
0.10s call     tests/test_modeling_roberta.py::RobertaModelTest::test_tie_model_weights
0.10s call     tests/test_tokenization_transfo_xl.py::TransfoXLTokenizationTest::test_add_special_tokens
0.10s call     tests/test_tokenization_marian.py::MarianTokenizationTest::test_swap_special_token
0.10s call     tests/test_modeling_reformer.py::ReformerLSHAttnModelTest::test_reformer_with_lm
0.10s call     tests/test_modeling_reformer.py::ReformerIntegrationTests::test_local_lm_model_grad
0.09s call     tests/test_modeling_reformer.py::ReformerLocalAttnModelTest::test_model_common_attributes
0.09s call     tests/test_tokenization_marian.py::MarianTokenizationTest::test_outputs_not_longer_than_maxlen
0.09s call     tests/test_tokenization_distilbert.py::BertTokenizationTest::test_batch_encode_plus_padding
0.09s call     tests/test_modeling_reformer.py::ReformerLocalAttnModelTest::test_correct_missing_keys
0.09s call     tests/test_modeling_electra.py::ElectraModelTest::test_model_common_attributes
0.08s call     tests/test_modeling_distilbert.py::DistilBertModelTest::test_model_common_attributes
0.08s call     tests/test_tokenization_marian.py::MarianTokenizationTest::test_pickle_tokenizer
0.08s call     tests/test_modeling_tf_common.py::UtilsFunctionsTest::test_top_k_top_p_filtering
0.08s call     tests/test_modeling_longformer.py::LongformerModelTest::test_model_common_attributes
0.07s call     tests/test_tokenization_gpt2.py::GPT2TokenizationTest::test_call
0.07s call     tests/test_modeling_reformer.py::ReformerLSHAttnModelTest::test_reformer_with_mlm
0.07s call     tests/test_modeling_xlm.py::XLMModelTest::test_tie_model_weights
0.07s call     tests/test_tokenization_distilbert.py::DistilBertTokenizationTest::test_batch_encode_plus_tensors
0.07s call     tests/test_optimization.py::OptimizationTest::test_adam_w
0.07s call     tests/test_modeling_transfo_xl.py::TransfoXLModelTest::test_correct_missing_keys
0.07s call     tests/test_tokenization_bert.py::BertTokenizationTest::test_pretokenized_inputs
0.07s call     tests/test_tokenization_transfo_xl.py::TransfoXLTokenizationTest::test_save_and_load_tokenizer
0.07s call     tests/test_tokenization_marian.py::MarianTokenizationTest::test_pretokenized_inputs
0.07s call     tests/test_modeling_reformer.py::ReformerLocalAttnModelTest::test_initialization
0.07s call     tests/test_tokenization_xlm_roberta.py::XLMRobertaTokenizationTest::test_save_and_load_tokenizer
0.07s call     tests/test_tokenization_marian.py::MarianTokenizationTest::test_special_tokens_mask
0.07s call     tests/test_tokenization_xlnet.py::XLNetTokenizationTest::test_tokenizer_no_lower
0.06s call     tests/test_modeling_t5.py::T5ModelTest::test_shift_right
0.06s call     tests/test_tokenization_gpt2.py::GPT2TokenizationTest::test_batch_encode_plus_batch_sequence_length
0.06s call     tests/test_modeling_xlnet.py::XLNetModelTest::test_xlnet_sequence_classif
0.06s call     tests/test_tokenization_gpt2.py::GPT2TokenizationTest::test_save_and_load_tokenizer
0.06s call     tests/test_tokenization_t5.py::T5TokenizationTest::test_call
0.06s call     tests/test_tokenization_t5.py::T5TokenizationTest::test_conversion_reversible
0.06s call     tests/test_modeling_xlnet.py::XLNetModelTest::test_tie_model_weights
0.06s call     tests/test_modeling_t5.py::T5ModelTest::test_initialization
0.06s call     tests/test_tokenization_marian.py::MarianTokenizationTest::test_padding_to_max_length
0.06s call     tests/test_tokenization_transfo_xl.py::TransfoXLTokenizationTest::test_batch_encode_plus_tensors
0.06s call     tests/test_tokenization_roberta.py::RobertaTokenizationTest::test_pretokenized_inputs
0.05s call     tests/test_modeling_xlm.py::XLMModelTest::test_model_common_attributes
0.05s call     tests/test_tokenization_marian.py::MarianTokenizationTest::test_internal_consistency
0.05s call     tests/test_modeling_t5.py::T5ModelTest::test_correct_missing_keys
0.05s call     tests/test_tokenization_distilbert.py::BertTokenizationTest::test_batch_encode_plus_tensors
0.05s call     tests/test_tokenization_xlnet.py::XLNetTokenizationTest::test_save_and_load_tokenizer
0.05s call     tests/test_modeling_xlnet.py::XLNetModelTest::test_model_common_attributes
0.05s call     tests/test_tokenization_distilbert.py::BertTokenizationTest::test_batch_encode_plus_batch_sequence_length
0.04s call     tests/test_tokenization_t5.py::T5TokenizationTest::test_batch_encode_plus_batch_sequence_length
0.04s call     tests/test_tokenization_gpt2.py::GPT2TokenizationTest::test_rust_and_python_full_tokenizers
0.04s call     tests/test_tokenization_marian.py::MarianTokenizationTest::test_call
0.04s call     tests/test_modeling_reformer.py::ReformerIntegrationTests::test_lsh_layer_forward
0.04s call     tests/test_modeling_bart.py::BartHeadTests::test_prepare_bart_decoder_inputs
0.04s call     tests/test_modeling_transfo_xl.py::TransfoXLModelTest::test_initialization
0.04s call     tests/test_modeling_reformer.py::ReformerLSHAttnModelTest::test_initialization
0.04s call     tests/test_tokenization_marian.py::MarianTokenizationTest::test_batch_encode_plus_padding
0.04s call     tests/test_tokenization_distilbert.py::BertTokenizationTest::test_call
0.04s call     tests/test_modeling_tf_albert.py::TFAlbertModelTest::test_lm_head_model_random_no_beam_search_generate
0.04s call     tests/test_tokenization_gpt2.py::GPT2TokenizationTest::test_number_of_added_tokens
0.04s call     tests/test_tokenization_t5.py::T5TokenizationTest::test_get_vocab
0.04s call     tests/test_tokenization_marian.py::MarianTokenizationTest::test_separate_tokenizers
0.04s call     tests/test_tokenization_xlm_roberta.py::XLMRobertaTokenizationTest::test_batch_encode_plus_tensors
0.04s call     tests/test_tokenization_xlm_roberta.py::XLMRobertaTokenizationTest::test_tokenizers_common_properties
0.04s call     tests/test_tokenization_distilbert.py::DistilBertTokenizationTest::test_call
0.04s call     tests/test_tokenization_marian.py::MarianTokenizationTest::test_conversion_reversible
0.04s call     tests/test_tokenization_xlnet.py::XLNetTokenizationTest::test_batch_encode_plus_batch_sequence_length
0.04s call     tests/test_modeling_bart.py::BARTModelTest::test_model_common_attributes
0.04s call     tests/test_tokenization_transfo_xl.py::TransfoXLTokenizationTest::test_batch_encode_plus_batch_sequence_length
0.03s call     tests/test_modeling_tf_distilbert.py::TFDistilBertModelTest::test_config
0.03s call     tests/test_modeling_reformer.py::ReformerIntegrationTests::test_local_layer_forward
0.03s call     tests/test_tokenization_t5.py::T5TokenizationTest::test_special_tokens_mask
0.03s call     tests/test_tokenization_gpt2.py::GPT2TokenizationTest::test_batch_encode_plus_padding
0.03s call     tests/test_tokenization_marian.py::MarianTokenizationTest::test_encode_plus_with_padding
0.03s call     tests/test_modeling_bart.py::BartHeadTests::test_resize_tokens_embeddings_more
0.03s call     tests/test_tokenization_transfo_xl.py::TransfoXLTokenizationTest::test_swap_special_token
0.03s call     tests/test_tokenization_marian.py::MarianTokenizationTest::test_batch_encode_plus_tensors
0.03s teardown tests/test_tokenization_distilbert.py::BertTokenizationTest::test_number_of_added_tokens
0.03s call     tests/test_tokenization_t5.py::T5TokenizationTest::test_separate_tokenizers
0.03s call     tests/test_tokenization_bert.py::BertTokenizationTest::test_call
0.03s call     tests/test_tokenization_xlm_roberta.py::XLMRobertaTokenizationTest::test_conversion_reversible
0.03s call     tests/test_modeling_reformer.py::ReformerIntegrationTests::test_local_layer_forward_complex
0.03s call     tests/test_tokenization_gpt2.py::GPT2TokenizationTest::test_special_tokens_mask_input_pairs
0.03s call     tests/test_tokenization_xlm_roberta.py::XLMRobertaTokenizationTest::test_batch_encode_plus_padding
0.03s call     tests/test_tokenization_marian.py::MarianTokenizationTest::test_mask_output
0.03s call     tests/test_tokenization_t5.py::T5TokenizationTest::test_batch_encode_plus_padding
0.03s call     tests/test_tokenization_xlm_roberta.py::XLMRobertaTokenizationTest::test_get_vocab
0.03s call     tests/test_tokenization_t5.py::T5TokenizationTest::test_right_and_left_padding
0.03s call     tests/test_modeling_reformer.py::ReformerLSHAttnModelTest::test_reformer_no_chunking
0.03s call     tests/test_tokenization_marian.py::MarianTokenizationTest::test_number_of_added_tokens
0.03s call     tests/test_tokenization_transfo_xl.py::TransfoXLTokenizationTest::test_batch_encode_plus_padding
0.03s call     tests/test_tokenization_xlm_roberta.py::XLMRobertaTokenizationTest::test_added_tokens_do_lower_case
0.03s call     tests/test_tokenization_t5.py::T5TokenizationTest::test_add_tokens_tokenizer
0.03s call     tests/test_tokenization_xlnet.py::XLNetTokenizationTest::test_batch_encode_plus_padding
0.03s call     tests/test_tokenization_xlm_roberta.py::XLMRobertaTokenizationTest::test_call
0.03s call     tests/test_tokenization_gpt2.py::GPT2TokenizationTest::test_batch_encode_plus_tensors
0.03s call     tests/test_tokenization_t5.py::T5TokenizationTest::test_batch_encode_plus_tensors
0.03s call     tests/test_tokenization_t5.py::T5TokenizationTest::test_encode_plus_with_padding
0.03s call     tests/test_modeling_tf_roberta.py::TFRobertaModelTest::test_config
0.03s call     tests/test_tokenization_transfo_xl.py::TransfoXLTokenizationTest::test_added_tokens_do_lower_case
0.03s call     tests/test_tokenization_marian.py::MarianTokenizationTest::test_special_tokens_mask_input_pairs
0.03s call     tests/test_tokenization_xlm.py::XLMTokenizationTest::test_batch_encode_plus_padding
0.03s call     tests/test_tokenization_bert.py::BertTokenizationTest::test_batch_encode_plus_batch_sequence_length
0.03s call     tests/test_tokenization_gpt2.py::GPT2TokenizationTest::test_internal_consistency
0.03s call     tests/test_tokenization_xlm_roberta.py::XLMRobertaTokenizationTest::test_batch_encode_plus_batch_sequence_length
0.03s call     tests/test_tokenization_t5.py::T5TokenizationTest::test_encode_decode_with_spaces
0.02s call     tests/test_tokenization_marian.py::MarianTokenizationTest::test_added_tokens_do_lower_case
0.02s setup    tests/test_modeling_tf_albert.py::TFAlbertModelTest::test_keyword_and_dict_args
0.02s call     tests/test_modeling_transfo_xl.py::TransfoXLModelTest::test_model_common_attributes
0.02s call     tests/test_tokenization_marian.py::MarianTokenizationTest::test_tokenizers_common_properties
0.02s call     tests/test_tokenization_marian.py::MarianTokenizationTest::test_encode_decode_with_spaces
0.02s call     tests/test_tokenization_gpt2.py::GPT2TokenizationTest::test_encode_plus_with_padding
0.02s call     tests/test_tokenization_xlnet.py::XLNetTokenizationTest::test_get_vocab
0.02s call     tests/test_tokenization_marian.py::MarianTokenizationTest::test_right_and_left_padding
0.02s call     tests/test_tokenization_xlnet.py::XLNetTokenizationTest::test_conversion_reversible
0.02s call     tests/test_modeling_tf_mobilebert.py::TFMobileBertModelTest::test_config
0.02s call     tests/test_modeling_flaubert.py::FlaubertModelTest::test_config
0.02s teardown tests/test_modeling_tf_xlm.py::TFXLMModelTest::test_inputs_embeds
0.02s call     tests/test_tokenization_xlm.py::XLMTokenizationTest::test_batch_encode_plus_batch_sequence_length
0.02s call     tests/test_tokenization_marian.py::MarianTokenizationTest::test_get_vocab
0.02s call     tests/test_tokenization_gpt2.py::GPT2TokenizationTest::test_pickle_tokenizer
0.02s call     tests/test_tokenization_xlnet.py::XLNetTokenizationTest::test_pickle_tokenizer
0.02s call     tests/test_tokenization_roberta.py::RobertaTokenizationTest::test_save_and_load_tokenizer
0.02s call     tests/test_modeling_reformer.py::ReformerLSHAttnModelTest::test_model_common_attributes
0.02s call     tests/test_modeling_gpt2.py::GPT2ModelTest::test_config
0.02s call     tests/test_tokenization_marian.py::MarianTokenizationTest::test_batch_encode_plus_batch_sequence_length
0.02s call     tests/test_tokenization_marian.py::MarianTokenizationTest::test_padding_to_multiple_of
0.02s call     tests/test_tokenization_xlm_roberta.py::XLMRobertaTokenizationTest::test_separate_tokenizers
0.02s call     tests/test_tokenization_distilbert.py::BertTokenizationTest::test_save_and_load_tokenizer
0.02s call     tests/test_modeling_common.py::UtilsFunctionsTest::test_top_k_top_p_filtering
0.02s call     tests/test_tokenization_distilbert.py::BertTokenizationTest::test_padding_to_multiple_of
0.02s call     tests/test_modeling_bart.py::BARTModelTest::test_initialization_more
0.02s call     tests/test_modeling_auto.py::AutoModelTest::test_parents_and_children_in_mappings
0.02s call     tests/test_tokenization_marian.py::MarianTokenizationTest::test_outputs_can_be_shorter
0.02s call     tests/test_tokenization_transfo_xl.py::TransfoXLTokenizationTest::test_padding_to_max_length
0.02s call     tests/test_tokenization_xlm_roberta.py::XLMRobertaTokenizationTest::test_special_tokens_mask
0.02s call     tests/test_tokenization_gpt2.py::GPT2TokenizationTest::test_add_special_tokens
0.02s call     tests/test_tokenization_marian.py::MarianTokenizationTest::test_pretrained_model_lists
0.02s call     tests/test_tokenization_distilbert.py::DistilBertTokenizationTest::test_save_and_load_tokenizer
0.02s call     tests/test_modeling_ctrl.py::CTRLModelTest::test_config
0.02s call     tests/test_tokenization_marian.py::MarianTokenizationTest::test_add_special_tokens
0.02s call     tests/test_tokenization_xlnet.py::XLNetTokenizationTest::test_batch_encode_plus_tensors
0.02s call     tests/test_tokenization_bert.py::BertTokenizationTest::test_save_and_load_tokenizer
0.02s call     tests/test_tokenization_transfo_xl.py::TransfoXLTokenizationTest::test_call
0.02s call     tests/test_tokenization_transfo_xl.py::TransfoXLTokenizationTest::test_pickle_tokenizer
0.02s call     tests/test_tokenization_marian.py::MarianTokenizationTest::test_add_tokens_tokenizer
0.02s call     tests/test_tokenization_t5.py::T5TokenizationTest::test_special_tokens_mask_input_pairs
0.02s call     tests/test_tokenization_xlnet.py::XLNetTokenizationTest::test_number_of_added_tokens
0.02s call     tests/test_tokenization_xlnet.py::XLNetTokenizationTest::test_added_tokens_do_lower_case
0.02s call     tests/test_tokenization_xlm_roberta.py::XLMRobertaTokenizationTest::test_swap_special_token
0.02s call     tests/test_tokenization_t5.py::T5TokenizationTest::test_full_tokenizer
0.02s call     tests/test_tokenization_xlm.py::XLMTokenizationTest::test_call
0.02s call     tests/test_tokenization_xlnet.py::XLNetTokenizationTest::test_separate_tokenizers
0.02s call     tests/test_tokenization_t5.py::T5TokenizationTest::test_swap_special_token
0.02s call     tests/test_tokenization_xlnet.py::XLNetTokenizationTest::test_call
0.02s call     tests/test_tokenization_xlm_roberta.py::XLMRobertaTokenizationTest::test_pickle_tokenizer
0.02s call     tests/test_tokenization_roberta.py::RobertaTokenizationTest::test_batch_encode_plus_batch_sequence_length
0.01s call     tests/test_tokenization_xlnet.py::XLNetTokenizationTest::test_padding_to_max_length
0.01s call     tests/test_tokenization_xlm_roberta.py::XLMRobertaTokenizationTest::test_right_and_left_padding
0.01s teardown tests/test_modeling_tf_openai_gpt.py::TFOpenAIGPTModelTest::test_loss_computation
0.01s teardown tests/test_modeling_flaubert.py::FlaubertModelTest::test_torchscript
0.01s call     tests/test_tokenization_xlnet.py::XLNetTokenizationTest::test_padding_to_multiple_of
0.01s call     tests/test_hf_argparser.py::HfArgumentParserTest::test_with_optional
0.01s call     tests/test_tokenization_xlm_roberta.py::XLMRobertaTokenizationTest::test_add_tokens_tokenizer
0.01s call     tests/test_tokenization_t5.py::T5TokenizationTest::test_pickle_tokenizer
0.01s call     tests/test_tokenization_ctrl.py::CTRLTokenizationTest::test_maximum_encoding_length_single_input
0.01s call     tests/test_tokenization_t5.py::T5TokenizationTest::test_padding_to_multiple_of
0.01s call     tests/test_tokenization_t5.py::T5TokenizationTest::test_tokenizers_common_properties
0.01s call     tests/test_tokenization_xlm_roberta.py::XLMRobertaTokenizationTest::test_encode_decode_with_spaces
0.01s call     tests/test_tokenization_xlm.py::XLMTokenizationTest::test_added_tokens_do_lower_case
0.01s teardown tests/test_modeling_marian.py::TestMarian_en_ROMANCE::test_pipeline
0.01s call     tests/test_modeling_electra.py::ElectraModelTest::test_config
0.01s call     tests/test_tokenization_t5.py::T5TokenizationTest::test_padding_to_max_length
0.01s call     tests/test_modeling_longformer.py::LongformerModelTest::test_config
0.01s call     tests/test_tokenization_xlm_roberta.py::XLMRobertaTokenizationTest::test_encode_plus_with_padding
0.01s call     tests/test_tokenization_t5.py::T5TokenizationTest::test_number_of_added_tokens
0.01s call     tests/test_tokenization_bert.py::BertTokenizationTest::test_batch_encode_plus_padding
0.01s call     tests/test_modeling_tf_electra.py::TFElectraModelTest::test_config
0.01s call     tests/test_tokenization_transfo_xl.py::TransfoXLTokenizationTest::test_number_of_added_tokens
0.01s setup    tests/test_modeling_tf_albert.py::TFAlbertModelTest::test_pt_tf_model_equivalence
0.01s teardown tests/test_tokenization_transfo_xl.py::TransfoXLTokenizationTest::test_torch_encode_plus_sent_to_model
0.01s call     tests/test_modeling_tf_bert.py::TFBertModelTest::test_lm_head_model_random_beam_search_generate
0.01s call     tests/test_tokenization_ctrl.py::CTRLTokenizationTest::test_call
0.01s call     tests/test_modeling_tf_electra.py::TFElectraModelTest::test_lm_head_model_random_no_beam_search_generate
0.01s call     tests/test_tokenization_xlm_roberta.py::XLMRobertaTokenizationTest::test_special_tokens_mask_input_pairs
0.01s call     tests/test_modeling_tf_albert.py::TFAlbertModelTest::test_lm_head_model_random_beam_search_generate
0.01s call     tests/test_tokenization_roberta.py::RobertaTokenizationTest::test_call
0.01s call     tests/test_tokenization_roberta.py::RobertaTokenizationTest::test_batch_encode_plus_padding
0.01s call     tests/test_tokenization_xlm.py::XLMTokenizationTest::test_batch_encode_plus_tensors
0.01s call     tests/test_tokenization_t5.py::T5TokenizationTest::test_pretrained_model_lists
0.01s call     tests/test_modeling_tf_gpt2.py::TFGPT2ModelTest::test_config
0.01s call     tests/test_tokenization_xlm_roberta.py::XLMRobertaTokenizationTest::test_full_tokenizer
0.01s call     tests/test_modeling_mobilebert.py::MobileBertModelTest::test_config
0.01s call     tests/test_tokenization_transfo_xl.py::TransfoXLTokenizationTest::test_right_and_left_padding
0.01s call     tests/test_tokenization_transfo_xl.py::TransfoXLTokenizationTest::test_tokenizers_common_properties
0.01s call     tests/test_modeling_tf_distilbert.py::TFDistilBertModelTest::test_lm_head_model_random_no_beam_search_generate
0.01s call     tests/test_tokenization_transfo_xl.py::TransfoXLTokenizationTest::test_internal_consistency
0.01s call     tests/test_tokenization_distilbert.py::DistilBertTokenizationTest::test_tokenizers_common_properties
0.01s call     tests/test_modeling_tf_distilbert.py::TFDistilBertModelTest::test_lm_head_model_random_beam_search_generate
0.01s call     tests/test_tokenization_xlnet.py::XLNetTokenizationTest::test_right_and_left_padding
0.01s call     tests/test_modeling_tf_mobilebert.py::TFMobileBertModelTest::test_lm_head_model_random_no_beam_search_generate
0.01s call     tests/test_tokenization_xlnet.py::XLNetTokenizationTest::test_add_tokens_tokenizer
0.01s call     tests/test_modeling_tf_mobilebert.py::TFMobileBertModelTest::test_lm_head_model_random_beam_search_generate
0.01s call     tests/test_tokenization_ctrl.py::CTRLTokenizationTest::test_pretokenized_inputs
0.01s call     tests/test_modeling_t5.py::T5ModelTest::test_config
0.01s setup    tests/test_modeling_tf_roberta.py::TFRobertaModelTest::test_for_multiple_choice
0.01s teardown tests/test_modeling_auto.py::AutoModelTest::test_lmhead_model_from_pretrained
0.01s call     tests/test_tokenization_xlm.py::XLMTokenizationTest::test_save_and_load_tokenizer
0.01s call     tests/test_tokenization_roberta.py::RobertaTokenizationTest::test_get_vocab
0.01s call     tests/test_tokenization_transfo_xl.py::TransfoXLTokenizationTest::test_separate_tokenizers
0.01s call     tests/test_tokenization_transfo_xl.py::TransfoXLTokenizationTest::test_padding_to_multiple_of
0.01s call     tests/test_tokenization_xlnet.py::XLNetTokenizationTest::test_encode_decode_with_spaces
0.01s call     tests/test_modeling_transfo_xl.py::TransfoXLModelTest::test_config
0.01s call     tests/test_tokenization_roberta.py::RobertaTokenizationTest::test_add_special_tokens
0.01s call     tests/test_tokenization_ctrl.py::CTRLTokenizationTest::test_batch_encode_plus_padding
0.01s call     tests/test_tokenization_xlm_roberta.py::XLMRobertaTokenizationTest::test_mask_output
0.01s call     tests/test_tokenization_t5.py::T5TokenizationTest::test_mask_output
0.01s teardown tests/test_tokenization_gpt2.py::GPT2TokenizationTest::test_torch_encode_plus_sent_to_model
0.01s call     tests/test_tokenization_transfo_xl.py::TransfoXLTokenizationTest::test_mask_output
0.01s call     tests/test_tokenization_xlnet.py::XLNetTokenizationTest::test_special_tokens_mask_input_pairs
0.01s teardown tests/test_modeling_tf_roberta.py::TFRobertaModelTest::test_for_multiple_choice
0.01s setup    tests/test_tokenization_albert.py::AlbertTokenizationTest::test_encode_plus_with_padding
0.01s setup    tests/test_tokenization_marian.py::MarianTokenizationTest::test_tokenizer_equivalence_en_de
0.01s call     tests/test_tokenization_xlnet.py::XLNetTokenizationTest::test_special_tokens_mask
0.01s call     tests/test_modeling_tf_transfo_xl.py::TFTransfoXLModelTest::test_config
0.01s teardown tests/test_modeling_tf_bert.py::TFBertModelTest::test_inputs_embeds
0.01s call     tests/test_tokenization_xlnet.py::XLNetTokenizationTest::test_encode_plus_with_padding
0.01s call     tests/test_tokenization_xlm.py::XLMTokenizationTest::test_padding_to_max_length
0.01s call     tests/test_modeling_tf_roberta.py::TFRobertaModelTest::test_lm_head_model_random_beam_search_generate
0.01s teardown tests/test_tokenization_fast.py::CommonFastTokenizerTest::test_all_tokenizers
0.01s call     tests/test_tokenization_ctrl.py::CTRLTokenizationTest::test_encode_plus_with_padding
0.01s call     tests/test_tokenization_xlnet.py::XLNetTokenizationTest::test_mask_output
0.01s call     tests/test_tokenization_transfo_xl.py::TransfoXLTokenizationTest::test_move_added_token
0.01s call     tests/test_tokenization_xlm.py::XLMTokenizationTest::test_torch_encode_plus_sent_to_model
0.01s call     tests/test_tokenization_transfo_xl.py::TransfoXLTokenizationTest::test_encode_plus_with_padding
0.01s call     tests/test_tokenization_xlm_roberta.py::XLMRobertaTokenizationTest::test_padding_to_multiple_of
0.01s call     tests/test_tokenization_xlm_roberta.py::XLMRobertaTokenizationTest::test_padding_to_max_length
0.01s call     tests/test_tokenization_xlnet.py::XLNetTokenizationTest::test_swap_special_token
0.01s call     tests/test_tokenization_distilbert.py::BertTokenizationTest::test_rust_and_python_full_tokenizers
0.01s call     tests/test_tokenization_xlm_roberta.py::XLMRobertaTokenizationTest::test_number_of_added_tokens
0.01s call     tests/test_tokenization_transfo_xl.py::TransfoXLTokenizationTest::test_add_tokens_tokenizer
0.01s call     tests/test_tokenization_xlm.py::XLMTokenizationTest::test_pickle_tokenizer
0.01s call     tests/test_tokenization_ctrl.py::CTRLTokenizationTest::test_internal_consistency
0.01s setup    tests/test_benchmark.py::BenchmarkTest::test_train_with_configs
0.01s call     tests/test_tokenization_ctrl.py::CTRLTokenizationTest::test_get_vocab
0.01s call     tests/test_tokenization_ctrl.py::CTRLTokenizationTest::test_mask_output
0.01s call     tests/test_tokenization_ctrl.py::CTRLTokenizationTest::test_full_tokenizer
0.01s call     tests/test_tokenization_xlnet.py::XLNetTokenizationTest::test_full_tokenizer
0.01s call     tests/test_tokenization_transfo_xl.py::TransfoXLTokenizationTest::test_special_tokens_mask
0.01s call     tests/test_modeling_bart.py::MBartIntegrationTests::test_enro_tokenizer_decode_ignores_language_codes
0.01s call     tests/test_tokenization_xlnet.py::XLNetTokenizationTest::test_tokenizer_lower
0.01s setup    tests/test_modeling_tf_transfo_xl.py::TFTransfoXLModelTest::test_lm_head_model_random_beam_search_generate
0.01s call     tests/test_tokenization_bert.py::BertTokenizationTest::test_rust_and_python_full_tokenizers
0.01s call     tests/test_tokenization_distilbert.py::DistilBertTokenizationTest::test_rust_and_python_full_tokenizers
0.01s setup    tests/test_tokenization_marian.py::MarianTokenizationTest::test_padding_to_max_length
0.01s call     tests/test_tokenization_roberta.py::RobertaTokenizationTest::test_add_tokens_tokenizer
0.01s call     tests/test_modeling_tf_bert.py::TFBertModelTest::test_model_from_pretrained
0.01s setup    tests/test_tokenization_t5.py::T5TokenizationTest::test_encode_plus_with_padding
0.01s call     tests/test_tokenization_transfo_xl.py::TransfoXLTokenizationTest::test_special_tokens_mask_input_pairs
0.01s setup    tests/test_benchmark_tf.py::TFBenchmarkTest::test_trace_memory
0.01s setup    tests/test_modeling_tf_bert.py::TFBertModelTest::test_for_masked_lm
0.01s setup    tests/test_tokenization_t5.py::T5TokenizationTest::test_separate_tokenizers
0.01s call     tests/test_tokenization_bert.py::BertTokenizationTest::test_add_special_tokens
0.01s setup    tests/test_modeling_albert.py::AlbertModelTest::test_determinism
0.01s teardown tests/test_tokenization_t5.py::T5TokenizationTest::test_full_tokenizer
0.01s call     tests/test_tokenization_transfo_xl.py::TransfoXLTokenizationTest::test_conversion_reversible
0.01s call     tests/test_tokenization_gpt2.py::GPT2TokenizationTest::test_swap_special_token
0.01s call     tests/test_tokenization_distilbert.py::DistilBertTokenizationTest::test_padding_to_multiple_of
0.01s teardown tests/test_modeling_bart.py::BARTModelTest::test_model_common_attributes
0.01s call     tests/test_tokenization_distilbert.py::DistilBertTokenizationTest::test_add_special_tokens
0.01s call     tests/test_tokenization_roberta.py::RobertaTokenizationTest::test_batch_encode_plus_tensors
0.01s call     tests/test_tokenization_ctrl.py::CTRLTokenizationTest::test_add_tokens_tokenizer
0.01s call     tests/test_tokenization_gpt2.py::GPT2TokenizationTest::test_add_tokens_tokenizer
0.01s setup    tests/test_tokenization_transfo_xl.py::TransfoXLTokenizationTest::test_full_tokenizer_lower
0.01s call     tests/test_tokenization_distilbert.py::BertTokenizationTest::test_pickle_tokenizer
0.01s setup    tests/test_tokenization_transfo_xl.py::TransfoXLTokenizationTest::test_internal_consistency
0.01s call     tests/test_modeling_transfo_xl.py::TransfoXLModelTest::test_torchscript_output_attentions
0.01s call     tests/test_tokenization_roberta.py::RobertaTokenizationTest::test_added_tokens_do_lower_case
0.01s teardown tests/test_configuration_auto.py::AutoConfigTest::test_pattern_matching_fallback
0.01s call     tests/test_tokenization_gpt2.py::GPT2TokenizationTest::test_get_vocab
0.01s call     tests/test_tokenization_distilbert.py::BertTokenizationTest::test_add_special_tokens
0.01s call     tests/test_tokenization_distilbert.py::BertTokenizationTest::test_add_tokens_tokenizer
0.01s call     tests/test_tokenization_roberta.py::RobertaTokenizationTest::test_special_tokens_mask_input_pairs
0.01s call     tests/test_tokenization_gpt2.py::GPT2TokenizationTest::test_right_and_left_padding
0.01s call     tests/test_tokenization_ctrl.py::CTRLTokenizationTest::test_batch_encode_plus_batch_sequence_length
0.01s call     tests/test_tokenization_xlm.py::XLMTokenizationTest::test_right_and_left_padding
0.01s call     tests/test_tokenization_ctrl.py::CTRLTokenizationTest::test_save_and_load_tokenizer
0.01s setup    tests/test_tokenization_ctrl.py::CTRLTokenizationTest::test_add_special_tokens
0.01s call     tests/test_tokenization_bert.py::BertTokenizationTest::test_padding_to_max_length
0.01s setup    tests/test_tokenization_xlm_roberta.py::XLMRobertaTokenizationTest::test_added_tokens_do_lower_case
0.01s setup    tests/test_tokenization_xlm_roberta.py::XLMRobertaTokenizationTest::test_conversion_reversible
0.01s call     tests/test_tokenization_xlm.py::XLMTokenizationTest::test_number_of_added_tokens
0.01s setup    tests/test_tokenization_xlnet.py::XLNetTokenizationTest::test_pickle_tokenizer
0.01s call     tests/test_tokenization_bert.py::BertTokenizationTest::test_swap_special_token
0.01s call     tests/test_tokenization_transfo_xl.py::TransfoXLTokenizationTest::test_encode_decode_with_spaces
0.01s call     tests/test_tokenization_distilbert.py::DistilBertTokenizationTest::test_swap_special_token
0.01s teardown tests/test_tokenization_xlm_roberta.py::XLMRobertaTokenizationTest::test_swap_special_token
0.01s setup    tests/test_tokenization_bert_japanese.py::BertJapaneseCharacterTokenizationTest::test_tokenizers_common_properties
0.01s call     tests/test_tokenization_distilbert.py::BertTokenizationTest::test_right_and_left_padding
0.01s call     tests/test_modeling_reformer.py::ReformerIntegrationTests::test_lsh_layer_forward_complex
0.01s call     tests/test_modeling_ctrl.py::CTRLModelTest::test_torchscript_output_hidden_state
0.01s call     tests/test_tokenization_transfo_xl.py::TransfoXLTokenizationTest::test_get_vocab
0.01s call     tests/test_modeling_tf_electra.py::TFElectraModelTest::test_lm_head_model_random_beam_search_generate
0.01s call     tests/test_modeling_tf_electra.py::TFElectraModelTest::test_keras_save_load
0.01s call     tests/test_tokenization_bert.py::BertTokenizationTest::test_encode_plus_with_padding
0.01s call     tests/test_tokenization_bert.py::BertTokenizationTest::test_add_tokens_tokenizer
0.01s call     tests/test_modeling_reformer.py::ReformerLocalAttnModelTest::test_config
0.01s call     tests/test_modeling_bart.py::BARTModelTest::test_config
0.01s call     tests/test_modeling_tf_bert.py::TFBertModelTest::test_lm_head_model_random_no_beam_search_generate
0.01s call     tests/test_modeling_tf_roberta.py::TFRobertaModelTest::test_lm_head_model_random_no_beam_search_generate

(0.00 durations hidden.  Use -vv to show these durations.)
=========================== short test summary info ============================
FAILED tests/test_tokenization_fast.py::NoPaddingTokenFastTokenizerMatchingTest::test_all_tokenizers
=== 1 failed, 1348 passed, 270 skipped, 13206 warnings in 539.86s (0:08:59) ====
