test/analysis/test_error_analysis.py::ErrorAnalysisTest::test_get_label_buckets
test/analysis/test_error_analysis.py::ErrorAnalysisTest::test_get_label_buckets_bad_shape
test/analysis/test_error_analysis.py::ErrorAnalysisTest::test_get_label_buckets_multi
test/analysis/test_metrics.py::MetricsTest::test_accuracy_basic
test/analysis/test_metrics.py::MetricsTest::test_bad_inputs
test/analysis/test_metrics.py::MetricsTest::test_coverage
test/analysis/test_metrics.py::MetricsTest::test_f1
test/analysis/test_metrics.py::MetricsTest::test_f1_multiclass
test/analysis/test_metrics.py::MetricsTest::test_fbeta
test/analysis/test_metrics.py::MetricsTest::test_ignores
test/analysis/test_metrics.py::MetricsTest::test_matthews
test/analysis/test_metrics.py::MetricsTest::test_missing_preds
test/analysis/test_metrics.py::MetricsTest::test_precision
test/analysis/test_metrics.py::MetricsTest::test_recall
test/analysis/test_metrics.py::MetricsTest::test_roc_auc
test/analysis/test_scorer.py::ScorerTest::test_abstain_labels
test/analysis/test_scorer.py::ScorerTest::test_dict_metric
test/analysis/test_scorer.py::ScorerTest::test_invalid_metric
test/analysis/test_scorer.py::ScorerTest::test_no_labels
test/analysis/test_scorer.py::ScorerTest::test_no_metrics
test/analysis/test_scorer.py::ScorerTest::test_no_probs
test/analysis/test_scorer.py::ScorerTest::test_score_slices
test/analysis/test_scorer.py::ScorerTest::test_scorer
test/augmentation/apply/test_tf_applier.py::TestTFApplier::test_tf_applier
test/augmentation/apply/test_tf_applier.py::TestTFApplier::test_tf_applier_generator
test/augmentation/apply/test_tf_applier.py::TestTFApplier::test_tf_applier_keep_original
test/augmentation/apply/test_tf_applier.py::TestTFApplier::test_tf_applier_keep_original_generator
test/augmentation/apply/test_tf_applier.py::TestTFApplier::test_tf_applier_keep_original_modify_in_place
test/augmentation/apply/test_tf_applier.py::TestTFApplier::test_tf_applier_keep_original_modify_in_place_generator
test/augmentation/apply/test_tf_applier.py::TestTFApplier::test_tf_applier_returns_none
test/augmentation/apply/test_tf_applier.py::TestTFApplier::test_tf_applier_returns_none_generator
test/augmentation/apply/test_tf_applier.py::TestPandasTFApplier::test_tf_applier_pandas
test/augmentation/apply/test_tf_applier.py::TestPandasTFApplier::test_tf_applier_pandas_generator
test/augmentation/apply/test_tf_applier.py::TestPandasTFApplier::test_tf_applier_pandas_keep_original
test/augmentation/apply/test_tf_applier.py::TestPandasTFApplier::test_tf_applier_pandas_keep_original_generator
test/augmentation/apply/test_tf_applier.py::TestPandasTFApplier::test_tf_applier_pandas_modify_in_place
test/augmentation/apply/test_tf_applier.py::TestPandasTFApplier::test_tf_applier_pandas_modify_in_place_generator
test/augmentation/apply/test_tf_applier.py::TestPandasTFApplier::test_tf_applier_returns_none
test/augmentation/apply/test_tf_applier.py::TestPandasTFApplier::test_tf_applier_returns_none_generator
test/augmentation/policy/test_core.py::TestPolicy::test_apply_all_policy
test/augmentation/policy/test_core.py::TestPolicy::test_apply_each_policy
test/augmentation/policy/test_sampling.py::TestSamplingPolicy::test_mean_field_policy
test/augmentation/policy/test_sampling.py::TestSamplingPolicy::test_random_policy
test/classification/test_classifier_convergence.py::ClassifierConvergenceTest::test_convergence
test/classification/test_data.py::DatasetTest::test_classifier_dataloader
test/classification/test_data.py::DatasetTest::test_classifier_dataset
test/classification/test_loss.py::SoftCrossEntropyTest::test_equal_loss
test/classification/test_loss.py::SoftCrossEntropyTest::test_invalid_reduction
test/classification/test_loss.py::SoftCrossEntropyTest::test_loss_weights
test/classification/test_loss.py::SoftCrossEntropyTest::test_lower_loss
test/classification/test_loss.py::SoftCrossEntropyTest::test_perfect_predictions
test/classification/test_loss.py::SoftCrossEntropyTest::test_sce_equals_ce
test/classification/test_multitask_classifier.py::ClassifierTest::test_bad_tasks
test/classification/test_multitask_classifier.py::ClassifierTest::test_empty_batch
test/classification/test_multitask_classifier.py::ClassifierTest::test_no_data_parallel
test/classification/test_multitask_classifier.py::ClassifierTest::test_no_input_spec
test/classification/test_multitask_classifier.py::ClassifierTest::test_onetask_model
test/classification/test_multitask_classifier.py::ClassifierTest::test_partially_empty_batch
test/classification/test_multitask_classifier.py::ClassifierTest::test_predict
test/classification/test_multitask_classifier.py::ClassifierTest::test_remapped_labels
test/classification/test_multitask_classifier.py::ClassifierTest::test_save_load
test/classification/test_multitask_classifier.py::ClassifierTest::test_score
test/classification/test_multitask_classifier.py::ClassifierTest::test_score_shuffled
test/classification/test_multitask_classifier.py::ClassifierTest::test_twotask_all_overlap_model
test/classification/test_multitask_classifier.py::ClassifierTest::test_twotask_none_overlap_model
test/classification/test_multitask_classifier.py::ClassifierTest::test_twotask_partial_overlap_model
test/classification/test_task.py::TaskTest::test_task_creation
test/classification/test_utils.py::UtilsTest::test_collect_flow_outputs_by_suffix
test/classification/test_utils.py::UtilsTest::test_list_to_tensor
test/classification/test_utils.py::UtilsTest::test_pad_batch
test/classification/training/test_trainer.py::TrainerTest::test_checkpointer_init
test/classification/training/test_trainer.py::TrainerTest::test_log_writer_init
test/classification/training/test_trainer.py::TrainerTest::test_log_writer_json
test/classification/training/test_trainer.py::TrainerTest::test_optimizer_init
test/classification/training/test_trainer.py::TrainerTest::test_scheduler_init
test/classification/training/test_trainer.py::TrainerTest::test_trainer_errors
test/classification/training/test_trainer.py::TrainerTest::test_trainer_onetask
test/classification/training/test_trainer.py::TrainerTest::test_trainer_twotask
test/classification/training/test_trainer.py::TrainerTest::test_warmup
test/classification/training/loggers/test_checkpointer.py::TestLogManager::test_bad_checkpoint_runway
test/classification/training/loggers/test_checkpointer.py::TestLogManager::test_bad_metric_name
test/classification/training/loggers/test_checkpointer.py::TestLogManager::test_checkpointer
test/classification/training/loggers/test_checkpointer.py::TestLogManager::test_checkpointer_clear
test/classification/training/loggers/test_checkpointer.py::TestLogManager::test_checkpointer_load_best
test/classification/training/loggers/test_checkpointer.py::TestLogManager::test_checkpointer_min
test/classification/training/loggers/test_checkpointer.py::TestLogManager::test_no_zero_frequency
test/classification/training/loggers/test_log_manager.py::TestLogManager::test_bad_unit
test/classification/training/loggers/test_log_manager.py::TestLogManager::test_load_on_cleanup
test/classification/training/loggers/test_log_manager.py::TestLogManager::test_log_manager_batch
test/classification/training/loggers/test_log_manager.py::TestLogManager::test_log_manager_epoch
test/classification/training/loggers/test_log_manager.py::TestLogManager::test_log_manager_points
test/classification/training/loggers/test_log_writer.py::TestLogWriter::test_log_writer
test/classification/training/loggers/test_log_writer.py::TestLogWriter::test_write_config
test/classification/training/loggers/test_log_writer.py::TestLogWriter::test_write_text
test/classification/training/loggers/test_tensorboard_writer.py::TestTensorBoardWriter::test_tensorboard_writer
test/classification/training/schedulers/test_schedulers.py::SequentialTest::test_sequential
test/classification/training/schedulers/test_schedulers.py::SequentialTest::test_shuffled
test/labeling/test_analysis.py::TestAnalysis::test_label_conflict
test/labeling/test_analysis.py::TestAnalysis::test_label_coverage
test/labeling/test_analysis.py::TestAnalysis::test_label_overlap
test/labeling/test_analysis.py::TestAnalysis::test_lf_conflicts
test/labeling/test_analysis.py::TestAnalysis::test_lf_coverages
test/labeling/test_analysis.py::TestAnalysis::test_lf_empirical_accuracies
test/labeling/test_analysis.py::TestAnalysis::test_lf_empirical_probs
test/labeling/test_analysis.py::TestAnalysis::test_lf_overlaps
test/labeling/test_analysis.py::TestAnalysis::test_lf_polarities
test/labeling/test_analysis.py::TestAnalysis::test_lf_summary
test/labeling/test_analysis.py::TestAnalysis::test_lf_summary_without_abstain
test/labeling/test_analysis.py::TestAnalysis::test_wrong_number_of_lfs
test/labeling/test_convergence.py::LabelingConvergenceTest::test_labeling_convergence
test/labeling/test_utils.py::TestAnalysis::test_filter_unlabeled_dataframe
test/labeling/apply/test_lf_applier.py::TestLFApplier::test_lf_applier
test/labeling/apply/test_lf_applier.py::TestLFApplier::test_lf_applier_fault
test/labeling/apply/test_lf_applier.py::TestLFApplier::test_lf_applier_no_labels
test/labeling/apply/test_lf_applier.py::TestLFApplier::test_lf_applier_numpy
test/labeling/apply/test_lf_applier.py::TestLFApplier::test_lf_applier_preprocessor
test/labeling/apply/test_lf_applier.py::TestLFApplier::test_lf_applier_preprocessor_memoized
test/labeling/apply/test_lf_applier.py::TestPandasApplier::test_lf_applier_pandas
test/labeling/apply/test_lf_applier.py::TestPandasApplier::test_lf_applier_pandas_fault
test/labeling/apply/test_lf_applier.py::TestPandasApplier::test_lf_applier_pandas_preprocessor
test/labeling/apply/test_lf_applier.py::TestPandasApplier::test_lf_applier_pandas_preprocessor_memoized
test/labeling/apply/test_lf_applier.py::TestPandasApplier::test_lf_applier_pandas_spacy_preprocessor
test/labeling/apply/test_lf_applier.py::TestPandasApplier::test_lf_applier_pandas_spacy_preprocessor_memoized
test/labeling/apply/test_lf_applier.py::TestDaskApplier::test_lf_applier_dask
test/labeling/apply/test_lf_applier.py::TestDaskApplier::test_lf_applier_dask_fault
test/labeling/apply/test_lf_applier.py::TestDaskApplier::test_lf_applier_dask_preprocessor
test/labeling/apply/test_lf_applier.py::TestDaskApplier::test_lf_applier_dask_spacy_preprocessor
test/labeling/apply/test_lf_applier.py::TestDaskApplier::test_lf_applier_pandas_parallel
test/labeling/apply/test_lf_applier.py::TestDaskApplier::test_lf_applier_pandas_parallel_raises
test/labeling/apply/test_lf_applier.py::TestDaskApplier::test_lf_applier_pandas_preprocessor_memoized
test/labeling/apply/test_lf_applier.py::TestDaskApplier::test_lf_applier_pandas_spacy_preprocessor_memoized
test/labeling/apply/test_spark.py::TestSparkApplier::test_lf_applier_spark
test/labeling/apply/test_spark.py::TestSparkApplier::test_lf_applier_spark_fault
test/labeling/apply/test_spark.py::TestSparkApplier::test_lf_applier_spark_preprocessor
test/labeling/apply/test_spark.py::TestSparkApplier::test_lf_applier_spark_preprocessor_memoized
test/labeling/lf/test_core.py::TestLabelingFunction::test_labeling_function
test/labeling/lf/test_core.py::TestLabelingFunction::test_labeling_function_decorator
test/labeling/lf/test_core.py::TestLabelingFunction::test_labeling_function_decorator_args
test/labeling/lf/test_core.py::TestLabelingFunction::test_labeling_function_decorator_no_parens
test/labeling/lf/test_core.py::TestLabelingFunction::test_labeling_function_preprocessor
test/labeling/lf/test_core.py::TestLabelingFunction::test_labeling_function_resources
test/labeling/lf/test_core.py::TestLabelingFunction::test_labeling_function_returns_none
test/labeling/lf/test_core.py::TestLabelingFunction::test_labeling_function_serialize
test/labeling/lf/test_nlp.py::TestNLPLabelingFunction::test_labeling_function_serialize
test/labeling/lf/test_nlp.py::TestNLPLabelingFunction::test_nlp_labeling_function
test/labeling/lf/test_nlp.py::TestNLPLabelingFunction::test_nlp_labeling_function_decorator
test/labeling/lf/test_nlp.py::TestNLPLabelingFunction::test_nlp_labeling_function_decorator_no_parens
test/labeling/lf/test_nlp.py::TestNLPLabelingFunction::test_nlp_labeling_function_memoized
test/labeling/lf/test_nlp.py::TestNLPLabelingFunction::test_nlp_labeling_function_raises
test/labeling/lf/test_nlp.py::TestNLPLabelingFunction::test_nlp_labeling_function_shared_cache
test/labeling/lf/test_nlp_spark.py::TestNLPLabelingFunction::test_nlp_labeling_function
test/labeling/lf/test_nlp_spark.py::TestNLPLabelingFunction::test_nlp_labeling_function_decorator
test/labeling/lf/test_nlp_spark.py::TestNLPLabelingFunction::test_spark_nlp_labeling_function_with_nlp_labeling_function
test/labeling/model/test_baseline.py::BaselineModelTest::test_majority_class_vote
test/labeling/model/test_baseline.py::BaselineModelTest::test_majority_label_vote
test/labeling/model/test_baseline.py::BaselineModelTest::test_random_vote
test/labeling/model/test_label_model.py::LabelModelTest::test_L_form
test/labeling/model/test_label_model.py::LabelModelTest::test_augmented_L_construction
test/labeling/model/test_label_model.py::LabelModelTest::test_build_mask
test/labeling/model/test_label_model.py::LabelModelTest::test_class_balance
test/labeling/model/test_label_model.py::LabelModelTest::test_conditional_probs
test/labeling/model/test_label_model.py::LabelModelTest::test_generate_O
test/labeling/model/test_label_model.py::LabelModelTest::test_get_weight
test/labeling/model/test_label_model.py::LabelModelTest::test_init_params
test/labeling/model/test_label_model.py::LabelModelTest::test_loss
test/labeling/model/test_label_model.py::LabelModelTest::test_lr_scheduler
test/labeling/model/test_label_model.py::LabelModelTest::test_model_loss
test/labeling/model/test_label_model.py::LabelModelTest::test_mv_default
test/labeling/model/test_label_model.py::LabelModelTest::test_optimizer
test/labeling/model/test_label_model.py::LabelModelTest::test_optimizer_init
test/labeling/model/test_label_model.py::LabelModelTest::test_predict
test/labeling/model/test_label_model.py::LabelModelTest::test_predict_proba
test/labeling/model/test_label_model.py::LabelModelTest::test_save_and_load
test/labeling/model/test_label_model.py::LabelModelTest::test_scheduler_init
test/labeling/model/test_label_model.py::LabelModelTest::test_score
test/labeling/model/test_label_model.py::LabelModelTest::test_set_mu_eps
test/labeling/model/test_label_model.py::LabelModelTest::test_symmetry_breaking
test/labeling/model/test_label_model.py::LabelModelTest::test_symmetry_breaking_multiclass
test/labeling/model/test_label_model.py::LabelModelTest::test_warmup
test/labeling/model/test_label_model.py::TestLabelModelAdvanced::test_label_model_basic
test/labeling/model/test_label_model.py::TestLabelModelAdvanced::test_label_model_sparse
test/labeling/model/test_logger.py::LoggerTest::test_bad_metrics_dict
test/labeling/model/test_logger.py::LoggerTest::test_basic
test/labeling/model/test_logger.py::LoggerTest::test_valid_metrics_dict
test/labeling/preprocess/test_nlp.py::TestSpacyPreprocessor::test_spacy_preprocessor
test/map/test_core.py::TestMapperCore::test_decorator_mapper_memoized
test/map/test_core.py::TestMapperCore::test_decorator_mapper_memoized_none
test/map/test_core.py::TestMapperCore::test_decorator_mapper_not_memoized
test/map/test_core.py::TestMapperCore::test_mapper_decorator_no_parens
test/map/test_core.py::TestMapperCore::test_mapper_default_args
test/map/test_core.py::TestMapperCore::test_mapper_in_place
test/map/test_core.py::TestMapperCore::test_mapper_pre
test/map/test_core.py::TestMapperCore::test_mapper_pre_decorator
test/map/test_core.py::TestMapperCore::test_mapper_pre_memoized
test/map/test_core.py::TestMapperCore::test_mapper_returns_none
test/map/test_core.py::TestMapperCore::test_mapper_same_field
test/map/test_core.py::TestMapperCore::test_mapper_with_args_kwargs
test/map/test_core.py::TestMapperCore::test_numeric_mapper
test/map/test_core.py::TestMapperCore::test_text_mapper
test/map/test_core.py::TestGetHashable::test_get_hashable_dict
test/map/test_core.py::TestGetHashable::test_get_hashable_hashable
test/map/test_core.py::TestGetHashable::test_get_hashable_list
test/map/test_core.py::TestGetHashable::test_get_hashable_ndarray
test/map/test_core.py::TestGetHashable::test_get_hashable_series
test/map/test_core.py::TestGetHashable::test_get_hashable_series_with_doc
test/map/test_core.py::TestGetHashable::test_get_hashable_unhashable
test/map/test_spark.py::TestMapperCore::test_decorator_mapper_memoized
test/map/test_spark.py::TestMapperCore::test_decorator_mapper_memoized_none
test/map/test_spark.py::TestMapperCore::test_decorator_mapper_not_memoized
test/map/test_spark.py::TestMapperCore::test_mapper_default_args
test/map/test_spark.py::TestMapperCore::test_mapper_in_place
test/map/test_spark.py::TestMapperCore::test_mapper_returns_none
test/map/test_spark.py::TestMapperCore::test_mapper_same_field
test/map/test_spark.py::TestMapperCore::test_numeric_mapper
test/map/test_spark.py::TestMapperCore::test_text_mapper
test/slicing/test_convergence.py::SlicingConvergenceTest::test_convergence
test/slicing/test_convergence.py::SlicingConvergenceTest::test_performance
test/slicing/test_monitor.py::PandasSlicerTest::test_slice
test/slicing/test_slice_combiner.py::SliceCombinerTest::test_average_reweighting
test/slicing/test_slice_combiner.py::SliceCombinerTest::test_average_reweighting_by_ind
test/slicing/test_slice_combiner.py::SliceCombinerTest::test_average_reweighting_by_pred_confidence
test/slicing/test_slice_combiner.py::SliceCombinerTest::test_combiner_multiclass
test/slicing/test_slice_combiner.py::SliceCombinerTest::test_forward_shape
test/slicing/test_slice_combiner.py::SliceCombinerTest::test_many_slices
test/slicing/test_slice_combiner.py::SliceCombinerTest::test_temperature
test/slicing/test_sliceaware_classifier.py::SliceCombinerTest::test_make_slice_dataloader
test/slicing/test_sliceaware_classifier.py::SliceCombinerTest::test_scores_pipeline
test/slicing/test_sliceaware_classifier.py::SliceCombinerTest::test_slice_tasks
test/slicing/test_utils.py::UtilsTest::test_add_slice_labels
test/slicing/test_utils.py::UtilsTest::test_convert_to_slice_tasks
test/slicing/apply/test_sf_applier.py::TestSFApplier::test_sf_applier
test/slicing/apply/test_sf_applier.py::TestSFApplier::test_sf_applier_preprocessor
test/slicing/sf/test_core.py::TestSlicingFunction::test_slicing_function_decorator
test/slicing/sf/test_core.py::TestSlicingFunction::test_slicing_function_decorator_no_parens
test/slicing/sf/test_nlp.py::TestNLPSlicingFunction::test_nlp_slicing_function
test/slicing/sf/test_nlp.py::TestNLPSlicingFunction::test_nlp_slicing_function_decorator
test/synthetic/test_synthetic_data.py::TestGenerateSimpleLabelMatrix::test_generate_L
test/synthetic/test_synthetic_data.py::TestGenerateSimpleLabelMatrix::test_generate_L_multiclass
test/utils/test_config_utils.py::UtilsTest::test_merge_config
test/utils/test_core.py::UtilsTest::test_filter_labels
test/utils/test_core.py::UtilsTest::test_filter_labels_probs
test/utils/test_core.py::UtilsTest::test_preds_to_probs
test/utils/test_core.py::UtilsTest::test_probs_to_preds
test/utils/test_core.py::UtilsTest::test_to_int_label_array
test/utils/test_data_operators.py::DataOperatorsTest::test_check_unique_names

=============================================================================================== warnings summary ================================================================================================
snorkel/map/core.py:3
  /home/saikatd2/projects/borntobeflaky/projects/pytorch-deps/snorkel/snorkel/map/core.py:3: DeprecationWarning: Using or importing the ABCs from 'collections' instead of from 'collections.abc' is deprecated since Python 3.3,and in 3.9 it will stop working
    from collections import Hashable

/home/saikatd2/anaconda3/envs/pv3.6_snorkel/lib/python3.7/site-packages/py4j/java_collections.py:13
/home/saikatd2/anaconda3/envs/pv3.6_snorkel/lib/python3.7/site-packages/py4j/java_collections.py:13
/home/saikatd2/anaconda3/envs/pv3.6_snorkel/lib/python3.7/site-packages/py4j/java_collections.py:13
/home/saikatd2/anaconda3/envs/pv3.6_snorkel/lib/python3.7/site-packages/py4j/java_collections.py:13
/home/saikatd2/anaconda3/envs/pv3.6_snorkel/lib/python3.7/site-packages/py4j/java_collections.py:13
  /home/saikatd2/anaconda3/envs/pv3.6_snorkel/lib/python3.7/site-packages/py4j/java_collections.py:13: DeprecationWarning: Using or importing the ABCs from 'collections' instead of from 'collections.abc' is deprecated since Python 3.3,and in 3.9 it will stop working
    from collections import (

/home/saikatd2/anaconda3/envs/pv3.6_snorkel/lib/python3.7/site-packages/pyspark/resultiterable.py:23
  /home/saikatd2/anaconda3/envs/pv3.6_snorkel/lib/python3.7/site-packages/pyspark/resultiterable.py:23: DeprecationWarning: Using or importing the ABCs from 'collections' instead of from 'collections.abc' is deprecated since Python 3.3,and in 3.9 it will stop working
    class ResultIterable(collections.Iterable):

-- Docs: https://docs.pytest.org/en/latest/warnings.html
7 warnings in 19.70s
