all-MiniLM-L6-v2 trained on MEDI-MTEB triplets
This is a sentence-transformers model finetuned from sentence-transformers/all-MiniLM-L6-v2 on the NQ, pubmed, specter_train_triples, S2ORC_citations_abstracts, fever, gooaq_pairs, codesearchnet, wikihow, WikiAnswers, eli5_question_answer, amazon-qa, medmcqa, zeroshot, TriviaQA_pairs, PAQ_pairs, stackexchange_duplicate_questions_title-body_title-body, trex, flickr30k_captions, hotpotqa, task671_ambigqa_text_generation, task061_ropes_answer_generation, task285_imdb_answer_generation, task905_hate_speech_offensive_classification, task566_circa_classification, task184_snli_entailment_to_neutral_text_modification, task280_stereoset_classification_stereotype_type, task1599_smcalflow_classification, task1384_deal_or_no_dialog_classification, task591_sciq_answer_generation, task823_peixian-rtgender_sentiment_analysis, task023_cosmosqa_question_generation, task900_freebase_qa_category_classification, task924_event2mind_word_generation, task152_tomqa_find_location_easy_noise, task1368_healthfact_sentence_generation, task1661_super_glue_classification, task1187_politifact_classification, task1728_web_nlg_data_to_text, task112_asset_simple_sentence_identification, task1340_msr_text_compression_compression, task072_abductivenli_answer_generation, task1504_hatexplain_answer_generation, task684_online_privacy_policy_text_information_type_generation, task1290_xsum_summarization, task075_squad1.1_answer_generation, task1587_scifact_classification, task384_socialiqa_question_classification, task1555_scitail_answer_generation, task1532_daily_dialog_emotion_classification, task239_tweetqa_answer_generation, task596_mocha_question_generation, task1411_dart_subject_identification, task1359_numer_sense_answer_generation, task329_gap_classification, task220_rocstories_title_classification, task316_crows-pairs_classification_stereotype, task495_semeval_headline_classification, task1168_brown_coarse_pos_tagging, task348_squad2.0_unanswerable_question_generation, task049_multirc_questions_needed_to_answer, task1534_daily_dialog_question_classification, task322_jigsaw_classification_threat, task295_semeval_2020_task4_commonsense_reasoning, task186_snli_contradiction_to_entailment_text_modification, task034_winogrande_question_modification_object, task160_replace_letter_in_a_sentence, task469_mrqa_answer_generation, task105_story_cloze-rocstories_sentence_generation, task649_race_blank_question_generation, task1536_daily_dialog_happiness_classification, task683_online_privacy_policy_text_purpose_answer_generation, task024_cosmosqa_answer_generation, task584_udeps_eng_fine_pos_tagging, task066_timetravel_binary_consistency_classification, task413_mickey_en_sentence_perturbation_generation, task182_duorc_question_generation, task028_drop_answer_generation, task1601_webquestions_answer_generation, task1295_adversarial_qa_question_answering, task201_mnli_neutral_classification, task038_qasc_combined_fact, task293_storycommonsense_emotion_text_generation, task572_recipe_nlg_text_generation, task517_emo_classify_emotion_of_dialogue, task382_hybridqa_answer_generation, task176_break_decompose_questions, task1291_multi_news_summarization, task155_count_nouns_verbs, task031_winogrande_question_generation_object, task279_stereoset_classification_stereotype, task1336_peixian_equity_evaluation_corpus_gender_classifier, task508_scruples_dilemmas_more_ethical_isidentifiable, task518_emo_different_dialogue_emotions, task077_splash_explanation_to_sql, task923_event2mind_classifier, task470_mrqa_question_generation, task638_multi_woz_classification, task1412_web_questions_question_answering, task847_pubmedqa_question_generation, task678_ollie_actual_relationship_answer_generation, task290_tellmewhy_question_answerability, task575_air_dialogue_classification, task189_snli_neutral_to_contradiction_text_modification, task026_drop_question_generation, task162_count_words_starting_with_letter, task079_conala_concat_strings, task610_conllpp_ner, task046_miscellaneous_question_typing, task197_mnli_domain_answer_generation, task1325_qa_zre_question_generation_on_subject_relation, task430_senteval_subject_count, task672_nummersense, task402_grailqa_paraphrase_generation, task904_hate_speech_offensive_classification, task192_hotpotqa_sentence_generation, task069_abductivenli_classification, task574_air_dialogue_sentence_generation, task187_snli_entailment_to_contradiction_text_modification, task749_glucose_reverse_cause_emotion_detection, task1552_scitail_question_generation, task750_aqua_multiple_choice_answering, task327_jigsaw_classification_toxic, task1502_hatexplain_classification, task328_jigsaw_classification_insult, task304_numeric_fused_head_resolution, task1293_kilt_tasks_hotpotqa_question_answering, task216_rocstories_correct_answer_generation, task1326_qa_zre_question_generation_from_answer, task1338_peixian_equity_evaluation_corpus_sentiment_classifier, task1729_personachat_generate_next, task1202_atomic_classification_xneed, task400_paws_paraphrase_classification, task502_scruples_anecdotes_whoiswrong_verification, task088_identify_typo_verification, task221_rocstories_two_choice_classification, task200_mnli_entailment_classification, task074_squad1.1_question_generation, task581_socialiqa_question_generation, task1186_nne_hrngo_classification, task898_freebase_qa_answer_generation, task1408_dart_similarity_classification, task168_strategyqa_question_decomposition, task1357_xlsum_summary_generation, task390_torque_text_span_selection, task165_mcscript_question_answering_commonsense, task1533_daily_dialog_formal_classification, task002_quoref_answer_generation, task1297_qasc_question_answering, task305_jeopardy_answer_generation_normal, task029_winogrande_full_object, task1327_qa_zre_answer_generation_from_question, task326_jigsaw_classification_obscene, task1542_every_ith_element_from_starting, task570_recipe_nlg_ner_generation, task1409_dart_text_generation, task401_numeric_fused_head_reference, task846_pubmedqa_classification, task1712_poki_classification, task344_hybridqa_answer_generation, task875_emotion_classification, task1214_atomic_classification_xwant, task106_scruples_ethical_judgment, task238_iirc_answer_from_passage_answer_generation, task1391_winogrande_easy_answer_generation, task195_sentiment140_classification, task163_count_words_ending_with_letter, task579_socialiqa_classification, task569_recipe_nlg_text_generation, task1602_webquestion_question_genreation, task747_glucose_cause_emotion_detection, task219_rocstories_title_answer_generation, task178_quartz_question_answering, task103_facts2story_long_text_generation, task301_record_question_generation, task1369_healthfact_sentence_generation, task515_senteval_odd_word_out, task496_semeval_answer_generation, task1658_billsum_summarization, task1204_atomic_classification_hinderedby, task1392_superglue_multirc_answer_verification, task306_jeopardy_answer_generation_double, task1286_openbookqa_question_answering, task159_check_frequency_of_words_in_sentence_pair, task151_tomqa_find_location_easy_clean, task323_jigsaw_classification_sexually_explicit, task037_qasc_generate_related_fact, task027_drop_answer_type_generation, task1596_event2mind_text_generation_2, task141_odd-man-out_classification_category, task194_duorc_answer_generation, task679_hope_edi_english_text_classification, task246_dream_question_generation, task1195_disflqa_disfluent_to_fluent_conversion, task065_timetravel_consistent_sentence_classification, task351_winomt_classification_gender_identifiability_anti, task580_socialiqa_answer_generation, task583_udeps_eng_coarse_pos_tagging, task202_mnli_contradiction_classification, task222_rocstories_two_chioce_slotting_classification, task498_scruples_anecdotes_whoiswrong_classification, task067_abductivenli_answer_generation, task616_cola_classification, task286_olid_offense_judgment, task188_snli_neutral_to_entailment_text_modification, task223_quartz_explanation_generation, task820_protoqa_answer_generation, task196_sentiment140_answer_generation, task1678_mathqa_answer_selection, task349_squad2.0_answerable_unanswerable_question_classification, task154_tomqa_find_location_hard_noise, task333_hateeval_classification_hate_en, task235_iirc_question_from_subtext_answer_generation, task1554_scitail_classification, task210_logic2text_structured_text_generation, task035_winogrande_question_modification_person, task230_iirc_passage_classification, task1356_xlsum_title_generation, task1726_mathqa_correct_answer_generation, task302_record_classification, task380_boolq_yes_no_question, task212_logic2text_classification, task748_glucose_reverse_cause_event_detection, task834_mathdataset_classification, task350_winomt_classification_gender_identifiability_pro, task191_hotpotqa_question_generation, task236_iirc_question_from_passage_answer_generation, task217_rocstories_ordering_answer_generation, task568_circa_question_generation, task614_glucose_cause_event_detection, task361_spolin_yesand_prompt_response_classification, task421_persent_sentence_sentiment_classification, task203_mnli_sentence_generation, task420_persent_document_sentiment_classification, task153_tomqa_find_location_hard_clean, task346_hybridqa_classification, task1211_atomic_classification_hassubevent, task360_spolin_yesand_response_generation, task510_reddit_tifu_title_summarization, task511_reddit_tifu_long_text_summarization, task345_hybridqa_answer_generation, task270_csrg_counterfactual_context_generation, task307_jeopardy_answer_generation_final, task001_quoref_question_generation, task089_swap_words_verification, task1196_atomic_classification_oeffect, task080_piqa_answer_generation, task1598_nyc_long_text_generation, task240_tweetqa_question_generation, task615_moviesqa_answer_generation, task1347_glue_sts-b_similarity_classification, task114_is_the_given_word_longest, task292_storycommonsense_character_text_generation, task115_help_advice_classification, task431_senteval_object_count, task1360_numer_sense_multiple_choice_qa_generation, task177_para-nmt_paraphrasing, task132_dais_text_modification, task269_csrg_counterfactual_story_generation, task233_iirc_link_exists_classification, task161_count_words_containing_letter, task1205_atomic_classification_isafter, task571_recipe_nlg_ner_generation, task1292_yelp_review_full_text_categorization, task428_senteval_inversion, task311_race_question_generation, task429_senteval_tense, task403_creak_commonsense_inference, task929_products_reviews_classification, task582_naturalquestion_answer_generation, task237_iirc_answer_from_subtext_answer_generation, task050_multirc_answerability, task184_break_generate_question, task669_ambigqa_answer_generation, task169_strategyqa_sentence_generation, task500_scruples_anecdotes_title_generation, task241_tweetqa_classification, task1345_glue_qqp_question_paraprashing, task218_rocstories_swap_order_answer_generation, task613_politifact_text_generation, task1167_penn_treebank_coarse_pos_tagging, task1422_mathqa_physics, task247_dream_answer_generation, task199_mnli_classification, task164_mcscript_question_answering_text, task1541_agnews_classification, task516_senteval_conjoints_inversion, task294_storycommonsense_motiv_text_generation, task501_scruples_anecdotes_post_type_verification, task213_rocstories_correct_ending_classification, task821_protoqa_question_generation, task493_review_polarity_classification, task308_jeopardy_answer_generation_all, task1595_event2mind_text_generation_1, task040_qasc_question_generation, task231_iirc_link_classification, task1727_wiqa_what_is_the_effect, task578_curiosity_dialogs_answer_generation, task310_race_classification, task309_race_answer_generation, task379_agnews_topic_classification, task030_winogrande_full_person, task1540_parsed_pdfs_summarization, task039_qasc_find_overlapping_words, task1206_atomic_classification_isbefore, task157_count_vowels_and_consonants, task339_record_answer_generation, task453_swag_answer_generation, task848_pubmedqa_classification, task673_google_wellformed_query_classification, task676_ollie_relationship_answer_generation, task268_casehold_legal_answer_generation, task844_financial_phrasebank_classification, task330_gap_answer_generation, task595_mocha_answer_generation, task1285_kpa_keypoint_matching, task234_iirc_passage_line_answer_generation, task494_review_polarity_answer_generation, task670_ambigqa_question_generation, task289_gigaword_summarization, npr, nli, SimpleWiki, amazon_review_2018, ccnews_title_text, agnews, xsum, msmarco, yahoo_answers_title_answer, squad_pairs, wow, mteb-amazon_counterfactual-avs_triplets, mteb-amazon_massive_intent-avs_triplets, mteb-amazon_massive_scenario-avs_triplets, mteb-amazon_reviews_multi-avs_triplets, mteb-banking77-avs_triplets, mteb-emotion-avs_triplets, mteb-imdb-avs_triplets, mteb-mtop_domain-avs_triplets, mteb-mtop_intent-avs_triplets, mteb-toxic_conversations_50k-avs_triplets, mteb-tweet_sentiment_extraction-avs_triplets and covid-bing-query-gpt4-avs_triplets datasets. It maps sentences & paragraphs to a 384-dimensional dense vector space and can be used for semantic textual similarity, semantic search, paraphrase mining, text classification, clustering, and more.
Model Details
Model Description
- Model Type: Sentence Transformer
- Base model: sentence-transformers/all-MiniLM-L6-v2
- Maximum Sequence Length: 256 tokens
- Output Dimensionality: 384 tokens
- Similarity Function: Cosine Similarity
- Training Datasets:
- NQ
- pubmed
- specter_train_triples
- S2ORC_citations_abstracts
- fever
- gooaq_pairs
- codesearchnet
- wikihow
- WikiAnswers
- eli5_question_answer
- amazon-qa
- medmcqa
- zeroshot
- TriviaQA_pairs
- PAQ_pairs
- stackexchange_duplicate_questions_title-body_title-body
- trex
- flickr30k_captions
- hotpotqa
- task671_ambigqa_text_generation
- task061_ropes_answer_generation
- task285_imdb_answer_generation
- task905_hate_speech_offensive_classification
- task566_circa_classification
- task184_snli_entailment_to_neutral_text_modification
- task280_stereoset_classification_stereotype_type
- task1599_smcalflow_classification
- task1384_deal_or_no_dialog_classification
- task591_sciq_answer_generation
- task823_peixian-rtgender_sentiment_analysis
- task023_cosmosqa_question_generation
- task900_freebase_qa_category_classification
- task924_event2mind_word_generation
- task152_tomqa_find_location_easy_noise
- task1368_healthfact_sentence_generation
- task1661_super_glue_classification
- task1187_politifact_classification
- task1728_web_nlg_data_to_text
- task112_asset_simple_sentence_identification
- task1340_msr_text_compression_compression
- task072_abductivenli_answer_generation
- task1504_hatexplain_answer_generation
- task684_online_privacy_policy_text_information_type_generation
- task1290_xsum_summarization
- task075_squad1.1_answer_generation
- task1587_scifact_classification
- task384_socialiqa_question_classification
- task1555_scitail_answer_generation
- task1532_daily_dialog_emotion_classification
- task239_tweetqa_answer_generation
- task596_mocha_question_generation
- task1411_dart_subject_identification
- task1359_numer_sense_answer_generation
- task329_gap_classification
- task220_rocstories_title_classification
- task316_crows-pairs_classification_stereotype
- task495_semeval_headline_classification
- task1168_brown_coarse_pos_tagging
- task348_squad2.0_unanswerable_question_generation
- task049_multirc_questions_needed_to_answer
- task1534_daily_dialog_question_classification
- task322_jigsaw_classification_threat
- task295_semeval_2020_task4_commonsense_reasoning
- task186_snli_contradiction_to_entailment_text_modification
- task034_winogrande_question_modification_object
- task160_replace_letter_in_a_sentence
- task469_mrqa_answer_generation
- task105_story_cloze-rocstories_sentence_generation
- task649_race_blank_question_generation
- task1536_daily_dialog_happiness_classification
- task683_online_privacy_policy_text_purpose_answer_generation
- task024_cosmosqa_answer_generation
- task584_udeps_eng_fine_pos_tagging
- task066_timetravel_binary_consistency_classification
- task413_mickey_en_sentence_perturbation_generation
- task182_duorc_question_generation
- task028_drop_answer_generation
- task1601_webquestions_answer_generation
- task1295_adversarial_qa_question_answering
- task201_mnli_neutral_classification
- task038_qasc_combined_fact
- task293_storycommonsense_emotion_text_generation
- task572_recipe_nlg_text_generation
- task517_emo_classify_emotion_of_dialogue
- task382_hybridqa_answer_generation
- task176_break_decompose_questions
- task1291_multi_news_summarization
- task155_count_nouns_verbs
- task031_winogrande_question_generation_object
- task279_stereoset_classification_stereotype
- task1336_peixian_equity_evaluation_corpus_gender_classifier
- task508_scruples_dilemmas_more_ethical_isidentifiable
- task518_emo_different_dialogue_emotions
- task077_splash_explanation_to_sql
- task923_event2mind_classifier
- task470_mrqa_question_generation
- task638_multi_woz_classification
- task1412_web_questions_question_answering
- task847_pubmedqa_question_generation
- task678_ollie_actual_relationship_answer_generation
- task290_tellmewhy_question_answerability
- task575_air_dialogue_classification
- task189_snli_neutral_to_contradiction_text_modification
- task026_drop_question_generation
- task162_count_words_starting_with_letter
- task079_conala_concat_strings
- task610_conllpp_ner
- task046_miscellaneous_question_typing
- task197_mnli_domain_answer_generation
- task1325_qa_zre_question_generation_on_subject_relation
- task430_senteval_subject_count
- task672_nummersense
- task402_grailqa_paraphrase_generation
- task904_hate_speech_offensive_classification
- task192_hotpotqa_sentence_generation
- task069_abductivenli_classification
- task574_air_dialogue_sentence_generation
- task187_snli_entailment_to_contradiction_text_modification
- task749_glucose_reverse_cause_emotion_detection
- task1552_scitail_question_generation
- task750_aqua_multiple_choice_answering
- task327_jigsaw_classification_toxic
- task1502_hatexplain_classification
- task328_jigsaw_classification_insult
- task304_numeric_fused_head_resolution
- task1293_kilt_tasks_hotpotqa_question_answering
- task216_rocstories_correct_answer_generation
- task1326_qa_zre_question_generation_from_answer
- task1338_peixian_equity_evaluation_corpus_sentiment_classifier
- task1729_personachat_generate_next
- task1202_atomic_classification_xneed
- task400_paws_paraphrase_classification
- task502_scruples_anecdotes_whoiswrong_verification
- task088_identify_typo_verification
- task221_rocstories_two_choice_classification
- task200_mnli_entailment_classification
- task074_squad1.1_question_generation
- task581_socialiqa_question_generation
- task1186_nne_hrngo_classification
- task898_freebase_qa_answer_generation
- task1408_dart_similarity_classification
- task168_strategyqa_question_decomposition
- task1357_xlsum_summary_generation
- task390_torque_text_span_selection
- task165_mcscript_question_answering_commonsense
- task1533_daily_dialog_formal_classification
- task002_quoref_answer_generation
- task1297_qasc_question_answering
- task305_jeopardy_answer_generation_normal
- task029_winogrande_full_object
- task1327_qa_zre_answer_generation_from_question
- task326_jigsaw_classification_obscene
- task1542_every_ith_element_from_starting
- task570_recipe_nlg_ner_generation
- task1409_dart_text_generation
- task401_numeric_fused_head_reference
- task846_pubmedqa_classification
- task1712_poki_classification
- task344_hybridqa_answer_generation
- task875_emotion_classification
- task1214_atomic_classification_xwant
- task106_scruples_ethical_judgment
- task238_iirc_answer_from_passage_answer_generation
- task1391_winogrande_easy_answer_generation
- task195_sentiment140_classification
- task163_count_words_ending_with_letter
- task579_socialiqa_classification
- task569_recipe_nlg_text_generation
- task1602_webquestion_question_genreation
- task747_glucose_cause_emotion_detection
- task219_rocstories_title_answer_generation
- task178_quartz_question_answering
- task103_facts2story_long_text_generation
- task301_record_question_generation
- task1369_healthfact_sentence_generation
- task515_senteval_odd_word_out
- task496_semeval_answer_generation
- task1658_billsum_summarization
- task1204_atomic_classification_hinderedby
- task1392_superglue_multirc_answer_verification
- task306_jeopardy_answer_generation_double
- task1286_openbookqa_question_answering
- task159_check_frequency_of_words_in_sentence_pair
- task151_tomqa_find_location_easy_clean
- task323_jigsaw_classification_sexually_explicit
- task037_qasc_generate_related_fact
- task027_drop_answer_type_generation
- task1596_event2mind_text_generation_2
- task141_odd-man-out_classification_category
- task194_duorc_answer_generation
- task679_hope_edi_english_text_classification
- task246_dream_question_generation
- task1195_disflqa_disfluent_to_fluent_conversion
- task065_timetravel_consistent_sentence_classification
- task351_winomt_classification_gender_identifiability_anti
- task580_socialiqa_answer_generation
- task583_udeps_eng_coarse_pos_tagging
- task202_mnli_contradiction_classification
- task222_rocstories_two_chioce_slotting_classification
- task498_scruples_anecdotes_whoiswrong_classification
- task067_abductivenli_answer_generation
- task616_cola_classification
- task286_olid_offense_judgment
- task188_snli_neutral_to_entailment_text_modification
- task223_quartz_explanation_generation
- task820_protoqa_answer_generation
- task196_sentiment140_answer_generation
- task1678_mathqa_answer_selection
- task349_squad2.0_answerable_unanswerable_question_classification
- task154_tomqa_find_location_hard_noise
- task333_hateeval_classification_hate_en
- task235_iirc_question_from_subtext_answer_generation
- task1554_scitail_classification
- task210_logic2text_structured_text_generation
- task035_winogrande_question_modification_person
- task230_iirc_passage_classification
- task1356_xlsum_title_generation
- task1726_mathqa_correct_answer_generation
- task302_record_classification
- task380_boolq_yes_no_question
- task212_logic2text_classification
- task748_glucose_reverse_cause_event_detection
- task834_mathdataset_classification
- task350_winomt_classification_gender_identifiability_pro
- task191_hotpotqa_question_generation
- task236_iirc_question_from_passage_answer_generation
- task217_rocstories_ordering_answer_generation
- task568_circa_question_generation
- task614_glucose_cause_event_detection
- task361_spolin_yesand_prompt_response_classification
- task421_persent_sentence_sentiment_classification
- task203_mnli_sentence_generation
- task420_persent_document_sentiment_classification
- task153_tomqa_find_location_hard_clean
- task346_hybridqa_classification
- task1211_atomic_classification_hassubevent
- task360_spolin_yesand_response_generation
- task510_reddit_tifu_title_summarization
- task511_reddit_tifu_long_text_summarization
- task345_hybridqa_answer_generation
- task270_csrg_counterfactual_context_generation
- task307_jeopardy_answer_generation_final
- task001_quoref_question_generation
- task089_swap_words_verification
- task1196_atomic_classification_oeffect
- task080_piqa_answer_generation
- task1598_nyc_long_text_generation
- task240_tweetqa_question_generation
- task615_moviesqa_answer_generation
- task1347_glue_sts-b_similarity_classification
- task114_is_the_given_word_longest
- task292_storycommonsense_character_text_generation
- task115_help_advice_classification
- task431_senteval_object_count
- task1360_numer_sense_multiple_choice_qa_generation
- task177_para-nmt_paraphrasing
- task132_dais_text_modification
- task269_csrg_counterfactual_story_generation
- task233_iirc_link_exists_classification
- task161_count_words_containing_letter
- task1205_atomic_classification_isafter
- task571_recipe_nlg_ner_generation
- task1292_yelp_review_full_text_categorization
- task428_senteval_inversion
- task311_race_question_generation
- task429_senteval_tense
- task403_creak_commonsense_inference
- task929_products_reviews_classification
- task582_naturalquestion_answer_generation
- task237_iirc_answer_from_subtext_answer_generation
- task050_multirc_answerability
- task184_break_generate_question
- task669_ambigqa_answer_generation
- task169_strategyqa_sentence_generation
- task500_scruples_anecdotes_title_generation
- task241_tweetqa_classification
- task1345_glue_qqp_question_paraprashing
- task218_rocstories_swap_order_answer_generation
- task613_politifact_text_generation
- task1167_penn_treebank_coarse_pos_tagging
- task1422_mathqa_physics
- task247_dream_answer_generation
- task199_mnli_classification
- task164_mcscript_question_answering_text
- task1541_agnews_classification
- task516_senteval_conjoints_inversion
- task294_storycommonsense_motiv_text_generation
- task501_scruples_anecdotes_post_type_verification
- task213_rocstories_correct_ending_classification
- task821_protoqa_question_generation
- task493_review_polarity_classification
- task308_jeopardy_answer_generation_all
- task1595_event2mind_text_generation_1
- task040_qasc_question_generation
- task231_iirc_link_classification
- task1727_wiqa_what_is_the_effect
- task578_curiosity_dialogs_answer_generation
- task310_race_classification
- task309_race_answer_generation
- task379_agnews_topic_classification
- task030_winogrande_full_person
- task1540_parsed_pdfs_summarization
- task039_qasc_find_overlapping_words
- task1206_atomic_classification_isbefore
- task157_count_vowels_and_consonants
- task339_record_answer_generation
- task453_swag_answer_generation
- task848_pubmedqa_classification
- task673_google_wellformed_query_classification
- task676_ollie_relationship_answer_generation
- task268_casehold_legal_answer_generation
- task844_financial_phrasebank_classification
- task330_gap_answer_generation
- task595_mocha_answer_generation
- task1285_kpa_keypoint_matching
- task234_iirc_passage_line_answer_generation
- task494_review_polarity_answer_generation
- task670_ambigqa_question_generation
- task289_gigaword_summarization
- npr
- nli
- SimpleWiki
- amazon_review_2018
- ccnews_title_text
- agnews
- xsum
- msmarco
- yahoo_answers_title_answer
- squad_pairs
- wow
- mteb-amazon_counterfactual-avs_triplets
- mteb-amazon_massive_intent-avs_triplets
- mteb-amazon_massive_scenario-avs_triplets
- mteb-amazon_reviews_multi-avs_triplets
- mteb-banking77-avs_triplets
- mteb-emotion-avs_triplets
- mteb-imdb-avs_triplets
- mteb-mtop_domain-avs_triplets
- mteb-mtop_intent-avs_triplets
- mteb-toxic_conversations_50k-avs_triplets
- mteb-tweet_sentiment_extraction-avs_triplets
- covid-bing-query-gpt4-avs_triplets
- Language: en
- License: apache-2.0
Model Sources
- Documentation: Sentence Transformers Documentation
- Repository: Sentence Transformers on GitHub
- Hugging Face: Sentence Transformers on Hugging Face
Full Model Architecture
SentenceTransformer(
(0): Transformer({'max_seq_length': 256, 'do_lower_case': False}) with Transformer model: BertModel
(1): Pooling({'word_embedding_dimension': 384, 'pooling_mode_cls_token': False, 'pooling_mode_mean_tokens': True, 'pooling_mode_max_tokens': False, 'pooling_mode_mean_sqrt_len_tokens': False, 'pooling_mode_weightedmean_tokens': False, 'pooling_mode_lasttoken': False, 'include_prompt': True})
(2): Normalize()
)
Usage
Direct Usage (Sentence Transformers)
First install the Sentence Transformers library:
pip install -U sentence-transformers
Then you can load this model and run inference.
from sentence_transformers import SentenceTransformer
# Download from the 🤗 Hub
model = SentenceTransformer("avsolatorio/all-MiniLM-L6-v2-MEDI-MTEB-triplet-final")
# Run inference
sentences = [
'who does george nelson represent in o brother where art thou',
'O Brother, Where Art Thou? omitted all instances of the words "damn" and "hell" from the Coens\' script, which only became known to Clooney after the directors pointed this out to him during shooting. This was the fourth film of the brothers in which John Turturro has starred. Other actors in "O Brother, Where Art Thou?" who had worked previously with the Coens include John Goodman (three films), Holly Hunter (two), Michael Badalucco and Charles Durning (one film each). The Coens used digital color correction to give the film a sepia-tinted look. Joel stated this was because the actual set was "greener than Ireland". Cinematographer',
'O Brother, Where Art Thou? the film got together and performed the music from the film in a Down from the Mountain concert tour which was filmed for TV and DVD. This included Ralph Stanley, John Hartford, Alison Krauss, Emmylou Harris, Gillian Welch, Chris Sharp, and others. O Brother, Where Art Thou? O Brother, Where Art Thou? is a 2000 crime comedy film written, produced, and directed by Joel and Ethan Coen, and starring George Clooney, John Turturro, and Tim Blake Nelson, with John Goodman, Holly Hunter, and Charles Durning in supporting roles. The film is set in 1937 rural Mississippi during the Great Depression.',
]
embeddings = model.encode(sentences)
print(embeddings.shape)
# [3, 384]
# Get the similarity scores for the embeddings
similarities = model.similarity(embeddings, embeddings)
print(similarities.shape)
# [3, 3]
Evaluation
Metrics
Triplet
- Dataset:
medi-mteb-dev - Evaluated with TripletEvaluator
| Metric | Value |
|---|---|
| cosine_accuracy | 0.9117 |
| dot_accuracy | 0.081 |
| manhattan_accuracy | 0.912 |
| euclidean_accuracy | 0.9115 |
| max_accuracy | 0.912 |
Training Details
Training Datasets
NQ
- Dataset: NQ
- Size: 49,676 training samples
- Columns: anchor, positive, and negative
- Approximate statistics based on the first 1000 samples:
anchor positive negative type string string string details min: 10 tokensmean: 11.91 tokensmax: 24 tokens min: 111 tokensmean: 137.95 tokensmax: 212 tokens min: 113 tokensmean: 138.79 tokensmax: 209 tokens - Samples:
- Loss: MultipleNegativesRankingLoss with these parameters:
{ "scale": 20.0, "similarity_fct": "cos_sim" }
pubmed
- Dataset: pubmed
- Size: 29,908 training samples
- Columns: anchor, positive, and negative
- Approximate statistics based on the first 1000 samples:
anchor positive negative type string string string details min: 6 tokensmean: 22.81 tokensmax: 62 tokens min: 93 tokensmean: 240.49 tokensmax: 256 tokens min: 73 tokensmean: 239.5 tokensmax: 256 tokens - Samples:
- Loss: MultipleNegativesRankingLoss with these parameters:
{ "scale": 20.0, "similarity_fct": "cos_sim" }
specter_train_triples
- Dataset: specter_train_triples
- Size: 49,676 training samples
- Columns: anchor, positive, and negative
- Approximate statistics based on the first 1000 samples:
anchor positive negative type string string string details min: 4 tokensmean: 15.69 tokensmax: 94 tokens min: 4 tokensmean: 14.12 tokensmax: 39 tokens min: 4 tokensmean: 16.39 tokensmax: 64 tokens - Samples:
- Loss: MultipleNegativesRankingLoss with these parameters:
{ "scale": 20.0, "similarity_fct": "cos_sim" }
S2ORC_citations_abstracts
- Dataset: S2ORC_citations_abstracts
- Size: 99,352 training samples
- Columns: anchor, positive, and negative
- Approximate statistics based on the first 1000 samples:
anchor positive negative type string string string details min: 20 tokensmean: 196.74 tokensmax: 256 tokens min: 24 tokensmean: 203.91 tokensmax: 256 tokens min: 24 tokensmean: 208.09 tokensmax: 256 tokens - Samples:
- Loss: MultipleNegativesRankingLoss with these parameters:
{ "scale": 20.0, "similarity_fct": "cos_sim" }
fever
- Dataset: fever
- Size: 74,514 training samples
- Columns: anchor, positive, and negative
- Approximate statistics based on the first 1000 samples:
anchor positive negative type string string string details min: 6 tokensmean: 12.49 tokensmax: 51 tokens min: 48 tokensmean: 112.67 tokensmax: 154 tokens min: 35 tokensmean: 113.92 tokensmax: 163 tokens - Samples:
- Loss: MultipleNegativesRankingLoss with these parameters:
{ "scale": 20.0, "similarity_fct": "cos_sim" }
gooaq_pairs
- Dataset: gooaq_pairs
- Size: 24,838 training samples
- Columns: anchor, positive, and negative
- Approximate statistics based on the first 1000 samples:
anchor positive negative type string string string details min: 8 tokensmean: 11.92 tokensmax: 24 tokens min: 14 tokensmean: 60.11 tokensmax: 150 tokens min: 15 tokensmean: 63.73 tokensmax: 150 tokens - Samples:
- Loss: MultipleNegativesRankingLoss with these parameters:
{ "scale": 20.0, "similarity_fct": "cos_sim" }
codesearchnet
- Dataset: codesearchnet
- Size: 15,210 training samples
- Columns: anchor, positive, and negative
- Approximate statistics based on the first 1000 samples:
anchor positive negative type string string string details min: 5 tokensmean: 28.96 tokensmax: 143 tokens min: 28 tokensmean: 134.91 tokensmax: 256 tokens min: 29 tokensmean: 163.95 tokensmax: 256 tokens - Samples:
- Loss: MultipleNegativesRankingLoss with these parameters:
{ "scale": 20.0, "similarity_fct": "cos_sim" }
wikihow
- Dataset: wikihow
- Size: 5,070 training samples
- Columns: anchor, positive, and negative
- Approximate statistics based on the first 1000 samples:
anchor positive negative type string string string details min: 4 tokensmean: 8.05 tokensmax: 21 tokens min: 13 tokensmean: 45.27 tokensmax: 117 tokens min: 10 tokensmean: 35.68 tokensmax: 75 tokens - Samples:
- Loss: MultipleNegativesRankingLoss with these parameters:
{ "scale": 20.0, "similarity_fct": "cos_sim" }
WikiAnswers
- Dataset: WikiAnswers
- Size: 24,838 training samples
- Columns: anchor, positive, and negative
- Approximate statistics based on the first 1000 samples:
anchor positive negative type string string string details min: 6 tokensmean: 12.79 tokensmax: 43 tokens min: 6 tokensmean: 12.93 tokensmax: 47 tokens min: 6 tokensmean: 13.13 tokensmax: 44 tokens - Samples:
- Loss: MultipleNegativesRankingLoss with these parameters:
{ "scale": 20.0, "similarity_fct": "cos_sim" }
eli5_question_answer
- Dataset: eli5_question_answer
- Size: 24,838 training samples
- Columns: anchor, positive, and negative
- Approximate statistics based on the first 1000 samples:
anchor positive negative type string string string details min: 5 tokensmean: 21.16 tokensmax: 69 tokens min: 11 tokensmean: 100.92 tokensmax: 256 tokens min: 13 tokensmean: 112.62 tokensmax: 256 tokens - Samples:
- Loss: MultipleNegativesRankingLoss with these parameters:
{ "scale": 20.0, "similarity_fct": "cos_sim" }
amazon-qa
- Dataset: amazon-qa
- Size: 99,352 training samples
- Columns: anchor, positive, and negative
- Approximate statistics based on the first 1000 samples:
anchor positive negative type string string string details min: 6 tokensmean: 23.56 tokensmax: 256 tokens min: 15 tokensmean: 52.4 tokensmax: 256 tokens min: 18 tokensmean: 62.09 tokensmax: 256 tokens - Samples:
- Loss: MultipleNegativesRankingLoss with these parameters:
{ "scale": 20.0, "similarity_fct": "cos_sim" }
medmcqa
- Dataset: medmcqa
- Size: 29,908 training samples
- Columns: anchor, positive, and negative
- Approximate statistics based on the first 1000 samples:
anchor positive negative type string string string details min: 4 tokensmean: 19.62 tokensmax: 167 tokens min: 3 tokensmean: 110.24 tokensmax: 256 tokens min: 3 tokensmean: 111.99 tokensmax: 256 tokens - Samples:
- Loss: MultipleNegativesRankingLoss with these parameters:
{ "scale": 20.0, "similarity_fct": "cos_sim" }
zeroshot
- Dataset: zeroshot
- Size: 15,210 training samples
- Columns: anchor, positive, and negative
- Approximate statistics based on the first 1000 samples:
anchor positive negative type string string string details min: 5 tokensmean: 8.7 tokensmax: 20 tokens min: 10 tokensmean: 112.73 tokensmax: 178 tokens min: 14 tokensmean: 115.71 tokensmax: 256 tokens - Samples:
- Loss: MultipleNegativesRankingLoss with these parameters:
{ "scale": 20.0, "similarity_fct": "cos_sim" }
TriviaQA_pairs
- Dataset: TriviaQA_pairs
- Size: 49,676 training samples
- Columns: anchor, positive, and negative
- Approximate statistics based on the first 1000 samples:
anchor positive negative type string string string details min: 8 tokensmean: 19.22 tokensmax: 59 tokens min: 33 tokensmean: 246.01 tokensmax: 256 tokens min: 21 tokensmean: 232.19 tokensmax: 256 tokens - Samples:
- Loss: MultipleNegativesRankingLoss with these parameters:
{ "scale": 20.0, "similarity_fct": "cos_sim" }
PAQ_pairs
- Dataset: PAQ_pairs
- Size: 24,838 training samples
- Columns: anchor, positive, and negative
- Approximate statistics based on the first 1000 samples:
anchor positive negative type string string string details min: 8 tokensmean: 12.6 tokensmax: 22 tokens min: 112 tokensmean: 136.78 tokensmax: 205 tokens min: 110 tokensmean: 135.66 tokensmax: 254 tokens - Samples:
- Loss: MultipleNegativesRankingLoss with these parameters:
{ "scale": 20.0, "similarity_fct": "cos_sim" }
stackexchange_duplicate_questions_title-body_title-body
- Dataset: stackexchange_duplicate_questions_title-body_title-body
- Size: 24,838 training samples
- Columns: anchor, positive, and negative
- Approximate statistics based on the first 1000 samples:
anchor positive negative type string string string details min: 18 tokensmean: 150.59 tokensmax: 256 tokens min: 20 tokensmean: 142.04 tokensmax: 256 tokens min: 27 tokensmean: 198.29 tokensmax: 256 tokens - Samples:
- Loss: MultipleNegativesRankingLoss with these parameters:
{ "scale": 20.0, "similarity_fct": "cos_sim" }
trex
- Dataset: trex
- Size: 29,908 training samples
- Columns: anchor, positive, and negative
- Approximate statistics based on the first 1000 samples:
anchor positive negative type string string string details min: 5 tokensmean: 9.55 tokensmax: 27 tokens min: 16 tokensmean: 104.71 tokensmax: 212 tokens min: 14 tokensmean: 118.22 tokensmax: 256 tokens - Samples:
- Loss: MultipleNegativesRankingLoss with these parameters:
{ "scale": 20.0, "similarity_fct": "cos_sim" }
flickr30k_captions
- Dataset: flickr30k_captions
- Size: 24,838 training samples
- Columns: anchor, positive, and negative
- Approximate statistics based on the first 1000 samples:
anchor positive negative type string string string details min: 7 tokensmean: 15.95 tokensmax: 88 tokens min: 7 tokensmean: 15.68 tokensmax: 59 tokens min: 7 tokensmean: 17.15 tokensmax: 52 tokens - Samples:
- Loss: MultipleNegativesRankingLoss with these parameters:
{ "scale": 20.0, "similarity_fct": "cos_sim" }
hotpotqa
- Dataset: hotpotqa
- Size: 40,048 training samples
- Columns: anchor, positive, and negative
- Approximate statistics based on the first 1000 samples:
anchor positive negative type string string string details min: 8 tokensmean: 23.83 tokensmax: 103 tokens min: 27 tokensmean: 113.6 tokensmax: 194 tokens min: 38 tokensmean: 115.33 tokensmax: 178 tokens - Samples:
- Loss: MultipleNegativesRankingLoss with these parameters:
{ "scale": 20.0, "similarity_fct": "cos_sim" }
task671_ambigqa_text_generation
- Dataset: task671_ambigqa_text_generation
- Size: 1,018 training samples
- Columns: anchor, positive, and negative
- Approximate statistics based on the first 1000 samples:
anchor positive negative type string string string details min: 11 tokensmean: 12.69 tokensmax: 26 tokens min: 11 tokensmean: 12.52 tokensmax: 23 tokens min: 11 tokensmean: 12.23 tokensmax: 19 tokens - Samples:
- Loss: MultipleNegativesRankingLoss with these parameters:
{ "scale": 20.0, "similarity_fct": "cos_sim" }
task061_ropes_answer_generation
- Dataset: task061_ropes_answer_generation
- Size: 1,018 training samples
- Columns: anchor, positive, and negative
- Approximate statistics based on the first 1000 samples:
anchor positive negative type string string string details min: 117 tokensmean: 208.96 tokensmax: 256 tokens min: 117 tokensmean: 208.27 tokensmax: 256 tokens min: 119 tokensmean: 210.46 tokensmax: 256 tokens - Samples:
- Loss: MultipleNegativesRankingLoss with these parameters:
{ "scale": 20.0, "similarity_fct": "cos_sim" }
task285_imdb_answer_generation
- Dataset: task285_imdb_answer_generation
- Size: 1,018 training samples
- Columns: anchor, positive, and negative
- Approximate statistics based on the first 1000 samples:
anchor positive negative type string string string details min: 46 tokensmean: 208.78 tokensmax: 256 tokens min: 49 tokensmean: 203.97 tokensmax: 256 tokens min: 46 tokensmean: 208.78 tokensmax: 256 tokens - Samples:
- Loss: MultipleNegativesRankingLoss with these parameters:
{ "scale": 20.0, "similarity_fct": "cos_sim" }
task905_hate_speech_offensive_classification
- Dataset: task905_hate_speech_offensive_classification
- Size: 1,018 training samples
- Columns: anchor, positive, and negative
- Approximate statistics based on the first 1000 samples:
anchor positive negative type string string string details min: 15 tokensmean: 41.73 tokensmax: 164 tokens min: 13 tokensmean: 40.48 tokensmax: 198 tokens min: 13 tokensmean: 32.23 tokensmax: 135 tokens - Samples:
- Loss: MultipleNegativesRankingLoss with these parameters:
{ "scale": 20.0, "similarity_fct": "cos_sim" }
task566_circa_classification
- Dataset: task566_circa_classification
- Size: 1,018 training samples
- Columns: anchor, positive, and negative
- Approximate statistics based on the first 1000 samples:
anchor positive negative type string string string details min: 20 tokensmean: 27.77 tokensmax: 48 tokens min: 19 tokensmean: 27.22 tokensmax: 44 tokens min: 20 tokensmean: 27.46 tokensmax: 47 tokens - Samples:
- Loss: MultipleNegativesRankingLoss with these parameters:
{ "scale": 20.0, "similarity_fct": "cos_sim" }
task184_snli_entailment_to_neutral_text_modification
- Dataset: task184_snli_entailment_to_neutral_text_modification
- Size: 1,018 training samples
- Columns: anchor, positive, and negative
- Approximate statistics based on the first 1000 samples:
anchor positive negative type string string string details min: 17 tokensmean: 29.98 tokensmax: 72 tokens min: 16 tokensmean: 28.9 tokensmax: 60 tokens min: 17 tokensmean: 30.33 tokensmax: 100 tokens - Samples:
- Loss: MultipleNegativesRankingLoss with these parameters:
{ "scale": 20.0, "similarity_fct": "cos_sim" }
task280_stereoset_classification_stereotype_type
- Dataset: task280_stereoset_classification_stereotype_type
- Size: 1,018 training samples
- Columns: anchor, positive, and negative
- Approximate statistics based on the first 1000 samples:
anchor positive negative type string string string details min: 8 tokensmean: 18.47 tokensmax: 53 tokens min: 8 tokensmean: 16.89 tokensmax: 53 tokens min: 8 tokensmean: 16.86 tokensmax: 51 tokens - Samples:
- Loss: MultipleNegativesRankingLoss with these parameters:
{ "scale": 20.0, "similarity_fct": "cos_sim" }
task1599_smcalflow_classification
- Dataset: task1599_smcalflow_classification
- Size: 1,018 training samples
- Columns: anchor, positive, and negative
- Approximate statistics based on the first 1000 samples:
anchor positive negative type string string string details min: 3 tokensmean: 11.25 tokensmax: 37 tokens min: 3 tokensmean: 10.47 tokensmax: 38 tokens min: 5 tokensmean: 16.12 tokensmax: 45 tokens - Samples:
- Loss: MultipleNegativesRankingLoss with these parameters:
{ "scale": 20.0, "similarity_fct": "cos_sim" }
task1384_deal_or_no_dialog_classification
- Dataset: task1384_deal_or_no_dialog_classification
- Size: 1,018 training samples
- Columns: anchor, positive, and negative
- Approximate statistics based on the first 1000 samples:
anchor positive negative type string string string details min: 14 tokensmean: 59.1 tokensmax: 256 tokens min: 12 tokensmean: 59.35 tokensmax: 256 tokens min: 15 tokensmean: 58.47 tokensmax: 256 tokens - Samples:
- Loss: MultipleNegativesRankingLoss with these parameters:
{ "scale": 20.0, "similarity_fct": "cos_sim" }
task591_sciq_answer_generation
- Dataset: task591_sciq_answer_generation
- Size: 1,018 training samples
- Columns: anchor, positive, and negative
- Approximate statistics based on the first 1000 samples:
anchor positive negative type string string string details min: 8 tokensmean: 17.61 tokensmax: 70 tokens min: 7 tokensmean: 17.17 tokensmax: 43 tokens min: 6 tokensmean: 16.67 tokensmax: 75 tokens - Samples:
- Loss: MultipleNegativesRankingLoss with these parameters:
{ "scale": 20.0, "similarity_fct": "cos_sim" }
task823_peixian-rtgender_sentiment_analysis
- Dataset: task823_peixian-rtgender_sentiment_analysis
- Size: 1,018 training samples
- Columns: anchor, positive, and negative
- Approximate statistics based on the first 1000 samples:
anchor positive negative type string string string details min: 16 tokensmean: 57.26 tokensmax: 179 tokens min: 16 tokensmean: 60.03 tokensmax: 153 tokens min: 14 tokensmean: 60.89 tokensmax: 169 tokens - Samples:
- Loss: MultipleNegativesRankingLoss with these parameters:
{ "scale": 20.0, "similarity_fct": "cos_sim" }
task023_cosmosqa_question_generation
- Dataset: task023_cosmosqa_question_generation
- Size: 1,018 training samples
- Columns: anchor, positive, and negative
- Approximate statistics based on the first 1000 samples:
anchor positive negative type string string string details min: 35 tokensmean: 79.52 tokensmax: 159 tokens min: 34 tokensmean: 80.36 tokensmax: 165 tokens min: 35 tokensmean: 79.14 tokensmax: 161 tokens - Samples:
- Loss: MultipleNegativesRankingLoss with these parameters:
{ "scale": 20.0, "similarity_fct": "cos_sim" }
task900_freebase_qa_category_classification
- Dataset: task900_freebase_qa_category_classification
- Size: 1,018 training samples
- Columns: anchor, positive, and negative
- Approximate statistics based on the first 1000 samples:
anchor positive negative type string string string details min: 8 tokensmean: 20.44 tokensmax: 88 tokens min: 8 tokensmean: 18.33 tokensmax: 62 tokens min: 8 tokensmean: 19.14 tokensmax: 69 tokens - Samples:
- Loss: MultipleNegativesRankingLoss with these parameters:
{ "scale": 20.0, "similarity_fct": "cos_sim" }
task924_event2mind_word_generation
- Dataset: task924_event2mind_word_generation
- Size: 1,018 training samples
- Columns: anchor, positive, and negative
- Approximate statistics based on the first 1000 samples:
anchor positive negative type string string string details min: 17 tokensmean: 32.06 tokensmax: 64 tokens min: 17 tokensmean: 32.13 tokensmax: 70 tokens min: 17 tokensmean: 31.58 tokensmax: 68 tokens - Samples:
- Loss: MultipleNegativesRankingLoss with these parameters:
{ "scale": 20.0, "similarity_fct": "cos_sim" }
task152_tomqa_find_location_easy_noise
- Dataset: task152_tomqa_find_location_easy_noise
- Size: 1,018 training samples
- Columns: anchor, positive, and negative
- Approximate statistics based on the first 1000 samples:
anchor positive negative type string string string details min: 37 tokensmean: 52.96 tokensmax: 79 tokens min: 37 tokensmean: 52.53 tokensmax: 78 tokens min: 37 tokensmean: 52.92 tokensmax: 82 tokens - Samples:
- Loss: MultipleNegativesRankingLoss with these parameters:
{ "scale": 20.0, "similarity_fct": "cos_sim" }
task1368_healthfact_sentence_generation
- Dataset: task1368_healthfact_sentence_generation
- Size: 1,018 training samples
- Columns: anchor, positive, and negative
- Approximate statistics based on the first 1000 samples:
anchor positive negative type string string string details min: 91 tokensmean: 240.57 tokensmax: 256 tokens min: 84 tokensmean: 239.31 tokensmax: 256 tokens min: 97 tokensmean: 245.05 tokensmax: 256 tokens - Samples:
- Loss: MultipleNegativesRankingLoss with these parameters:
{ "scale": 20.0, "similarity_fct": "cos_sim" }
task1661_super_glue_classification
- Dataset: task1661_super_glue_classification
- Size: 1,018 training samples
- Columns: anchor, positive, and negative
- Approximate statistics based on the first 1000 samples:
anchor positive negative type string string string details min: 35 tokensmean: 140.99 tokensmax: 256 tokens min: 31 tokensmean: 142.44 tokensmax: 256 tokens min: 31 tokensmean: 143.37 tokensmax: 256 tokens - Samples:
- Loss: MultipleNegativesRankingLoss with these parameters:
{ "scale": 20.0, "similarity_fct": "cos_sim" }
task1187_politifact_classification
- Dataset: task1187_politifact_classification
- Size: 1,018 training samples
- Columns: anchor, positive, and negative
- Approximate statistics based on the first 1000 samples:
anchor positive negative type string string string details min: 14 tokensmean: 33.28 tokensmax: 79 tokens min: 10 tokensmean: 31.59 tokensmax: 75 tokens min: 13 tokensmean: 31.9 tokensmax: 71 tokens - Samples:
- Loss: MultipleNegativesRankingLoss with these parameters:
{ "scale": 20.0, "similarity_fct": "cos_sim" }
task1728_web_nlg_data_to_text
- Dataset: task1728_web_nlg_data_to_text
- Size: 1,018 training samples
- Columns: anchor, positive, and negative
- Approximate statistics based on the first 1000 samples:
anchor positive negative type string string string details min: 7 tokensmean: 43.07 tokensmax: 152 tokens min: 7 tokensmean: 46.55 tokensmax: 152 tokens min: 8 tokensmean: 43.18 tokensmax: 152 tokens - Samples:
- Loss: MultipleNegativesRankingLoss with these parameters:
{ "scale": 20.0, "similarity_fct": "cos_sim" }
task112_asset_simple_sentence_identification
- Dataset: task112_asset_simple_sentence_identification
- Size: 1,018 training samples
- Columns: anchor, positive, and negative
- Approximate statistics based on the first 1000 samples:
anchor positive negative type string string string details min: 18 tokensmean: 51.87 tokensmax: 136 tokens min: 18 tokensmean: 51.68 tokensmax: 144 tokens min: 22 tokensmean: 51.93 tokensmax: 114 tokens - Samples:
- Loss: MultipleNegativesRankingLoss with these parameters:
{ "scale": 20.0, "similarity_fct": "cos_sim" }
task1340_msr_text_compression_compression
- Dataset: task1340_msr_text_compression_compression
- Size: 1,018 training samples
- Columns: anchor, positive, and negative
- Approximate statistics based on the first 1000 samples:
anchor positive negative type string string string details min: 14 tokensmean: 41.77 tokensmax: 116 tokens min: 14 tokensmean: 44.27 tokensmax: 133 tokens min: 12 tokensmean: 40.08 tokensmax: 141 tokens - Samples:
- Loss: MultipleNegativesRankingLoss with these parameters:
{ "scale": 20.0, "similarity_fct": "cos_sim" }
task072_abductivenli_answer_generation
- Dataset: task072_abductivenli_answer_generation
- Size: 1,018 training samples
- Columns: anchor, positive, and negative
- Approximate statistics based on the first 1000 samples:
anchor positive negative type string string string details min: 17 tokensmean: 26.8 tokensmax: 56 tokens min: 16 tokensmean: 26.15 tokensmax: 47 tokens min: 16 tokensmean: 26.4 tokensmax: 55 tokens - Samples:
- Loss: MultipleNegativesRankingLoss with these parameters:
{ "scale": 20.0, "similarity_fct": "cos_sim" }
task1504_hatexplain_answer_generation
- Dataset: task1504_hatexplain_answer_generation
- Size: 1,018 training samples
- Columns: anchor, positive, and negative
- Approximate statistics based on the first 1000 samples:
anchor positive negative type string string string details min: 7 tokensmean: 28.53 tokensmax: 72 tokens min: 5 tokensmean: 24.21 tokensmax: 86 tokens min: 5 tokensmean: 27.94 tokensmax: 67 tokens - Samples:
- Loss: MultipleNegativesRankingLoss with these parameters:
{ "scale": 20.0, "similarity_fct": "cos_sim" }
task684_online_privacy_policy_text_information_type_generation
- Dataset: task684_online_privacy_policy_text_information_type_generation
- Size: 1,018 training samples
- Columns: anchor, positive, and negative
- Approximate statistics based on the first 1000 samples:
anchor positive negative type string string string details min: 10 tokensmean: 29.91 tokensmax: 68 tokens min: 10 tokensmean: 30.18 tokensmax: 61 tokens min: 14 tokensmean: 30.06 tokensmax: 68 tokens - Samples:
- Loss: MultipleNegativesRankingLoss with these parameters:
{ "scale": 20.0, "similarity_fct": "cos_sim" }
task1290_xsum_summarization
- Dataset: task1290_xsum_summarization
- Size: 1,018 training samples
- Columns: anchor, positive, and negative
- Approximate statistics based on the first 1000 samples:
anchor positive negative type string string string details min: 39 tokensmean: 226.28 tokensmax: 256 tokens min: 50 tokensmean: 229.51 tokensmax: 256 tokens min: 34 tokensmean: 229.59 tokensmax: 256 tokens - Samples:
- Loss: MultipleNegativesRankingLoss with these parameters:
{ "scale": 20.0, "similarity_fct": "cos_sim" }
task075_squad1.1_answer_generation
- Dataset: task075_squad1.1_answer_generation
- Size: 1,018 training samples
- Columns: anchor, positive, and negative
- Approximate statistics based on the first 1000 samples:
anchor positive negative type string string string details min: 48 tokensmean: 167.12 tokensmax: 256 tokens min: 45 tokensmean: 173.01 tokensmax: 256 tokens min: 46 tokensmean: 178.89 tokensmax: 256 tokens - Samples:
- Loss: MultipleNegativesRankingLoss with these parameters:
{ "scale": 20.0, "similarity_fct": "cos_sim" }
task1587_scifact_classification
- Dataset: task1587_scifact_classification
- Size: 1,018 training samples
- Columns: anchor, positive, and negative
- Approximate statistics based on the first 1000 samples:
anchor positive negative type string string string details min: 88 tokensmean: 242.08 tokensmax: 256 tokens min: 90 tokensmean: 246.93 tokensmax: 256 tokens min: 86 tokensmean: 244.36 tokensmax: 256 tokens - Samples:
- Loss: MultipleNegativesRankingLoss with these parameters:
{ "scale": 20.0, "similarity_fct": "cos_sim" }
task384_socialiqa_question_classification
- Dataset: task384_socialiqa_question_classification
- Size: 1,018 training samples
- Columns: anchor, positive, and negative
- Approximate statistics based on the first 1000 samples:
anchor positive negative type string string string details min: 24 tokensmean: 35.46 tokensmax: 78 tokens min: 22 tokensmean: 34.33 tokensmax: 59 tokens min: 22 tokensmean: 34.52 tokensmax: 57 tokens - Samples:
- Loss: MultipleNegativesRankingLoss with these parameters:
{ "scale": 20.0, "similarity_fct": "cos_sim" }
task1555_scitail_answer_generation
- Dataset: task1555_scitail_answer_generation
- Size: 1,018 training samples
- Columns: anchor, positive, and negative
- Approximate statistics based on the first 1000 samples:
anchor positive negative type string string string details min: 18 tokensmean: 36.88 tokensmax: 90 tokens min: 18 tokensmean: 36.12 tokensmax: 80 tokens min: 18 tokensmean: 36.59 tokensmax: 92 tokens - Samples:
- Loss: MultipleNegativesRankingLoss with these parameters:
{ "scale": 20.0, "similarity_fct": "cos_sim" }
task1532_daily_dialog_emotion_classification
- Dataset: task1532_daily_dialog_emotion_classification
- Size: 1,018 training samples
- Columns: anchor, positive, and negative
- Approximate statistics based on the first 1000 samples:
anchor positive negative type string string string details min: 16 tokensmean: 135.8 tokensmax: 256 tokens min: 15 tokensmean: 140.06 tokensmax: 256 tokens min: 17 tokensmean: 134.53 tokensmax: 256 tokens - Samples:
- Loss: MultipleNegativesRankingLoss with these parameters:
{ "scale": 20.0, "similarity_fct": "cos_sim" }
task239_tweetqa_answer_generation
- Dataset: task239_tweetqa_answer_generation
- Size: 1,018 training samples
- Columns: anchor, positive, and negative
- Approximate statistics based on the first 1000 samples:
anchor positive negative type string string string details min: 28 tokensmean: 56.05 tokensmax: 91 tokens min: 29 tokensmean: 56.59 tokensmax: 92 tokens min: 25 tokensmean: 56.05 tokensmax: 81 tokens - Samples:
- Loss: MultipleNegativesRankingLoss with these parameters:
{ "scale": 20.0, "similarity_fct": "cos_sim" }
task596_mocha_question_generation
- Dataset: task596_mocha_question_generation
- Size: 1,018 training samples
- Columns: anchor, positive, and negative
- Approximate statistics based on the first 1000 samples:
anchor positive negative type string string string details min: 34 tokensmean: 80.75 tokensmax: 163 tokens min: 12 tokensmean: 96.06 tokensmax: 256 tokens min: 10 tokensmean: 45.02 tokensmax: 256 tokens - Samples:
- Loss: MultipleNegativesRankingLoss with these parameters:
{ "scale": 20.0, "similarity_fct": "cos_sim" }
task1411_dart_subject_identification
- Dataset: task1411_dart_subject_identification
- Size: 1,018 training samples
- Columns: anchor, positive, and negative
- Approximate statistics based on the first 1000 samples:
anchor positive negative type string string string details min: 7 tokensmean: 15.01 tokensmax: 74 tokens min: 6 tokensmean: 14.1 tokensmax: 37 tokens min: 6 tokensmean: 14.36 tokensmax: 38 tokens - Samples:
- Loss: MultipleNegativesRankingLoss with these parameters:
{ "scale": 20.0, "similarity_fct": "cos_sim" }
task1359_numer_sense_answer_generation
- Dataset: task1359_numer_sense_answer_generation
- Size: 1,018 training samples
- Columns: anchor, positive, and negative
- Approximate statistics based on the first 1000 samples:
anchor positive negative type string string string details min: 10 tokensmean: 18.75 tokensmax: 30 tokens min: 10 tokensmean: 18.43 tokensmax: 33 tokens min: 10 tokensmean: 18.3 tokensmax: 30 tokens - Samples:
- Loss: MultipleNegativesRankingLoss with these parameters:
{ "scale": 20.0, "similarity_fct": "cos_sim" }
task329_gap_classification
- Dataset: task329_gap_classification
- Size: 1,018 training samples
- Columns: anchor, positive, and negative
- Approximate statistics based on the first 1000 samples:
anchor positive negative type string string string details min: 40 tokensmean: 123.98 tokensmax: 256 tokens min: 62 tokensmean: 127.04 tokensmax: 256 tokens min: 58 tokensmean: 128.35 tokensmax: 256 tokens - Samples:
- Loss: MultipleNegativesRankingLoss with these parameters:
{ "scale": 20.0, "similarity_fct": "cos_sim" }
task220_rocstories_title_classification
- Dataset: task220_rocstories_title_classification
- Size: 1,018 training samples
- Columns: anchor, positive, and negative
- Approximate statistics based on the first 1000 samples:
anchor positive negative type string string string details min: 53 tokensmean: 80.81 tokensmax: 116 tokens min: 51 tokensmean: 81.14 tokensmax: 108 tokens min: 55 tokensmean: 79.79 tokensmax: 115 tokens - Samples:
- Loss: MultipleNegativesRankingLoss with these parameters:
{ "scale": 20.0, "similarity_fct": "cos_sim" }
task316_crows-pairs_classification_stereotype
- Dataset: task316_crows-pairs_classification_stereotype
- Size: 1,018 training samples
- Columns: anchor, positive, and negative
- Approximate statistics based on the first 1000 samples:
anchor positive negative type string string string details min: 8 tokensmean: 19.78 tokensmax: 51 tokens min: 7 tokensmean: 18.35 tokensmax: 41 tokens min: 7 tokensmean: 19.82 tokensmax: 52 tokens - Samples:
- Loss: MultipleNegativesRankingLoss with these parameters:
{ "scale": 20.0, "similarity_fct": "cos_sim" }
task495_semeval_headline_classification
- Dataset: task495_semeval_headline_classification
- Size: 1,018 training samples
- Columns: anchor, positive, and negative
- Approximate statistics based on the first 1000 samples:
anchor positive negative type string string string details min: 17 tokensmean: 24.57 tokensmax: 42 tokens min: 15 tokensmean: 24.23 tokensmax: 41 tokens min: 15 tokensmean: 24.2 tokensmax: 38 tokens - Samples:
- Loss: MultipleNegativesRankingLoss with these parameters:
{ "scale": 20.0, "similarity_fct": "cos_sim" }
task1168_brown_coarse_pos_tagging
- Dataset: task1168_brown_coarse_pos_tagging
- Size: 1,018 training samples
- Columns: anchor, positive, and negative
- Approximate statistics based on the first 1000 samples:
anchor positive negative type string string string details min: 13 tokensmean: 43.83 tokensmax: 142 tokens min: 12 tokensmean: 43.44 tokensmax: 197 tokens min: 12 tokensmean: 44.95 tokensmax: 197 tokens - Samples:
- Loss: MultipleNegativesRankingLoss with these parameters:
{ "scale": 20.0, "similarity_fct": "cos_sim" }
task348_squad2.0_unanswerable_question_generation
- Dataset: task348_squad2.0_unanswerable_question_generation
- Size: 1,018 training samples
- Columns: anchor, positive, and negative
- Approximate statistics based on the first 1000 samples:
anchor positive negative type string string string details min: 30 tokensmean: 153.01 tokensmax: 256 tokens min: 38 tokensmean: 161.19 tokensmax: 256 tokens min: 33 tokensmean: 167.06 tokensmax: 256 tokens - Samples:
- Loss: MultipleNegativesRankingLoss with these parameters:
{ "scale": 20.0, "similarity_fct": "cos_sim" }
task049_multirc_questions_needed_to_answer
- Dataset: task049_multirc_questions_needed_to_answer
- Size: 1,018 training samples
- Columns: anchor, positive, and negative
- Approximate statistics based on the first 1000 samples:
anchor positive negative type string string string details min: 174 tokensmean: 252.54 tokensmax: 256 tokens min: 169 tokensmean: 252.57 tokensmax: 256 tokens min: 178 tokensmean: 252.73 tokensmax: 256 tokens - Samples:
- Loss: MultipleNegativesRankingLoss with these parameters:
{ "scale": 20.0, "similarity_fct": "cos_sim" }
task1534_daily_dialog_question_classification
- Dataset: task1534_daily_dialog_question_classification
- Size: 1,018 training samples
- Columns: anchor, positive, and negative
- Approximate statistics based on the first 1000 samples:
anchor positive negative type string string string details min: 17 tokensmean: 125.31 tokensmax: 256 tokens min: 15 tokensmean: 130.35 tokensmax: 256 tokens min: 16 tokensmean: 135.56 tokensmax: 256 tokens - Samples:
- Loss: MultipleNegativesRankingLoss with these parameters:
{ "scale": 20.0, "similarity_fct": "cos_sim" }
task322_jigsaw_classification_threat
- Dataset: task322_jigsaw_classification_threat
- Size: 1,018 training samples
- Columns: anchor, positive, and negative
- Approximate statistics based on the first 1000 samples:
anchor positive negative type string string string details min: 7 tokensmean: 54.84 tokensmax: 256 tokens min: 6 tokensmean: 62.09 tokensmax: 249 tokens min: 6 tokensmean: 62.43 tokensmax: 256 tokens - Samples:
- Loss: MultipleNegativesRankingLoss with these parameters:
{ "scale": 20.0, "similarity_fct": "cos_sim" }
task295_semeval_2020_task4_commonsense_reasoning
- Dataset: task295_semeval_2020_task4_commonsense_reasoning
- Size: 1,018 training samples
- Columns: anchor, positive, and negative
- Approximate statistics based on the first 1000 samples:
anchor positive negative type string string string details min: 25 tokensmean: 44.81 tokensmax: 92 tokens min: 25 tokensmean: 45.07 tokensmax: 95 tokens min: 25 tokensmean: 44.7 tokensmax: 88 tokens - Samples:
- Loss: MultipleNegativesRankingLoss with these parameters:
{ "scale": 20.0, "similarity_fct": "cos_sim" }
task186_snli_contradiction_to_entailment_text_modification
- Dataset: task186_snli_contradiction_to_entailment_text_modification
- Size: 1,018 training samples
- Columns: anchor, positive, and negative
- Approximate statistics based on the first 1000 samples:
anchor positive negative type string string string details min: 18 tokensmean: 31.21 tokensmax: 102 tokens min: 18 tokensmean: 30.13 tokensmax: 65 tokens min: 18 tokensmean: 32.21 tokensmax: 67 tokens - Samples:
- Loss: MultipleNegativesRankingLoss with these parameters:
{ "scale": 20.0, "similarity_fct": "cos_sim" }
task034_winogrande_question_modification_object
- Dataset: task034_winogrande_question_modification_object
- Size: 1,018 training samples
- Columns: anchor, positive, and negative
- Approximate statistics based on the first 1000 samples:
anchor positive negative type string string string details min: 29 tokensmean: 36.36 tokensmax: 53 tokens min: 29 tokensmean: 35.59 tokensmax: 54 tokens min: 29 tokensmean: 34.87 tokensmax: 55 tokens - Samples:
- Loss: MultipleNegativesRankingLoss with these parameters:
{ "scale": 20.0, "similarity_fct": "cos_sim" }
task160_replace_letter_in_a_sentence
- Dataset: task160_replace_letter_in_a_sentence
- Size: 1,018 training samples
- Columns: anchor, positive, and negative
- Approximate statistics based on the first 1000 samples:
anchor positive negative type string string string details min: 29 tokensmean: 31.98 tokensmax: 49 tokens min: 28 tokensmean: 31.78 tokensmax: 41 tokens min: 29 tokensmean: 31.8 tokensmax: 48 tokens - Samples:
- Loss: MultipleNegativesRankingLoss with these parameters:
{ "scale": 20.0, "similarity_fct": "cos_sim" }
task469_mrqa_answer_generation
- Dataset: task469_mrqa_answer_generation
- Size: 1,018 training samples
- Columns: anchor, positive, and negative
- Approximate statistics based on the first 1000 samples:
anchor positive negative type string string string details min: 27 tokensmean: 182.22 tokensmax: 256 tokens min: 25 tokensmean: 180.87 tokensmax: 256 tokens min: 27 tokensmean: 184.07 tokensmax: 256 tokens - Samples:
- Loss: MultipleNegativesRankingLoss with these parameters:
{ "scale": 20.0, "similarity_fct": "cos_sim" }
task105_story_cloze-rocstories_sentence_generation
- Dataset: task105_story_cloze-rocstories_sentence_generation
- Size: 1,018 training samples
- Columns: anchor, positive, and negative
- Approximate statistics based on the first 1000 samples:
anchor positive negative type string string string details min: 36 tokensmean: 55.58 tokensmax: 75 tokens min: 35 tokensmean: 54.96 tokensmax: 76 tokens min: 36 tokensmean: 55.99 tokensmax: 76 tokens - Samples:
- Loss: MultipleNegativesRankingLoss with these parameters:
{ "scale": 20.0, "similarity_fct": "cos_sim" }
task649_race_blank_question_generation
- Dataset: task649_race_blank_question_generation
- Size: 1,018 training samples
- Columns: anchor, positive, and negative
- Approximate statistics based on the first 1000 samples:
anchor positive negative type string string string details min: 36 tokensmean: 253.19 tokensmax: 256 tokens min: 36 tokensmean: 252.56 tokensmax: 256 tokens min: 157 tokensmean: 254.12 tokensmax: 256 tokens - Samples:
- Loss: MultipleNegativesRankingLoss with these parameters:
{ "scale": 20.0, "similarity_fct": "cos_sim" }
task1536_daily_dialog_happiness_classification
- Dataset: task1536_daily_dialog_happiness_classification
- Size: 1,018 training samples
- Columns: anchor, positive, and negative
- Approximate statistics based on the first 1000 samples:
anchor positive negative type string string string details min: 13 tokensmean: 127.06 tokensmax: 256 tokens min: 13 tokensmean: 133.94 tokensmax: 256 tokens min: 16 tokensmean: 142.64 tokensmax: 256 tokens - Samples:
- Loss: MultipleNegativesRankingLoss with these parameters:
{ "scale": 20.0, "similarity_fct": "cos_sim" }
task683_online_privacy_policy_text_purpose_answer_generation
- Dataset: task683_online_privacy_policy_text_purpose_answer_generation
- Size: 1,018 training samples
- Columns: anchor, positive, and negative
- Approximate statistics based on the first 1000 samples:
anchor positive negative type string string string details min: 10 tokensmean: 29.93 tokensmax: 68 tokens min: 10 tokensmean: 30.22 tokensmax: 64 tokens min: 14 tokensmean: 29.85 tokensmax: 68 tokens - Samples:
- Loss: MultipleNegativesRankingLoss with these parameters:
{ "scale": 20.0, "similarity_fct": "cos_sim" }
task024_cosmosqa_answer_generation
- Dataset: task024_cosmosqa_answer_generation
- Size: 1,018 training samples
- Columns: anchor, positive, and negative
- Approximate statistics based on the first 1000 samples:
anchor positive negative type string string string details min: 45 tokensmean: 92.5 tokensmax: 176 tokens min: 47 tokensmean: 93.22 tokensmax: 174 tokens min: 42 tokensmean: 94.89 tokensmax: 183 tokens - Samples:
- Loss: MultipleNegativesRankingLoss with these parameters:
{ "scale": 20.0, "similarity_fct": "cos_sim" }
task584_udeps_eng_fine_pos_tagging
- Dataset: task584_udeps_eng_fine_pos_tagging
- Size: 1,018 training samples
- Columns: anchor, positive, and negative
- Approximate statistics based on the first 1000 samples:
anchor positive negative type string string string details min: 12 tokensmean: 40.13 tokensmax: 120 tokens min: 12 tokensmean: 39.18 tokensmax: 186 tokens min: 12 tokensmean: 40.4 tokensmax: 148 tokens - Samples:
- Loss: MultipleNegativesRankingLoss with these parameters:
{ "scale": 20.0, "similarity_fct": "cos_sim" }
task066_timetravel_binary_consistency_classification
- Dataset: task066_timetravel_binary_consistency_classification
- Size: 1,018 training samples
- Columns: anchor, positive, and negative
- Approximate statistics based on the first 1000 samples:
anchor positive negative type string string string details min: 42 tokensmean: 66.89 tokensmax: 93 tokens min: 43 tokensmean: 67.42 tokensmax: 94 tokens min: 45 tokensmean: 67.0 tokensmax: 92 tokens - Samples:
- Loss: MultipleNegativesRankingLoss with these parameters:
{ "scale": 20.0, "similarity_fct": "cos_sim" }
task413_mickey_en_sentence_perturbation_generation
- Dataset: task413_mickey_en_sentence_perturbation_generation
- Size: 1,018 training samples
- Columns: anchor, positive, and negative
- Approximate statistics based on the first 1000 samples:
anchor positive negative type string string string details min: 7 tokensmean: 13.77 tokensmax: 21 tokens min: 7 tokensmean: 13.82 tokensmax: 21 tokens min: 7 tokensmean: 13.31 tokensmax: 20 tokens - Samples:
- Loss: MultipleNegativesRankingLoss with these parameters:
{ "scale": 20.0, "similarity_fct": "cos_sim" }
task182_duorc_question_generation
- Dataset: task182_duorc_question_generation
- Size: 1,018 training samples
- Columns: anchor, positive, and negative
- Approximate statistics based on the first 1000 samples:
anchor positive negative type string string string details min: 99 tokensmean: 241.8 tokensmax: 256 tokens min: 120 tokensmean: 245.95 tokensmax: 256 tokens min: 99 tokensmean: 246.6 tokensmax: 256 tokens - Samples:
- Loss: MultipleNegativesRankingLoss with these parameters:
{ "scale": 20.0, "similarity_fct": "cos_sim" }
task028_drop_answer_generation
- Dataset: task028_drop_answer_generation
- Size: 1,018 training samples
- Columns: anchor, positive, and negative
- Approximate statistics based on the first 1000 samples:
anchor positive negative type string string string details min: 76 tokensmean: 230.72 tokensmax: 256 tokens min: 86 tokensmean: 234.59 tokensmax: 256 tokens min: 81 tokensmean: 235.71 tokensmax: 256 tokens - Samples:
- Loss: MultipleNegativesRankingLoss with these parameters:
{ "scale": 20.0, "similarity_fct": "cos_sim" }
task1601_webquestions_answer_generation
- Dataset: task1601_webquestions_answer_generation
- Size: 1,018 training samples
- Columns: anchor, positive, and negative
- Approximate statistics based on the first 1000 samples:
anchor positive negative type string string string details min: 9 tokensmean: 16.47 tokensmax: 28 tokens min: 11 tokensmean: 16.67 tokensmax: 28 tokens min: 9 tokensmean: 16.76 tokensmax: 27 tokens - Samples:
- Loss: MultipleNegativesRankingLoss with these parameters:
{ "scale": 20.0, "similarity_fct": "cos_sim" }
task1295_adversarial_qa_question_answering
- Dataset: task1295_adversarial_qa_question_answering
- Size: 1,018 training samples
- Columns: anchor, positive, and negative
- Approximate statistics based on the first 1000 samples:
anchor positive negative type string string string details min: 45 tokensmean: 165.1 tokensmax: 256 tokens min: 54 tokensmean: 167.21 tokensmax: 256 tokens min: 48 tokensmean: 166.49 tokensmax: 256 tokens - Samples:
- Loss: MultipleNegativesRankingLoss with these parameters:
{ "scale": 20.0, "similarity_fct": "cos_sim" }
task201_mnli_neutral_classification
- Dataset: task201_mnli_neutral_classification
- Size: 1,018 training samples
- Columns: anchor, positive, and negative
- Approximate statistics based on the first 1000 samples:
anchor positive negative type string string string details min: 24 tokensmean: 73.0 tokensmax: 218 tokens min: 25 tokensmean: 73.42 tokensmax: 170 tokens min: 27 tokensmean: 72.48 tokensmax: 205 tokens - Samples:
- Loss: MultipleNegativesRankingLoss with these parameters:
{ "scale": 20.0, "similarity_fct": "cos_sim" }
task038_qasc_combined_fact
- Dataset: task038_qasc_combined_fact
- Size: 1,018 training samples
- Columns: anchor, positive, and negative
- Approximate statistics based on the first 1000 samples:
anchor positive negative type string string string details min: 18 tokensmean: 31.3 tokensmax: 57 tokens min: 19 tokensmean: 30.49 tokensmax: 53 tokens min: 18 tokensmean: 30.87 tokensmax: 53 tokens - Samples:
- Loss: MultipleNegativesRankingLoss with these parameters:
{ "scale": 20.0, "similarity_fct": "cos_sim" }
task293_storycommonsense_emotion_text_generation
- Dataset: task293_storycommonsense_emotion_text_generation
- Size: 1,018 training samples
- Columns: anchor, positive, and negative
- Approximate statistics based on the first 1000 samples:
anchor positive negative type string string string details min: 14 tokensmean: 40.74 tokensmax: 86 tokens min: 15 tokensmean: 40.56 tokensmax: 86 tokens min: 14 tokensmean: 38.5 tokensmax: 86 tokens - Samples:
- Loss: MultipleNegativesRankingLoss with these parameters:
{ "scale": 20.0, "similarity_fct": "cos_sim" }
task572_recipe_nlg_text_generation
- Dataset: task572_recipe_nlg_text_generation
- Size: 1,018 training samples
- Columns: anchor, positive, and negative
- Approximate statistics based on the first 1000 samples:
anchor positive negative type string string string details min: 24 tokensmean: 114.82 tokensmax: 256 tokens min: 24 tokensmean: 121.93 tokensmax: 256 tokens min: 24 tokensmean: 124.38 tokensmax: 256 tokens - Samples:
- Loss: MultipleNegativesRankingLoss with these parameters:
{ "scale": 20.0, "similarity_fct": "cos_sim" }
task517_emo_classify_emotion_of_dialogue
- Dataset: task517_emo_classify_emotion_of_dialogue
- Size: 1,018 training samples
- Columns: anchor, positive, and negative
- Approximate statistics based on the first 1000 samples:
anchor positive negative type string string string details min: 7 tokensmean: 18.18 tokensmax: 78 tokens min: 7 tokensmean: 17.03 tokensmax: 59 tokens min: 7 tokensmean: 18.39 tokensmax: 67 tokens - Samples:
- Loss: MultipleNegativesRankingLoss with these parameters:
{ "scale": 20.0, "similarity_fct": "cos_sim" }
task382_hybridqa_answer_generation
- Dataset: task382_hybridqa_answer_generation
- Size: 1,018 training samples
- Columns: anchor, positive, and negative
- Approximate statistics based on the first 1000 samples:
anchor positive negative type string string string details min: 29 tokensmean: 42.34 tokensmax: 70 tokens min: 29 tokensmean: 41.63 tokensmax: 74 tokens min: 28 tokensmean: 41.73 tokensmax: 75 tokens - Samples:
- Loss: MultipleNegativesRankingLoss with these parameters:
{ "scale": 20.0, "similarity_fct": "cos_sim" }
task176_break_decompose_questions
- Dataset: task176_break_decompose_questions
- Size: 1,018 training samples
- Columns: anchor, positive, and negative
- Approximate statistics based on the first 1000 samples:
anchor positive negative type string string string details min: 9 tokensmean: 17.39 tokensmax: 41 tokens min: 8 tokensmean: 17.19 tokensmax: 39 tokens min: 8 tokensmean: 15.71 tokensmax: 38 tokens - Samples:
- Loss: MultipleNegativesRankingLoss with these parameters:
{ "scale": 20.0, "similarity_fct": "cos_sim" }
task1291_multi_news_summarization
- Dataset: task1291_multi_news_summarization
- Size: 1,018 training samples
- Columns: anchor, positive, and negative
- Approximate statistics based on the first 1000 samples:
anchor positive negative type string string string details min: 116 tokensmean: 255.36 tokensmax: 256 tokens min: 146 tokensmean: 255.71 tokensmax: 256 tokens min: 68 tokensmean: 252.09 tokensmax: 256 tokens - Samples:
- Loss: MultipleNegativesRankingLoss with these parameters:
{ "scale": 20.0, "similarity_fct": "cos_sim" }
task155_count_nouns_verbs
- Dataset: task155_count_nouns_verbs
- Size: 1,018 training samples
- Columns: anchor, positive, and negative
- Approximate statistics based on the first 1000 samples:
anchor positive negative type string string string details min: 23 tokensmean: 27.03 tokensmax: 56 tokens min: 23 tokensmean: 26.8 tokensmax: 43 tokens min: 23 tokensmean: 26.94 tokensmax: 46 tokens - Samples:
- Loss: MultipleNegativesRankingLoss with these parameters:
{ "scale": 20.0, "similarity_fct": "cos_sim" }
task031_winogrande_question_generation_object
- Dataset: task031_winogrande_question_generation_object
- Size: 1,018 training samples
- Columns: anchor, positive, and negative
- Approximate statistics based on the first 1000 samples:
anchor positive negative type string string string details min: 7 tokensmean: 7.42 tokensmax: 11 tokens min: 7 tokensmean: 7.31 tokensmax: 11 tokens min: 7 tokensmean: 7.27 tokensmax: 11 tokens - Samples:
- Loss: MultipleNegativesRankingLoss with these parameters:
{ "scale": 20.0, "similarity_fct": "cos_sim" }
task279_stereoset_classification_stereotype
- Dataset: task279_stereoset_classification_stereotype
- Size: 1,018 training samples
- Columns: anchor, positive, and negative
- Approximate statistics based on the first 1000 samples:
anchor positive negative type string string string details min: 8 tokensmean: 17.91 tokensmax: 41 tokens min: 8 tokensmean: 15.43 tokensmax: 43 tokens min: 8 tokensmean: 17.2 tokensmax: 50 tokens - Samples:
- Loss: MultipleNegativesRankingLoss with these parameters:
{ "scale": 20.0, "similarity_fct": "cos_sim" }
task1336_peixian_equity_evaluation_corpus_gender_classifier
- Dataset: task1336_peixian_equity_evaluation_corpus_gender_classifier
- Size: 1,018 training samples
- Columns: anchor, positive, and negative
- Approximate statistics based on the first 1000 samples:
anchor positive negative type string string string details min: 6 tokensmean: 9.62 tokensmax: 17 tokens min: 6 tokensmean: 9.6 tokensmax: 16 tokens min: 6 tokensmean: 9.69 tokensmax: 16 tokens - Samples:
- Loss: MultipleNegativesRankingLoss with these parameters:
{ "scale": 20.0, "similarity_fct": "cos_sim" }
task508_scruples_dilemmas_more_ethical_isidentifiable
- Dataset: task508_scruples_dilemmas_more_ethical_isidentifiable
- Size: 1,018 training samples
- Columns: anchor, positive, and negative
- Approximate statistics based on the first 1000 samples:
anchor positive negative type string string string details min: 12 tokensmean: 29.63 tokensmax: 94 tokens min: 12 tokensmean: 28.69 tokensmax: 94 tokens min: 12 tokensmean: 28.59 tokensmax: 86 tokens - Samples:
- Loss: MultipleNegativesRankingLoss with these parameters:
{ "scale": 20.0, "similarity_fct": "cos_sim" }
task518_emo_different_dialogue_emotions
- Dataset: task518_emo_different_dialogue_emotions
- Size: 1,018 training samples
- Columns: anchor, positive, and negative
- Approximate statistics based on the first 1000 samples:
anchor positive negative type string string string details min: 28 tokensmean: 47.83 tokensmax: 106 tokens min: 28 tokensmean: 45.51 tokensmax: 116 tokens min: 26 tokensmean: 45.81 tokensmax: 123 tokens - Samples:
- Loss: MultipleNegativesRankingLoss with these parameters:
{ "scale": 20.0, "similarity_fct": "cos_sim" }
task077_splash_explanation_to_sql
- Dataset: task077_splash_explanation_to_sql
- Size: 1,018 training samples
- Columns: anchor, positive, and negative
- Approximate statistics based on the first 1000 samples:
anchor positive negative type string string string details min: 8 tokensmean: 39.82 tokensmax: 126 tokens min: 8 tokensmean: 39.88 tokensmax: 126 tokens min: 8 tokensmean: 35.83 tokensmax: 111 tokens - Samples:
- Loss: MultipleNegativesRankingLoss with these parameters:
{ "scale": 20.0, "similarity_fct": "cos_sim" }
task923_event2mind_classifier
- Dataset: task923_event2mind_classifier
- Size: 1,018 training samples
- Columns: anchor, positive, and negative
- Approximate statistics based on the first 1000 samples:
anchor positive negative type string string string details min: 10 tokensmean: 20.61 tokensmax: 46 tokens min: 11 tokensmean: 18.62 tokensmax: 41 tokens min: 11 tokensmean: 19.51 tokensmax: 46 tokens - Samples:
- Loss: MultipleNegativesRankingLoss with these parameters:
{ "scale": 20.0, "similarity_fct": "cos_sim" }
task470_mrqa_question_generation
- Dataset: task470_mrqa_question_generation
- Size: 1,018 training samples
- Columns: anchor, positive, and negative
- Approximate statistics based on the first 1000 samples:
anchor positive negative type string string string details min: 13 tokensmean: 172.18 tokensmax: 256 tokens min: 11 tokensmean: 175.43 tokensmax: 256 tokens min: 14 tokensmean: 180.36 tokensmax: 256 tokens - Samples:
- Loss: MultipleNegativesRankingLoss with these parameters:
{ "scale": 20.0, "similarity_fct": "cos_sim" }
task638_multi_woz_classification
- Dataset: task638_multi_woz_classification
- Size: 1,018 training samples
- Columns: anchor, positive, and negative
- Approximate statistics based on the first 1000 samples:
anchor positive negative type string string string details min: 78 tokensmean: 223.56 tokensmax: 256 tokens min: 76 tokensmean: 220.51 tokensmax: 256 tokens min: 64 tokensmean: 220.0 tokensmax: 256 tokens - Samples:
- Loss: MultipleNegativesRankingLoss with these parameters:
{ "scale": 20.0, "similarity_fct": "cos_sim" }
task1412_web_questions_question_answering
- Dataset: task1412_web_questions_question_answering
- Size: 1,018 training samples
- Columns: anchor, positive, and negative
- Approximate statistics based on the first 1000 samples:
anchor positive negative type string string string details min: 6 tokensmean: 10.33 tokensmax: 17 tokens min: 6 tokensmean: 10.18 tokensmax: 17 tokens min: 6 tokensmean: 10.08 tokensmax: 16 tokens - Samples:
- Loss: MultipleNegativesRankingLoss with these parameters:
{ "scale": 20.0, "similarity_fct": "cos_sim" }
task847_pubmedqa_question_generation
- Dataset: task847_pubmedqa_question_generation
- Size: 1,018 training samples
- Columns: anchor, positive, and negative
- Approximate statistics based on the first 1000 samples:
anchor positive negative type string string string details min: 21 tokensmean: 248.66 tokensmax: 256 tokens min: 21 tokensmean: 248.78 tokensmax: 256 tokens min: 43 tokensmean: 249.11 tokensmax: 256 tokens - Samples:
- Loss: MultipleNegativesRankingLoss with these parameters:
{ "scale": 20.0, "similarity_fct": "cos_sim" }
task678_ollie_actual_relationship_answer_generation
- Dataset: task678_ollie_actual_relationship_answer_generation
- Size: 1,018 training samples
- Columns: anchor, positive, and negative
- Approximate statistics based on the first 1000 samples:
anchor positive negative type string string string details min: 20 tokensmean: 41.01 tokensmax: 95 tokens min: 19 tokensmean: 37.95 tokensmax: 102 tokens min: 18 tokensmean: 41.14 tokensmax: 104 tokens - Samples:
- Loss: MultipleNegativesRankingLoss with these parameters:
{ "scale": 20.0, "similarity_fct": "cos_sim" }
task290_tellmewhy_question_answerability
- Dataset: task290_tellmewhy_question_answerability
- Size: 1,018 training samples
- Columns: anchor, positive, and negative
- Approximate statistics based on the first 1000 samples:
anchor positive negative type string string string details min: 37 tokensmean: 63.19 tokensmax: 95 tokens min: 36 tokensmean: 62.66 tokensmax: 94 tokens min: 37 tokensmean: 63.44 tokensmax: 95 tokens - Samples:
- Loss: MultipleNegativesRankingLoss with these parameters:
{ "scale": 20.0, "similarity_fct": "cos_sim" }
task575_air_dialogue_classification
- Dataset: task575_air_dialogue_classification
- Size: 1,018 training samples
- Columns: anchor, positive, and negative
- Approximate statistics based on the first 1000 samples:
anchor positive negative type string string string details min: 4 tokensmean: 14.16 tokensmax: 45 tokens min: 4 tokensmean: 13.55 tokensmax: 43 tokens min: 4 tokensmean: 12.3 tokensmax: 42 tokens - Samples:
- Loss: MultipleNegativesRankingLoss with these parameters:
{ "scale": 20.0, "similarity_fct": "cos_sim" }
task189_snli_neutral_to_contradiction_text_modification
- Dataset: task189_snli_neutral_to_contradiction_text_modification
- Size: 1,018 training samples
- Columns: anchor, positive, and negative
- Approximate statistics based on the first 1000 samples:
anchor positive negative type string string string details min: 18 tokensmean: 31.82 tokensmax: 60 tokens min: 18 tokensmean: 30.75 tokensmax: 57 tokens min: 18 tokensmean: 33.25 tokensmax: 105 tokens - Samples:
- Loss: MultipleNegativesRankingLoss with these parameters:
{ "scale": 20.0, "similarity_fct": "cos_sim" }
task026_drop_question_generation
- Dataset: task026_drop_question_generation
- Size: 1,018 training samples
- Columns: anchor, positive, and negative
- Approximate statistics based on the first 1000 samples:
anchor positive negative type string string string details min: 82 tokensmean: 219.39 tokensmax: 256 tokens min: 57 tokensmean: 222.63 tokensmax: 256 tokens min: 96 tokensmean: 232.08 tokensmax: 256 tokens - Samples:
- Loss: MultipleNegativesRankingLoss with these parameters:
{ "scale": 20.0, "similarity_fct": "cos_sim" }
task162_count_words_starting_with_letter
- Dataset: task162_count_words_starting_with_letter
- Size: 1,018 training samples
- Columns: anchor, positive, and negative
- Approximate statistics based on the first 1000 samples:
anchor positive negative type string string string details min: 28 tokensmean: 32.21 tokensmax: 56 tokens min: 28 tokensmean: 31.77 tokensmax: 45 tokens min: 28 tokensmean: 31.64 tokensmax: 46 tokens - Samples:
- Loss: MultipleNegativesRankingLoss with these parameters:
{ "scale": 20.0, "similarity_fct": "cos_sim" }
task079_conala_concat_strings
- Dataset: task079_conala_concat_strings
- Size: 1,018 training samples
- Columns: anchor, positive, and negative
- Approximate statistics based on the first 1000 samples:
anchor positive negative type string string string details min: 11 tokensmean: 39.62 tokensmax: 76 tokens min: 11 tokensmean: 34.2 tokensmax: 80 tokens min: 11 tokensmean: 33.53 tokensmax: 76 tokens - Samples:
- Loss: MultipleNegativesRankingLoss with these parameters:
{ "scale": 20.0, "similarity_fct": "cos_sim" }
task610_conllpp_ner
- Dataset: task610_conllpp_ner
- Size: 1,018 training samples
- Columns: anchor, positive, and negative
- Approximate statistics based on the first 1000 samples:
anchor positive negative type string string string details min: 4 tokensmean: 19.55 tokensmax: 62 tokens min: 4 tokensmean: 20.27 tokensmax: 62 tokens min: 4 tokensmean: 14.12 tokensmax: 54 tokens - Samples:
- Loss: MultipleNegativesRankingLoss with these parameters:
{ "scale": 20.0, "similarity_fct": "cos_sim" }
task046_miscellaneous_question_typing
- Dataset: task046_miscellaneous_question_typing
- Size: 1,018 training samples
- Columns: anchor, positive, and negative
- Approximate statistics based on the first 1000 samples:
anchor positive negative type string string string details min: 16 tokensmean: 25.41 tokensmax: 70 tokens min: 16 tokensmean: 24.94 tokensmax: 70 tokens min: 16 tokensmean: 25.13 tokensmax: 57 tokens - Samples:
- Loss: MultipleNegativesRankingLoss with these parameters:
{ "scale": 20.0, "similarity_fct": "cos_sim" }
task197_mnli_domain_answer_generation
- Dataset: task197_mnli_domain_answer_generation
- Size: 1,018 training samples
- Columns: anchor, positive, and negative
- Approximate statistics based on the first 1000 samples:
anchor positive negative type string string string details min: 15 tokensmean: 44.09 tokensmax: 197 tokens min: 12 tokensmean: 44.97 tokensmax: 211 tokens min: 11 tokensmean: 39.22 tokensmax: 115 tokens - Samples:
- Loss: MultipleNegativesRankingLoss with these parameters:
{ "scale": 20.0, "similarity_fct": "cos_sim" }
task1325_qa_zre_question_generation_on_subject_relation
- Dataset: task1325_qa_zre_question_generation_on_subject_relation
- Size: 1,018 training samples
- Columns: anchor, positive, and negative
- Approximate statistics based on the first 1000 samples:
anchor positive negative type string string string details min: 18 tokensmean: 51.02 tokensmax: 256 tokens min: 20 tokensmean: 49.57 tokensmax: 180 tokens min: 22 tokensmean: 54.59 tokensmax: 256 tokens - Samples:
- Loss: MultipleNegativesRankingLoss with these parameters:
{ "scale": 20.0, "similarity_fct": "cos_sim" }
task430_senteval_subject_count
- Dataset: task430_senteval_subject_count
- Size: 1,018 training samples
- Columns: anchor, positive, and negative
- Approximate statistics based on the first 1000 samples:
anchor positive negative type string string string details min: 7 tokensmean: 17.14 tokensmax: 35 tokens min: 7 tokensmean: 15.31 tokensmax: 34 tokens min: 7 tokensmean: 16.13 tokensmax: 34 tokens - Samples:
- Loss: MultipleNegativesRankingLoss with these parameters:
{ "scale": 20.0, "similarity_fct": "cos_sim" }
task672_nummersense
- Dataset: task672_nummersense
- Size: 1,018 training samples
- Columns: anchor, positive, and negative
- Approximate statistics based on the first 1000 samples:
anchor positive negative type string string string details min: 7 tokensmean: 15.72 tokensmax: 30 tokens min: 7 tokensmean: 15.33 tokensmax: 27 tokens min: 7 tokensmean: 15.21 tokensmax: 30 tokens - Samples:
- Loss: MultipleNegativesRankingLoss with these parameters:
{ "scale": 20.0, "similarity_fct": "cos_sim" }
task402_grailqa_paraphrase_generation
- Dataset: task402_grailqa_paraphrase_generation
- Size: 1,018 training samples
- Columns: anchor, positive, and negative
- Approximate statistics based on the first 1000 samples:
anchor positive negative type string string string details min: 23 tokensmean: 127.55 tokensmax: 256 tokens min: 24 tokensmean: 139.34 tokensmax: 256 tokens min: 22 tokensmean: 133.69 tokensmax: 256 tokens - Samples:
- Loss: MultipleNegativesRankingLoss with these parameters:
{ "scale": 20.0, "similarity_fct": "cos_sim" }
task904_hate_speech_offensive_classification
- Dataset: task904_hate_speech_offensive_classification
- Size: 1,018 training samples
- Columns: anchor, positive, and negative
- Approximate statistics based on the first 1000 samples:
anchor positive negative type string string string details min: 8 tokensmean: 35.03 tokensmax: 157 tokens min: 8 tokensmean: 34.67 tokensmax: 256 tokens min: 5 tokensmean: 27.84 tokensmax: 148 tokens - Samples:
- Loss: MultipleNegativesRankingLoss with these parameters:
{ "scale": 20.0, "similarity_fct": "cos_sim" }
task192_hotpotqa_sentence_generation
- Dataset: task192_hotpotqa_sentence_generation
- Size: 1,018 training samples
- Columns: anchor, positive, and negative
- Approximate statistics based on the first 1000 samples:
anchor positive negative type string string string details min: 37 tokensmean: 125.55 tokensmax: 256 tokens min: 35 tokensmean: 123.85 tokensmax: 256 tokens min: 33 tokensmean: 134.16 tokensmax: 256 tokens - Samples:
- Loss: MultipleNegativesRankingLoss with these parameters:
{ "scale": 20.0, "similarity_fct": "cos_sim" }
task069_abductivenli_classification
- Dataset: task069_abductivenli_classification
- Size: 1,018 training samples
- Columns: anchor, positive, and negative
- Approximate statistics based on the first 1000 samples:
anchor positive negative type string string string details min: 33 tokensmean: 52.09 tokensmax: 86 tokens min: 33 tokensmean: 52.16 tokensmax: 95 tokens min: 33 tokensmean: 51.84 tokensmax: 95 tokens - Samples:
- Loss: MultipleNegativesRankingLoss with these parameters:
{ "scale": 20.0, "similarity_fct": "cos_sim" }
task574_air_dialogue_sentence_generation
- Dataset: task574_air_dialogue_sentence_generation
- Size: 1,018 training samples
- Columns: anchor, positive, and negative
- Approximate statistics based on the first 1000 samples:
anchor positive negative type string string string details min: 54 tokensmean: 143.98 tokensmax: 256 tokens min: 57 tokensmean: 143.52 tokensmax: 256 tokens min: 66 tokensmean: 147.45 tokensmax: 256 tokens - Samples:
- Loss: MultipleNegativesRankingLoss with these parameters:
{ "scale": 20.0, "similarity_fct": "cos_sim" }
task187_snli_entailment_to_contradiction_text_modification
- Dataset: task187_snli_entailment_to_contradiction_text_modification
- Size: 1,018 training samples
- Columns: anchor, positive, and negative
- Approximate statistics based on the first 1000 samples:
anchor positive negative type string string string details min: 16 tokensmean: 30.23 tokensmax: 69 tokens min: 16 tokensmean: 29.82 tokensmax: 104 tokens min: 17 tokensmean: 29.44 tokensmax: 71 tokens - Samples:
- Loss: MultipleNegativesRankingLoss with these parameters:
{ "scale": 20.0, "similarity_fct": "cos_sim" }
task749_glucose_reverse_cause_emotion_detection
- Dataset: task749_glucose_reverse_cause_emotion_detection
- Size: 1,018 training samples
- Columns: anchor, positive, and negative
- Approximate statistics based on the first 1000 samples:
anchor positive negative type string string string details min: 38 tokensmean: 67.61 tokensmax: 106 tokens min: 37 tokensmean: 67.14 tokensmax: 104 tokens min: 39 tokensmean: 68.46 tokensmax: 107 tokens - Samples:
- Loss: MultipleNegativesRankingLoss with these parameters:
{ "scale": 20.0, "similarity_fct": "cos_sim" }
task1552_scitail_question_generation
- Dataset: task1552_scitail_question_generation
- Size: 1,018 training samples
- Columns: anchor, positive, and negative
- Approximate statistics based on the first 1000 samples:
anchor positive negative type string string string details min: 7 tokensmean: 18.37 tokensmax: 53 tokens min: 7 tokensmean: 17.55 tokensmax: 46 tokens min: 7 tokensmean: 15.88 tokensmax: 54 tokens - Samples:
- Loss: MultipleNegativesRankingLoss with these parameters:
{ "scale": 20.0, "similarity_fct": "cos_sim" }
task750_aqua_multiple_choice_answering
- Dataset: task750_aqua_multiple_choice_answering
- Size: 1,018 training samples
- Columns: anchor, positive, and negative
- Approximate statistics based on the first 1000 samples:
anchor positive negative type string string string details min: 33 tokensmean: 69.62 tokensmax: 194 tokens min: 32 tokensmean: 67.98 tokensmax: 194 tokens min: 28 tokensmean: 67.81 tokensmax: 165 tokens - Samples:
- Loss: MultipleNegativesRankingLoss with these parameters:
{ "scale": 20.0, "similarity_fct": "cos_sim" }
task327_jigsaw_classification_toxic
- Dataset: task327_jigsaw_classification_toxic
- Size: 1,018 training samples
- Columns: anchor, positive, and negative
- Approximate statistics based on the first 1000 samples:
anchor positive negative type string string string details min: 5 tokensmean: 36.8 tokensmax: 234 tokens min: 5 tokensmean: 40.85 tokensmax: 256 tokens min: 5 tokensmean: 45.53 tokensmax: 244 tokens - Samples:
- Loss: MultipleNegativesRankingLoss with these parameters:
{ "scale": 20.0, "similarity_fct": "cos_sim" }
task1502_hatexplain_classification
- Dataset: task1502_hatexplain_classification
- Size: 1,018 training samples
- Columns: anchor, positive, and negative
- Approximate statistics based on the first 1000 samples:
anchor positive negative type string string string details min: 5 tokensmean: 28.69 tokensmax: 73 tokens min: 5 tokensmean: 26.7 tokensmax: 110 tokens min: 5 tokensmean: 26.92 tokensmax: 90 tokens - Samples:
- Loss: MultipleNegativesRankingLoss with these parameters:
{ "scale": 20.0, "similarity_fct": "cos_sim" }
task328_jigsaw_classification_insult
- Dataset: task328_jigsaw_classification_insult
- Size: 1,018 training samples
- Columns: anchor, positive, and negative
- Approximate statistics based on the first 1000 samples:
anchor positive negative type string string string details min: 5 tokensmean: 51.02 tokensmax: 247 tokens min: 5 tokensmean: 60.56 tokensmax: 256 tokens min: 5 tokensmean: 64.19 tokensmax: 249 tokens - Samples:
- Loss: MultipleNegativesRankingLoss with these parameters:
{ "scale": 20.0, "similarity_fct": "cos_sim" }
task304_numeric_fused_head_resolution
- Dataset: task304_numeric_fused_head_resolution
- Size: 1,018 training samples
- Columns: anchor, positive, and negative
- Approximate statistics based on the first 1000 samples:
anchor positive negative type string string string details min: 15 tokensmean: 120.75 tokensmax: 256 tokens min: 12 tokensmean: 122.1 tokensmax: 256 tokens min: 11 tokensmean: 134.06 tokensmax: 256 tokens - Samples:
- Loss: MultipleNegativesRankingLoss with these parameters:
{ "scale": 20.0, "similarity_fct": "cos_sim" }
task1293_kilt_tasks_hotpotqa_question_answering
- Dataset: task1293_kilt_tasks_hotpotqa_question_answering
- Size: 1,018 training samples
- Columns: anchor, positive, and negative
- Approximate statistics based on the first 1000 samples:
anchor positive negative type string string string details min: 10 tokensmean: 24.78 tokensmax: 114 tokens min: 9 tokensmean: 24.2 tokensmax: 114 tokens min: 8 tokensmean: 23.85 tokensmax: 84 tokens - Samples:
- Loss: MultipleNegativesRankingLoss with these parameters:
{ "scale": 20.0, "similarity_fct": "cos_sim" }
task216_rocstories_correct_answer_generation
- Dataset: task216_rocstories_correct_answer_generation
- Size: 1,018 training samples
- Columns: anchor, positive, and negative
- Approximate statistics based on the first 1000 samples:
anchor positive negative type string string string details min: 39 tokensmean: 59.5 tokensmax: 83 tokens min: 36 tokensmean: 58.38 tokensmax: 92 tokens min: 39 tokensmean: 58.22 tokensmax: 95 tokens - Samples:
- Loss: MultipleNegativesRankingLoss with these parameters:
{ "scale": 20.0, "similarity_fct": "cos_sim" }
task1326_qa_zre_question_generation_from_answer
- Dataset: task1326_qa_zre_question_generation_from_answer
- Size: 1,018 training samples
- Columns: anchor, positive, and negative
- Approximate statistics based on the first 1000 samples:
anchor positive negative type string string string details min: 17 tokensmean: 46.37 tokensmax: 256 tokens min: 14 tokensmean: 45.05 tokensmax: 256 tokens min: 18 tokensmean: 49.47 tokensmax: 256 tokens - Samples:
- Loss: MultipleNegativesRankingLoss with these parameters:
{ "scale": 20.0, "similarity_fct": "cos_sim" }
task1338_peixian_equity_evaluation_corpus_sentiment_classifier
- Dataset: task1338_peixian_equity_evaluation_corpus_sentiment_classifier
- Size: 1,018 training samples
- Columns: anchor, positive, and negative
- Approximate statistics based on the first 1000 samples:
anchor positive negative type string string string details min: 6 tokensmean: 9.68 tokensmax: 16 tokens min: 6 tokensmean: 9.71 tokensmax: 16 tokens min: 6 tokensmean: 9.57 tokensmax: 17 tokens - Samples:
- Loss: MultipleNegativesRankingLoss with these parameters:
{ "scale": 20.0, "similarity_fct": "cos_sim" }
task1729_personachat_generate_next
- Dataset: task1729_personachat_generate_next
- Size: 1,018 training samples
- Columns: anchor, positive, and negative
- Approximate statistics based on the first 1000 samples:
anchor positive negative type string string string details min: 44 tokensmean: 146.46 tokensmax: 256 tokens min: 43 tokensmean: 142.09 tokensmax: 256 tokens min: 50 tokensmean: 144.22 tokensmax: 256 tokens - Samples:
- Loss: MultipleNegativesRankingLoss with these parameters:
{ "scale": 20.0, "similarity_fct": "cos_sim" }
task1202_atomic_classification_xneed
- Dataset: task1202_atomic_classification_xneed
- Size: 1,018 training samples
- Columns: anchor, positive, and negative
- Approximate statistics based on the first 1000 samples:
anchor positive negative type string string string details min: 14 tokensmean: 19.55 tokensmax: 32 tokens min: 14 tokensmean: 19.39 tokensmax: 31 tokens min: 14 tokensmean: 19.22 tokensmax: 28 tokens - Samples:
- Loss: MultipleNegativesRankingLoss with these parameters:
{ "scale": 20.0, "similarity_fct": "cos_sim" }
task400_paws_paraphrase_classification
- Dataset: task400_paws_paraphrase_classification
- Size: 1,018 training samples
- Columns: anchor, positive, and negative
- Approximate statistics based on the first 1000 samples:
anchor positive negative type string string string details min: 19 tokensmean: 52.28 tokensmax: 97 tokens min: 18 tokensmean: 51.88 tokensmax: 98 tokens min: 19 tokensmean: 53.03 tokensmax: 97 tokens - Samples:
- Loss: MultipleNegativesRankingLoss with these parameters:
{ "scale": 20.0, "similarity_fct": "cos_sim" }
task502_scruples_anecdotes_whoiswrong_verification
- Dataset: task502_scruples_anecdotes_whoiswrong_verification
- Size: 1,018 training samples
- Columns: anchor, positive, and negative
- Approximate statistics based on the first 1000 samples:
anchor positive negative type string string string details min: 12 tokensmean: 229.76 tokensmax: 256 tokens min: 12 tokensmean: 236.43 tokensmax: 256 tokens min: 23 tokensmean: 235.02 tokensmax: 256 tokens - Samples:
- Loss: MultipleNegativesRankingLoss with these parameters:
{ "scale": 20.0, "similarity_fct": "cos_sim" }
task088_identify_typo_verification
- Dataset: task088_identify_typo_verification
- Size: 1,018 training samples
- Columns: anchor, positive, and negative
- Approximate statistics based on the first 1000 samples:
anchor positive negative type string string string details min: 11 tokensmean: 15.08 tokensmax: 48 tokens min: 10 tokensmean: 15.05 tokensmax: 47 tokens min: 10 tokensmean: 15.39 tokensmax: 47 tokens - Samples:
- Loss: MultipleNegativesRankingLoss with these parameters:
{ "scale": 20.0, "similarity_fct": "cos_sim" }
task221_rocstories_two_choice_classification
- Dataset: task221_rocstories_two_choice_classification
- Size: 1,018 training samples
- Columns: anchor, positive, and negative
- Approximate statistics based on the first 1000 samples:
anchor positive negative type string string string details min: 47 tokensmean: 72.64 tokensmax: 108 tokens min: 48 tokensmean: 72.66 tokensmax: 109 tokens min: 46 tokensmean: 73.26 tokensmax: 108 tokens - Samples:
- Loss: MultipleNegativesRankingLoss with these parameters:
{ "scale": 20.0, "similarity_fct": "cos_sim" }
task200_mnli_entailment_classification
- Dataset: task200_mnli_entailment_classification
- Size: 1,018 training samples
- Columns: anchor, positive, and negative
- Approximate statistics based on the first 1000 samples:
anchor positive negative type string string string details min: 24 tokensmean: 72.63 tokensmax: 198 tokens min: 23 tokensmean: 72.69 tokensmax: 224 tokens min: 23 tokensmean: 73.44 tokensmax: 226 tokens - Samples:
- Loss: MultipleNegativesRankingLoss with these parameters:
{ "scale": 20.0, "similarity_fct": "cos_sim" }
task074_squad1.1_question_generation
- Dataset: task074_squad1.1_question_generation
- Size: 1,018 training samples
- Columns: anchor, positive, and negative
- Approximate statistics based on the first 1000 samples:
anchor positive negative type string string string details min: 30 tokensmean: 150.23 tokensmax: 256 tokens min: 33 tokensmean: 160.48 tokensmax: 256 tokens min: 38 tokensmean: 164.59 tokensmax: 256 tokens - Samples:
- Loss: MultipleNegativesRankingLoss with these parameters:
{ "scale": 20.0, "similarity_fct": "cos_sim" }
task581_socialiqa_question_generation
- Dataset: task581_socialiqa_question_generation
- Size: 1,018 training samples
- Columns: anchor, positive, and negative
- Approximate statistics based on the first 1000 samples:
anchor positive negative type string string string details min: 12 tokensmean: 26.52 tokensmax: 69 tokens min: 14 tokensmean: 25.55 tokensmax: 48 tokens min: 15 tokensmean: 25.85 tokensmax: 48 tokens - Samples:
- Loss: MultipleNegativesRankingLoss with these parameters:
{ "scale": 20.0, "similarity_fct": "cos_sim" }
task1186_nne_hrngo_classification
- Dataset: task1186_nne_hrngo_classification
- Size: 1,018 training samples
- Columns: anchor, positive, and negative
- Approximate statistics based on the first 1000 samples:
anchor positive negative type string string string details min: 19 tokensmean: 33.82 tokensmax: 79 tokens min: 19 tokensmean: 33.49 tokensmax: 74 tokens min: 20 tokensmean: 33.34 tokensmax: 77 tokens - Samples:
- Loss: MultipleNegativesRankingLoss with these parameters:
{ "scale": 20.0, "similarity_fct": "cos_sim" }
task898_freebase_qa_answer_generation
- Dataset: task898_freebase_qa_answer_generation
- Size: 1,018 training samples
- Columns: anchor, positive, and negative
- Approximate statistics based on the first 1000 samples:
anchor positive negative type string string string details min: 8 tokensmean: 19.18 tokensmax: 125 tokens min: 8 tokensmean: 17.45 tokensmax: 49 tokens min: 8 tokensmean: 17.48 tokensmax: 79 tokens - Samples:
- Loss: MultipleNegativesRankingLoss with these parameters:
{ "scale": 20.0, "similarity_fct": "cos_sim" }
task1408_dart_similarity_classification
- Dataset: task1408_dart_similarity_classification
- Size: 1,018 training samples
- Columns: anchor, positive, and negative
- Approximate statistics based on the first 1000 samples:
anchor positive negative type string string string details min: 22 tokensmean: 59.48 tokensmax: 147 tokens min: 22 tokensmean: 61.95 tokensmax: 154 tokens min: 20 tokensmean: 48.32 tokensmax: 124 tokens - Samples:
- Loss: MultipleNegativesRankingLoss with these parameters:
{ "scale": 20.0, "similarity_fct": "cos_sim" }
task168_strategyqa_question_decomposition
- Dataset: task168_strategyqa_question_decomposition
- Size: 1,018 training samples
- Columns: anchor, positive, and negative
- Approximate statistics based on the first 1000 samples:
anchor positive negative type string string string details min: 42 tokensmean: 81.83 tokensmax: 181 tokens min: 42 tokensmean: 79.75 tokensmax: 179 tokens min: 42 tokensmean: 77.43 tokensmax: 166 tokens - Samples:
- Loss: MultipleNegativesRankingLoss with these parameters:
{ "scale": 20.0, "similarity_fct": "cos_sim" }
task1357_xlsum_summary_generation
- Dataset: task1357_xlsum_summary_generation
- Size: 1,018 training samples
- Columns: anchor, positive, and negative
- Approximate statistics based on the first 1000 samples:
anchor positive negative type string string string details min: 67 tokensmean: 242.04 tokensmax: 256 tokens min: 76 tokensmean: 243.28 tokensmax: 256 tokens min: 67 tokensmean: 247.07 tokensmax: 256 tokens - Samples:
- Loss: MultipleNegativesRankingLoss with these parameters:
{ "scale": 20.0, "similarity_fct": "cos_sim" }
task390_torque_text_span_selection
- Dataset: task390_torque_text_span_selection
- Size: 1,018 training samples
- Columns: anchor, positive, and negative
- Approximate statistics based on the first 1000 samples:
anchor positive negative type string string string details min: 47 tokensmean: 110.04 tokensmax: 196 tokens min: 42 tokensmean: 110.49 tokensmax: 195 tokens min: 48 tokensmean: 110.67 tokensmax: 196 tokens - Samples:
- Loss: MultipleNegativesRankingLoss with these parameters:
{ "scale": 20.0, "similarity_fct": "cos_sim" }
task165_mcscript_question_answering_commonsense
- Dataset: task165_mcscript_question_answering_commonsense
- Size: 1,018 training samples
- Columns: anchor, positive, and negative
- Approximate statistics based on the first 1000 samples:
anchor positive negative type string string string details min: 147 tokensmean: 198.24 tokensmax: 256 tokens min: 145 tokensmean: 196.67 tokensmax: 256 tokens min: 147 tokensmean: 198.41 tokensmax: 256 tokens - Samples:
- Loss: MultipleNegativesRankingLoss with these parameters:
{ "scale": 20.0, "similarity_fct": "cos_sim" }
task1533_daily_dialog_formal_classification
- Dataset: task1533_daily_dialog_formal_classification
- Size: 1,018 training samples
- Columns: anchor, positive, and negative
- Approximate statistics based on the first 1000 samples:
anchor positive negative type string string string details min: 13 tokensmean: 129.55 tokensmax: 256 tokens min: 15 tokensmean: 136.75 tokensmax: 256 tokens min: 17 tokensmean: 137.33 tokensmax: 256 tokens - Samples:
- Loss: MultipleNegativesRankingLoss with these parameters:
{ "scale": 20.0, "similarity_fct": "cos_sim" }
task002_quoref_answer_generation
- Dataset: task002_quoref_answer_generation
- Size: 1,018 training samples
- Columns: anchor, positive, and negative
- Approximate statistics based on the first 1000 samples:
anchor positive negative type string string string details min: 214 tokensmean: 255.54 tokensmax: 256 tokens min: 214 tokensmean: 255.53 tokensmax: 256 tokens min: 224 tokensmean: 255.61 tokensmax: 256 tokens - Samples:
- Loss: MultipleNegativesRankingLoss with these parameters:
{ "scale": 20.0, "similarity_fct": "cos_sim" }
task1297_qasc_question_answering
- Dataset: task1297_qasc_question_answering
- Size: 1,018 training samples
- Columns: anchor, positive, and negative
- Approximate statistics based on the first 1000 samples:
anchor positive negative type string string string details min: 61 tokensmean: 84.69 tokensmax: 134 tokens min: 59 tokensmean: 85.39 tokensmax: 130 tokens min: 58 tokensmean: 84.83 tokensmax: 125 tokens - Samples:
- Loss: MultipleNegativesRankingLoss with these parameters:
{ "scale": 20.0, "similarity_fct": "cos_sim" }
task305_jeopardy_answer_generation_normal
- Dataset: task305_jeopardy_answer_generation_normal
- Size: 1,018 training samples
- Columns: anchor, positive, and negative
- Approximate statistics based on the first 1000 samples:
anchor positive negative type string string string details min: 9 tokensmean: 27.72 tokensmax: 59 tokens min: 9 tokensmean: 27.43 tokensmax: 45 tokens min: 11 tokensmean: 27.37 tokensmax: 46 tokens - Samples:
- Loss: MultipleNegativesRankingLoss with these parameters:
{ "scale": 20.0, "similarity_fct": "cos_sim" }
task029_winogrande_full_object
- Dataset: task029_winogrande_full_object
- Size: 1,018 training samples
- Columns: anchor, positive, and negative
- Approximate statistics based on the first 1000 samples:
anchor positive negative type string string string details min: 7 tokensmean: 7.37 tokensmax: 12 tokens min: 7 tokensmean: 7.32 tokensmax: 11 tokens min: 7 tokensmean: 7.24 tokensmax: 10 tokens - Samples:
- Loss: MultipleNegativesRankingLoss with these parameters:
{ "scale": 20.0, "similarity_fct": "cos_sim" }
task1327_qa_zre_answer_generation_from_question
- Dataset: task1327_qa_zre_answer_generation_from_question
- Size: 1,018 training samples
- Columns: anchor, positive, and negative
- Approximate statistics based on the first 1000 samples:
anchor positive negative type string string string details min: 24 tokensmean: 55.0 tokensmax: 256 tokens min: 23 tokensmean: 52.2 tokensmax: 256 tokens min: 27 tokensmean: 55.59 tokensmax: 256 tokens - Samples:
- Loss: MultipleNegativesRankingLoss with these parameters:
{ "scale": 20.0, "similarity_fct": "cos_sim" }
task326_jigsaw_classification_obscene
- Dataset: task326_jigsaw_classification_obscene
- Size: 1,018 training samples
- Columns: anchor, positive, and negative
- Approximate statistics based on the first 1000 samples:
anchor positive negative type string string string details min: 5 tokensmean: 65.45 tokensmax: 256 tokens min: 5 tokensmean: 77.38 tokensmax: 256 tokens min: 5 tokensmean: 74.07 tokensmax: 256 tokens - Samples:
- Loss: MultipleNegativesRankingLoss with these parameters:
{ "scale": 20.0, "similarity_fct": "cos_sim" }
task1542_every_ith_element_from_starting
- Dataset: task1542_every_ith_element_from_starting
- Size: 1,018 training samples
- Columns: anchor, positive, and negative
- Approximate statistics based on the first 1000 samples:
anchor positive negative type string string string details min: 13 tokensmean: 125.21 tokensmax: 245 tokens min: 13 tokensmean: 123.54 tokensmax: 244 tokens min: 13 tokensmean: 120.48 tokensmax: 238 tokens - Samples:
- Loss: MultipleNegativesRankingLoss with these parameters:
{ "scale": 20.0, "similarity_fct": "cos_sim" }
task570_recipe_nlg_ner_generation
- Dataset: task570_recipe_nlg_ner_generation
- Size: 1,018 training samples
- Columns: anchor, positive, and negative
- Approximate statistics based on the first 1000 samples:
anchor positive negative type string string string details min: 9 tokensmean: 74.07 tokensmax: 250 tokens min: 5 tokensmean: 73.6 tokensmax: 256 tokens min: 8 tokensmean: 76.08 tokensmax: 256 tokens - Samples:
- Loss: MultipleNegativesRankingLoss with these parameters:
{ "scale": 20.0, "similarity_fct": "cos_sim" }
task1409_dart_text_generation
- Dataset: task1409_dart_text_generation
- Size: 1,018 training samples
- Columns: anchor, positive, and negative
- Approximate statistics based on the first 1000 samples:
anchor positive negative type string string string details min: 18 tokensmean: 67.5 tokensmax: 174 tokens min: 18 tokensmean: 72.52 tokensmax: 170 tokens min: 17 tokensmean: 67.55 tokensmax: 164 tokens - Samples:
- Loss: MultipleNegativesRankingLoss with these parameters:
{ "scale": 20.0, "similarity_fct": "cos_sim" }
task401_numeric_fused_head_reference
- Dataset: task401_numeric_fused_head_reference
- Size: 1,018 training samples
- Columns: anchor, positive, and negative
- Approximate statistics based on the first 1000 samples:
anchor positive negative type string string string details min: 16 tokensmean: 109.08 tokensmax: 256 tokens min: 16 tokensmean: 116.35 tokensmax: 256 tokens min: 18 tokensmean: 119.65 tokensmax: 256 tokens - Samples:
- Loss: MultipleNegativesRankingLoss with these parameters:
{ "scale": 20.0, "similarity_fct": "cos_sim" }
task846_pubmedqa_classification
- Dataset: task846_pubmedqa_classification
- Size: 1,018 training samples
- Columns: anchor, positive, and negative
- Approximate statistics based on the first 1000 samples:
anchor positive negative type string string string details min: 32 tokensmean: 85.83 tokensmax: 246 tokens min: 33 tokensmean: 85.03 tokensmax: 225 tokens min: 28 tokensmean: 93.96 tokensmax: 256 tokens - Samples:
- Loss: MultipleNegativesRankingLoss with these parameters:
{ "scale": 20.0, "similarity_fct": "cos_sim" }
task1712_poki_classification
- Dataset: task1712_poki_classification
- Size: 1,018 training samples
- Columns: anchor, positive, and negative
- Approximate statistics based on the first 1000 samples:
anchor positive negative type string string string details min: 6 tokensmean: 52.73 tokensmax: 256 tokens min: 7 tokensmean: 55.65 tokensmax: 256 tokens min: 7 tokensmean: 63.01 tokensmax: 256 tokens - Samples:
- Loss: MultipleNegativesRankingLoss with these parameters:
{ "scale": 20.0, "similarity_fct": "cos_sim" }
task344_hybridqa_answer_generation
- Dataset: task344_hybridqa_answer_generation
- Size: 1,018 training samples
- Columns: anchor, positive, and negative
- Approximate statistics based on the first 1000 samples:
anchor positive negative type string string string details min: 9 tokensmean: 22.15 tokensmax: 50 tokens min: 8 tokensmean: 22.07 tokensmax: 58 tokens min: 7 tokensmean: 22.07 tokensmax: 55 tokens - Samples:
- Loss: MultipleNegativesRankingLoss with these parameters:
{ "scale": 20.0, "similarity_fct": "cos_sim" }
task875_emotion_classification
- Dataset: task875_emotion_classification
- Size: 1,018 training samples
- Columns: anchor, positive, and negative
- Approximate statistics based on the first 1000 samples:
anchor positive negative type string string string details min: 4 tokensmean: 23.03 tokensmax: 75 tokens min: 4 tokensmean: 18.42 tokensmax: 63 tokens min: 5 tokensmean: 20.36 tokensmax: 68 tokens - Samples:
- Loss: MultipleNegativesRankingLoss with these parameters:
{ "scale": 20.0, "similarity_fct": "cos_sim" }
task1214_atomic_classification_xwant
- Dataset: task1214_atomic_classification_xwant
- Size: 1,018 training samples
- Columns: anchor, positive, and negative
- Approximate statistics based on the first 1000 samples:
anchor positive negative type string string string details min: 14 tokensmean: 19.66 tokensmax: 32 tokens min: 14 tokensmean: 19.39 tokensmax: 29 tokens min: 14 tokensmean: 19.57 tokensmax: 31 tokens - Samples:
- Loss: MultipleNegativesRankingLoss with these parameters:
{ "scale": 20.0, "similarity_fct": "cos_sim" }
task106_scruples_ethical_judgment
- Dataset: task106_scruples_ethical_judgment
- Size: 1,018 training samples
- Columns: anchor, positive, and negative
- Approximate statistics based on the first 1000 samples:
anchor positive negative type string string string details min: 12 tokensmean: 29.85 tokensmax: 70 tokens min: 14 tokensmean: 28.96 tokensmax: 86 tokens min: 14 tokensmean: 28.77 tokensmax: 58 tokens - Samples:
- Loss: MultipleNegativesRankingLoss with these parameters:
{ "scale": 20.0, "similarity_fct": "cos_sim" }
task238_iirc_answer_from_passage_answer_generation
- Dataset: task238_iirc_answer_from_passage_answer_generation
- Size: 1,018 training samples
- Columns: anchor, positive, and negative
- Approximate statistics based on the first 1000 samples:
anchor positive negative type string string string details min: 138 tokensmean: 242.59 tokensmax: 256 tokens min: 165 tokensmean: 242.86 tokensmax: 256 tokens min: 173 tokensmean: 243.06 tokensmax: 256 tokens - Samples:
- Loss: MultipleNegativesRankingLoss with these parameters:
{ "scale": 20.0, "similarity_fct": "cos_sim" }
task1391_winogrande_easy_answer_generation
- Dataset: task1391_winogrande_easy_answer_generation
- Size: 1,018 training samples
- Columns: anchor, positive, and negative
- Approximate statistics based on the first 1000 samples:
anchor positive negative type string string string details min: 26 tokensmean: 31.69 tokensmax: 54 tokens min: 26 tokensmean: 31.28 tokensmax: 48 tokens min: 25 tokensmean: 31.16 tokensmax: 49 tokens - Samples:
- Loss: MultipleNegativesRankingLoss with these parameters:
{ "scale": 20.0, "similarity_fct": "cos_sim" }
task195_sentiment140_classification
- Dataset: task195_sentiment140_classification
- Size: 1,018 training samples
- Columns: anchor, positive, and negative
- Approximate statistics based on the first 1000 samples:
anchor positive negative type string string string details min: 4 tokensmean: 22.62 tokensmax: 118 tokens min: 4 tokensmean: 18.82 tokensmax: 79 tokens min: 5 tokensmean: 21.32 tokensmax: 51 tokens - Samples:
- Loss: MultipleNegativesRankingLoss with these parameters:
{ "scale": 20.0, "similarity_fct": "cos_sim" }
task163_count_words_ending_with_letter
- Dataset: task163_count_words_ending_with_letter
- Size: 1,018 training samples
- Columns: anchor, positive, and negative
- Approximate statistics based on the first 1000 samples:
anchor positive negative type string string string details min: 28 tokensmean: 32.06 tokensmax: 54 tokens min: 28 tokensmean: 31.69 tokensmax: 57 tokens min: 28 tokensmean: 31.58 tokensmax: 43 tokens - Samples:
- Loss: MultipleNegativesRankingLoss with these parameters:
{ "scale": 20.0, "similarity_fct": "cos_sim" }
task579_socialiqa_classification
- Dataset: task579_socialiqa_classification
- Size: 1,018 training samples
- Columns: anchor, positive, and negative
- Approximate statistics based on the first 1000 samples:
anchor positive negative type string string string details min: 39 tokensmean: 54.2 tokensmax: 132 tokens min: 36 tokensmean: 53.61 tokensmax: 103 tokens min: 40 tokensmean: 54.16 tokensmax: 84 tokens - Samples:
- Loss: MultipleNegativesRankingLoss with these parameters:
{ "scale": 20.0, "similarity_fct": "cos_sim" }
task569_recipe_nlg_text_generation
- Dataset: task569_recipe_nlg_text_generation
- Size: 1,018 training samples
- Columns: anchor, positive, and negative
- Approximate statistics based on the first 1000 samples:
anchor positive negative type string string string details min: 25 tokensmean: 193.73 tokensmax: 256 tokens min: 55 tokensmean: 193.64 tokensmax: 256 tokens min: 37 tokensmean: 198.12 tokensmax: 256 tokens - Samples:
- Loss: MultipleNegativesRankingLoss with these parameters:
{ "scale": 20.0, "similarity_fct": "cos_sim" }
task1602_webquestion_question_genreation
- Dataset: task1602_webquestion_question_genreation
- Size: 1,018 training samples
- Columns: anchor, positive, and negative
- Approximate statistics based on the first 1000 samples:
anchor positive negative type string string string details min: 12 tokensmean: 23.64 tokensmax: 112 tokens min: 12 tokensmean: 24.12 tokensmax: 112 tokens min: 12 tokensmean: 22.49 tokensmax: 120 tokens - Samples:
- Loss: MultipleNegativesRankingLoss with these parameters:
{ "scale": 20.0, "similarity_fct": "cos_sim" }
task747_glucose_cause_emotion_detection
- Dataset: task747_glucose_cause_emotion_detection
- Size: 1,018 training samples
- Columns: anchor, positive, and negative
- Approximate statistics based on the first 1000 samples:
anchor positive negative type string string string details min: 35 tokensmean: 68.15 tokensmax: 112 tokens min: 36 tokensmean: 68.3 tokensmax: 108 tokens min: 36 tokensmean: 68.79 tokensmax: 99 tokens - Samples:
- Loss: MultipleNegativesRankingLoss with these parameters:
{ "scale": 20.0, "similarity_fct": "cos_sim" }
task219_rocstories_title_answer_generation
- Dataset: task219_rocstories_title_answer_generation
- Size: 1,018 training samples
- Columns: anchor, positive, and negative
- Approximate statistics based on the first 1000 samples:
anchor positive negative type string string string details min: 42 tokensmean: 67.71 tokensmax: 97 tokens min: 45 tokensmean: 66.7 tokensmax: 97 tokens min: 41 tokensmean: 66.92 tokensmax: 96 tokens - Samples:
- Loss: MultipleNegativesRankingLoss with these parameters:
{ "scale": 20.0, "similarity_fct": "cos_sim" }
task178_quartz_question_answering
- Dataset: task178_quartz_question_answering
- Size: 1,018 training samples
- Columns: anchor, positive, and negative
- Approximate statistics based on the first 1000 samples:
anchor positive negative type string string string details min: 28 tokensmean: 57.78 tokensmax: 110 tokens min: 28 tokensmean: 57.44 tokensmax: 111 tokens min: 28 tokensmean: 56.86 tokensmax: 102 tokens - Samples:
- Loss: MultipleNegativesRankingLoss with these parameters:
{ "scale": 20.0, "similarity_fct": "cos_sim" }
task103_facts2story_long_text_generation
- Dataset: task103_facts2story_long_text_generation
- Size: 1,018 training samples
- Columns: anchor, positive, and negative
- Approximate statistics based on the first 1000 samples:
anchor positive negative type string string string details min: 52 tokensmean: 80.49 tokensmax: 143 tokens min: 51 tokensmean: 82.22 tokensmax: 157 tokens min: 49 tokensmean: 78.96 tokensmax: 145 tokens - Samples:
- Loss: MultipleNegativesRankingLoss with these parameters:
{ "scale": 20.0, "similarity_fct": "cos_sim" }
task301_record_question_generation
- Dataset: task301_record_question_generation
- Size: 1,018 training samples
- Columns: anchor, positive, and negative
- Approximate statistics based on the first 1000 samples:
anchor positive negative type string string string details min: 140 tokensmean: 210.71 tokensmax: 256 tokens min: 139 tokensmean: 209.62 tokensmax: 256 tokens min: 143 tokensmean: 208.74 tokensmax: 256 tokens - Samples:
- Loss: MultipleNegativesRankingLoss with these parameters:
{ "scale": 20.0, "similarity_fct": "cos_sim" }
task1369_healthfact_sentence_generation
- Dataset: task1369_healthfact_sentence_generation
- Size: 1,018 training samples
- Columns: anchor, positive, and negative
- Approximate statistics based on the first 1000 samples:
anchor positive negative type string string string details min: 110 tokensmean: 243.25 tokensmax: 256 tokens min: 101 tokensmean: 243.17 tokensmax: 256 tokens min: 113 tokensmean: 251.67 tokensmax: 256 tokens - Samples:
- Loss: MultipleNegativesRankingLoss with these parameters:
{ "scale": 20.0, "similarity_fct": "cos_sim" }
task515_senteval_odd_word_out
- Dataset: task515_senteval_odd_word_out
- Size: 1,018 training samples
- Columns: anchor, positive, and negative
- Approximate statistics based on the first 1000 samples:
anchor positive negative type string string string details min: 7 tokensmean: 19.72 tokensmax: 36 tokens min: 7 tokensmean: 19.13 tokensmax: 38 tokens min: 7 tokensmean: 19.0 tokensmax: 35 tokens - Samples:
- Loss: MultipleNegativesRankingLoss with these parameters:
{ "scale": 20.0, "similarity_fct": "cos_sim" }
task496_semeval_answer_generation
- Dataset: task496_semeval_answer_generation
- Size: 1,018 training samples
- Columns: anchor, positive, and negative
- Approximate statistics based on the first 1000 samples:
anchor positive negative type string string string details min: 4 tokensmean: 28.11 tokensmax: 46 tokens min: 18 tokensmean: 27.8 tokensmax: 45 tokens min: 19 tokensmean: 27.68 tokensmax: 45 tokens - Samples:
- Loss: MultipleNegativesRankingLoss with these parameters:
{ "scale": 20.0, "similarity_fct": "cos_sim" }
task1658_billsum_summarization
- Dataset: task1658_billsum_summarization
- Size: 1,018 training samples
- Columns: anchor, positive, and negative
- Approximate statistics based on the first 1000 samples:
anchor positive negative type string string string details min: 256 tokensmean: 256.0 tokensmax: 256 tokens min: 256 tokensmean: 256.0 tokensmax: 256 tokens min: 256 tokensmean: 256.0 tokensmax: 256 tokens - Samples:
- Loss: MultipleNegativesRankingLoss with these parameters:
{ "scale": 20.0, "similarity_fct": "cos_sim" }
task1204_atomic_classification_hinderedby
- Dataset: task1204_atomic_classification_hinderedby
- Size: 1,018 training samples
- Columns: anchor, positive, and negative
- Approximate statistics based on the first 1000 samples:
anchor positive negative type string string string details min: 14 tokensmean: 22.1 tokensmax: 35 tokens min: 14 tokensmean: 22.07 tokensmax: 34 tokens min: 14 tokensmean: 21.5 tokensmax: 38 tokens - Samples:
- Loss: MultipleNegativesRankingLoss with these parameters:
{ "scale": 20.0, "similarity_fct": "cos_sim" }
task1392_superglue_multirc_answer_verification
- Dataset: task1392_superglue_multirc_answer_verification
- Size: 1,018 training samples
- Columns: anchor, positive, and negative
- Approximate statistics based on the first 1000 samples:
anchor positive negative type string string string details min: 128 tokensmean: 241.77 tokensmax: 256 tokens min: 127 tokensmean: 241.97 tokensmax: 256 tokens min: 136 tokensmean: 242.04 tokensmax: 256 tokens - Samples:
- Loss: MultipleNegativesRankingLoss with these parameters:
{ "scale": 20.0, "similarity_fct": "cos_sim" }
task306_jeopardy_answer_generation_double
- Dataset: task306_jeopardy_answer_generation_double
- Size: 1,018 training samples
- Columns: anchor, positive, and negative
- Approximate statistics based on the first 1000 samples:
anchor positive negative type string string string details min: 10 tokensmean: 27.79 tokensmax: 47 tokens min: 10 tokensmean: 27.16 tokensmax: 46 tokens min: 11 tokensmean: 27.61 tokensmax: 47 tokens - Samples:
- Loss: MultipleNegativesRankingLoss with these parameters:
{ "scale": 20.0, "similarity_fct": "cos_sim" }
task1286_openbookqa_question_answering
- Dataset: task1286_openbookqa_question_answering
- Size: 1,018 training samples
- Columns: anchor, positive, and negative
- Approximate statistics based on the first 1000 samples:
anchor positive negative type string string string details min: 22 tokensmean: 39.54 tokensmax: 85 tokens min: 23 tokensmean: 38.94 tokensmax: 96 tokens min: 22 tokensmean: 38.26 tokensmax: 89 tokens - Samples:
- Loss: MultipleNegativesRankingLoss with these parameters:
{ "scale": 20.0, "similarity_fct": "cos_sim" }
task159_check_frequency_of_words_in_sentence_pair
- Dataset: task159_check_frequency_of_words_in_sentence_pair
- Size: 1,018 training samples
- Columns: anchor, positive, and negative
- Approximate statistics based on the first 1000 samples:
anchor positive negative type string string string details min: 44 tokensmean: 50.37 tokensmax: 67 tokens min: 44 tokensmean: 50.35 tokensmax: 67 tokens min: 44 tokensmean: 50.61 tokensmax: 66 tokens - Samples:
- Loss: MultipleNegativesRankingLoss with these parameters:
{ "scale": 20.0, "similarity_fct": "cos_sim" }
task151_tomqa_find_location_easy_clean
- Dataset: task151_tomqa_find_location_easy_clean
- Size: 1,018 training samples
- Columns: anchor, positive, and negative
- Approximate statistics based on the first 1000 samples:
anchor positive negative type string string string details min: 37 tokensmean: 50.73 tokensmax: 79 tokens min: 37 tokensmean: 50.28 tokensmax: 74 tokens min: 37 tokensmean: 50.52 tokensmax: 74 tokens - Samples:
- Loss: MultipleNegativesRankingLoss with these parameters:
{ "scale": 20.0, "similarity_fct": "cos_sim" }
task323_jigsaw_classification_sexually_explicit
- Dataset: task323_jigsaw_classification_sexually_explicit
- Size: 1,018 training samples
- Columns: anchor, positive, and negative
- Approximate statistics based on the first 1000 samples:
anchor positive negative type string string string details min: 6 tokensmean: 66.26 tokensmax: 248 tokens min: 5 tokensmean: 76.73 tokensmax: 248 tokens min: 6 tokensmean: 75.5 tokensmax: 251 tokens - Samples:
- Loss: MultipleNegativesRankingLoss with these parameters:
{ "scale": 20.0, "similarity_fct": "cos_sim" }
task037_qasc_generate_related_fact
- Dataset: task037_qasc_generate_related_fact
- Size: 1,018 training samples
- Columns: anchor, positive, and negative
- Approximate statistics based on the first 1000 samples:
anchor positive negative type string string string details min: 13 tokensmean: 22.04 tokensmax: 50 tokens min: 13 tokensmean: 22.03 tokensmax: 42 tokens min: 13 tokensmean: 21.9 tokensmax: 40 tokens - Samples:
- Loss: MultipleNegativesRankingLoss with these parameters:
{ "scale": 20.0, "similarity_fct": "cos_sim" }
task027_drop_answer_type_generation
- Dataset: task027_drop_answer_type_generation
- Size: 1,018 training samples
- Columns: anchor, positive, and negative
- Approximate statistics based on the first 1000 samples:
anchor positive negative type string string string details min: 87 tokensmean: 229.02 tokensmax: 256 tokens min: 74 tokensmean: 230.67 tokensmax: 256 tokens min: 71 tokensmean: 232.43 tokensmax: 256 tokens - Samples:
- Loss: MultipleNegativesRankingLoss with these parameters:
{ "scale": 20.0, "similarity_fct": "cos_sim" }
task1596_event2mind_text_generation_2
- Dataset: task1596_event2mind_text_generation_2
- Size: 1,018 training samples
- Columns: anchor, positive, and negative
- Approximate statistics based on the first 1000 samples:
anchor positive negative type string string string details min: 6 tokensmean: 9.97 tokensmax: 18 tokens min: 6 tokensmean: 10.03 tokensmax: 19 tokens min: 6 tokensmean: 10.06 tokensmax: 18 tokens - Samples:
- Loss: MultipleNegativesRankingLoss with these parameters:
{ "scale": 20.0, "similarity_fct": "cos_sim" }
task141_odd-man-out_classification_category
- Dataset: task141_odd-man-out_classification_category
- Size: 1,018 training samples
- Columns: anchor, positive, and negative
- Approximate statistics based on the first 1000 samples:
anchor positive negative type string string string details min: 16 tokensmean: 18.45 tokensmax: 28 tokens min: 16 tokensmean: 18.38 tokensmax: 26 tokens min: 16 tokensmean: 18.46 tokensmax: 25 tokens - Samples:
- Loss: MultipleNegativesRankingLoss with these parameters:
{ "scale": 20.0, "similarity_fct": "cos_sim" }
task194_duorc_answer_generation
- Dataset: task194_duorc_answer_generation
- Size: 1,018 training samples
- Columns: anchor, positive, and negative
- Approximate statistics based on the first 1000 samples:
anchor positive negative type string string string details min: 149 tokensmean: 251.76 tokensmax: 256 tokens min: 147 tokensmean: 252.05 tokensmax: 256 tokens min: 148 tokensmean: 251.76 tokensmax: 256 tokens - Samples:
- Loss: MultipleNegativesRankingLoss with these parameters:
{ "scale": 20.0, "similarity_fct": "cos_sim" }
task679_hope_edi_english_text_classification
- Dataset: task679_hope_edi_english_text_classification
- Size: 1,018 training samples
- Columns: anchor, positive, and negative
- Approximate statistics based on the first 1000 samples:
anchor positive negative type string string string details min: 5 tokensmean: 27.77 tokensmax: 199 tokens min: 4 tokensmean: 27.23 tokensmax: 205 tokens min: 5 tokensmean: 29.87 tokensmax: 194 tokens - Samples:
- Loss: MultipleNegativesRankingLoss with these parameters:
{ "scale": 20.0, "similarity_fct": "cos_sim" }
task246_dream_question_generation
- Dataset: task246_dream_question_generation
- Size: 1,018 training samples
- Columns: anchor, positive, and negative
- Approximate statistics based on the first 1000 samples:
anchor positive negative type string string string details min: 17 tokensmean: 80.33 tokensmax: 256 tokens min: 14 tokensmean: 80.74 tokensmax: 256 tokens min: 15 tokensmean: 87.22 tokensmax: 256 tokens - Samples:
- Loss: MultipleNegativesRankingLoss with these parameters:
{ "scale": 20.0, "similarity_fct": "cos_sim" }
task1195_disflqa_disfluent_to_fluent_conversion
- Dataset: task1195_disflqa_disfluent_to_fluent_conversion
- Size: 1,018 training samples
- Columns: anchor, positive, and negative
- Approximate statistics based on the first 1000 samples:
anchor positive negative type string string string details min: 9 tokensmean: 19.76 tokensmax: 41 tokens min: 9 tokensmean: 19.88 tokensmax: 40 tokens min: 2 tokensmean: 20.2 tokensmax: 44 tokens - Samples:
- Loss: MultipleNegativesRankingLoss with these parameters:
{ "scale": 20.0, "similarity_fct": "cos_sim" }
task065_timetravel_consistent_sentence_classification
- Dataset: task065_timetravel_consistent_sentence_classification
- Size: 1,018 training samples
- Columns: anchor, positive, and negative
- Approximate statistics based on the first 1000 samples:
anchor positive negative type string string string details min: 55 tokensmean: 79.4 tokensmax: 117 tokens min: 51 tokensmean: 79.17 tokensmax: 110 tokens min: 53 tokensmean: 80.1 tokensmax: 110 tokens - Samples:
- Loss: MultipleNegativesRankingLoss with these parameters:
{ "scale": 20.0, "similarity_fct": "cos_sim" }
task351_winomt_classification_gender_identifiability_anti
- Dataset: task351_winomt_classification_gender_identifiability_anti
- Size: 1,018 training samples
- Columns: anchor, positive, and negative
- Approximate statistics based on the first 1000 samples:
anchor positive negative type string string string details min: 16 tokensmean: 21.76 tokensmax: 30 tokens min: 16 tokensmean: 21.66 tokensmax: 31 tokens min: 16 tokensmean: 21.78 tokensmax: 30 tokens - Samples:
- Loss: MultipleNegativesRankingLoss with these parameters:
{ "scale": 20.0, "similarity_fct": "cos_sim" }
task580_socialiqa_answer_generation
- Dataset: task580_socialiqa_answer_generation
- Size: 1,018 training samples
- Columns: anchor, positive, and negative
- Approximate statistics based on the first 1000 samples:
anchor positive negative type string string string details min: 35 tokensmean: 52.41 tokensmax: 107 tokens min: 35 tokensmean: 51.02 tokensmax: 86 tokens min: 35 tokensmean: 50.98 tokensmax: 87 tokens - Samples:
- Loss: MultipleNegativesRankingLoss with these parameters:
{ "scale": 20.0, "similarity_fct": "cos_sim" }
task583_udeps_eng_coarse_pos_tagging
- Dataset: task583_udeps_eng_coarse_pos_tagging
- Size: 1,018 training samples
- Columns: anchor, positive, and negative
- Approximate statistics based on the first 1000 samples:
anchor positive negative type string string string details min: 12 tokensmean: 41.24 tokensmax: 185 tokens min: 12 tokensmean: 40.21 tokensmax: 185 tokens min: 12 tokensmean: 40.93 tokensmax: 185 tokens - Samples:
- Loss: MultipleNegativesRankingLoss with these parameters:
{ "scale": 20.0, "similarity_fct": "cos_sim" }
task202_mnli_contradiction_classification
- Dataset: task202_mnli_contradiction_classification
- Size: 1,018 training samples
- Columns: anchor, positive, and negative
- Approximate statistics based on the first 1000 samples:
anchor positive negative type string string string details min: 24 tokensmean: 73.7 tokensmax: 190 tokens min: 28 tokensmean: 76.06 tokensmax: 256 tokens min: 23 tokensmean: 74.56 tokensmax: 256 tokens - Samples:
- Loss: MultipleNegativesRankingLoss with these parameters:
{ "scale": 20.0, "similarity_fct": "cos_sim" }
task222_rocstories_two_chioce_slotting_classification
- Dataset: task222_rocstories_two_chioce_slotting_classification
- Size: 1,018 training samples
- Columns: anchor, positive, and negative
- Approximate statistics based on the first 1000 samples:
anchor positive negative type string string string details min: 48 tokensmean: 73.06 tokensmax: 105 tokens min: 48 tokensmean: 73.24 tokensmax: 100 tokens min: 49 tokensmean: 71.71 tokensmax: 102 tokens - Samples:
- Loss: MultipleNegativesRankingLoss with these parameters:
{ "scale": 20.0, "similarity_fct": "cos_sim" }
task498_scruples_anecdotes_whoiswrong_classification
- Dataset: task498_scruples_anecdotes_whoiswrong_classification
- Size: 1,018 training samples
- Columns: anchor, positive, and negative
- Approximate statistics based on the first 1000 samples:
anchor positive negative type string string string details min: 24 tokensmean: 225.8 tokensmax: 256 tokens min: 47 tokensmean: 232.86 tokensmax: 256 tokens min: 47 tokensmean: 231.22 tokensmax: 256 tokens - Samples:
- Loss: MultipleNegativesRankingLoss with these parameters:
{ "scale": 20.0, "similarity_fct": "cos_sim" }
task067_abductivenli_answer_generation
- Dataset: task067_abductivenli_answer_generation
- Size: 1,018 training samples
- Columns: anchor, positive, and negative
- Approximate statistics based on the first 1000 samples:
anchor positive negative type string string string details min: 14 tokensmean: 26.75 tokensmax: 40 tokens min: 14 tokensmean: 26.13 tokensmax: 42 tokens min: 15 tokensmean: 26.34 tokensmax: 38 tokens - Samples:
- Loss: MultipleNegativesRankingLoss with these parameters:
{ "scale": 20.0, "similarity_fct": "cos_sim" }
task616_cola_classification
- Dataset: task616_cola_classification
- Size: 1,018 training samples
- Columns: anchor, positive, and negative
- Approximate statistics based on the first 1000 samples:
anchor positive negative type string string string details min: 5 tokensmean: 12.16 tokensmax: 33 tokens min: 5 tokensmean: 12.05 tokensmax: 33 tokens min: 6 tokensmean: 11.96 tokensmax: 29 tokens - Samples:
- Loss: MultipleNegativesRankingLoss with these parameters:
{ "scale": 20.0, "similarity_fct": "cos_sim" }
task286_olid_offense_judgment
- Dataset: task286_olid_offense_judgment
- Size: 1,018 training samples
- Columns: anchor, positive, and negative
- Approximate statistics based on the first 1000 samples:
anchor positive negative type string string string details min: 5 tokensmean: 32.85 tokensmax: 145 tokens min: 5 tokensmean: 30.81 tokensmax: 171 tokens min: 5 tokensmean: 30.26 tokensmax: 169 tokens - Samples:
- Loss: MultipleNegativesRankingLoss with these parameters:
{ "scale": 20.0, "similarity_fct": "cos_sim" }
task188_snli_neutral_to_entailment_text_modification
- Dataset: task188_snli_neutral_to_entailment_text_modification
- Size: 1,018 training samples
- Columns: anchor, positive, and negative
- Approximate statistics based on the first 1000 samples:
anchor positive negative type string string string details min: 18 tokensmean: 31.55 tokensmax: 79 tokens min: 18 tokensmean: 31.31 tokensmax: 84 tokens min: 18 tokensmean: 32.91 tokensmax: 84 tokens - Samples:
- Loss: MultipleNegativesRankingLoss with these parameters:
{ "scale": 20.0, "similarity_fct": "cos_sim" }
task223_quartz_explanation_generation
- Dataset: task223_quartz_explanation_generation
- Size: 1,018 training samples
- Columns: anchor, positive, and negative
- Approximate statistics based on the first 1000 samples:
anchor positive negative type string string string details min: 12 tokensmean: 31.46 tokensmax: 68 tokens min: 13 tokensmean: 31.8 tokensmax: 68 tokens min: 13 tokensmean: 28.95 tokensmax: 96 tokens - Samples:
- Loss: MultipleNegativesRankingLoss with these parameters:
{ "scale": 20.0, "similarity_fct": "cos_sim" }
task820_protoqa_answer_generation
- Dataset: task820_protoqa_answer_generation
- Size: 1,018 training samples
- Columns: anchor, positive, and negative
- Approximate statistics based on the first 1000 samples:
anchor positive negative type string string string details min: 6 tokensmean: 14.87 tokensmax: 29 tokens min: 7 tokensmean: 14.54 tokensmax: 27 tokens min: 6 tokensmean: 14.22 tokensmax: 29 tokens - Samples:
- Loss: MultipleNegativesRankingLoss with these parameters:
{ "scale": 20.0, "similarity_fct": "cos_sim" }
task196_sentiment140_answer_generation
- Dataset: task196_sentiment140_answer_generation
- Size: 1,018 training samples
- Columns: anchor, positive, and negative
- Approximate statistics based on the first 1000 samples:
anchor positive negative type string string string details min: 17 tokensmean: 36.26 tokensmax: 72 tokens min: 17 tokensmean: 32.85 tokensmax: 61 tokens min: 17 tokensmean: 36.27 tokensmax: 72 tokens - Samples:
- Loss: MultipleNegativesRankingLoss with these parameters:
{ "scale": 20.0, "similarity_fct": "cos_sim" }
task1678_mathqa_answer_selection
- Dataset: task1678_mathqa_answer_selection
- Size: 1,018 training samples
- Columns: anchor, positive, and negative
- Approximate statistics based on the first 1000 samples:
anchor positive negative type string string string details min: 33 tokensmean: 70.42 tokensmax: 177 tokens min: 30 tokensmean: 68.99 tokensmax: 146 tokens min: 33 tokensmean: 69.69 tokensmax: 160 tokens - Samples:
- Loss: MultipleNegativesRankingLoss with these parameters:
{ "scale": 20.0, "similarity_fct": "cos_sim" }
task349_squad2.0_answerable_unanswerable_question_classification
- Dataset: task349_squad2.0_answerable_unanswerable_question_classification
- Size: 1,018 training samples
- Columns: anchor, positive, and negative
- Approximate statistics based on the first 1000 samples:
anchor positive negative type string string string details min: 53 tokensmean: 176.83 tokensmax: 256 tokens min: 57 tokensmean: 177.07 tokensmax: 256 tokens min: 53 tokensmean: 176.78 tokensmax: 256 tokens - Samples:
- Loss: MultipleNegativesRankingLoss with these parameters:
{ "scale": 20.0, "similarity_fct": "cos_sim" }
task154_tomqa_find_location_hard_noise
- Dataset: task154_tomqa_find_location_hard_noise
- Size: 1,018 training samples
- Columns: anchor, positive, and negative
- Approximate statistics based on the first 1000 samples:
anchor positive negative type string string string details min: 129 tokensmean: 176.29 tokensmax: 253 tokens min: 126 tokensmean: 176.3 tokensmax: 249 tokens min: 128 tokensmean: 178.24 tokensmax: 254 tokens - Samples:
- Loss: MultipleNegativesRankingLoss with these parameters:
{ "scale": 20.0, "similarity_fct": "cos_sim" }
task333_hateeval_classification_hate_en
- Dataset: task333_hateeval_classification_hate_en
- Size: 1,018 training samples
- Columns: anchor, positive, and negative
- Approximate statistics based on the first 1000 samples:
anchor positive negative type string string string details min: 8 tokensmean: 38.33 tokensmax: 117 tokens min: 7 tokensmean: 36.79 tokensmax: 109 tokens min: 7 tokensmean: 36.61 tokensmax: 113 tokens - Samples:
- Loss: MultipleNegativesRankingLoss with these parameters:
{ "scale": 20.0, "similarity_fct": "cos_sim" }
task235_iirc_question_from_subtext_answer_generation
- Dataset: task235_iirc_question_from_subtext_answer_generation
- Size: 1,018 training samples
- Columns: anchor, positive, and negative
- Approximate statistics based on the first 1000 samples:
anchor positive negative type string string string details min: 14 tokensmean: 52.9 tokensmax: 256 tokens min: 12 tokensmean: 50.44 tokensmax: 256 tokens min: 12 tokensmean: 55.89 tokensmax: 256 tokens - Samples:
- Loss: MultipleNegativesRankingLoss with these parameters:
{ "scale": 20.0, "similarity_fct": "cos_sim" }
task1554_scitail_classification
- Dataset: task1554_scitail_classification
- Size: 1,018 training samples
- Columns: anchor, positive, and negative
- Approximate statistics based on the first 1000 samples:
anchor positive negative type string string string details min: 7 tokensmean: 16.8 tokensmax: 38 tokens min: 7 tokensmean: 25.75 tokensmax: 68 tokens min: 7 tokensmean: 24.34 tokensmax: 59 tokens - Samples:
- Loss: MultipleNegativesRankingLoss with these parameters:
{ "scale": 20.0, "similarity_fct": "cos_sim" }
task210_logic2text_structured_text_generation
- Dataset: task210_logic2text_structured_text_generation
- Size: 1,018 training samples
- Columns: anchor, positive, and negative
- Approximate statistics based on the first 1000 samples:
anchor positive negative type string string string details min: 13 tokensmean: 31.88 tokensmax: 101 tokens min: 13 tokensmean: 30.88 tokensmax: 94 tokens min: 12 tokensmean: 32.75 tokensmax: 89 tokens - Samples:
- Loss: MultipleNegativesRankingLoss with these parameters:
{ "scale": 20.0, "similarity_fct": "cos_sim" }
task035_winogrande_question_modification_person
- Dataset: task035_winogrande_question_modification_person
- Size: 1,018 training samples
- Columns: anchor, positive, and negative
- Approximate statistics based on the first 1000 samples:
anchor positive negative type string string string details min: 31 tokensmean: 36.16 tokensmax: 50 tokens min: 31 tokensmean: 35.75 tokensmax: 55 tokens min: 31 tokensmean: 35.41 tokensmax: 48 tokens - Samples:
- Loss: MultipleNegativesRankingLoss with these parameters:
{ "scale": 20.0, "similarity_fct": "cos_sim" }
task230_iirc_passage_classification
- Dataset: task230_iirc_passage_classification
- Size: 1,018 training samples
- Columns: anchor, positive, and negative
- Approximate statistics based on the first 1000 samples:
anchor positive negative type string string string details min: 256 tokensmean: 256.0 tokensmax: 256 tokens min: 256 tokensmean: 256.0 tokensmax: 256 tokens min: 256 tokensmean: 256.0 tokensmax: 256 tokens - Samples:
- Loss: MultipleNegativesRankingLoss with these parameters:
{ "scale": 20.0, "similarity_fct": "cos_sim" }
task1356_xlsum_title_generation
- Dataset: task1356_xlsum_title_generation
- Size: 1,018 training samples
- Columns: anchor, positive, and negative
- Approximate statistics based on the first 1000 samples:
anchor positive negative type string string string details min: 59 tokensmean: 239.92 tokensmax: 256 tokens min: 58 tokensmean: 240.94 tokensmax: 256 tokens min: 64 tokensmean: 248.75 tokensmax: 256 tokens - Samples:
- Loss: MultipleNegativesRankingLoss with these parameters:
{ "scale": 20.0, "similarity_fct": "cos_sim" }
task1726_mathqa_correct_answer_generation
- Dataset: task1726_mathqa_correct_answer_generation
- Size: 1,018 training samples
- Columns: anchor, positive, and negative
- Approximate statistics based on the first 1000 samples:
anchor positive negative type string string string details min: 10 tokensmean: 43.81 tokensmax: 156 tokens min: 12 tokensmean: 42.63 tokensmax: 129 tokens min: 11 tokensmean: 42.82 tokensmax: 133 tokens - Samples:
- Loss: MultipleNegativesRankingLoss with these parameters:
{ "scale": 20.0, "similarity_fct": "cos_sim" }
task302_record_classification
- Dataset: task302_record_classification
- Size: 1,018 training samples
- Columns: anchor, positive, and negative
- Approximate statistics based on the first 1000 samples:
anchor positive negative type string string string details min: 194 tokensmean: 253.35 tokensmax: 256 tokens min: 198 tokensmean: 252.85 tokensmax: 256 tokens min: 195 tokensmean: 252.78 tokensmax: 256 tokens - Samples:
- Loss: MultipleNegativesRankingLoss with these parameters:
{ "scale": 20.0, "similarity_fct": "cos_sim" }
task380_boolq_yes_no_question
- Dataset: task380_boolq_yes_no_question
- Size: 1,018 training samples
- Columns: anchor, positive, and negative
- Approximate statistics based on the first 1000 samples:
anchor positive negative type string string string details min: 26 tokensmean: 134.17 tokensmax: 256 tokens min: 26 tokensmean: 138.56 tokensmax: 256 tokens min: 27 tokensmean: 138.25 tokensmax: 256 tokens - Samples:
- Loss: MultipleNegativesRankingLoss with these parameters:
{ "scale": 20.0, "similarity_fct": "cos_sim" }
task212_logic2text_classification
- Dataset: task212_logic2text_classification
- Size: 1,018 training samples
- Columns: anchor, positive, and negative
- Approximate statistics based on the first 1000 samples:
anchor positive negative type string string string details min: 14 tokensmean: 33.28 tokensmax: 146 tokens min: 14 tokensmean: 32.14 tokensmax: 146 tokens min: 14 tokensmean: 32.96 tokensmax: 127 tokens - Samples:
- Loss: MultipleNegativesRankingLoss with these parameters:
{ "scale": 20.0, "similarity_fct": "cos_sim" }
task748_glucose_reverse_cause_event_detection
- Dataset: task748_glucose_reverse_cause_event_detection
- Size: 1,018 training samples
- Columns: anchor, positive, and negative
- Approximate statistics based on the first 1000 samples:
anchor positive negative type string string string details min: 35 tokensmean: 67.63 tokensmax: 105 tokens min: 38 tokensmean: 66.95 tokensmax: 106 tokens min: 39 tokensmean: 68.94 tokensmax: 105 tokens - Samples:
- Loss: MultipleNegativesRankingLoss with these parameters:
{ "scale": 20.0, "similarity_fct": "cos_sim" }
task834_mathdataset_classification
- Dataset: task834_mathdataset_classification
- Size: 1,018 training samples
- Columns: anchor, positive, and negative
- Approximate statistics based on the first 1000 samples:
anchor positive negative type string string string details min: 6 tokensmean: 27.7 tokensmax: 83 tokens min: 6 tokensmean: 27.88 tokensmax: 83 tokens min: 5 tokensmean: 26.97 tokensmax: 93 tokens - Samples:
- Loss: MultipleNegativesRankingLoss with these parameters:
{ "scale": 20.0, "similarity_fct": "cos_sim" }
task350_winomt_classification_gender_identifiability_pro
- Dataset: task350_winomt_classification_gender_identifiability_pro
- Size: 1,018 training samples
- Columns: anchor, positive, and negative
- Approximate statistics based on the first 1000 samples:
anchor positive negative type string string string details min: 16 tokensmean: 21.79 tokensmax: 30 tokens min: 16 tokensmean: 21.63 tokensmax: 30 tokens min: 16 tokensmean: 21.79 tokensmax: 30 tokens - Samples:
- Loss: MultipleNegativesRankingLoss with these parameters:
{ "scale": 20.0, "similarity_fct": "cos_sim" }
task191_hotpotqa_question_generation
- Dataset: task191_hotpotqa_question_generation
- Size: 1,018 training samples
- Columns: anchor, positive, and negative
- Approximate statistics based on the first 1000 samples:
anchor positive negative type string string string details min: 198 tokensmean: 255.88 tokensmax: 256 tokens min: 238 tokensmean: 255.93 tokensmax: 256 tokens min: 255 tokensmean: 256.0 tokensmax: 256 tokens - Samples:
- Loss: MultipleNegativesRankingLoss with these parameters:
{ "scale": 20.0, "similarity_fct": "cos_sim" }
task236_iirc_question_from_passage_answer_generation
- Dataset: task236_iirc_question_from_passage_answer_generation
- Size: 1,018 training samples
- Columns: anchor, positive, and negative
- Approximate statistics based on the first 1000 samples:
anchor positive negative type string string string details min: 135 tokensmean: 238.3 tokensmax: 256 tokens min: 155 tokensmean: 237.61 tokensmax: 256 tokens min: 154 tokensmean: 239.64 tokensmax: 256 tokens - Samples:
- Loss: MultipleNegativesRankingLoss with these parameters:
{ "scale": 20.0, "similarity_fct": "cos_sim" }
task217_rocstories_ordering_answer_generation
- Dataset: task217_rocstories_ordering_answer_generation
- Size: 1,018 training samples
- Columns: anchor, positive, and negative
- Approximate statistics based on the first 1000 samples:
anchor positive negative type string string string details min: 45 tokensmean: 72.32 tokensmax: 107 tokens min: 48 tokensmean: 72.29 tokensmax: 107 tokens min: 48 tokensmean: 70.87 tokensmax: 105 tokens - Samples:
- Loss: MultipleNegativesRankingLoss with these parameters:
{ "scale": 20.0, "similarity_fct": "cos_sim" }
task568_circa_question_generation
- Dataset: task568_circa_question_generation
- Size: 1,018 training samples
- Columns: anchor, positive, and negative
- Approximate statistics based on the first 1000 samples:
anchor positive negative type string string string details min: 4 tokensmean: 9.6 tokensmax: 25 tokens min: 4 tokensmean: 9.46 tokensmax: 20 tokens min: 4 tokensmean: 8.93 tokensmax: 20 tokens - Samples:
- Loss: MultipleNegativesRankingLoss with these parameters:
{ "scale": 20.0, "similarity_fct": "cos_sim" }
task614_glucose_cause_event_detection
- Dataset: task614_glucose_cause_event_detection
- Size: 1,018 training samples
- Columns: anchor, positive, and negative
- Approximate statistics based on the first 1000 samples:
anchor positive negative type string string string details min: 39 tokensmean: 67.66 tokensmax: 102 tokens min: 39 tokensmean: 67.16 tokensmax: 106 tokens min: 38 tokensmean: 68.48 tokensmax: 103 tokens - Samples:
- Loss: MultipleNegativesRankingLoss with these parameters:
{ "scale": 20.0, "similarity_fct": "cos_sim" }
task361_spolin_yesand_prompt_response_classification
- Dataset: task361_spolin_yesand_prompt_response_classification
- Size: 1,018 training samples
- Columns: anchor, positive, and negative
- Approximate statistics based on the first 1000 samples:
anchor positive negative type string string string details min: 18 tokensmean: 47.01 tokensmax: 137 tokens min: 17 tokensmean: 46.18 tokensmax: 119 tokens min: 17 tokensmean: 47.2 tokensmax: 128 tokens - Samples:
- Loss: MultipleNegativesRankingLoss with these parameters:
{ "scale": 20.0, "similarity_fct": "cos_sim" }
task421_persent_sentence_sentiment_classification
- Dataset: task421_persent_sentence_sentiment_classification
- Size: 1,018 training samples
- Columns: anchor, positive, and negative
- Approximate statistics based on the first 1000 samples:
anchor positive negative type string string string details min: 22 tokensmean: 67.77 tokensmax: 256 tokens min: 22 tokensmean: 71.21 tokensmax: 256 tokens min: 19 tokensmean: 72.24 tokensmax: 256 tokens - Samples:
- Loss: MultipleNegativesRankingLoss with these parameters:
{ "scale": 20.0, "similarity_fct": "cos_sim" }
task203_mnli_sentence_generation
- Dataset: task203_mnli_sentence_generation
- Size: 1,018 training samples
- Columns: anchor, positive, and negative
- Approximate statistics based on the first 1000 samples:
anchor positive negative type string string string details min: 14 tokensmean: 38.73 tokensmax: 175 tokens min: 14 tokensmean: 35.74 tokensmax: 175 tokens min: 13 tokensmean: 34.18 tokensmax: 170 tokens - Samples:
- Loss: MultipleNegativesRankingLoss with these parameters:
{ "scale": 20.0, "similarity_fct": "cos_sim" }
task420_persent_document_sentiment_classification
- Dataset: task420_persent_document_sentiment_classification
- Size: 1,018 training samples
- Columns: anchor, positive, and negative
- Approximate statistics based on the first 1000 samples:
anchor positive negative type string string string details min: 22 tokensmean: 224.14 tokensmax: 256 tokens min: 22 tokensmean: 233.63 tokensmax: 256 tokens min: 22 tokensmean: 227.59 tokensmax: 256 tokens - Samples:
- Loss: MultipleNegativesRankingLoss with these parameters:
{ "scale": 20.0, "similarity_fct": "cos_sim" }
task153_tomqa_find_location_hard_clean
- Dataset: task153_tomqa_find_location_hard_clean
- Size: 1,018 training samples
- Columns: anchor, positive, and negative
- Approximate statistics based on the first 1000 samples:
anchor positive negative type string string string details min: 39 tokensmean: 160.13 tokensmax: 256 tokens min: 39 tokensmean: 159.86 tokensmax: 256 tokens min: 39 tokensmean: 162.75 tokensmax: 256 tokens - Samples:
- Loss: MultipleNegativesRankingLoss with these parameters:
{ "scale": 20.0, "similarity_fct": "cos_sim" }
task346_hybridqa_classification
- Dataset: task346_hybridqa_classification
- Size: 1,018 training samples
- Columns: anchor, positive, and negative
- Approximate statistics based on the first 1000 samples:
anchor positive negative type string string string details min: 18 tokensmean: 32.87 tokensmax: 68 tokens min: 18 tokensmean: 31.92 tokensmax: 63 tokens min: 19 tokensmean: 31.83 tokensmax: 75 tokens - Samples:
- Loss: MultipleNegativesRankingLoss with these parameters:
{ "scale": 20.0, "similarity_fct": "cos_sim" }
task1211_atomic_classification_hassubevent
- Dataset: task1211_atomic_classification_hassubevent
- Size: 1,018 training samples
- Columns: anchor, positive, and negative
- Approximate statistics based on the first 1000 samples:
anchor positive negative type string string string details min: 11 tokensmean: 16.25 tokensmax: 31 tokens min: 11 tokensmean: 16.02 tokensmax: 29 tokens min: 11 tokensmean: 16.89 tokensmax: 29 tokens - Samples:
- Loss: MultipleNegativesRankingLoss with these parameters:
{ "scale": 20.0, "similarity_fct": "cos_sim" }
task360_spolin_yesand_response_generation
- Dataset: task360_spolin_yesand_response_generation
- Size: 1,018 training samples
- Columns: anchor, positive, and negative
- Approximate statistics based on the first 1000 samples:
anchor positive negative type string string string details min: 7 tokensmean: 22.54 tokensmax: 89 tokens min: 6 tokensmean: 21.16 tokensmax: 92 tokens min: 7 tokensmean: 20.91 tokensmax: 67 tokens - Samples:
- Loss: MultipleNegativesRankingLoss with these parameters:
{ "scale": 20.0, "similarity_fct": "cos_sim" }
task510_reddit_tifu_title_summarization
- Dataset: task510_reddit_tifu_title_summarization
- Size: 1,018 training samples
- Columns: anchor, positive, and negative
- Approximate statistics based on the first 1000 samples:
anchor positive negative type string string string details min: 9 tokensmean: 217.53 tokensmax: 256 tokens min: 20 tokensmean: 218.59 tokensmax: 256 tokens min: 10 tokensmean: 221.41 tokensmax: 256 tokens - Samples:
- Loss: MultipleNegativesRankingLoss with these parameters:
{ "scale": 20.0, "similarity_fct": "cos_sim" }
task511_reddit_tifu_long_text_summarization
- Dataset: task511_reddit_tifu_long_text_summarization
- Size: 1,018 training samples
- Columns: anchor, positive, and negative
- Approximate statistics based on the first 1000 samples:
anchor positive negative type string string string details min: 29 tokensmean: 239.72 tokensmax: 256 tokens min: 76 tokensmean: 238.38 tokensmax: 256 tokens min: 43 tokensmean: 245.03 tokensmax: 256 tokens - Samples:
- Loss: MultipleNegativesRankingLoss with these parameters:
{ "scale": 20.0, "similarity_fct": "cos_sim" }
task345_hybridqa_answer_generation
- Dataset: task345_hybridqa_answer_generation
- Size: 1,018 training samples
- Columns: anchor, positive, and negative
- Approximate statistics based on the first 1000 samples:
anchor positive negative type string string string details min: 9 tokensmean: 22.14 tokensmax: 50 tokens min: 10 tokensmean: 21.6 tokensmax: 70 tokens min: 8 tokensmean: 20.96 tokensmax: 47 tokens - Samples:
- Loss: MultipleNegativesRankingLoss with these parameters:
{ "scale": 20.0, "similarity_fct": "cos_sim" }
task270_csrg_counterfactual_context_generation
- Dataset: task270_csrg_counterfactual_context_generation
- Size: 1,018 training samples
- Columns: anchor, positive, and negative
- Approximate statistics based on the first 1000 samples:
anchor positive negative type string string string details min: 63 tokensmean: 100.05 tokensmax: 158 tokens min: 63 tokensmean: 98.61 tokensmax: 142 tokens min: 62 tokensmean: 100.35 tokensmax: 141 tokens - Samples:
- Loss: MultipleNegativesRankingLoss with these parameters:
{ "scale": 20.0, "similarity_fct": "cos_sim" }
task307_jeopardy_answer_generation_final
- Dataset: task307_jeopardy_answer_generation_final
- Size: 1,018 training samples
- Columns: anchor, positive, and negative
- Approximate statistics based on the first 1000 samples:
anchor positive negative type string string string details min: 15 tokensmean: 29.61 tokensmax: 46 tokens min: 15 tokensmean: 29.31 tokensmax: 53 tokens min: 15 tokensmean: 29.28 tokensmax: 43 tokens - Samples:
- Loss: MultipleNegativesRankingLoss with these parameters:
{ "scale": 20.0, "similarity_fct": "cos_sim" }
task001_quoref_question_generation
- Dataset: task001_quoref_question_generation
- Size: 1,018 training samples
- Columns: anchor, positive, and negative
- Approximate statistics based on the first 1000 samples:
anchor positive negative type string string string details min: 201 tokensmean: 254.96 tokensmax: 256 tokens min: 99 tokensmean: 254.28 tokensmax: 256 tokens min: 173 tokensmean: 255.13 tokensmax: 256 tokens - Samples:
- Loss: MultipleNegativesRankingLoss with these parameters:
{ "scale": 20.0, "similarity_fct": "cos_sim" }
task089_swap_words_verification
- Dataset: task089_swap_words_verification
- Size: 1,018 training samples
- Columns: anchor, positive, and negative
- Approximate statistics based on the first 1000 samples:
anchor positive negative type string string string details min: 9 tokensmean: 12.86 tokensmax: 28 tokens min: 9 tokensmean: 12.64 tokensmax: 24 tokens min: 9 tokensmean: 12.26 tokensmax: 22 tokens - Samples:
- Loss: MultipleNegativesRankingLoss with these parameters:
{ "scale": 20.0, "similarity_fct": "cos_sim" }
task1196_atomic_classification_oeffect
- Dataset: task1196_atomic_classification_oeffect
- Size: 1,018 training samples
- Columns: anchor, positive, and negative
- Approximate statistics based on the first 1000 samples:
anchor positive negative type string string string details min: 14 tokensmean: 18.79 tokensmax: 41 tokens min: 14 tokensmean: 18.57 tokensmax: 30 tokens min: 14 tokensmean: 18.51 tokensmax: 29 tokens - Samples:
- Loss: MultipleNegativesRankingLoss with these parameters:
{ "scale": 20.0, "similarity_fct": "cos_sim" }
task080_piqa_answer_generation
- Dataset: task080_piqa_answer_generation
- Size: 1,018 training samples
- Columns: anchor, positive, and negative
- Approximate statistics based on the first 1000 samples:
anchor positive negative type string string string details min: 3 tokensmean: 10.82 tokensmax: 33 tokens min: 3 tokensmean: 10.77 tokensmax: 24 tokens min: 3 tokensmean: 10.03 tokensmax: 26 tokens - Samples:
- Loss: MultipleNegativesRankingLoss with these parameters:
{ "scale": 20.0, "similarity_fct": "cos_sim" }
task1598_nyc_long_text_generation
- Dataset: task1598_nyc_long_text_generation
- Size: 1,018 training samples
- Columns: anchor, positive, and negative
- Approximate statistics based on the first 1000 samples:
anchor positive negative type string string string details min: 17 tokensmean: 35.5 tokensmax: 56 tokens min: 17 tokensmean: 35.66 tokensmax: 56 tokens min: 20 tokensmean: 36.66 tokensmax: 55 tokens - Samples:
- Loss: MultipleNegativesRankingLoss with these parameters:
{ "scale": 20.0, "similarity_fct": "cos_sim" }
task240_tweetqa_question_generation
- Dataset: task240_tweetqa_question_generation
- Size: 1,018 training samples
- Columns: anchor, positive, and negative
- Approximate statistics based on the first 1000 samples:
anchor positive negative type string string string details min: 27 tokensmean: 51.18 tokensmax: 94 tokens min: 25 tokensmean: 50.72 tokensmax: 92 tokens min: 20 tokensmean: 51.63 tokensmax: 95 tokens - Samples:
- Loss: MultipleNegativesRankingLoss with these parameters:
{ "scale": 20.0, "similarity_fct": "cos_sim" }
task615_moviesqa_answer_generation
- Dataset: task615_moviesqa_answer_generation
- Size: 1,018 training samples
- Columns: anchor, positive, and negative
- Approximate statistics based on the first 1000 samples:
anchor positive negative type string string string details min: 6 tokensmean: 11.46 tokensmax: 23 tokens min: 7 tokensmean: 11.44 tokensmax: 19 tokens min: 5 tokensmean: 11.4 tokensmax: 22 tokens - Samples:
- Loss: MultipleNegativesRankingLoss with these parameters:
{ "scale": 20.0, "similarity_fct": "cos_sim" }
task1347_glue_sts-b_similarity_classification
- Dataset: task1347_glue_sts-b_similarity_classification
- Size: 1,018 training samples
- Columns: anchor, positive, and negative
- Approximate statistics based on the first 1000 samples:
anchor positive negative type string string string details min: 17 tokensmean: 31.13 tokensmax: 88 tokens min: 16 tokensmean: 31.12 tokensmax: 92 tokens min: 16 tokensmean: 30.85 tokensmax: 92 tokens - Samples:
- Loss: MultipleNegativesRankingLoss with these parameters:
{ "scale": 20.0, "similarity_fct": "cos_sim" }
task114_is_the_given_word_longest
- Dataset: task114_is_the_given_word_longest
- Size: 1,018 training samples
- Columns: anchor, positive, and negative
- Approximate statistics based on the first 1000 samples:
anchor positive negative type string string string details min: 25 tokensmean: 28.87 tokensmax: 68 tokens min: 25 tokensmean: 28.46 tokensmax: 48 tokens min: 25 tokensmean: 28.7 tokensmax: 47 tokens - Samples:
- Loss: MultipleNegativesRankingLoss with these parameters:
{ "scale": 20.0, "similarity_fct": "cos_sim" }
task292_storycommonsense_character_text_generation
- Dataset: task292_storycommonsense_character_text_generation
- Size: 1,018 training samples
- Columns: anchor, positive, and negative
- Approximate statistics based on the first 1000 samples:
anchor positive negative type string string string details min: 43 tokensmean: 67.87 tokensmax: 98 tokens min: 46 tokensmean: 67.11 tokensmax: 104 tokens min: 43 tokensmean: 69.05 tokensmax: 96 tokens - Samples:
- Loss: MultipleNegativesRankingLoss with these parameters:
{ "scale": 20.0, "similarity_fct": "cos_sim" }
task115_help_advice_classification
- Dataset: task115_help_advice_classification
- Size: 1,018 training samples
- Columns: anchor, positive, and negative
- Approximate statistics based on the first 1000 samples:
anchor positive negative type string string string details min: 2 tokensmean: 19.89 tokensmax: 91 tokens min: 3 tokensmean: 18.13 tokensmax: 92 tokens min: 4 tokensmean: 19.22 tokensmax: 137 tokens - Samples:
- Loss: MultipleNegativesRankingLoss with these parameters:
{ "scale": 20.0, "similarity_fct": "cos_sim" }
task431_senteval_object_count
- Dataset: task431_senteval_object_count
- Size: 1,018 training samples
- Columns: anchor, positive, and negative
- Approximate statistics based on the first 1000 samples:
anchor positive negative type string string string details min: 7 tokensmean: 16.78 tokensmax: 37 tokens min: 7 tokensmean: 15.12 tokensmax: 36 tokens min: 7 tokensmean: 15.72 tokensmax: 35 tokens - Samples:
- Loss: MultipleNegativesRankingLoss with these parameters:
{ "scale": 20.0, "similarity_fct": "cos_sim" }
task1360_numer_sense_multiple_choice_qa_generation
- Dataset: task1360_numer_sense_multiple_choice_qa_generation
- Size: 1,018 training samples
- Columns: anchor, positive, and negative
- Approximate statistics based on the first 1000 samples:
anchor positive negative type string string string details min: 32 tokensmean: 40.62 tokensmax: 54 tokens min: 32 tokensmean: 40.3 tokensmax: 53 tokens min: 32 tokensmean: 40.28 tokensmax: 60 tokens - Samples:
- Loss: MultipleNegativesRankingLoss with these parameters:
{ "scale": 20.0, "similarity_fct": "cos_sim" }
task177_para-nmt_paraphrasing
- Dataset: task177_para-nmt_paraphrasing
- Size: 1,018 training samples
- Columns: anchor, positive, and negative
- Approximate statistics based on the first 1000 samples:
anchor positive negative type string string string details min: 8 tokensmean: 19.86 tokensmax: 82 tokens min: 9 tokensmean: 18.91 tokensmax: 58 tokens min: 9 tokensmean: 18.22 tokensmax: 36 tokens - Samples:
- Loss: MultipleNegativesRankingLoss with these parameters:
{ "scale": 20.0, "similarity_fct": "cos_sim" }
task132_dais_text_modification
- Dataset: task132_dais_text_modification
- Size: 1,018 training samples
- Columns: anchor, positive, and negative
- Approximate statistics based on the first 1000 samples:
anchor positive negative type string string string details min: 6 tokensmean: 9.3 tokensmax: 15 tokens min: 6 tokensmean: 9.08 tokensmax: 15 tokens min: 6 tokensmean: 10.11 tokensmax: 15 tokens - Samples:
- Loss: MultipleNegativesRankingLoss with these parameters:
{ "scale": 20.0, "similarity_fct": "cos_sim" }
task269_csrg_counterfactual_story_generation
- Dataset: task269_csrg_counterfactual_story_generation
- Size: 1,018 training samples
- Columns: anchor, positive, and negative
- Approximate statistics based on the first 1000 samples:
anchor positive negative type string string string details min: 49 tokensmean: 79.95 tokensmax: 111 tokens min: 53 tokensmean: 79.51 tokensmax: 116 tokens min: 48 tokensmean: 79.5 tokensmax: 114 tokens - Samples:
- Loss: MultipleNegativesRankingLoss with these parameters:
{ "scale": 20.0, "similarity_fct": "cos_sim" }
task233_iirc_link_exists_classification
- Dataset: task233_iirc_link_exists_classification
- Size: 1,018 training samples
- Columns: anchor, positive, and negative
- Approximate statistics based on the first 1000 samples:
anchor positive negative type string string string details min: 145 tokensmean: 235.67 tokensmax: 256 tokens min: 142 tokensmean: 233.59 tokensmax: 256 tokens min: 151 tokensmean: 235.1 tokensmax: 256 tokens - Samples:
- Loss: MultipleNegativesRankingLoss with these parameters:
{ "scale": 20.0, "similarity_fct": "cos_sim" }
task161_count_words_containing_letter
- Dataset: task161_count_words_containing_letter
- Size: 1,018 training samples
- Columns: anchor, positive, and negative
- Approximate statistics based on the first 1000 samples:
anchor positive negative type string string string details min: 27 tokensmean: 30.99 tokensmax: 53 tokens min: 27 tokensmean: 30.8 tokensmax: 61 tokens min: 27 tokensmean: 30.5 tokensmax: 42 tokens - Samples:
- Loss: MultipleNegativesRankingLoss with these parameters:
{ "scale": 20.0, "similarity_fct": "cos_sim" }
task1205_atomic_classification_isafter
- Dataset: task1205_atomic_classification_isafter
- Size: 1,018 training samples
- Columns: anchor, positive, and negative
- Approximate statistics based on the first 1000 samples:
anchor positive negative type string string string details min: 14 tokensmean: 20.91 tokensmax: 37 tokens min: 14 tokensmean: 20.65 tokensmax: 35 tokens min: 14 tokensmean: 21.51 tokensmax: 37 tokens - Samples:
- Loss: MultipleNegativesRankingLoss with these parameters:
{ "scale": 20.0, "similarity_fct": "cos_sim" }
task571_recipe_nlg_ner_generation
- Dataset: task571_recipe_nlg_ner_generation
- Size: 1,018 training samples
- Columns: anchor, positive, and negative
- Approximate statistics based on the first 1000 samples:
anchor positive negative type string string string details min: 5 tokensmean: 118.38 tokensmax: 256 tokens min: 7 tokensmean: 118.92 tokensmax: 256 tokens min: 6 tokensmean: 111.39 tokensmax: 256 tokens - Samples:
- Loss: MultipleNegativesRankingLoss with these parameters:
{ "scale": 20.0, "similarity_fct": "cos_sim" }
task1292_yelp_review_full_text_categorization
- Dataset: task1292_yelp_review_full_text_categorization
- Size: 1,018 training samples
- Columns: anchor, positive, and negative
- Approximate statistics based on the first 1000 samples:
anchor positive negative type string string string details min: 4 tokensmean: 136.66 tokensmax: 256 tokens min: 7 tokensmean: 146.65 tokensmax: 256 tokens min: 3 tokensmean: 146.05 tokensmax: 256 tokens - Samples:
- Loss: MultipleNegativesRankingLoss with these parameters:
{ "scale": 20.0, "similarity_fct": "cos_sim" }
task428_senteval_inversion
- Dataset: task428_senteval_inversion
- Size: 1,018 training samples
- Columns: anchor, positive, and negative
- Approximate statistics based on the first 1000 samples:
anchor positive negative type string string string details min: 7 tokensmean: 16.69 tokensmax: 32 tokens min: 7 tokensmean: 14.58 tokensmax: 31 tokens min: 7 tokensmean: 15.26 tokensmax: 34 tokens - Samples:
- Loss: MultipleNegativesRankingLoss with these parameters:
{ "scale": 20.0, "similarity_fct": "cos_sim" }
task311_race_question_generation
- Dataset: task311_race_question_generation
- Size: 1,018 training samples
- Columns: anchor, positive, and negative
- Approximate statistics based on the first 1000 samples:
anchor positive negative type string string string details min: 115 tokensmean: 254.87 tokensmax: 256 tokens min: 137 tokensmean: 254.4 tokensmax: 256 tokens min: 171 tokensmean: 255.44 tokensmax: 256 tokens - Samples:
- Loss: MultipleNegativesRankingLoss with these parameters:
{ "scale": 20.0, "similarity_fct": "cos_sim" }
task429_senteval_tense
- Dataset: task429_senteval_tense
- Size: 1,018 training samples
- Columns: anchor, positive, and negative
- Approximate statistics based on the first 1000 samples:
anchor positive negative type string string string details min: 7 tokensmean: 15.84 tokensmax: 37 tokens min: 6 tokensmean: 13.96 tokensmax: 33 tokens min: 7 tokensmean: 15.25 tokensmax: 36 tokens - Samples:
- Loss: MultipleNegativesRankingLoss with these parameters:
{ "scale": 20.0, "similarity_fct": "cos_sim" }
task403_creak_commonsense_inference
- Dataset: task403_creak_commonsense_inference
- Size: 1,018 training samples
- Columns: anchor, positive, and negative
- Approximate statistics based on the first 1000 samples:
anchor positive negative type string string string details min: 13 tokensmean: 30.24 tokensmax: 104 tokens min: 13 tokensmean: 29.39 tokensmax: 108 tokens min: 13 tokensmean: 29.32 tokensmax: 122 tokens - Samples:
- Loss: MultipleNegativesRankingLoss with these parameters:
{ "scale": 20.0, "similarity_fct": "cos_sim" }
task929_products_reviews_classification
- Dataset: task929_products_reviews_classification
- Size: 1,018 training samples
- Columns: anchor, positive, and negative
- Approximate statistics based on the first 1000 samples:
anchor positive negative type string string string details min: 5 tokensmean: 69.68 tokensmax: 126 tokens min: 6 tokensmean: 70.66 tokensmax: 123 tokens min: 6 tokensmean: 70.61 tokensmax: 123 tokens - Samples:
- Loss: MultipleNegativesRankingLoss with these parameters:
{ "scale": 20.0, "similarity_fct": "cos_sim" }
task582_naturalquestion_answer_generation
- Dataset: task582_naturalquestion_answer_generation
- Size: 1,018 training samples
- Columns: anchor, positive, and negative
- Approximate statistics based on the first 1000 samples:
anchor positive negative type string string string details min: 10 tokensmean: 11.71 tokensmax: 25 tokens min: 10 tokensmean: 11.65 tokensmax: 24 tokens min: 10 tokensmean: 11.73 tokensmax: 25 tokens - Samples:
- Loss: MultipleNegativesRankingLoss with these parameters:
{ "scale": 20.0, "similarity_fct": "cos_sim" }
task237_iirc_answer_from_subtext_answer_generation
- Dataset: task237_iirc_answer_from_subtext_answer_generation
- Size: 1,018 training samples
- Columns: anchor, positive, and negative
- Approximate statistics based on the first 1000 samples:
anchor positive negative type string string string details min: 22 tokensmean: 66.3 tokensmax: 256 tokens min: 25 tokensmean: 64.61 tokensmax: 256 tokens min: 23 tokensmean: 61.49 tokensmax: 161 tokens - Samples:
- Loss: MultipleNegativesRankingLoss with these parameters:
{ "scale": 20.0, "similarity_fct": "cos_sim" }
task050_multirc_answerability
- Dataset: task050_multirc_answerability
- Size: 1,018 training samples
- Columns: anchor, positive, and negative
- Approximate statistics based on the first 1000 samples:
anchor positive negative type string string string details min: 15 tokensmean: 32.3 tokensmax: 112 tokens min: 14 tokensmean: 31.56 tokensmax: 93 tokens min: 15 tokensmean: 32.13 tokensmax: 159 tokens - Samples:
- Loss: MultipleNegativesRankingLoss with these parameters:
{ "scale": 20.0, "similarity_fct": "cos_sim" }
task184_break_generate_question
- Dataset: task184_break_generate_question
- Size: 1,018 training samples
- Columns: anchor, positive, and negative
- Approximate statistics based on the first 1000 samples:
anchor positive negative type string string string details min: 13 tokensmean: 39.73 tokensmax: 147 tokens min: 13 tokensmean: 38.83 tokensmax: 149 tokens min: 13 tokensmean: 39.61 tokensmax: 148 tokens - Samples:
- Loss: MultipleNegativesRankingLoss with these parameters:
{ "scale": 20.0, "similarity_fct": "cos_sim" }
task669_ambigqa_answer_generation
- Dataset: task669_ambigqa_answer_generation
- Size: 1,018 training samples
- Columns: anchor, positive, and negative
- Approximate statistics based on the first 1000 samples:
anchor positive negative type string string string details min: 10 tokensmean: 12.94 tokensmax: 23 tokens min: 10 tokensmean: 12.88 tokensmax: 27 tokens min: 11 tokensmean: 12.76 tokensmax: 22 tokens - Samples:
- Loss: MultipleNegativesRankingLoss with these parameters:
{ "scale": 20.0, "similarity_fct": "cos_sim" }
task169_strategyqa_sentence_generation
- Dataset: task169_strategyqa_sentence_generation
- Size: 1,018 training samples
- Columns: anchor, positive, and negative
- Approximate statistics based on the first 1000 samples:
anchor positive negative type string string string details min: 19 tokensmean: 35.21 tokensmax: 65 tokens min: 22 tokensmean: 34.25 tokensmax: 60 tokens min: 19 tokensmean: 33.3 tokensmax: 65 tokens - Samples:
- Loss: MultipleNegativesRankingLoss with these parameters:
{ "scale": 20.0, "similarity_fct": "cos_sim" }
task500_scruples_anecdotes_title_generation
- Dataset: task500_scruples_anecdotes_title_generation
- Size: 1,018 training samples
- Columns: anchor, positive, and negative
- Approximate statistics based on the first 1000 samples:
anchor positive negative type string string string details min: 14 tokensmean: 225.76 tokensmax: 256 tokens min: 31 tokensmean: 233.16 tokensmax: 256 tokens min: 27 tokensmean: 235.28 tokensmax: 256 tokens - Samples:
- Loss: MultipleNegativesRankingLoss with these parameters:
{ "scale": 20.0, "similarity_fct": "cos_sim" }
task241_tweetqa_classification
- Dataset: task241_tweetqa_classification
- Size: 1,018 training samples
- Columns: anchor, positive, and negative
- Approximate statistics based on the first 1000 samples:
anchor positive negative type string string string details min: 31 tokensmean: 61.75 tokensmax: 92 tokens min: 36 tokensmean: 62.23 tokensmax: 106 tokens min: 31 tokensmean: 61.7 tokensmax: 92 tokens - Samples:
- Loss: MultipleNegativesRankingLoss with these parameters:
{ "scale": 20.0, "similarity_fct": "cos_sim" }
task1345_glue_qqp_question_paraprashing
- Dataset: task1345_glue_qqp_question_paraprashing
- Size: 1,018 training samples
- Columns: anchor, positive, and negative
- Approximate statistics based on the first 1000 samples:
anchor positive negative type string string string details min: 6 tokensmean: 16.86 tokensmax: 60 tokens min: 6 tokensmean: 15.83 tokensmax: 69 tokens min: 6 tokensmean: 16.62 tokensmax: 51 tokens - Samples:
- Loss: MultipleNegativesRankingLoss with these parameters:
{ "scale": 20.0, "similarity_fct": "cos_sim" }
task218_rocstories_swap_order_answer_generation
- Dataset: task218_rocstories_swap_order_answer_generation
- Size: 1,018 training samples
- Columns: anchor, positive, and negative
- Approximate statistics based on the first 1000 samples:
anchor positive negative type string string string details min: 48 tokensmean: 72.41 tokensmax: 118 tokens min: 48 tokensmean: 72.48 tokensmax: 102 tokens min: 47 tokensmean: 72.1 tokensmax: 106 tokens - Samples:
- Loss: MultipleNegativesRankingLoss with these parameters:
{ "scale": 20.0, "similarity_fct": "cos_sim" }
task613_politifact_text_generation
- Dataset: task613_politifact_text_generation
- Size: 1,018 training samples
- Columns: anchor, positive, and negative
- Approximate statistics based on the first 1000 samples:
anchor positive negative type string string string details min: 4 tokensmean: 24.87 tokensmax: 75 tokens min: 7 tokensmean: 23.39 tokensmax: 56 tokens min: 5 tokensmean: 23.07 tokensmax: 61 tokens - Samples:
- Loss: MultipleNegativesRankingLoss with these parameters:
{ "scale": 20.0, "similarity_fct": "cos_sim" }
task1167_penn_treebank_coarse_pos_tagging
- Dataset: task1167_penn_treebank_coarse_pos_tagging
- Size: 1,018 training samples
- Columns: anchor, positive, and negative
- Approximate statistics based on the first 1000 samples:
anchor positive negative type string string string details min: 16 tokensmean: 53.65 tokensmax: 200 tokens min: 16 tokensmean: 53.64 tokensmax: 220 tokens min: 16 tokensmean: 54.8 tokensmax: 202 tokens - Samples:
- Loss: MultipleNegativesRankingLoss with these parameters:
{ "scale": 20.0, "similarity_fct": "cos_sim" }
task1422_mathqa_physics
- Dataset: task1422_mathqa_physics
- Size: 1,018 training samples
- Columns: anchor, positive, and negative
- Approximate statistics based on the first 1000 samples:
anchor positive negative type string string string details min: 34 tokensmean: 72.71 tokensmax: 164 tokens min: 38 tokensmean: 71.93 tokensmax: 157 tokens min: 39 tokensmean: 72.67 tokensmax: 155 tokens - Samples:
- Loss: MultipleNegativesRankingLoss with these parameters:
{ "scale": 20.0, "similarity_fct": "cos_sim" }
task247_dream_answer_generation
- Dataset: task247_dream_answer_generation
- Size: 1,018 training samples
- Columns: anchor, positive, and negative
- Approximate statistics based on the first 1000 samples:
anchor positive negative type string string string details min: 38 tokensmean: 160.28 tokensmax: 256 tokens min: 39 tokensmean: 159.0 tokensmax: 256 tokens min: 41 tokensmean: 167.8 tokensmax: 256 tokens - Samples:
- Loss: MultipleNegativesRankingLoss with these parameters:
{ "scale": 20.0, "similarity_fct": "cos_sim" }
task199_mnli_classification
- Dataset: task199_mnli_classification
- Size: 1,018 training samples
- Columns: anchor, positive, and negative
- Approximate statistics based on the first 1000 samples:
anchor positive negative type string string string details min: 13 tokensmean: 43.07 tokensmax: 127 tokens min: 11 tokensmean: 44.72 tokensmax: 149 tokens min: 11 tokensmean: 43.81 tokensmax: 113 tokens - Samples:
- Loss: MultipleNegativesRankingLoss with these parameters:
{ "scale": 20.0, "similarity_fct": "cos_sim" }
task164_mcscript_question_answering_text
- Dataset: task164_mcscript_question_answering_text
- Size: 1,018 training samples
- Columns: anchor, positive, and negative
- Approximate statistics based on the first 1000 samples:
anchor positive negative type string string string details min: 150 tokensmean: 200.63 tokensmax: 256 tokens min: 150 tokensmean: 200.9 tokensmax: 256 tokens min: 142 tokensmean: 200.85 tokensmax: 256 tokens - Samples:
- Loss: MultipleNegativesRankingLoss with these parameters:
{ "scale": 20.0, "similarity_fct": "cos_sim" }
task1541_agnews_classification
- Dataset: task1541_agnews_classification
- Size: 1,018 training samples
- Columns: anchor, positive, and negative
- Approximate statistics based on the first 1000 samples:
anchor positive negative type string string string details min: 21 tokensmean: 53.59 tokensmax: 256 tokens min: 18 tokensmean: 53.09 tokensmax: 256 tokens min: 18 tokensmean: 53.95 tokensmax: 161 tokens - Samples:
- Loss: MultipleNegativesRankingLoss with these parameters:
{ "scale": 20.0, "similarity_fct": "cos_sim" }
task516_senteval_conjoints_inversion
- Dataset: task516_senteval_conjoints_inversion
- Size: 1,018 training samples
- Columns: anchor, positive, and negative
- Approximate statistics based on the first 1000 samples:
anchor positive negative type string string string details min: 8 tokensmean: 20.33 tokensmax: 34 tokens min: 8 tokensmean: 19.01 tokensmax: 34 tokens min: 8 tokensmean: 18.96 tokensmax: 34 tokens - Samples:
- Loss: MultipleNegativesRankingLoss with these parameters:
{ "scale": 20.0, "similarity_fct": "cos_sim" }
task294_storycommonsense_motiv_text_generation
- Dataset: task294_storycommonsense_motiv_text_generation
- Size: 1,018 training samples
- Columns: anchor, positive, and negative
- Approximate statistics based on the first 1000 samples:
anchor positive negative type string string string details min: 14 tokensmean: 40.09 tokensmax: 86 tokens min: 14 tokensmean: 40.77 tokensmax: 86 tokens min: 14 tokensmean: 39.86 tokensmax: 86 tokens - Samples:
- Loss: MultipleNegativesRankingLoss with these parameters:
{ "scale": 20.0, "similarity_fct": "cos_sim" }
task501_scruples_anecdotes_post_type_verification
- Dataset: task501_scruples_anecdotes_post_type_verification
- Size: 1,018 training samples
- Columns: anchor, positive, and negative
- Approximate statistics based on the first 1000 samples:
anchor positive negative type string string string details min: 18 tokensmean: 231.55 tokensmax: 256 tokens min: 12 tokensmean: 235.21 tokensmax: 256 tokens min: 18 tokensmean: 234.47 tokensmax: 256 tokens - Samples:
- Loss: MultipleNegativesRankingLoss with these parameters:
{ "scale": 20.0, "similarity_fct": "cos_sim" }
task213_rocstories_correct_ending_classification
- Dataset: task213_rocstories_correct_ending_classification
- Size: 1,018 training samples
- Columns: anchor, positive, and negative
- Approximate statistics based on the first 1000 samples:
anchor positive negative type string string string details min: 62 tokensmean: 86.17 tokensmax: 125 tokens min: 60 tokensmean: 85.49 tokensmax: 131 tokens min: 59 tokensmean: 86.18 tokensmax: 131 tokens - Samples:
- Loss: MultipleNegativesRankingLoss with these parameters:
{ "scale": 20.0, "similarity_fct": "cos_sim" }
task821_protoqa_question_generation
- Dataset: task821_protoqa_question_generation
- Size: 1,018 training samples
- Columns: anchor, positive, and negative
- Approximate statistics based on the first 1000 samples:
anchor positive negative type string string string details min: 5 tokensmean: 14.6 tokensmax: 61 tokens min: 5 tokensmean: 14.95 tokensmax: 35 tokens min: 5 tokensmean: 13.89 tokensmax: 93 tokens - Samples:
- Loss: MultipleNegativesRankingLoss with these parameters:
{ "scale": 20.0, "similarity_fct": "cos_sim" }
task493_review_polarity_classification
- Dataset: task493_review_polarity_classification
- Size: 1,018 training samples
- Columns: anchor, positive, and negative
- Approximate statistics based on the first 1000 samples:
anchor positive negative type string string string details min: 18 tokensmean: 100.91 tokensmax: 256 tokens min: 19 tokensmean: 107.28 tokensmax: 256 tokens min: 14 tokensmean: 113.07 tokensmax: 256 tokens - Samples:
- Loss: MultipleNegativesRankingLoss with these parameters:
{ "scale": 20.0, "similarity_fct": "cos_sim" }
task308_jeopardy_answer_generation_all
- Dataset: task308_jeopardy_answer_generation_all
- Size: 1,018 training samples
- Columns: anchor, positive, and negative
- Approximate statistics based on the first 1000 samples:
anchor positive negative type string string string details min: 12 tokensmean: 27.9 tokensmax: 50 tokens min: 10 tokensmean: 26.98 tokensmax: 44 tokens min: 9 tokensmean: 27.48 tokensmax: 48 tokens - Samples:
- Loss: MultipleNegativesRankingLoss with these parameters:
{ "scale": 20.0, "similarity_fct": "cos_sim" }
task1595_event2mind_text_generation_1
- Dataset: task1595_event2mind_text_generation_1
- Size: 1,018 training samples
- Columns: anchor, positive, and negative
- Approximate statistics based on the first 1000 samples:
anchor positive negative type string string string details min: 6 tokensmean: 9.86 tokensmax: 18 tokens min: 6 tokensmean: 9.97 tokensmax: 20 tokens min: 6 tokensmean: 10.02 tokensmax: 20 tokens - Samples:
- Loss: MultipleNegativesRankingLoss with these parameters:
{ "scale": 20.0, "similarity_fct": "cos_sim" }
task040_qasc_question_generation
- Dataset: task040_qasc_question_generation
- Size: 1,018 training samples
- Columns: anchor, positive, and negative
- Approximate statistics based on the first 1000 samples:
anchor positive negative type string string string details min: 8 tokensmean: 15.04 tokensmax: 29 tokens min: 7 tokensmean: 15.05 tokensmax: 30 tokens min: 8 tokensmean: 13.84 tokensmax: 32 tokens - Samples:
- Loss: MultipleNegativesRankingLoss with these parameters:
{ "scale": 20.0, "similarity_fct": "cos_sim" }
task231_iirc_link_classification
- Dataset: task231_iirc_link_classification
- Size: 1,018 training samples
- Columns: anchor, positive, and negative
- Approximate statistics based on the first 1000 samples:
anchor positive negative type string string string details min: 179 tokensmean: 246.31 tokensmax: 256 tokens min: 170 tokensmean: 245.93 tokensmax: 256 tokens min: 161 tokensmean: 247.13 tokensmax: 256 tokens - Samples:
- Loss: MultipleNegativesRankingLoss with these parameters:
{ "scale": 20.0, "similarity_fct": "cos_sim" }
task1727_wiqa_what_is_the_effect
- Dataset: task1727_wiqa_what_is_the_effect
- Size: 1,018 training samples
- Columns: anchor, positive, and negative
- Approximate statistics based on the first 1000 samples:
anchor positive negative type string string string details min: 44 tokensmean: 95.17 tokensmax: 183 tokens min: 44 tokensmean: 95.18 tokensmax: 185 tokens min: 43 tokensmean: 95.42 tokensmax: 183 tokens - Samples:
- Loss: MultipleNegativesRankingLoss with these parameters:
{ "scale": 20.0, "similarity_fct": "cos_sim" }
task578_curiosity_dialogs_answer_generation
- Dataset: task578_curiosity_dialogs_answer_generation
- Size: 1,018 training samples
- Columns: anchor, positive, and negative
- Approximate statistics based on the first 1000 samples:
anchor positive negative type string string string details min: 10 tokensmean: 229.66 tokensmax: 256 tokens min: 118 tokensmean: 235.49 tokensmax: 256 tokens min: 12 tokensmean: 229.46 tokensmax: 256 tokens - Samples:
- Loss: MultipleNegativesRankingLoss with these parameters:
{ "scale": 20.0, "similarity_fct": "cos_sim" }
task310_race_classification
- Dataset: task310_race_classification
- Size: 1,018 training samples
- Columns: anchor, positive, and negative
- Approximate statistics based on the first 1000 samples:
anchor positive negative type string string string details min: 101 tokensmean: 254.9 tokensmax: 256 tokens min: 218 tokensmean: 255.78 tokensmax: 256 tokens min: 101 tokensmean: 254.9 tokensmax: 256 tokens - Samples:
- Loss: MultipleNegativesRankingLoss with these parameters:
{ "scale": 20.0, "similarity_fct": "cos_sim" }
task309_race_answer_generation
- Dataset: task309_race_answer_generation
- Size: 1,018 training samples
- Columns: anchor, positive, and negative
- Approximate statistics based on the first 1000 samples:
anchor positive negative type string string string details min: 75 tokensmean: 254.99 tokensmax: 256 tokens min: 204 tokensmean: 255.6 tokensmax: 256 tokens min: 75 tokensmean: 255.19 tokensmax: 256 tokens - Samples:
- Loss: MultipleNegativesRankingLoss with these parameters:
{ "scale": 20.0, "similarity_fct": "cos_sim" }
task379_agnews_topic_classification
- Dataset: task379_agnews_topic_classification
- Size: 1,018 training samples
- Columns: anchor, positive, and negative
- Approximate statistics based on the first 1000 samples:
anchor positive negative type string string string details min: 20 tokensmean: 54.89 tokensmax: 193 tokens min: 20 tokensmean: 54.64 tokensmax: 175 tokens min: 21 tokensmean: 54.78 tokensmax: 187 tokens - Samples:
- Loss: MultipleNegativesRankingLoss with these parameters:
{ "scale": 20.0, "similarity_fct": "cos_sim" }
task030_winogrande_full_person
- Dataset: task030_winogrande_full_person
- Size: 1,018 training samples
- Columns: anchor, positive, and negative
- Approximate statistics based on the first 1000 samples:
anchor positive negative type string string string details min: 7 tokensmean: 7.59 tokensmax: 12 tokens min: 7 tokensmean: 7.49 tokensmax: 12 tokens min: 7 tokensmean: 7.38 tokensmax: 11 tokens - Samples:
- Loss: MultipleNegativesRankingLoss with these parameters:
{ "scale": 20.0, "similarity_fct": "cos_sim" }
task1540_parsed_pdfs_summarization
- Dataset: task1540_parsed_pdfs_summarization
- Size: 1,018 training samples
- Columns: anchor, positive, and negative
- Approximate statistics based on the first 1000 samples:
anchor positive negative type string string string details min: 3 tokensmean: 188.4 tokensmax: 256 tokens min: 46 tokensmean: 190.16 tokensmax: 256 tokens min: 3 tokensmean: 192.07 tokensmax: 256 tokens - Samples:
- Loss: MultipleNegativesRankingLoss with these parameters:
{ "scale": 20.0, "similarity_fct": "cos_sim" }
task039_qasc_find_overlapping_words
- Dataset: task039_qasc_find_overlapping_words
- Size: 1,018 training samples
- Columns: anchor, positive, and negative
- Approximate statistics based on the first 1000 samples:
anchor positive negative type string string string details min: 16 tokensmean: 30.48 tokensmax: 55 tokens min: 16 tokensmean: 30.05 tokensmax: 57 tokens min: 16 tokensmean: 30.65 tokensmax: 60 tokens - Samples:
- Loss: MultipleNegativesRankingLoss with these parameters:
{ "scale": 20.0, "similarity_fct": "cos_sim" }
task1206_atomic_classification_isbefore
- Dataset: task1206_atomic_classification_isbefore
- Size: 1,018 training samples
- Columns: anchor, positive, and negative
- Approximate statistics based on the first 1000 samples:
anchor positive negative type string string string details min: 14 tokensmean: 21.2 tokensmax: 40 tokens min: 14 tokensmean: 20.77 tokensmax: 31 tokens min: 14 tokensmean: 21.41 tokensmax: 31 tokens - Samples:
- Loss: MultipleNegativesRankingLoss with these parameters:
{ "scale": 20.0, "similarity_fct": "cos_sim" }
task157_count_vowels_and_consonants
- Dataset: task157_count_vowels_and_consonants
- Size: 1,018 training samples
- Columns: anchor, positive, and negative
- Approximate statistics based on the first 1000 samples:
anchor positive negative type string string string details min: 24 tokensmean: 28.0 tokensmax: 41 tokens min: 24 tokensmean: 27.91 tokensmax: 41 tokens min: 24 tokensmean: 28.3 tokensmax: 39 tokens - Samples:
- Loss: MultipleNegativesRankingLoss with these parameters:
{ "scale": 20.0, "similarity_fct": "cos_sim" }
task339_record_answer_generation
- Dataset: task339_record_answer_generation
- Size: 1,018 training samples
- Columns: anchor, positive, and negative
- Approximate statistics based on the first 1000 samples:
anchor positive negative type string string string details min: 171 tokensmean: 235.1 tokensmax: 256 tokens min: 171 tokensmean: 234.38 tokensmax: 256 tokens min: 171 tokensmean: 232.38 tokensmax: 256 tokens - Samples:
- Loss: MultipleNegativesRankingLoss with these parameters:
{ "scale": 20.0, "similarity_fct": "cos_sim" }
task453_swag_answer_generation
- Dataset: task453_swag_answer_generation
- Size: 1,018 training samples
- Columns: anchor, positive, and negative
- Approximate statistics based on the first 1000 samples:
anchor positive negative type string string string details min: 9 tokensmean: 18.56 tokensmax: 60 tokens min: 9 tokensmean: 18.16 tokensmax: 63 tokens min: 9 tokensmean: 17.5 tokensmax: 55 tokens - Samples:
- Loss: MultipleNegativesRankingLoss with these parameters:
{ "scale": 20.0, "similarity_fct": "cos_sim" }
task848_pubmedqa_classification
- Dataset: task848_pubmedqa_classification
- Size: 1,018 training samples
- Columns: anchor, positive, and negative
- Approximate statistics based on the first 1000 samples:
anchor positive negative type string string string details min: 21 tokensmean: 248.87 tokensmax: 256 tokens min: 21 tokensmean: 250.0 tokensmax: 256 tokens min: 84 tokensmean: 251.62 tokensmax: 256 tokens - Samples:
- Loss: MultipleNegativesRankingLoss with these parameters:
{ "scale": 20.0, "similarity_fct": "cos_sim" }
task673_google_wellformed_query_classification
- Dataset: task673_google_wellformed_query_classification
- Size: 1,018 training samples
- Columns: anchor, positive, and negative
- Approximate statistics based on the first 1000 samples:
anchor positive negative type string string string details min: 6 tokensmean: 11.6 tokensmax: 27 tokens min: 6 tokensmean: 11.22 tokensmax: 24 tokens min: 6 tokensmean: 11.34 tokensmax: 22 tokens - Samples:
- Loss: MultipleNegativesRankingLoss with these parameters:
{ "scale": 20.0, "similarity_fct": "cos_sim" }
task676_ollie_relationship_answer_generation
- Dataset: task676_ollie_relationship_answer_generation
- Size: 1,018 training samples
- Columns: anchor, positive, and negative
- Approximate statistics based on the first 1000 samples:
anchor positive negative type string string string details min: 29 tokensmean: 50.99 tokensmax: 113 tokens min: 29 tokensmean: 49.39 tokensmax: 134 tokens min: 30 tokensmean: 51.48 tokensmax: 113 tokens - Samples:
- Loss: MultipleNegativesRankingLoss with these parameters:
{ "scale": 20.0, "similarity_fct": "cos_sim" }
task268_casehold_legal_answer_generation
- Dataset: task268_casehold_legal_answer_generation
- Size: 1,018 training samples
- Columns: anchor, positive, and negative
- Approximate statistics based on the first 1000 samples:
anchor positive negative type string string string details min: 235 tokensmean: 255.96 tokensmax: 256 tokens min: 156 tokensmean: 255.46 tokensmax: 256 tokens min: 226 tokensmean: 255.94 tokensmax: 256 tokens - Samples:
- Loss: MultipleNegativesRankingLoss with these parameters:
{ "scale": 20.0, "similarity_fct": "cos_sim" }
task844_financial_phrasebank_classification
- Dataset: task844_financial_phrasebank_classification
- Size: 1,018 training samples
- Columns: anchor, positive, and negative
- Approximate statistics based on the first 1000 samples:
anchor positive negative type string string string details min: 14 tokensmean: 39.8 tokensmax: 86 tokens min: 13 tokensmean: 38.45 tokensmax: 78 tokens min: 15 tokensmean: 39.06 tokensmax: 86 tokens - Samples:
- Loss: MultipleNegativesRankingLoss with these parameters:
{ "scale": 20.0, "similarity_fct": "cos_sim" }
task330_gap_answer_generation
- Dataset: task330_gap_answer_generation
- Size: 1,018 training samples
- Columns: anchor, positive, and negative
- Approximate statistics based on the first 1000 samples:
anchor positive negative type string string string details min: 26 tokensmean: 106.78 tokensmax: 256 tokens min: 44 tokensmean: 108.12 tokensmax: 256 tokens min: 45 tokensmean: 110.93 tokensmax: 256 tokens - Samples:
- Loss: MultipleNegativesRankingLoss with these parameters:
{ "scale": 20.0, "similarity_fct": "cos_sim" }
task595_mocha_answer_generation
- Dataset: task595_mocha_answer_generation
- Size: 1,018 training samples
- Columns: anchor, positive, and negative
- Approximate statistics based on the first 1000 samples:
anchor positive negative type string string string details min: 44 tokensmean: 94.08 tokensmax: 178 tokens min: 21 tokensmean: 97.06 tokensmax: 256 tokens min: 19 tokensmean: 118.77 tokensmax: 256 tokens - Samples:
- Loss: MultipleNegativesRankingLoss with these parameters:
{ "scale": 20.0, "similarity_fct": "cos_sim" }
task1285_kpa_keypoint_matching
- Dataset: task1285_kpa_keypoint_matching
- Size: 1,018 training samples
- Columns: anchor, positive, and negative
- Approximate statistics based on the first 1000 samples:
anchor positive negative type string string string details min: 30 tokensmean: 52.36 tokensmax: 92 tokens min: 29 tokensmean: 50.14 tokensmax: 84 tokens min: 31 tokensmean: 53.21 tokensmax: 88 tokens - Samples:
- Loss: MultipleNegativesRankingLoss with these parameters:
{ "scale": 20.0, "similarity_fct": "cos_sim" }
task234_iirc_passage_line_answer_generation
- Dataset: task234_iirc_passage_line_answer_generation
- Size: 1,018 training samples
- Columns: anchor, positive, and negative
- Approximate statistics based on the first 1000 samples:
anchor positive negative type string string string details min: 143 tokensmean: 235.25 tokensmax: 256 tokens min: 155 tokensmean: 235.25 tokensmax: 256 tokens min: 146 tokensmean: 236.25 tokensmax: 256 tokens - Samples:
- Loss: MultipleNegativesRankingLoss with these parameters:
{ "scale": 20.0, "similarity_fct": "cos_sim" }
task494_review_polarity_answer_generation
- Dataset: task494_review_polarity_answer_generation
- Size: 1,018 training samples
- Columns: anchor, positive, and negative
- Approximate statistics based on the first 1000 samples:
anchor positive negative type string string string details min: 3 tokensmean: 106.0 tokensmax: 256 tokens min: 23 tokensmean: 112.36 tokensmax: 256 tokens min: 20 tokensmean: 112.66 tokensmax: 249 tokens - Samples:
- Loss: MultipleNegativesRankingLoss with these parameters:
{ "scale": 20.0, "similarity_fct": "cos_sim" }
task670_ambigqa_question_generation
- Dataset: task670_ambigqa_question_generation
- Size: 1,018 training samples
- Columns: anchor, positive, and negative
- Approximate statistics based on the first 1000 samples:
anchor positive negative type string string string details min: 11 tokensmean: 12.66 tokensmax: 26 tokens min: 11 tokensmean: 12.48 tokensmax: 23 tokens min: 11 tokensmean: 12.24 tokensmax: 18 tokens - Samples:
- Loss: MultipleNegativesRankingLoss with these parameters:
{ "scale": 20.0, "similarity_fct": "cos_sim" }
task289_gigaword_summarization
- Dataset: task289_gigaword_summarization
- Size: 1,018 training samples
- Columns: anchor, positive, and negative
- Approximate statistics based on the first 1000 samples:
anchor positive negative type string string string details min: 25 tokensmean: 51.53 tokensmax: 87 tokens min: 27 tokensmean: 52.0 tokensmax: 87 tokens min: 25 tokensmean: 51.44 tokensmax: 87 tokens - Samples:
- Loss: MultipleNegativesRankingLoss with these parameters:
{ "scale": 20.0, "similarity_fct": "cos_sim" }
npr
- Dataset: npr
- Size: 24,838 training samples
- Columns: anchor, positive, and negative
- Approximate statistics based on the first 1000 samples:
anchor positive negative type string string string details min: 4 tokensmean: 12.74 tokensmax: 32 tokens min: 12 tokensmean: 152.32 tokensmax: 256 tokens min: 14 tokensmean: 119.75 tokensmax: 256 tokens - Samples:
- Loss: MultipleNegativesRankingLoss with these parameters:
{ "scale": 20.0, "similarity_fct": "cos_sim" }
nli
- Dataset: nli
- Size: 49,676 training samples
- Columns: anchor, positive, and negative
- Approximate statistics based on the first 1000 samples:
anchor positive negative type string string string details min: 5 tokensmean: 21.62 tokensmax: 108 tokens min: 4 tokensmean: 12.07 tokensmax: 50 tokens min: 4 tokensmean: 12.21 tokensmax: 44 tokens - Samples:
- Loss: MultipleNegativesRankingLoss with these parameters:
{ "scale": 20.0, "similarity_fct": "cos_sim" }
SimpleWiki
- Dataset: SimpleWiki
- Size: 5,070 training samples
- Columns: anchor, positive, and negative
- Approximate statistics based on the first 1000 samples:
anchor positive negative type string string string details min: 8 tokensmean: 29.35 tokensmax: 256 tokens min: 8 tokensmean: 33.94 tokensmax: 256 tokens min: 10 tokensmean: 56.42 tokensmax: 256 tokens - Samples:
- Loss: MultipleNegativesRankingLoss with these parameters:
{ "scale": 20.0, "similarity_fct": "cos_sim" }
amazon_review_2018
- Dataset: amazon_review_2018
- Size: 99,352 training samples
- Columns: anchor, positive, and negative
- Approximate statistics based on the first 1000 samples:
anchor positive negative type string string string details min: 4 tokensmean: 11.86 tokensmax: 33 tokens min: 11 tokensmean: 88.89 tokensmax: 256 tokens min: 11 tokensmean: 70.8 tokensmax: 256 tokens - Samples:
- Loss: MultipleNegativesRankingLoss with these parameters:
{ "scale": 20.0, "similarity_fct": "cos_sim" }
ccnews_title_text
- Dataset: ccnews_title_text
- Size: 24,838 training samples
- Columns: anchor, positive, and negative
- Approximate statistics based on the first 1000 samples:
anchor positive negative type string string string details min: 6 tokensmean: 15.24 tokensmax: 59 tokens min: 21 tokensmean: 210.26 tokensmax: 256 tokens min: 20 tokensmean: 194.92 tokensmax: 256 tokens - Samples:
- Loss: MultipleNegativesRankingLoss with these parameters:
{ "scale": 20.0, "similarity_fct": "cos_sim" }
agnews
- Dataset: agnews
- Size: 44,606 training samples
- Columns: anchor, positive, and negative
- Approximate statistics based on the first 1000 samples:
anchor positive negative type string string string details min: 5 tokensmean: 11.73 tokensmax: 38 tokens min: 10 tokensmean: 39.85 tokensmax: 256 tokens min: 13 tokensmean: 45.43 tokensmax: 256 tokens - Samples:
- Loss: MultipleNegativesRankingLoss with these parameters:
{ "scale": 20.0, "similarity_fct": "cos_sim" }
xsum
- Dataset: xsum
- Size: 10,140 training samples
- Columns: anchor, positive, and negative
- Approximate statistics based on the first 1000 samples:
anchor positive negative type string string string details min: 8 tokensmean: 27.77 tokensmax: 58 tokens min: 14 tokensmean: 226.87 tokensmax: 256 tokens min: 41 tokensmean: 232.14 tokensmax: 256 tokens - Samples:
- Loss: MultipleNegativesRankingLoss with these parameters:
{ "scale": 20.0, "similarity_fct": "cos_sim" }
msmarco
- Dataset: msmarco
- Size: 173,354 training samples
- Columns: anchor, positive, and negative
- Approximate statistics based on the first 1000 samples:
anchor positive negative type string string string details min: 4 tokensmean: 9.07 tokensmax: 25 tokens min: 19 tokensmean: 82.14 tokensmax: 237 tokens min: 19 tokensmean: 80.54 tokensmax: 252 tokens - Samples:
- Loss: MultipleNegativesRankingLoss with these parameters:
{ "scale": 20.0, "similarity_fct": "cos_sim" }
yahoo_answers_title_answer
- Dataset: yahoo_answers_title_answer
- Size: 24,838 training samples
- Columns: anchor, positive, and negative
- Approximate statistics based on the first 1000 samples:
anchor positive negative type string string string details min: 6 tokensmean: 16.73 tokensmax: 45 tokens min: 5 tokensmean: 82.94 tokensmax: 256 tokens min: 7 tokensmean: 86.15 tokensmax: 256 tokens - Samples:
- Loss: MultipleNegativesRankingLoss with these parameters:
{ "scale": 20.0, "similarity_fct": "cos_sim" }
squad_pairs
- Dataset: squad_pairs
- Size: 24,838 training samples
- Columns: anchor, positive, and negative
- Approximate statistics based on the first 1000 samples:
anchor positive negative type string string string details min: 7 tokensmean: 14.05 tokensmax: 38 tokens min: 32 tokensmean: 153.91 tokensmax: 256 tokens min: 34 tokensmean: 162.67 tokensmax: 256 tokens - Samples:
- Loss: MultipleNegativesRankingLoss with these parameters:
{ "scale": 20.0, "similarity_fct": "cos_sim" }
wow
- Dataset: wow
- Size: 29,908 training samples
- Columns: anchor, positive, and negative
- Approximate statistics based on the first 1000 samples:
anchor positive negative type string string string details min: 3 tokensmean: 88.36 tokensmax: 256 tokens min: 100 tokensmean: 112.02 tokensmax: 150 tokens min: 83 tokensmean: 113.07 tokensmax: 147 tokens - Samples:
- Loss: MultipleNegativesRankingLoss with these parameters:
{ "scale": 20.0, "similarity_fct": "cos_sim" }
mteb-amazon_counterfactual-avs_triplets
- Dataset: mteb-amazon_counterfactual-avs_triplets
- Size: 4,055 training samples
- Columns: anchor, positive, and negative
- Approximate statistics based on the first 1000 samples:
anchor positive negative type string string string details min: 12 tokensmean: 27.68 tokensmax: 137 tokens min: 12 tokensmean: 26.84 tokensmax: 137 tokens min: 12 tokensmean: 26.34 tokensmax: 91 tokens - Samples:
- Loss: MultipleNegativesRankingLoss with these parameters:
{ "scale": 20.0, "similarity_fct": "cos_sim" }
mteb-amazon_massive_intent-avs_triplets
- Dataset: mteb-amazon_massive_intent-avs_triplets
- Size: 11,661 training samples
- Columns: anchor, positive, and negative
- Approximate statistics based on the first 1000 samples:
anchor positive negative type string string string details min: 3 tokensmean: 9.5 tokensmax: 28 tokens min: 3 tokensmean: 9.05 tokensmax: 26 tokens min: 3 tokensmean: 9.45 tokensmax: 25 tokens - Samples:
- Loss: MultipleNegativesRankingLoss with these parameters:
{ "scale": 20.0, "similarity_fct": "cos_sim" }
mteb-amazon_massive_scenario-avs_triplets
- Dataset: mteb-amazon_massive_scenario-avs_triplets
- Size: 11,661 training samples
- Columns: anchor, positive, and negative
- Approximate statistics based on the first 1000 samples:
anchor positive negative type string string string details min: 3 tokensmean: 9.62 tokensmax: 39 tokens min: 3 tokensmean: 9.19 tokensmax: 29 tokens min: 3 tokensmean: 9.59 tokensmax: 24 tokens - Samples:
- Loss: MultipleNegativesRankingLoss with these parameters:
{ "scale": 20.0, "similarity_fct": "cos_sim" }
mteb-amazon_reviews_multi-avs_triplets
- Dataset: mteb-amazon_reviews_multi-avs_triplets
- Size: 198,192 training samples
- Columns: anchor, positive, and negative
- Approximate statistics based on the first 1000 samples:
anchor positive negative type string string string details min: 7 tokensmean: 49.55 tokensmax: 256 tokens min: 6 tokensmean: 49.51 tokensmax: 256 tokens min: 8 tokensmean: 48.42 tokensmax: 256 tokens - Samples:
- Loss: MultipleNegativesRankingLoss with these parameters:
{ "scale": 20.0, "similarity_fct": "cos_sim" }
mteb-banking77-avs_triplets
- Dataset: mteb-banking77-avs_triplets
- Size: 10,139 training samples
- Columns: anchor, positive, and negative
- Approximate statistics based on the first 1000 samples:
anchor positive negative type string string string details min: 4 tokensmean: 15.81 tokensmax: 73 tokens min: 6 tokensmean: 15.77 tokensmax: 73 tokens min: 5 tokensmean: 16.1 tokensmax: 73 tokens - Samples:
- Loss: MultipleNegativesRankingLoss with these parameters:
{ "scale": 20.0, "similarity_fct": "cos_sim" }
mteb-emotion-avs_triplets
- Dataset: mteb-emotion-avs_triplets
- Size: 16,224 training samples
- Columns: anchor, positive, and negative
- Approximate statistics based on the first 1000 samples:
anchor positive negative type string string string details min: 5 tokensmean: 22.04 tokensmax: 67 tokens min: 5 tokensmean: 17.71 tokensmax: 65 tokens min: 5 tokensmean: 21.99 tokensmax: 72 tokens - Samples:
- Loss: MultipleNegativesRankingLoss with these parameters:
{ "scale": 20.0, "similarity_fct": "cos_sim" }
mteb-imdb-avs_triplets
- Dataset: mteb-imdb-avs_triplets
- Size: 24,839 training samples
- Columns: anchor, positive, and negative
- Approximate statistics based on the first 1000 samples:
anchor positive negative type string string string details min: 34 tokensmean: 207.67 tokensmax: 256 tokens min: 36 tokensmean: 223.93 tokensmax: 256 tokens min: 42 tokensmean: 206.87 tokensmax: 256 tokens - Samples:
- Loss: MultipleNegativesRankingLoss with these parameters:
{ "scale": 20.0, "similarity_fct": "cos_sim" }
mteb-mtop_domain-avs_triplets
- Dataset: mteb-mtop_domain-avs_triplets
- Size: 15,715 training samples
- Columns: anchor, positive, and negative
- Approximate statistics based on the first 1000 samples:
anchor positive negative type string string string details min: 4 tokensmean: 10.27 tokensmax: 32 tokens min: 4 tokensmean: 9.62 tokensmax: 24 tokens min: 4 tokensmean: 10.01 tokensmax: 33 tokens - Samples:
- Loss: MultipleNegativesRankingLoss with these parameters:
{ "scale": 20.0, "similarity_fct": "cos_sim" }
mteb-mtop_intent-avs_triplets
- Dataset: mteb-mtop_intent-avs_triplets
- Size: 15,715 training samples
- Columns: anchor, positive, and negative
- Approximate statistics based on the first 1000 samples:
anchor positive negative type string string string details min: 3 tokensmean: 10.22 tokensmax: 35 tokens min: 4 tokensmean: 9.74 tokensmax: 27 tokens min: 3 tokensmean: 10.43 tokensmax: 28 tokens - Samples:
- Loss: MultipleNegativesRankingLoss with these parameters:
{ "scale": 20.0, "similarity_fct": "cos_sim" }
mteb-toxic_conversations_50k-avs_triplets
- Dataset: mteb-toxic_conversations_50k-avs_triplets
- Size: 49,677 training samples
- Columns: anchor, positive, and negative
- Approximate statistics based on the first 1000 samples:
anchor positive negative type string string string details min: 3 tokensmean: 67.17 tokensmax: 256 tokens min: 3 tokensmean: 88.29 tokensmax: 256 tokens min: 3 tokensmean: 64.96 tokensmax: 252 tokens - Samples:
- Loss: MultipleNegativesRankingLoss with these parameters:
{ "scale": 20.0, "similarity_fct": "cos_sim" }
mteb-tweet_sentiment_extraction-avs_triplets
- Dataset: mteb-tweet_sentiment_extraction-avs_triplets
- Size: 27,373 training samples
- Columns: anchor, positive, and negative
- Approximate statistics based on the first 1000 samples:
anchor positive negative type string string string details min: 3 tokensmean: 20.58 tokensmax: 45 tokens min: 2 tokensmean: 20.26 tokensmax: 56 tokens min: 3 tokensmean: 21.1 tokensmax: 59 tokens - Samples:
- Loss: MultipleNegativesRankingLoss with these parameters:
{ "scale": 20.0, "similarity_fct": "cos_sim" }
covid-bing-query-gpt4-avs_triplets
- Dataset: covid-bing-query-gpt4-avs_triplets
- Size: 5,070 training samples
- Columns: anchor, positive, and negative
- Approximate statistics based on the first 1000 samples:
anchor positive negative type string string string details min: 6 tokensmean: 15.28 tokensmax: 33 tokens min: 14 tokensmean: 37.6 tokensmax: 92 tokens min: 16 tokensmean: 38.13 tokensmax: 239 tokens - Samples:
- Loss: MultipleNegativesRankingLoss with these parameters:
{ "scale": 20.0, "similarity_fct": "cos_sim" }
Evaluation Dataset
Unnamed Dataset
- Size: 18,269 evaluation samples
- Columns: anchor, positive, and negative
- Approximate statistics based on the first 1000 samples:
anchor positive negative type string string string details min: 4 tokensmean: 16.04 tokensmax: 55 tokens min: 5 tokensmean: 142.75 tokensmax: 256 tokens min: 5 tokensmean: 144.56 tokensmax: 256 tokens - Samples:
- Loss: MultipleNegativesRankingLoss with these parameters:
{ "scale": 20.0, "similarity_fct": "cos_sim" }
Training Hyperparameters
Non-Default Hyperparameters
eval_strategy: stepsper_device_train_batch_size: 512per_device_eval_batch_size: 512learning_rate: 2e-05num_train_epochs: 10warmup_ratio: 0.1fp16: Truegradient_checkpointing: Truebatch_sampler: no_duplicates
All Hyperparameters
overwrite_output_dir: Falsedo_predict: Falseeval_strategy: stepsprediction_loss_only: Trueper_device_train_batch_size: 512per_device_eval_batch_size: 512per_gpu_train_batch_size: Noneper_gpu_eval_batch_size: Nonegradient_accumulation_steps: 1eval_accumulation_steps: Nonelearning_rate: 2e-05weight_decay: 0.0adam_beta1: 0.9adam_beta2: 0.999adam_epsilon: 1e-08max_grad_norm: 1.0num_train_epochs: 10max_steps: -1lr_scheduler_type: linearlr_scheduler_kwargs: {}warmup_ratio: 0.1warmup_steps: 0log_level: passivelog_level_replica: warninglog_on_each_node: Truelogging_nan_inf_filter: Truesave_safetensors: Truesave_on_each_node: Falsesave_only_model: Falserestore_callback_states_from_checkpoint: Falseno_cuda: Falseuse_cpu: Falseuse_mps_device: Falseseed: 42data_seed: Nonejit_mode_eval: Falseuse_ipex: Falsebf16: Falsefp16: Truefp16_opt_level: O1half_precision_backend: autobf16_full_eval: Falsefp16_full_eval: Falsetf32: Nonelocal_rank: 0ddp_backend: Nonetpu_num_cores: Nonetpu_metrics_debug: Falsedebug: []dataloader_drop_last: Falsedataloader_num_workers: 0dataloader_prefetch_factor: Nonepast_index: -1disable_tqdm: Falseremove_unused_columns: Truelabel_names: Noneload_best_model_at_end: Falseignore_data_skip: Falsefsdp: []fsdp_min_num_params: 0fsdp_config: {'min_num_params': 0, 'xla': False, 'xla_fsdp_v2': False, 'xla_fsdp_grad_ckpt': False}fsdp_transformer_layer_cls_to_wrap: Noneaccelerator_config: {'split_batches': False, 'dispatch_batches': None, 'even_batches': True, 'use_seedable_sampler': True, 'non_blocking': False, 'gradient_accumulation_kwargs': None}deepspeed: Nonelabel_smoothing_factor: 0.0optim: adamw_torchoptim_args: Noneadafactor: Falsegroup_by_length: Falselength_column_name: lengthddp_find_unused_parameters: Noneddp_bucket_cap_mb: Noneddp_broadcast_buffers: Falsedataloader_pin_memory: Truedataloader_persistent_workers: Falseskip_memory_metrics: Trueuse_legacy_prediction_loop: Falsepush_to_hub: Falseresume_from_checkpoint: Nonehub_model_id: Nonehub_strategy: every_savehub_private_repo: Falsehub_always_push: Falsegradient_checkpointing: Truegradient_checkpointing_kwargs: Noneinclude_inputs_for_metrics: Falseeval_do_concat_batches: Truefp16_backend: autopush_to_hub_model_id: Nonepush_to_hub_organization: Nonemp_parameters:auto_find_batch_size: Falsefull_determinism: Falsetorchdynamo: Noneray_scope: lastddp_timeout: 1800torch_compile: Falsetorch_compile_backend: Nonetorch_compile_mode: Nonedispatch_batches: Nonesplit_batches: Noneinclude_tokens_per_second: Falseinclude_num_input_tokens_seen: Falseneftune_noise_alpha: Noneoptim_target_modules: Nonebatch_eval_metrics: Falseeval_on_start: Falsebatch_sampler: no_duplicatesmulti_dataset_batch_sampler: proportional
Training Logs
| Epoch | Step | Training Loss | loss | medi-mteb-dev_max_accuracy |
|---|---|---|---|---|
| 0 | 0 | - | - | 0.8705 |
| 0.1308 | 500 | 2.1744 | 1.5723 | 0.8786 |
| 0.2616 | 1000 | 1.9245 | 1.5045 | 0.8851 |
| 0.3925 | 1500 | 1.9833 | 1.4719 | 0.8882 |
| 0.5233 | 2000 | 1.7492 | 1.4434 | 0.8909 |
| 0.6541 | 2500 | 1.8815 | 1.4244 | 0.8935 |
| 0.7849 | 3000 | 1.7921 | 1.4064 | 0.8949 |
| 0.9158 | 3500 | 1.8495 | 1.3894 | 0.8956 |
| 1.0466 | 4000 | 1.7415 | 1.3744 | 0.8966 |
| 1.1774 | 4500 | 1.8663 | 1.3619 | 0.9005 |
| 1.3082 | 5000 | 1.7016 | 1.3520 | 0.8979 |
| 1.4390 | 5500 | 1.7308 | 1.3467 | 0.9007 |
| 1.5699 | 6000 | 1.6965 | 1.3346 | 0.9021 |
| 1.7007 | 6500 | 1.7355 | 1.3251 | 0.9018 |
| 1.8315 | 7000 | 1.6783 | 1.3156 | 0.9031 |
| 1.9623 | 7500 | 1.6381 | 1.3101 | 0.9047 |
| 2.0931 | 8000 | 1.7169 | 1.3056 | 0.9044 |
| 2.2240 | 8500 | 1.6527 | 1.3070 | 0.9039 |
| 2.3548 | 9000 | 1.7078 | 1.2977 | 0.9055 |
| 2.4856 | 9500 | 1.533 | 1.2991 | 0.9050 |
| 2.6164 | 10000 | 1.6676 | 1.2916 | 0.9057 |
| 2.7473 | 10500 | 1.5866 | 1.2885 | 0.9053 |
| 2.8781 | 11000 | 1.641 | 1.2765 | 0.9066 |
| 3.0089 | 11500 | 1.5193 | 1.2816 | 0.9062 |
| 3.1397 | 12000 | 1.6907 | 1.2804 | 0.9065 |
| 3.2705 | 12500 | 1.557 | 1.2684 | 0.9065 |
| 3.4014 | 13000 | 1.6808 | 1.2711 | 0.9075 |
| 3.5322 | 13500 | 1.4751 | 1.2700 | 0.9072 |
| 3.6630 | 14000 | 1.5934 | 1.2692 | 0.9081 |
| 3.7938 | 14500 | 1.5395 | 1.2672 | 0.9087 |
| 3.9246 | 15000 | 1.5809 | 1.2678 | 0.9072 |
| 4.0555 | 15500 | 1.4972 | 1.2621 | 0.9089 |
| 4.1863 | 16000 | 1.614 | 1.2690 | 0.9070 |
| 4.3171 | 16500 | 1.5186 | 1.2625 | 0.9091 |
| 4.4479 | 17000 | 1.5239 | 1.2629 | 0.9079 |
| 4.5788 | 17500 | 1.5354 | 1.2569 | 0.9086 |
| 4.7096 | 18000 | 1.5134 | 1.2559 | 0.9095 |
| 4.8404 | 18500 | 1.5237 | 1.2494 | 0.9100 |
| 4.9712 | 19000 | 1.5038 | 1.2486 | 0.9113 |
| 5.1020 | 19500 | 1.5527 | 1.2493 | 0.9098 |
| 5.2329 | 20000 | 1.5018 | 1.2521 | 0.9102 |
| 5.3637 | 20500 | 1.584 | 1.2496 | 0.9095 |
| 5.4945 | 21000 | 1.3948 | 1.2467 | 0.9102 |
| 5.6253 | 21500 | 1.5118 | 1.2487 | 0.9098 |
| 5.7561 | 22000 | 1.458 | 1.2471 | 0.9098 |
| 5.8870 | 22500 | 1.5158 | 1.2367 | 0.9105 |
| 6.0178 | 23000 | 1.4091 | 1.2480 | 0.9096 |
| 6.1486 | 23500 | 1.5823 | 1.2456 | 0.9114 |
| 6.2794 | 24000 | 1.4383 | 1.2404 | 0.9101 |
| 6.4103 | 24500 | 1.5606 | 1.2431 | 0.9100 |
| 6.5411 | 25000 | 1.3906 | 1.2386 | 0.9112 |
| 6.6719 | 25500 | 1.4887 | 1.2382 | 0.9103 |
| 6.8027 | 26000 | 1.4347 | 1.2384 | 0.9112 |
| 6.9335 | 26500 | 1.4733 | 1.2395 | 0.9113 |
| 7.0644 | 27000 | 1.4323 | 1.2385 | 0.9111 |
| 7.1952 | 27500 | 1.505 | 1.2413 | 0.9107 |
| 7.3260 | 28000 | 1.4648 | 1.2362 | 0.9114 |
| 7.4568 | 28500 | 1.4252 | 1.2361 | 0.9116 |
| 7.5877 | 29000 | 1.458 | 1.2344 | 0.9118 |
| 7.7185 | 29500 | 1.4309 | 1.2357 | 0.9120 |
| 7.8493 | 30000 | 1.4431 | 1.2330 | 0.9114 |
| 7.9801 | 30500 | 1.4266 | 1.2306 | 0.9127 |
| 8.1109 | 31000 | 1.4803 | 1.2328 | 0.9118 |
| 8.2418 | 31500 | 1.414 | 1.2345 | 0.9110 |
| 8.3726 | 32000 | 1.5456 | 1.2343 | 0.9116 |
| 8.5034 | 32500 | 1.346 | 1.2324 | 0.9118 |
| 8.6342 | 33000 | 1.4467 | 1.2315 | 0.9118 |
| 8.7650 | 33500 | 1.3864 | 1.2330 | 0.9119 |
| 8.8959 | 34000 | 1.4806 | 1.2277 | 0.9119 |
| 9.0267 | 34500 | 1.3381 | 1.2330 | 0.9119 |
| 9.1575 | 35000 | 1.5277 | 1.2315 | 0.9121 |
| 9.2883 | 35500 | 1.3966 | 1.2309 | 0.9112 |
| 9.4192 | 36000 | 1.4921 | 1.2321 | 0.9117 |
| 9.5500 | 36500 | 1.3668 | 1.2303 | 0.9118 |
| 9.6808 | 37000 | 1.4407 | 1.2308 | 0.9121 |
| 9.8116 | 37500 | 1.3852 | 1.2314 | 0.9118 |
| 9.9424 | 38000 | 1.4329 | 1.2300 | 0.9120 |
Framework Versions
- Python: 3.10.10
- Sentence Transformers: 3.1.0.dev0
- Transformers: 4.42.4
- PyTorch: 2.3.1+cu121
- Accelerate: 0.32.1
- Datasets: 2.20.0
- Tokenizers: 0.19.1
Citation
BibTeX
Sentence Transformers
@inproceedings{reimers-2019-sentence-bert,
title = "Sentence-BERT: Sentence Embeddings using Siamese BERT-Networks",
author = "Reimers, Nils and Gurevych, Iryna",
booktitle = "Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing",
month = "11",
year = "2019",
publisher = "Association for Computational Linguistics",
url = "https://arxiv.org/abs/1908.10084",
}
MultipleNegativesRankingLoss
@misc{henderson2017efficient,
title={Efficient Natural Language Response Suggestion for Smart Reply},
author={Matthew Henderson and Rami Al-Rfou and Brian Strope and Yun-hsuan Sung and Laszlo Lukacs and Ruiqi Guo and Sanjiv Kumar and Balint Miklos and Ray Kurzweil},
year={2017},
eprint={1705.00652},
archivePrefix={arXiv},
primaryClass={cs.CL}
}