/ Модель

Характеристики

Контекст
512 токенов
Параметры
25,9 млн
Лицензия
Apache 2.0
Архитектура
bert · dense
Базовая модель
all-MiniLM-L6-v2
Библиотека
sentence-transformers
Опубликована
14 июл 2024

all-MiniLM-L6-v2-MEDI-MTEB-triplet-final

ЭмбеддингиТекст → embedding9 профессий

Англоязычный энкодер предложений для преобразования текстов в векторы и поиска семантически похожих предложений.

123скачиваний за 30 дней1лайквеса обновлены14 июл 2024

Бенчмарки

Как модель справилась с задачами пользователей ailist и что о ней публикуют открытые лидерборды

Тесты пользователейпока нет

Никто ещё не опубликовал тест этой модели. Соберите бенчмарк из своих задач — результат появится здесь.

  1. Добавьте модель в бенчмарк

    Вместе с другими моделями категории «Эмбеддинги» — сравнение идёт внутри одной категории.

  2. Опишите свои задачи

    Напишите запросы, при необходимости приложите файлы и эталонные ответы.

  3. Запустите и опубликуйте

    Модели ответят на каждую задачу, судья оценит ответы. Опубликованный результат появится на этой странице.

Публичные оценки

Из открытых лидербордов. Сравнивайте результаты одного теста при одинаковых условиях — отсутствие оценки не значит, что модель хуже.

В подключённых источниках результатов для этой модели пока нет.

Что умеет модель

Описание составлено по карточке модели и метаданным Hugging Face

avsolatorio/all-MiniLM-L6-v2-MEDI-MTEB-triplet-final — англоязычная модель Sentence Transformers, дообученная на базе sentence-transformers/all-MiniLM-L6-v2 для получения векторных представлений предложений и оценки их семантического сходства. Её можно применять для поиска похожих текстов, ранжирования кандидатов по близости к запросу, кластеризации и дедупликации предложений, в том числе в задачах с медицинскими и научными текстами среди обучающих данных.

Модель построена на архитектуре BERT, содержит 25,9 млн параметров и выдаёт векторы размерности 384. Для сравнения векторов используется косинусное сходство. README указывает максимальную длину последовательности 256 токенов, а метаданные — контекстное окно 512 токенов. Модель принимает текст и возвращает эмбеддинги; заявленный язык — английский.

Модель распространяется по лицензии Apache-2.0. Это энкодер предложений, а не генеративная модель: он не предназначен для свободной генерации ответов. Качество сходства зависит от домена и формулировок; длину входного текста следует учитывать с учётом ограничения README в 256 токенов.

Сценарии применения

  • семантический поиск по коллекции англоязычных документов
  • поиск похожих медицинских вопросов и текстов
  • ранжирование предложений по сходству с запросом
  • кластеризация коротких текстов по смыслу
  • поиск дубликатов вопросов и предложений

Ограничения

Модель ориентирована на английский язык и создаёт эмбеддинги, но не генерирует ответы. README указывает максимальную длину последовательности 256 токенов; качество на других языках и вне тематик обучающих данных не установлено.

Для каких профессий подходит9

Разделы каталога профессий, в задачах которых используется эта модель

Все профессии

Также подходит для

Карточка модели

README от автора на Hugging Face, как он его опубликовал

Открыть на Hugging Face

all-MiniLM-L6-v2 trained on MEDI-MTEB triplets

This is a sentence-transformers model finetuned from sentence-transformers/all-MiniLM-L6-v2 on the NQ, pubmed, specter_train_triples, S2ORC_citations_abstracts, fever, gooaq_pairs, codesearchnet, wikihow, WikiAnswers, eli5_question_answer, amazon-qa, medmcqa, zeroshot, TriviaQA_pairs, PAQ_pairs, stackexchange_duplicate_questions_title-body_title-body, trex, flickr30k_captions, hotpotqa, task671_ambigqa_text_generation, task061_ropes_answer_generation, task285_imdb_answer_generation, task905_hate_speech_offensive_classification, task566_circa_classification, task184_snli_entailment_to_neutral_text_modification, task280_stereoset_classification_stereotype_type, task1599_smcalflow_classification, task1384_deal_or_no_dialog_classification, task591_sciq_answer_generation, task823_peixian-rtgender_sentiment_analysis, task023_cosmosqa_question_generation, task900_freebase_qa_category_classification, task924_event2mind_word_generation, task152_tomqa_find_location_easy_noise, task1368_healthfact_sentence_generation, task1661_super_glue_classification, task1187_politifact_classification, task1728_web_nlg_data_to_text, task112_asset_simple_sentence_identification, task1340_msr_text_compression_compression, task072_abductivenli_answer_generation, task1504_hatexplain_answer_generation, task684_online_privacy_policy_text_information_type_generation, task1290_xsum_summarization, task075_squad1.1_answer_generation, task1587_scifact_classification, task384_socialiqa_question_classification, task1555_scitail_answer_generation, task1532_daily_dialog_emotion_classification, task239_tweetqa_answer_generation, task596_mocha_question_generation, task1411_dart_subject_identification, task1359_numer_sense_answer_generation, task329_gap_classification, task220_rocstories_title_classification, task316_crows-pairs_classification_stereotype, task495_semeval_headline_classification, task1168_brown_coarse_pos_tagging, task348_squad2.0_unanswerable_question_generation, task049_multirc_questions_needed_to_answer, task1534_daily_dialog_question_classification, task322_jigsaw_classification_threat, task295_semeval_2020_task4_commonsense_reasoning, task186_snli_contradiction_to_entailment_text_modification, task034_winogrande_question_modification_object, task160_replace_letter_in_a_sentence, task469_mrqa_answer_generation, task105_story_cloze-rocstories_sentence_generation, task649_race_blank_question_generation, task1536_daily_dialog_happiness_classification, task683_online_privacy_policy_text_purpose_answer_generation, task024_cosmosqa_answer_generation, task584_udeps_eng_fine_pos_tagging, task066_timetravel_binary_consistency_classification, task413_mickey_en_sentence_perturbation_generation, task182_duorc_question_generation, task028_drop_answer_generation, task1601_webquestions_answer_generation, task1295_adversarial_qa_question_answering, task201_mnli_neutral_classification, task038_qasc_combined_fact, task293_storycommonsense_emotion_text_generation, task572_recipe_nlg_text_generation, task517_emo_classify_emotion_of_dialogue, task382_hybridqa_answer_generation, task176_break_decompose_questions, task1291_multi_news_summarization, task155_count_nouns_verbs, task031_winogrande_question_generation_object, task279_stereoset_classification_stereotype, task1336_peixian_equity_evaluation_corpus_gender_classifier, task508_scruples_dilemmas_more_ethical_isidentifiable, task518_emo_different_dialogue_emotions, task077_splash_explanation_to_sql, task923_event2mind_classifier, task470_mrqa_question_generation, task638_multi_woz_classification, task1412_web_questions_question_answering, task847_pubmedqa_question_generation, task678_ollie_actual_relationship_answer_generation, task290_tellmewhy_question_answerability, task575_air_dialogue_classification, task189_snli_neutral_to_contradiction_text_modification, task026_drop_question_generation, task162_count_words_starting_with_letter, task079_conala_concat_strings, task610_conllpp_ner, task046_miscellaneous_question_typing, task197_mnli_domain_answer_generation, task1325_qa_zre_question_generation_on_subject_relation, task430_senteval_subject_count, task672_nummersense, task402_grailqa_paraphrase_generation, task904_hate_speech_offensive_classification, task192_hotpotqa_sentence_generation, task069_abductivenli_classification, task574_air_dialogue_sentence_generation, task187_snli_entailment_to_contradiction_text_modification, task749_glucose_reverse_cause_emotion_detection, task1552_scitail_question_generation, task750_aqua_multiple_choice_answering, task327_jigsaw_classification_toxic, task1502_hatexplain_classification, task328_jigsaw_classification_insult, task304_numeric_fused_head_resolution, task1293_kilt_tasks_hotpotqa_question_answering, task216_rocstories_correct_answer_generation, task1326_qa_zre_question_generation_from_answer, task1338_peixian_equity_evaluation_corpus_sentiment_classifier, task1729_personachat_generate_next, task1202_atomic_classification_xneed, task400_paws_paraphrase_classification, task502_scruples_anecdotes_whoiswrong_verification, task088_identify_typo_verification, task221_rocstories_two_choice_classification, task200_mnli_entailment_classification, task074_squad1.1_question_generation, task581_socialiqa_question_generation, task1186_nne_hrngo_classification, task898_freebase_qa_answer_generation, task1408_dart_similarity_classification, task168_strategyqa_question_decomposition, task1357_xlsum_summary_generation, task390_torque_text_span_selection, task165_mcscript_question_answering_commonsense, task1533_daily_dialog_formal_classification, task002_quoref_answer_generation, task1297_qasc_question_answering, task305_jeopardy_answer_generation_normal, task029_winogrande_full_object, task1327_qa_zre_answer_generation_from_question, task326_jigsaw_classification_obscene, task1542_every_ith_element_from_starting, task570_recipe_nlg_ner_generation, task1409_dart_text_generation, task401_numeric_fused_head_reference, task846_pubmedqa_classification, task1712_poki_classification, task344_hybridqa_answer_generation, task875_emotion_classification, task1214_atomic_classification_xwant, task106_scruples_ethical_judgment, task238_iirc_answer_from_passage_answer_generation, task1391_winogrande_easy_answer_generation, task195_sentiment140_classification, task163_count_words_ending_with_letter, task579_socialiqa_classification, task569_recipe_nlg_text_generation, task1602_webquestion_question_genreation, task747_glucose_cause_emotion_detection, task219_rocstories_title_answer_generation, task178_quartz_question_answering, task103_facts2story_long_text_generation, task301_record_question_generation, task1369_healthfact_sentence_generation, task515_senteval_odd_word_out, task496_semeval_answer_generation, task1658_billsum_summarization, task1204_atomic_classification_hinderedby, task1392_superglue_multirc_answer_verification, task306_jeopardy_answer_generation_double, task1286_openbookqa_question_answering, task159_check_frequency_of_words_in_sentence_pair, task151_tomqa_find_location_easy_clean, task323_jigsaw_classification_sexually_explicit, task037_qasc_generate_related_fact, task027_drop_answer_type_generation, task1596_event2mind_text_generation_2, task141_odd-man-out_classification_category, task194_duorc_answer_generation, task679_hope_edi_english_text_classification, task246_dream_question_generation, task1195_disflqa_disfluent_to_fluent_conversion, task065_timetravel_consistent_sentence_classification, task351_winomt_classification_gender_identifiability_anti, task580_socialiqa_answer_generation, task583_udeps_eng_coarse_pos_tagging, task202_mnli_contradiction_classification, task222_rocstories_two_chioce_slotting_classification, task498_scruples_anecdotes_whoiswrong_classification, task067_abductivenli_answer_generation, task616_cola_classification, task286_olid_offense_judgment, task188_snli_neutral_to_entailment_text_modification, task223_quartz_explanation_generation, task820_protoqa_answer_generation, task196_sentiment140_answer_generation, task1678_mathqa_answer_selection, task349_squad2.0_answerable_unanswerable_question_classification, task154_tomqa_find_location_hard_noise, task333_hateeval_classification_hate_en, task235_iirc_question_from_subtext_answer_generation, task1554_scitail_classification, task210_logic2text_structured_text_generation, task035_winogrande_question_modification_person, task230_iirc_passage_classification, task1356_xlsum_title_generation, task1726_mathqa_correct_answer_generation, task302_record_classification, task380_boolq_yes_no_question, task212_logic2text_classification, task748_glucose_reverse_cause_event_detection, task834_mathdataset_classification, task350_winomt_classification_gender_identifiability_pro, task191_hotpotqa_question_generation, task236_iirc_question_from_passage_answer_generation, task217_rocstories_ordering_answer_generation, task568_circa_question_generation, task614_glucose_cause_event_detection, task361_spolin_yesand_prompt_response_classification, task421_persent_sentence_sentiment_classification, task203_mnli_sentence_generation, task420_persent_document_sentiment_classification, task153_tomqa_find_location_hard_clean, task346_hybridqa_classification, task1211_atomic_classification_hassubevent, task360_spolin_yesand_response_generation, task510_reddit_tifu_title_summarization, task511_reddit_tifu_long_text_summarization, task345_hybridqa_answer_generation, task270_csrg_counterfactual_context_generation, task307_jeopardy_answer_generation_final, task001_quoref_question_generation, task089_swap_words_verification, task1196_atomic_classification_oeffect, task080_piqa_answer_generation, task1598_nyc_long_text_generation, task240_tweetqa_question_generation, task615_moviesqa_answer_generation, task1347_glue_sts-b_similarity_classification, task114_is_the_given_word_longest, task292_storycommonsense_character_text_generation, task115_help_advice_classification, task431_senteval_object_count, task1360_numer_sense_multiple_choice_qa_generation, task177_para-nmt_paraphrasing, task132_dais_text_modification, task269_csrg_counterfactual_story_generation, task233_iirc_link_exists_classification, task161_count_words_containing_letter, task1205_atomic_classification_isafter, task571_recipe_nlg_ner_generation, task1292_yelp_review_full_text_categorization, task428_senteval_inversion, task311_race_question_generation, task429_senteval_tense, task403_creak_commonsense_inference, task929_products_reviews_classification, task582_naturalquestion_answer_generation, task237_iirc_answer_from_subtext_answer_generation, task050_multirc_answerability, task184_break_generate_question, task669_ambigqa_answer_generation, task169_strategyqa_sentence_generation, task500_scruples_anecdotes_title_generation, task241_tweetqa_classification, task1345_glue_qqp_question_paraprashing, task218_rocstories_swap_order_answer_generation, task613_politifact_text_generation, task1167_penn_treebank_coarse_pos_tagging, task1422_mathqa_physics, task247_dream_answer_generation, task199_mnli_classification, task164_mcscript_question_answering_text, task1541_agnews_classification, task516_senteval_conjoints_inversion, task294_storycommonsense_motiv_text_generation, task501_scruples_anecdotes_post_type_verification, task213_rocstories_correct_ending_classification, task821_protoqa_question_generation, task493_review_polarity_classification, task308_jeopardy_answer_generation_all, task1595_event2mind_text_generation_1, task040_qasc_question_generation, task231_iirc_link_classification, task1727_wiqa_what_is_the_effect, task578_curiosity_dialogs_answer_generation, task310_race_classification, task309_race_answer_generation, task379_agnews_topic_classification, task030_winogrande_full_person, task1540_parsed_pdfs_summarization, task039_qasc_find_overlapping_words, task1206_atomic_classification_isbefore, task157_count_vowels_and_consonants, task339_record_answer_generation, task453_swag_answer_generation, task848_pubmedqa_classification, task673_google_wellformed_query_classification, task676_ollie_relationship_answer_generation, task268_casehold_legal_answer_generation, task844_financial_phrasebank_classification, task330_gap_answer_generation, task595_mocha_answer_generation, task1285_kpa_keypoint_matching, task234_iirc_passage_line_answer_generation, task494_review_polarity_answer_generation, task670_ambigqa_question_generation, task289_gigaword_summarization, npr, nli, SimpleWiki, amazon_review_2018, ccnews_title_text, agnews, xsum, msmarco, yahoo_answers_title_answer, squad_pairs, wow, mteb-amazon_counterfactual-avs_triplets, mteb-amazon_massive_intent-avs_triplets, mteb-amazon_massive_scenario-avs_triplets, mteb-amazon_reviews_multi-avs_triplets, mteb-banking77-avs_triplets, mteb-emotion-avs_triplets, mteb-imdb-avs_triplets, mteb-mtop_domain-avs_triplets, mteb-mtop_intent-avs_triplets, mteb-toxic_conversations_50k-avs_triplets, mteb-tweet_sentiment_extraction-avs_triplets and covid-bing-query-gpt4-avs_triplets datasets. It maps sentences & paragraphs to a 384-dimensional dense vector space and can be used for semantic textual similarity, semantic search, paraphrase mining, text classification, clustering, and more.

Model Details

Model Description

  • Model Type: Sentence Transformer
  • Base model: sentence-transformers/all-MiniLM-L6-v2
  • Maximum Sequence Length: 256 tokens
  • Output Dimensionality: 384 tokens
  • Similarity Function: Cosine Similarity
  • Training Datasets:
    • NQ
    • pubmed
    • specter_train_triples
    • S2ORC_citations_abstracts
    • fever
    • gooaq_pairs
    • codesearchnet
    • wikihow
    • WikiAnswers
    • eli5_question_answer
    • amazon-qa
    • medmcqa
    • zeroshot
    • TriviaQA_pairs
    • PAQ_pairs
    • stackexchange_duplicate_questions_title-body_title-body
    • trex
    • flickr30k_captions
    • hotpotqa
    • task671_ambigqa_text_generation
    • task061_ropes_answer_generation
    • task285_imdb_answer_generation
    • task905_hate_speech_offensive_classification
    • task566_circa_classification
    • task184_snli_entailment_to_neutral_text_modification
    • task280_stereoset_classification_stereotype_type
    • task1599_smcalflow_classification
    • task1384_deal_or_no_dialog_classification
    • task591_sciq_answer_generation
    • task823_peixian-rtgender_sentiment_analysis
    • task023_cosmosqa_question_generation
    • task900_freebase_qa_category_classification
    • task924_event2mind_word_generation
    • task152_tomqa_find_location_easy_noise
    • task1368_healthfact_sentence_generation
    • task1661_super_glue_classification
    • task1187_politifact_classification
    • task1728_web_nlg_data_to_text
    • task112_asset_simple_sentence_identification
    • task1340_msr_text_compression_compression
    • task072_abductivenli_answer_generation
    • task1504_hatexplain_answer_generation
    • task684_online_privacy_policy_text_information_type_generation
    • task1290_xsum_summarization
    • task075_squad1.1_answer_generation
    • task1587_scifact_classification
    • task384_socialiqa_question_classification
    • task1555_scitail_answer_generation
    • task1532_daily_dialog_emotion_classification
    • task239_tweetqa_answer_generation
    • task596_mocha_question_generation
    • task1411_dart_subject_identification
    • task1359_numer_sense_answer_generation
    • task329_gap_classification
    • task220_rocstories_title_classification
    • task316_crows-pairs_classification_stereotype
    • task495_semeval_headline_classification
    • task1168_brown_coarse_pos_tagging
    • task348_squad2.0_unanswerable_question_generation
    • task049_multirc_questions_needed_to_answer
    • task1534_daily_dialog_question_classification
    • task322_jigsaw_classification_threat
    • task295_semeval_2020_task4_commonsense_reasoning
    • task186_snli_contradiction_to_entailment_text_modification
    • task034_winogrande_question_modification_object
    • task160_replace_letter_in_a_sentence
    • task469_mrqa_answer_generation
    • task105_story_cloze-rocstories_sentence_generation
    • task649_race_blank_question_generation
    • task1536_daily_dialog_happiness_classification
    • task683_online_privacy_policy_text_purpose_answer_generation
    • task024_cosmosqa_answer_generation
    • task584_udeps_eng_fine_pos_tagging
    • task066_timetravel_binary_consistency_classification
    • task413_mickey_en_sentence_perturbation_generation
    • task182_duorc_question_generation
    • task028_drop_answer_generation
    • task1601_webquestions_answer_generation
    • task1295_adversarial_qa_question_answering
    • task201_mnli_neutral_classification
    • task038_qasc_combined_fact
    • task293_storycommonsense_emotion_text_generation
    • task572_recipe_nlg_text_generation
    • task517_emo_classify_emotion_of_dialogue
    • task382_hybridqa_answer_generation
    • task176_break_decompose_questions
    • task1291_multi_news_summarization
    • task155_count_nouns_verbs
    • task031_winogrande_question_generation_object
    • task279_stereoset_classification_stereotype
    • task1336_peixian_equity_evaluation_corpus_gender_classifier
    • task508_scruples_dilemmas_more_ethical_isidentifiable
    • task518_emo_different_dialogue_emotions
    • task077_splash_explanation_to_sql
    • task923_event2mind_classifier
    • task470_mrqa_question_generation
    • task638_multi_woz_classification
    • task1412_web_questions_question_answering
    • task847_pubmedqa_question_generation
    • task678_ollie_actual_relationship_answer_generation
    • task290_tellmewhy_question_answerability
    • task575_air_dialogue_classification
    • task189_snli_neutral_to_contradiction_text_modification
    • task026_drop_question_generation
    • task162_count_words_starting_with_letter
    • task079_conala_concat_strings
    • task610_conllpp_ner
    • task046_miscellaneous_question_typing
    • task197_mnli_domain_answer_generation
    • task1325_qa_zre_question_generation_on_subject_relation
    • task430_senteval_subject_count
    • task672_nummersense
    • task402_grailqa_paraphrase_generation
    • task904_hate_speech_offensive_classification
    • task192_hotpotqa_sentence_generation
    • task069_abductivenli_classification
    • task574_air_dialogue_sentence_generation
    • task187_snli_entailment_to_contradiction_text_modification
    • task749_glucose_reverse_cause_emotion_detection
    • task1552_scitail_question_generation
    • task750_aqua_multiple_choice_answering
    • task327_jigsaw_classification_toxic
    • task1502_hatexplain_classification
    • task328_jigsaw_classification_insult
    • task304_numeric_fused_head_resolution
    • task1293_kilt_tasks_hotpotqa_question_answering
    • task216_rocstories_correct_answer_generation
    • task1326_qa_zre_question_generation_from_answer
    • task1338_peixian_equity_evaluation_corpus_sentiment_classifier
    • task1729_personachat_generate_next
    • task1202_atomic_classification_xneed
    • task400_paws_paraphrase_classification
    • task502_scruples_anecdotes_whoiswrong_verification
    • task088_identify_typo_verification
    • task221_rocstories_two_choice_classification
    • task200_mnli_entailment_classification
    • task074_squad1.1_question_generation
    • task581_socialiqa_question_generation
    • task1186_nne_hrngo_classification
    • task898_freebase_qa_answer_generation
    • task1408_dart_similarity_classification
    • task168_strategyqa_question_decomposition
    • task1357_xlsum_summary_generation
    • task390_torque_text_span_selection
    • task165_mcscript_question_answering_commonsense
    • task1533_daily_dialog_formal_classification
    • task002_quoref_answer_generation
    • task1297_qasc_question_answering
    • task305_jeopardy_answer_generation_normal
    • task029_winogrande_full_object
    • task1327_qa_zre_answer_generation_from_question
    • task326_jigsaw_classification_obscene
    • task1542_every_ith_element_from_starting
    • task570_recipe_nlg_ner_generation
    • task1409_dart_text_generation
    • task401_numeric_fused_head_reference
    • task846_pubmedqa_classification
    • task1712_poki_classification
    • task344_hybridqa_answer_generation
    • task875_emotion_classification
    • task1214_atomic_classification_xwant
    • task106_scruples_ethical_judgment
    • task238_iirc_answer_from_passage_answer_generation
    • task1391_winogrande_easy_answer_generation
    • task195_sentiment140_classification
    • task163_count_words_ending_with_letter
    • task579_socialiqa_classification
    • task569_recipe_nlg_text_generation
    • task1602_webquestion_question_genreation
    • task747_glucose_cause_emotion_detection
    • task219_rocstories_title_answer_generation
    • task178_quartz_question_answering
    • task103_facts2story_long_text_generation
    • task301_record_question_generation
    • task1369_healthfact_sentence_generation
    • task515_senteval_odd_word_out
    • task496_semeval_answer_generation
    • task1658_billsum_summarization
    • task1204_atomic_classification_hinderedby
    • task1392_superglue_multirc_answer_verification
    • task306_jeopardy_answer_generation_double
    • task1286_openbookqa_question_answering
    • task159_check_frequency_of_words_in_sentence_pair
    • task151_tomqa_find_location_easy_clean
    • task323_jigsaw_classification_sexually_explicit
    • task037_qasc_generate_related_fact
    • task027_drop_answer_type_generation
    • task1596_event2mind_text_generation_2
    • task141_odd-man-out_classification_category
    • task194_duorc_answer_generation
    • task679_hope_edi_english_text_classification
    • task246_dream_question_generation
    • task1195_disflqa_disfluent_to_fluent_conversion
    • task065_timetravel_consistent_sentence_classification
    • task351_winomt_classification_gender_identifiability_anti
    • task580_socialiqa_answer_generation
    • task583_udeps_eng_coarse_pos_tagging
    • task202_mnli_contradiction_classification
    • task222_rocstories_two_chioce_slotting_classification
    • task498_scruples_anecdotes_whoiswrong_classification
    • task067_abductivenli_answer_generation
    • task616_cola_classification
    • task286_olid_offense_judgment
    • task188_snli_neutral_to_entailment_text_modification
    • task223_quartz_explanation_generation
    • task820_protoqa_answer_generation
    • task196_sentiment140_answer_generation
    • task1678_mathqa_answer_selection
    • task349_squad2.0_answerable_unanswerable_question_classification
    • task154_tomqa_find_location_hard_noise
    • task333_hateeval_classification_hate_en
    • task235_iirc_question_from_subtext_answer_generation
    • task1554_scitail_classification
    • task210_logic2text_structured_text_generation
    • task035_winogrande_question_modification_person
    • task230_iirc_passage_classification
    • task1356_xlsum_title_generation
    • task1726_mathqa_correct_answer_generation
    • task302_record_classification
    • task380_boolq_yes_no_question
    • task212_logic2text_classification
    • task748_glucose_reverse_cause_event_detection
    • task834_mathdataset_classification
    • task350_winomt_classification_gender_identifiability_pro
    • task191_hotpotqa_question_generation
    • task236_iirc_question_from_passage_answer_generation
    • task217_rocstories_ordering_answer_generation
    • task568_circa_question_generation
    • task614_glucose_cause_event_detection
    • task361_spolin_yesand_prompt_response_classification
    • task421_persent_sentence_sentiment_classification
    • task203_mnli_sentence_generation
    • task420_persent_document_sentiment_classification
    • task153_tomqa_find_location_hard_clean
    • task346_hybridqa_classification
    • task1211_atomic_classification_hassubevent
    • task360_spolin_yesand_response_generation
    • task510_reddit_tifu_title_summarization
    • task511_reddit_tifu_long_text_summarization
    • task345_hybridqa_answer_generation
    • task270_csrg_counterfactual_context_generation
    • task307_jeopardy_answer_generation_final
    • task001_quoref_question_generation
    • task089_swap_words_verification
    • task1196_atomic_classification_oeffect
    • task080_piqa_answer_generation
    • task1598_nyc_long_text_generation
    • task240_tweetqa_question_generation
    • task615_moviesqa_answer_generation
    • task1347_glue_sts-b_similarity_classification
    • task114_is_the_given_word_longest
    • task292_storycommonsense_character_text_generation
    • task115_help_advice_classification
    • task431_senteval_object_count
    • task1360_numer_sense_multiple_choice_qa_generation
    • task177_para-nmt_paraphrasing
    • task132_dais_text_modification
    • task269_csrg_counterfactual_story_generation
    • task233_iirc_link_exists_classification
    • task161_count_words_containing_letter
    • task1205_atomic_classification_isafter
    • task571_recipe_nlg_ner_generation
    • task1292_yelp_review_full_text_categorization
    • task428_senteval_inversion
    • task311_race_question_generation
    • task429_senteval_tense
    • task403_creak_commonsense_inference
    • task929_products_reviews_classification
    • task582_naturalquestion_answer_generation
    • task237_iirc_answer_from_subtext_answer_generation
    • task050_multirc_answerability
    • task184_break_generate_question
    • task669_ambigqa_answer_generation
    • task169_strategyqa_sentence_generation
    • task500_scruples_anecdotes_title_generation
    • task241_tweetqa_classification
    • task1345_glue_qqp_question_paraprashing
    • task218_rocstories_swap_order_answer_generation
    • task613_politifact_text_generation
    • task1167_penn_treebank_coarse_pos_tagging
    • task1422_mathqa_physics
    • task247_dream_answer_generation
    • task199_mnli_classification
    • task164_mcscript_question_answering_text
    • task1541_agnews_classification
    • task516_senteval_conjoints_inversion
    • task294_storycommonsense_motiv_text_generation
    • task501_scruples_anecdotes_post_type_verification
    • task213_rocstories_correct_ending_classification
    • task821_protoqa_question_generation
    • task493_review_polarity_classification
    • task308_jeopardy_answer_generation_all
    • task1595_event2mind_text_generation_1
    • task040_qasc_question_generation
    • task231_iirc_link_classification
    • task1727_wiqa_what_is_the_effect
    • task578_curiosity_dialogs_answer_generation
    • task310_race_classification
    • task309_race_answer_generation
    • task379_agnews_topic_classification
    • task030_winogrande_full_person
    • task1540_parsed_pdfs_summarization
    • task039_qasc_find_overlapping_words
    • task1206_atomic_classification_isbefore
    • task157_count_vowels_and_consonants
    • task339_record_answer_generation
    • task453_swag_answer_generation
    • task848_pubmedqa_classification
    • task673_google_wellformed_query_classification
    • task676_ollie_relationship_answer_generation
    • task268_casehold_legal_answer_generation
    • task844_financial_phrasebank_classification
    • task330_gap_answer_generation
    • task595_mocha_answer_generation
    • task1285_kpa_keypoint_matching
    • task234_iirc_passage_line_answer_generation
    • task494_review_polarity_answer_generation
    • task670_ambigqa_question_generation
    • task289_gigaword_summarization
    • npr
    • nli
    • SimpleWiki
    • amazon_review_2018
    • ccnews_title_text
    • agnews
    • xsum
    • msmarco
    • yahoo_answers_title_answer
    • squad_pairs
    • wow
    • mteb-amazon_counterfactual-avs_triplets
    • mteb-amazon_massive_intent-avs_triplets
    • mteb-amazon_massive_scenario-avs_triplets
    • mteb-amazon_reviews_multi-avs_triplets
    • mteb-banking77-avs_triplets
    • mteb-emotion-avs_triplets
    • mteb-imdb-avs_triplets
    • mteb-mtop_domain-avs_triplets
    • mteb-mtop_intent-avs_triplets
    • mteb-toxic_conversations_50k-avs_triplets
    • mteb-tweet_sentiment_extraction-avs_triplets
    • covid-bing-query-gpt4-avs_triplets
  • Language: en
  • License: apache-2.0

Model Sources

Full Model Architecture

SentenceTransformer(
  (0): Transformer({'max_seq_length': 256, 'do_lower_case': False}) with Transformer model: BertModel 
  (1): Pooling({'word_embedding_dimension': 384, 'pooling_mode_cls_token': False, 'pooling_mode_mean_tokens': True, 'pooling_mode_max_tokens': False, 'pooling_mode_mean_sqrt_len_tokens': False, 'pooling_mode_weightedmean_tokens': False, 'pooling_mode_lasttoken': False, 'include_prompt': True})
  (2): Normalize()
)

Usage

Direct Usage (Sentence Transformers)

First install the Sentence Transformers library:

pip install -U sentence-transformers

Then you can load this model and run inference.

from sentence_transformers import SentenceTransformer

# Download from the 🤗 Hub
model = SentenceTransformer("avsolatorio/all-MiniLM-L6-v2-MEDI-MTEB-triplet-final")
# Run inference
sentences = [
    'who does george nelson represent in o brother where art thou',
    'O Brother, Where Art Thou? omitted all instances of the words "damn" and "hell" from the Coens\' script, which only became known to Clooney after the directors pointed this out to him during shooting. This was the fourth film of the brothers in which John Turturro has starred. Other actors in "O Brother, Where Art Thou?" who had worked previously with the Coens include John Goodman (three films), Holly Hunter (two), Michael Badalucco and Charles Durning (one film each). The Coens used digital color correction to give the film a sepia-tinted look. Joel stated this was because the actual set was "greener than Ireland". Cinematographer',
    'O Brother, Where Art Thou? the film got together and performed the music from the film in a Down from the Mountain concert tour which was filmed for TV and DVD. This included Ralph Stanley, John Hartford, Alison Krauss, Emmylou Harris, Gillian Welch, Chris Sharp, and others. O Brother, Where Art Thou? O Brother, Where Art Thou? is a 2000 crime comedy film written, produced, and directed by Joel and Ethan Coen, and starring George Clooney, John Turturro, and Tim Blake Nelson, with John Goodman, Holly Hunter, and Charles Durning in supporting roles. The film is set in 1937 rural Mississippi during the Great Depression.',
]
embeddings = model.encode(sentences)
print(embeddings.shape)
# [3, 384]

# Get the similarity scores for the embeddings
similarities = model.similarity(embeddings, embeddings)
print(similarities.shape)
# [3, 3]

Evaluation

Metrics

Triplet

MetricValue
cosine_accuracy0.9117
dot_accuracy0.081
manhattan_accuracy0.912
euclidean_accuracy0.9115
max_accuracy0.912

Training Details

Training Datasets

NQ

  • Dataset: NQ
  • Size: 49,676 training samples
  • Columns: anchor, positive, and negative
  • Approximate statistics based on the first 1000 samples:
    anchorpositivenegative
    typestringstringstring
    detailsmin: 10 tokensmean: 11.91 tokensmax: 24 tokensmin: 111 tokensmean: 137.95 tokensmax: 212 tokensmin: 113 tokensmean: 138.79 tokensmax: 209 tokens
  • Samples:
  • Loss: MultipleNegativesRankingLoss with these parameters:
    {
        "scale": 20.0,
        "similarity_fct": "cos_sim"
    }
    

pubmed

  • Dataset: pubmed
  • Size: 29,908 training samples
  • Columns: anchor, positive, and negative
  • Approximate statistics based on the first 1000 samples:
    anchorpositivenegative
    typestringstringstring
    detailsmin: 6 tokensmean: 22.81 tokensmax: 62 tokensmin: 93 tokensmean: 240.49 tokensmax: 256 tokensmin: 73 tokensmean: 239.5 tokensmax: 256 tokens
  • Samples:
  • Loss: MultipleNegativesRankingLoss with these parameters:
    {
        "scale": 20.0,
        "similarity_fct": "cos_sim"
    }
    

specter_train_triples

  • Dataset: specter_train_triples
  • Size: 49,676 training samples
  • Columns: anchor, positive, and negative
  • Approximate statistics based on the first 1000 samples:
    anchorpositivenegative
    typestringstringstring
    detailsmin: 4 tokensmean: 15.69 tokensmax: 94 tokensmin: 4 tokensmean: 14.12 tokensmax: 39 tokensmin: 4 tokensmean: 16.39 tokensmax: 64 tokens
  • Samples:
  • Loss: MultipleNegativesRankingLoss with these parameters:
    {
        "scale": 20.0,
        "similarity_fct": "cos_sim"
    }
    

S2ORC_citations_abstracts

  • Dataset: S2ORC_citations_abstracts
  • Size: 99,352 training samples
  • Columns: anchor, positive, and negative
  • Approximate statistics based on the first 1000 samples:
    anchorpositivenegative
    typestringstringstring
    detailsmin: 20 tokensmean: 196.74 tokensmax: 256 tokensmin: 24 tokensmean: 203.91 tokensmax: 256 tokensmin: 24 tokensmean: 208.09 tokensmax: 256 tokens
  • Samples:
  • Loss: MultipleNegativesRankingLoss with these parameters:
    {
        "scale": 20.0,
        "similarity_fct": "cos_sim"
    }
    

fever

  • Dataset: fever
  • Size: 74,514 training samples
  • Columns: anchor, positive, and negative
  • Approximate statistics based on the first 1000 samples:
    anchorpositivenegative
    typestringstringstring
    detailsmin: 6 tokensmean: 12.49 tokensmax: 51 tokensmin: 48 tokensmean: 112.67 tokensmax: 154 tokensmin: 35 tokensmean: 113.92 tokensmax: 163 tokens
  • Samples:
  • Loss: MultipleNegativesRankingLoss with these parameters:
    {
        "scale": 20.0,
        "similarity_fct": "cos_sim"
    }
    

gooaq_pairs

  • Dataset: gooaq_pairs
  • Size: 24,838 training samples
  • Columns: anchor, positive, and negative
  • Approximate statistics based on the first 1000 samples:
    anchorpositivenegative
    typestringstringstring
    detailsmin: 8 tokensmean: 11.92 tokensmax: 24 tokensmin: 14 tokensmean: 60.11 tokensmax: 150 tokensmin: 15 tokensmean: 63.73 tokensmax: 150 tokens
  • Samples:
  • Loss: MultipleNegativesRankingLoss with these parameters:
    {
        "scale": 20.0,
        "similarity_fct": "cos_sim"
    }
    

codesearchnet

  • Dataset: codesearchnet
  • Size: 15,210 training samples
  • Columns: anchor, positive, and negative
  • Approximate statistics based on the first 1000 samples:
    anchorpositivenegative
    typestringstringstring
    detailsmin: 5 tokensmean: 28.96 tokensmax: 143 tokensmin: 28 tokensmean: 134.91 tokensmax: 256 tokensmin: 29 tokensmean: 163.95 tokensmax: 256 tokens
  • Samples:
  • Loss: MultipleNegativesRankingLoss with these parameters:
    {
        "scale": 20.0,
        "similarity_fct": "cos_sim"
    }
    

wikihow

  • Dataset: wikihow
  • Size: 5,070 training samples
  • Columns: anchor, positive, and negative
  • Approximate statistics based on the first 1000 samples:
    anchorpositivenegative
    typestringstringstring
    detailsmin: 4 tokensmean: 8.05 tokensmax: 21 tokensmin: 13 tokensmean: 45.27 tokensmax: 117 tokensmin: 10 tokensmean: 35.68 tokensmax: 75 tokens
  • Samples:
  • Loss: MultipleNegativesRankingLoss with these parameters:
    {
        "scale": 20.0,
        "similarity_fct": "cos_sim"
    }
    

WikiAnswers

  • Dataset: WikiAnswers
  • Size: 24,838 training samples
  • Columns: anchor, positive, and negative
  • Approximate statistics based on the first 1000 samples:
    anchorpositivenegative
    typestringstringstring
    detailsmin: 6 tokensmean: 12.79 tokensmax: 43 tokensmin: 6 tokensmean: 12.93 tokensmax: 47 tokensmin: 6 tokensmean: 13.13 tokensmax: 44 tokens
  • Samples:
  • Loss: MultipleNegativesRankingLoss with these parameters:
    {
        "scale": 20.0,
        "similarity_fct": "cos_sim"
    }
    

eli5_question_answer

  • Dataset: eli5_question_answer
  • Size: 24,838 training samples
  • Columns: anchor, positive, and negative
  • Approximate statistics based on the first 1000 samples:
    anchorpositivenegative
    typestringstringstring
    detailsmin: 5 tokensmean: 21.16 tokensmax: 69 tokensmin: 11 tokensmean: 100.92 tokensmax: 256 tokensmin: 13 tokensmean: 112.62 tokensmax: 256 tokens
  • Samples:
  • Loss: MultipleNegativesRankingLoss with these parameters:
    {
        "scale": 20.0,
        "similarity_fct": "cos_sim"
    }
    

amazon-qa

  • Dataset: amazon-qa
  • Size: 99,352 training samples
  • Columns: anchor, positive, and negative
  • Approximate statistics based on the first 1000 samples:
    anchorpositivenegative
    typestringstringstring
    detailsmin: 6 tokensmean: 23.56 tokensmax: 256 tokensmin: 15 tokensmean: 52.4 tokensmax: 256 tokensmin: 18 tokensmean: 62.09 tokensmax: 256 tokens
  • Samples:
  • Loss: MultipleNegativesRankingLoss with these parameters:
    {
        "scale": 20.0,
        "similarity_fct": "cos_sim"
    }
    

medmcqa

  • Dataset: medmcqa
  • Size: 29,908 training samples
  • Columns: anchor, positive, and negative
  • Approximate statistics based on the first 1000 samples:
    anchorpositivenegative
    typestringstringstring
    detailsmin: 4 tokensmean: 19.62 tokensmax: 167 tokensmin: 3 tokensmean: 110.24 tokensmax: 256 tokensmin: 3 tokensmean: 111.99 tokensmax: 256 tokens
  • Samples:
  • Loss: MultipleNegativesRankingLoss with these parameters:
    {
        "scale": 20.0,
        "similarity_fct": "cos_sim"
    }
    

zeroshot

  • Dataset: zeroshot
  • Size: 15,210 training samples
  • Columns: anchor, positive, and negative
  • Approximate statistics based on the first 1000 samples:
    anchorpositivenegative
    typestringstringstring
    detailsmin: 5 tokensmean: 8.7 tokensmax: 20 tokensmin: 10 tokensmean: 112.73 tokensmax: 178 tokensmin: 14 tokensmean: 115.71 tokensmax: 256 tokens
  • Samples:
  • Loss: MultipleNegativesRankingLoss with these parameters:
    {
        "scale": 20.0,
        "similarity_fct": "cos_sim"
    }
    

TriviaQA_pairs

  • Dataset: TriviaQA_pairs
  • Size: 49,676 training samples
  • Columns: anchor, positive, and negative
  • Approximate statistics based on the first 1000 samples:
    anchorpositivenegative
    typestringstringstring
    detailsmin: 8 tokensmean: 19.22 tokensmax: 59 tokensmin: 33 tokensmean: 246.01 tokensmax: 256 tokensmin: 21 tokensmean: 232.19 tokensmax: 256 tokens
  • Samples:
  • Loss: MultipleNegativesRankingLoss with these parameters:
    {
        "scale": 20.0,
        "similarity_fct": "cos_sim"
    }
    

PAQ_pairs

  • Dataset: PAQ_pairs
  • Size: 24,838 training samples
  • Columns: anchor, positive, and negative
  • Approximate statistics based on the first 1000 samples:
    anchorpositivenegative
    typestringstringstring
    detailsmin: 8 tokensmean: 12.6 tokensmax: 22 tokensmin: 112 tokensmean: 136.78 tokensmax: 205 tokensmin: 110 tokensmean: 135.66 tokensmax: 254 tokens
  • Samples:
  • Loss: MultipleNegativesRankingLoss with these parameters:
    {
        "scale": 20.0,
        "similarity_fct": "cos_sim"
    }
    

stackexchange_duplicate_questions_title-body_title-body

  • Dataset: stackexchange_duplicate_questions_title-body_title-body
  • Size: 24,838 training samples
  • Columns: anchor, positive, and negative
  • Approximate statistics based on the first 1000 samples:
    anchorpositivenegative
    typestringstringstring
    detailsmin: 18 tokensmean: 150.59 tokensmax: 256 tokensmin: 20 tokensmean: 142.04 tokensmax: 256 tokensmin: 27 tokensmean: 198.29 tokensmax: 256 tokens
  • Samples:
  • Loss: MultipleNegativesRankingLoss with these parameters:
    {
        "scale": 20.0,
        "similarity_fct": "cos_sim"
    }
    

trex

  • Dataset: trex
  • Size: 29,908 training samples
  • Columns: anchor, positive, and negative
  • Approximate statistics based on the first 1000 samples:
    anchorpositivenegative
    typestringstringstring
    detailsmin: 5 tokensmean: 9.55 tokensmax: 27 tokensmin: 16 tokensmean: 104.71 tokensmax: 212 tokensmin: 14 tokensmean: 118.22 tokensmax: 256 tokens
  • Samples:
  • Loss: MultipleNegativesRankingLoss with these parameters:
    {
        "scale": 20.0,
        "similarity_fct": "cos_sim"
    }
    

flickr30k_captions

  • Dataset: flickr30k_captions
  • Size: 24,838 training samples
  • Columns: anchor, positive, and negative
  • Approximate statistics based on the first 1000 samples:
    anchorpositivenegative
    typestringstringstring
    detailsmin: 7 tokensmean: 15.95 tokensmax: 88 tokensmin: 7 tokensmean: 15.68 tokensmax: 59 tokensmin: 7 tokensmean: 17.15 tokensmax: 52 tokens
  • Samples:
  • Loss: MultipleNegativesRankingLoss with these parameters:
    {
        "scale": 20.0,
        "similarity_fct": "cos_sim"
    }
    

hotpotqa

  • Dataset: hotpotqa
  • Size: 40,048 training samples
  • Columns: anchor, positive, and negative
  • Approximate statistics based on the first 1000 samples:
    anchorpositivenegative
    typestringstringstring
    detailsmin: 8 tokensmean: 23.83 tokensmax: 103 tokensmin: 27 tokensmean: 113.6 tokensmax: 194 tokensmin: 38 tokensmean: 115.33 tokensmax: 178 tokens
  • Samples:
  • Loss: MultipleNegativesRankingLoss with these parameters:
    {
        "scale": 20.0,
        "similarity_fct": "cos_sim"
    }
    

task671_ambigqa_text_generation

  • Dataset: task671_ambigqa_text_generation
  • Size: 1,018 training samples
  • Columns: anchor, positive, and negative
  • Approximate statistics based on the first 1000 samples:
    anchorpositivenegative
    typestringstringstring
    detailsmin: 11 tokensmean: 12.69 tokensmax: 26 tokensmin: 11 tokensmean: 12.52 tokensmax: 23 tokensmin: 11 tokensmean: 12.23 tokensmax: 19 tokens
  • Samples:
  • Loss: MultipleNegativesRankingLoss with these parameters:
    {
        "scale": 20.0,
        "similarity_fct": "cos_sim"
    }
    

task061_ropes_answer_generation

  • Dataset: task061_ropes_answer_generation
  • Size: 1,018 training samples
  • Columns: anchor, positive, and negative
  • Approximate statistics based on the first 1000 samples:
    anchorpositivenegative
    typestringstringstring
    detailsmin: 117 tokensmean: 208.96 tokensmax: 256 tokensmin: 117 tokensmean: 208.27 tokensmax: 256 tokensmin: 119 tokensmean: 210.46 tokensmax: 256 tokens
  • Samples:
  • Loss: MultipleNegativesRankingLoss with these parameters:
    {
        "scale": 20.0,
        "similarity_fct": "cos_sim"
    }
    

task285_imdb_answer_generation

  • Dataset: task285_imdb_answer_generation
  • Size: 1,018 training samples
  • Columns: anchor, positive, and negative
  • Approximate statistics based on the first 1000 samples:
    anchorpositivenegative
    typestringstringstring
    detailsmin: 46 tokensmean: 208.78 tokensmax: 256 tokensmin: 49 tokensmean: 203.97 tokensmax: 256 tokensmin: 46 tokensmean: 208.78 tokensmax: 256 tokens
  • Samples:
  • Loss: MultipleNegativesRankingLoss with these parameters:
    {
        "scale": 20.0,
        "similarity_fct": "cos_sim"
    }
    

task905_hate_speech_offensive_classification

  • Dataset: task905_hate_speech_offensive_classification
  • Size: 1,018 training samples
  • Columns: anchor, positive, and negative
  • Approximate statistics based on the first 1000 samples:
    anchorpositivenegative
    typestringstringstring
    detailsmin: 15 tokensmean: 41.73 tokensmax: 164 tokensmin: 13 tokensmean: 40.48 tokensmax: 198 tokensmin: 13 tokensmean: 32.23 tokensmax: 135 tokens
  • Samples:
  • Loss: MultipleNegativesRankingLoss with these parameters:
    {
        "scale": 20.0,
        "similarity_fct": "cos_sim"
    }
    

task566_circa_classification

  • Dataset: task566_circa_classification
  • Size: 1,018 training samples
  • Columns: anchor, positive, and negative
  • Approximate statistics based on the first 1000 samples:
    anchorpositivenegative
    typestringstringstring
    detailsmin: 20 tokensmean: 27.77 tokensmax: 48 tokensmin: 19 tokensmean: 27.22 tokensmax: 44 tokensmin: 20 tokensmean: 27.46 tokensmax: 47 tokens
  • Samples:
  • Loss: MultipleNegativesRankingLoss with these parameters:
    {
        "scale": 20.0,
        "similarity_fct": "cos_sim"
    }
    

task184_snli_entailment_to_neutral_text_modification

  • Dataset: task184_snli_entailment_to_neutral_text_modification
  • Size: 1,018 training samples
  • Columns: anchor, positive, and negative
  • Approximate statistics based on the first 1000 samples:
    anchorpositivenegative
    typestringstringstring
    detailsmin: 17 tokensmean: 29.98 tokensmax: 72 tokensmin: 16 tokensmean: 28.9 tokensmax: 60 tokensmin: 17 tokensmean: 30.33 tokensmax: 100 tokens
  • Samples:
  • Loss: MultipleNegativesRankingLoss with these parameters:
    {
        "scale": 20.0,
        "similarity_fct": "cos_sim"
    }
    

task280_stereoset_classification_stereotype_type

  • Dataset: task280_stereoset_classification_stereotype_type
  • Size: 1,018 training samples
  • Columns: anchor, positive, and negative
  • Approximate statistics based on the first 1000 samples:
    anchorpositivenegative
    typestringstringstring
    detailsmin: 8 tokensmean: 18.47 tokensmax: 53 tokensmin: 8 tokensmean: 16.89 tokensmax: 53 tokensmin: 8 tokensmean: 16.86 tokensmax: 51 tokens
  • Samples:
  • Loss: MultipleNegativesRankingLoss with these parameters:
    {
        "scale": 20.0,
        "similarity_fct": "cos_sim"
    }
    

task1599_smcalflow_classification

  • Dataset: task1599_smcalflow_classification
  • Size: 1,018 training samples
  • Columns: anchor, positive, and negative
  • Approximate statistics based on the first 1000 samples:
    anchorpositivenegative
    typestringstringstring
    detailsmin: 3 tokensmean: 11.25 tokensmax: 37 tokensmin: 3 tokensmean: 10.47 tokensmax: 38 tokensmin: 5 tokensmean: 16.12 tokensmax: 45 tokens
  • Samples:
  • Loss: MultipleNegativesRankingLoss with these parameters:
    {
        "scale": 20.0,
        "similarity_fct": "cos_sim"
    }
    

task1384_deal_or_no_dialog_classification

  • Dataset: task1384_deal_or_no_dialog_classification
  • Size: 1,018 training samples
  • Columns: anchor, positive, and negative
  • Approximate statistics based on the first 1000 samples:
    anchorpositivenegative
    typestringstringstring
    detailsmin: 14 tokensmean: 59.1 tokensmax: 256 tokensmin: 12 tokensmean: 59.35 tokensmax: 256 tokensmin: 15 tokensmean: 58.47 tokensmax: 256 tokens
  • Samples:
  • Loss: MultipleNegativesRankingLoss with these parameters:
    {
        "scale": 20.0,
        "similarity_fct": "cos_sim"
    }
    

task591_sciq_answer_generation

  • Dataset: task591_sciq_answer_generation
  • Size: 1,018 training samples
  • Columns: anchor, positive, and negative
  • Approximate statistics based on the first 1000 samples:
    anchorpositivenegative
    typestringstringstring
    detailsmin: 8 tokensmean: 17.61 tokensmax: 70 tokensmin: 7 tokensmean: 17.17 tokensmax: 43 tokensmin: 6 tokensmean: 16.67 tokensmax: 75 tokens
  • Samples:
  • Loss: MultipleNegativesRankingLoss with these parameters:
    {
        "scale": 20.0,
        "similarity_fct": "cos_sim"
    }
    

task823_peixian-rtgender_sentiment_analysis

  • Dataset: task823_peixian-rtgender_sentiment_analysis
  • Size: 1,018 training samples
  • Columns: anchor, positive, and negative
  • Approximate statistics based on the first 1000 samples:
    anchorpositivenegative
    typestringstringstring
    detailsmin: 16 tokensmean: 57.26 tokensmax: 179 tokensmin: 16 tokensmean: 60.03 tokensmax: 153 tokensmin: 14 tokensmean: 60.89 tokensmax: 169 tokens
  • Samples:
  • Loss: MultipleNegativesRankingLoss with these parameters:
    {
        "scale": 20.0,
        "similarity_fct": "cos_sim"
    }
    

task023_cosmosqa_question_generation

  • Dataset: task023_cosmosqa_question_generation
  • Size: 1,018 training samples
  • Columns: anchor, positive, and negative
  • Approximate statistics based on the first 1000 samples:
    anchorpositivenegative
    typestringstringstring
    detailsmin: 35 tokensmean: 79.52 tokensmax: 159 tokensmin: 34 tokensmean: 80.36 tokensmax: 165 tokensmin: 35 tokensmean: 79.14 tokensmax: 161 tokens
  • Samples:
  • Loss: MultipleNegativesRankingLoss with these parameters:
    {
        "scale": 20.0,
        "similarity_fct": "cos_sim"
    }
    

task900_freebase_qa_category_classification

  • Dataset: task900_freebase_qa_category_classification
  • Size: 1,018 training samples
  • Columns: anchor, positive, and negative
  • Approximate statistics based on the first 1000 samples:
    anchorpositivenegative
    typestringstringstring
    detailsmin: 8 tokensmean: 20.44 tokensmax: 88 tokensmin: 8 tokensmean: 18.33 tokensmax: 62 tokensmin: 8 tokensmean: 19.14 tokensmax: 69 tokens
  • Samples:
  • Loss: MultipleNegativesRankingLoss with these parameters:
    {
        "scale": 20.0,
        "similarity_fct": "cos_sim"
    }
    

task924_event2mind_word_generation

  • Dataset: task924_event2mind_word_generation
  • Size: 1,018 training samples
  • Columns: anchor, positive, and negative
  • Approximate statistics based on the first 1000 samples:
    anchorpositivenegative
    typestringstringstring
    detailsmin: 17 tokensmean: 32.06 tokensmax: 64 tokensmin: 17 tokensmean: 32.13 tokensmax: 70 tokensmin: 17 tokensmean: 31.58 tokensmax: 68 tokens
  • Samples:
  • Loss: MultipleNegativesRankingLoss with these parameters:
    {
        "scale": 20.0,
        "similarity_fct": "cos_sim"
    }
    

task152_tomqa_find_location_easy_noise

  • Dataset: task152_tomqa_find_location_easy_noise
  • Size: 1,018 training samples
  • Columns: anchor, positive, and negative
  • Approximate statistics based on the first 1000 samples:
    anchorpositivenegative
    typestringstringstring
    detailsmin: 37 tokensmean: 52.96 tokensmax: 79 tokensmin: 37 tokensmean: 52.53 tokensmax: 78 tokensmin: 37 tokensmean: 52.92 tokensmax: 82 tokens
  • Samples:
  • Loss: MultipleNegativesRankingLoss with these parameters:
    {
        "scale": 20.0,
        "similarity_fct": "cos_sim"
    }
    

task1368_healthfact_sentence_generation

  • Dataset: task1368_healthfact_sentence_generation
  • Size: 1,018 training samples
  • Columns: anchor, positive, and negative
  • Approximate statistics based on the first 1000 samples:
    anchorpositivenegative
    typestringstringstring
    detailsmin: 91 tokensmean: 240.57 tokensmax: 256 tokensmin: 84 tokensmean: 239.31 tokensmax: 256 tokensmin: 97 tokensmean: 245.05 tokensmax: 256 tokens
  • Samples:
  • Loss: MultipleNegativesRankingLoss with these parameters:
    {
        "scale": 20.0,
        "similarity_fct": "cos_sim"
    }
    

task1661_super_glue_classification

  • Dataset: task1661_super_glue_classification
  • Size: 1,018 training samples
  • Columns: anchor, positive, and negative
  • Approximate statistics based on the first 1000 samples:
    anchorpositivenegative
    typestringstringstring
    detailsmin: 35 tokensmean: 140.99 tokensmax: 256 tokensmin: 31 tokensmean: 142.44 tokensmax: 256 tokensmin: 31 tokensmean: 143.37 tokensmax: 256 tokens
  • Samples:
  • Loss: MultipleNegativesRankingLoss with these parameters:
    {
        "scale": 20.0,
        "similarity_fct": "cos_sim"
    }
    

task1187_politifact_classification

  • Dataset: task1187_politifact_classification
  • Size: 1,018 training samples
  • Columns: anchor, positive, and negative
  • Approximate statistics based on the first 1000 samples:
    anchorpositivenegative
    typestringstringstring
    detailsmin: 14 tokensmean: 33.28 tokensmax: 79 tokensmin: 10 tokensmean: 31.59 tokensmax: 75 tokensmin: 13 tokensmean: 31.9 tokensmax: 71 tokens
  • Samples:
  • Loss: MultipleNegativesRankingLoss with these parameters:
    {
        "scale": 20.0,
        "similarity_fct": "cos_sim"
    }
    

task1728_web_nlg_data_to_text

  • Dataset: task1728_web_nlg_data_to_text
  • Size: 1,018 training samples
  • Columns: anchor, positive, and negative
  • Approximate statistics based on the first 1000 samples:
    anchorpositivenegative
    typestringstringstring
    detailsmin: 7 tokensmean: 43.07 tokensmax: 152 tokensmin: 7 tokensmean: 46.55 tokensmax: 152 tokensmin: 8 tokensmean: 43.18 tokensmax: 152 tokens
  • Samples:
  • Loss: MultipleNegativesRankingLoss with these parameters:
    {
        "scale": 20.0,
        "similarity_fct": "cos_sim"
    }
    

task112_asset_simple_sentence_identification

  • Dataset: task112_asset_simple_sentence_identification
  • Size: 1,018 training samples
  • Columns: anchor, positive, and negative
  • Approximate statistics based on the first 1000 samples:
    anchorpositivenegative
    typestringstringstring
    detailsmin: 18 tokensmean: 51.87 tokensmax: 136 tokensmin: 18 tokensmean: 51.68 tokensmax: 144 tokensmin: 22 tokensmean: 51.93 tokensmax: 114 tokens
  • Samples:
  • Loss: MultipleNegativesRankingLoss with these parameters:
    {
        "scale": 20.0,
        "similarity_fct": "cos_sim"
    }
    

task1340_msr_text_compression_compression

  • Dataset: task1340_msr_text_compression_compression
  • Size: 1,018 training samples
  • Columns: anchor, positive, and negative
  • Approximate statistics based on the first 1000 samples:
    anchorpositivenegative
    typestringstringstring
    detailsmin: 14 tokensmean: 41.77 tokensmax: 116 tokensmin: 14 tokensmean: 44.27 tokensmax: 133 tokensmin: 12 tokensmean: 40.08 tokensmax: 141 tokens
  • Samples:
  • Loss: MultipleNegativesRankingLoss with these parameters:
    {
        "scale": 20.0,
        "similarity_fct": "cos_sim"
    }
    

task072_abductivenli_answer_generation

  • Dataset: task072_abductivenli_answer_generation
  • Size: 1,018 training samples
  • Columns: anchor, positive, and negative
  • Approximate statistics based on the first 1000 samples:
    anchorpositivenegative
    typestringstringstring
    detailsmin: 17 tokensmean: 26.8 tokensmax: 56 tokensmin: 16 tokensmean: 26.15 tokensmax: 47 tokensmin: 16 tokensmean: 26.4 tokensmax: 55 tokens
  • Samples:
  • Loss: MultipleNegativesRankingLoss with these parameters:
    {
        "scale": 20.0,
        "similarity_fct": "cos_sim"
    }
    

task1504_hatexplain_answer_generation

  • Dataset: task1504_hatexplain_answer_generation
  • Size: 1,018 training samples
  • Columns: anchor, positive, and negative
  • Approximate statistics based on the first 1000 samples:
    anchorpositivenegative
    typestringstringstring
    detailsmin: 7 tokensmean: 28.53 tokensmax: 72 tokensmin: 5 tokensmean: 24.21 tokensmax: 86 tokensmin: 5 tokensmean: 27.94 tokensmax: 67 tokens
  • Samples:
  • Loss: MultipleNegativesRankingLoss with these parameters:
    {
        "scale": 20.0,
        "similarity_fct": "cos_sim"
    }
    

task684_online_privacy_policy_text_information_type_generation

  • Dataset: task684_online_privacy_policy_text_information_type_generation
  • Size: 1,018 training samples
  • Columns: anchor, positive, and negative
  • Approximate statistics based on the first 1000 samples:
    anchorpositivenegative
    typestringstringstring
    detailsmin: 10 tokensmean: 29.91 tokensmax: 68 tokensmin: 10 tokensmean: 30.18 tokensmax: 61 tokensmin: 14 tokensmean: 30.06 tokensmax: 68 tokens
  • Samples:
  • Loss: MultipleNegativesRankingLoss with these parameters:
    {
        "scale": 20.0,
        "similarity_fct": "cos_sim"
    }
    

task1290_xsum_summarization

  • Dataset: task1290_xsum_summarization
  • Size: 1,018 training samples
  • Columns: anchor, positive, and negative
  • Approximate statistics based on the first 1000 samples:
    anchorpositivenegative
    typestringstringstring
    detailsmin: 39 tokensmean: 226.28 tokensmax: 256 tokensmin: 50 tokensmean: 229.51 tokensmax: 256 tokensmin: 34 tokensmean: 229.59 tokensmax: 256 tokens
  • Samples:
  • Loss: MultipleNegativesRankingLoss with these parameters:
    {
        "scale": 20.0,
        "similarity_fct": "cos_sim"
    }
    

task075_squad1.1_answer_generation

  • Dataset: task075_squad1.1_answer_generation
  • Size: 1,018 training samples
  • Columns: anchor, positive, and negative
  • Approximate statistics based on the first 1000 samples:
    anchorpositivenegative
    typestringstringstring
    detailsmin: 48 tokensmean: 167.12 tokensmax: 256 tokensmin: 45 tokensmean: 173.01 tokensmax: 256 tokensmin: 46 tokensmean: 178.89 tokensmax: 256 tokens
  • Samples:
  • Loss: MultipleNegativesRankingLoss with these parameters:
    {
        "scale": 20.0,
        "similarity_fct": "cos_sim"
    }
    

task1587_scifact_classification

  • Dataset: task1587_scifact_classification
  • Size: 1,018 training samples
  • Columns: anchor, positive, and negative
  • Approximate statistics based on the first 1000 samples:
    anchorpositivenegative
    typestringstringstring
    detailsmin: 88 tokensmean: 242.08 tokensmax: 256 tokensmin: 90 tokensmean: 246.93 tokensmax: 256 tokensmin: 86 tokensmean: 244.36 tokensmax: 256 tokens
  • Samples:
  • Loss: MultipleNegativesRankingLoss with these parameters:
    {
        "scale": 20.0,
        "similarity_fct": "cos_sim"
    }
    

task384_socialiqa_question_classification

  • Dataset: task384_socialiqa_question_classification
  • Size: 1,018 training samples
  • Columns: anchor, positive, and negative
  • Approximate statistics based on the first 1000 samples:
    anchorpositivenegative
    typestringstringstring
    detailsmin: 24 tokensmean: 35.46 tokensmax: 78 tokensmin: 22 tokensmean: 34.33 tokensmax: 59 tokensmin: 22 tokensmean: 34.52 tokensmax: 57 tokens
  • Samples:
  • Loss: MultipleNegativesRankingLoss with these parameters:
    {
        "scale": 20.0,
        "similarity_fct": "cos_sim"
    }
    

task1555_scitail_answer_generation

  • Dataset: task1555_scitail_answer_generation
  • Size: 1,018 training samples
  • Columns: anchor, positive, and negative
  • Approximate statistics based on the first 1000 samples:
    anchorpositivenegative
    typestringstringstring
    detailsmin: 18 tokensmean: 36.88 tokensmax: 90 tokensmin: 18 tokensmean: 36.12 tokensmax: 80 tokensmin: 18 tokensmean: 36.59 tokensmax: 92 tokens
  • Samples:
  • Loss: MultipleNegativesRankingLoss with these parameters:
    {
        "scale": 20.0,
        "similarity_fct": "cos_sim"
    }
    

task1532_daily_dialog_emotion_classification

  • Dataset: task1532_daily_dialog_emotion_classification
  • Size: 1,018 training samples
  • Columns: anchor, positive, and negative
  • Approximate statistics based on the first 1000 samples:
    anchorpositivenegative
    typestringstringstring
    detailsmin: 16 tokensmean: 135.8 tokensmax: 256 tokensmin: 15 tokensmean: 140.06 tokensmax: 256 tokensmin: 17 tokensmean: 134.53 tokensmax: 256 tokens
  • Samples:
  • Loss: MultipleNegativesRankingLoss with these parameters:
    {
        "scale": 20.0,
        "similarity_fct": "cos_sim"
    }
    

task239_tweetqa_answer_generation

  • Dataset: task239_tweetqa_answer_generation
  • Size: 1,018 training samples
  • Columns: anchor, positive, and negative
  • Approximate statistics based on the first 1000 samples:
    anchorpositivenegative
    typestringstringstring
    detailsmin: 28 tokensmean: 56.05 tokensmax: 91 tokensmin: 29 tokensmean: 56.59 tokensmax: 92 tokensmin: 25 tokensmean: 56.05 tokensmax: 81 tokens
  • Samples:
  • Loss: MultipleNegativesRankingLoss with these parameters:
    {
        "scale": 20.0,
        "similarity_fct": "cos_sim"
    }
    

task596_mocha_question_generation

  • Dataset: task596_mocha_question_generation
  • Size: 1,018 training samples
  • Columns: anchor, positive, and negative
  • Approximate statistics based on the first 1000 samples:
    anchorpositivenegative
    typestringstringstring
    detailsmin: 34 tokensmean: 80.75 tokensmax: 163 tokensmin: 12 tokensmean: 96.06 tokensmax: 256 tokensmin: 10 tokensmean: 45.02 tokensmax: 256 tokens
  • Samples:
  • Loss: MultipleNegativesRankingLoss with these parameters:
    {
        "scale": 20.0,
        "similarity_fct": "cos_sim"
    }
    

task1411_dart_subject_identification

  • Dataset: task1411_dart_subject_identification
  • Size: 1,018 training samples
  • Columns: anchor, positive, and negative
  • Approximate statistics based on the first 1000 samples:
    anchorpositivenegative
    typestringstringstring
    detailsmin: 7 tokensmean: 15.01 tokensmax: 74 tokensmin: 6 tokensmean: 14.1 tokensmax: 37 tokensmin: 6 tokensmean: 14.36 tokensmax: 38 tokens
  • Samples:
  • Loss: MultipleNegativesRankingLoss with these parameters:
    {
        "scale": 20.0,
        "similarity_fct": "cos_sim"
    }
    

task1359_numer_sense_answer_generation

  • Dataset: task1359_numer_sense_answer_generation
  • Size: 1,018 training samples
  • Columns: anchor, positive, and negative
  • Approximate statistics based on the first 1000 samples:
    anchorpositivenegative
    typestringstringstring
    detailsmin: 10 tokensmean: 18.75 tokensmax: 30 tokensmin: 10 tokensmean: 18.43 tokensmax: 33 tokensmin: 10 tokensmean: 18.3 tokensmax: 30 tokens
  • Samples:
  • Loss: MultipleNegativesRankingLoss with these parameters:
    {
        "scale": 20.0,
        "similarity_fct": "cos_sim"
    }
    

task329_gap_classification

  • Dataset: task329_gap_classification
  • Size: 1,018 training samples
  • Columns: anchor, positive, and negative
  • Approximate statistics based on the first 1000 samples:
    anchorpositivenegative
    typestringstringstring
    detailsmin: 40 tokensmean: 123.98 tokensmax: 256 tokensmin: 62 tokensmean: 127.04 tokensmax: 256 tokensmin: 58 tokensmean: 128.35 tokensmax: 256 tokens
  • Samples:
  • Loss: MultipleNegativesRankingLoss with these parameters:
    {
        "scale": 20.0,
        "similarity_fct": "cos_sim"
    }
    

task220_rocstories_title_classification

  • Dataset: task220_rocstories_title_classification
  • Size: 1,018 training samples
  • Columns: anchor, positive, and negative
  • Approximate statistics based on the first 1000 samples:
    anchorpositivenegative
    typestringstringstring
    detailsmin: 53 tokensmean: 80.81 tokensmax: 116 tokensmin: 51 tokensmean: 81.14 tokensmax: 108 tokensmin: 55 tokensmean: 79.79 tokensmax: 115 tokens
  • Samples:
  • Loss: MultipleNegativesRankingLoss with these parameters:
    {
        "scale": 20.0,
        "similarity_fct": "cos_sim"
    }
    

task316_crows-pairs_classification_stereotype

  • Dataset: task316_crows-pairs_classification_stereotype
  • Size: 1,018 training samples
  • Columns: anchor, positive, and negative
  • Approximate statistics based on the first 1000 samples:
    anchorpositivenegative
    typestringstringstring
    detailsmin: 8 tokensmean: 19.78 tokensmax: 51 tokensmin: 7 tokensmean: 18.35 tokensmax: 41 tokensmin: 7 tokensmean: 19.82 tokensmax: 52 tokens
  • Samples:
  • Loss: MultipleNegativesRankingLoss with these parameters:
    {
        "scale": 20.0,
        "similarity_fct": "cos_sim"
    }
    

task495_semeval_headline_classification

  • Dataset: task495_semeval_headline_classification
  • Size: 1,018 training samples
  • Columns: anchor, positive, and negative
  • Approximate statistics based on the first 1000 samples:
    anchorpositivenegative
    typestringstringstring
    detailsmin: 17 tokensmean: 24.57 tokensmax: 42 tokensmin: 15 tokensmean: 24.23 tokensmax: 41 tokensmin: 15 tokensmean: 24.2 tokensmax: 38 tokens
  • Samples:
  • Loss: MultipleNegativesRankingLoss with these parameters:
    {
        "scale": 20.0,
        "similarity_fct": "cos_sim"
    }
    

task1168_brown_coarse_pos_tagging

  • Dataset: task1168_brown_coarse_pos_tagging
  • Size: 1,018 training samples
  • Columns: anchor, positive, and negative
  • Approximate statistics based on the first 1000 samples:
    anchorpositivenegative
    typestringstringstring
    detailsmin: 13 tokensmean: 43.83 tokensmax: 142 tokensmin: 12 tokensmean: 43.44 tokensmax: 197 tokensmin: 12 tokensmean: 44.95 tokensmax: 197 tokens
  • Samples:
  • Loss: MultipleNegativesRankingLoss with these parameters:
    {
        "scale": 20.0,
        "similarity_fct": "cos_sim"
    }
    

task348_squad2.0_unanswerable_question_generation

  • Dataset: task348_squad2.0_unanswerable_question_generation
  • Size: 1,018 training samples
  • Columns: anchor, positive, and negative
  • Approximate statistics based on the first 1000 samples:
    anchorpositivenegative
    typestringstringstring
    detailsmin: 30 tokensmean: 153.01 tokensmax: 256 tokensmin: 38 tokensmean: 161.19 tokensmax: 256 tokensmin: 33 tokensmean: 167.06 tokensmax: 256 tokens
  • Samples:
  • Loss: MultipleNegativesRankingLoss with these parameters:
    {
        "scale": 20.0,
        "similarity_fct": "cos_sim"
    }
    

task049_multirc_questions_needed_to_answer

  • Dataset: task049_multirc_questions_needed_to_answer
  • Size: 1,018 training samples
  • Columns: anchor, positive, and negative
  • Approximate statistics based on the first 1000 samples:
    anchorpositivenegative
    typestringstringstring
    detailsmin: 174 tokensmean: 252.54 tokensmax: 256 tokensmin: 169 tokensmean: 252.57 tokensmax: 256 tokensmin: 178 tokensmean: 252.73 tokensmax: 256 tokens
  • Samples:
  • Loss: MultipleNegativesRankingLoss with these parameters:
    {
        "scale": 20.0,
        "similarity_fct": "cos_sim"
    }
    

task1534_daily_dialog_question_classification

  • Dataset: task1534_daily_dialog_question_classification
  • Size: 1,018 training samples
  • Columns: anchor, positive, and negative
  • Approximate statistics based on the first 1000 samples:
    anchorpositivenegative
    typestringstringstring
    detailsmin: 17 tokensmean: 125.31 tokensmax: 256 tokensmin: 15 tokensmean: 130.35 tokensmax: 256 tokensmin: 16 tokensmean: 135.56 tokensmax: 256 tokens
  • Samples:
  • Loss: MultipleNegativesRankingLoss with these parameters:
    {
        "scale": 20.0,
        "similarity_fct": "cos_sim"
    }
    

task322_jigsaw_classification_threat

  • Dataset: task322_jigsaw_classification_threat
  • Size: 1,018 training samples
  • Columns: anchor, positive, and negative
  • Approximate statistics based on the first 1000 samples:
    anchorpositivenegative
    typestringstringstring
    detailsmin: 7 tokensmean: 54.84 tokensmax: 256 tokensmin: 6 tokensmean: 62.09 tokensmax: 249 tokensmin: 6 tokensmean: 62.43 tokensmax: 256 tokens
  • Samples:
  • Loss: MultipleNegativesRankingLoss with these parameters:
    {
        "scale": 20.0,
        "similarity_fct": "cos_sim"
    }
    

task295_semeval_2020_task4_commonsense_reasoning

  • Dataset: task295_semeval_2020_task4_commonsense_reasoning
  • Size: 1,018 training samples
  • Columns: anchor, positive, and negative
  • Approximate statistics based on the first 1000 samples:
    anchorpositivenegative
    typestringstringstring
    detailsmin: 25 tokensmean: 44.81 tokensmax: 92 tokensmin: 25 tokensmean: 45.07 tokensmax: 95 tokensmin: 25 tokensmean: 44.7 tokensmax: 88 tokens
  • Samples:
  • Loss: MultipleNegativesRankingLoss with these parameters:
    {
        "scale": 20.0,
        "similarity_fct": "cos_sim"
    }
    

task186_snli_contradiction_to_entailment_text_modification

  • Dataset: task186_snli_contradiction_to_entailment_text_modification
  • Size: 1,018 training samples
  • Columns: anchor, positive, and negative
  • Approximate statistics based on the first 1000 samples:
    anchorpositivenegative
    typestringstringstring
    detailsmin: 18 tokensmean: 31.21 tokensmax: 102 tokensmin: 18 tokensmean: 30.13 tokensmax: 65 tokensmin: 18 tokensmean: 32.21 tokensmax: 67 tokens
  • Samples:
  • Loss: MultipleNegativesRankingLoss with these parameters:
    {
        "scale": 20.0,
        "similarity_fct": "cos_sim"
    }
    

task034_winogrande_question_modification_object

  • Dataset: task034_winogrande_question_modification_object
  • Size: 1,018 training samples
  • Columns: anchor, positive, and negative
  • Approximate statistics based on the first 1000 samples:
    anchorpositivenegative
    typestringstringstring
    detailsmin: 29 tokensmean: 36.36 tokensmax: 53 tokensmin: 29 tokensmean: 35.59 tokensmax: 54 tokensmin: 29 tokensmean: 34.87 tokensmax: 55 tokens
  • Samples:
  • Loss: MultipleNegativesRankingLoss with these parameters:
    {
        "scale": 20.0,
        "similarity_fct": "cos_sim"
    }
    

task160_replace_letter_in_a_sentence

  • Dataset: task160_replace_letter_in_a_sentence
  • Size: 1,018 training samples
  • Columns: anchor, positive, and negative
  • Approximate statistics based on the first 1000 samples:
    anchorpositivenegative
    typestringstringstring
    detailsmin: 29 tokensmean: 31.98 tokensmax: 49 tokensmin: 28 tokensmean: 31.78 tokensmax: 41 tokensmin: 29 tokensmean: 31.8 tokensmax: 48 tokens
  • Samples:
  • Loss: MultipleNegativesRankingLoss with these parameters:
    {
        "scale": 20.0,
        "similarity_fct": "cos_sim"
    }
    

task469_mrqa_answer_generation

  • Dataset: task469_mrqa_answer_generation
  • Size: 1,018 training samples
  • Columns: anchor, positive, and negative
  • Approximate statistics based on the first 1000 samples:
    anchorpositivenegative
    typestringstringstring
    detailsmin: 27 tokensmean: 182.22 tokensmax: 256 tokensmin: 25 tokensmean: 180.87 tokensmax: 256 tokensmin: 27 tokensmean: 184.07 tokensmax: 256 tokens
  • Samples:
  • Loss: MultipleNegativesRankingLoss with these parameters:
    {
        "scale": 20.0,
        "similarity_fct": "cos_sim"
    }
    

task105_story_cloze-rocstories_sentence_generation

  • Dataset: task105_story_cloze-rocstories_sentence_generation
  • Size: 1,018 training samples
  • Columns: anchor, positive, and negative
  • Approximate statistics based on the first 1000 samples:
    anchorpositivenegative
    typestringstringstring
    detailsmin: 36 tokensmean: 55.58 tokensmax: 75 tokensmin: 35 tokensmean: 54.96 tokensmax: 76 tokensmin: 36 tokensmean: 55.99 tokensmax: 76 tokens
  • Samples:
  • Loss: MultipleNegativesRankingLoss with these parameters:
    {
        "scale": 20.0,
        "similarity_fct": "cos_sim"
    }
    

task649_race_blank_question_generation

  • Dataset: task649_race_blank_question_generation
  • Size: 1,018 training samples
  • Columns: anchor, positive, and negative
  • Approximate statistics based on the first 1000 samples:
    anchorpositivenegative
    typestringstringstring
    detailsmin: 36 tokensmean: 253.19 tokensmax: 256 tokensmin: 36 tokensmean: 252.56 tokensmax: 256 tokensmin: 157 tokensmean: 254.12 tokensmax: 256 tokens
  • Samples:
  • Loss: MultipleNegativesRankingLoss with these parameters:
    {
        "scale": 20.0,
        "similarity_fct": "cos_sim"
    }
    

task1536_daily_dialog_happiness_classification

  • Dataset: task1536_daily_dialog_happiness_classification
  • Size: 1,018 training samples
  • Columns: anchor, positive, and negative
  • Approximate statistics based on the first 1000 samples:
    anchorpositivenegative
    typestringstringstring
    detailsmin: 13 tokensmean: 127.06 tokensmax: 256 tokensmin: 13 tokensmean: 133.94 tokensmax: 256 tokensmin: 16 tokensmean: 142.64 tokensmax: 256 tokens
  • Samples:
  • Loss: MultipleNegativesRankingLoss with these parameters:
    {
        "scale": 20.0,
        "similarity_fct": "cos_sim"
    }
    

task683_online_privacy_policy_text_purpose_answer_generation

  • Dataset: task683_online_privacy_policy_text_purpose_answer_generation
  • Size: 1,018 training samples
  • Columns: anchor, positive, and negative
  • Approximate statistics based on the first 1000 samples:
    anchorpositivenegative
    typestringstringstring
    detailsmin: 10 tokensmean: 29.93 tokensmax: 68 tokensmin: 10 tokensmean: 30.22 tokensmax: 64 tokensmin: 14 tokensmean: 29.85 tokensmax: 68 tokens
  • Samples:
  • Loss: MultipleNegativesRankingLoss with these parameters:
    {
        "scale": 20.0,
        "similarity_fct": "cos_sim"
    }
    

task024_cosmosqa_answer_generation

  • Dataset: task024_cosmosqa_answer_generation
  • Size: 1,018 training samples
  • Columns: anchor, positive, and negative
  • Approximate statistics based on the first 1000 samples:
    anchorpositivenegative
    typestringstringstring
    detailsmin: 45 tokensmean: 92.5 tokensmax: 176 tokensmin: 47 tokensmean: 93.22 tokensmax: 174 tokensmin: 42 tokensmean: 94.89 tokensmax: 183 tokens
  • Samples:
  • Loss: MultipleNegativesRankingLoss with these parameters:
    {
        "scale": 20.0,
        "similarity_fct": "cos_sim"
    }
    

task584_udeps_eng_fine_pos_tagging

  • Dataset: task584_udeps_eng_fine_pos_tagging
  • Size: 1,018 training samples
  • Columns: anchor, positive, and negative
  • Approximate statistics based on the first 1000 samples:
    anchorpositivenegative
    typestringstringstring
    detailsmin: 12 tokensmean: 40.13 tokensmax: 120 tokensmin: 12 tokensmean: 39.18 tokensmax: 186 tokensmin: 12 tokensmean: 40.4 tokensmax: 148 tokens
  • Samples:
  • Loss: MultipleNegativesRankingLoss with these parameters:
    {
        "scale": 20.0,
        "similarity_fct": "cos_sim"
    }
    

task066_timetravel_binary_consistency_classification

  • Dataset: task066_timetravel_binary_consistency_classification
  • Size: 1,018 training samples
  • Columns: anchor, positive, and negative
  • Approximate statistics based on the first 1000 samples:
    anchorpositivenegative
    typestringstringstring
    detailsmin: 42 tokensmean: 66.89 tokensmax: 93 tokensmin: 43 tokensmean: 67.42 tokensmax: 94 tokensmin: 45 tokensmean: 67.0 tokensmax: 92 tokens
  • Samples:
  • Loss: MultipleNegativesRankingLoss with these parameters:
    {
        "scale": 20.0,
        "similarity_fct": "cos_sim"
    }
    

task413_mickey_en_sentence_perturbation_generation

  • Dataset: task413_mickey_en_sentence_perturbation_generation
  • Size: 1,018 training samples
  • Columns: anchor, positive, and negative
  • Approximate statistics based on the first 1000 samples:
    anchorpositivenegative
    typestringstringstring
    detailsmin: 7 tokensmean: 13.77 tokensmax: 21 tokensmin: 7 tokensmean: 13.82 tokensmax: 21 tokensmin: 7 tokensmean: 13.31 tokensmax: 20 tokens
  • Samples:
  • Loss: MultipleNegativesRankingLoss with these parameters:
    {
        "scale": 20.0,
        "similarity_fct": "cos_sim"
    }
    

task182_duorc_question_generation

  • Dataset: task182_duorc_question_generation
  • Size: 1,018 training samples
  • Columns: anchor, positive, and negative
  • Approximate statistics based on the first 1000 samples:
    anchorpositivenegative
    typestringstringstring
    detailsmin: 99 tokensmean: 241.8 tokensmax: 256 tokensmin: 120 tokensmean: 245.95 tokensmax: 256 tokensmin: 99 tokensmean: 246.6 tokensmax: 256 tokens
  • Samples:
  • Loss: MultipleNegativesRankingLoss with these parameters:
    {
        "scale": 20.0,
        "similarity_fct": "cos_sim"
    }
    

task028_drop_answer_generation

  • Dataset: task028_drop_answer_generation
  • Size: 1,018 training samples
  • Columns: anchor, positive, and negative
  • Approximate statistics based on the first 1000 samples:
    anchorpositivenegative
    typestringstringstring
    detailsmin: 76 tokensmean: 230.72 tokensmax: 256 tokensmin: 86 tokensmean: 234.59 tokensmax: 256 tokensmin: 81 tokensmean: 235.71 tokensmax: 256 tokens
  • Samples:
  • Loss: MultipleNegativesRankingLoss with these parameters:
    {
        "scale": 20.0,
        "similarity_fct": "cos_sim"
    }
    

task1601_webquestions_answer_generation

  • Dataset: task1601_webquestions_answer_generation
  • Size: 1,018 training samples
  • Columns: anchor, positive, and negative
  • Approximate statistics based on the first 1000 samples:
    anchorpositivenegative
    typestringstringstring
    detailsmin: 9 tokensmean: 16.47 tokensmax: 28 tokensmin: 11 tokensmean: 16.67 tokensmax: 28 tokensmin: 9 tokensmean: 16.76 tokensmax: 27 tokens
  • Samples:
  • Loss: MultipleNegativesRankingLoss with these parameters:
    {
        "scale": 20.0,
        "similarity_fct": "cos_sim"
    }
    

task1295_adversarial_qa_question_answering

  • Dataset: task1295_adversarial_qa_question_answering
  • Size: 1,018 training samples
  • Columns: anchor, positive, and negative
  • Approximate statistics based on the first 1000 samples:
    anchorpositivenegative
    typestringstringstring
    detailsmin: 45 tokensmean: 165.1 tokensmax: 256 tokensmin: 54 tokensmean: 167.21 tokensmax: 256 tokensmin: 48 tokensmean: 166.49 tokensmax: 256 tokens
  • Samples:
  • Loss: MultipleNegativesRankingLoss with these parameters:
    {
        "scale": 20.0,
        "similarity_fct": "cos_sim"
    }
    

task201_mnli_neutral_classification

  • Dataset: task201_mnli_neutral_classification
  • Size: 1,018 training samples
  • Columns: anchor, positive, and negative
  • Approximate statistics based on the first 1000 samples:
    anchorpositivenegative
    typestringstringstring
    detailsmin: 24 tokensmean: 73.0 tokensmax: 218 tokensmin: 25 tokensmean: 73.42 tokensmax: 170 tokensmin: 27 tokensmean: 72.48 tokensmax: 205 tokens
  • Samples:
  • Loss: MultipleNegativesRankingLoss with these parameters:
    {
        "scale": 20.0,
        "similarity_fct": "cos_sim"
    }
    

task038_qasc_combined_fact

  • Dataset: task038_qasc_combined_fact
  • Size: 1,018 training samples
  • Columns: anchor, positive, and negative
  • Approximate statistics based on the first 1000 samples:
    anchorpositivenegative
    typestringstringstring
    detailsmin: 18 tokensmean: 31.3 tokensmax: 57 tokensmin: 19 tokensmean: 30.49 tokensmax: 53 tokensmin: 18 tokensmean: 30.87 tokensmax: 53 tokens
  • Samples:
  • Loss: MultipleNegativesRankingLoss with these parameters:
    {
        "scale": 20.0,
        "similarity_fct": "cos_sim"
    }
    

task293_storycommonsense_emotion_text_generation

  • Dataset: task293_storycommonsense_emotion_text_generation
  • Size: 1,018 training samples
  • Columns: anchor, positive, and negative
  • Approximate statistics based on the first 1000 samples:
    anchorpositivenegative
    typestringstringstring
    detailsmin: 14 tokensmean: 40.74 tokensmax: 86 tokensmin: 15 tokensmean: 40.56 tokensmax: 86 tokensmin: 14 tokensmean: 38.5 tokensmax: 86 tokens
  • Samples:
  • Loss: MultipleNegativesRankingLoss with these parameters:
    {
        "scale": 20.0,
        "similarity_fct": "cos_sim"
    }
    

task572_recipe_nlg_text_generation

  • Dataset: task572_recipe_nlg_text_generation
  • Size: 1,018 training samples
  • Columns: anchor, positive, and negative
  • Approximate statistics based on the first 1000 samples:
    anchorpositivenegative
    typestringstringstring
    detailsmin: 24 tokensmean: 114.82 tokensmax: 256 tokensmin: 24 tokensmean: 121.93 tokensmax: 256 tokensmin: 24 tokensmean: 124.38 tokensmax: 256 tokens
  • Samples:
  • Loss: MultipleNegativesRankingLoss with these parameters:
    {
        "scale": 20.0,
        "similarity_fct": "cos_sim"
    }
    

task517_emo_classify_emotion_of_dialogue

  • Dataset: task517_emo_classify_emotion_of_dialogue
  • Size: 1,018 training samples
  • Columns: anchor, positive, and negative
  • Approximate statistics based on the first 1000 samples:
    anchorpositivenegative
    typestringstringstring
    detailsmin: 7 tokensmean: 18.18 tokensmax: 78 tokensmin: 7 tokensmean: 17.03 tokensmax: 59 tokensmin: 7 tokensmean: 18.39 tokensmax: 67 tokens
  • Samples:
  • Loss: MultipleNegativesRankingLoss with these parameters:
    {
        "scale": 20.0,
        "similarity_fct": "cos_sim"
    }
    

task382_hybridqa_answer_generation

  • Dataset: task382_hybridqa_answer_generation
  • Size: 1,018 training samples
  • Columns: anchor, positive, and negative
  • Approximate statistics based on the first 1000 samples:
    anchorpositivenegative
    typestringstringstring
    detailsmin: 29 tokensmean: 42.34 tokensmax: 70 tokensmin: 29 tokensmean: 41.63 tokensmax: 74 tokensmin: 28 tokensmean: 41.73 tokensmax: 75 tokens
  • Samples:
  • Loss: MultipleNegativesRankingLoss with these parameters:
    {
        "scale": 20.0,
        "similarity_fct": "cos_sim"
    }
    

task176_break_decompose_questions

  • Dataset: task176_break_decompose_questions
  • Size: 1,018 training samples
  • Columns: anchor, positive, and negative
  • Approximate statistics based on the first 1000 samples:
    anchorpositivenegative
    typestringstringstring
    detailsmin: 9 tokensmean: 17.39 tokensmax: 41 tokensmin: 8 tokensmean: 17.19 tokensmax: 39 tokensmin: 8 tokensmean: 15.71 tokensmax: 38 tokens
  • Samples:
  • Loss: MultipleNegativesRankingLoss with these parameters:
    {
        "scale": 20.0,
        "similarity_fct": "cos_sim"
    }
    

task1291_multi_news_summarization

  • Dataset: task1291_multi_news_summarization
  • Size: 1,018 training samples
  • Columns: anchor, positive, and negative
  • Approximate statistics based on the first 1000 samples:
    anchorpositivenegative
    typestringstringstring
    detailsmin: 116 tokensmean: 255.36 tokensmax: 256 tokensmin: 146 tokensmean: 255.71 tokensmax: 256 tokensmin: 68 tokensmean: 252.09 tokensmax: 256 tokens
  • Samples:
  • Loss: MultipleNegativesRankingLoss with these parameters:
    {
        "scale": 20.0,
        "similarity_fct": "cos_sim"
    }
    

task155_count_nouns_verbs

  • Dataset: task155_count_nouns_verbs
  • Size: 1,018 training samples
  • Columns: anchor, positive, and negative
  • Approximate statistics based on the first 1000 samples:
    anchorpositivenegative
    typestringstringstring
    detailsmin: 23 tokensmean: 27.03 tokensmax: 56 tokensmin: 23 tokensmean: 26.8 tokensmax: 43 tokensmin: 23 tokensmean: 26.94 tokensmax: 46 tokens
  • Samples:
  • Loss: MultipleNegativesRankingLoss with these parameters:
    {
        "scale": 20.0,
        "similarity_fct": "cos_sim"
    }
    

task031_winogrande_question_generation_object

  • Dataset: task031_winogrande_question_generation_object
  • Size: 1,018 training samples
  • Columns: anchor, positive, and negative
  • Approximate statistics based on the first 1000 samples:
    anchorpositivenegative
    typestringstringstring
    detailsmin: 7 tokensmean: 7.42 tokensmax: 11 tokensmin: 7 tokensmean: 7.31 tokensmax: 11 tokensmin: 7 tokensmean: 7.27 tokensmax: 11 tokens
  • Samples:
  • Loss: MultipleNegativesRankingLoss with these parameters:
    {
        "scale": 20.0,
        "similarity_fct": "cos_sim"
    }
    

task279_stereoset_classification_stereotype

  • Dataset: task279_stereoset_classification_stereotype
  • Size: 1,018 training samples
  • Columns: anchor, positive, and negative
  • Approximate statistics based on the first 1000 samples:
    anchorpositivenegative
    typestringstringstring
    detailsmin: 8 tokensmean: 17.91 tokensmax: 41 tokensmin: 8 tokensmean: 15.43 tokensmax: 43 tokensmin: 8 tokensmean: 17.2 tokensmax: 50 tokens
  • Samples:
  • Loss: MultipleNegativesRankingLoss with these parameters:
    {
        "scale": 20.0,
        "similarity_fct": "cos_sim"
    }
    

task1336_peixian_equity_evaluation_corpus_gender_classifier

  • Dataset: task1336_peixian_equity_evaluation_corpus_gender_classifier
  • Size: 1,018 training samples
  • Columns: anchor, positive, and negative
  • Approximate statistics based on the first 1000 samples:
    anchorpositivenegative
    typestringstringstring
    detailsmin: 6 tokensmean: 9.62 tokensmax: 17 tokensmin: 6 tokensmean: 9.6 tokensmax: 16 tokensmin: 6 tokensmean: 9.69 tokensmax: 16 tokens
  • Samples:
  • Loss: MultipleNegativesRankingLoss with these parameters:
    {
        "scale": 20.0,
        "similarity_fct": "cos_sim"
    }
    

task508_scruples_dilemmas_more_ethical_isidentifiable

  • Dataset: task508_scruples_dilemmas_more_ethical_isidentifiable
  • Size: 1,018 training samples
  • Columns: anchor, positive, and negative
  • Approximate statistics based on the first 1000 samples:
    anchorpositivenegative
    typestringstringstring
    detailsmin: 12 tokensmean: 29.63 tokensmax: 94 tokensmin: 12 tokensmean: 28.69 tokensmax: 94 tokensmin: 12 tokensmean: 28.59 tokensmax: 86 tokens
  • Samples:
  • Loss: MultipleNegativesRankingLoss with these parameters:
    {
        "scale": 20.0,
        "similarity_fct": "cos_sim"
    }
    

task518_emo_different_dialogue_emotions

  • Dataset: task518_emo_different_dialogue_emotions
  • Size: 1,018 training samples
  • Columns: anchor, positive, and negative
  • Approximate statistics based on the first 1000 samples:
    anchorpositivenegative
    typestringstringstring
    detailsmin: 28 tokensmean: 47.83 tokensmax: 106 tokensmin: 28 tokensmean: 45.51 tokensmax: 116 tokensmin: 26 tokensmean: 45.81 tokensmax: 123 tokens
  • Samples:
  • Loss: MultipleNegativesRankingLoss with these parameters:
    {
        "scale": 20.0,
        "similarity_fct": "cos_sim"
    }
    

task077_splash_explanation_to_sql

  • Dataset: task077_splash_explanation_to_sql
  • Size: 1,018 training samples
  • Columns: anchor, positive, and negative
  • Approximate statistics based on the first 1000 samples:
    anchorpositivenegative
    typestringstringstring
    detailsmin: 8 tokensmean: 39.82 tokensmax: 126 tokensmin: 8 tokensmean: 39.88 tokensmax: 126 tokensmin: 8 tokensmean: 35.83 tokensmax: 111 tokens
  • Samples:
  • Loss: MultipleNegativesRankingLoss with these parameters:
    {
        "scale": 20.0,
        "similarity_fct": "cos_sim"
    }
    

task923_event2mind_classifier

  • Dataset: task923_event2mind_classifier
  • Size: 1,018 training samples
  • Columns: anchor, positive, and negative
  • Approximate statistics based on the first 1000 samples:
    anchorpositivenegative
    typestringstringstring
    detailsmin: 10 tokensmean: 20.61 tokensmax: 46 tokensmin: 11 tokensmean: 18.62 tokensmax: 41 tokensmin: 11 tokensmean: 19.51 tokensmax: 46 tokens
  • Samples:
  • Loss: MultipleNegativesRankingLoss with these parameters:
    {
        "scale": 20.0,
        "similarity_fct": "cos_sim"
    }
    

task470_mrqa_question_generation

  • Dataset: task470_mrqa_question_generation
  • Size: 1,018 training samples
  • Columns: anchor, positive, and negative
  • Approximate statistics based on the first 1000 samples:
    anchorpositivenegative
    typestringstringstring
    detailsmin: 13 tokensmean: 172.18 tokensmax: 256 tokensmin: 11 tokensmean: 175.43 tokensmax: 256 tokensmin: 14 tokensmean: 180.36 tokensmax: 256 tokens
  • Samples:
  • Loss: MultipleNegativesRankingLoss with these parameters:
    {
        "scale": 20.0,
        "similarity_fct": "cos_sim"
    }
    

task638_multi_woz_classification

  • Dataset: task638_multi_woz_classification
  • Size: 1,018 training samples
  • Columns: anchor, positive, and negative
  • Approximate statistics based on the first 1000 samples:
    anchorpositivenegative
    typestringstringstring
    detailsmin: 78 tokensmean: 223.56 tokensmax: 256 tokensmin: 76 tokensmean: 220.51 tokensmax: 256 tokensmin: 64 tokensmean: 220.0 tokensmax: 256 tokens
  • Samples:
  • Loss: MultipleNegativesRankingLoss with these parameters:
    {
        "scale": 20.0,
        "similarity_fct": "cos_sim"
    }
    

task1412_web_questions_question_answering

  • Dataset: task1412_web_questions_question_answering
  • Size: 1,018 training samples
  • Columns: anchor, positive, and negative
  • Approximate statistics based on the first 1000 samples:
    anchorpositivenegative
    typestringstringstring
    detailsmin: 6 tokensmean: 10.33 tokensmax: 17 tokensmin: 6 tokensmean: 10.18 tokensmax: 17 tokensmin: 6 tokensmean: 10.08 tokensmax: 16 tokens
  • Samples:
  • Loss: MultipleNegativesRankingLoss with these parameters:
    {
        "scale": 20.0,
        "similarity_fct": "cos_sim"
    }
    

task847_pubmedqa_question_generation

  • Dataset: task847_pubmedqa_question_generation
  • Size: 1,018 training samples
  • Columns: anchor, positive, and negative
  • Approximate statistics based on the first 1000 samples:
    anchorpositivenegative
    typestringstringstring
    detailsmin: 21 tokensmean: 248.66 tokensmax: 256 tokensmin: 21 tokensmean: 248.78 tokensmax: 256 tokensmin: 43 tokensmean: 249.11 tokensmax: 256 tokens
  • Samples:
  • Loss: MultipleNegativesRankingLoss with these parameters:
    {
        "scale": 20.0,
        "similarity_fct": "cos_sim"
    }
    

task678_ollie_actual_relationship_answer_generation

  • Dataset: task678_ollie_actual_relationship_answer_generation
  • Size: 1,018 training samples
  • Columns: anchor, positive, and negative
  • Approximate statistics based on the first 1000 samples:
    anchorpositivenegative
    typestringstringstring
    detailsmin: 20 tokensmean: 41.01 tokensmax: 95 tokensmin: 19 tokensmean: 37.95 tokensmax: 102 tokensmin: 18 tokensmean: 41.14 tokensmax: 104 tokens
  • Samples:
  • Loss: MultipleNegativesRankingLoss with these parameters:
    {
        "scale": 20.0,
        "similarity_fct": "cos_sim"
    }
    

task290_tellmewhy_question_answerability

  • Dataset: task290_tellmewhy_question_answerability
  • Size: 1,018 training samples
  • Columns: anchor, positive, and negative
  • Approximate statistics based on the first 1000 samples:
    anchorpositivenegative
    typestringstringstring
    detailsmin: 37 tokensmean: 63.19 tokensmax: 95 tokensmin: 36 tokensmean: 62.66 tokensmax: 94 tokensmin: 37 tokensmean: 63.44 tokensmax: 95 tokens
  • Samples:
  • Loss: MultipleNegativesRankingLoss with these parameters:
    {
        "scale": 20.0,
        "similarity_fct": "cos_sim"
    }
    

task575_air_dialogue_classification

  • Dataset: task575_air_dialogue_classification
  • Size: 1,018 training samples
  • Columns: anchor, positive, and negative
  • Approximate statistics based on the first 1000 samples:
    anchorpositivenegative
    typestringstringstring
    detailsmin: 4 tokensmean: 14.16 tokensmax: 45 tokensmin: 4 tokensmean: 13.55 tokensmax: 43 tokensmin: 4 tokensmean: 12.3 tokensmax: 42 tokens
  • Samples:
  • Loss: MultipleNegativesRankingLoss with these parameters:
    {
        "scale": 20.0,
        "similarity_fct": "cos_sim"
    }
    

task189_snli_neutral_to_contradiction_text_modification

  • Dataset: task189_snli_neutral_to_contradiction_text_modification
  • Size: 1,018 training samples
  • Columns: anchor, positive, and negative
  • Approximate statistics based on the first 1000 samples:
    anchorpositivenegative
    typestringstringstring
    detailsmin: 18 tokensmean: 31.82 tokensmax: 60 tokensmin: 18 tokensmean: 30.75 tokensmax: 57 tokensmin: 18 tokensmean: 33.25 tokensmax: 105 tokens
  • Samples:
  • Loss: MultipleNegativesRankingLoss with these parameters:
    {
        "scale": 20.0,
        "similarity_fct": "cos_sim"
    }
    

task026_drop_question_generation

  • Dataset: task026_drop_question_generation
  • Size: 1,018 training samples
  • Columns: anchor, positive, and negative
  • Approximate statistics based on the first 1000 samples:
    anchorpositivenegative
    typestringstringstring
    detailsmin: 82 tokensmean: 219.39 tokensmax: 256 tokensmin: 57 tokensmean: 222.63 tokensmax: 256 tokensmin: 96 tokensmean: 232.08 tokensmax: 256 tokens
  • Samples:
  • Loss: MultipleNegativesRankingLoss with these parameters:
    {
        "scale": 20.0,
        "similarity_fct": "cos_sim"
    }
    

task162_count_words_starting_with_letter

  • Dataset: task162_count_words_starting_with_letter
  • Size: 1,018 training samples
  • Columns: anchor, positive, and negative
  • Approximate statistics based on the first 1000 samples:
    anchorpositivenegative
    typestringstringstring
    detailsmin: 28 tokensmean: 32.21 tokensmax: 56 tokensmin: 28 tokensmean: 31.77 tokensmax: 45 tokensmin: 28 tokensmean: 31.64 tokensmax: 46 tokens
  • Samples:
  • Loss: MultipleNegativesRankingLoss with these parameters:
    {
        "scale": 20.0,
        "similarity_fct": "cos_sim"
    }
    

task079_conala_concat_strings

  • Dataset: task079_conala_concat_strings
  • Size: 1,018 training samples
  • Columns: anchor, positive, and negative
  • Approximate statistics based on the first 1000 samples:
    anchorpositivenegative
    typestringstringstring
    detailsmin: 11 tokensmean: 39.62 tokensmax: 76 tokensmin: 11 tokensmean: 34.2 tokensmax: 80 tokensmin: 11 tokensmean: 33.53 tokensmax: 76 tokens
  • Samples:
  • Loss: MultipleNegativesRankingLoss with these parameters:
    {
        "scale": 20.0,
        "similarity_fct": "cos_sim"
    }
    

task610_conllpp_ner

  • Dataset: task610_conllpp_ner
  • Size: 1,018 training samples
  • Columns: anchor, positive, and negative
  • Approximate statistics based on the first 1000 samples:
    anchorpositivenegative
    typestringstringstring
    detailsmin: 4 tokensmean: 19.55 tokensmax: 62 tokensmin: 4 tokensmean: 20.27 tokensmax: 62 tokensmin: 4 tokensmean: 14.12 tokensmax: 54 tokens
  • Samples:
  • Loss: MultipleNegativesRankingLoss with these parameters:
    {
        "scale": 20.0,
        "similarity_fct": "cos_sim"
    }
    

task046_miscellaneous_question_typing

  • Dataset: task046_miscellaneous_question_typing
  • Size: 1,018 training samples
  • Columns: anchor, positive, and negative
  • Approximate statistics based on the first 1000 samples:
    anchorpositivenegative
    typestringstringstring
    detailsmin: 16 tokensmean: 25.41 tokensmax: 70 tokensmin: 16 tokensmean: 24.94 tokensmax: 70 tokensmin: 16 tokensmean: 25.13 tokensmax: 57 tokens
  • Samples:
  • Loss: MultipleNegativesRankingLoss with these parameters:
    {
        "scale": 20.0,
        "similarity_fct": "cos_sim"
    }
    

task197_mnli_domain_answer_generation

  • Dataset: task197_mnli_domain_answer_generation
  • Size: 1,018 training samples
  • Columns: anchor, positive, and negative
  • Approximate statistics based on the first 1000 samples:
    anchorpositivenegative
    typestringstringstring
    detailsmin: 15 tokensmean: 44.09 tokensmax: 197 tokensmin: 12 tokensmean: 44.97 tokensmax: 211 tokensmin: 11 tokensmean: 39.22 tokensmax: 115 tokens
  • Samples:
  • Loss: MultipleNegativesRankingLoss with these parameters:
    {
        "scale": 20.0,
        "similarity_fct": "cos_sim"
    }
    

task1325_qa_zre_question_generation_on_subject_relation

  • Dataset: task1325_qa_zre_question_generation_on_subject_relation
  • Size: 1,018 training samples
  • Columns: anchor, positive, and negative
  • Approximate statistics based on the first 1000 samples:
    anchorpositivenegative
    typestringstringstring
    detailsmin: 18 tokensmean: 51.02 tokensmax: 256 tokensmin: 20 tokensmean: 49.57 tokensmax: 180 tokensmin: 22 tokensmean: 54.59 tokensmax: 256 tokens
  • Samples:
  • Loss: MultipleNegativesRankingLoss with these parameters:
    {
        "scale": 20.0,
        "similarity_fct": "cos_sim"
    }
    

task430_senteval_subject_count

  • Dataset: task430_senteval_subject_count
  • Size: 1,018 training samples
  • Columns: anchor, positive, and negative
  • Approximate statistics based on the first 1000 samples:
    anchorpositivenegative
    typestringstringstring
    detailsmin: 7 tokensmean: 17.14 tokensmax: 35 tokensmin: 7 tokensmean: 15.31 tokensmax: 34 tokensmin: 7 tokensmean: 16.13 tokensmax: 34 tokens
  • Samples:
  • Loss: MultipleNegativesRankingLoss with these parameters:
    {
        "scale": 20.0,
        "similarity_fct": "cos_sim"
    }
    

task672_nummersense

  • Dataset: task672_nummersense
  • Size: 1,018 training samples
  • Columns: anchor, positive, and negative
  • Approximate statistics based on the first 1000 samples:
    anchorpositivenegative
    typestringstringstring
    detailsmin: 7 tokensmean: 15.72 tokensmax: 30 tokensmin: 7 tokensmean: 15.33 tokensmax: 27 tokensmin: 7 tokensmean: 15.21 tokensmax: 30 tokens
  • Samples:
  • Loss: MultipleNegativesRankingLoss with these parameters:
    {
        "scale": 20.0,
        "similarity_fct": "cos_sim"
    }
    

task402_grailqa_paraphrase_generation

  • Dataset: task402_grailqa_paraphrase_generation
  • Size: 1,018 training samples
  • Columns: anchor, positive, and negative
  • Approximate statistics based on the first 1000 samples:
    anchorpositivenegative
    typestringstringstring
    detailsmin: 23 tokensmean: 127.55 tokensmax: 256 tokensmin: 24 tokensmean: 139.34 tokensmax: 256 tokensmin: 22 tokensmean: 133.69 tokensmax: 256 tokens
  • Samples:
  • Loss: MultipleNegativesRankingLoss with these parameters:
    {
        "scale": 20.0,
        "similarity_fct": "cos_sim"
    }
    

task904_hate_speech_offensive_classification

  • Dataset: task904_hate_speech_offensive_classification
  • Size: 1,018 training samples
  • Columns: anchor, positive, and negative
  • Approximate statistics based on the first 1000 samples:
    anchorpositivenegative
    typestringstringstring
    detailsmin: 8 tokensmean: 35.03 tokensmax: 157 tokensmin: 8 tokensmean: 34.67 tokensmax: 256 tokensmin: 5 tokensmean: 27.84 tokensmax: 148 tokens
  • Samples:
  • Loss: MultipleNegativesRankingLoss with these parameters:
    {
        "scale": 20.0,
        "similarity_fct": "cos_sim"
    }
    

task192_hotpotqa_sentence_generation

  • Dataset: task192_hotpotqa_sentence_generation
  • Size: 1,018 training samples
  • Columns: anchor, positive, and negative
  • Approximate statistics based on the first 1000 samples:
    anchorpositivenegative
    typestringstringstring
    detailsmin: 37 tokensmean: 125.55 tokensmax: 256 tokensmin: 35 tokensmean: 123.85 tokensmax: 256 tokensmin: 33 tokensmean: 134.16 tokensmax: 256 tokens
  • Samples:
  • Loss: MultipleNegativesRankingLoss with these parameters:
    {
        "scale": 20.0,
        "similarity_fct": "cos_sim"
    }
    

task069_abductivenli_classification

  • Dataset: task069_abductivenli_classification
  • Size: 1,018 training samples
  • Columns: anchor, positive, and negative
  • Approximate statistics based on the first 1000 samples:
    anchorpositivenegative
    typestringstringstring
    detailsmin: 33 tokensmean: 52.09 tokensmax: 86 tokensmin: 33 tokensmean: 52.16 tokensmax: 95 tokensmin: 33 tokensmean: 51.84 tokensmax: 95 tokens
  • Samples:
  • Loss: MultipleNegativesRankingLoss with these parameters:
    {
        "scale": 20.0,
        "similarity_fct": "cos_sim"
    }
    

task574_air_dialogue_sentence_generation

  • Dataset: task574_air_dialogue_sentence_generation
  • Size: 1,018 training samples
  • Columns: anchor, positive, and negative
  • Approximate statistics based on the first 1000 samples:
    anchorpositivenegative
    typestringstringstring
    detailsmin: 54 tokensmean: 143.98 tokensmax: 256 tokensmin: 57 tokensmean: 143.52 tokensmax: 256 tokensmin: 66 tokensmean: 147.45 tokensmax: 256 tokens
  • Samples:
  • Loss: MultipleNegativesRankingLoss with these parameters:
    {
        "scale": 20.0,
        "similarity_fct": "cos_sim"
    }
    

task187_snli_entailment_to_contradiction_text_modification

  • Dataset: task187_snli_entailment_to_contradiction_text_modification
  • Size: 1,018 training samples
  • Columns: anchor, positive, and negative
  • Approximate statistics based on the first 1000 samples:
    anchorpositivenegative
    typestringstringstring
    detailsmin: 16 tokensmean: 30.23 tokensmax: 69 tokensmin: 16 tokensmean: 29.82 tokensmax: 104 tokensmin: 17 tokensmean: 29.44 tokensmax: 71 tokens
  • Samples:
  • Loss: MultipleNegativesRankingLoss with these parameters:
    {
        "scale": 20.0,
        "similarity_fct": "cos_sim"
    }
    

task749_glucose_reverse_cause_emotion_detection

  • Dataset: task749_glucose_reverse_cause_emotion_detection
  • Size: 1,018 training samples
  • Columns: anchor, positive, and negative
  • Approximate statistics based on the first 1000 samples:
    anchorpositivenegative
    typestringstringstring
    detailsmin: 38 tokensmean: 67.61 tokensmax: 106 tokensmin: 37 tokensmean: 67.14 tokensmax: 104 tokensmin: 39 tokensmean: 68.46 tokensmax: 107 tokens
  • Samples:
  • Loss: MultipleNegativesRankingLoss with these parameters:
    {
        "scale": 20.0,
        "similarity_fct": "cos_sim"
    }
    

task1552_scitail_question_generation

  • Dataset: task1552_scitail_question_generation
  • Size: 1,018 training samples
  • Columns: anchor, positive, and negative
  • Approximate statistics based on the first 1000 samples:
    anchorpositivenegative
    typestringstringstring
    detailsmin: 7 tokensmean: 18.37 tokensmax: 53 tokensmin: 7 tokensmean: 17.55 tokensmax: 46 tokensmin: 7 tokensmean: 15.88 tokensmax: 54 tokens
  • Samples:
  • Loss: MultipleNegativesRankingLoss with these parameters:
    {
        "scale": 20.0,
        "similarity_fct": "cos_sim"
    }
    

task750_aqua_multiple_choice_answering

  • Dataset: task750_aqua_multiple_choice_answering
  • Size: 1,018 training samples
  • Columns: anchor, positive, and negative
  • Approximate statistics based on the first 1000 samples:
    anchorpositivenegative
    typestringstringstring
    detailsmin: 33 tokensmean: 69.62 tokensmax: 194 tokensmin: 32 tokensmean: 67.98 tokensmax: 194 tokensmin: 28 tokensmean: 67.81 tokensmax: 165 tokens
  • Samples:
  • Loss: MultipleNegativesRankingLoss with these parameters:
    {
        "scale": 20.0,
        "similarity_fct": "cos_sim"
    }
    

task327_jigsaw_classification_toxic

  • Dataset: task327_jigsaw_classification_toxic
  • Size: 1,018 training samples
  • Columns: anchor, positive, and negative
  • Approximate statistics based on the first 1000 samples:
    anchorpositivenegative
    typestringstringstring
    detailsmin: 5 tokensmean: 36.8 tokensmax: 234 tokensmin: 5 tokensmean: 40.85 tokensmax: 256 tokensmin: 5 tokensmean: 45.53 tokensmax: 244 tokens
  • Samples:
  • Loss: MultipleNegativesRankingLoss with these parameters:
    {
        "scale": 20.0,
        "similarity_fct": "cos_sim"
    }
    

task1502_hatexplain_classification

  • Dataset: task1502_hatexplain_classification
  • Size: 1,018 training samples
  • Columns: anchor, positive, and negative
  • Approximate statistics based on the first 1000 samples:
    anchorpositivenegative
    typestringstringstring
    detailsmin: 5 tokensmean: 28.69 tokensmax: 73 tokensmin: 5 tokensmean: 26.7 tokensmax: 110 tokensmin: 5 tokensmean: 26.92 tokensmax: 90 tokens
  • Samples:
  • Loss: MultipleNegativesRankingLoss with these parameters:
    {
        "scale": 20.0,
        "similarity_fct": "cos_sim"
    }
    

task328_jigsaw_classification_insult

  • Dataset: task328_jigsaw_classification_insult
  • Size: 1,018 training samples
  • Columns: anchor, positive, and negative
  • Approximate statistics based on the first 1000 samples:
    anchorpositivenegative
    typestringstringstring
    detailsmin: 5 tokensmean: 51.02 tokensmax: 247 tokensmin: 5 tokensmean: 60.56 tokensmax: 256 tokensmin: 5 tokensmean: 64.19 tokensmax: 249 tokens
  • Samples:
  • Loss: MultipleNegativesRankingLoss with these parameters:
    {
        "scale": 20.0,
        "similarity_fct": "cos_sim"
    }
    

task304_numeric_fused_head_resolution

  • Dataset: task304_numeric_fused_head_resolution
  • Size: 1,018 training samples
  • Columns: anchor, positive, and negative
  • Approximate statistics based on the first 1000 samples:
    anchorpositivenegative
    typestringstringstring
    detailsmin: 15 tokensmean: 120.75 tokensmax: 256 tokensmin: 12 tokensmean: 122.1 tokensmax: 256 tokensmin: 11 tokensmean: 134.06 tokensmax: 256 tokens
  • Samples:
  • Loss: MultipleNegativesRankingLoss with these parameters:
    {
        "scale": 20.0,
        "similarity_fct": "cos_sim"
    }
    

task1293_kilt_tasks_hotpotqa_question_answering

  • Dataset: task1293_kilt_tasks_hotpotqa_question_answering
  • Size: 1,018 training samples
  • Columns: anchor, positive, and negative
  • Approximate statistics based on the first 1000 samples:
    anchorpositivenegative
    typestringstringstring
    detailsmin: 10 tokensmean: 24.78 tokensmax: 114 tokensmin: 9 tokensmean: 24.2 tokensmax: 114 tokensmin: 8 tokensmean: 23.85 tokensmax: 84 tokens
  • Samples:
  • Loss: MultipleNegativesRankingLoss with these parameters:
    {
        "scale": 20.0,
        "similarity_fct": "cos_sim"
    }
    

task216_rocstories_correct_answer_generation

  • Dataset: task216_rocstories_correct_answer_generation
  • Size: 1,018 training samples
  • Columns: anchor, positive, and negative
  • Approximate statistics based on the first 1000 samples:
    anchorpositivenegative
    typestringstringstring
    detailsmin: 39 tokensmean: 59.5 tokensmax: 83 tokensmin: 36 tokensmean: 58.38 tokensmax: 92 tokensmin: 39 tokensmean: 58.22 tokensmax: 95 tokens
  • Samples:
  • Loss: MultipleNegativesRankingLoss with these parameters:
    {
        "scale": 20.0,
        "similarity_fct": "cos_sim"
    }
    

task1326_qa_zre_question_generation_from_answer

  • Dataset: task1326_qa_zre_question_generation_from_answer
  • Size: 1,018 training samples
  • Columns: anchor, positive, and negative
  • Approximate statistics based on the first 1000 samples:
    anchorpositivenegative
    typestringstringstring
    detailsmin: 17 tokensmean: 46.37 tokensmax: 256 tokensmin: 14 tokensmean: 45.05 tokensmax: 256 tokensmin: 18 tokensmean: 49.47 tokensmax: 256 tokens
  • Samples:
  • Loss: MultipleNegativesRankingLoss with these parameters:
    {
        "scale": 20.0,
        "similarity_fct": "cos_sim"
    }
    

task1338_peixian_equity_evaluation_corpus_sentiment_classifier

  • Dataset: task1338_peixian_equity_evaluation_corpus_sentiment_classifier
  • Size: 1,018 training samples
  • Columns: anchor, positive, and negative
  • Approximate statistics based on the first 1000 samples:
    anchorpositivenegative
    typestringstringstring
    detailsmin: 6 tokensmean: 9.68 tokensmax: 16 tokensmin: 6 tokensmean: 9.71 tokensmax: 16 tokensmin: 6 tokensmean: 9.57 tokensmax: 17 tokens
  • Samples:
  • Loss: MultipleNegativesRankingLoss with these parameters:
    {
        "scale": 20.0,
        "similarity_fct": "cos_sim"
    }
    

task1729_personachat_generate_next

  • Dataset: task1729_personachat_generate_next
  • Size: 1,018 training samples
  • Columns: anchor, positive, and negative
  • Approximate statistics based on the first 1000 samples:
    anchorpositivenegative
    typestringstringstring
    detailsmin: 44 tokensmean: 146.46 tokensmax: 256 tokensmin: 43 tokensmean: 142.09 tokensmax: 256 tokensmin: 50 tokensmean: 144.22 tokensmax: 256 tokens
  • Samples:
  • Loss: MultipleNegativesRankingLoss with these parameters:
    {
        "scale": 20.0,
        "similarity_fct": "cos_sim"
    }
    

task1202_atomic_classification_xneed

  • Dataset: task1202_atomic_classification_xneed
  • Size: 1,018 training samples
  • Columns: anchor, positive, and negative
  • Approximate statistics based on the first 1000 samples:
    anchorpositivenegative
    typestringstringstring
    detailsmin: 14 tokensmean: 19.55 tokensmax: 32 tokensmin: 14 tokensmean: 19.39 tokensmax: 31 tokensmin: 14 tokensmean: 19.22 tokensmax: 28 tokens
  • Samples:
  • Loss: MultipleNegativesRankingLoss with these parameters:
    {
        "scale": 20.0,
        "similarity_fct": "cos_sim"
    }
    

task400_paws_paraphrase_classification

  • Dataset: task400_paws_paraphrase_classification
  • Size: 1,018 training samples
  • Columns: anchor, positive, and negative
  • Approximate statistics based on the first 1000 samples:
    anchorpositivenegative
    typestringstringstring
    detailsmin: 19 tokensmean: 52.28 tokensmax: 97 tokensmin: 18 tokensmean: 51.88 tokensmax: 98 tokensmin: 19 tokensmean: 53.03 tokensmax: 97 tokens
  • Samples:
  • Loss: MultipleNegativesRankingLoss with these parameters:
    {
        "scale": 20.0,
        "similarity_fct": "cos_sim"
    }
    

task502_scruples_anecdotes_whoiswrong_verification

  • Dataset: task502_scruples_anecdotes_whoiswrong_verification
  • Size: 1,018 training samples
  • Columns: anchor, positive, and negative
  • Approximate statistics based on the first 1000 samples:
    anchorpositivenegative
    typestringstringstring
    detailsmin: 12 tokensmean: 229.76 tokensmax: 256 tokensmin: 12 tokensmean: 236.43 tokensmax: 256 tokensmin: 23 tokensmean: 235.02 tokensmax: 256 tokens
  • Samples:
  • Loss: MultipleNegativesRankingLoss with these parameters:
    {
        "scale": 20.0,
        "similarity_fct": "cos_sim"
    }
    

task088_identify_typo_verification

  • Dataset: task088_identify_typo_verification
  • Size: 1,018 training samples
  • Columns: anchor, positive, and negative
  • Approximate statistics based on the first 1000 samples:
    anchorpositivenegative
    typestringstringstring
    detailsmin: 11 tokensmean: 15.08 tokensmax: 48 tokensmin: 10 tokensmean: 15.05 tokensmax: 47 tokensmin: 10 tokensmean: 15.39 tokensmax: 47 tokens
  • Samples:
  • Loss: MultipleNegativesRankingLoss with these parameters:
    {
        "scale": 20.0,
        "similarity_fct": "cos_sim"
    }
    

task221_rocstories_two_choice_classification

  • Dataset: task221_rocstories_two_choice_classification
  • Size: 1,018 training samples
  • Columns: anchor, positive, and negative
  • Approximate statistics based on the first 1000 samples:
    anchorpositivenegative
    typestringstringstring
    detailsmin: 47 tokensmean: 72.64 tokensmax: 108 tokensmin: 48 tokensmean: 72.66 tokensmax: 109 tokensmin: 46 tokensmean: 73.26 tokensmax: 108 tokens
  • Samples:
  • Loss: MultipleNegativesRankingLoss with these parameters:
    {
        "scale": 20.0,
        "similarity_fct": "cos_sim"
    }
    

task200_mnli_entailment_classification

  • Dataset: task200_mnli_entailment_classification
  • Size: 1,018 training samples
  • Columns: anchor, positive, and negative
  • Approximate statistics based on the first 1000 samples:
    anchorpositivenegative
    typestringstringstring
    detailsmin: 24 tokensmean: 72.63 tokensmax: 198 tokensmin: 23 tokensmean: 72.69 tokensmax: 224 tokensmin: 23 tokensmean: 73.44 tokensmax: 226 tokens
  • Samples:
  • Loss: MultipleNegativesRankingLoss with these parameters:
    {
        "scale": 20.0,
        "similarity_fct": "cos_sim"
    }
    

task074_squad1.1_question_generation

  • Dataset: task074_squad1.1_question_generation
  • Size: 1,018 training samples
  • Columns: anchor, positive, and negative
  • Approximate statistics based on the first 1000 samples:
    anchorpositivenegative
    typestringstringstring
    detailsmin: 30 tokensmean: 150.23 tokensmax: 256 tokensmin: 33 tokensmean: 160.48 tokensmax: 256 tokensmin: 38 tokensmean: 164.59 tokensmax: 256 tokens
  • Samples:
  • Loss: MultipleNegativesRankingLoss with these parameters:
    {
        "scale": 20.0,
        "similarity_fct": "cos_sim"
    }
    

task581_socialiqa_question_generation

  • Dataset: task581_socialiqa_question_generation
  • Size: 1,018 training samples
  • Columns: anchor, positive, and negative
  • Approximate statistics based on the first 1000 samples:
    anchorpositivenegative
    typestringstringstring
    detailsmin: 12 tokensmean: 26.52 tokensmax: 69 tokensmin: 14 tokensmean: 25.55 tokensmax: 48 tokensmin: 15 tokensmean: 25.85 tokensmax: 48 tokens
  • Samples:
  • Loss: MultipleNegativesRankingLoss with these parameters:
    {
        "scale": 20.0,
        "similarity_fct": "cos_sim"
    }
    

task1186_nne_hrngo_classification

  • Dataset: task1186_nne_hrngo_classification
  • Size: 1,018 training samples
  • Columns: anchor, positive, and negative
  • Approximate statistics based on the first 1000 samples:
    anchorpositivenegative
    typestringstringstring
    detailsmin: 19 tokensmean: 33.82 tokensmax: 79 tokensmin: 19 tokensmean: 33.49 tokensmax: 74 tokensmin: 20 tokensmean: 33.34 tokensmax: 77 tokens
  • Samples:
  • Loss: MultipleNegativesRankingLoss with these parameters:
    {
        "scale": 20.0,
        "similarity_fct": "cos_sim"
    }
    

task898_freebase_qa_answer_generation

  • Dataset: task898_freebase_qa_answer_generation
  • Size: 1,018 training samples
  • Columns: anchor, positive, and negative
  • Approximate statistics based on the first 1000 samples:
    anchorpositivenegative
    typestringstringstring
    detailsmin: 8 tokensmean: 19.18 tokensmax: 125 tokensmin: 8 tokensmean: 17.45 tokensmax: 49 tokensmin: 8 tokensmean: 17.48 tokensmax: 79 tokens
  • Samples:
  • Loss: MultipleNegativesRankingLoss with these parameters:
    {
        "scale": 20.0,
        "similarity_fct": "cos_sim"
    }
    

task1408_dart_similarity_classification

  • Dataset: task1408_dart_similarity_classification
  • Size: 1,018 training samples
  • Columns: anchor, positive, and negative
  • Approximate statistics based on the first 1000 samples:
    anchorpositivenegative
    typestringstringstring
    detailsmin: 22 tokensmean: 59.48 tokensmax: 147 tokensmin: 22 tokensmean: 61.95 tokensmax: 154 tokensmin: 20 tokensmean: 48.32 tokensmax: 124 tokens
  • Samples:
  • Loss: MultipleNegativesRankingLoss with these parameters:
    {
        "scale": 20.0,
        "similarity_fct": "cos_sim"
    }
    

task168_strategyqa_question_decomposition

  • Dataset: task168_strategyqa_question_decomposition
  • Size: 1,018 training samples
  • Columns: anchor, positive, and negative
  • Approximate statistics based on the first 1000 samples:
    anchorpositivenegative
    typestringstringstring
    detailsmin: 42 tokensmean: 81.83 tokensmax: 181 tokensmin: 42 tokensmean: 79.75 tokensmax: 179 tokensmin: 42 tokensmean: 77.43 tokensmax: 166 tokens
  • Samples:
  • Loss: MultipleNegativesRankingLoss with these parameters:
    {
        "scale": 20.0,
        "similarity_fct": "cos_sim"
    }
    

task1357_xlsum_summary_generation

  • Dataset: task1357_xlsum_summary_generation
  • Size: 1,018 training samples
  • Columns: anchor, positive, and negative
  • Approximate statistics based on the first 1000 samples:
    anchorpositivenegative
    typestringstringstring
    detailsmin: 67 tokensmean: 242.04 tokensmax: 256 tokensmin: 76 tokensmean: 243.28 tokensmax: 256 tokensmin: 67 tokensmean: 247.07 tokensmax: 256 tokens
  • Samples:
  • Loss: MultipleNegativesRankingLoss with these parameters:
    {
        "scale": 20.0,
        "similarity_fct": "cos_sim"
    }
    

task390_torque_text_span_selection

  • Dataset: task390_torque_text_span_selection
  • Size: 1,018 training samples
  • Columns: anchor, positive, and negative
  • Approximate statistics based on the first 1000 samples:
    anchorpositivenegative
    typestringstringstring
    detailsmin: 47 tokensmean: 110.04 tokensmax: 196 tokensmin: 42 tokensmean: 110.49 tokensmax: 195 tokensmin: 48 tokensmean: 110.67 tokensmax: 196 tokens
  • Samples:
  • Loss: MultipleNegativesRankingLoss with these parameters:
    {
        "scale": 20.0,
        "similarity_fct": "cos_sim"
    }
    

task165_mcscript_question_answering_commonsense

  • Dataset: task165_mcscript_question_answering_commonsense
  • Size: 1,018 training samples
  • Columns: anchor, positive, and negative
  • Approximate statistics based on the first 1000 samples:
    anchorpositivenegative
    typestringstringstring
    detailsmin: 147 tokensmean: 198.24 tokensmax: 256 tokensmin: 145 tokensmean: 196.67 tokensmax: 256 tokensmin: 147 tokensmean: 198.41 tokensmax: 256 tokens
  • Samples:
  • Loss: MultipleNegativesRankingLoss with these parameters:
    {
        "scale": 20.0,
        "similarity_fct": "cos_sim"
    }
    

task1533_daily_dialog_formal_classification

  • Dataset: task1533_daily_dialog_formal_classification
  • Size: 1,018 training samples
  • Columns: anchor, positive, and negative
  • Approximate statistics based on the first 1000 samples:
    anchorpositivenegative
    typestringstringstring
    detailsmin: 13 tokensmean: 129.55 tokensmax: 256 tokensmin: 15 tokensmean: 136.75 tokensmax: 256 tokensmin: 17 tokensmean: 137.33 tokensmax: 256 tokens
  • Samples:
  • Loss: MultipleNegativesRankingLoss with these parameters:
    {
        "scale": 20.0,
        "similarity_fct": "cos_sim"
    }
    

task002_quoref_answer_generation

  • Dataset: task002_quoref_answer_generation
  • Size: 1,018 training samples
  • Columns: anchor, positive, and negative
  • Approximate statistics based on the first 1000 samples:
    anchorpositivenegative
    typestringstringstring
    detailsmin: 214 tokensmean: 255.54 tokensmax: 256 tokensmin: 214 tokensmean: 255.53 tokensmax: 256 tokensmin: 224 tokensmean: 255.61 tokensmax: 256 tokens
  • Samples:
  • Loss: MultipleNegativesRankingLoss with these parameters:
    {
        "scale": 20.0,
        "similarity_fct": "cos_sim"
    }
    

task1297_qasc_question_answering

  • Dataset: task1297_qasc_question_answering
  • Size: 1,018 training samples
  • Columns: anchor, positive, and negative
  • Approximate statistics based on the first 1000 samples:
    anchorpositivenegative
    typestringstringstring
    detailsmin: 61 tokensmean: 84.69 tokensmax: 134 tokensmin: 59 tokensmean: 85.39 tokensmax: 130 tokensmin: 58 tokensmean: 84.83 tokensmax: 125 tokens
  • Samples:
  • Loss: MultipleNegativesRankingLoss with these parameters:
    {
        "scale": 20.0,
        "similarity_fct": "cos_sim"
    }
    

task305_jeopardy_answer_generation_normal

  • Dataset: task305_jeopardy_answer_generation_normal
  • Size: 1,018 training samples
  • Columns: anchor, positive, and negative
  • Approximate statistics based on the first 1000 samples:
    anchorpositivenegative
    typestringstringstring
    detailsmin: 9 tokensmean: 27.72 tokensmax: 59 tokensmin: 9 tokensmean: 27.43 tokensmax: 45 tokensmin: 11 tokensmean: 27.37 tokensmax: 46 tokens
  • Samples:
  • Loss: MultipleNegativesRankingLoss with these parameters:
    {
        "scale": 20.0,
        "similarity_fct": "cos_sim"
    }
    

task029_winogrande_full_object

  • Dataset: task029_winogrande_full_object
  • Size: 1,018 training samples
  • Columns: anchor, positive, and negative
  • Approximate statistics based on the first 1000 samples:
    anchorpositivenegative
    typestringstringstring
    detailsmin: 7 tokensmean: 7.37 tokensmax: 12 tokensmin: 7 tokensmean: 7.32 tokensmax: 11 tokensmin: 7 tokensmean: 7.24 tokensmax: 10 tokens
  • Samples:
  • Loss: MultipleNegativesRankingLoss with these parameters:
    {
        "scale": 20.0,
        "similarity_fct": "cos_sim"
    }
    

task1327_qa_zre_answer_generation_from_question

  • Dataset: task1327_qa_zre_answer_generation_from_question
  • Size: 1,018 training samples
  • Columns: anchor, positive, and negative
  • Approximate statistics based on the first 1000 samples:
    anchorpositivenegative
    typestringstringstring
    detailsmin: 24 tokensmean: 55.0 tokensmax: 256 tokensmin: 23 tokensmean: 52.2 tokensmax: 256 tokensmin: 27 tokensmean: 55.59 tokensmax: 256 tokens
  • Samples:
  • Loss: MultipleNegativesRankingLoss with these parameters:
    {
        "scale": 20.0,
        "similarity_fct": "cos_sim"
    }
    

task326_jigsaw_classification_obscene

  • Dataset: task326_jigsaw_classification_obscene
  • Size: 1,018 training samples
  • Columns: anchor, positive, and negative
  • Approximate statistics based on the first 1000 samples:
    anchorpositivenegative
    typestringstringstring
    detailsmin: 5 tokensmean: 65.45 tokensmax: 256 tokensmin: 5 tokensmean: 77.38 tokensmax: 256 tokensmin: 5 tokensmean: 74.07 tokensmax: 256 tokens
  • Samples:
  • Loss: MultipleNegativesRankingLoss with these parameters:
    {
        "scale": 20.0,
        "similarity_fct": "cos_sim"
    }
    

task1542_every_ith_element_from_starting

  • Dataset: task1542_every_ith_element_from_starting
  • Size: 1,018 training samples
  • Columns: anchor, positive, and negative
  • Approximate statistics based on the first 1000 samples:
    anchorpositivenegative
    typestringstringstring
    detailsmin: 13 tokensmean: 125.21 tokensmax: 245 tokensmin: 13 tokensmean: 123.54 tokensmax: 244 tokensmin: 13 tokensmean: 120.48 tokensmax: 238 tokens
  • Samples:
  • Loss: MultipleNegativesRankingLoss with these parameters:
    {
        "scale": 20.0,
        "similarity_fct": "cos_sim"
    }
    

task570_recipe_nlg_ner_generation

  • Dataset: task570_recipe_nlg_ner_generation
  • Size: 1,018 training samples
  • Columns: anchor, positive, and negative
  • Approximate statistics based on the first 1000 samples:
    anchorpositivenegative
    typestringstringstring
    detailsmin: 9 tokensmean: 74.07 tokensmax: 250 tokensmin: 5 tokensmean: 73.6 tokensmax: 256 tokensmin: 8 tokensmean: 76.08 tokensmax: 256 tokens
  • Samples:
  • Loss: MultipleNegativesRankingLoss with these parameters:
    {
        "scale": 20.0,
        "similarity_fct": "cos_sim"
    }
    

task1409_dart_text_generation

  • Dataset: task1409_dart_text_generation
  • Size: 1,018 training samples
  • Columns: anchor, positive, and negative
  • Approximate statistics based on the first 1000 samples:
    anchorpositivenegative
    typestringstringstring
    detailsmin: 18 tokensmean: 67.5 tokensmax: 174 tokensmin: 18 tokensmean: 72.52 tokensmax: 170 tokensmin: 17 tokensmean: 67.55 tokensmax: 164 tokens
  • Samples:
  • Loss: MultipleNegativesRankingLoss with these parameters:
    {
        "scale": 20.0,
        "similarity_fct": "cos_sim"
    }
    

task401_numeric_fused_head_reference

  • Dataset: task401_numeric_fused_head_reference
  • Size: 1,018 training samples
  • Columns: anchor, positive, and negative
  • Approximate statistics based on the first 1000 samples:
    anchorpositivenegative
    typestringstringstring
    detailsmin: 16 tokensmean: 109.08 tokensmax: 256 tokensmin: 16 tokensmean: 116.35 tokensmax: 256 tokensmin: 18 tokensmean: 119.65 tokensmax: 256 tokens
  • Samples:
  • Loss: MultipleNegativesRankingLoss with these parameters:
    {
        "scale": 20.0,
        "similarity_fct": "cos_sim"
    }
    

task846_pubmedqa_classification

  • Dataset: task846_pubmedqa_classification
  • Size: 1,018 training samples
  • Columns: anchor, positive, and negative
  • Approximate statistics based on the first 1000 samples:
    anchorpositivenegative
    typestringstringstring
    detailsmin: 32 tokensmean: 85.83 tokensmax: 246 tokensmin: 33 tokensmean: 85.03 tokensmax: 225 tokensmin: 28 tokensmean: 93.96 tokensmax: 256 tokens
  • Samples:
  • Loss: MultipleNegativesRankingLoss with these parameters:
    {
        "scale": 20.0,
        "similarity_fct": "cos_sim"
    }
    

task1712_poki_classification

  • Dataset: task1712_poki_classification
  • Size: 1,018 training samples
  • Columns: anchor, positive, and negative
  • Approximate statistics based on the first 1000 samples:
    anchorpositivenegative
    typestringstringstring
    detailsmin: 6 tokensmean: 52.73 tokensmax: 256 tokensmin: 7 tokensmean: 55.65 tokensmax: 256 tokensmin: 7 tokensmean: 63.01 tokensmax: 256 tokens
  • Samples:
  • Loss: MultipleNegativesRankingLoss with these parameters:
    {
        "scale": 20.0,
        "similarity_fct": "cos_sim"
    }
    

task344_hybridqa_answer_generation

  • Dataset: task344_hybridqa_answer_generation
  • Size: 1,018 training samples
  • Columns: anchor, positive, and negative
  • Approximate statistics based on the first 1000 samples:
    anchorpositivenegative
    typestringstringstring
    detailsmin: 9 tokensmean: 22.15 tokensmax: 50 tokensmin: 8 tokensmean: 22.07 tokensmax: 58 tokensmin: 7 tokensmean: 22.07 tokensmax: 55 tokens
  • Samples:
  • Loss: MultipleNegativesRankingLoss with these parameters:
    {
        "scale": 20.0,
        "similarity_fct": "cos_sim"
    }
    

task875_emotion_classification

  • Dataset: task875_emotion_classification
  • Size: 1,018 training samples
  • Columns: anchor, positive, and negative
  • Approximate statistics based on the first 1000 samples:
    anchorpositivenegative
    typestringstringstring
    detailsmin: 4 tokensmean: 23.03 tokensmax: 75 tokensmin: 4 tokensmean: 18.42 tokensmax: 63 tokensmin: 5 tokensmean: 20.36 tokensmax: 68 tokens
  • Samples:
  • Loss: MultipleNegativesRankingLoss with these parameters:
    {
        "scale": 20.0,
        "similarity_fct": "cos_sim"
    }
    

task1214_atomic_classification_xwant

  • Dataset: task1214_atomic_classification_xwant
  • Size: 1,018 training samples
  • Columns: anchor, positive, and negative
  • Approximate statistics based on the first 1000 samples:
    anchorpositivenegative
    typestringstringstring
    detailsmin: 14 tokensmean: 19.66 tokensmax: 32 tokensmin: 14 tokensmean: 19.39 tokensmax: 29 tokensmin: 14 tokensmean: 19.57 tokensmax: 31 tokens
  • Samples:
  • Loss: MultipleNegativesRankingLoss with these parameters:
    {
        "scale": 20.0,
        "similarity_fct": "cos_sim"
    }
    

task106_scruples_ethical_judgment

  • Dataset: task106_scruples_ethical_judgment
  • Size: 1,018 training samples
  • Columns: anchor, positive, and negative
  • Approximate statistics based on the first 1000 samples:
    anchorpositivenegative
    typestringstringstring
    detailsmin: 12 tokensmean: 29.85 tokensmax: 70 tokensmin: 14 tokensmean: 28.96 tokensmax: 86 tokensmin: 14 tokensmean: 28.77 tokensmax: 58 tokens
  • Samples:
  • Loss: MultipleNegativesRankingLoss with these parameters:
    {
        "scale": 20.0,
        "similarity_fct": "cos_sim"
    }
    

task238_iirc_answer_from_passage_answer_generation

  • Dataset: task238_iirc_answer_from_passage_answer_generation
  • Size: 1,018 training samples
  • Columns: anchor, positive, and negative
  • Approximate statistics based on the first 1000 samples:
    anchorpositivenegative
    typestringstringstring
    detailsmin: 138 tokensmean: 242.59 tokensmax: 256 tokensmin: 165 tokensmean: 242.86 tokensmax: 256 tokensmin: 173 tokensmean: 243.06 tokensmax: 256 tokens
  • Samples:
  • Loss: MultipleNegativesRankingLoss with these parameters:
    {
        "scale": 20.0,
        "similarity_fct": "cos_sim"
    }
    

task1391_winogrande_easy_answer_generation

  • Dataset: task1391_winogrande_easy_answer_generation
  • Size: 1,018 training samples
  • Columns: anchor, positive, and negative
  • Approximate statistics based on the first 1000 samples:
    anchorpositivenegative
    typestringstringstring
    detailsmin: 26 tokensmean: 31.69 tokensmax: 54 tokensmin: 26 tokensmean: 31.28 tokensmax: 48 tokensmin: 25 tokensmean: 31.16 tokensmax: 49 tokens
  • Samples:
  • Loss: MultipleNegativesRankingLoss with these parameters:
    {
        "scale": 20.0,
        "similarity_fct": "cos_sim"
    }
    

task195_sentiment140_classification

  • Dataset: task195_sentiment140_classification
  • Size: 1,018 training samples
  • Columns: anchor, positive, and negative
  • Approximate statistics based on the first 1000 samples:
    anchorpositivenegative
    typestringstringstring
    detailsmin: 4 tokensmean: 22.62 tokensmax: 118 tokensmin: 4 tokensmean: 18.82 tokensmax: 79 tokensmin: 5 tokensmean: 21.32 tokensmax: 51 tokens
  • Samples:
  • Loss: MultipleNegativesRankingLoss with these parameters:
    {
        "scale": 20.0,
        "similarity_fct": "cos_sim"
    }
    

task163_count_words_ending_with_letter

  • Dataset: task163_count_words_ending_with_letter
  • Size: 1,018 training samples
  • Columns: anchor, positive, and negative
  • Approximate statistics based on the first 1000 samples:
    anchorpositivenegative
    typestringstringstring
    detailsmin: 28 tokensmean: 32.06 tokensmax: 54 tokensmin: 28 tokensmean: 31.69 tokensmax: 57 tokensmin: 28 tokensmean: 31.58 tokensmax: 43 tokens
  • Samples:
  • Loss: MultipleNegativesRankingLoss with these parameters:
    {
        "scale": 20.0,
        "similarity_fct": "cos_sim"
    }
    

task579_socialiqa_classification

  • Dataset: task579_socialiqa_classification
  • Size: 1,018 training samples
  • Columns: anchor, positive, and negative
  • Approximate statistics based on the first 1000 samples:
    anchorpositivenegative
    typestringstringstring
    detailsmin: 39 tokensmean: 54.2 tokensmax: 132 tokensmin: 36 tokensmean: 53.61 tokensmax: 103 tokensmin: 40 tokensmean: 54.16 tokensmax: 84 tokens
  • Samples:
  • Loss: MultipleNegativesRankingLoss with these parameters:
    {
        "scale": 20.0,
        "similarity_fct": "cos_sim"
    }
    

task569_recipe_nlg_text_generation

  • Dataset: task569_recipe_nlg_text_generation
  • Size: 1,018 training samples
  • Columns: anchor, positive, and negative
  • Approximate statistics based on the first 1000 samples:
    anchorpositivenegative
    typestringstringstring
    detailsmin: 25 tokensmean: 193.73 tokensmax: 256 tokensmin: 55 tokensmean: 193.64 tokensmax: 256 tokensmin: 37 tokensmean: 198.12 tokensmax: 256 tokens
  • Samples:
  • Loss: MultipleNegativesRankingLoss with these parameters:
    {
        "scale": 20.0,
        "similarity_fct": "cos_sim"
    }
    

task1602_webquestion_question_genreation

  • Dataset: task1602_webquestion_question_genreation
  • Size: 1,018 training samples
  • Columns: anchor, positive, and negative
  • Approximate statistics based on the first 1000 samples:
    anchorpositivenegative
    typestringstringstring
    detailsmin: 12 tokensmean: 23.64 tokensmax: 112 tokensmin: 12 tokensmean: 24.12 tokensmax: 112 tokensmin: 12 tokensmean: 22.49 tokensmax: 120 tokens
  • Samples:
  • Loss: MultipleNegativesRankingLoss with these parameters:
    {
        "scale": 20.0,
        "similarity_fct": "cos_sim"
    }
    

task747_glucose_cause_emotion_detection

  • Dataset: task747_glucose_cause_emotion_detection
  • Size: 1,018 training samples
  • Columns: anchor, positive, and negative
  • Approximate statistics based on the first 1000 samples:
    anchorpositivenegative
    typestringstringstring
    detailsmin: 35 tokensmean: 68.15 tokensmax: 112 tokensmin: 36 tokensmean: 68.3 tokensmax: 108 tokensmin: 36 tokensmean: 68.79 tokensmax: 99 tokens
  • Samples:
  • Loss: MultipleNegativesRankingLoss with these parameters:
    {
        "scale": 20.0,
        "similarity_fct": "cos_sim"
    }
    

task219_rocstories_title_answer_generation

  • Dataset: task219_rocstories_title_answer_generation
  • Size: 1,018 training samples
  • Columns: anchor, positive, and negative
  • Approximate statistics based on the first 1000 samples:
    anchorpositivenegative
    typestringstringstring
    detailsmin: 42 tokensmean: 67.71 tokensmax: 97 tokensmin: 45 tokensmean: 66.7 tokensmax: 97 tokensmin: 41 tokensmean: 66.92 tokensmax: 96 tokens
  • Samples:
  • Loss: MultipleNegativesRankingLoss with these parameters:
    {
        "scale": 20.0,
        "similarity_fct": "cos_sim"
    }
    

task178_quartz_question_answering

  • Dataset: task178_quartz_question_answering
  • Size: 1,018 training samples
  • Columns: anchor, positive, and negative
  • Approximate statistics based on the first 1000 samples:
    anchorpositivenegative
    typestringstringstring
    detailsmin: 28 tokensmean: 57.78 tokensmax: 110 tokensmin: 28 tokensmean: 57.44 tokensmax: 111 tokensmin: 28 tokensmean: 56.86 tokensmax: 102 tokens
  • Samples:
  • Loss: MultipleNegativesRankingLoss with these parameters:
    {
        "scale": 20.0,
        "similarity_fct": "cos_sim"
    }
    

task103_facts2story_long_text_generation

  • Dataset: task103_facts2story_long_text_generation
  • Size: 1,018 training samples
  • Columns: anchor, positive, and negative
  • Approximate statistics based on the first 1000 samples:
    anchorpositivenegative
    typestringstringstring
    detailsmin: 52 tokensmean: 80.49 tokensmax: 143 tokensmin: 51 tokensmean: 82.22 tokensmax: 157 tokensmin: 49 tokensmean: 78.96 tokensmax: 145 tokens
  • Samples:
  • Loss: MultipleNegativesRankingLoss with these parameters:
    {
        "scale": 20.0,
        "similarity_fct": "cos_sim"
    }
    

task301_record_question_generation

  • Dataset: task301_record_question_generation
  • Size: 1,018 training samples
  • Columns: anchor, positive, and negative
  • Approximate statistics based on the first 1000 samples:
    anchorpositivenegative
    typestringstringstring
    detailsmin: 140 tokensmean: 210.71 tokensmax: 256 tokensmin: 139 tokensmean: 209.62 tokensmax: 256 tokensmin: 143 tokensmean: 208.74 tokensmax: 256 tokens
  • Samples:
  • Loss: MultipleNegativesRankingLoss with these parameters:
    {
        "scale": 20.0,
        "similarity_fct": "cos_sim"
    }
    

task1369_healthfact_sentence_generation

  • Dataset: task1369_healthfact_sentence_generation
  • Size: 1,018 training samples
  • Columns: anchor, positive, and negative
  • Approximate statistics based on the first 1000 samples:
    anchorpositivenegative
    typestringstringstring
    detailsmin: 110 tokensmean: 243.25 tokensmax: 256 tokensmin: 101 tokensmean: 243.17 tokensmax: 256 tokensmin: 113 tokensmean: 251.67 tokensmax: 256 tokens
  • Samples:
  • Loss: MultipleNegativesRankingLoss with these parameters:
    {
        "scale": 20.0,
        "similarity_fct": "cos_sim"
    }
    

task515_senteval_odd_word_out

  • Dataset: task515_senteval_odd_word_out
  • Size: 1,018 training samples
  • Columns: anchor, positive, and negative
  • Approximate statistics based on the first 1000 samples:
    anchorpositivenegative
    typestringstringstring
    detailsmin: 7 tokensmean: 19.72 tokensmax: 36 tokensmin: 7 tokensmean: 19.13 tokensmax: 38 tokensmin: 7 tokensmean: 19.0 tokensmax: 35 tokens
  • Samples:
  • Loss: MultipleNegativesRankingLoss with these parameters:
    {
        "scale": 20.0,
        "similarity_fct": "cos_sim"
    }
    

task496_semeval_answer_generation

  • Dataset: task496_semeval_answer_generation
  • Size: 1,018 training samples
  • Columns: anchor, positive, and negative
  • Approximate statistics based on the first 1000 samples:
    anchorpositivenegative
    typestringstringstring
    detailsmin: 4 tokensmean: 28.11 tokensmax: 46 tokensmin: 18 tokensmean: 27.8 tokensmax: 45 tokensmin: 19 tokensmean: 27.68 tokensmax: 45 tokens
  • Samples:
  • Loss: MultipleNegativesRankingLoss with these parameters:
    {
        "scale": 20.0,
        "similarity_fct": "cos_sim"
    }
    

task1658_billsum_summarization

  • Dataset: task1658_billsum_summarization
  • Size: 1,018 training samples
  • Columns: anchor, positive, and negative
  • Approximate statistics based on the first 1000 samples:
    anchorpositivenegative
    typestringstringstring
    detailsmin: 256 tokensmean: 256.0 tokensmax: 256 tokensmin: 256 tokensmean: 256.0 tokensmax: 256 tokensmin: 256 tokensmean: 256.0 tokensmax: 256 tokens
  • Samples:
  • Loss: MultipleNegativesRankingLoss with these parameters:
    {
        "scale": 20.0,
        "similarity_fct": "cos_sim"
    }
    

task1204_atomic_classification_hinderedby

  • Dataset: task1204_atomic_classification_hinderedby
  • Size: 1,018 training samples
  • Columns: anchor, positive, and negative
  • Approximate statistics based on the first 1000 samples:
    anchorpositivenegative
    typestringstringstring
    detailsmin: 14 tokensmean: 22.1 tokensmax: 35 tokensmin: 14 tokensmean: 22.07 tokensmax: 34 tokensmin: 14 tokensmean: 21.5 tokensmax: 38 tokens
  • Samples:
  • Loss: MultipleNegativesRankingLoss with these parameters:
    {
        "scale": 20.0,
        "similarity_fct": "cos_sim"
    }
    

task1392_superglue_multirc_answer_verification

  • Dataset: task1392_superglue_multirc_answer_verification
  • Size: 1,018 training samples
  • Columns: anchor, positive, and negative
  • Approximate statistics based on the first 1000 samples:
    anchorpositivenegative
    typestringstringstring
    detailsmin: 128 tokensmean: 241.77 tokensmax: 256 tokensmin: 127 tokensmean: 241.97 tokensmax: 256 tokensmin: 136 tokensmean: 242.04 tokensmax: 256 tokens
  • Samples:
  • Loss: MultipleNegativesRankingLoss with these parameters:
    {
        "scale": 20.0,
        "similarity_fct": "cos_sim"
    }
    

task306_jeopardy_answer_generation_double

  • Dataset: task306_jeopardy_answer_generation_double
  • Size: 1,018 training samples
  • Columns: anchor, positive, and negative
  • Approximate statistics based on the first 1000 samples:
    anchorpositivenegative
    typestringstringstring
    detailsmin: 10 tokensmean: 27.79 tokensmax: 47 tokensmin: 10 tokensmean: 27.16 tokensmax: 46 tokensmin: 11 tokensmean: 27.61 tokensmax: 47 tokens
  • Samples:
  • Loss: MultipleNegativesRankingLoss with these parameters:
    {
        "scale": 20.0,
        "similarity_fct": "cos_sim"
    }
    

task1286_openbookqa_question_answering

  • Dataset: task1286_openbookqa_question_answering
  • Size: 1,018 training samples
  • Columns: anchor, positive, and negative
  • Approximate statistics based on the first 1000 samples:
    anchorpositivenegative
    typestringstringstring
    detailsmin: 22 tokensmean: 39.54 tokensmax: 85 tokensmin: 23 tokensmean: 38.94 tokensmax: 96 tokensmin: 22 tokensmean: 38.26 tokensmax: 89 tokens
  • Samples:
  • Loss: MultipleNegativesRankingLoss with these parameters:
    {
        "scale": 20.0,
        "similarity_fct": "cos_sim"
    }
    

task159_check_frequency_of_words_in_sentence_pair

  • Dataset: task159_check_frequency_of_words_in_sentence_pair
  • Size: 1,018 training samples
  • Columns: anchor, positive, and negative
  • Approximate statistics based on the first 1000 samples:
    anchorpositivenegative
    typestringstringstring
    detailsmin: 44 tokensmean: 50.37 tokensmax: 67 tokensmin: 44 tokensmean: 50.35 tokensmax: 67 tokensmin: 44 tokensmean: 50.61 tokensmax: 66 tokens
  • Samples:
  • Loss: MultipleNegativesRankingLoss with these parameters:
    {
        "scale": 20.0,
        "similarity_fct": "cos_sim"
    }
    

task151_tomqa_find_location_easy_clean

  • Dataset: task151_tomqa_find_location_easy_clean
  • Size: 1,018 training samples
  • Columns: anchor, positive, and negative
  • Approximate statistics based on the first 1000 samples:
    anchorpositivenegative
    typestringstringstring
    detailsmin: 37 tokensmean: 50.73 tokensmax: 79 tokensmin: 37 tokensmean: 50.28 tokensmax: 74 tokensmin: 37 tokensmean: 50.52 tokensmax: 74 tokens
  • Samples:
  • Loss: MultipleNegativesRankingLoss with these parameters:
    {
        "scale": 20.0,
        "similarity_fct": "cos_sim"
    }
    

task323_jigsaw_classification_sexually_explicit

  • Dataset: task323_jigsaw_classification_sexually_explicit
  • Size: 1,018 training samples
  • Columns: anchor, positive, and negative
  • Approximate statistics based on the first 1000 samples:
    anchorpositivenegative
    typestringstringstring
    detailsmin: 6 tokensmean: 66.26 tokensmax: 248 tokensmin: 5 tokensmean: 76.73 tokensmax: 248 tokensmin: 6 tokensmean: 75.5 tokensmax: 251 tokens
  • Samples:
  • Loss: MultipleNegativesRankingLoss with these parameters:
    {
        "scale": 20.0,
        "similarity_fct": "cos_sim"
    }
    

task037_qasc_generate_related_fact

  • Dataset: task037_qasc_generate_related_fact
  • Size: 1,018 training samples
  • Columns: anchor, positive, and negative
  • Approximate statistics based on the first 1000 samples:
    anchorpositivenegative
    typestringstringstring
    detailsmin: 13 tokensmean: 22.04 tokensmax: 50 tokensmin: 13 tokensmean: 22.03 tokensmax: 42 tokensmin: 13 tokensmean: 21.9 tokensmax: 40 tokens
  • Samples:
  • Loss: MultipleNegativesRankingLoss with these parameters:
    {
        "scale": 20.0,
        "similarity_fct": "cos_sim"
    }
    

task027_drop_answer_type_generation

  • Dataset: task027_drop_answer_type_generation
  • Size: 1,018 training samples
  • Columns: anchor, positive, and negative
  • Approximate statistics based on the first 1000 samples:
    anchorpositivenegative
    typestringstringstring
    detailsmin: 87 tokensmean: 229.02 tokensmax: 256 tokensmin: 74 tokensmean: 230.67 tokensmax: 256 tokensmin: 71 tokensmean: 232.43 tokensmax: 256 tokens
  • Samples:
  • Loss: MultipleNegativesRankingLoss with these parameters:
    {
        "scale": 20.0,
        "similarity_fct": "cos_sim"
    }
    

task1596_event2mind_text_generation_2

  • Dataset: task1596_event2mind_text_generation_2
  • Size: 1,018 training samples
  • Columns: anchor, positive, and negative
  • Approximate statistics based on the first 1000 samples:
    anchorpositivenegative
    typestringstringstring
    detailsmin: 6 tokensmean: 9.97 tokensmax: 18 tokensmin: 6 tokensmean: 10.03 tokensmax: 19 tokensmin: 6 tokensmean: 10.06 tokensmax: 18 tokens
  • Samples:
  • Loss: MultipleNegativesRankingLoss with these parameters:
    {
        "scale": 20.0,
        "similarity_fct": "cos_sim"
    }
    

task141_odd-man-out_classification_category

  • Dataset: task141_odd-man-out_classification_category
  • Size: 1,018 training samples
  • Columns: anchor, positive, and negative
  • Approximate statistics based on the first 1000 samples:
    anchorpositivenegative
    typestringstringstring
    detailsmin: 16 tokensmean: 18.45 tokensmax: 28 tokensmin: 16 tokensmean: 18.38 tokensmax: 26 tokensmin: 16 tokensmean: 18.46 tokensmax: 25 tokens
  • Samples:
  • Loss: MultipleNegativesRankingLoss with these parameters:
    {
        "scale": 20.0,
        "similarity_fct": "cos_sim"
    }
    

task194_duorc_answer_generation

  • Dataset: task194_duorc_answer_generation
  • Size: 1,018 training samples
  • Columns: anchor, positive, and negative
  • Approximate statistics based on the first 1000 samples:
    anchorpositivenegative
    typestringstringstring
    detailsmin: 149 tokensmean: 251.76 tokensmax: 256 tokensmin: 147 tokensmean: 252.05 tokensmax: 256 tokensmin: 148 tokensmean: 251.76 tokensmax: 256 tokens
  • Samples:
  • Loss: MultipleNegativesRankingLoss with these parameters:
    {
        "scale": 20.0,
        "similarity_fct": "cos_sim"
    }
    

task679_hope_edi_english_text_classification

  • Dataset: task679_hope_edi_english_text_classification
  • Size: 1,018 training samples
  • Columns: anchor, positive, and negative
  • Approximate statistics based on the first 1000 samples:
    anchorpositivenegative
    typestringstringstring
    detailsmin: 5 tokensmean: 27.77 tokensmax: 199 tokensmin: 4 tokensmean: 27.23 tokensmax: 205 tokensmin: 5 tokensmean: 29.87 tokensmax: 194 tokens
  • Samples:
  • Loss: MultipleNegativesRankingLoss with these parameters:
    {
        "scale": 20.0,
        "similarity_fct": "cos_sim"
    }
    

task246_dream_question_generation

  • Dataset: task246_dream_question_generation
  • Size: 1,018 training samples
  • Columns: anchor, positive, and negative
  • Approximate statistics based on the first 1000 samples:
    anchorpositivenegative
    typestringstringstring
    detailsmin: 17 tokensmean: 80.33 tokensmax: 256 tokensmin: 14 tokensmean: 80.74 tokensmax: 256 tokensmin: 15 tokensmean: 87.22 tokensmax: 256 tokens
  • Samples:
  • Loss: MultipleNegativesRankingLoss with these parameters:
    {
        "scale": 20.0,
        "similarity_fct": "cos_sim"
    }
    

task1195_disflqa_disfluent_to_fluent_conversion

  • Dataset: task1195_disflqa_disfluent_to_fluent_conversion
  • Size: 1,018 training samples
  • Columns: anchor, positive, and negative
  • Approximate statistics based on the first 1000 samples:
    anchorpositivenegative
    typestringstringstring
    detailsmin: 9 tokensmean: 19.76 tokensmax: 41 tokensmin: 9 tokensmean: 19.88 tokensmax: 40 tokensmin: 2 tokensmean: 20.2 tokensmax: 44 tokens
  • Samples:
  • Loss: MultipleNegativesRankingLoss with these parameters:
    {
        "scale": 20.0,
        "similarity_fct": "cos_sim"
    }
    

task065_timetravel_consistent_sentence_classification

  • Dataset: task065_timetravel_consistent_sentence_classification
  • Size: 1,018 training samples
  • Columns: anchor, positive, and negative
  • Approximate statistics based on the first 1000 samples:
    anchorpositivenegative
    typestringstringstring
    detailsmin: 55 tokensmean: 79.4 tokensmax: 117 tokensmin: 51 tokensmean: 79.17 tokensmax: 110 tokensmin: 53 tokensmean: 80.1 tokensmax: 110 tokens
  • Samples:
  • Loss: MultipleNegativesRankingLoss with these parameters:
    {
        "scale": 20.0,
        "similarity_fct": "cos_sim"
    }
    

task351_winomt_classification_gender_identifiability_anti

  • Dataset: task351_winomt_classification_gender_identifiability_anti
  • Size: 1,018 training samples
  • Columns: anchor, positive, and negative
  • Approximate statistics based on the first 1000 samples:
    anchorpositivenegative
    typestringstringstring
    detailsmin: 16 tokensmean: 21.76 tokensmax: 30 tokensmin: 16 tokensmean: 21.66 tokensmax: 31 tokensmin: 16 tokensmean: 21.78 tokensmax: 30 tokens
  • Samples:
  • Loss: MultipleNegativesRankingLoss with these parameters:
    {
        "scale": 20.0,
        "similarity_fct": "cos_sim"
    }
    

task580_socialiqa_answer_generation

  • Dataset: task580_socialiqa_answer_generation
  • Size: 1,018 training samples
  • Columns: anchor, positive, and negative
  • Approximate statistics based on the first 1000 samples:
    anchorpositivenegative
    typestringstringstring
    detailsmin: 35 tokensmean: 52.41 tokensmax: 107 tokensmin: 35 tokensmean: 51.02 tokensmax: 86 tokensmin: 35 tokensmean: 50.98 tokensmax: 87 tokens
  • Samples:
  • Loss: MultipleNegativesRankingLoss with these parameters:
    {
        "scale": 20.0,
        "similarity_fct": "cos_sim"
    }
    

task583_udeps_eng_coarse_pos_tagging

  • Dataset: task583_udeps_eng_coarse_pos_tagging
  • Size: 1,018 training samples
  • Columns: anchor, positive, and negative
  • Approximate statistics based on the first 1000 samples:
    anchorpositivenegative
    typestringstringstring
    detailsmin: 12 tokensmean: 41.24 tokensmax: 185 tokensmin: 12 tokensmean: 40.21 tokensmax: 185 tokensmin: 12 tokensmean: 40.93 tokensmax: 185 tokens
  • Samples:
  • Loss: MultipleNegativesRankingLoss with these parameters:
    {
        "scale": 20.0,
        "similarity_fct": "cos_sim"
    }
    

task202_mnli_contradiction_classification

  • Dataset: task202_mnli_contradiction_classification
  • Size: 1,018 training samples
  • Columns: anchor, positive, and negative
  • Approximate statistics based on the first 1000 samples:
    anchorpositivenegative
    typestringstringstring
    detailsmin: 24 tokensmean: 73.7 tokensmax: 190 tokensmin: 28 tokensmean: 76.06 tokensmax: 256 tokensmin: 23 tokensmean: 74.56 tokensmax: 256 tokens
  • Samples:
  • Loss: MultipleNegativesRankingLoss with these parameters:
    {
        "scale": 20.0,
        "similarity_fct": "cos_sim"
    }
    

task222_rocstories_two_chioce_slotting_classification

  • Dataset: task222_rocstories_two_chioce_slotting_classification
  • Size: 1,018 training samples
  • Columns: anchor, positive, and negative
  • Approximate statistics based on the first 1000 samples:
    anchorpositivenegative
    typestringstringstring
    detailsmin: 48 tokensmean: 73.06 tokensmax: 105 tokensmin: 48 tokensmean: 73.24 tokensmax: 100 tokensmin: 49 tokensmean: 71.71 tokensmax: 102 tokens
  • Samples:
  • Loss: MultipleNegativesRankingLoss with these parameters:
    {
        "scale": 20.0,
        "similarity_fct": "cos_sim"
    }
    

task498_scruples_anecdotes_whoiswrong_classification

  • Dataset: task498_scruples_anecdotes_whoiswrong_classification
  • Size: 1,018 training samples
  • Columns: anchor, positive, and negative
  • Approximate statistics based on the first 1000 samples:
    anchorpositivenegative
    typestringstringstring
    detailsmin: 24 tokensmean: 225.8 tokensmax: 256 tokensmin: 47 tokensmean: 232.86 tokensmax: 256 tokensmin: 47 tokensmean: 231.22 tokensmax: 256 tokens
  • Samples:
  • Loss: MultipleNegativesRankingLoss with these parameters:
    {
        "scale": 20.0,
        "similarity_fct": "cos_sim"
    }
    

task067_abductivenli_answer_generation

  • Dataset: task067_abductivenli_answer_generation
  • Size: 1,018 training samples
  • Columns: anchor, positive, and negative
  • Approximate statistics based on the first 1000 samples:
    anchorpositivenegative
    typestringstringstring
    detailsmin: 14 tokensmean: 26.75 tokensmax: 40 tokensmin: 14 tokensmean: 26.13 tokensmax: 42 tokensmin: 15 tokensmean: 26.34 tokensmax: 38 tokens
  • Samples:
  • Loss: MultipleNegativesRankingLoss with these parameters:
    {
        "scale": 20.0,
        "similarity_fct": "cos_sim"
    }
    

task616_cola_classification

  • Dataset: task616_cola_classification
  • Size: 1,018 training samples
  • Columns: anchor, positive, and negative
  • Approximate statistics based on the first 1000 samples:
    anchorpositivenegative
    typestringstringstring
    detailsmin: 5 tokensmean: 12.16 tokensmax: 33 tokensmin: 5 tokensmean: 12.05 tokensmax: 33 tokensmin: 6 tokensmean: 11.96 tokensmax: 29 tokens
  • Samples:
  • Loss: MultipleNegativesRankingLoss with these parameters:
    {
        "scale": 20.0,
        "similarity_fct": "cos_sim"
    }
    

task286_olid_offense_judgment

  • Dataset: task286_olid_offense_judgment
  • Size: 1,018 training samples
  • Columns: anchor, positive, and negative
  • Approximate statistics based on the first 1000 samples:
    anchorpositivenegative
    typestringstringstring
    detailsmin: 5 tokensmean: 32.85 tokensmax: 145 tokensmin: 5 tokensmean: 30.81 tokensmax: 171 tokensmin: 5 tokensmean: 30.26 tokensmax: 169 tokens
  • Samples:
  • Loss: MultipleNegativesRankingLoss with these parameters:
    {
        "scale": 20.0,
        "similarity_fct": "cos_sim"
    }
    

task188_snli_neutral_to_entailment_text_modification

  • Dataset: task188_snli_neutral_to_entailment_text_modification
  • Size: 1,018 training samples
  • Columns: anchor, positive, and negative
  • Approximate statistics based on the first 1000 samples:
    anchorpositivenegative
    typestringstringstring
    detailsmin: 18 tokensmean: 31.55 tokensmax: 79 tokensmin: 18 tokensmean: 31.31 tokensmax: 84 tokensmin: 18 tokensmean: 32.91 tokensmax: 84 tokens
  • Samples:
  • Loss: MultipleNegativesRankingLoss with these parameters:
    {
        "scale": 20.0,
        "similarity_fct": "cos_sim"
    }
    

task223_quartz_explanation_generation

  • Dataset: task223_quartz_explanation_generation
  • Size: 1,018 training samples
  • Columns: anchor, positive, and negative
  • Approximate statistics based on the first 1000 samples:
    anchorpositivenegative
    typestringstringstring
    detailsmin: 12 tokensmean: 31.46 tokensmax: 68 tokensmin: 13 tokensmean: 31.8 tokensmax: 68 tokensmin: 13 tokensmean: 28.95 tokensmax: 96 tokens
  • Samples:
  • Loss: MultipleNegativesRankingLoss with these parameters:
    {
        "scale": 20.0,
        "similarity_fct": "cos_sim"
    }
    

task820_protoqa_answer_generation

  • Dataset: task820_protoqa_answer_generation
  • Size: 1,018 training samples
  • Columns: anchor, positive, and negative
  • Approximate statistics based on the first 1000 samples:
    anchorpositivenegative
    typestringstringstring
    detailsmin: 6 tokensmean: 14.87 tokensmax: 29 tokensmin: 7 tokensmean: 14.54 tokensmax: 27 tokensmin: 6 tokensmean: 14.22 tokensmax: 29 tokens
  • Samples:
  • Loss: MultipleNegativesRankingLoss with these parameters:
    {
        "scale": 20.0,
        "similarity_fct": "cos_sim"
    }
    

task196_sentiment140_answer_generation

  • Dataset: task196_sentiment140_answer_generation
  • Size: 1,018 training samples
  • Columns: anchor, positive, and negative
  • Approximate statistics based on the first 1000 samples:
    anchorpositivenegative
    typestringstringstring
    detailsmin: 17 tokensmean: 36.26 tokensmax: 72 tokensmin: 17 tokensmean: 32.85 tokensmax: 61 tokensmin: 17 tokensmean: 36.27 tokensmax: 72 tokens
  • Samples:
  • Loss: MultipleNegativesRankingLoss with these parameters:
    {
        "scale": 20.0,
        "similarity_fct": "cos_sim"
    }
    

task1678_mathqa_answer_selection

  • Dataset: task1678_mathqa_answer_selection
  • Size: 1,018 training samples
  • Columns: anchor, positive, and negative
  • Approximate statistics based on the first 1000 samples:
    anchorpositivenegative
    typestringstringstring
    detailsmin: 33 tokensmean: 70.42 tokensmax: 177 tokensmin: 30 tokensmean: 68.99 tokensmax: 146 tokensmin: 33 tokensmean: 69.69 tokensmax: 160 tokens
  • Samples:
  • Loss: MultipleNegativesRankingLoss with these parameters:
    {
        "scale": 20.0,
        "similarity_fct": "cos_sim"
    }
    

task349_squad2.0_answerable_unanswerable_question_classification

  • Dataset: task349_squad2.0_answerable_unanswerable_question_classification
  • Size: 1,018 training samples
  • Columns: anchor, positive, and negative
  • Approximate statistics based on the first 1000 samples:
    anchorpositivenegative
    typestringstringstring
    detailsmin: 53 tokensmean: 176.83 tokensmax: 256 tokensmin: 57 tokensmean: 177.07 tokensmax: 256 tokensmin: 53 tokensmean: 176.78 tokensmax: 256 tokens
  • Samples:
  • Loss: MultipleNegativesRankingLoss with these parameters:
    {
        "scale": 20.0,
        "similarity_fct": "cos_sim"
    }
    

task154_tomqa_find_location_hard_noise

  • Dataset: task154_tomqa_find_location_hard_noise
  • Size: 1,018 training samples
  • Columns: anchor, positive, and negative
  • Approximate statistics based on the first 1000 samples:
    anchorpositivenegative
    typestringstringstring
    detailsmin: 129 tokensmean: 176.29 tokensmax: 253 tokensmin: 126 tokensmean: 176.3 tokensmax: 249 tokensmin: 128 tokensmean: 178.24 tokensmax: 254 tokens
  • Samples:
  • Loss: MultipleNegativesRankingLoss with these parameters:
    {
        "scale": 20.0,
        "similarity_fct": "cos_sim"
    }
    

task333_hateeval_classification_hate_en

  • Dataset: task333_hateeval_classification_hate_en
  • Size: 1,018 training samples
  • Columns: anchor, positive, and negative
  • Approximate statistics based on the first 1000 samples:
    anchorpositivenegative
    typestringstringstring
    detailsmin: 8 tokensmean: 38.33 tokensmax: 117 tokensmin: 7 tokensmean: 36.79 tokensmax: 109 tokensmin: 7 tokensmean: 36.61 tokensmax: 113 tokens
  • Samples:
  • Loss: MultipleNegativesRankingLoss with these parameters:
    {
        "scale": 20.0,
        "similarity_fct": "cos_sim"
    }
    

task235_iirc_question_from_subtext_answer_generation

  • Dataset: task235_iirc_question_from_subtext_answer_generation
  • Size: 1,018 training samples
  • Columns: anchor, positive, and negative
  • Approximate statistics based on the first 1000 samples:
    anchorpositivenegative
    typestringstringstring
    detailsmin: 14 tokensmean: 52.9 tokensmax: 256 tokensmin: 12 tokensmean: 50.44 tokensmax: 256 tokensmin: 12 tokensmean: 55.89 tokensmax: 256 tokens
  • Samples:
  • Loss: MultipleNegativesRankingLoss with these parameters:
    {
        "scale": 20.0,
        "similarity_fct": "cos_sim"
    }
    

task1554_scitail_classification

  • Dataset: task1554_scitail_classification
  • Size: 1,018 training samples
  • Columns: anchor, positive, and negative
  • Approximate statistics based on the first 1000 samples:
    anchorpositivenegative
    typestringstringstring
    detailsmin: 7 tokensmean: 16.8 tokensmax: 38 tokensmin: 7 tokensmean: 25.75 tokensmax: 68 tokensmin: 7 tokensmean: 24.34 tokensmax: 59 tokens
  • Samples:
  • Loss: MultipleNegativesRankingLoss with these parameters:
    {
        "scale": 20.0,
        "similarity_fct": "cos_sim"
    }
    

task210_logic2text_structured_text_generation

  • Dataset: task210_logic2text_structured_text_generation
  • Size: 1,018 training samples
  • Columns: anchor, positive, and negative
  • Approximate statistics based on the first 1000 samples:
    anchorpositivenegative
    typestringstringstring
    detailsmin: 13 tokensmean: 31.88 tokensmax: 101 tokensmin: 13 tokensmean: 30.88 tokensmax: 94 tokensmin: 12 tokensmean: 32.75 tokensmax: 89 tokens
  • Samples:
  • Loss: MultipleNegativesRankingLoss with these parameters:
    {
        "scale": 20.0,
        "similarity_fct": "cos_sim"
    }
    

task035_winogrande_question_modification_person

  • Dataset: task035_winogrande_question_modification_person
  • Size: 1,018 training samples
  • Columns: anchor, positive, and negative
  • Approximate statistics based on the first 1000 samples:
    anchorpositivenegative
    typestringstringstring
    detailsmin: 31 tokensmean: 36.16 tokensmax: 50 tokensmin: 31 tokensmean: 35.75 tokensmax: 55 tokensmin: 31 tokensmean: 35.41 tokensmax: 48 tokens
  • Samples:
  • Loss: MultipleNegativesRankingLoss with these parameters:
    {
        "scale": 20.0,
        "similarity_fct": "cos_sim"
    }
    

task230_iirc_passage_classification

  • Dataset: task230_iirc_passage_classification
  • Size: 1,018 training samples
  • Columns: anchor, positive, and negative
  • Approximate statistics based on the first 1000 samples:
    anchorpositivenegative
    typestringstringstring
    detailsmin: 256 tokensmean: 256.0 tokensmax: 256 tokensmin: 256 tokensmean: 256.0 tokensmax: 256 tokensmin: 256 tokensmean: 256.0 tokensmax: 256 tokens
  • Samples:
  • Loss: MultipleNegativesRankingLoss with these parameters:
    {
        "scale": 20.0,
        "similarity_fct": "cos_sim"
    }
    

task1356_xlsum_title_generation

  • Dataset: task1356_xlsum_title_generation
  • Size: 1,018 training samples
  • Columns: anchor, positive, and negative
  • Approximate statistics based on the first 1000 samples:
    anchorpositivenegative
    typestringstringstring
    detailsmin: 59 tokensmean: 239.92 tokensmax: 256 tokensmin: 58 tokensmean: 240.94 tokensmax: 256 tokensmin: 64 tokensmean: 248.75 tokensmax: 256 tokens
  • Samples:
  • Loss: MultipleNegativesRankingLoss with these parameters:
    {
        "scale": 20.0,
        "similarity_fct": "cos_sim"
    }
    

task1726_mathqa_correct_answer_generation

  • Dataset: task1726_mathqa_correct_answer_generation
  • Size: 1,018 training samples
  • Columns: anchor, positive, and negative
  • Approximate statistics based on the first 1000 samples:
    anchorpositivenegative
    typestringstringstring
    detailsmin: 10 tokensmean: 43.81 tokensmax: 156 tokensmin: 12 tokensmean: 42.63 tokensmax: 129 tokensmin: 11 tokensmean: 42.82 tokensmax: 133 tokens
  • Samples:
  • Loss: MultipleNegativesRankingLoss with these parameters:
    {
        "scale": 20.0,
        "similarity_fct": "cos_sim"
    }
    

task302_record_classification

  • Dataset: task302_record_classification
  • Size: 1,018 training samples
  • Columns: anchor, positive, and negative
  • Approximate statistics based on the first 1000 samples:
    anchorpositivenegative
    typestringstringstring
    detailsmin: 194 tokensmean: 253.35 tokensmax: 256 tokensmin: 198 tokensmean: 252.85 tokensmax: 256 tokensmin: 195 tokensmean: 252.78 tokensmax: 256 tokens
  • Samples:
  • Loss: MultipleNegativesRankingLoss with these parameters:
    {
        "scale": 20.0,
        "similarity_fct": "cos_sim"
    }
    

task380_boolq_yes_no_question

  • Dataset: task380_boolq_yes_no_question
  • Size: 1,018 training samples
  • Columns: anchor, positive, and negative
  • Approximate statistics based on the first 1000 samples:
    anchorpositivenegative
    typestringstringstring
    detailsmin: 26 tokensmean: 134.17 tokensmax: 256 tokensmin: 26 tokensmean: 138.56 tokensmax: 256 tokensmin: 27 tokensmean: 138.25 tokensmax: 256 tokens
  • Samples:
  • Loss: MultipleNegativesRankingLoss with these parameters:
    {
        "scale": 20.0,
        "similarity_fct": "cos_sim"
    }
    

task212_logic2text_classification

  • Dataset: task212_logic2text_classification
  • Size: 1,018 training samples
  • Columns: anchor, positive, and negative
  • Approximate statistics based on the first 1000 samples:
    anchorpositivenegative
    typestringstringstring
    detailsmin: 14 tokensmean: 33.28 tokensmax: 146 tokensmin: 14 tokensmean: 32.14 tokensmax: 146 tokensmin: 14 tokensmean: 32.96 tokensmax: 127 tokens
  • Samples:
  • Loss: MultipleNegativesRankingLoss with these parameters:
    {
        "scale": 20.0,
        "similarity_fct": "cos_sim"
    }
    

task748_glucose_reverse_cause_event_detection

  • Dataset: task748_glucose_reverse_cause_event_detection
  • Size: 1,018 training samples
  • Columns: anchor, positive, and negative
  • Approximate statistics based on the first 1000 samples:
    anchorpositivenegative
    typestringstringstring
    detailsmin: 35 tokensmean: 67.63 tokensmax: 105 tokensmin: 38 tokensmean: 66.95 tokensmax: 106 tokensmin: 39 tokensmean: 68.94 tokensmax: 105 tokens
  • Samples:
  • Loss: MultipleNegativesRankingLoss with these parameters:
    {
        "scale": 20.0,
        "similarity_fct": "cos_sim"
    }
    

task834_mathdataset_classification

  • Dataset: task834_mathdataset_classification
  • Size: 1,018 training samples
  • Columns: anchor, positive, and negative
  • Approximate statistics based on the first 1000 samples:
    anchorpositivenegative
    typestringstringstring
    detailsmin: 6 tokensmean: 27.7 tokensmax: 83 tokensmin: 6 tokensmean: 27.88 tokensmax: 83 tokensmin: 5 tokensmean: 26.97 tokensmax: 93 tokens
  • Samples:
  • Loss: MultipleNegativesRankingLoss with these parameters:
    {
        "scale": 20.0,
        "similarity_fct": "cos_sim"
    }
    

task350_winomt_classification_gender_identifiability_pro

  • Dataset: task350_winomt_classification_gender_identifiability_pro
  • Size: 1,018 training samples
  • Columns: anchor, positive, and negative
  • Approximate statistics based on the first 1000 samples:
    anchorpositivenegative
    typestringstringstring
    detailsmin: 16 tokensmean: 21.79 tokensmax: 30 tokensmin: 16 tokensmean: 21.63 tokensmax: 30 tokensmin: 16 tokensmean: 21.79 tokensmax: 30 tokens
  • Samples:
  • Loss: MultipleNegativesRankingLoss with these parameters:
    {
        "scale": 20.0,
        "similarity_fct": "cos_sim"
    }
    

task191_hotpotqa_question_generation

  • Dataset: task191_hotpotqa_question_generation
  • Size: 1,018 training samples
  • Columns: anchor, positive, and negative
  • Approximate statistics based on the first 1000 samples:
    anchorpositivenegative
    typestringstringstring
    detailsmin: 198 tokensmean: 255.88 tokensmax: 256 tokensmin: 238 tokensmean: 255.93 tokensmax: 256 tokensmin: 255 tokensmean: 256.0 tokensmax: 256 tokens
  • Samples:
  • Loss: MultipleNegativesRankingLoss with these parameters:
    {
        "scale": 20.0,
        "similarity_fct": "cos_sim"
    }
    

task236_iirc_question_from_passage_answer_generation

  • Dataset: task236_iirc_question_from_passage_answer_generation
  • Size: 1,018 training samples
  • Columns: anchor, positive, and negative
  • Approximate statistics based on the first 1000 samples:
    anchorpositivenegative
    typestringstringstring
    detailsmin: 135 tokensmean: 238.3 tokensmax: 256 tokensmin: 155 tokensmean: 237.61 tokensmax: 256 tokensmin: 154 tokensmean: 239.64 tokensmax: 256 tokens
  • Samples:
  • Loss: MultipleNegativesRankingLoss with these parameters:
    {
        "scale": 20.0,
        "similarity_fct": "cos_sim"
    }
    

task217_rocstories_ordering_answer_generation

  • Dataset: task217_rocstories_ordering_answer_generation
  • Size: 1,018 training samples
  • Columns: anchor, positive, and negative
  • Approximate statistics based on the first 1000 samples:
    anchorpositivenegative
    typestringstringstring
    detailsmin: 45 tokensmean: 72.32 tokensmax: 107 tokensmin: 48 tokensmean: 72.29 tokensmax: 107 tokensmin: 48 tokensmean: 70.87 tokensmax: 105 tokens
  • Samples:
  • Loss: MultipleNegativesRankingLoss with these parameters:
    {
        "scale": 20.0,
        "similarity_fct": "cos_sim"
    }
    

task568_circa_question_generation

  • Dataset: task568_circa_question_generation
  • Size: 1,018 training samples
  • Columns: anchor, positive, and negative
  • Approximate statistics based on the first 1000 samples:
    anchorpositivenegative
    typestringstringstring
    detailsmin: 4 tokensmean: 9.6 tokensmax: 25 tokensmin: 4 tokensmean: 9.46 tokensmax: 20 tokensmin: 4 tokensmean: 8.93 tokensmax: 20 tokens
  • Samples:
  • Loss: MultipleNegativesRankingLoss with these parameters:
    {
        "scale": 20.0,
        "similarity_fct": "cos_sim"
    }
    

task614_glucose_cause_event_detection

  • Dataset: task614_glucose_cause_event_detection
  • Size: 1,018 training samples
  • Columns: anchor, positive, and negative
  • Approximate statistics based on the first 1000 samples:
    anchorpositivenegative
    typestringstringstring
    detailsmin: 39 tokensmean: 67.66 tokensmax: 102 tokensmin: 39 tokensmean: 67.16 tokensmax: 106 tokensmin: 38 tokensmean: 68.48 tokensmax: 103 tokens
  • Samples:
  • Loss: MultipleNegativesRankingLoss with these parameters:
    {
        "scale": 20.0,
        "similarity_fct": "cos_sim"
    }
    

task361_spolin_yesand_prompt_response_classification

  • Dataset: task361_spolin_yesand_prompt_response_classification
  • Size: 1,018 training samples
  • Columns: anchor, positive, and negative
  • Approximate statistics based on the first 1000 samples:
    anchorpositivenegative
    typestringstringstring
    detailsmin: 18 tokensmean: 47.01 tokensmax: 137 tokensmin: 17 tokensmean: 46.18 tokensmax: 119 tokensmin: 17 tokensmean: 47.2 tokensmax: 128 tokens
  • Samples:
  • Loss: MultipleNegativesRankingLoss with these parameters:
    {
        "scale": 20.0,
        "similarity_fct": "cos_sim"
    }
    

task421_persent_sentence_sentiment_classification

  • Dataset: task421_persent_sentence_sentiment_classification
  • Size: 1,018 training samples
  • Columns: anchor, positive, and negative
  • Approximate statistics based on the first 1000 samples:
    anchorpositivenegative
    typestringstringstring
    detailsmin: 22 tokensmean: 67.77 tokensmax: 256 tokensmin: 22 tokensmean: 71.21 tokensmax: 256 tokensmin: 19 tokensmean: 72.24 tokensmax: 256 tokens
  • Samples:
  • Loss: MultipleNegativesRankingLoss with these parameters:
    {
        "scale": 20.0,
        "similarity_fct": "cos_sim"
    }
    

task203_mnli_sentence_generation

  • Dataset: task203_mnli_sentence_generation
  • Size: 1,018 training samples
  • Columns: anchor, positive, and negative
  • Approximate statistics based on the first 1000 samples:
    anchorpositivenegative
    typestringstringstring
    detailsmin: 14 tokensmean: 38.73 tokensmax: 175 tokensmin: 14 tokensmean: 35.74 tokensmax: 175 tokensmin: 13 tokensmean: 34.18 tokensmax: 170 tokens
  • Samples:
  • Loss: MultipleNegativesRankingLoss with these parameters:
    {
        "scale": 20.0,
        "similarity_fct": "cos_sim"
    }
    

task420_persent_document_sentiment_classification

  • Dataset: task420_persent_document_sentiment_classification
  • Size: 1,018 training samples
  • Columns: anchor, positive, and negative
  • Approximate statistics based on the first 1000 samples:
    anchorpositivenegative
    typestringstringstring
    detailsmin: 22 tokensmean: 224.14 tokensmax: 256 tokensmin: 22 tokensmean: 233.63 tokensmax: 256 tokensmin: 22 tokensmean: 227.59 tokensmax: 256 tokens
  • Samples:
  • Loss: MultipleNegativesRankingLoss with these parameters:
    {
        "scale": 20.0,
        "similarity_fct": "cos_sim"
    }
    

task153_tomqa_find_location_hard_clean

  • Dataset: task153_tomqa_find_location_hard_clean
  • Size: 1,018 training samples
  • Columns: anchor, positive, and negative
  • Approximate statistics based on the first 1000 samples:
    anchorpositivenegative
    typestringstringstring
    detailsmin: 39 tokensmean: 160.13 tokensmax: 256 tokensmin: 39 tokensmean: 159.86 tokensmax: 256 tokensmin: 39 tokensmean: 162.75 tokensmax: 256 tokens
  • Samples:
  • Loss: MultipleNegativesRankingLoss with these parameters:
    {
        "scale": 20.0,
        "similarity_fct": "cos_sim"
    }
    

task346_hybridqa_classification

  • Dataset: task346_hybridqa_classification
  • Size: 1,018 training samples
  • Columns: anchor, positive, and negative
  • Approximate statistics based on the first 1000 samples:
    anchorpositivenegative
    typestringstringstring
    detailsmin: 18 tokensmean: 32.87 tokensmax: 68 tokensmin: 18 tokensmean: 31.92 tokensmax: 63 tokensmin: 19 tokensmean: 31.83 tokensmax: 75 tokens
  • Samples:
  • Loss: MultipleNegativesRankingLoss with these parameters:
    {
        "scale": 20.0,
        "similarity_fct": "cos_sim"
    }
    

task1211_atomic_classification_hassubevent

  • Dataset: task1211_atomic_classification_hassubevent
  • Size: 1,018 training samples
  • Columns: anchor, positive, and negative
  • Approximate statistics based on the first 1000 samples:
    anchorpositivenegative
    typestringstringstring
    detailsmin: 11 tokensmean: 16.25 tokensmax: 31 tokensmin: 11 tokensmean: 16.02 tokensmax: 29 tokensmin: 11 tokensmean: 16.89 tokensmax: 29 tokens
  • Samples:
  • Loss: MultipleNegativesRankingLoss with these parameters:
    {
        "scale": 20.0,
        "similarity_fct": "cos_sim"
    }
    

task360_spolin_yesand_response_generation

  • Dataset: task360_spolin_yesand_response_generation
  • Size: 1,018 training samples
  • Columns: anchor, positive, and negative
  • Approximate statistics based on the first 1000 samples:
    anchorpositivenegative
    typestringstringstring
    detailsmin: 7 tokensmean: 22.54 tokensmax: 89 tokensmin: 6 tokensmean: 21.16 tokensmax: 92 tokensmin: 7 tokensmean: 20.91 tokensmax: 67 tokens
  • Samples:
  • Loss: MultipleNegativesRankingLoss with these parameters:
    {
        "scale": 20.0,
        "similarity_fct": "cos_sim"
    }
    

task510_reddit_tifu_title_summarization

  • Dataset: task510_reddit_tifu_title_summarization
  • Size: 1,018 training samples
  • Columns: anchor, positive, and negative
  • Approximate statistics based on the first 1000 samples:
    anchorpositivenegative
    typestringstringstring
    detailsmin: 9 tokensmean: 217.53 tokensmax: 256 tokensmin: 20 tokensmean: 218.59 tokensmax: 256 tokensmin: 10 tokensmean: 221.41 tokensmax: 256 tokens
  • Samples:
  • Loss: MultipleNegativesRankingLoss with these parameters:
    {
        "scale": 20.0,
        "similarity_fct": "cos_sim"
    }
    

task511_reddit_tifu_long_text_summarization

  • Dataset: task511_reddit_tifu_long_text_summarization
  • Size: 1,018 training samples
  • Columns: anchor, positive, and negative
  • Approximate statistics based on the first 1000 samples:
    anchorpositivenegative
    typestringstringstring
    detailsmin: 29 tokensmean: 239.72 tokensmax: 256 tokensmin: 76 tokensmean: 238.38 tokensmax: 256 tokensmin: 43 tokensmean: 245.03 tokensmax: 256 tokens
  • Samples:
  • Loss: MultipleNegativesRankingLoss with these parameters:
    {
        "scale": 20.0,
        "similarity_fct": "cos_sim"
    }
    

task345_hybridqa_answer_generation

  • Dataset: task345_hybridqa_answer_generation
  • Size: 1,018 training samples
  • Columns: anchor, positive, and negative
  • Approximate statistics based on the first 1000 samples:
    anchorpositivenegative
    typestringstringstring
    detailsmin: 9 tokensmean: 22.14 tokensmax: 50 tokensmin: 10 tokensmean: 21.6 tokensmax: 70 tokensmin: 8 tokensmean: 20.96 tokensmax: 47 tokens
  • Samples:
  • Loss: MultipleNegativesRankingLoss with these parameters:
    {
        "scale": 20.0,
        "similarity_fct": "cos_sim"
    }
    

task270_csrg_counterfactual_context_generation

  • Dataset: task270_csrg_counterfactual_context_generation
  • Size: 1,018 training samples
  • Columns: anchor, positive, and negative
  • Approximate statistics based on the first 1000 samples:
    anchorpositivenegative
    typestringstringstring
    detailsmin: 63 tokensmean: 100.05 tokensmax: 158 tokensmin: 63 tokensmean: 98.61 tokensmax: 142 tokensmin: 62 tokensmean: 100.35 tokensmax: 141 tokens
  • Samples:
  • Loss: MultipleNegativesRankingLoss with these parameters:
    {
        "scale": 20.0,
        "similarity_fct": "cos_sim"
    }
    

task307_jeopardy_answer_generation_final

  • Dataset: task307_jeopardy_answer_generation_final
  • Size: 1,018 training samples
  • Columns: anchor, positive, and negative
  • Approximate statistics based on the first 1000 samples:
    anchorpositivenegative
    typestringstringstring
    detailsmin: 15 tokensmean: 29.61 tokensmax: 46 tokensmin: 15 tokensmean: 29.31 tokensmax: 53 tokensmin: 15 tokensmean: 29.28 tokensmax: 43 tokens
  • Samples:
  • Loss: MultipleNegativesRankingLoss with these parameters:
    {
        "scale": 20.0,
        "similarity_fct": "cos_sim"
    }
    

task001_quoref_question_generation

  • Dataset: task001_quoref_question_generation
  • Size: 1,018 training samples
  • Columns: anchor, positive, and negative
  • Approximate statistics based on the first 1000 samples:
    anchorpositivenegative
    typestringstringstring
    detailsmin: 201 tokensmean: 254.96 tokensmax: 256 tokensmin: 99 tokensmean: 254.28 tokensmax: 256 tokensmin: 173 tokensmean: 255.13 tokensmax: 256 tokens
  • Samples:
  • Loss: MultipleNegativesRankingLoss with these parameters:
    {
        "scale": 20.0,
        "similarity_fct": "cos_sim"
    }
    

task089_swap_words_verification

  • Dataset: task089_swap_words_verification
  • Size: 1,018 training samples
  • Columns: anchor, positive, and negative
  • Approximate statistics based on the first 1000 samples:
    anchorpositivenegative
    typestringstringstring
    detailsmin: 9 tokensmean: 12.86 tokensmax: 28 tokensmin: 9 tokensmean: 12.64 tokensmax: 24 tokensmin: 9 tokensmean: 12.26 tokensmax: 22 tokens
  • Samples:
  • Loss: MultipleNegativesRankingLoss with these parameters:
    {
        "scale": 20.0,
        "similarity_fct": "cos_sim"
    }
    

task1196_atomic_classification_oeffect

  • Dataset: task1196_atomic_classification_oeffect
  • Size: 1,018 training samples
  • Columns: anchor, positive, and negative
  • Approximate statistics based on the first 1000 samples:
    anchorpositivenegative
    typestringstringstring
    detailsmin: 14 tokensmean: 18.79 tokensmax: 41 tokensmin: 14 tokensmean: 18.57 tokensmax: 30 tokensmin: 14 tokensmean: 18.51 tokensmax: 29 tokens
  • Samples:
  • Loss: MultipleNegativesRankingLoss with these parameters:
    {
        "scale": 20.0,
        "similarity_fct": "cos_sim"
    }
    

task080_piqa_answer_generation

  • Dataset: task080_piqa_answer_generation
  • Size: 1,018 training samples
  • Columns: anchor, positive, and negative
  • Approximate statistics based on the first 1000 samples:
    anchorpositivenegative
    typestringstringstring
    detailsmin: 3 tokensmean: 10.82 tokensmax: 33 tokensmin: 3 tokensmean: 10.77 tokensmax: 24 tokensmin: 3 tokensmean: 10.03 tokensmax: 26 tokens
  • Samples:
  • Loss: MultipleNegativesRankingLoss with these parameters:
    {
        "scale": 20.0,
        "similarity_fct": "cos_sim"
    }
    

task1598_nyc_long_text_generation

  • Dataset: task1598_nyc_long_text_generation
  • Size: 1,018 training samples
  • Columns: anchor, positive, and negative
  • Approximate statistics based on the first 1000 samples:
    anchorpositivenegative
    typestringstringstring
    detailsmin: 17 tokensmean: 35.5 tokensmax: 56 tokensmin: 17 tokensmean: 35.66 tokensmax: 56 tokensmin: 20 tokensmean: 36.66 tokensmax: 55 tokens
  • Samples:
  • Loss: MultipleNegativesRankingLoss with these parameters:
    {
        "scale": 20.0,
        "similarity_fct": "cos_sim"
    }
    

task240_tweetqa_question_generation

  • Dataset: task240_tweetqa_question_generation
  • Size: 1,018 training samples
  • Columns: anchor, positive, and negative
  • Approximate statistics based on the first 1000 samples:
    anchorpositivenegative
    typestringstringstring
    detailsmin: 27 tokensmean: 51.18 tokensmax: 94 tokensmin: 25 tokensmean: 50.72 tokensmax: 92 tokensmin: 20 tokensmean: 51.63 tokensmax: 95 tokens
  • Samples:
  • Loss: MultipleNegativesRankingLoss with these parameters:
    {
        "scale": 20.0,
        "similarity_fct": "cos_sim"
    }
    

task615_moviesqa_answer_generation

  • Dataset: task615_moviesqa_answer_generation
  • Size: 1,018 training samples
  • Columns: anchor, positive, and negative
  • Approximate statistics based on the first 1000 samples:
    anchorpositivenegative
    typestringstringstring
    detailsmin: 6 tokensmean: 11.46 tokensmax: 23 tokensmin: 7 tokensmean: 11.44 tokensmax: 19 tokensmin: 5 tokensmean: 11.4 tokensmax: 22 tokens
  • Samples:
  • Loss: MultipleNegativesRankingLoss with these parameters:
    {
        "scale": 20.0,
        "similarity_fct": "cos_sim"
    }
    

task1347_glue_sts-b_similarity_classification

  • Dataset: task1347_glue_sts-b_similarity_classification
  • Size: 1,018 training samples
  • Columns: anchor, positive, and negative
  • Approximate statistics based on the first 1000 samples:
    anchorpositivenegative
    typestringstringstring
    detailsmin: 17 tokensmean: 31.13 tokensmax: 88 tokensmin: 16 tokensmean: 31.12 tokensmax: 92 tokensmin: 16 tokensmean: 30.85 tokensmax: 92 tokens
  • Samples:
  • Loss: MultipleNegativesRankingLoss with these parameters:
    {
        "scale": 20.0,
        "similarity_fct": "cos_sim"
    }
    

task114_is_the_given_word_longest

  • Dataset: task114_is_the_given_word_longest
  • Size: 1,018 training samples
  • Columns: anchor, positive, and negative
  • Approximate statistics based on the first 1000 samples:
    anchorpositivenegative
    typestringstringstring
    detailsmin: 25 tokensmean: 28.87 tokensmax: 68 tokensmin: 25 tokensmean: 28.46 tokensmax: 48 tokensmin: 25 tokensmean: 28.7 tokensmax: 47 tokens
  • Samples:
  • Loss: MultipleNegativesRankingLoss with these parameters:
    {
        "scale": 20.0,
        "similarity_fct": "cos_sim"
    }
    

task292_storycommonsense_character_text_generation

  • Dataset: task292_storycommonsense_character_text_generation
  • Size: 1,018 training samples
  • Columns: anchor, positive, and negative
  • Approximate statistics based on the first 1000 samples:
    anchorpositivenegative
    typestringstringstring
    detailsmin: 43 tokensmean: 67.87 tokensmax: 98 tokensmin: 46 tokensmean: 67.11 tokensmax: 104 tokensmin: 43 tokensmean: 69.05 tokensmax: 96 tokens
  • Samples:
  • Loss: MultipleNegativesRankingLoss with these parameters:
    {
        "scale": 20.0,
        "similarity_fct": "cos_sim"
    }
    

task115_help_advice_classification

  • Dataset: task115_help_advice_classification
  • Size: 1,018 training samples
  • Columns: anchor, positive, and negative
  • Approximate statistics based on the first 1000 samples:
    anchorpositivenegative
    typestringstringstring
    detailsmin: 2 tokensmean: 19.89 tokensmax: 91 tokensmin: 3 tokensmean: 18.13 tokensmax: 92 tokensmin: 4 tokensmean: 19.22 tokensmax: 137 tokens
  • Samples:
  • Loss: MultipleNegativesRankingLoss with these parameters:
    {
        "scale": 20.0,
        "similarity_fct": "cos_sim"
    }
    

task431_senteval_object_count

  • Dataset: task431_senteval_object_count
  • Size: 1,018 training samples
  • Columns: anchor, positive, and negative
  • Approximate statistics based on the first 1000 samples:
    anchorpositivenegative
    typestringstringstring
    detailsmin: 7 tokensmean: 16.78 tokensmax: 37 tokensmin: 7 tokensmean: 15.12 tokensmax: 36 tokensmin: 7 tokensmean: 15.72 tokensmax: 35 tokens
  • Samples:
  • Loss: MultipleNegativesRankingLoss with these parameters:
    {
        "scale": 20.0,
        "similarity_fct": "cos_sim"
    }
    

task1360_numer_sense_multiple_choice_qa_generation

  • Dataset: task1360_numer_sense_multiple_choice_qa_generation
  • Size: 1,018 training samples
  • Columns: anchor, positive, and negative
  • Approximate statistics based on the first 1000 samples:
    anchorpositivenegative
    typestringstringstring
    detailsmin: 32 tokensmean: 40.62 tokensmax: 54 tokensmin: 32 tokensmean: 40.3 tokensmax: 53 tokensmin: 32 tokensmean: 40.28 tokensmax: 60 tokens
  • Samples:
  • Loss: MultipleNegativesRankingLoss with these parameters:
    {
        "scale": 20.0,
        "similarity_fct": "cos_sim"
    }
    

task177_para-nmt_paraphrasing

  • Dataset: task177_para-nmt_paraphrasing
  • Size: 1,018 training samples
  • Columns: anchor, positive, and negative
  • Approximate statistics based on the first 1000 samples:
    anchorpositivenegative
    typestringstringstring
    detailsmin: 8 tokensmean: 19.86 tokensmax: 82 tokensmin: 9 tokensmean: 18.91 tokensmax: 58 tokensmin: 9 tokensmean: 18.22 tokensmax: 36 tokens
  • Samples:
  • Loss: MultipleNegativesRankingLoss with these parameters:
    {
        "scale": 20.0,
        "similarity_fct": "cos_sim"
    }
    

task132_dais_text_modification

  • Dataset: task132_dais_text_modification
  • Size: 1,018 training samples
  • Columns: anchor, positive, and negative
  • Approximate statistics based on the first 1000 samples:
    anchorpositivenegative
    typestringstringstring
    detailsmin: 6 tokensmean: 9.3 tokensmax: 15 tokensmin: 6 tokensmean: 9.08 tokensmax: 15 tokensmin: 6 tokensmean: 10.11 tokensmax: 15 tokens
  • Samples:
  • Loss: MultipleNegativesRankingLoss with these parameters:
    {
        "scale": 20.0,
        "similarity_fct": "cos_sim"
    }
    

task269_csrg_counterfactual_story_generation

  • Dataset: task269_csrg_counterfactual_story_generation
  • Size: 1,018 training samples
  • Columns: anchor, positive, and negative
  • Approximate statistics based on the first 1000 samples:
    anchorpositivenegative
    typestringstringstring
    detailsmin: 49 tokensmean: 79.95 tokensmax: 111 tokensmin: 53 tokensmean: 79.51 tokensmax: 116 tokensmin: 48 tokensmean: 79.5 tokensmax: 114 tokens
  • Samples:
  • Loss: MultipleNegativesRankingLoss with these parameters:
    {
        "scale": 20.0,
        "similarity_fct": "cos_sim"
    }
    

task233_iirc_link_exists_classification

  • Dataset: task233_iirc_link_exists_classification
  • Size: 1,018 training samples
  • Columns: anchor, positive, and negative
  • Approximate statistics based on the first 1000 samples:
    anchorpositivenegative
    typestringstringstring
    detailsmin: 145 tokensmean: 235.67 tokensmax: 256 tokensmin: 142 tokensmean: 233.59 tokensmax: 256 tokensmin: 151 tokensmean: 235.1 tokensmax: 256 tokens
  • Samples:
  • Loss: MultipleNegativesRankingLoss with these parameters:
    {
        "scale": 20.0,
        "similarity_fct": "cos_sim"
    }
    

task161_count_words_containing_letter

  • Dataset: task161_count_words_containing_letter
  • Size: 1,018 training samples
  • Columns: anchor, positive, and negative
  • Approximate statistics based on the first 1000 samples:
    anchorpositivenegative
    typestringstringstring
    detailsmin: 27 tokensmean: 30.99 tokensmax: 53 tokensmin: 27 tokensmean: 30.8 tokensmax: 61 tokensmin: 27 tokensmean: 30.5 tokensmax: 42 tokens
  • Samples:
  • Loss: MultipleNegativesRankingLoss with these parameters:
    {
        "scale": 20.0,
        "similarity_fct": "cos_sim"
    }
    

task1205_atomic_classification_isafter

  • Dataset: task1205_atomic_classification_isafter
  • Size: 1,018 training samples
  • Columns: anchor, positive, and negative
  • Approximate statistics based on the first 1000 samples:
    anchorpositivenegative
    typestringstringstring
    detailsmin: 14 tokensmean: 20.91 tokensmax: 37 tokensmin: 14 tokensmean: 20.65 tokensmax: 35 tokensmin: 14 tokensmean: 21.51 tokensmax: 37 tokens
  • Samples:
  • Loss: MultipleNegativesRankingLoss with these parameters:
    {
        "scale": 20.0,
        "similarity_fct": "cos_sim"
    }
    

task571_recipe_nlg_ner_generation

  • Dataset: task571_recipe_nlg_ner_generation
  • Size: 1,018 training samples
  • Columns: anchor, positive, and negative
  • Approximate statistics based on the first 1000 samples:
    anchorpositivenegative
    typestringstringstring
    detailsmin: 5 tokensmean: 118.38 tokensmax: 256 tokensmin: 7 tokensmean: 118.92 tokensmax: 256 tokensmin: 6 tokensmean: 111.39 tokensmax: 256 tokens
  • Samples:
  • Loss: MultipleNegativesRankingLoss with these parameters:
    {
        "scale": 20.0,
        "similarity_fct": "cos_sim"
    }
    

task1292_yelp_review_full_text_categorization

  • Dataset: task1292_yelp_review_full_text_categorization
  • Size: 1,018 training samples
  • Columns: anchor, positive, and negative
  • Approximate statistics based on the first 1000 samples:
    anchorpositivenegative
    typestringstringstring
    detailsmin: 4 tokensmean: 136.66 tokensmax: 256 tokensmin: 7 tokensmean: 146.65 tokensmax: 256 tokensmin: 3 tokensmean: 146.05 tokensmax: 256 tokens
  • Samples:
  • Loss: MultipleNegativesRankingLoss with these parameters:
    {
        "scale": 20.0,
        "similarity_fct": "cos_sim"
    }
    

task428_senteval_inversion

  • Dataset: task428_senteval_inversion
  • Size: 1,018 training samples
  • Columns: anchor, positive, and negative
  • Approximate statistics based on the first 1000 samples:
    anchorpositivenegative
    typestringstringstring
    detailsmin: 7 tokensmean: 16.69 tokensmax: 32 tokensmin: 7 tokensmean: 14.58 tokensmax: 31 tokensmin: 7 tokensmean: 15.26 tokensmax: 34 tokens
  • Samples:
  • Loss: MultipleNegativesRankingLoss with these parameters:
    {
        "scale": 20.0,
        "similarity_fct": "cos_sim"
    }
    

task311_race_question_generation

  • Dataset: task311_race_question_generation
  • Size: 1,018 training samples
  • Columns: anchor, positive, and negative
  • Approximate statistics based on the first 1000 samples:
    anchorpositivenegative
    typestringstringstring
    detailsmin: 115 tokensmean: 254.87 tokensmax: 256 tokensmin: 137 tokensmean: 254.4 tokensmax: 256 tokensmin: 171 tokensmean: 255.44 tokensmax: 256 tokens
  • Samples:
  • Loss: MultipleNegativesRankingLoss with these parameters:
    {
        "scale": 20.0,
        "similarity_fct": "cos_sim"
    }
    

task429_senteval_tense

  • Dataset: task429_senteval_tense
  • Size: 1,018 training samples
  • Columns: anchor, positive, and negative
  • Approximate statistics based on the first 1000 samples:
    anchorpositivenegative
    typestringstringstring
    detailsmin: 7 tokensmean: 15.84 tokensmax: 37 tokensmin: 6 tokensmean: 13.96 tokensmax: 33 tokensmin: 7 tokensmean: 15.25 tokensmax: 36 tokens
  • Samples:
  • Loss: MultipleNegativesRankingLoss with these parameters:
    {
        "scale": 20.0,
        "similarity_fct": "cos_sim"
    }
    

task403_creak_commonsense_inference

  • Dataset: task403_creak_commonsense_inference
  • Size: 1,018 training samples
  • Columns: anchor, positive, and negative
  • Approximate statistics based on the first 1000 samples:
    anchorpositivenegative
    typestringstringstring
    detailsmin: 13 tokensmean: 30.24 tokensmax: 104 tokensmin: 13 tokensmean: 29.39 tokensmax: 108 tokensmin: 13 tokensmean: 29.32 tokensmax: 122 tokens
  • Samples:
  • Loss: MultipleNegativesRankingLoss with these parameters:
    {
        "scale": 20.0,
        "similarity_fct": "cos_sim"
    }
    

task929_products_reviews_classification

  • Dataset: task929_products_reviews_classification
  • Size: 1,018 training samples
  • Columns: anchor, positive, and negative
  • Approximate statistics based on the first 1000 samples:
    anchorpositivenegative
    typestringstringstring
    detailsmin: 5 tokensmean: 69.68 tokensmax: 126 tokensmin: 6 tokensmean: 70.66 tokensmax: 123 tokensmin: 6 tokensmean: 70.61 tokensmax: 123 tokens
  • Samples:
  • Loss: MultipleNegativesRankingLoss with these parameters:
    {
        "scale": 20.0,
        "similarity_fct": "cos_sim"
    }
    

task582_naturalquestion_answer_generation

  • Dataset: task582_naturalquestion_answer_generation
  • Size: 1,018 training samples
  • Columns: anchor, positive, and negative
  • Approximate statistics based on the first 1000 samples:
    anchorpositivenegative
    typestringstringstring
    detailsmin: 10 tokensmean: 11.71 tokensmax: 25 tokensmin: 10 tokensmean: 11.65 tokensmax: 24 tokensmin: 10 tokensmean: 11.73 tokensmax: 25 tokens
  • Samples:
  • Loss: MultipleNegativesRankingLoss with these parameters:
    {
        "scale": 20.0,
        "similarity_fct": "cos_sim"
    }
    

task237_iirc_answer_from_subtext_answer_generation

  • Dataset: task237_iirc_answer_from_subtext_answer_generation
  • Size: 1,018 training samples
  • Columns: anchor, positive, and negative
  • Approximate statistics based on the first 1000 samples:
    anchorpositivenegative
    typestringstringstring
    detailsmin: 22 tokensmean: 66.3 tokensmax: 256 tokensmin: 25 tokensmean: 64.61 tokensmax: 256 tokensmin: 23 tokensmean: 61.49 tokensmax: 161 tokens
  • Samples:
  • Loss: MultipleNegativesRankingLoss with these parameters:
    {
        "scale": 20.0,
        "similarity_fct": "cos_sim"
    }
    

task050_multirc_answerability

  • Dataset: task050_multirc_answerability
  • Size: 1,018 training samples
  • Columns: anchor, positive, and negative
  • Approximate statistics based on the first 1000 samples:
    anchorpositivenegative
    typestringstringstring
    detailsmin: 15 tokensmean: 32.3 tokensmax: 112 tokensmin: 14 tokensmean: 31.56 tokensmax: 93 tokensmin: 15 tokensmean: 32.13 tokensmax: 159 tokens
  • Samples:
  • Loss: MultipleNegativesRankingLoss with these parameters:
    {
        "scale": 20.0,
        "similarity_fct": "cos_sim"
    }
    

task184_break_generate_question

  • Dataset: task184_break_generate_question
  • Size: 1,018 training samples
  • Columns: anchor, positive, and negative
  • Approximate statistics based on the first 1000 samples:
    anchorpositivenegative
    typestringstringstring
    detailsmin: 13 tokensmean: 39.73 tokensmax: 147 tokensmin: 13 tokensmean: 38.83 tokensmax: 149 tokensmin: 13 tokensmean: 39.61 tokensmax: 148 tokens
  • Samples:
  • Loss: MultipleNegativesRankingLoss with these parameters:
    {
        "scale": 20.0,
        "similarity_fct": "cos_sim"
    }
    

task669_ambigqa_answer_generation

  • Dataset: task669_ambigqa_answer_generation
  • Size: 1,018 training samples
  • Columns: anchor, positive, and negative
  • Approximate statistics based on the first 1000 samples:
    anchorpositivenegative
    typestringstringstring
    detailsmin: 10 tokensmean: 12.94 tokensmax: 23 tokensmin: 10 tokensmean: 12.88 tokensmax: 27 tokensmin: 11 tokensmean: 12.76 tokensmax: 22 tokens
  • Samples:
  • Loss: MultipleNegativesRankingLoss with these parameters:
    {
        "scale": 20.0,
        "similarity_fct": "cos_sim"
    }
    

task169_strategyqa_sentence_generation

  • Dataset: task169_strategyqa_sentence_generation
  • Size: 1,018 training samples
  • Columns: anchor, positive, and negative
  • Approximate statistics based on the first 1000 samples:
    anchorpositivenegative
    typestringstringstring
    detailsmin: 19 tokensmean: 35.21 tokensmax: 65 tokensmin: 22 tokensmean: 34.25 tokensmax: 60 tokensmin: 19 tokensmean: 33.3 tokensmax: 65 tokens
  • Samples:
  • Loss: MultipleNegativesRankingLoss with these parameters:
    {
        "scale": 20.0,
        "similarity_fct": "cos_sim"
    }
    

task500_scruples_anecdotes_title_generation

  • Dataset: task500_scruples_anecdotes_title_generation
  • Size: 1,018 training samples
  • Columns: anchor, positive, and negative
  • Approximate statistics based on the first 1000 samples:
    anchorpositivenegative
    typestringstringstring
    detailsmin: 14 tokensmean: 225.76 tokensmax: 256 tokensmin: 31 tokensmean: 233.16 tokensmax: 256 tokensmin: 27 tokensmean: 235.28 tokensmax: 256 tokens
  • Samples:
  • Loss: MultipleNegativesRankingLoss with these parameters:
    {
        "scale": 20.0,
        "similarity_fct": "cos_sim"
    }
    

task241_tweetqa_classification

  • Dataset: task241_tweetqa_classification
  • Size: 1,018 training samples
  • Columns: anchor, positive, and negative
  • Approximate statistics based on the first 1000 samples:
    anchorpositivenegative
    typestringstringstring
    detailsmin: 31 tokensmean: 61.75 tokensmax: 92 tokensmin: 36 tokensmean: 62.23 tokensmax: 106 tokensmin: 31 tokensmean: 61.7 tokensmax: 92 tokens
  • Samples:
  • Loss: MultipleNegativesRankingLoss with these parameters:
    {
        "scale": 20.0,
        "similarity_fct": "cos_sim"
    }
    

task1345_glue_qqp_question_paraprashing

  • Dataset: task1345_glue_qqp_question_paraprashing
  • Size: 1,018 training samples
  • Columns: anchor, positive, and negative
  • Approximate statistics based on the first 1000 samples:
    anchorpositivenegative
    typestringstringstring
    detailsmin: 6 tokensmean: 16.86 tokensmax: 60 tokensmin: 6 tokensmean: 15.83 tokensmax: 69 tokensmin: 6 tokensmean: 16.62 tokensmax: 51 tokens
  • Samples:
  • Loss: MultipleNegativesRankingLoss with these parameters:
    {
        "scale": 20.0,
        "similarity_fct": "cos_sim"
    }
    

task218_rocstories_swap_order_answer_generation

  • Dataset: task218_rocstories_swap_order_answer_generation
  • Size: 1,018 training samples
  • Columns: anchor, positive, and negative
  • Approximate statistics based on the first 1000 samples:
    anchorpositivenegative
    typestringstringstring
    detailsmin: 48 tokensmean: 72.41 tokensmax: 118 tokensmin: 48 tokensmean: 72.48 tokensmax: 102 tokensmin: 47 tokensmean: 72.1 tokensmax: 106 tokens
  • Samples:
  • Loss: MultipleNegativesRankingLoss with these parameters:
    {
        "scale": 20.0,
        "similarity_fct": "cos_sim"
    }
    

task613_politifact_text_generation

  • Dataset: task613_politifact_text_generation
  • Size: 1,018 training samples
  • Columns: anchor, positive, and negative
  • Approximate statistics based on the first 1000 samples:
    anchorpositivenegative
    typestringstringstring
    detailsmin: 4 tokensmean: 24.87 tokensmax: 75 tokensmin: 7 tokensmean: 23.39 tokensmax: 56 tokensmin: 5 tokensmean: 23.07 tokensmax: 61 tokens
  • Samples:
  • Loss: MultipleNegativesRankingLoss with these parameters:
    {
        "scale": 20.0,
        "similarity_fct": "cos_sim"
    }
    

task1167_penn_treebank_coarse_pos_tagging

  • Dataset: task1167_penn_treebank_coarse_pos_tagging
  • Size: 1,018 training samples
  • Columns: anchor, positive, and negative
  • Approximate statistics based on the first 1000 samples:
    anchorpositivenegative
    typestringstringstring
    detailsmin: 16 tokensmean: 53.65 tokensmax: 200 tokensmin: 16 tokensmean: 53.64 tokensmax: 220 tokensmin: 16 tokensmean: 54.8 tokensmax: 202 tokens
  • Samples:
  • Loss: MultipleNegativesRankingLoss with these parameters:
    {
        "scale": 20.0,
        "similarity_fct": "cos_sim"
    }
    

task1422_mathqa_physics

  • Dataset: task1422_mathqa_physics
  • Size: 1,018 training samples
  • Columns: anchor, positive, and negative
  • Approximate statistics based on the first 1000 samples:
    anchorpositivenegative
    typestringstringstring
    detailsmin: 34 tokensmean: 72.71 tokensmax: 164 tokensmin: 38 tokensmean: 71.93 tokensmax: 157 tokensmin: 39 tokensmean: 72.67 tokensmax: 155 tokens
  • Samples:
  • Loss: MultipleNegativesRankingLoss with these parameters:
    {
        "scale": 20.0,
        "similarity_fct": "cos_sim"
    }
    

task247_dream_answer_generation

  • Dataset: task247_dream_answer_generation
  • Size: 1,018 training samples
  • Columns: anchor, positive, and negative
  • Approximate statistics based on the first 1000 samples:
    anchorpositivenegative
    typestringstringstring
    detailsmin: 38 tokensmean: 160.28 tokensmax: 256 tokensmin: 39 tokensmean: 159.0 tokensmax: 256 tokensmin: 41 tokensmean: 167.8 tokensmax: 256 tokens
  • Samples:
  • Loss: MultipleNegativesRankingLoss with these parameters:
    {
        "scale": 20.0,
        "similarity_fct": "cos_sim"
    }
    

task199_mnli_classification

  • Dataset: task199_mnli_classification
  • Size: 1,018 training samples
  • Columns: anchor, positive, and negative
  • Approximate statistics based on the first 1000 samples:
    anchorpositivenegative
    typestringstringstring
    detailsmin: 13 tokensmean: 43.07 tokensmax: 127 tokensmin: 11 tokensmean: 44.72 tokensmax: 149 tokensmin: 11 tokensmean: 43.81 tokensmax: 113 tokens
  • Samples:
  • Loss: MultipleNegativesRankingLoss with these parameters:
    {
        "scale": 20.0,
        "similarity_fct": "cos_sim"
    }
    

task164_mcscript_question_answering_text

  • Dataset: task164_mcscript_question_answering_text
  • Size: 1,018 training samples
  • Columns: anchor, positive, and negative
  • Approximate statistics based on the first 1000 samples:
    anchorpositivenegative
    typestringstringstring
    detailsmin: 150 tokensmean: 200.63 tokensmax: 256 tokensmin: 150 tokensmean: 200.9 tokensmax: 256 tokensmin: 142 tokensmean: 200.85 tokensmax: 256 tokens
  • Samples:
  • Loss: MultipleNegativesRankingLoss with these parameters:
    {
        "scale": 20.0,
        "similarity_fct": "cos_sim"
    }
    

task1541_agnews_classification

  • Dataset: task1541_agnews_classification
  • Size: 1,018 training samples
  • Columns: anchor, positive, and negative
  • Approximate statistics based on the first 1000 samples:
    anchorpositivenegative
    typestringstringstring
    detailsmin: 21 tokensmean: 53.59 tokensmax: 256 tokensmin: 18 tokensmean: 53.09 tokensmax: 256 tokensmin: 18 tokensmean: 53.95 tokensmax: 161 tokens
  • Samples:
  • Loss: MultipleNegativesRankingLoss with these parameters:
    {
        "scale": 20.0,
        "similarity_fct": "cos_sim"
    }
    

task516_senteval_conjoints_inversion

  • Dataset: task516_senteval_conjoints_inversion
  • Size: 1,018 training samples
  • Columns: anchor, positive, and negative
  • Approximate statistics based on the first 1000 samples:
    anchorpositivenegative
    typestringstringstring
    detailsmin: 8 tokensmean: 20.33 tokensmax: 34 tokensmin: 8 tokensmean: 19.01 tokensmax: 34 tokensmin: 8 tokensmean: 18.96 tokensmax: 34 tokens
  • Samples:
  • Loss: MultipleNegativesRankingLoss with these parameters:
    {
        "scale": 20.0,
        "similarity_fct": "cos_sim"
    }
    

task294_storycommonsense_motiv_text_generation

  • Dataset: task294_storycommonsense_motiv_text_generation
  • Size: 1,018 training samples
  • Columns: anchor, positive, and negative
  • Approximate statistics based on the first 1000 samples:
    anchorpositivenegative
    typestringstringstring
    detailsmin: 14 tokensmean: 40.09 tokensmax: 86 tokensmin: 14 tokensmean: 40.77 tokensmax: 86 tokensmin: 14 tokensmean: 39.86 tokensmax: 86 tokens
  • Samples:
  • Loss: MultipleNegativesRankingLoss with these parameters:
    {
        "scale": 20.0,
        "similarity_fct": "cos_sim"
    }
    

task501_scruples_anecdotes_post_type_verification

  • Dataset: task501_scruples_anecdotes_post_type_verification
  • Size: 1,018 training samples
  • Columns: anchor, positive, and negative
  • Approximate statistics based on the first 1000 samples:
    anchorpositivenegative
    typestringstringstring
    detailsmin: 18 tokensmean: 231.55 tokensmax: 256 tokensmin: 12 tokensmean: 235.21 tokensmax: 256 tokensmin: 18 tokensmean: 234.47 tokensmax: 256 tokens
  • Samples:
  • Loss: MultipleNegativesRankingLoss with these parameters:
    {
        "scale": 20.0,
        "similarity_fct": "cos_sim"
    }
    

task213_rocstories_correct_ending_classification

  • Dataset: task213_rocstories_correct_ending_classification
  • Size: 1,018 training samples
  • Columns: anchor, positive, and negative
  • Approximate statistics based on the first 1000 samples:
    anchorpositivenegative
    typestringstringstring
    detailsmin: 62 tokensmean: 86.17 tokensmax: 125 tokensmin: 60 tokensmean: 85.49 tokensmax: 131 tokensmin: 59 tokensmean: 86.18 tokensmax: 131 tokens
  • Samples:
  • Loss: MultipleNegativesRankingLoss with these parameters:
    {
        "scale": 20.0,
        "similarity_fct": "cos_sim"
    }
    

task821_protoqa_question_generation

  • Dataset: task821_protoqa_question_generation
  • Size: 1,018 training samples
  • Columns: anchor, positive, and negative
  • Approximate statistics based on the first 1000 samples:
    anchorpositivenegative
    typestringstringstring
    detailsmin: 5 tokensmean: 14.6 tokensmax: 61 tokensmin: 5 tokensmean: 14.95 tokensmax: 35 tokensmin: 5 tokensmean: 13.89 tokensmax: 93 tokens
  • Samples:
  • Loss: MultipleNegativesRankingLoss with these parameters:
    {
        "scale": 20.0,
        "similarity_fct": "cos_sim"
    }
    

task493_review_polarity_classification

  • Dataset: task493_review_polarity_classification
  • Size: 1,018 training samples
  • Columns: anchor, positive, and negative
  • Approximate statistics based on the first 1000 samples:
    anchorpositivenegative
    typestringstringstring
    detailsmin: 18 tokensmean: 100.91 tokensmax: 256 tokensmin: 19 tokensmean: 107.28 tokensmax: 256 tokensmin: 14 tokensmean: 113.07 tokensmax: 256 tokens
  • Samples:
  • Loss: MultipleNegativesRankingLoss with these parameters:
    {
        "scale": 20.0,
        "similarity_fct": "cos_sim"
    }
    

task308_jeopardy_answer_generation_all

  • Dataset: task308_jeopardy_answer_generation_all
  • Size: 1,018 training samples
  • Columns: anchor, positive, and negative
  • Approximate statistics based on the first 1000 samples:
    anchorpositivenegative
    typestringstringstring
    detailsmin: 12 tokensmean: 27.9 tokensmax: 50 tokensmin: 10 tokensmean: 26.98 tokensmax: 44 tokensmin: 9 tokensmean: 27.48 tokensmax: 48 tokens
  • Samples:
  • Loss: MultipleNegativesRankingLoss with these parameters:
    {
        "scale": 20.0,
        "similarity_fct": "cos_sim"
    }
    

task1595_event2mind_text_generation_1

  • Dataset: task1595_event2mind_text_generation_1
  • Size: 1,018 training samples
  • Columns: anchor, positive, and negative
  • Approximate statistics based on the first 1000 samples:
    anchorpositivenegative
    typestringstringstring
    detailsmin: 6 tokensmean: 9.86 tokensmax: 18 tokensmin: 6 tokensmean: 9.97 tokensmax: 20 tokensmin: 6 tokensmean: 10.02 tokensmax: 20 tokens
  • Samples:
  • Loss: MultipleNegativesRankingLoss with these parameters:
    {
        "scale": 20.0,
        "similarity_fct": "cos_sim"
    }
    

task040_qasc_question_generation

  • Dataset: task040_qasc_question_generation
  • Size: 1,018 training samples
  • Columns: anchor, positive, and negative
  • Approximate statistics based on the first 1000 samples:
    anchorpositivenegative
    typestringstringstring
    detailsmin: 8 tokensmean: 15.04 tokensmax: 29 tokensmin: 7 tokensmean: 15.05 tokensmax: 30 tokensmin: 8 tokensmean: 13.84 tokensmax: 32 tokens
  • Samples:
  • Loss: MultipleNegativesRankingLoss with these parameters:
    {
        "scale": 20.0,
        "similarity_fct": "cos_sim"
    }
    

task231_iirc_link_classification

  • Dataset: task231_iirc_link_classification
  • Size: 1,018 training samples
  • Columns: anchor, positive, and negative
  • Approximate statistics based on the first 1000 samples:
    anchorpositivenegative
    typestringstringstring
    detailsmin: 179 tokensmean: 246.31 tokensmax: 256 tokensmin: 170 tokensmean: 245.93 tokensmax: 256 tokensmin: 161 tokensmean: 247.13 tokensmax: 256 tokens
  • Samples:
  • Loss: MultipleNegativesRankingLoss with these parameters:
    {
        "scale": 20.0,
        "similarity_fct": "cos_sim"
    }
    

task1727_wiqa_what_is_the_effect

  • Dataset: task1727_wiqa_what_is_the_effect
  • Size: 1,018 training samples
  • Columns: anchor, positive, and negative
  • Approximate statistics based on the first 1000 samples:
    anchorpositivenegative
    typestringstringstring
    detailsmin: 44 tokensmean: 95.17 tokensmax: 183 tokensmin: 44 tokensmean: 95.18 tokensmax: 185 tokensmin: 43 tokensmean: 95.42 tokensmax: 183 tokens
  • Samples:
  • Loss: MultipleNegativesRankingLoss with these parameters:
    {
        "scale": 20.0,
        "similarity_fct": "cos_sim"
    }
    

task578_curiosity_dialogs_answer_generation

  • Dataset: task578_curiosity_dialogs_answer_generation
  • Size: 1,018 training samples
  • Columns: anchor, positive, and negative
  • Approximate statistics based on the first 1000 samples:
    anchorpositivenegative
    typestringstringstring
    detailsmin: 10 tokensmean: 229.66 tokensmax: 256 tokensmin: 118 tokensmean: 235.49 tokensmax: 256 tokensmin: 12 tokensmean: 229.46 tokensmax: 256 tokens
  • Samples:
  • Loss: MultipleNegativesRankingLoss with these parameters:
    {
        "scale": 20.0,
        "similarity_fct": "cos_sim"
    }
    

task310_race_classification

  • Dataset: task310_race_classification
  • Size: 1,018 training samples
  • Columns: anchor, positive, and negative
  • Approximate statistics based on the first 1000 samples:
    anchorpositivenegative
    typestringstringstring
    detailsmin: 101 tokensmean: 254.9 tokensmax: 256 tokensmin: 218 tokensmean: 255.78 tokensmax: 256 tokensmin: 101 tokensmean: 254.9 tokensmax: 256 tokens
  • Samples:
  • Loss: MultipleNegativesRankingLoss with these parameters:
    {
        "scale": 20.0,
        "similarity_fct": "cos_sim"
    }
    

task309_race_answer_generation

  • Dataset: task309_race_answer_generation
  • Size: 1,018 training samples
  • Columns: anchor, positive, and negative
  • Approximate statistics based on the first 1000 samples:
    anchorpositivenegative
    typestringstringstring
    detailsmin: 75 tokensmean: 254.99 tokensmax: 256 tokensmin: 204 tokensmean: 255.6 tokensmax: 256 tokensmin: 75 tokensmean: 255.19 tokensmax: 256 tokens
  • Samples:
  • Loss: MultipleNegativesRankingLoss with these parameters:
    {
        "scale": 20.0,
        "similarity_fct": "cos_sim"
    }
    

task379_agnews_topic_classification

  • Dataset: task379_agnews_topic_classification
  • Size: 1,018 training samples
  • Columns: anchor, positive, and negative
  • Approximate statistics based on the first 1000 samples:
    anchorpositivenegative
    typestringstringstring
    detailsmin: 20 tokensmean: 54.89 tokensmax: 193 tokensmin: 20 tokensmean: 54.64 tokensmax: 175 tokensmin: 21 tokensmean: 54.78 tokensmax: 187 tokens
  • Samples:
  • Loss: MultipleNegativesRankingLoss with these parameters:
    {
        "scale": 20.0,
        "similarity_fct": "cos_sim"
    }
    

task030_winogrande_full_person

  • Dataset: task030_winogrande_full_person
  • Size: 1,018 training samples
  • Columns: anchor, positive, and negative
  • Approximate statistics based on the first 1000 samples:
    anchorpositivenegative
    typestringstringstring
    detailsmin: 7 tokensmean: 7.59 tokensmax: 12 tokensmin: 7 tokensmean: 7.49 tokensmax: 12 tokensmin: 7 tokensmean: 7.38 tokensmax: 11 tokens
  • Samples:
  • Loss: MultipleNegativesRankingLoss with these parameters:
    {
        "scale": 20.0,
        "similarity_fct": "cos_sim"
    }
    

task1540_parsed_pdfs_summarization

  • Dataset: task1540_parsed_pdfs_summarization
  • Size: 1,018 training samples
  • Columns: anchor, positive, and negative
  • Approximate statistics based on the first 1000 samples:
    anchorpositivenegative
    typestringstringstring
    detailsmin: 3 tokensmean: 188.4 tokensmax: 256 tokensmin: 46 tokensmean: 190.16 tokensmax: 256 tokensmin: 3 tokensmean: 192.07 tokensmax: 256 tokens
  • Samples:
  • Loss: MultipleNegativesRankingLoss with these parameters:
    {
        "scale": 20.0,
        "similarity_fct": "cos_sim"
    }
    

task039_qasc_find_overlapping_words

  • Dataset: task039_qasc_find_overlapping_words
  • Size: 1,018 training samples
  • Columns: anchor, positive, and negative
  • Approximate statistics based on the first 1000 samples:
    anchorpositivenegative
    typestringstringstring
    detailsmin: 16 tokensmean: 30.48 tokensmax: 55 tokensmin: 16 tokensmean: 30.05 tokensmax: 57 tokensmin: 16 tokensmean: 30.65 tokensmax: 60 tokens
  • Samples:
  • Loss: MultipleNegativesRankingLoss with these parameters:
    {
        "scale": 20.0,
        "similarity_fct": "cos_sim"
    }
    

task1206_atomic_classification_isbefore

  • Dataset: task1206_atomic_classification_isbefore
  • Size: 1,018 training samples
  • Columns: anchor, positive, and negative
  • Approximate statistics based on the first 1000 samples:
    anchorpositivenegative
    typestringstringstring
    detailsmin: 14 tokensmean: 21.2 tokensmax: 40 tokensmin: 14 tokensmean: 20.77 tokensmax: 31 tokensmin: 14 tokensmean: 21.41 tokensmax: 31 tokens
  • Samples:
  • Loss: MultipleNegativesRankingLoss with these parameters:
    {
        "scale": 20.0,
        "similarity_fct": "cos_sim"
    }
    

task157_count_vowels_and_consonants

  • Dataset: task157_count_vowels_and_consonants
  • Size: 1,018 training samples
  • Columns: anchor, positive, and negative
  • Approximate statistics based on the first 1000 samples:
    anchorpositivenegative
    typestringstringstring
    detailsmin: 24 tokensmean: 28.0 tokensmax: 41 tokensmin: 24 tokensmean: 27.91 tokensmax: 41 tokensmin: 24 tokensmean: 28.3 tokensmax: 39 tokens
  • Samples:
  • Loss: MultipleNegativesRankingLoss with these parameters:
    {
        "scale": 20.0,
        "similarity_fct": "cos_sim"
    }
    

task339_record_answer_generation

  • Dataset: task339_record_answer_generation
  • Size: 1,018 training samples
  • Columns: anchor, positive, and negative
  • Approximate statistics based on the first 1000 samples:
    anchorpositivenegative
    typestringstringstring
    detailsmin: 171 tokensmean: 235.1 tokensmax: 256 tokensmin: 171 tokensmean: 234.38 tokensmax: 256 tokensmin: 171 tokensmean: 232.38 tokensmax: 256 tokens
  • Samples:
  • Loss: MultipleNegativesRankingLoss with these parameters:
    {
        "scale": 20.0,
        "similarity_fct": "cos_sim"
    }
    

task453_swag_answer_generation

  • Dataset: task453_swag_answer_generation
  • Size: 1,018 training samples
  • Columns: anchor, positive, and negative
  • Approximate statistics based on the first 1000 samples:
    anchorpositivenegative
    typestringstringstring
    detailsmin: 9 tokensmean: 18.56 tokensmax: 60 tokensmin: 9 tokensmean: 18.16 tokensmax: 63 tokensmin: 9 tokensmean: 17.5 tokensmax: 55 tokens
  • Samples:
  • Loss: MultipleNegativesRankingLoss with these parameters:
    {
        "scale": 20.0,
        "similarity_fct": "cos_sim"
    }
    

task848_pubmedqa_classification

  • Dataset: task848_pubmedqa_classification
  • Size: 1,018 training samples
  • Columns: anchor, positive, and negative
  • Approximate statistics based on the first 1000 samples:
    anchorpositivenegative
    typestringstringstring
    detailsmin: 21 tokensmean: 248.87 tokensmax: 256 tokensmin: 21 tokensmean: 250.0 tokensmax: 256 tokensmin: 84 tokensmean: 251.62 tokensmax: 256 tokens
  • Samples:
  • Loss: MultipleNegativesRankingLoss with these parameters:
    {
        "scale": 20.0,
        "similarity_fct": "cos_sim"
    }
    

task673_google_wellformed_query_classification

  • Dataset: task673_google_wellformed_query_classification
  • Size: 1,018 training samples
  • Columns: anchor, positive, and negative
  • Approximate statistics based on the first 1000 samples:
    anchorpositivenegative
    typestringstringstring
    detailsmin: 6 tokensmean: 11.6 tokensmax: 27 tokensmin: 6 tokensmean: 11.22 tokensmax: 24 tokensmin: 6 tokensmean: 11.34 tokensmax: 22 tokens
  • Samples:
  • Loss: MultipleNegativesRankingLoss with these parameters:
    {
        "scale": 20.0,
        "similarity_fct": "cos_sim"
    }
    

task676_ollie_relationship_answer_generation

  • Dataset: task676_ollie_relationship_answer_generation
  • Size: 1,018 training samples
  • Columns: anchor, positive, and negative
  • Approximate statistics based on the first 1000 samples:
    anchorpositivenegative
    typestringstringstring
    detailsmin: 29 tokensmean: 50.99 tokensmax: 113 tokensmin: 29 tokensmean: 49.39 tokensmax: 134 tokensmin: 30 tokensmean: 51.48 tokensmax: 113 tokens
  • Samples:
  • Loss: MultipleNegativesRankingLoss with these parameters:
    {
        "scale": 20.0,
        "similarity_fct": "cos_sim"
    }
    

task268_casehold_legal_answer_generation

  • Dataset: task268_casehold_legal_answer_generation
  • Size: 1,018 training samples
  • Columns: anchor, positive, and negative
  • Approximate statistics based on the first 1000 samples:
    anchorpositivenegative
    typestringstringstring
    detailsmin: 235 tokensmean: 255.96 tokensmax: 256 tokensmin: 156 tokensmean: 255.46 tokensmax: 256 tokensmin: 226 tokensmean: 255.94 tokensmax: 256 tokens
  • Samples:
  • Loss: MultipleNegativesRankingLoss with these parameters:
    {
        "scale": 20.0,
        "similarity_fct": "cos_sim"
    }
    

task844_financial_phrasebank_classification

  • Dataset: task844_financial_phrasebank_classification
  • Size: 1,018 training samples
  • Columns: anchor, positive, and negative
  • Approximate statistics based on the first 1000 samples:
    anchorpositivenegative
    typestringstringstring
    detailsmin: 14 tokensmean: 39.8 tokensmax: 86 tokensmin: 13 tokensmean: 38.45 tokensmax: 78 tokensmin: 15 tokensmean: 39.06 tokensmax: 86 tokens
  • Samples:
  • Loss: MultipleNegativesRankingLoss with these parameters:
    {
        "scale": 20.0,
        "similarity_fct": "cos_sim"
    }
    

task330_gap_answer_generation

  • Dataset: task330_gap_answer_generation
  • Size: 1,018 training samples
  • Columns: anchor, positive, and negative
  • Approximate statistics based on the first 1000 samples:
    anchorpositivenegative
    typestringstringstring
    detailsmin: 26 tokensmean: 106.78 tokensmax: 256 tokensmin: 44 tokensmean: 108.12 tokensmax: 256 tokensmin: 45 tokensmean: 110.93 tokensmax: 256 tokens
  • Samples:
  • Loss: MultipleNegativesRankingLoss with these parameters:
    {
        "scale": 20.0,
        "similarity_fct": "cos_sim"
    }
    

task595_mocha_answer_generation

  • Dataset: task595_mocha_answer_generation
  • Size: 1,018 training samples
  • Columns: anchor, positive, and negative
  • Approximate statistics based on the first 1000 samples:
    anchorpositivenegative
    typestringstringstring
    detailsmin: 44 tokensmean: 94.08 tokensmax: 178 tokensmin: 21 tokensmean: 97.06 tokensmax: 256 tokensmin: 19 tokensmean: 118.77 tokensmax: 256 tokens
  • Samples:
  • Loss: MultipleNegativesRankingLoss with these parameters:
    {
        "scale": 20.0,
        "similarity_fct": "cos_sim"
    }
    

task1285_kpa_keypoint_matching

  • Dataset: task1285_kpa_keypoint_matching
  • Size: 1,018 training samples
  • Columns: anchor, positive, and negative
  • Approximate statistics based on the first 1000 samples:
    anchorpositivenegative
    typestringstringstring
    detailsmin: 30 tokensmean: 52.36 tokensmax: 92 tokensmin: 29 tokensmean: 50.14 tokensmax: 84 tokensmin: 31 tokensmean: 53.21 tokensmax: 88 tokens
  • Samples:
  • Loss: MultipleNegativesRankingLoss with these parameters:
    {
        "scale": 20.0,
        "similarity_fct": "cos_sim"
    }
    

task234_iirc_passage_line_answer_generation

  • Dataset: task234_iirc_passage_line_answer_generation
  • Size: 1,018 training samples
  • Columns: anchor, positive, and negative
  • Approximate statistics based on the first 1000 samples:
    anchorpositivenegative
    typestringstringstring
    detailsmin: 143 tokensmean: 235.25 tokensmax: 256 tokensmin: 155 tokensmean: 235.25 tokensmax: 256 tokensmin: 146 tokensmean: 236.25 tokensmax: 256 tokens
  • Samples:
  • Loss: MultipleNegativesRankingLoss with these parameters:
    {
        "scale": 20.0,
        "similarity_fct": "cos_sim"
    }
    

task494_review_polarity_answer_generation

  • Dataset: task494_review_polarity_answer_generation
  • Size: 1,018 training samples
  • Columns: anchor, positive, and negative
  • Approximate statistics based on the first 1000 samples:
    anchorpositivenegative
    typestringstringstring
    detailsmin: 3 tokensmean: 106.0 tokensmax: 256 tokensmin: 23 tokensmean: 112.36 tokensmax: 256 tokensmin: 20 tokensmean: 112.66 tokensmax: 249 tokens
  • Samples:
  • Loss: MultipleNegativesRankingLoss with these parameters:
    {
        "scale": 20.0,
        "similarity_fct": "cos_sim"
    }
    

task670_ambigqa_question_generation

  • Dataset: task670_ambigqa_question_generation
  • Size: 1,018 training samples
  • Columns: anchor, positive, and negative
  • Approximate statistics based on the first 1000 samples:
    anchorpositivenegative
    typestringstringstring
    detailsmin: 11 tokensmean: 12.66 tokensmax: 26 tokensmin: 11 tokensmean: 12.48 tokensmax: 23 tokensmin: 11 tokensmean: 12.24 tokensmax: 18 tokens
  • Samples:
  • Loss: MultipleNegativesRankingLoss with these parameters:
    {
        "scale": 20.0,
        "similarity_fct": "cos_sim"
    }
    

task289_gigaword_summarization

  • Dataset: task289_gigaword_summarization
  • Size: 1,018 training samples
  • Columns: anchor, positive, and negative
  • Approximate statistics based on the first 1000 samples:
    anchorpositivenegative
    typestringstringstring
    detailsmin: 25 tokensmean: 51.53 tokensmax: 87 tokensmin: 27 tokensmean: 52.0 tokensmax: 87 tokensmin: 25 tokensmean: 51.44 tokensmax: 87 tokens
  • Samples:
  • Loss: MultipleNegativesRankingLoss with these parameters:
    {
        "scale": 20.0,
        "similarity_fct": "cos_sim"
    }
    

npr

  • Dataset: npr
  • Size: 24,838 training samples
  • Columns: anchor, positive, and negative
  • Approximate statistics based on the first 1000 samples:
    anchorpositivenegative
    typestringstringstring
    detailsmin: 4 tokensmean: 12.74 tokensmax: 32 tokensmin: 12 tokensmean: 152.32 tokensmax: 256 tokensmin: 14 tokensmean: 119.75 tokensmax: 256 tokens
  • Samples:
  • Loss: MultipleNegativesRankingLoss with these parameters:
    {
        "scale": 20.0,
        "similarity_fct": "cos_sim"
    }
    

nli

  • Dataset: nli
  • Size: 49,676 training samples
  • Columns: anchor, positive, and negative
  • Approximate statistics based on the first 1000 samples:
    anchorpositivenegative
    typestringstringstring
    detailsmin: 5 tokensmean: 21.62 tokensmax: 108 tokensmin: 4 tokensmean: 12.07 tokensmax: 50 tokensmin: 4 tokensmean: 12.21 tokensmax: 44 tokens
  • Samples:
  • Loss: MultipleNegativesRankingLoss with these parameters:
    {
        "scale": 20.0,
        "similarity_fct": "cos_sim"
    }
    

SimpleWiki

  • Dataset: SimpleWiki
  • Size: 5,070 training samples
  • Columns: anchor, positive, and negative
  • Approximate statistics based on the first 1000 samples:
    anchorpositivenegative
    typestringstringstring
    detailsmin: 8 tokensmean: 29.35 tokensmax: 256 tokensmin: 8 tokensmean: 33.94 tokensmax: 256 tokensmin: 10 tokensmean: 56.42 tokensmax: 256 tokens
  • Samples:
  • Loss: MultipleNegativesRankingLoss with these parameters:
    {
        "scale": 20.0,
        "similarity_fct": "cos_sim"
    }
    

amazon_review_2018

  • Dataset: amazon_review_2018
  • Size: 99,352 training samples
  • Columns: anchor, positive, and negative
  • Approximate statistics based on the first 1000 samples:
    anchorpositivenegative
    typestringstringstring
    detailsmin: 4 tokensmean: 11.86 tokensmax: 33 tokensmin: 11 tokensmean: 88.89 tokensmax: 256 tokensmin: 11 tokensmean: 70.8 tokensmax: 256 tokens
  • Samples:
  • Loss: MultipleNegativesRankingLoss with these parameters:
    {
        "scale": 20.0,
        "similarity_fct": "cos_sim"
    }
    

ccnews_title_text

  • Dataset: ccnews_title_text
  • Size: 24,838 training samples
  • Columns: anchor, positive, and negative
  • Approximate statistics based on the first 1000 samples:
    anchorpositivenegative
    typestringstringstring
    detailsmin: 6 tokensmean: 15.24 tokensmax: 59 tokensmin: 21 tokensmean: 210.26 tokensmax: 256 tokensmin: 20 tokensmean: 194.92 tokensmax: 256 tokens
  • Samples:
  • Loss: MultipleNegativesRankingLoss with these parameters:
    {
        "scale": 20.0,
        "similarity_fct": "cos_sim"
    }
    

agnews

  • Dataset: agnews
  • Size: 44,606 training samples
  • Columns: anchor, positive, and negative
  • Approximate statistics based on the first 1000 samples:
    anchorpositivenegative
    typestringstringstring
    detailsmin: 5 tokensmean: 11.73 tokensmax: 38 tokensmin: 10 tokensmean: 39.85 tokensmax: 256 tokensmin: 13 tokensmean: 45.43 tokensmax: 256 tokens
  • Samples:
  • Loss: MultipleNegativesRankingLoss with these parameters:
    {
        "scale": 20.0,
        "similarity_fct": "cos_sim"
    }
    

xsum

  • Dataset: xsum
  • Size: 10,140 training samples
  • Columns: anchor, positive, and negative
  • Approximate statistics based on the first 1000 samples:
    anchorpositivenegative
    typestringstringstring
    detailsmin: 8 tokensmean: 27.77 tokensmax: 58 tokensmin: 14 tokensmean: 226.87 tokensmax: 256 tokensmin: 41 tokensmean: 232.14 tokensmax: 256 tokens
  • Samples:
  • Loss: MultipleNegativesRankingLoss with these parameters:
    {
        "scale": 20.0,
        "similarity_fct": "cos_sim"
    }
    

msmarco

  • Dataset: msmarco
  • Size: 173,354 training samples
  • Columns: anchor, positive, and negative
  • Approximate statistics based on the first 1000 samples:
    anchorpositivenegative
    typestringstringstring
    detailsmin: 4 tokensmean: 9.07 tokensmax: 25 tokensmin: 19 tokensmean: 82.14 tokensmax: 237 tokensmin: 19 tokensmean: 80.54 tokensmax: 252 tokens
  • Samples:
  • Loss: MultipleNegativesRankingLoss with these parameters:
    {
        "scale": 20.0,
        "similarity_fct": "cos_sim"
    }
    

yahoo_answers_title_answer

  • Dataset: yahoo_answers_title_answer
  • Size: 24,838 training samples
  • Columns: anchor, positive, and negative
  • Approximate statistics based on the first 1000 samples:
    anchorpositivenegative
    typestringstringstring
    detailsmin: 6 tokensmean: 16.73 tokensmax: 45 tokensmin: 5 tokensmean: 82.94 tokensmax: 256 tokensmin: 7 tokensmean: 86.15 tokensmax: 256 tokens
  • Samples:
  • Loss: MultipleNegativesRankingLoss with these parameters:
    {
        "scale": 20.0,
        "similarity_fct": "cos_sim"
    }
    

squad_pairs

  • Dataset: squad_pairs
  • Size: 24,838 training samples
  • Columns: anchor, positive, and negative
  • Approximate statistics based on the first 1000 samples:
    anchorpositivenegative
    typestringstringstring
    detailsmin: 7 tokensmean: 14.05 tokensmax: 38 tokensmin: 32 tokensmean: 153.91 tokensmax: 256 tokensmin: 34 tokensmean: 162.67 tokensmax: 256 tokens
  • Samples:
  • Loss: MultipleNegativesRankingLoss with these parameters:
    {
        "scale": 20.0,
        "similarity_fct": "cos_sim"
    }
    

wow

  • Dataset: wow
  • Size: 29,908 training samples
  • Columns: anchor, positive, and negative
  • Approximate statistics based on the first 1000 samples:
    anchorpositivenegative
    typestringstringstring
    detailsmin: 3 tokensmean: 88.36 tokensmax: 256 tokensmin: 100 tokensmean: 112.02 tokensmax: 150 tokensmin: 83 tokensmean: 113.07 tokensmax: 147 tokens
  • Samples:
  • Loss: MultipleNegativesRankingLoss with these parameters:
    {
        "scale": 20.0,
        "similarity_fct": "cos_sim"
    }
    

mteb-amazon_counterfactual-avs_triplets

  • Dataset: mteb-amazon_counterfactual-avs_triplets
  • Size: 4,055 training samples
  • Columns: anchor, positive, and negative
  • Approximate statistics based on the first 1000 samples:
    anchorpositivenegative
    typestringstringstring
    detailsmin: 12 tokensmean: 27.68 tokensmax: 137 tokensmin: 12 tokensmean: 26.84 tokensmax: 137 tokensmin: 12 tokensmean: 26.34 tokensmax: 91 tokens
  • Samples:
  • Loss: MultipleNegativesRankingLoss with these parameters:
    {
        "scale": 20.0,
        "similarity_fct": "cos_sim"
    }
    

mteb-amazon_massive_intent-avs_triplets

  • Dataset: mteb-amazon_massive_intent-avs_triplets
  • Size: 11,661 training samples
  • Columns: anchor, positive, and negative
  • Approximate statistics based on the first 1000 samples:
    anchorpositivenegative
    typestringstringstring
    detailsmin: 3 tokensmean: 9.5 tokensmax: 28 tokensmin: 3 tokensmean: 9.05 tokensmax: 26 tokensmin: 3 tokensmean: 9.45 tokensmax: 25 tokens
  • Samples:
  • Loss: MultipleNegativesRankingLoss with these parameters:
    {
        "scale": 20.0,
        "similarity_fct": "cos_sim"
    }
    

mteb-amazon_massive_scenario-avs_triplets

  • Dataset: mteb-amazon_massive_scenario-avs_triplets
  • Size: 11,661 training samples
  • Columns: anchor, positive, and negative
  • Approximate statistics based on the first 1000 samples:
    anchorpositivenegative
    typestringstringstring
    detailsmin: 3 tokensmean: 9.62 tokensmax: 39 tokensmin: 3 tokensmean: 9.19 tokensmax: 29 tokensmin: 3 tokensmean: 9.59 tokensmax: 24 tokens
  • Samples:
  • Loss: MultipleNegativesRankingLoss with these parameters:
    {
        "scale": 20.0,
        "similarity_fct": "cos_sim"
    }
    

mteb-amazon_reviews_multi-avs_triplets

  • Dataset: mteb-amazon_reviews_multi-avs_triplets
  • Size: 198,192 training samples
  • Columns: anchor, positive, and negative
  • Approximate statistics based on the first 1000 samples:
    anchorpositivenegative
    typestringstringstring
    detailsmin: 7 tokensmean: 49.55 tokensmax: 256 tokensmin: 6 tokensmean: 49.51 tokensmax: 256 tokensmin: 8 tokensmean: 48.42 tokensmax: 256 tokens
  • Samples:
  • Loss: MultipleNegativesRankingLoss with these parameters:
    {
        "scale": 20.0,
        "similarity_fct": "cos_sim"
    }
    

mteb-banking77-avs_triplets

  • Dataset: mteb-banking77-avs_triplets
  • Size: 10,139 training samples
  • Columns: anchor, positive, and negative
  • Approximate statistics based on the first 1000 samples:
    anchorpositivenegative
    typestringstringstring
    detailsmin: 4 tokensmean: 15.81 tokensmax: 73 tokensmin: 6 tokensmean: 15.77 tokensmax: 73 tokensmin: 5 tokensmean: 16.1 tokensmax: 73 tokens
  • Samples:
  • Loss: MultipleNegativesRankingLoss with these parameters:
    {
        "scale": 20.0,
        "similarity_fct": "cos_sim"
    }
    

mteb-emotion-avs_triplets

  • Dataset: mteb-emotion-avs_triplets
  • Size: 16,224 training samples
  • Columns: anchor, positive, and negative
  • Approximate statistics based on the first 1000 samples:
    anchorpositivenegative
    typestringstringstring
    detailsmin: 5 tokensmean: 22.04 tokensmax: 67 tokensmin: 5 tokensmean: 17.71 tokensmax: 65 tokensmin: 5 tokensmean: 21.99 tokensmax: 72 tokens
  • Samples:
  • Loss: MultipleNegativesRankingLoss with these parameters:
    {
        "scale": 20.0,
        "similarity_fct": "cos_sim"
    }
    

mteb-imdb-avs_triplets

  • Dataset: mteb-imdb-avs_triplets
  • Size: 24,839 training samples
  • Columns: anchor, positive, and negative
  • Approximate statistics based on the first 1000 samples:
    anchorpositivenegative
    typestringstringstring
    detailsmin: 34 tokensmean: 207.67 tokensmax: 256 tokensmin: 36 tokensmean: 223.93 tokensmax: 256 tokensmin: 42 tokensmean: 206.87 tokensmax: 256 tokens
  • Samples:
  • Loss: MultipleNegativesRankingLoss with these parameters:
    {
        "scale": 20.0,
        "similarity_fct": "cos_sim"
    }
    

mteb-mtop_domain-avs_triplets

  • Dataset: mteb-mtop_domain-avs_triplets
  • Size: 15,715 training samples
  • Columns: anchor, positive, and negative
  • Approximate statistics based on the first 1000 samples:
    anchorpositivenegative
    typestringstringstring
    detailsmin: 4 tokensmean: 10.27 tokensmax: 32 tokensmin: 4 tokensmean: 9.62 tokensmax: 24 tokensmin: 4 tokensmean: 10.01 tokensmax: 33 tokens
  • Samples:
  • Loss: MultipleNegativesRankingLoss with these parameters:
    {
        "scale": 20.0,
        "similarity_fct": "cos_sim"
    }
    

mteb-mtop_intent-avs_triplets

  • Dataset: mteb-mtop_intent-avs_triplets
  • Size: 15,715 training samples
  • Columns: anchor, positive, and negative
  • Approximate statistics based on the first 1000 samples:
    anchorpositivenegative
    typestringstringstring
    detailsmin: 3 tokensmean: 10.22 tokensmax: 35 tokensmin: 4 tokensmean: 9.74 tokensmax: 27 tokensmin: 3 tokensmean: 10.43 tokensmax: 28 tokens
  • Samples:
  • Loss: MultipleNegativesRankingLoss with these parameters:
    {
        "scale": 20.0,
        "similarity_fct": "cos_sim"
    }
    

mteb-toxic_conversations_50k-avs_triplets

  • Dataset: mteb-toxic_conversations_50k-avs_triplets
  • Size: 49,677 training samples
  • Columns: anchor, positive, and negative
  • Approximate statistics based on the first 1000 samples:
    anchorpositivenegative
    typestringstringstring
    detailsmin: 3 tokensmean: 67.17 tokensmax: 256 tokensmin: 3 tokensmean: 88.29 tokensmax: 256 tokensmin: 3 tokensmean: 64.96 tokensmax: 252 tokens
  • Samples:
  • Loss: MultipleNegativesRankingLoss with these parameters:
    {
        "scale": 20.0,
        "similarity_fct": "cos_sim"
    }
    

mteb-tweet_sentiment_extraction-avs_triplets

  • Dataset: mteb-tweet_sentiment_extraction-avs_triplets
  • Size: 27,373 training samples
  • Columns: anchor, positive, and negative
  • Approximate statistics based on the first 1000 samples:
    anchorpositivenegative
    typestringstringstring
    detailsmin: 3 tokensmean: 20.58 tokensmax: 45 tokensmin: 2 tokensmean: 20.26 tokensmax: 56 tokensmin: 3 tokensmean: 21.1 tokensmax: 59 tokens
  • Samples:
  • Loss: MultipleNegativesRankingLoss with these parameters:
    {
        "scale": 20.0,
        "similarity_fct": "cos_sim"
    }
    

covid-bing-query-gpt4-avs_triplets

  • Dataset: covid-bing-query-gpt4-avs_triplets
  • Size: 5,070 training samples
  • Columns: anchor, positive, and negative
  • Approximate statistics based on the first 1000 samples:
    anchorpositivenegative
    typestringstringstring
    detailsmin: 6 tokensmean: 15.28 tokensmax: 33 tokensmin: 14 tokensmean: 37.6 tokensmax: 92 tokensmin: 16 tokensmean: 38.13 tokensmax: 239 tokens
  • Samples:
  • Loss: MultipleNegativesRankingLoss with these parameters:
    {
        "scale": 20.0,
        "similarity_fct": "cos_sim"
    }
    

Evaluation Dataset

Unnamed Dataset

  • Size: 18,269 evaluation samples
  • Columns: anchor, positive, and negative
  • Approximate statistics based on the first 1000 samples:
    anchorpositivenegative
    typestringstringstring
    detailsmin: 4 tokensmean: 16.04 tokensmax: 55 tokensmin: 5 tokensmean: 142.75 tokensmax: 256 tokensmin: 5 tokensmean: 144.56 tokensmax: 256 tokens
  • Samples:
  • Loss: MultipleNegativesRankingLoss with these parameters:
    {
        "scale": 20.0,
        "similarity_fct": "cos_sim"
    }
    

Training Hyperparameters

Non-Default Hyperparameters

  • eval_strategy: steps
  • per_device_train_batch_size: 512
  • per_device_eval_batch_size: 512
  • learning_rate: 2e-05
  • num_train_epochs: 10
  • warmup_ratio: 0.1
  • fp16: True
  • gradient_checkpointing: True
  • batch_sampler: no_duplicates

All Hyperparameters

  • overwrite_output_dir: False
  • do_predict: False
  • eval_strategy: steps
  • prediction_loss_only: True
  • per_device_train_batch_size: 512
  • per_device_eval_batch_size: 512
  • per_gpu_train_batch_size: None
  • per_gpu_eval_batch_size: None
  • gradient_accumulation_steps: 1
  • eval_accumulation_steps: None
  • learning_rate: 2e-05
  • weight_decay: 0.0
  • adam_beta1: 0.9
  • adam_beta2: 0.999
  • adam_epsilon: 1e-08
  • max_grad_norm: 1.0
  • num_train_epochs: 10
  • max_steps: -1
  • lr_scheduler_type: linear
  • lr_scheduler_kwargs: {}
  • warmup_ratio: 0.1
  • warmup_steps: 0
  • log_level: passive
  • log_level_replica: warning
  • log_on_each_node: True
  • logging_nan_inf_filter: True
  • save_safetensors: True
  • save_on_each_node: False
  • save_only_model: False
  • restore_callback_states_from_checkpoint: False
  • no_cuda: False
  • use_cpu: False
  • use_mps_device: False
  • seed: 42
  • data_seed: None
  • jit_mode_eval: False
  • use_ipex: False
  • bf16: False
  • fp16: True
  • fp16_opt_level: O1
  • half_precision_backend: auto
  • bf16_full_eval: False
  • fp16_full_eval: False
  • tf32: None
  • local_rank: 0
  • ddp_backend: None
  • tpu_num_cores: None
  • tpu_metrics_debug: False
  • debug: []
  • dataloader_drop_last: False
  • dataloader_num_workers: 0
  • dataloader_prefetch_factor: None
  • past_index: -1
  • disable_tqdm: False
  • remove_unused_columns: True
  • label_names: None
  • load_best_model_at_end: False
  • ignore_data_skip: False
  • fsdp: []
  • fsdp_min_num_params: 0
  • fsdp_config: {'min_num_params': 0, 'xla': False, 'xla_fsdp_v2': False, 'xla_fsdp_grad_ckpt': False}
  • fsdp_transformer_layer_cls_to_wrap: None
  • accelerator_config: {'split_batches': False, 'dispatch_batches': None, 'even_batches': True, 'use_seedable_sampler': True, 'non_blocking': False, 'gradient_accumulation_kwargs': None}
  • deepspeed: None
  • label_smoothing_factor: 0.0
  • optim: adamw_torch
  • optim_args: None
  • adafactor: False
  • group_by_length: False
  • length_column_name: length
  • ddp_find_unused_parameters: None
  • ddp_bucket_cap_mb: None
  • ddp_broadcast_buffers: False
  • dataloader_pin_memory: True
  • dataloader_persistent_workers: False
  • skip_memory_metrics: True
  • use_legacy_prediction_loop: False
  • push_to_hub: False
  • resume_from_checkpoint: None
  • hub_model_id: None
  • hub_strategy: every_save
  • hub_private_repo: False
  • hub_always_push: False
  • gradient_checkpointing: True
  • gradient_checkpointing_kwargs: None
  • include_inputs_for_metrics: False
  • eval_do_concat_batches: True
  • fp16_backend: auto
  • push_to_hub_model_id: None
  • push_to_hub_organization: None
  • mp_parameters:
  • auto_find_batch_size: False
  • full_determinism: False
  • torchdynamo: None
  • ray_scope: last
  • ddp_timeout: 1800
  • torch_compile: False
  • torch_compile_backend: None
  • torch_compile_mode: None
  • dispatch_batches: None
  • split_batches: None
  • include_tokens_per_second: False
  • include_num_input_tokens_seen: False
  • neftune_noise_alpha: None
  • optim_target_modules: None
  • batch_eval_metrics: False
  • eval_on_start: False
  • batch_sampler: no_duplicates
  • multi_dataset_batch_sampler: proportional

Training Logs

EpochStepTraining Losslossmedi-mteb-dev_max_accuracy
00--0.8705
0.13085002.17441.57230.8786
0.261610001.92451.50450.8851
0.392515001.98331.47190.8882
0.523320001.74921.44340.8909
0.654125001.88151.42440.8935
0.784930001.79211.40640.8949
0.915835001.84951.38940.8956
1.046640001.74151.37440.8966
1.177445001.86631.36190.9005
1.308250001.70161.35200.8979
1.439055001.73081.34670.9007
1.569960001.69651.33460.9021
1.700765001.73551.32510.9018
1.831570001.67831.31560.9031
1.962375001.63811.31010.9047
2.093180001.71691.30560.9044
2.224085001.65271.30700.9039
2.354890001.70781.29770.9055
2.485695001.5331.29910.9050
2.6164100001.66761.29160.9057
2.7473105001.58661.28850.9053
2.8781110001.6411.27650.9066
3.0089115001.51931.28160.9062
3.1397120001.69071.28040.9065
3.2705125001.5571.26840.9065
3.4014130001.68081.27110.9075
3.5322135001.47511.27000.9072
3.6630140001.59341.26920.9081
3.7938145001.53951.26720.9087
3.9246150001.58091.26780.9072
4.0555155001.49721.26210.9089
4.1863160001.6141.26900.9070
4.3171165001.51861.26250.9091
4.4479170001.52391.26290.9079
4.5788175001.53541.25690.9086
4.7096180001.51341.25590.9095
4.8404185001.52371.24940.9100
4.9712190001.50381.24860.9113
5.1020195001.55271.24930.9098
5.2329200001.50181.25210.9102
5.3637205001.5841.24960.9095
5.4945210001.39481.24670.9102
5.6253215001.51181.24870.9098
5.7561220001.4581.24710.9098
5.8870225001.51581.23670.9105
6.0178230001.40911.24800.9096
6.1486235001.58231.24560.9114
6.2794240001.43831.24040.9101
6.4103245001.56061.24310.9100
6.5411250001.39061.23860.9112
6.6719255001.48871.23820.9103
6.8027260001.43471.23840.9112
6.9335265001.47331.23950.9113
7.0644270001.43231.23850.9111
7.1952275001.5051.24130.9107
7.3260280001.46481.23620.9114
7.4568285001.42521.23610.9116
7.5877290001.4581.23440.9118
7.7185295001.43091.23570.9120
7.8493300001.44311.23300.9114
7.9801305001.42661.23060.9127
8.1109310001.48031.23280.9118
8.2418315001.4141.23450.9110
8.3726320001.54561.23430.9116
8.5034325001.3461.23240.9118
8.6342330001.44671.23150.9118
8.7650335001.38641.23300.9119
8.8959340001.48061.22770.9119
9.0267345001.33811.23300.9119
9.1575350001.52771.23150.9121
9.2883355001.39661.23090.9112
9.4192360001.49211.23210.9117
9.5500365001.36681.23030.9118
9.6808370001.44071.23080.9121
9.8116375001.38521.23140.9118
9.9424380001.43291.23000.9120

Framework Versions

  • Python: 3.10.10
  • Sentence Transformers: 3.1.0.dev0
  • Transformers: 4.42.4
  • PyTorch: 2.3.1+cu121
  • Accelerate: 0.32.1
  • Datasets: 2.20.0
  • Tokenizers: 0.19.1

Citation

BibTeX

Sentence Transformers

@inproceedings{reimers-2019-sentence-bert,
    title = "Sentence-BERT: Sentence Embeddings using Siamese BERT-Networks",
    author = "Reimers, Nils and Gurevych, Iryna",
    booktitle = "Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing",
    month = "11",
    year = "2019",
    publisher = "Association for Computational Linguistics",
    url = "https://arxiv.org/abs/1908.10084",
}

MultipleNegativesRankingLoss

@misc{henderson2017efficient,
    title={Efficient Natural Language Response Suggestion for Smart Reply},
    author={Matthew Henderson and Rami Al-Rfou and Brian Strope and Yun-hsuan Sung and Laszlo Lukacs and Ruiqi Guo and Sanjiv Kumar and Balint Miklos and Ray Kurzweil},
    year={2017},
    eprint={1705.00652},
    archivePrefix={arXiv},
    primaryClass={cs.CL}
}

Как запустить

На своей GPU в ailist. Цена — по текущим предложениям провайдеров

GPU в ailist

Универсальный рантайм · sentence-transformers

Можно запустить

Подбираем GPU…

Класс архитектуры
BertModel
Ревизия весов
3963e9e

0 моделей