CrossEncoder based on microsoft/MiniLM-L12-H384-uncased

This is a Cross Encoder model finetuned from microsoft/MiniLM-L12-H384-uncased using the sentence-transformers library. It computes scores for pairs of texts, which can be used for text reranking and semantic search.

Model Details

Model Description

• Model Type: Cross Encoder
• Base model: microsoft/MiniLM-L12-H384-uncased
• Maximum Sequence Length: 512 tokens
• Number of Output Labels: 1 label
• Supported Modality: Text

Model Sources

• Documentation: Sentence Transformers Documentation
• Documentation: Cross Encoder Documentation
• Repository: Sentence Transformers on GitHub
• Hugging Face: Cross Encoders on Hugging Face

Full Model Architecture

CrossEncoder(
  (0): Transformer({'transformer_task': 'sequence-classification', 'modality_config': {'text': {'method': 'forward', 'method_output_name': 'logits'}}, 'module_output_name': 'scores', 'architecture': 'BertForSequenceClassification'})
)

Usage

Direct Usage (Sentence Transformers)

First install the Sentence Transformers library:

pip install -U sentence-transformers

Then you can load this model and run inference.

from sentence_transformers import CrossEncoder

# Download from the 🤗 Hub
model = CrossEncoder("kwondw/reranker-msmarco-v1.1-MiniLM-L12-H384-uncased-lambdaloss-hard-neg")
# Get scores for pairs of inputs
pairs = [
    ['what is the medicine called for tonsillitis', 'Tonsillitis is usually caused by a virus and does not require prescription medicine. For information on over-the-counter pain medicine and other self-care options, see Home Treatment. An antibiotic, usually amoxicillin or penicillin, is used to treat tonsillitis caused by strep bacteria. Although tonsillitis caused by strep bacteria usually will go away on its own, antibiotics are used to prevent the complications, such as rheumatic fever, that can result from untreated strep throat. '],
    ['what is the medicine called for tonsillitis', 'You have two tonsils, one on either side at the back of the mouth. The picture below shows large non-infected tonsils (no redness or pus). Tonsillitis is an infection of the tonsils. A sore throat is the most common of all tonsillitis symptoms. In addition, you may also have a cough, high temperature (fever), headache, feel sick, feel tired, find swallowing painful, and have swollen neck glands. '],
    ['what is the medicine called for tonsillitis', 'Tonsillitis (/ˌtɒnsɪˈlaɪtɪs/ TON-si-LEYE-tis) is inflammation of the tonsils most commonly caused by viral or bacterial infection. Symptoms may include sore throat and fever. When caused by a bacterium belonging to the group A streptococcus, it is typically referred to as strep throat. When tonsillitis is caused by a virus, the length of illness depends on which virus is involved. Usually, a complete recovery is made within one week; however, symptoms may last for up to two weeks. Chronic cases may be treated with tonsillectomy (surgical removal of tonsils) as a choice for treatment.'],
    ['what is the medicine called for tonsillitis', 'Tonsillitis is when your tonsils become inflamed, infected and swollen. Tonsils are glands that lie in two bands on either side of the back of your throat. They play an important part in helping to protect your body against infection. Tonsillitis is common in children but anyone can catch it no matter what their age. Regardless of whether tonsillitis is caused by a virus or by bacteria, the symptoms are very similar and include: 1  a sore throat; 2  fever; 3  difficulty swallowing; 4  headache;'],
    ['what is the medicine called for tonsillitis', 'At the back of your throat, two masses of tissue called tonsils help the body to fight infection. However, sometimes the tonsils themselves become infected. Overwhelmed by bacteria or viruses, they swell and become inflamed, a condition known as tonsillitis. Tonsillitis is common, especially in children. '],
]
scores = model.predict(pairs)
print(scores)
# [0.2856 0.1668 0.2954 0.2175 0.2316]

# Or rank different texts based on similarity to a single text
ranks = model.rank(
    'what is the medicine called for tonsillitis',
    [
        'Tonsillitis is usually caused by a virus and does not require prescription medicine. For information on over-the-counter pain medicine and other self-care options, see Home Treatment. An antibiotic, usually amoxicillin or penicillin, is used to treat tonsillitis caused by strep bacteria. Although tonsillitis caused by strep bacteria usually will go away on its own, antibiotics are used to prevent the complications, such as rheumatic fever, that can result from untreated strep throat. ',
        'You have two tonsils, one on either side at the back of the mouth. The picture below shows large non-infected tonsils (no redness or pus). Tonsillitis is an infection of the tonsils. A sore throat is the most common of all tonsillitis symptoms. In addition, you may also have a cough, high temperature (fever), headache, feel sick, feel tired, find swallowing painful, and have swollen neck glands. ',
        'Tonsillitis (/ˌtɒnsɪˈlaɪtɪs/ TON-si-LEYE-tis) is inflammation of the tonsils most commonly caused by viral or bacterial infection. Symptoms may include sore throat and fever. When caused by a bacterium belonging to the group A streptococcus, it is typically referred to as strep throat. When tonsillitis is caused by a virus, the length of illness depends on which virus is involved. Usually, a complete recovery is made within one week; however, symptoms may last for up to two weeks. Chronic cases may be treated with tonsillectomy (surgical removal of tonsils) as a choice for treatment.',
        'Tonsillitis is when your tonsils become inflamed, infected and swollen. Tonsils are glands that lie in two bands on either side of the back of your throat. They play an important part in helping to protect your body against infection. Tonsillitis is common in children but anyone can catch it no matter what their age. Regardless of whether tonsillitis is caused by a virus or by bacteria, the symptoms are very similar and include: 1  a sore throat; 2  fever; 3  difficulty swallowing; 4  headache;',
        'At the back of your throat, two masses of tissue called tonsils help the body to fight infection. However, sometimes the tonsils themselves become infected. Overwhelmed by bacteria or viruses, they swell and become inflamed, a condition known as tonsillitis. Tonsillitis is common, especially in children. ',
    ]
)
# [{'corpus_id': ..., 'score': ...}, {'corpus_id': ..., 'score': ...}, ...]

Evaluation

Metrics

Cross Encoder Reranking

• Datasets: NanoMSMARCO_R100, NanoNFCorpus_R100 and NanoNQ_R100
• Evaluated with CrossEncoderRerankingEvaluator with these parameters:

  {
      "at_k": 10,
      "always_rerank_positives": true
  }
  

Cross Encoder Nano BEIR

• Dataset: NanoBEIR_R100_mean
• Evaluated with CrossEncoderNanoBEIREvaluator with these parameters:

  {
      "dataset_names": [
          "msmarco",
          "nfcorpus",
          "nq"
      ],
      "dataset_id": "sentence-transformers/NanoBEIR-en",
      "rerank_k": 100,
      "at_k": 10,
      "always_rerank_positives": true
  }
  

Training Details

Training Dataset

Unnamed Dataset

• Size: 167,224 training samples
• Columns: query, docs, and labels
• Approximate statistics based on the first 1000 samples:

  	query	docs	labels
  type	string	list	list
  details	min: 4 tokensmean: 9.07 tokensmax: 20 tokens	min: 3 elementsmean: 6.50 elementsmax: 10 elements	min: 3 elementsmean: 6.50 elementsmax: 10 elements

• Samples:

  query	docs	labels
  where is narbonne gaul located	['Narbonne was established in Gaul in 118 BC, as Colonia Narbo Martius, colloquially Narbo. It was located on the Via Domitia, the first Roman road in Gaul, built at the time of the foundation of the colony, and connecting Italy to Spain. It was subsequently the capital of the Visigothic province of Septimania, the only territory from Gaul to fend off the Frankish thrust after the Battle of Vouille (507). For 40 years, from 719, Narbonne was part of the Emirate of Cordoba with a strong Gothic presence.', 'Among the amenities of Narbonne, its rosemary-flower honey was famous among Romans. Later, the province of Transalpine Gaul was renamed Gallia Narbonensis after the city, which became its capital. Seat of a powerful administration, the city enjoyed economic and architectural expansion. It was subsequently the capital of the Visigothic province of Septimania, the only territory from Gaul to fend off the Frankish thrust after the Battle of Vouille (507). For 40 years, from 719, Narbonne was part of the Emirate of Cordoba with a strong Gothic presence.', 'It was from the capital of Narbonne that Julius Caesar began his Gallic Wars. The area became a Roman province in 121 BCE, originally under the name of Gallia Transalpina (Transalpine Gaul). This name was chosen to distinguish it from Cisalpine Gaul, the part of Gaul on the near side of the Alps to Rome. Its boundaries were roughly defined by the Mediterranean Sea to the south and the C vennes and Alps and north and west. Names. The province of Gallia Transalpina (Transalpine Gaul) was later renamed Gallia Narbonensis, after its capital the Roman colony of Narbo Martius (Narbonne), founded on the coast in 118 BCE.', 'The city of Narbonne is a big french city located south of France. The city of Narbonne is located in the department of Aude of the french region Languedoc-Roussillon. The city of Narbonne is located in the district of Narbonne. The area code for Narbonne is 11262 (also known as code INSEE), and the Narbonne zip code is 11100. The altitude of the city hall of Narbonne is approximately 13 meters. The Narbonne surface is 172.96 km ²', 'The province of Gallia Transalpina (Transalpine Gaul) was later renamed Gallia Narbonensis, after its newly established capital of Colonia Narbo Martius (Narbonne), a Roman colony founded on the coast in 118 BC. The Romans had called it Provincia Nostra (our province) or simply Provincia (the province). The name distinguished it from Cisalpine Gaul on the near side of the Alps to Rome. In 40 BC, during the Second Triumvirate, Lepidus was given responsibility for Narbonese Gaul (along with Hispania and Africa), while Mark Antony was given the balance of Gaul.', ...]	[1, 0, 0, 0, 0, ...]
  what is an HMI	['HMI. HMI (Human Machine Interface) is a User Interface where interaction between a human and a manufacturing or process control system occurs. The HMI provides graphics-based visualization of a control system. The outcome of interaction with an HMI is effective operation and control of a process.', "HMI stands for H uman M achine I nterface. This is the interface between the operator and the controller. The HMI is the controller operating panel. The panel comprises a numeric keypad and a LCD screen that displays text. The keypad is used to input data into the application, such as Timer values. The PLC's Display screen can show operator messages, variable information from the program and system information. HMI messages are created in the Display Editor.", "HMI stands for H uman M achine I nterface. This is the interface between the operator and the controller. The HMI is the controller operating panel. The panel comprises a numeric keypad and a LCD screen that displays text. The keypad is used to input data into the application, such as Timer values. The PLC's Display screen can show operator messages, variable information from the program and system information. HMI messages are created in the Display Edito", "A Human-Machine Interface or HMI is the apparatus which presents process data to a human operator, and through which the human operator controls the process. An HMI is usually linked to the SCADA system's databases and software programs, to provide trending, diagnostic data, and management information such as scheduled maintenance procedures, logistic information, detailed schematics for a particular sensor or machine, and expert-system troubleshooting guides.", '» Sign-up for News. The Human Machine Interface (HMI) includes the electronics required to signal and control the state of industrial automation equipment. These interface products can range from a basic LED status indicator to a 20-inch TFT panel with touchscreen interface', ...]	[1, 0, 0, 0, 0, ...]
  does laila engaged to meera's brother	['Laila Got Engaged To Meera Brother Ahsan. admin April 9, 2015 Laila Got Engaged To Meera Brother Ahsan 2015-04-10T03:50:40+00:00 Latest Happning No Comment. After the late buildup on media about Laila discovering her life accomplice through a network show, Laila has at long last discovered her “To-Be” Ahson. Kaun Bane Ga Laila Ka Dulha was a quite discussed fragment where youthful men contended to be Laila’s husband to be on APlus Morning Show, facilitated by Noor', 'Kaun Bane Ga Laila Ka Dulha was a much talked about segment where young men competed to be Laila’s groom on APlus Morning Show, hosted by Noor. Ahson, surprisingly happens to be the brother of film actress Meera and it has been revealed by sources that Laila and Ahson have been in a relationship for some time.', 'As we all be acquainted with that Laila was in look for of her life colleague. The beat show Kaun Banega “ Laila Ka Dulha ” was aired on A plus. In this part, men from special places take part and compete every other to become Laila’s Dulha.', 'Pinterest0. As we all know that Laila was in search of her life partner. The hit show Kaun Banega Laila Ka Dulha was aired on Aplus. In this segment, men from different places took part and competed each other to become Laila’s groom. The show was hosted by Noor and Saim.After waiting for a long period, Ahsan was finally announced the groom of Laila. According to sources, Laila and Ahsan were in a relationship for a long time.', 'Mohsin Abbas got married. As we all know that Laila was in search of her life partner. The hit show Kaun Banega Laila Ka Dulha was aired on Aplus. In this segment, men from different places took part and competed each other to become Laila’s groom. The show was hosted by Noor and Saim.After waiting for a long period, Ahsan was finally announced the groom of Laila. According to sources, Laila and Ahsan were in a relationship for a long time.', ...]	[1, 0, 0, 0, 0, ...]

• Loss: LambdaLoss with these parameters:

  {
      "weighting_scheme": "sentence_transformers.cross_encoder.losses.lambda_loss.NDCGLoss2PPScheme",
      "k": null,
      "sigma": 1.0,
      "eps": 1e-10,
      "reduction_log": "binary",
      "activation_fn": "torch.nn.modules.linear.Identity",
      "mini_batch_size": 16
  }
  

Evaluation Dataset

Unnamed Dataset

• Size: 1,000 evaluation samples
• Columns: query, docs, and labels
• Approximate statistics based on the first 1000 samples:

  	query	docs	labels
  type	string	list	list
  details	min: 4 tokensmean: 9.2 tokensmax: 22 tokens	min: 3 elementsmean: 6.50 elementsmax: 10 elements	min: 3 elementsmean: 6.50 elementsmax: 10 elements

• Samples:

  query	docs	labels
  what is the medicine called for tonsillitis	['Tonsillitis is usually caused by a virus and does not require prescription medicine. For information on over-the-counter pain medicine and other self-care options, see Home Treatment. An antibiotic, usually amoxicillin or penicillin, is used to treat tonsillitis caused by strep bacteria. Although tonsillitis caused by strep bacteria usually will go away on its own, antibiotics are used to prevent the complications, such as rheumatic fever, that can result from untreated strep throat. ', 'You have two tonsils, one on either side at the back of the mouth. The picture below shows large non-infected tonsils (no redness or pus). Tonsillitis is an infection of the tonsils. A sore throat is the most common of all tonsillitis symptoms. In addition, you may also have a cough, high temperature (fever), headache, feel sick, feel tired, find swallowing painful, and have swollen neck glands. ', 'Tonsillitis (/ˌtɒnsɪˈlaɪtɪs/ TON-si-LEYE-tis) is inflammation of the tonsils most commonly caused by viral or bacterial infection. Symptoms may include sore throat and fever. When caused by a bacterium belonging to the group A streptococcus, it is typically referred to as strep throat. When tonsillitis is caused by a virus, the length of illness depends on which virus is involved. Usually, a complete recovery is made within one week; however, symptoms may last for up to two weeks. Chronic cases may be treated with tonsillectomy (surgical removal of tonsils) as a choice for treatment.', 'Tonsillitis is when your tonsils become inflamed, infected and swollen. Tonsils are glands that lie in two bands on either side of the back of your throat. They play an important part in helping to protect your body against infection. Tonsillitis is common in children but anyone can catch it no matter what their age. Regardless of whether tonsillitis is caused by a virus or by bacteria, the symptoms are very similar and include: 1 a sore throat; 2 fever; 3 difficulty swallowing; 4 headache;', 'At the back of your throat, two masses of tissue called tonsils help the body to fight infection. However, sometimes the tonsils themselves become infected. Overwhelmed by bacteria or viruses, they swell and become inflamed, a condition known as tonsillitis. Tonsillitis is common, especially in children. ', ...]	[1, 0, 0, 0, 0, ...]
  what properties distinguish pyrite from gold?	['To tell the difference between pyrite and real gold, you can check the color and shape of the ore. Gold and pyrite have a yellowish color but pyrite has a pale and brassy … color compared to gold. Pyrites are shaped more like crystals while gold tends to form as a nugget. Another difference between the two is that gold can be scratched with a pocketknife while pyrite cannot be scratched.', 'Pyrite is harder than gold. While Pyrite’s hardness is 6 to 6.5, gold has hardness around 2 to 3. Pyrite also contains high amount of iron. There is also a big difference in the specific gravity between gold and pyrite. While gold has a specific gravity of 15.6/19.3, pyrite has 5.0. Gold vs Pyrite. It is easy to make out the difference between Gold and pyrite. They have much difference in their structure, colour, hardness and specific gravity. When comparing gold and pyrite with regard to their colour, both have a metallic lustre but have different yellow tones.', "Pyrite is usually found associated with other sulfides or oxides in quartz veins, sedimentary rock, and metamorphic rock, as well as in coal beds and as a replacement mineral in fossils. Despite being nicknamed fool's gold, pyrite is sometimes found in association with small quantities of gold. Gold and arsenic occur as a coupled substitution in the pyrite structure. In the Carlin–type gold deposits, arsenian pyrite contains up to 0.37 wt% gold.", 'Pyrite and chalcopyrite can be notoriously hard to distinguish between. There are several mineral properties that can be used to tell the difference, however. First, chalcopyr … ite is slightly softer than pyrite (Chalcopyrite has a hardness of 4.0 on the Mohs hardness scale, whereas pyrite has a hardness of 6.0.-6.5). Gold and pyrite have a yellowish color but pyrite has a pale and brassy … color compared to gold. Pyrites are shaped more like crystals while gold tends to form as a nugget. Another difference between the two is that gold can be scratched with a pocketknife while pyrite cannot be scratched.', 'Pyrite and chalcopyrite can be notoriously hard to distinguish between. There are several mineral properties that can be used to tell the difference, however. First, chalcopyr … ite is slightly softer than pyrite (Chalcopyrite has a hardness of 4.0 on the Mohs hardness scale, whereas pyrite has a hardness of 6.0.-6.5). To tell the difference between pyrite and real gold, you can check the color and shape of the ore. Gold and pyrite have a yellowish color but pyrite has a pale and brassy … color compared to gold.', ...]	[1, 1, 0, 0, 0, ...]
  how long does a turkey live in captivity	['The maximum recorded lifespan for a turkey in captivity is twelve years and four months. For turkeys living in the wild, the maximum is less than ten years, but the average life expectancy of a male turkey is just over 2 years and just over 3 years for females. If you have turkeys that can fly, their enclosed cage should have chicken wire surrounding it on all sides and top with a wood frame with a stiff metal dog wire of about 3-4 feet tall along the bottom to keep out other animals and to keep the turkeys in.', 'HowStuffWorks Turkey . The wild turkey has the potential to live as long as thirteen years or so, They can (and do) run fast with their long legs, and will take wing and fly. wild turkey. The maximum recorded lifespan for a turkey in captivity is twelve years and four months.	ChaCha Answers. Male wild Turkeys grow to about four feet long, including the tail. If you own wild turkeys and do not wish for them to fly away, their wings need Domestic turkeys bred for food consumption were not bred to live over one year.', 'If turkeys survive the first two weeks of its life, then it is expected to live 1-3 years. There have been trukeys that live 10 years or longer. Most domestic turkeys live 26 weeks (thanksgiving turkeys) :) Hope this helps. ', 'The average life expectancy of a poult is about 1 ½ years. Turkeys that survive their first year, though, have little to fear from any predator (except humans) and can live up to 15 years in their natural habitats. In the fall, young gobblers will leave the hen flocks and form or join gobbler flocks. ', "0. Turkeys are rather moderately-lived birds compared to long-lived species such as some hawks, gulls, and waterfowl. Overall, the mortality rate of turkeys during the first 2 weeks of life is about 70%, though longevity increases after this critical time period. The average turkey probably lives to about 11/2 years of age. Individuals may live longer, but any turkey over 6 years old is definitely an old-timer. Based on a banded bird, the oldest known eastern turkey (coincidentally from Massachusetts) was at least 15 years old at death. Rio Grande turkeys have lived to 14, Florida turkeys to 13, and Merriam's turkeys to 91/2 years of age.", ...]

• Loss: LambdaLoss with these parameters:

  {
      "weighting_scheme": "sentence_transformers.cross_encoder.losses.lambda_loss.NDCGLoss2PPScheme",
      "k": null,
      "sigma": 1.0,
      "eps": 1e-10,
      "reduction_log": "binary",
      "activation_fn": "torch.nn.modules.linear.Identity",
      "mini_batch_size": 16
  }
  

Training Hyperparameters

Non-Default Hyperparameters

• per_device_train_batch_size: 16
• per_device_eval_batch_size: 16
• learning_rate: 2e-05
• num_train_epochs: 1
• warmup_steps: 0.1
• seed: 12
• fp16: True
• load_best_model_at_end: True

All Hyperparameters

• do_predict: False
• prediction_loss_only: True
• per_device_train_batch_size: 16
• per_device_eval_batch_size: 16
• gradient_accumulation_steps: 1
• eval_accumulation_steps: None
• torch_empty_cache_steps: None
• learning_rate: 2e-05
• weight_decay: 0.0
• adam_beta1: 0.9
• adam_beta2: 0.999
• adam_epsilon: 1e-08
• max_grad_norm: 1.0
• num_train_epochs: 1
• max_steps: -1
• lr_scheduler_type: linear
• lr_scheduler_kwargs: None
• warmup_ratio: None
• warmup_steps: 0.1
• log_level: passive
• log_level_replica: warning
• log_on_each_node: True
• logging_nan_inf_filter: True
• enable_jit_checkpoint: False
• save_on_each_node: False
• save_only_model: False
• restore_callback_states_from_checkpoint: False
• use_cpu: False
• seed: 12
• data_seed: None
• bf16: False
• fp16: True
• bf16_full_eval: False
• fp16_full_eval: False
• tf32: None
• local_rank: -1
• ddp_backend: None
• debug: []
• dataloader_drop_last: False
• dataloader_num_workers: 0
• dataloader_prefetch_factor: None
• disable_tqdm: False
• remove_unused_columns: True
• label_names: None
• load_best_model_at_end: True
• ignore_data_skip: False
• fsdp: []
• fsdp_config: {'min_num_params': 0, 'xla': False, 'xla_fsdp_v2': False, 'xla_fsdp_grad_ckpt': False}
• accelerator_config: {'split_batches': False, 'dispatch_batches': None, 'even_batches': True, 'use_seedable_sampler': True, 'non_blocking': False, 'gradient_accumulation_kwargs': None}
• parallelism_config: None
• deepspeed: None
• label_smoothing_factor: 0.0
• optim: adamw_torch_fused
• optim_args: None
• group_by_length: False
• length_column_name: length
• project: huggingface
• trackio_space_id: trackio
• ddp_find_unused_parameters: None
• ddp_bucket_cap_mb: None
• ddp_broadcast_buffers: False
• dataloader_pin_memory: True
• dataloader_persistent_workers: False
• skip_memory_metrics: True
• push_to_hub: False
• resume_from_checkpoint: None
• hub_model_id: None
• hub_strategy: every_save
• hub_private_repo: None
• hub_always_push: False
• hub_revision: None
• gradient_checkpointing: False
• gradient_checkpointing_kwargs: None
• include_for_metrics: []
• eval_do_concat_batches: True
• auto_find_batch_size: False
• full_determinism: False
• ddp_timeout: 1800
• torch_compile: False
• torch_compile_backend: None
• torch_compile_mode: None
• include_num_input_tokens_seen: no
• neftune_noise_alpha: None
• optim_target_modules: None
• batch_eval_metrics: False
• eval_on_start: False
• use_liger_kernel: False
• liger_kernel_config: None
• eval_use_gather_object: False
• average_tokens_across_devices: True
• use_cache: False
• prompts: None
• batch_sampler: batch_sampler
• multi_dataset_batch_sampler: proportional
• router_mapping: {}
• learning_rate_mapping: {}

Training Logs

• The bold row denotes the saved checkpoint.

Training Time

• Training: 1.5 hours
• Evaluation: 6.0 minutes
• Total: 1.6 hours

Framework Versions

• Python: 3.12.13
• Sentence Transformers: 5.4.1
• Transformers: 5.0.0
• PyTorch: 2.10.0+cu128
• Accelerate: 1.13.0
• Datasets: 5.0.0
• Tokenizers: 0.22.2

Citation

BibTeX

Sentence Transformers

@inproceedings{reimers-2019-sentence-bert,
    title = "Sentence-BERT: Sentence Embeddings using Siamese BERT-Networks",
    author = "Reimers, Nils and Gurevych, Iryna",
    booktitle = "Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing",
    month = "11",
    year = "2019",
    publisher = "Association for Computational Linguistics",
    url = "https://arxiv.org/abs/1908.10084",
}

LambdaLoss

@inproceedings{wang2018lambdaloss,
  title={The LambdaLoss Framework for Ranking Metric Optimization},
  author={Wang, Xuanhui and Li, Cheng and Golbandi, Nadav and Bendersky, Michael and Najork, Marc},
  booktitle={Proceedings of the 27th ACM international conference on information and knowledge management},
  pages={1313--1322},
  year={2018}
}