SentenceTransformer based on BAAI/bge-m3

This is a sentence-transformers model finetuned from BAAI/bge-m3. It maps sentences & paragraphs to a 1024-dimensional dense vector space and can be used for retrieval.

Model Details

Model Description

• Model Type: Sentence Transformer
• Base model: BAAI/bge-m3
• Maximum Sequence Length: 512 tokens
• Output Dimensionality: 1024 dimensions
• Similarity Function: Cosine Similarity
• Supported Modality: Text

Model Sources

• Documentation: Sentence Transformers Documentation
• Repository: Sentence Transformers on GitHub
• Hugging Face: Sentence Transformers on Hugging Face

Full Model Architecture

SentenceTransformer(
  (0): Transformer({'transformer_task': 'feature-extraction', 'modality_config': {'text': {'method': 'forward', 'method_output_name': 'last_hidden_state'}}, 'module_output_name': 'token_embeddings', 'architecture': 'XLMRobertaModel'})
  (1): Pooling({'embedding_dimension': 1024, 'pooling_mode': 'cls', 'include_prompt': True})
  (2): Normalize({})
)

Usage

Direct Usage (Sentence Transformers)

First install the Sentence Transformers library:

pip install -U sentence-transformers

Then you can load this model and run inference.

from sentence_transformers import SentenceTransformer

# Download from the 🤗 Hub
model = SentenceTransformer("sentence_transformers_model_id")
# Run inference
sentences = [
    'How can I rewrite text so it hides where the writer is from?',
    'Mitigating Bias in Text Classification via Prompt-Based Text Transformation\nThe presence of specific linguistic signals particular to a certain sub-group can become highly salient to language models during training. In automated decision-making settings, this may lead to biased outcomes when models rely on cues that correlate with protected characteristics. We investigate whether prompting ChatGPT to rewrite text using simplification, neutralisation, localisation, and formalisation can reduce demographic signals while preserving meaning. Experimental results show a statistically significant drop in location classification accuracy across multiple models after transformation, suggesting reduced reliance on group-specific language. At the same time, sentiment analysis and rating prediction tasks confirm that the core meaning of the reviews remains greatly intact. These results suggest that prompt-based rewriting offers a practical and generalisable approach for mitigating bias in text classification.',
    'Beyond Outlining: Heterogeneous Recursive Planning for Adaptive Long-form Writing with Language Models\nLong-form writing agents require flexible integration and interaction across information retrieval, reasoning, and composition. Current approaches rely on predefined workflows and rigid thinking patterns to generate outlines before writing, resulting in constrained adaptability during writing. In this paper we propose WriteHERE, a general agent framework that achieves human-like adaptive writing through recursive task decomposition and dynamic integration of three fundamental task types: retrieval, reasoning, and composition. Our methodology features: 1) a planning mechanism that interleaves recursive task decomposition and execution, eliminating artificial restrictions on writing workflow; and 2) integration of task types that facilitates heterogeneous task decomposition. Evaluations on both fiction writing and technical report generation show that our method consistently outperforms state-of-the-art approaches across all automatic evaluation metrics, demonstrating the effectiveness and broad applicability of our proposed framework. We have publicly released our code and prompts to facilitate further research.',
]
embeddings = model.encode(sentences)
print(embeddings.shape)
# [3, 1024]

# Get the similarity scores for the embeddings
similarities = model.similarity(embeddings, embeddings)
print(similarities)
# tensor([[1.0000, 0.3995, 0.1831],
#         [0.3995, 1.0000, 0.1697],
#         [0.1831, 0.1697, 1.0000]])

Training Details

Training Dataset

Unnamed Dataset

• Size: 33,000 training samples
• Columns: anchor, positive, negative_1, negative_2, negative_3, negative_4, negative_5, and negative_6
• Approximate statistics based on the first 100 samples:

  	anchor	positive	negative_1	negative_2	negative_3	negative_4	negative_5	negative_6
  type	string	string	string	string	string	string	string	string
  modality	text	text	text	text	text	text	text	text
  details	min: 9 tokensmean: 18.34 tokensmax: 28 tokens	min: 187 tokensmean: 323.69 tokensmax: 477 tokens	min: 165 tokensmean: 291.34 tokensmax: 474 tokens	min: 123 tokensmean: 284.37 tokensmax: 483 tokens	min: 109 tokensmean: 290.24 tokensmax: 490 tokens	min: 122 tokensmean: 304.28 tokensmax: 512 tokens	min: 115 tokensmean: 297.33 tokensmax: 461 tokens	min: 165 tokensmean: 314.77 tokensmax: 478 tokens

• Samples:

  anchor	positive	negative_1	negative_2	negative_3	negative_4	negative_5	negative_6
  연속으로 바뀌는 데이터에서 개인 정보 지키면서 모델 업데이트 잘 하는 방법 없을까?	Differentially Private Online Federated Learning with Correlated NoiseWe introduce a novel differentially private algorithm for online federatedlearning that employs temporally correlated noise to enhance utility whileensuring privacy of continuously released models. To address challenges posedby DP noise and local updates with streaming non-iid data, we develop aperturbed iterate analysis to control the impact of the DP noise on theutility. Moreover, we demonstrate how the drift errors from local updates canbe effectively managed under a quasi-strong convexity condition. Subject to an$(\epsilon, \delta)$-DP budget, we establish a dynamic regret bound over theentire time horizon, quantifying the impact of key parameters and the intensityof changes in dynamic environments. Numerical experiments confirm the efficacyof the proposed algorithm.	Consistent Updates for Scalable MicroservicesOnline services are commonly implemented with a scalable microservice architecture, where isomorphic workers process client requests, recording persistent state in a backend data store. To maintain service, modifications to service functionality must be made on the fly -- i.e., as the service continues to process client requests -- but doing so is challenging. The central difficulty is that of avoiding inconsistencies from mixed-mode operation, caused by workers of current and new versions interacting via the data store. Some update methods avoid mixed-mode altogether, but only at the cost of substantial inefficiency -- by doubling resources (memory and compute), or by halving throughput. The alternative is an uncontrolled ``rolling'' update, which runs the risk of serious service failures arising from inconsistent mixed-mode behavior. Ideally, it should appear to every client that a service update takes effect atomically; this ensures th...	Consistent community detection in multi-layer networks with heterogeneous differential privacyAs network data has become increasingly prevalent, a substantial amount ofattention has been paid to the privacy issue in publishing network data. One ofthe critical challenges for data publishers is to preserve the topologicalstructures of the original network while protecting sensitive information. Inthis paper, we propose a personalized edge flipping mechanism that allows datapublishers to protect edge information based on each node's privacy preference.It can achieve differential privacy while preserving the community structureunder the multi-layer degree-corrected stochastic block model afterappropriately debiasing, and thus consistent community detection in theprivatized multi-layer networks is achievable. Theoretically, we establish theconsistency of community detection in the privatized multi-layer network andshow that better privacy protection of edges can be obtained fo...	Improved Generalization Guarantees in Restricted Data ModelsDifferential privacy is known to protect against threats to validity incurreddue to adaptive, or exploratory, data analysis -- even when the analystadversarially searches for a statistical estimate that diverges from the truevalue of the quantity of interest on the underlying population. The cost ofthis protection is the accuracy loss incurred by differential privacy. In thiswork, inspired by standard models in the genomics literature, we consider datamodels in which individuals are represented by a sequence of attributes withthe property that where distant attributes are only weakly correlated. We showthat, under this assumption, it is possible to "re-use" privacy budget ondifferent portions of the data, significantly improving accuracy withoutincreasing the risk of overfitting.	Protecting Time Series Data with Minimal Forecast LossForecasting could be negatively impacted due to anonymization requirements indata protection legislation. To measure the potential severity of this problem,we derive theoretical bounds for the loss to forecasts from additiveexponential smoothing models using protected data. Following the guidelines ofanonymization from the General Data Protection Regulation (GDPR) and CaliforniaConsumer Privacy Act (CCPA), we develop the $k$-nearest Time Series ($k$-nTS)Swapping and $k$-means Time Series ($k$-mTS) Shuffling methods to createprotected time series data that minimizes the loss to forecasts whilepreventing a data intruder from detecting privacy issues. For efficient andeffective decision making, we formally model an integer programming problem fora perfect matching for simultaneous data swapping in each cluster. We call it atwo-party data privacy framework since our optimization model includes theutilities of a data provide...	Privacy and Accuracy-Aware AI/ML Model DeduplicationWith the growing adoption of privacy-preserving machine learning algorithms,such as Differentially Private Stochastic Gradient Descent (DP-SGD), trainingor fine-tuning models on private datasets has become increasingly prevalent.This shift has led to the need for models offering varying privacy guaranteesand utility levels to satisfy diverse user requirements. However, managingnumerous versions of large models introduces significant operationalchallenges, including increased inference latency, higher resource consumption,and elevated costs. Model deduplication is a technique widely used by manymodel serving and database systems to support high-performance and low-costinference queries and model diagnosis queries. However, none of the existingmodel deduplication works has considered privacy, leading to unboundedaggregation of privacy costs for certain deduplicated models and inefficiencieswhen applied to deduplicate DP-tra...	Dynamically Adjusting Case Reporting Policy to Maximize Privacy and Utility in the Face of a PandemicSupporting public health research and the public's situational awarenessduring a pandemic requires continuous dissemination of infectious diseasesurveillance data. Legislation, such as the Health Insurance Portability andAccountability Act of 1996 (HIPAA) and recent state-level regulations, permitssharing de-identified person-level data; however, current de-identificationapproaches are limited. namely, they are inefficient, relying on retrospectivedisclosure risk assessments, and do not flex with changes in infection rates orpopulation demographics over time. In this paper, we introduce a framework todynamically adapt de-identification for near-real time sharing of person-levelsurveillance data. The framework leverages a simulation mechanism, capable ofapplication at any geographic level, to forecast the re-identification risk ofsharing the data under a wide range of gener...
  How can I keep user data private while updating models on constantly changing data streams?	Differentially Private Online Federated Learning with Correlated NoiseWe introduce a novel differentially private algorithm for online federatedlearning that employs temporally correlated noise to enhance utility whileensuring privacy of continuously released models. To address challenges posedby DP noise and local updates with streaming non-iid data, we develop aperturbed iterate analysis to control the impact of the DP noise on theutility. Moreover, we demonstrate how the drift errors from local updates canbe effectively managed under a quasi-strong convexity condition. Subject to an$(\epsilon, \delta)$-DP budget, we establish a dynamic regret bound over theentire time horizon, quantifying the impact of key parameters and the intensityof changes in dynamic environments. Numerical experiments confirm the efficacyof the proposed algorithm.	Differentially Private Runtime MonitoringModern stream-based monitors collect detailed statistics of the runtime behavior of the system under observation. If the system runs in a privacy-sensitive context, this poses the risk of disclosing sensitive information. Differential privacy is the state-of-the-art approach for protecting sensitive information, however, integrating it into runtime monitoring is challenging: temporal operators can cause individual input values to influence multiple outputs over time, leading to repeated disclosure of private information. We propose an approach that automatically enforces differential privacy in stream-based monitoring specifications by analyzing temporal dependencies and injecting carefully calibrated noise into the specification. To preserve the utility of the outputs, we identify strategically chosen positions in the specification for noise injection and leverage tree-based mechanisms to mitigate the accuracy loss caused by noise injected int...	Continuous Evolution Pool: Taming Recurring Concept Drift in Online Time Series ForecastingRecurring concept drift poses a dual challenge in online time series forecasting: mitigating catastrophic forgetting while adhering to strict privacy constraints that prevent retaining historical data. Existing approaches predominantly rely on parameter updates or experience replay, which inevitably suffer from knowledge overwriting or privacy risks. To address this, we propose the Continuous Evolution Pool (CEP), a privacy-preserving framework that maintains a dynamic pool of specialized forecasters. Instead of storing raw samples, CEP utilizes lightweight statistical genes to decouple concept identification from forecasting. Specifically, it employs a Retrieval mechanism to identify the nearest concept based on gene similarity, an Evolution strategy to spawn new forecasters upon detecting distribution shifts, and an Elimination policy to prune obsolete models under memory constraints. Experime...	Privacy-Preserving Nonlinear Observer Design Using Contraction AnalysisReal-time information processing applications such as those enabling a more intelligent infrastructure are increasingly focused on analyzing privacy-sensitive data obtained from individuals. To produce accurate statistics about the habits of a population of users of a system, this data might need to be processed through model-based estimators. Moreover, models of population dynamics, originating for example from epidemiology or the social sciences, are often necessarily nonlinear. Motivated by these trends, this paper presents an approach to design nonlinear privacy-preserving model-based observers, relying on additive input or output noise to give differential privacy guarantees to the individuals providing the input data. For the case of output perturbation, contraction analysis allows us to design convergent observers as well as set the level of privacy-preserving noise appropriately. Two examples illustrate the...	A Privacy-Preserving Outsourced Data Model in Cloud EnvironmentNowadays, more and more machine learning applications, such as medicaldiagnosis, online fraud detection, email spam filtering, etc., services areprovided by cloud computing. The cloud service provider collects the data fromthe various owners to train or classify the machine learning system in thecloud environment. However, multiple data owners may not entirely rely on thecloud platform that a third party engages. Therefore, data security and privacyproblems are among the critical hindrances to using machine learning tools,particularly with multiple data owners. In addition, unauthorized entities candetect the statistical input data and infer the machine learning modelparameters. Therefore, a privacy-preserving model is proposed, which protectsthe privacy of the data without compromising machine learning efficiency. Inorder to protect the data of data owners, the epsilon-differential privacy isused, and fog node...	Realistic Differentially-Private Transmission Power Flow Data ReleaseFor the modeling, design and planning of future energy transmission networks,it is vital for stakeholders to access faithful and useful power flow data,while provably maintaining the privacy of business confidentiality of serviceproviders. This critical challenge has recently been somewhat addressed in [1].This paper significantly extends this existing work. First, we reduce thepotential leakage information by proposing a fundamentally differentpost-processing method, using public information of grid losses rather thanpower dispatch, which achieve a higher level of privacy protection. Second, weprotect more sensitive parameters, i.e., branch shunt susceptance in additionto series impedance (complete pi-model). This protects power flow data for thetransmission high-voltage networks, using differentially privatetransformations that maintain the optimal power flow consistent with, andfaithful to, expected mo...	Privacy-Preserving Hierarchical Model-Distributed InferenceThis paper focuses on designing a privacy-preserving Machine Learning (ML)inference protocol for a hierarchical setup, where clients own/generate data,model owners (cloud servers) have a pre-trained ML model, and edge serversperform ML inference on clients' data using the cloud server's ML model. Ourgoal is to speed up ML inference while providing privacy to both data and theML model. Our approach (i) uses model-distributed inference (modelparallelization) at the edge servers and (ii) reduces the amount ofcommunication to/from the cloud server. Our privacy-preserving hierarchicalmodel-distributed inference, privateMDI design uses additive secret sharing andlinearly homomorphic encryption to handle linear calculations in the MLinference, and garbled circuit and a novel three-party oblivious transfer areused to handle non-linear functions. privateMDI consists of offline and onlinephases. We designed these phases in a...
  계속 바뀌는 데이터로 휴대폰들끼리 모델을 만들면서 개인정보를 안전하게 지키는 방법?	Differentially Private Online Federated Learning with Correlated NoiseWe introduce a novel differentially private algorithm for online federatedlearning that employs temporally correlated noise to enhance utility whileensuring privacy of continuously released models. To address challenges posedby DP noise and local updates with streaming non-iid data, we develop aperturbed iterate analysis to control the impact of the DP noise on theutility. Moreover, we demonstrate how the drift errors from local updates canbe effectively managed under a quasi-strong convexity condition. Subject to an$(\epsilon, \delta)$-DP budget, we establish a dynamic regret bound over theentire time horizon, quantifying the impact of key parameters and the intensityof changes in dynamic environments. Numerical experiments confirm the efficacyof the proposed algorithm.	Version Age of Information with Contact Mobility in Gossip NetworksA gossip network is considered in which a source node updates its status while other nodes in the network aim at keeping track of it as it varies over time. Information gets disseminated by the source sending status updates to the nodes, and the nodes gossiping with each other. In addition, the nodes in the network are mobile, and can move to other nodes to get information, which we term contact mobility. The goal for the nodes is to remain as fresh as possible, i.e., to have the same information as the source's. To evaluate the freshness of information, we use the Version Age-of-Information (VAoI) metric, defined as the difference between the version of information available at a given node and that at the source. We analyze the effect of contact mobility on information dissemination in the gossip network using a Stochastic Hybrid System (SHS) framework for different topologies and mobility scalings with increasing nu...	One Password: An Encryption Scheme for Hiding Users' Register InformationIn recent years, the attack which leverages register information (e.g.accounts and passwords) leaked from 3rd party applications to try otherapplications is popular and serious. We call this attack "database collision".Traditionally, people have to keep dozens of accounts and passwords fordifferent applications to prevent this attack. In this paper, we propose anovel encryption scheme for hiding users' register information and preventingthis attack. Specifically, we first hash the register information usingexisting safe hash function. Then the hash string is hidden, instead acoefficient vector is stored for verification. Coefficient vectors of the sameregister information are generated randomly for different applications. Hence,the original information is hardly cracked by dictionary based attack ordatabase collision in practice. Using our encryption scheme, each user onlyneeds to keep one password ...	Secure Data Hiding for Contact TracingContact tracing is an effective tool in controlling the spread of infectiousdiseases such as COVID-19. It involves digital monitoring and recording ofphysical proximity between people over time with a central and trustedauthority, so that when one user reports infection, it is possible to identifyall other users who have been in close proximity to that person during arelevant time period in the past and alert them. One way to achieve thisinvolves recording on the server the locations, e.g. by reading and reportingthe GPS coordinates of a smartphone, of all users over time. Despite itssimplicity, privacy concerns have prevented widespread adoption of this method.Technology that would enable the "hiding" of data could go a long way towardsalleviating privacy concerns and enable contact tracing at a very large scale.In this article we describe a general method to hide data. By hiding, we meanthat instead of disclosing a data value x, we w...	Software implementation of the SNOW 3G Generator on iOS and Android platformsThe standard for wireless communication of high-speed data in mobile phonesand data terminals, called LTE (Long-Term Evolution) and marketed as 4G/LTE, isquickly being adopted worldwide. The security of this type of communication isa crucial factor mainly due to its mobile and wireless nature. This workincludes a practical analysis of the SNOW 3G generator used to protect theconfidentiality and integrity in LTE communications. In particular, severaltechniques to perform multiplications and LFSR operations have been studied andimplemented on both iOS and Android platforms. The evaluation of thoseimplementations led to some conclusions that could be used to improve theefficiency of future implementations of the standard.	The Android Platform Security Model (2023)Android is the most widely deployed end-user focused operating system. Withits growing set of use cases encompassing communication, navigation, mediaconsumption, entertainment, finance, health, and access to sensors, actuators,cameras, or microphones, its underlying security model needs to address a hostof practical threats in a wide variety of scenarios while being useful tonon-security experts. To support this flexibility, Android's security modelmust strike a difficult balance between security, privacy, and usability forend users; provide assurances for app developers; and maintain systemperformance under tight hardware constraints. This paper aims to both documentthe assumed threat model and discuss its implications, with a focus on theecosystem context in which Android exists. We analyze how different securitymeasures in past and current Android implementations work together to mitigatethese threats, and, where there are speci...	Quotation-Based Data Retention Mechanism for Data Privacy in LLM-Empowered Network ServicesThe deployment of large language models (LLMs) for next-generation network optimization introduces novel data governance challenges. mobile network operators (MNOs) increasingly leverage generative artificial intelligence (AI) for traffic prediction, anomaly detection, and service personalization, requiring access to users' sensitive network usage data-including mobility patterns, traffic types, and location histories. Under the General Data Protection Regulation (GDPR), the California Consumer Privacy Act (CCPA), and similar regulations, users retain the right to withdraw consent and demand data deletion. However, extensive machine unlearning degrades model accuracy and incurs substantial computational costs, ultimately harming network performance for all users. We propose an iterative price discovery mechanism enabling MNOs to compensate users for data retention through sequential price quotat...

• Loss: MultipleNegativesRankingLoss with these parameters:

  {
      "scale": 20.0,
      "similarity_fct": "cos_sim",
      "gather_across_devices": false,
      "directions": [
          "query_to_doc"
      ],
      "partition_mode": "joint",
      "hardness_mode": null,
      "hardness_strength": 0.0
  }
  

Training Hyperparameters

Non-Default Hyperparameters

• num_train_epochs: 1.0
• learning_rate: 0.0001
• warmup_steps: 0.1
• bf16: True
• gradient_checkpointing: True

All Hyperparameters

• per_device_train_batch_size: 8
• num_train_epochs: 1.0
• max_steps: -1
• learning_rate: 0.0001
• lr_scheduler_type: linear
• lr_scheduler_kwargs: None
• warmup_steps: 0.1
• optim: adamw_torch_fused
• optim_args: None
• weight_decay: 0.0
• adam_beta1: 0.9
• adam_beta2: 0.999
• adam_epsilon: 1e-08
• optim_target_modules: None
• gradient_accumulation_steps: 1
• average_tokens_across_devices: True
• max_grad_norm: 1.0
• label_smoothing_factor: 0.0
• bf16: True
• fp16: False
• bf16_full_eval: False
• fp16_full_eval: False
• tf32: None
• gradient_checkpointing: True
• gradient_checkpointing_kwargs: None
• torch_compile: False
• torch_compile_backend: None
• torch_compile_mode: None
• use_liger_kernel: False
• liger_kernel_config: None
• use_cache: False
• neftune_noise_alpha: None
• torch_empty_cache_steps: None
• auto_find_batch_size: False
• log_on_each_node: True
• logging_nan_inf_filter: True
• include_num_input_tokens_seen: no
• log_level: passive
• log_level_replica: warning
• disable_tqdm: False
• project: huggingface
• trackio_space_id: None
• trackio_bucket_id: None
• trackio_static_space_id: None
• per_device_eval_batch_size: 8
• prediction_loss_only: True
• eval_on_start: False
• eval_do_concat_batches: True
• eval_use_gather_object: False
• eval_accumulation_steps: None
• include_for_metrics: []
• batch_eval_metrics: False
• save_only_model: False
• save_on_each_node: False
• enable_jit_checkpoint: False
• push_to_hub: False
• hub_private_repo: None
• hub_model_id: None
• hub_strategy: every_save
• hub_always_push: False
• hub_revision: None
• load_best_model_at_end: False
• ignore_data_skip: False
• restore_callback_states_from_checkpoint: False
• full_determinism: False
• seed: 42
• data_seed: None
• use_cpu: False
• accelerator_config: {'split_batches': False, 'dispatch_batches': None, 'even_batches': True, 'use_seedable_sampler': True, 'non_blocking': False, 'gradient_accumulation_kwargs': None}
• parallelism_config: None
• dataloader_drop_last: False
• dataloader_num_workers: 0
• dataloader_pin_memory: True
• dataloader_persistent_workers: False
• dataloader_prefetch_factor: None
• remove_unused_columns: True
• label_names: None
• train_sampling_strategy: random
• length_column_name: length
• ddp_find_unused_parameters: None
• ddp_bucket_cap_mb: None
• ddp_broadcast_buffers: False
• ddp_static_graph: None
• ddp_backend: None
• ddp_timeout: 1800
• fsdp: None
• fsdp_config: None
• deepspeed: None
• debug: []
• skip_memory_metrics: True
• do_predict: False
• resume_from_checkpoint: None
• warmup_ratio: None
• local_rank: -1
• prompts: None
• batch_sampler: batch_sampler
• multi_dataset_batch_sampler: proportional
• router_mapping: {}
• learning_rate_mapping: {}

Training Logs

Training Time

• Training: 2.2 hours

Framework Versions

• Python: 3.10.12
• Sentence Transformers: 5.6.0
• Transformers: 5.14.1
• PyTorch: 2.10.0+cu126
• Accelerate: 1.14.0
• Datasets: 5.0.0
• Tokenizers: 0.22.2

Citation

BibTeX

Sentence Transformers

@inproceedings{reimers-2019-sentence-bert,
    title = "Sentence-BERT: Sentence Embeddings using Siamese BERT-Networks",
    author = "Reimers, Nils and Gurevych, Iryna",
    booktitle = "Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing",
    month = "11",
    year = "2019",
    publisher = "Association for Computational Linguistics",
    url = "https://arxiv.org/abs/1908.10084",
}

MultipleNegativesRankingLoss

@misc{oord2019representationlearningcontrastivepredictive,
      title={Representation Learning with Contrastive Predictive Coding},
      author={Aaron van den Oord and Yazhe Li and Oriol Vinyals},
      year={2019},
      eprint={1807.03748},
      archivePrefix={arXiv},
      primaryClass={cs.LG},
      url={https://arxiv.org/abs/1807.03748},
}