CrossEncoder based on BAAI/bge-reranker-base

This is a Cross Encoder model finetuned from BAAI/bge-reranker-base using the sentence-transformers library. It computes scores for pairs of texts, which can be used for text reranking and semantic search.

Model Details

Model Description

• Model Type: Cross Encoder
• Base model: BAAI/bge-reranker-base
• Maximum Sequence Length: 512 tokens
• Number of Output Labels: 1 label
• Supported Modality: Text

Model Sources

• Documentation: Sentence Transformers Documentation
• Documentation: Cross Encoder Documentation
• Repository: Sentence Transformers on GitHub
• Hugging Face: Cross Encoders on Hugging Face

Full Model Architecture

CrossEncoder(
  (0): Transformer({'transformer_task': 'sequence-classification', 'modality_config': {'text': {'method': 'forward', 'method_output_name': 'logits'}}, 'module_output_name': 'scores', 'architecture': 'XLMRobertaForSequenceClassification'})
)

Usage

Direct Usage (Sentence Transformers)

First install the Sentence Transformers library:

pip install -U sentence-transformers

Then you can load this model and run inference.

from sentence_transformers import CrossEncoder

# Download from the 🤗 Hub
model = CrossEncoder("cross_encoder_model_id")
# Get scores for pairs of inputs
pairs = [
    ['as of december 31 , 2004 , how many shares of common stock were outstanding?', 'table of contents marketaxess holdings inc . notes to consolidated financial statements 2014 ( continued ) ( in thousands , except share and per share amounts ) the combined aggregate amount of redemption requirements for the senior preferred shares was as follows : shares of series b convertible preferred stock were convertible into common stock on a 3.33-for-one basis and only in connection with an initial public offering of the company 2019s stock . dividends on the series b convertible preferred stock accrued at the rate of 8% ( 8 % ) per annum and were subordinate to dividend payments on the senior preferred shares . shares of series b convertible preferred stock had a liquidation preference equal to the original issue price plus all cumulative accrued but unpaid dividends . the liquidation preference was subordinate to that of the senior preferred shares . cumulative accrued but unpaid dividends were forfeited upon conversion of shares of series b convertible preferred stock into common stock . as such , the company did not accrue dividends , as liquidation of the shares of series b convertible preferred stock was not anticipated . as of december 31 , 2004 , the company had 110000000 authorized shares of common stock and 10000000 authorized shares of non-voting common stock . as of december 31 , 2003 , the company had 120000000 authorized shares of common stock and 450060 authorized shares of non-voting common stock . common stock entitles the holder to one vote per share of common stock held . non-voting common stock is convertible on a one-for-one basis into shares of common stock at any time subject to a limitation on conversion to the extent such conversion would result in a stockholder , together with its affiliates , owning more than 9.99% ( 9.99 % ) of the outstanding shares of common stock . on march 30 , 2004 , the company 2019s board of directors authorized , and on november 1 , 2004 the company effectuated , a one-for-three reverse stock split of shares of common stock and non-voting common stock to be effective prior to the closing of the company 2019s initial public offering . all references in these financial statements to the number of shares of common stock and non-voting common stock of the company , securities convertible or exercisable therefor and per share amounts have been restated for all periods presented to reflect the effect of the common stock reverse stock split . in 2004 and 2003 , the company had 1939734 shares and 1937141 shares , respectively , of common stock that were issued to employees . included in these amounts , in 2001 , the company awarded 64001 shares and 289581 shares to employees at $ .003 and $ 3.60 , respectively , per share . the common stock subscribed was issued in 2001 in exchange for three-year promissory notes ( 64001 shares ) and eleven-year promissory notes ( 289581 shares ) , which bear interest at the applicable federal rate and are collateralized by the subscribed shares . the promissory note due in 2004 was repaid on january 15 , 2005 . compensation expense in relation to the excess of the fair value of such awards over the amount paid will be recorded over the vesting period . the awards vest over a period of either one and one-half or three years and are restricted as to transferability based on the vesting schedule set forth in the award agreement . the eleven-year promissory notes ( 289581 shares ) were entered into in connection with the loans of approximately $ 1042 made to the company 2019s chief executive officer in 2001 . these loans were made prior to the passage of the sarbanes-oxley act of 2002. .\n|year ended december 31,|as of december 31 , 2004|as of december 31 , 2003|\n|2005|$ 2014|$ 177973|\nconvertible preferred stock 9 . stockholders 2019 equity ( deficit ) common stock restricted common stock and common stock subscribed .'],
    ['as of december 31 , 2004 , how many shares of common stock were outstanding?', 'table of contents part ii price range our common stock commenced trading on the nasdaq national market under the symbol 201cmktx 201d on november 5 , 2004 . prior to that date , there was no public market for our common stock . on november 4 , 2004 , the registration statement relating to our initial public offering was declared effective by the sec . the high and low bid information for our common stock , as reported by nasdaq , was as follows : on march 28 , 2005 , the last reported closing price of our common stock on the nasdaq national market was $ 10.26 . holders there were approximately 188 holders of record of our common stock as of march 28 , 2005 . dividend policy we have not declared or paid any cash dividends on our capital stock since our inception . we intend to retain future earnings to finance the operation and expansion of our business and do not anticipate paying any cash dividends in the foreseeable future . in the event we decide to declare dividends on our common stock in the future , such declaration will be subject to the discretion of our board of directors . our board may take into account such matters as general business conditions , our financial results , capital requirements , contractual , legal , and regulatory restrictions on the payment of dividends by us to our stockholders or by our subsidiaries to us and any such other factors as our board may deem relevant . use of proceeds on november 4 , 2004 , the registration statement relating to our initial public offering ( no . 333-112718 ) was declared effective . we received net proceeds from the sale of the shares of our common stock in the offering of $ 53.9 million , at an initial public offering price of $ 11.00 per share , after deducting underwriting discounts and commissions and estimated offering expenses . additionally , prior to the closing of the initial public offering , all outstanding shares of convertible preferred stock were converted into 14484493 shares of common stock and 4266310 shares of non-voting common stock . the underwriters for our initial public offering were credit suisse first boston llc , j.p . morgan securities inc. , banc of america securities llc , bear , stearns & co . inc . and ubs securities llc . all of the underwriters are affiliates of some of our broker-dealer clients and affiliates of some our institutional investor clients . in addition , affiliates of all the underwriters are stockholders of ours . except for salaries , and reimbursements for travel expenses and other out-of-pocket costs incurred in the ordinary course of business , none of the proceeds from the offering have been paid by us , directly or indirectly , to any of our directors or officers or any of their associates , or to any persons owning ten percent or more of our outstanding stock or to any of our affiliates . as of december 31 , 2004 , we have not used any of the net proceeds from the initial public offering for product development costs , sales and marketing activities and working capital . we have invested the proceeds from the offering in cash and cash equivalents and short-term marketable securities pending their use for these or other purposes . item 5 . market for registrant 2019s common equity , related stockholder matters and issuer purchases of equity securities november 5 , 2004 december 31 , 2004 .\n|high|low|\n|$ 24.41|$ 12.75|\n.'],
    ['as of december 31 , 2004 , how many shares of common stock were outstanding?', 'part ii item 5 . market for registrant 2019s common equity , related stockholder matters and issuer purchases of equity securities the following table presents reported quarterly high and low per share sale prices of our class a common stock on the new york stock exchange ( nyse ) for the years 2004 and 2003. .\n|2004|high|low|\n|quarter ended march 31|$ 13.12|$ 9.89|\n|quarter ended june 30|16.00|11.13|\n|quarter ended september 30|15.85|13.10|\n|quarter ended december 31|18.75|15.19|\n|2003|high|low|\n|quarter ended march 31|$ 5.94|$ 3.55|\n|quarter ended june 30|9.90|5.41|\n|quarter ended september 30|11.74|8.73|\n|quarter ended december 31|12.00|9.59|\non march 18 , 2005 , the closing price of our class a common stock was $ 18.79 per share as reported on the as of march 18 , 2005 , we had 230604932 outstanding shares of class a common stock and 743 registered holders . in february 2004 , all outstanding shares of our class b common stock were converted into shares of our class a common stock on a one-for-one basis pursuant to the occurrence of the 201cdodge conversion event 201d as defined in our charter . our charter prohibits the future issuance of shares of class b common stock . also in february 2004 , all outstanding shares of class c common stock were converted into shares of class a common stock on a one-for-one basis . our charter permits the issuance of shares of class c common stock in the future . the information under 201csecurities authorized for issuance under equity compensation plans 201d from the definitive proxy statement is hereby incorporated by reference into item 12 of this annual report . dividends we have never paid a dividend on any class of common stock . we anticipate that we may retain future earnings , if any , to fund the development and growth of our business . the indentures governing our 93 20448% ( 20448 % ) senior notes due 2009 , our 7.50% ( 7.50 % ) senior notes due 2012 , and our 7.125% ( 7.125 % ) senior notes due 2012 prohibit us from paying dividends to our stockholders unless we satisfy certain financial covenants . our borrower subsidiaries are generally prohibited under the terms of the credit facility , subject to certain exceptions , from making to us any direct or indirect distribution , dividend or other payment on account of their limited liability company interests , partnership interests , capital stock or other equity interests , except that , if no default exists or would be created thereby under the credit facility , our borrower subsidiaries may pay cash dividends or make other distributions to us in accordance with the credit facility within certain specified amounts and , in addition , may pay cash dividends or make other distributions to us in respect of our outstanding indebtedness and permitted future indebtedness . the indentures governing the 12.25% ( 12.25 % ) senior subordinated discount notes due 2008 and the 7.25% ( 7.25 % ) senior subordinated notes due 2011 of american towers , inc . ( ati ) , our principal operating subsidiary , prohibit ati and certain of our other subsidiaries that have guaranteed those notes ( sister guarantors ) from paying dividends and making other payments or distributions to us unless certain .'],
    ['as of december 31 , 2004 , how many shares of common stock were outstanding?', 'part ii item 5 . market for registrant 2019s common equity , related stockholder matters and issuer purchases of equity securities the following table presents reported quarterly high and low per share sale prices of our class a common stock on the new york stock exchange ( nyse ) for the years 2005 and 2004. .\n|2005|high|low|\n|quarter ended march 31|$ 19.28|$ 17.30|\n|quarter ended june 30|21.16|16.28|\n|quarter ended september 30|25.20|20.70|\n|quarter ended december 31|28.33|22.73|\n|2004|high|low|\n|quarter ended march 31|$ 13.12|$ 9.89|\n|quarter ended june 30|16.00|11.13|\n|quarter ended september 30|15.85|13.10|\n|quarter ended december 31|18.75|15.19|\non march 9 , 2006 , the closing price of our class a common stock was $ 29.83 per share as reported on the nyse . as of march 9 , 2006 , we had 419677495 outstanding shares of class a common stock and 687 registered holders . in february 2004 , all outstanding shares of our class b common stock were converted into shares of our class a common stock on a one-for-one basis pursuant to the occurrence of the 201cdodge conversion event 201d as defined in our charter . also in february 2004 , all outstanding shares of class c common stock were converted into shares of class a common stock on a one-for-one basis . in august 2005 , we amended and restated our charter to , among other things , eliminate our class b common stock and class c common stock . the information under 201csecurities authorized for issuance under equity compensation plans 201d from the definitive proxy statement is hereby incorporated by reference into item 12 of this annual report . dividends we have never paid a dividend on any class of our common stock . we anticipate that we may retain future earnings , if any , to fund the development and growth of our business . the indentures governing our 7.50% ( 7.50 % ) senior notes due 2012 ( 7.50% ( 7.50 % ) notes ) and our 7.125% ( 7.125 % ) senior notes due 2012 ( 7.125% ( 7.125 % ) notes ) may prohibit us from paying dividends to our stockholders unless we satisfy certain financial covenants . our credit facilities and the indentures governing the terms of our debt securities contain covenants that may restrict the ability of our subsidiaries from making to us any direct or indirect distribution , dividend or other payment on account of their limited liability company interests , partnership interests , capital stock or other equity interests . under our credit facilities , the borrower subsidiaries may pay cash dividends or make other distributions to us in accordance with the applicable credit facility only if no default exists or would be created thereby . the indenture governing the terms of the ati 7.25% ( 7.25 % ) senior subordinated notes due 2011 ( ati 7.25% ( 7.25 % ) notes ) prohibit ati and certain of our other subsidiaries that have guaranteed those notes ( sister guarantors ) from paying dividends and making other payments or distributions to us unless certain financial covenants are satisfied . the indentures governing the terms of our 7.50% ( 7.50 % ) notes and 7.125% ( 7.125 % ) notes also contain certain restrictive covenants , which prohibit the restricted subsidiaries under these indentures from paying dividends and making other payments or distributions to us unless certain financial covenants are satisfied . for more information about the restrictions under our credit facilities and our notes indentures , see note 7 to our consolidated financial statements included in this annual report and the section entitled 201cmanagement 2019s .'],
    ['as of december 31 , 2004 , how many shares of common stock were outstanding?', 'part ii price range our common stock commenced trading on the nasdaq national market under the symbol 201cmktx 201d on november 5 , 2004 . prior to that date , there was no public market for our common stock . the high and low bid information for our common stock , as reported by nasdaq , was as follows : on march 8 , 2006 , the last reported closing price of our common stock on the nasdaq national market was $ 12.59 . holders there were approximately 114 holders of record of our common stock as of march 8 , 2006 . dividend policy we have not declared or paid any cash dividends on our capital stock since our inception . we intend to retain future earnings to finance the operation and expansion of our business and do not anticipate paying any cash dividends in the foreseeable future . in the event we decide to declare dividends on our common stock in the future , such declaration will be subject to the discretion of our board of directors . our board may take into account such matters as general business conditions , our financial results , capital requirements , contractual , legal , and regulatory restrictions on the payment of dividends by us to our stockholders or by our subsidiaries to us and any such other factors as our board may deem relevant . use of proceeds on november 4 , 2004 , the registration statement relating to our initial public offering ( no . 333-112718 ) was declared effective . we received net proceeds from the sale of the shares of our common stock in the offering of $ 53.9 million , at an initial public offering price of $ 11.00 per share , after deducting underwriting discounts and commissions and estimated offering expenses . except for salaries , and reimbursements for travel expenses and other out-of -pocket costs incurred in the ordinary course of business , none of the proceeds from the offering have been paid by us , directly or indirectly , to any of our directors or officers or any of their associates , or to any persons owning ten percent or more of our outstanding stock or to any of our affiliates . we have invested the proceeds from the offering in cash and cash equivalents and short-term marketable securities . item 5 . market for registrant 2019s common equity , related stockholder matters and issuer purchases of equity securities .\n||high|low|\n|november 5 2004 to december 31 2004|$ 24.41|$ 12.75|\n|january 1 2005 to march 31 2005|$ 15.95|$ 9.64|\n|april 1 2005 to june 30 2005|$ 13.87|$ 9.83|\n|july 1 2005 to september 30 2005|$ 14.09|$ 9.99|\n|october 1 2005 to december 31 2005|$ 13.14|$ 10.64|\n.'],
]
scores = model.predict(pairs)
print(scores)
# [0.8177 0.0237 0.0189 0.0176 0.0338]

# Or rank different texts based on similarity to a single text
ranks = model.rank(
    'as of december 31 , 2004 , how many shares of common stock were outstanding?',
    [
        'table of contents marketaxess holdings inc . notes to consolidated financial statements 2014 ( continued ) ( in thousands , except share and per share amounts ) the combined aggregate amount of redemption requirements for the senior preferred shares was as follows : shares of series b convertible preferred stock were convertible into common stock on a 3.33-for-one basis and only in connection with an initial public offering of the company 2019s stock . dividends on the series b convertible preferred stock accrued at the rate of 8% ( 8 % ) per annum and were subordinate to dividend payments on the senior preferred shares . shares of series b convertible preferred stock had a liquidation preference equal to the original issue price plus all cumulative accrued but unpaid dividends . the liquidation preference was subordinate to that of the senior preferred shares . cumulative accrued but unpaid dividends were forfeited upon conversion of shares of series b convertible preferred stock into common stock . as such , the company did not accrue dividends , as liquidation of the shares of series b convertible preferred stock was not anticipated . as of december 31 , 2004 , the company had 110000000 authorized shares of common stock and 10000000 authorized shares of non-voting common stock . as of december 31 , 2003 , the company had 120000000 authorized shares of common stock and 450060 authorized shares of non-voting common stock . common stock entitles the holder to one vote per share of common stock held . non-voting common stock is convertible on a one-for-one basis into shares of common stock at any time subject to a limitation on conversion to the extent such conversion would result in a stockholder , together with its affiliates , owning more than 9.99% ( 9.99 % ) of the outstanding shares of common stock . on march 30 , 2004 , the company 2019s board of directors authorized , and on november 1 , 2004 the company effectuated , a one-for-three reverse stock split of shares of common stock and non-voting common stock to be effective prior to the closing of the company 2019s initial public offering . all references in these financial statements to the number of shares of common stock and non-voting common stock of the company , securities convertible or exercisable therefor and per share amounts have been restated for all periods presented to reflect the effect of the common stock reverse stock split . in 2004 and 2003 , the company had 1939734 shares and 1937141 shares , respectively , of common stock that were issued to employees . included in these amounts , in 2001 , the company awarded 64001 shares and 289581 shares to employees at $ .003 and $ 3.60 , respectively , per share . the common stock subscribed was issued in 2001 in exchange for three-year promissory notes ( 64001 shares ) and eleven-year promissory notes ( 289581 shares ) , which bear interest at the applicable federal rate and are collateralized by the subscribed shares . the promissory note due in 2004 was repaid on january 15 , 2005 . compensation expense in relation to the excess of the fair value of such awards over the amount paid will be recorded over the vesting period . the awards vest over a period of either one and one-half or three years and are restricted as to transferability based on the vesting schedule set forth in the award agreement . the eleven-year promissory notes ( 289581 shares ) were entered into in connection with the loans of approximately $ 1042 made to the company 2019s chief executive officer in 2001 . these loans were made prior to the passage of the sarbanes-oxley act of 2002. .\n|year ended december 31,|as of december 31 , 2004|as of december 31 , 2003|\n|2005|$ 2014|$ 177973|\nconvertible preferred stock 9 . stockholders 2019 equity ( deficit ) common stock restricted common stock and common stock subscribed .',
        'table of contents part ii price range our common stock commenced trading on the nasdaq national market under the symbol 201cmktx 201d on november 5 , 2004 . prior to that date , there was no public market for our common stock . on november 4 , 2004 , the registration statement relating to our initial public offering was declared effective by the sec . the high and low bid information for our common stock , as reported by nasdaq , was as follows : on march 28 , 2005 , the last reported closing price of our common stock on the nasdaq national market was $ 10.26 . holders there were approximately 188 holders of record of our common stock as of march 28 , 2005 . dividend policy we have not declared or paid any cash dividends on our capital stock since our inception . we intend to retain future earnings to finance the operation and expansion of our business and do not anticipate paying any cash dividends in the foreseeable future . in the event we decide to declare dividends on our common stock in the future , such declaration will be subject to the discretion of our board of directors . our board may take into account such matters as general business conditions , our financial results , capital requirements , contractual , legal , and regulatory restrictions on the payment of dividends by us to our stockholders or by our subsidiaries to us and any such other factors as our board may deem relevant . use of proceeds on november 4 , 2004 , the registration statement relating to our initial public offering ( no . 333-112718 ) was declared effective . we received net proceeds from the sale of the shares of our common stock in the offering of $ 53.9 million , at an initial public offering price of $ 11.00 per share , after deducting underwriting discounts and commissions and estimated offering expenses . additionally , prior to the closing of the initial public offering , all outstanding shares of convertible preferred stock were converted into 14484493 shares of common stock and 4266310 shares of non-voting common stock . the underwriters for our initial public offering were credit suisse first boston llc , j.p . morgan securities inc. , banc of america securities llc , bear , stearns & co . inc . and ubs securities llc . all of the underwriters are affiliates of some of our broker-dealer clients and affiliates of some our institutional investor clients . in addition , affiliates of all the underwriters are stockholders of ours . except for salaries , and reimbursements for travel expenses and other out-of-pocket costs incurred in the ordinary course of business , none of the proceeds from the offering have been paid by us , directly or indirectly , to any of our directors or officers or any of their associates , or to any persons owning ten percent or more of our outstanding stock or to any of our affiliates . as of december 31 , 2004 , we have not used any of the net proceeds from the initial public offering for product development costs , sales and marketing activities and working capital . we have invested the proceeds from the offering in cash and cash equivalents and short-term marketable securities pending their use for these or other purposes . item 5 . market for registrant 2019s common equity , related stockholder matters and issuer purchases of equity securities november 5 , 2004 december 31 , 2004 .\n|high|low|\n|$ 24.41|$ 12.75|\n.',
        'part ii item 5 . market for registrant 2019s common equity , related stockholder matters and issuer purchases of equity securities the following table presents reported quarterly high and low per share sale prices of our class a common stock on the new york stock exchange ( nyse ) for the years 2004 and 2003. .\n|2004|high|low|\n|quarter ended march 31|$ 13.12|$ 9.89|\n|quarter ended june 30|16.00|11.13|\n|quarter ended september 30|15.85|13.10|\n|quarter ended december 31|18.75|15.19|\n|2003|high|low|\n|quarter ended march 31|$ 5.94|$ 3.55|\n|quarter ended june 30|9.90|5.41|\n|quarter ended september 30|11.74|8.73|\n|quarter ended december 31|12.00|9.59|\non march 18 , 2005 , the closing price of our class a common stock was $ 18.79 per share as reported on the as of march 18 , 2005 , we had 230604932 outstanding shares of class a common stock and 743 registered holders . in february 2004 , all outstanding shares of our class b common stock were converted into shares of our class a common stock on a one-for-one basis pursuant to the occurrence of the 201cdodge conversion event 201d as defined in our charter . our charter prohibits the future issuance of shares of class b common stock . also in february 2004 , all outstanding shares of class c common stock were converted into shares of class a common stock on a one-for-one basis . our charter permits the issuance of shares of class c common stock in the future . the information under 201csecurities authorized for issuance under equity compensation plans 201d from the definitive proxy statement is hereby incorporated by reference into item 12 of this annual report . dividends we have never paid a dividend on any class of common stock . we anticipate that we may retain future earnings , if any , to fund the development and growth of our business . the indentures governing our 93 20448% ( 20448 % ) senior notes due 2009 , our 7.50% ( 7.50 % ) senior notes due 2012 , and our 7.125% ( 7.125 % ) senior notes due 2012 prohibit us from paying dividends to our stockholders unless we satisfy certain financial covenants . our borrower subsidiaries are generally prohibited under the terms of the credit facility , subject to certain exceptions , from making to us any direct or indirect distribution , dividend or other payment on account of their limited liability company interests , partnership interests , capital stock or other equity interests , except that , if no default exists or would be created thereby under the credit facility , our borrower subsidiaries may pay cash dividends or make other distributions to us in accordance with the credit facility within certain specified amounts and , in addition , may pay cash dividends or make other distributions to us in respect of our outstanding indebtedness and permitted future indebtedness . the indentures governing the 12.25% ( 12.25 % ) senior subordinated discount notes due 2008 and the 7.25% ( 7.25 % ) senior subordinated notes due 2011 of american towers , inc . ( ati ) , our principal operating subsidiary , prohibit ati and certain of our other subsidiaries that have guaranteed those notes ( sister guarantors ) from paying dividends and making other payments or distributions to us unless certain .',
        'part ii item 5 . market for registrant 2019s common equity , related stockholder matters and issuer purchases of equity securities the following table presents reported quarterly high and low per share sale prices of our class a common stock on the new york stock exchange ( nyse ) for the years 2005 and 2004. .\n|2005|high|low|\n|quarter ended march 31|$ 19.28|$ 17.30|\n|quarter ended june 30|21.16|16.28|\n|quarter ended september 30|25.20|20.70|\n|quarter ended december 31|28.33|22.73|\n|2004|high|low|\n|quarter ended march 31|$ 13.12|$ 9.89|\n|quarter ended june 30|16.00|11.13|\n|quarter ended september 30|15.85|13.10|\n|quarter ended december 31|18.75|15.19|\non march 9 , 2006 , the closing price of our class a common stock was $ 29.83 per share as reported on the nyse . as of march 9 , 2006 , we had 419677495 outstanding shares of class a common stock and 687 registered holders . in february 2004 , all outstanding shares of our class b common stock were converted into shares of our class a common stock on a one-for-one basis pursuant to the occurrence of the 201cdodge conversion event 201d as defined in our charter . also in february 2004 , all outstanding shares of class c common stock were converted into shares of class a common stock on a one-for-one basis . in august 2005 , we amended and restated our charter to , among other things , eliminate our class b common stock and class c common stock . the information under 201csecurities authorized for issuance under equity compensation plans 201d from the definitive proxy statement is hereby incorporated by reference into item 12 of this annual report . dividends we have never paid a dividend on any class of our common stock . we anticipate that we may retain future earnings , if any , to fund the development and growth of our business . the indentures governing our 7.50% ( 7.50 % ) senior notes due 2012 ( 7.50% ( 7.50 % ) notes ) and our 7.125% ( 7.125 % ) senior notes due 2012 ( 7.125% ( 7.125 % ) notes ) may prohibit us from paying dividends to our stockholders unless we satisfy certain financial covenants . our credit facilities and the indentures governing the terms of our debt securities contain covenants that may restrict the ability of our subsidiaries from making to us any direct or indirect distribution , dividend or other payment on account of their limited liability company interests , partnership interests , capital stock or other equity interests . under our credit facilities , the borrower subsidiaries may pay cash dividends or make other distributions to us in accordance with the applicable credit facility only if no default exists or would be created thereby . the indenture governing the terms of the ati 7.25% ( 7.25 % ) senior subordinated notes due 2011 ( ati 7.25% ( 7.25 % ) notes ) prohibit ati and certain of our other subsidiaries that have guaranteed those notes ( sister guarantors ) from paying dividends and making other payments or distributions to us unless certain financial covenants are satisfied . the indentures governing the terms of our 7.50% ( 7.50 % ) notes and 7.125% ( 7.125 % ) notes also contain certain restrictive covenants , which prohibit the restricted subsidiaries under these indentures from paying dividends and making other payments or distributions to us unless certain financial covenants are satisfied . for more information about the restrictions under our credit facilities and our notes indentures , see note 7 to our consolidated financial statements included in this annual report and the section entitled 201cmanagement 2019s .',
        'part ii price range our common stock commenced trading on the nasdaq national market under the symbol 201cmktx 201d on november 5 , 2004 . prior to that date , there was no public market for our common stock . the high and low bid information for our common stock , as reported by nasdaq , was as follows : on march 8 , 2006 , the last reported closing price of our common stock on the nasdaq national market was $ 12.59 . holders there were approximately 114 holders of record of our common stock as of march 8 , 2006 . dividend policy we have not declared or paid any cash dividends on our capital stock since our inception . we intend to retain future earnings to finance the operation and expansion of our business and do not anticipate paying any cash dividends in the foreseeable future . in the event we decide to declare dividends on our common stock in the future , such declaration will be subject to the discretion of our board of directors . our board may take into account such matters as general business conditions , our financial results , capital requirements , contractual , legal , and regulatory restrictions on the payment of dividends by us to our stockholders or by our subsidiaries to us and any such other factors as our board may deem relevant . use of proceeds on november 4 , 2004 , the registration statement relating to our initial public offering ( no . 333-112718 ) was declared effective . we received net proceeds from the sale of the shares of our common stock in the offering of $ 53.9 million , at an initial public offering price of $ 11.00 per share , after deducting underwriting discounts and commissions and estimated offering expenses . except for salaries , and reimbursements for travel expenses and other out-of -pocket costs incurred in the ordinary course of business , none of the proceeds from the offering have been paid by us , directly or indirectly , to any of our directors or officers or any of their associates , or to any persons owning ten percent or more of our outstanding stock or to any of our affiliates . we have invested the proceeds from the offering in cash and cash equivalents and short-term marketable securities . item 5 . market for registrant 2019s common equity , related stockholder matters and issuer purchases of equity securities .\n||high|low|\n|november 5 2004 to december 31 2004|$ 24.41|$ 12.75|\n|january 1 2005 to march 31 2005|$ 15.95|$ 9.64|\n|april 1 2005 to june 30 2005|$ 13.87|$ 9.83|\n|july 1 2005 to september 30 2005|$ 14.09|$ 9.99|\n|october 1 2005 to december 31 2005|$ 13.14|$ 10.64|\n.',
    ]
)
# [{'corpus_id': ..., 'score': ...}, {'corpus_id': ..., 'score': ...}, ...]

Training Details

Training Dataset

Unnamed Dataset

• Size: 42,285 training samples
• Columns: query, response, and label
• Approximate statistics based on the first 100 samples:

  	query	response	label
  type	string	string	float
  modality	text	text
  details	min: 14 tokensmean: 21.87 tokensmax: 40 tokens	min: 189 tokensmean: 493.68 tokensmax: 512 tokens	min: 0.0mean: 0.2max: 1.0

• Samples:

  query	response	label
  as of december 31 , 2004 , how many shares of common stock were outstanding?	table of contents marketaxess holdings inc . notes to consolidated financial statements 2014 ( continued ) ( in thousands , except share and per share amounts ) the combined aggregate amount of redemption requirements for the senior preferred shares was as follows : shares of series b convertible preferred stock were convertible into common stock on a 3.33-for-one basis and only in connection with an initial public offering of the company 2019s stock . dividends on the series b convertible preferred stock accrued at the rate of 8% ( 8 % ) per annum and were subordinate to dividend payments on the senior preferred shares . shares of series b convertible preferred stock had a liquidation preference equal to the original issue price plus all cumulative accrued but unpaid dividends . the liquidation preference was subordinate to that of the senior preferred shares . cumulative accrued but unpaid dividends were forfeited upon conversion of shares of series b convertible preferred stock into...	1.0
  as of december 31 , 2004 , how many shares of common stock were outstanding?	table of contents part ii price range our common stock commenced trading on the nasdaq national market under the symbol 201cmktx 201d on november 5 , 2004 . prior to that date , there was no public market for our common stock . on november 4 , 2004 , the registration statement relating to our initial public offering was declared effective by the sec . the high and low bid information for our common stock , as reported by nasdaq , was as follows : on march 28 , 2005 , the last reported closing price of our common stock on the nasdaq national market was $ 10.26 . holders there were approximately 188 holders of record of our common stock as of march 28 , 2005 . dividend policy we have not declared or paid any cash dividends on our capital stock since our inception . we intend to retain future earnings to finance the operation and expansion of our business and do not anticipate paying any cash dividends in the foreseeable future . in the event we decide to declare dividends on our common s...	0.0
  as of december 31 , 2004 , how many shares of common stock were outstanding?	part ii item 5 . market for registrant 2019s common equity , related stockholder matters and issuer purchases of equity securities the following table presents reported quarterly high and low per share sale prices of our class a common stock on the new york stock exchange ( nyse ) for the years 2004 and 2003. .|2004|high|low||quarter ended march 31|$ 13.12|$ 9.89||quarter ended june 30|16.00|11.13||quarter ended september 30|15.85|13.10||quarter ended december 31|18.75|15.19||2003|high|low||quarter ended march 31|$ 5.94|$ 3.55||quarter ended june 30|9.90|5.41||quarter ended september 30|11.74|8.73||quarter ended december 31|12.00|9.59|on march 18 , 2005 , the closing price of our class a common stock was $ 18.79 per share as reported on the as of march 18 , 2005 , we had 230604932 outstanding shares of class a common stock and 743 registered holders . in february 2004 , all outstanding shares of our class b common stock were converted into shares of our class a common stock ...	0.0

• Loss: BinaryCrossEntropyLoss with these parameters:

  {
      "activation_fn": "torch.nn.modules.linear.Identity",
      "pos_weight": null
  }
  

Training Hyperparameters

Non-Default Hyperparameters

• per_device_train_batch_size: 32
• num_train_epochs: 2
• learning_rate: 2e-05
• warmup_steps: 0.1
• fp16: True

All Hyperparameters

• per_device_train_batch_size: 32
• num_train_epochs: 2
• max_steps: -1
• learning_rate: 2e-05
• lr_scheduler_type: linear
• lr_scheduler_kwargs: None
• warmup_steps: 0.1
• optim: adamw_torch_fused
• optim_args: None
• weight_decay: 0.0
• adam_beta1: 0.9
• adam_beta2: 0.999
• adam_epsilon: 1e-08
• optim_target_modules: None
• gradient_accumulation_steps: 1
• average_tokens_across_devices: True
• max_grad_norm: 1.0
• label_smoothing_factor: 0.0
• bf16: False
• fp16: True
• bf16_full_eval: False
• fp16_full_eval: False
• tf32: None
• gradient_checkpointing: False
• gradient_checkpointing_kwargs: None
• torch_compile: False
• torch_compile_backend: None
• torch_compile_mode: None
• use_liger_kernel: False
• liger_kernel_config: None
• use_cache: False
• neftune_noise_alpha: None
• torch_empty_cache_steps: None
• auto_find_batch_size: False
• log_on_each_node: True
• logging_nan_inf_filter: True
• include_num_input_tokens_seen: no
• log_level: passive
• log_level_replica: warning
• disable_tqdm: False
• project: huggingface
• trackio_space_id: None
• trackio_bucket_id: None
• trackio_static_space_id: None
• per_device_eval_batch_size: 8
• prediction_loss_only: True
• eval_on_start: False
• eval_do_concat_batches: True
• eval_use_gather_object: False
• eval_accumulation_steps: None
• include_for_metrics: []
• batch_eval_metrics: False
• save_only_model: False
• save_on_each_node: False
• enable_jit_checkpoint: False
• push_to_hub: False
• hub_private_repo: None
• hub_model_id: None
• hub_strategy: every_save
• hub_always_push: False
• hub_revision: None
• load_best_model_at_end: False
• ignore_data_skip: False
• restore_callback_states_from_checkpoint: False
• full_determinism: False
• seed: 42
• data_seed: None
• use_cpu: False
• accelerator_config: {'split_batches': False, 'dispatch_batches': None, 'even_batches': True, 'use_seedable_sampler': True, 'non_blocking': False, 'gradient_accumulation_kwargs': None}
• parallelism_config: None
• dataloader_drop_last: False
• dataloader_num_workers: 0
• dataloader_pin_memory: True
• dataloader_persistent_workers: False
• dataloader_prefetch_factor: None
• dataloader_multiprocessing_context: None
• dataloader_in_order: True
• remove_unused_columns: True
• label_names: None
• train_sampling_strategy: random
• length_column_name: length
• ddp_find_unused_parameters: None
• ddp_bucket_cap_mb: None
• ddp_broadcast_buffers: False
• ddp_static_graph: None
• ddp_backend: None
• ddp_timeout: 1800
• fsdp: None
• fsdp_config: None
• deepspeed: None
• debug: []
• skip_memory_metrics: True
• do_predict: False
• resume_from_checkpoint: None
• local_rank: -1
• prompts: None
• batch_sampler: batch_sampler
• multi_dataset_batch_sampler: proportional
• router_mapping: {}
• learning_rate_mapping: {}
• warmup_ratio: None

Training Logs

Training Time

• Training: 6.8 minutes

Framework Versions

• Python: 3.12.3
• Sentence Transformers: 6.0.1
• Transformers: 5.16.1
• PyTorch: 2.14.0+cu130
• Accelerate: 1.14.0
• Datasets: 5.0.1
• Tokenizers: 0.23.2

Additional Resources

• Training and Finetuning Reranker Models with Sentence Transformers: the end-to-end guide for training or finetuning Cross Encoder (reranker) models.
• Multimodal Embedding & Reranker Models with Sentence Transformers: use text, image, audio, and video reranker models through the same API.
• Training and Finetuning Multimodal Embedding & Reranker Models with Sentence Transformers: training multimodal Cross Encoders.

Citation

BibTeX

Sentence Transformers

@inproceedings{reimers-2019-sentence-bert,
    title = "Sentence-BERT: Sentence Embeddings using Siamese BERT-Networks",
    author = "Reimers, Nils and Gurevych, Iryna",
    booktitle = "Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing",
    month = "11",
    year = "2019",
    publisher = "Association for Computational Linguistics",
    url = "https://arxiv.org/abs/1908.10084",
}