Queen v2 “crawler” — Crawlnet

A small language model trained from scratch. Pretraining data and tokenizer: only pages the Crawlnet crawlers read on the crypto web (real browsers), plus public market, funding and on-chain records written out as plain-text pages (13% of the tokens, see below). No pretrained weights, no FineWeb, no other corpus. Chat tuning: question/answer pairs generated by deepseek-flash from those pages (details below). Expect a dumb, funny, confidently-wrong model; that is the point.

Contributors

Queen v2 was trained on pages found by these crawlers. Owners spawned theirs by burning $CRAWLNET; the wallets are the ones that made the burn, public on-chain.

Pages and tokens count what made it into this version's dataset after cleaning and dedupe. Machine-readable: contributors.json. The 44,968 record pages (see below) were not found by a crawler and are not in this table.

What went in besides crawler pages

• The nanochat training code, architecture and hyperparameter rules (no weights, no data).
• Six hand-written question templates used to turn page headings into questions (see SFT above).
• Record pages: 44,968 pages, about 9,707,932 tokens, of public market, funding and on-chain records (projects and their funding rounds, investors, token unlocks and token facts, DeFi protocols, chains and stablecoins, DEX and on-chain token statistics), written out as plain text from public data. Only factual fields were kept: no third-party labels, ratings or risk scores, and no social-media posts. They are in the pretraining data, the tokenizer and the generated chat pairs; the pairs cut from page headings use crawler pages only.
• Chat-tuning question/answer pairs generated by deepseek-flash from crawler pages and record pages (see SFT above).
• Nothing else. nanochat's default SFT mixture (SmolTalk, MMLU, GSM8K) and its CORE eval were switched off.

What it says

Fixed prompts, seeded sampling (temperature 0.7, top-k 50), unedited:

What is Bitcoin?

Bitcoin is a decentralized cryptocurrency that aims to provide a secure, decentralized, and secure digital asset. It operates on a Proof-of-Work consensus mechanism, where users are required to compete to solve a computationally intensive puzzle and earn money.

Who created Bitcoin?

Bitcoin was created by Satoshi Nakamoto, who placed the name in the white paper. The document is distributed under its declared BSD-3-Clause licence.

What is a blockchain?

A blockchain is a public, shared ledger that record all the transactions of all the accounts in a block. Transactions are verified and added to the blockchain. It is a distributed database that is constantly managed and maintained by multiple people. This type of database can be used to create a record of all the addresses that have transacted on the chain. For instance, with block 100,000, there will be 52 million addresses transacted on the blockchain.

Explain proof of work.

Proof of work is a process that was intended to work with proof-of-work blockchains to do work in a more energy efficient way by improving the underlying mathematical problems the blockchain uses. Proof of Work is a consensus mechanism that is designed to address this issue by requiring miners to compete with each other to solve complex mathematical problems. However, it can be argued that, in practice, it is possible to solve this problem by solving computationally intensive puzzles.

Explain proof of stake.

The proof of stake protocol is a mechanism enabling a distributed validator network to ensure that the amount of ETH staked by validators on the network is always available to all nodes, thereby reducing the risk of a coalition of validators. The proof of stake protocol allows the network to run more validators than a validator can operate on.

What is Ethereum?

↑ (EN) Eric W. Weisen, Guilty, Friedman (2018). "Ethereum's evolution: A New Formal 'The Fintech' Anders'". The Diamond. 2018. https://ethereum-magicians.org/t/eip-20Ethereum-Cancun-Deneb-7540/9258/5/27847

What is a smart contract?

A smart contract is a program deployed to a blockchain that automatically execute a certain function on a smart contract. The smart contract automatically executes the function when it receives a payment, usually through a crypto wallet.

What is gas on Ethereum?

Gas is the unit of computation for the access of Ethereum nodes. It works like a DoS attack, and the cost is not in the same sense as a memory attack.

What is Solana?

Solana is a high-performance blockchain platform that combines parallel execution and smart contract execution. It is a key component of Solana's architecture and consensus structure, providing minimal latency.

Why is Solana fast?

Solana is fast because it has a low fees and low transaction costs, and transaction fees can increase dramatically as the chain grows. This time, Solana has become one of the fastest and most successful chains in the industry. Solana's network is a high-speed blockchain that executes transactions faster than the network currently executes. It is a high-speed internet that is slow, fast, and cheap. Solana has a high-speed network that can process over 65,000 transactions per second (TPS) while processing thousands of transactions per second.

Use it

chat.py in this folder needs only karpathy/nanochat (MIT) at the commit above:

pip install torch tiktoken safetensors
git clone https://github.com/karpathy/nanochat && git -C nanochat checkout 92d63d4e8bb4
PYTHONPATH=nanochat python chat.py "What is staking?"

Or load it yourself: config.json has the nanochat GPTConfig; build nanochat.gpt.GPT, load model.safetensors; the tokenizer is tokenizer.tiktoken (tiktoken rank file) + the pattern and special tokens in tokenizer.json. Chat format: <|bos|><|user_start|>...<|user_end|><|assistant_start|>.

Limitations

Tiny model, narrow data. It makes things up, including prices, dates, addresses and links. It is not financial advice and must not be used as a source of facts.