🐱 Mew1-2.6B
Mew1-2.6B is a 2.69B-parameter LFM2-family text-generation model released by Unmid. This is the canonical BF16 Transformers checkpoint; ready-to-run GGUF files are published separately in Unmid/Mew1-2.6B-GGUF.
Model details
| Property | Value |
|---|---|
| Architecture | LFM2 hybrid (Lfm2ForCausalLM) |
| Parameters | 2.69B |
| Layers | 30 |
| Context configured by this checkpoint | 128,000 tokens |
| Vocabulary | 128,000 tokens |
| Weight format | BF16 Safetensors, 4 shards |
| Chat format | ChatML-like template with tool-use support |
| Primary tested language | English |
| License | LFM Open License v1.0 |
The checkpoint is intended for local conversational generation, creative writing, roleplay, instruction following, and experimentation on resource-constrained hardware. A complete reproducibility report and independent benchmark suite for the Mew1 modification have not yet been published; performance claims should be evaluated on your own workloads.
Files in this repository
The four model-0000x-of-00004.safetensors files are the actual BF16 model weights. model.safetensors.index.json maps every tensor to its shard. These are standard Transformers files and should be kept together.
Usage with Transformers
LFM2 is supported natively by recent Transformers releases. No custom remote code is required.
import torch
from transformers import AutoModelForCausalLM, AutoTokenizer
model_id = "Unmid/Mew1-2.6B"
tokenizer = AutoTokenizer.from_pretrained(model_id)
model = AutoModelForCausalLM.from_pretrained(
model_id,
dtype=torch.bfloat16,
device_map="auto",
)
messages = [
{"role": "system", "content": "You are a helpful assistant."},
{"role": "user", "content": "Write a short story about a cat exploring the Moon."},
]
input_ids = tokenizer.apply_chat_template(
messages,
add_generation_prompt=True,
return_tensors="pt",
).to(model.device)
output = model.generate(
input_ids,
max_new_tokens=512,
do_sample=True,
temperature=0.7,
top_k=50,
top_p=0.9,
repetition_penalty=1.1,
)
print(tokenizer.decode(output[0, input_ids.shape[-1]:], skip_special_tokens=True))
GGUF downloads
The owner-maintained GGUF release is Unmid/Mew1-2.6B-GGUF.
For backward compatibility, the earlier GGUF copies under this repository's ggufs/ directory remain available. No model artifacts were removed during the reorganization.
| Quant | Size | Suggested use | Download |
|---|---|---|---|
| Q2_K | 1.09 GB | Minimum memory | GGUF |
| Q4_0 | 1.59 GB | Fast legacy 4-bit | GGUF |
| Q4_K_M | 1.67 GB | Recommended balance | GGUF |
| Q5_K_M | 1.94 GB | Higher quality | GGUF |
| Q6_K | 2.22 GB | High quality | GGUF |
| Q8_0 | 2.87 GB | Maximum quantized quality | GGUF |
Additional community quantizations are available from mradermacher:
Limitations and responsible use
Mew1 may produce incorrect, biased, unsafe, or fabricated text. “Uncensored” describes reduced refusal behavior; it does not guarantee accuracy or suitability. Validate outputs before relying on them, especially for medical, legal, financial, security, or other high-impact decisions. Users are responsible for complying with applicable law and the model license.
License and attribution
This derivative is distributed under the LFM Open License v1.0. Review LICENSE, including its attribution and commercial-use conditions. Mew1 builds on work by Liquid AI and SC117; quantized community releases should also credit their respective quantizers.