Nova v1
Nova v1 is a decoder-only causal language model with 85.0 million parameters. This release packages the original trained weights for use through the Hugging Face Transformers API.
Model specifications
| Specification | Value |
|---|---|
| Parameters | 85.0M |
| Vocabulary | 32,768 tokens |
| Hidden size | 640 |
| Transformer layers | 10 |
| Attention | 10 query heads, 2 key/value heads |
| Feed-forward size | 1,728 |
| Maximum context | 2,048 tokens |
| Weights | Float32 (Safetensors) |
The architecture uses grouped-query attention, rotary position embeddings, RMSNorm, and a SwiGLU feed-forward network. The provided model implementation supports the Transformers causal language model interface and KV-cached generation. Review the custom modeling code before loading it with trust_remote_code=True.
Load with Transformers
Install PyTorch, Transformers, and Safetensors:
pip install torch transformers safetensors
Load the tokenizer and model from the Hub:
from transformers import AutoModelForCausalLM, AutoTokenizer
model_id = "plasmova/Nova-v1"
tokenizer = AutoTokenizer.from_pretrained(model_id, trust_remote_code=True)
model = AutoModelForCausalLM.from_pretrained(model_id, trust_remote_code=True)
system_prompt = (
"You are Nova, a helpful and accurate assistant. Answer directly and concisely. "
"For simple arithmetic, calculate the result. Do not invent names, scenarios, or equations."
)
prompt = f"<|user|>System instruction: {system_prompt}\n\nUser request: Explain why the sky appears blue in one sentence.<|assistant|>"
inputs = tokenizer(prompt, return_tensors="pt", add_special_tokens=False)
output = model.generate(
**inputs,
max_new_tokens=160,
do_sample=True,
temperature=0.2,
top_p=0.85,
top_k=12,
repetition_penalty=1.12,
no_repeat_ngram_size=3,
eos_token_id=[tokenizer.convert_tokens_to_ids("<|end|>"), tokenizer.convert_tokens_to_ids("<|endoftext|>")],
pad_token_id=tokenizer.pad_token_id,
use_cache=True,
)
print(tokenizer.decode(output[0, inputs["input_ids"].shape[1]:], skip_special_tokens=True))
These recommended starting settings match the local inference defaults: temperature 0.2, top-p 0.85, top-k 12, repetition penalty 1.12, and up to 160 new tokens. Nova v1 was trained without a dedicated system role, so the example places its concise instruction in the user text. Keep the prompt and generated text within the 2,048-token context.
Training and evaluation
The repository contains the converted model weights and tokenizer. No benchmark results are included with this release; evaluate the model for your intended use before deployment.
License
The model weights and accompanying custom model code are released under the Apache License 2.0. See LICENSE. Upstream dataset terms continue to apply to training data.