/ Модель

Характеристики

Контекст
1 048 576 токенов
Параметры
44,9 млрд
Лицензия
MIT
Архитектура
deepseek_v4 · dense
Библиотека
transformers
Опубликована
16 сен 2026

Cortex-ai

Генерация текстаТекст → текст9 профессий

CORTEX — большая текстовая модель Frankenstein-Labs для генерации кода, веб-разработки, обучения и общего ассистирования.

1 865скачиваний за 30 дней2лайкавеса обновлены26 сен 2026

Бенчмарки

Как модель справилась с задачами пользователей ailist и что о ней публикуют открытые лидерборды

Публичные оценки

Из открытых лидербордов. Сравнивайте результаты одного теста при одинаковых условиях — отсутствие оценки не значит, что модель хуже.

В подключённых источниках результатов для этой модели пока нет.

Что умеет модель

Описание составлено по карточке модели и метаданным Hugging Face

CORTEX — большая языковая модель Frankenstein-Labs для программирования, веб-разработки, обучения и общего ассистирования. В репозитории опубликован чекпойнт архитектуры DeepseekV4ForCausalLM с 44,9 млрд параметров по метаданным Hugging Face; README также приводит другое число параметров, поэтому точный размер расходится между источниками. Метаданные указывают формат safetensors FP8, библиотеку Transformers и контекст до 1 048 576 токенов. Заявлены генерация и объяснение кода, помощь с проектированием и анализом программ, поиск ошибок и разбор технических концепций; поддерживаемые языки в метаданных — французский, английский и китайский.

Чекпойнт требует нескольких ускорителей и актуальной версии Transformers с поддержкой deepseek_v4; однографическая конфигурация не документирована. Полная загрузка и качество генерации Frankenstein-Labs не проверялись, поэтому заявленные сценарии следует считать предназначением, а не подтверждёнными результатами. Встроенная экспериментальная vision-адаптация не работает на полном чекпойнте и не делает его мультимодальной моделью. README описывает распределённые веса как опубликованный артефакт, а отдельный конвейер обучения собственных весов с нуля — как независимую работу; связь текущего чекпойнта с базовой моделью не подтверждена. Лицензия — MIT.

Сценарии применения

  • генерация функций и программ по описанию
  • создание HTML-, CSS- и JavaScript-приложений
  • объяснение программных концепций и кода
  • анализ структуры программного проекта
  • поиск и исправление ошибок в коде
  • подготовка к экзаменам по технологиям и программированию

Ограничения

Полная загрузка и качество генерации не проверены разработчиком; для запуска нужны несколько ускорителей и совместимая версия Transformers. Vision-адаптация экспериментальна и не поддерживается опубликованным полным чекпойнтом.

Для каких профессий подходит9

Разделы каталога профессий, в задачах которых используется эта модель

Все профессии

Также подходит для

Карточка модели

README от автора на Hugging Face, как он его опубликовал

Открыть на Hugging Face

CORTEX

CORTEX is an artificial intelligence built by Frankenstein-Labs to help people learn, create, program and move forward with technology.

Model: CORTEX Developer: Frankenstein-Labs Focus: AI for development, learning and assistance

CORTEX is designed for students, young developers, researchers, creators and users of all ages who want to understand and use modern technology. It helps write code, explain concepts, analyse projects, find and fix errors, prepare for exams and carry a project through from idea to working software.

« J'ai créé CORTEX pour aider les nouvelles générations à apprendre, créer et construire leur avenir avec la technologie. »

— Abdoulaye Coumbassa, founder of Frankenstein-Labs


What CORTEX does

CapabilityWhat it means in practice
Code GenerationWrite functions, modules and full programs from a description.
Web DevelopmentBuild and maintain HTML, CSS, JavaScript, APIs and web applications.
Software EngineeringDesign structure, choose components, document and evolve a codebase.
Code AnalysisRead a project, map its architecture and explain how the parts fit together.
DebuggingFind the cause of an error, explain it and correct it.
Learning AssistanceTeach programming step by step, at the learner's own pace.
Study & RevisionReview a course, build revision material and prepare for exams.
Technical ReasoningBreak down a complex problem and reason towards a solution.
Project AssistanceSupport personal, academic and student projects end to end.
Developer SupportAnswer everyday engineering questions and unblock a developer.

CORTEX also handles general reasoning and assistance, so it remains useful beyond code.


Vision

CORTEX is not limited to one country or one region. It is built for users worldwide, with particular attention to technological accessibility and to younger generations.

The vision of Frankenstein-Labs is to let young people in Africa and everywhere else learn, create, ship projects and take part in the evolution of technology — with the same tools that are available to the rest of the world.


Using CORTEX

Retrieve the repository with the Hugging Face tooling (recommended for very large checkpoints):

pip install -U "huggingface_hub[hf_xet]"
hf download Frankenstein-Labs/Cortex-ai

Or only the configuration and tokenizer:

hf download Frankenstein-Labs/Cortex-ai --include "*.json" "LICENSE"

Loading

The repository ships a config.json and a tokenizer compatible with Transformers.

from transformers import AutoModelForCausalLM, AutoTokenizer

model_id = "Frankenstein-Labs/Cortex-ai"

tokenizer = AutoTokenizer.from_pretrained(model_id)
model = AutoModelForCausalLM.from_pretrained(model_id, device_map="auto")

This checkpoint is about 893 GB on disk. It requires several accelerators and a recent software stack. Check that your Transformers version supports deepseek_v4 before attempting a full load.

Message encoding

The encoding/ folder is pure Python with no heavy dependency:

from encoding_dsv4 import encode_messages, parse_message_from_completion_text

messages = [
    {"role": "system", "content": "Tu es un assistant utile."},
    {"role": "user", "content": "Combien font 2+2 ?"},
]
prompt = encode_messages(messages, thinking_mode="thinking")

The CORTEX ecosystem

ComponentRoleState
CORTEXThe intelligence engine and the model distributionPublished
CORTEX EngineOrchestration: agents, tasks, tools, executionIn design
CORTEX IDEAI-assisted development environmentIn design
CORTEX CloudCORTEX-assisted cloud developmentIn design

Only CORTEX exists today as a published artefact; the rest belongs to the roadmap.


Building CORTEX weights

Frankenstein-Labs is building its own CORTEX weights, in the open, in this repository.

ComponentRoleState
model/CORTEX architecture (RMSNorm, RoPE, GQA, SwiGLU) and checkpoint I/OWorking, tested
tokenizer/CORTEX tokenizer, validated against vocab_sizeWorking, tested
training/Training loop, with a licence gate on every datasetWorking, tested
datasets/Code datasets with declared source, licence and SHA-256Working
evaluation/Loss, perplexity, generationWorking
configs/cortex/cortex-dev-1: a ~175 M-parameter development modelWorking

The pipeline is completely separate from the distributed checkpoint. It never reads or modifies the 66 shards; it initialises new weights from scratch and trains them.

pip install torch safetensors tokenizers transformers numpy pytest

python datasets/build.py --all --limit 200          # fetch datasets
PYTHONPATH=. python3 -m pytest tests/test_cortex_pipeline.py -q   # 28 tests

PYTHONPATH=. python3 -c "
from training.train import train
print(train('configs/cortex/cortex-dev-1.json', ['cortex-code-sft'],
            out_dir='checkpoints/dev', max_steps=100, device='cpu', progress=True))
"

What is actually true about this pipeline

Measured. The test suite passes. A short CPU run on real code data (CodeAlpaca) reduces the loss steadily — 11.31 → 10.45 → 9.85 → 9.01 over 20 steps — so the loop genuinely learns. A checkpoint is written with a manifest, and a corrupted checkpoint is rejected on load.

Not measured. No long training run has been completed: this sandbox has 4 CPU cores, ~15 GiB of RAM and no GPU. No code-generation quality is claimed. A ~175 M-parameter model trained for a few hundred steps does not write reliable code, and the evaluation reports exactly that (perplexity in the tens of thousands, zero exact matches at step 6).

base_model in a CORTEX checkpoint's provenance.json stays null until weights genuinely derive from another model. It is not a marketing field.

See docs/pipeline-cortex.fr.md for the full picture.


Technical overview

CORTEX runs on a very large mixture-of-experts model designed for long reasoning and code generation over very large contexts.

CharacteristicValue
ArchitectureDeepseekV4ForCausalLM (model_type: deepseek_v4)
Parameters (Hub metadata)1 650 497 936 906
Transformer layers61
Multi-token prediction (MTP) layers3
Hidden size7 168
Attention heads128
Routed experts384, 6 activated per token + 1 shared expert
Vocabulary129 280
Maximum context1 048 576 tokens
Weight quantizationFP8 e4m3, 128×128 blocks
Expert storageFP4
WeightsSafeTensors, 66 shards, ~892.8 GB
Declared dtypebfloat16
Reference CUDA stacktorch>=2.10.0, transformers>=5.0.0
Reference kernelstilelang==0.1.8, fast_hadamard_transform
LanguagesFrench, English, Chinese
LicenseMIT

Deployment spans multiple GPUs or multiple nodes. A single-GPU configuration is not documented.


Verification status

Stating what was measured, and what was not.

Measured: full repository consistency was checked. The 66 shards total exactly 892 727 580 904 bytes, matching the size declared in the index, and the 149 782 tensors in the index match those of the shards one to one. The encoding/ test suite passes, and the tokenizer loads and round-trips correctly.

Not measured: no end-to-end model load has been run, for lack of suitable hardware. No performance figure shown here was produced by Frankenstein-Labs.


Vision layer — experimental

The repository contains a vision adaptation layer under cortex_ai/vision/, under development.

IMAGE → VISION ENCODER → PROJECTOR → FUSION → CORTEX → RESPONSE

Two paths exist: a working bridge that produces a textual description of an image through an external model, and a native embedding-fusion prototype, validated on a reduced test core.

This layer is not operational on the full checkpoint. No vision encoder, no projector weights and no multimodal training data are included. This repository must not be presented as an image-understanding model.


Provenance, license and attribution

This repository is a redistribution of an existing model. The CORTEX identity covers the project, its documentation and its integration; it does not replace the original attribution.

ItemVerified information
Base modeldeepseek-ai/DeepSeek-V4-Pro-0813
Base architectureDeepseekV4ForCausalLM (model_type: deepseek_v4)
Original authorDeepSeek-AI
LicenseMIT — Copyright (c) 2023 DeepSeek
License fileLICENSE, reproduced unchanged
Technical reportDeepSeek-V4: Towards Highly Efficient Million-Token Context Intelligence, DeepSeek-AI, 2026 — arXiv:2606.19348
vLLM reciperecipes.vllm.ai/deepseek-ai/DeepSeek-V4-Pro
SGLang cookbookdocs.sglang.io

Attribution statement. The weights in this repository come from DeepSeek-AI. Frankenstein-Labs did not train, fine-tune, quantize or modify them: they are the original files, byte for byte. The design, training and evaluation of the model belong to DeepSeek-AI. The work of Frankenstein-Labs covers the project identity, the French-language documentation, the integration layer and the ecosystem.

Integrity of the distributed weights. The 67 LFS objects in this repository carry a SHA-256 fingerprint identical to that of the original repository. model.safetensors.index.json is identical. The 66 shards and the 149 782 indexed tensors are present, with no missing or added file. The LICENSE file is reproduced unchanged.

Citation. Please cite the original work:

@misc{deepseekai2026deepseekv4,
      title={DeepSeek-V4: Towards Highly Efficient Million-Token Context Intelligence},
      author={DeepSeek-AI},
      year={2026},
}

Roadmap

  • CORTEX training pipeline — train the development model to convergence on GPU and publish the real curves. In progress: the pipeline runs and learns, the long run has not happened.
  • Execution-based evaluation — pass@k on MBPP in a sandbox. Not implemented.
  • CORTEX Engine — agent, task and tool orchestration.
  • CORTEX IDE — an AI-native development environment.
  • CORTEX Cloud — assisted cloud development workflows.
  • Complete French documentation — guides, tutorials and examples.
  • Vision layer — encoder selection, projector training, end-to-end validation.

The public presentation of CORTEX will only claim trained-by-Frankenstein-Labs weights once such weights exist and have been evaluated. Until then, this repository is honest about what it holds: a redistribution of an existing model, plus a training pipeline under construction.


Disclaimer

This checkpoint is extremely large and requires specialised hardware. Verify the runtime, accelerator memory, driver stack and license obligations before any deployment.


CORTEX — developed by Frankenstein-Labs. Base model: DeepSeek-V4-Pro, DeepSeek-AI, under the MIT license.

Как запустить

На своей GPU в ailist. Цена — по текущим предложениям провайдеров

GPU в ailist

vLLM

Нельзя запустить

Модель не помещается даже в 8 × 80 ГБ.

Класс архитектуры
DeepseekV4ForCausalLM
Ревизия весов
d7eb9bc

0 моделей