/ Модель

Характеристики

Контекст
131 072 токена
Параметры
7,5 млрд
Размер весов
16,1 ГБ
Лицензия
Llama 3.1
Архитектура
llama · dense
Опубликована
14 авг 2024

Llama-3.1-8B-ArliAI-Formax-v1.0

Генерация текстаТекст → текст11 профессий

Чат-модель на базе Llama 3.1 8B Instruct, дообученная для точного соблюдения заданного формата ответов и подготовки структурированных данных.

42скачиваний за 30 дней13лайковвеса обновлены19 сен 2024

Бенчмарки

Как модель справилась с задачами пользователей ailist и что о ней публикуют открытые лидерборды

Тесты пользователейпока нет

Никто ещё не опубликовал тест этой модели. Соберите бенчмарк из своих задач — результат появится здесь.

  1. Добавьте модель в бенчмарк

    Вместе с другими моделями категории «Текст» — сравнение идёт внутри одной категории.

  2. Опишите свои задачи

    Напишите запросы, при необходимости приложите файлы и эталонные ответы.

  3. Запустите и опубликуйте

    Модели ответят на каждую задачу, судья оценит ответы. Опубликованный результат появится на этой странице.

Публичные оценки

Из открытых лидербордов. Сравнивайте результаты одного теста при одинаковых условиях — отсутствие оценки не значит, что модель хуже.

В подключённых источниках результатов для этой модели пока нет.

Что умеет модель

Описание составлено по карточке модели и метаданным Hugging Face

OwenArli/Llama-3.1-8B-ArliAI-Formax-v1.0 — чат-модель на архитектуре Llama 3.1, дообученная на базе Meta-Llama-3.1-8B-Instruct с помощью LoRA. Она предназначена для точного следования инструкциям о формате ответа и подходит для структурирования данных, создания наборов данных и других задач, где важно соблюдать заданную форму вывода. Модель принимает текст и генерирует текст; заявленное окно контекста — 131072 токена, а обучающая последовательность имела длину 8192 токена.

Разработчик описывает модель как мало ограничивающую ответы и хорошо следующую инструкциям. Это заявление из карточки модели, а не независимая оценка качества. Модель содержит 7,5 млрд параметров и распространяется в формате safetensors по лицензии Meta Llama 3.1 License. Карточка не приводит результатов независимых тестов.

Сценарии применения

  • форматирование ответов по заданной схеме
  • преобразование текста в структурированные данные
  • создание примеров для датасетов
  • извлечение сведений с выводом в заданном формате

Ограничения

Заявления о точном следовании формату и низком уровне ограничений приведены разработчиком и не подкреплены в карточке независимыми оценками. Обучение проводилось с последовательностями длиной 8192 токена, поэтому заявленное контекстное окно в 131072 токена не подтверждает качество на максимальной длине.

Для каких профессий подходит11

Разделы каталога профессий, в задачах которых используется эта модель

Все профессии

Также подходит для

Карточка модели

README от автора на Hugging Face, как он его опубликовал

Открыть на Hugging Face

Based on Meta-Llama-3.1-8B-Instruct, and is governed by Meta Llama 3.1 License agreement: https://huggingface.co/meta-llama/Meta-Llama-3.1-8B-Instruct

Formax is a model that specializes in following response format instructions. Tell it the format of it's response and it will follow it perfectly. Great for data processing and dataset creation tasks.

It is also a highly uncensored model that will follow your instructions very well.

You can try it at https://www.arliai.com

Ask questions in our new Discord Server! https://discord.gg/aDVx6FZN

Training:

  • 8192 sequence length
  • Training duration is around 3 days on 2x3090Ti
  • 1 epoch training with a massive dataset for minimized repetition sickness.
  • LORA with 64-rank 128-alpha resulting in ~2% trainable weights.

Quants:

FP16: https://huggingface.co/ArliAI/Llama-3.1-8B-ArliAI-Formax-v1.0

GGUF: https://huggingface.co/ArliAI/Llama-3.1-8B-ArliAI-Formax-v1.0-GGUF

Suggested prompting strategy:

<|begin_of_text|><|start_header_id|>system<|end_header_id|>

You are a [give it a role]. You are tasked with [give it a task]. Reply in the following format: [requested format of reply]<|eot_id|><|start_header_id|>user<|end_header_id|>

{{ user_message_1 }}<|eot_id|><|start_header_id|>assistant<|end_header_id|>

{{ model_answer_1 }}<|eot_id|><|start_header_id|>user<|end_header_id|>

{{ user_message_2 }}<|eot_id|><|start_header_id|>assistant<|end_header_id|>

Example prompt:

System prompt: Your task is to identify if any type of question is being asked by the user. If a question is being asked, respond 'YES'. If not, respone with 'NO'. Reply in the following format: {\n  \"response\": \"[YES or NO]\"\n}

User: You are an AI.

Response: {\n  \"response\": \"NO\"\n}
System: You are a professional writer. You should create captivating stories that are interesting to read. Reply with the following format:\n\nTitle: [Create a title for the story]\n\n Story: Under the sun of azgul, [continue story]

User: Create for me a story about an adventure in a fantasy world.

Response: Title: The Quest for the Golden Chalice\n\nStory: Under the sun of Azgul, where the sky was painted with hues of crimson and gold, the village of Brindlemark lay nestled within the heart of the Whispering Woods. It was a place where magic dwelled, and the air was alive with ancient secrets. The villagers lived in harmony with nature, their days filled with the rhythms of the forest. But amidst this tranquility, a sense of unease settled over the village like a shroud.\n\nRumors began to circulate about a legendary Golden Chalice, hidden deep within the woods, which held the power to heal any wound. The villagers whispered of its existence in hushed tones, their eyes gleaming with a mix of hope and trepidation. For in a world where magic was a double-edged sword, the Golden Chalice represented a beacon of hope, a chance to restore balance to the fragile ecosystem.\n\nAmong the villagers was a young apprentice named Eira, who possessed a natural affinity for magic. Her mentor, the wise and enigmatic Elwynn, recognized her potential and saw an opportunity to shape her into a powerful force for good. As the whispers of the Golden Chalice grew louder, Elwynn sensed a calling, a duty to protect the village and its people.\n\nWith a heavy heart, Elwynn approached Eira, his eyes clouded with concern. \"The time has come, child,\" he said, his voice low and urgent. \"We must embark on a perilous quest to retrieve the Golden Chalice. The fate of our village hangs in the balance.\" Eira's heart raced as she accepted the challenge, knowing that the journey would test her courage, wit, and resolve.\n\nAs they ventured into the unknown, the Whispering Woods loomed before them, its shadows whispering secrets in the wind. The air was thick with an otherworldly energy, and the trees seemed to watch them with ancient, knowing eyes. Eira felt the weight of her responsibility, the burden of her quest, and the uncertainty that lay ahead.\n\nTheir journey was fraught with danger, as they navigated treacherous landscapes and battled fearsome creatures. But Eira's determination and Elwynn's guidance saw them through the darkest moments. As they drew closer to their goal, the whispers of the forest grew louder, guiding them toward the hidden glade where the Golden Chalice lay waiting.\n\nIn the heart of the glade, surrounded by a halo of golden light, the Chalice shone like a beacon. Its beauty was mesmerizing, and Eira felt an overwhelming sense of wonder and awe. But as they reached out to claim it, a dark presence emerged from the shadows, its malevolent energy threatening to destroy the delicate balance of the forest.\n\nEira and Elwynn stood firm, their magic intertwined as they battled the darkness. The outcome hung in the balance, as the fate of the village and the forest teetered on the edge of destruction. In the end, it was Eira's unyielding spirit and Elwynn's wisdom that saved the day, as they emerged victorious, the Golden Chalice secure in their possession.With the Chalice in hand, Eira and Elwynn returned to Brindlemark, their hearts filled with hope and their souls renewed. The villagers rejoiced, their faces aglow with gratitude, as the Golden Chalice was used to heal the land and restore balance to the ecosystem. Eira's legend grew, as she became known throughout the realm as a hero, her name etched in the annals of history. And though the journey had been long and arduous, Eira knew that the true reward lay not in the treasure, but in the bonds forged along the way, and the knowledge that she had made a difference in the world.
System: Your are an intelligent AI assistant that can process texts. Always reply in json formatting when possible.

User: The following is a short story, identify all the characters in it.\n\nTitle: The Quest for the Golden Chalice\n\nStory: Under the sun of Azgul, where the sky was painted with hues of crimson and gold, the village of Brindlemark lay nestled within the heart of the Whispering Woods. It was a place where magic dwelled, and the air was alive with ancient secrets. The villagers lived in harmony with nature, their days filled with the rhythms of the forest. But amidst this tranquility, a sense of unease settled over the village like a shroud.\n\nRumors began to circulate about a legendary Golden Chalice, hidden deep within the woods, which held the power to heal any wound. The villagers whispered of its existence in hushed tones, their eyes gleaming with a mix of hope and trepidation. For in a world where magic was a double-edged sword, the Golden Chalice represented a beacon of hope, a chance to restore balance to the fragile ecosystem.\n\nAmong the villagers was a young apprentice named Eira, who possessed a natural affinity for magic. Her mentor, the wise and enigmatic Elwynn, recognized her potential and saw an opportunity to shape her into a powerful force for good. As the whispers of the Golden Chalice grew louder, Elwynn sensed a calling, a duty to protect the village and its people.\n\nWith a heavy heart, Elwynn approached Eira, his eyes clouded with concern. \"The time has come, child,\" he said, his voice low and urgent. \"We must embark on a perilous quest to retrieve the Golden Chalice. The fate of our village hangs in the balance.\" Eira's heart raced as she accepted the challenge, knowing that the journey would test her courage, wit, and resolve.\n\nAs they ventured into the unknown, the Whispering Woods loomed before them, its shadows whispering secrets in the wind. The air was thick with an otherworldly energy, and the trees seemed to watch them with ancient, knowing eyes. Eira felt the weight of her responsibility, the burden of her quest, and the uncertainty that lay ahead.\n\nTheir journey was fraught with danger, as they navigated treacherous landscapes and battled fearsome creatures. But Eira's determination and Elwynn's guidance saw them through the darkest moments. As they drew closer to their goal, the whispers of the forest grew louder, guiding them toward the hidden glade where the Golden Chalice lay waiting.\n\nIn the heart of the glade, surrounded by a halo of golden light, the Chalice shone like a beacon. Its beauty was mesmerizing, and Eira felt an overwhelming sense of wonder and awe. But as they reached out to claim it, a dark presence emerged from the shadows, its malevolent energy threatening to destroy the delicate balance of the forest.\n\nEira and Elwynn stood firm, their magic intertwined as they battled the darkness. The outcome hung in the balance, as the fate of the village and the forest teetered on the edge of destruction. In the end, it was Eira's unyielding spirit and Elwynn's wisdom that saved the day, as they emerged victorious, the Golden Chalice secure in their possession.With the Chalice in hand, Eira and Elwynn returned to Brindlemark, their hearts filled with hope and their souls renewed. The villagers rejoiced, their faces aglow with gratitude, as the Golden Chalice was used to heal the land and restore balance to the ecosystem. Eira's legend grew, as she became known throughout the realm as a hero, her name etched in the annals of history. And though the journey had been long and arduous, Eira knew that the true reward lay not in the treasure, but in the bonds forged along the way, and the knowledge that she had made a difference in the world.

Response: {\n  \"characters\": [\n    {\n      \"name\": \"Eira\",\n      \"description\": \"A young apprentice with a natural affinity for magic, who embarks on a perilous quest to retrieve the Golden Chalice.\"\n    },\n    {\n      \"name\": \"Elwynn\",\n      \"description\": \"Eira's mentor, a wise and enigmatic figure who recognizes her potential and guides her on the quest.\"\n    },\n    {\n      \"name\": \"The villagers of Brindlemark\",\n      \"description\": \"The inhabitants of the village, who live in harmony with nature and are affected by the quest for the Golden Chalice.\"\n    },\n    {\n      \"name\": \"The dark presence\",\n      \"description\": \"A malevolent force that emerges from the shadows, threatening to destroy the balance of the forest.\"\n    }\n  ]\n}

Как запустить

На своей GPU в ailist. Цена — по текущим предложениям провайдеров

GPU в ailist

Универсальный рантайм

Можно запустить

Подбираем GPU…

Класс архитектуры
LlamaForCausalLM
Ревизия весов
ed9ffca

0 моделей