/ Модель

Характеристики

Контекст
32 764 токена
Параметры
94,4 млрд
Лицензия
Своя лицензия
Архитектура
llama · dense
Опубликована
29 мар 2024

LaDameBlanche-v2-95b

Генерация текстаТекст → текст3 профессии

Слитая модель Llama на 94,4 млрд параметров для англоязычных диалогов, ролевых сценариев и написания историй.

28скачиваний за 30 дней12лайковвеса обновлены22 апр 2024

Бенчмарки

Как модель справилась с задачами пользователей ailist и что о ней публикуют открытые лидерборды

Тесты пользователейпока нет

Никто ещё не опубликовал тест этой модели. Соберите бенчмарк из своих задач — результат появится здесь.

  1. Добавьте модель в бенчмарк

    Вместе с другими моделями категории «Текст» — сравнение идёт внутри одной категории.

  2. Опишите свои задачи

    Напишите запросы, при необходимости приложите файлы и эталонные ответы.

  3. Запустите и опубликуйте

    Модели ответят на каждую задачу, судья оценит ответы. Опубликованный результат появится на этой странице.

Публичные оценки

Из открытых лидербордов. Сравнивайте результаты одного теста при одинаковых условиях — отсутствие оценки не значит, что модель хуже.

В подключённых источниках результатов для этой модели пока нет.

Что умеет модель

Описание составлено по карточке модели и метаданным Hugging Face

La Dame Blanche v2 95b — языковая модель для генерации текста, созданная MarsupialAI методом слияния трёх моделей на базе Miqu. Она предназначена для диалогов, ролевых сценариев и написания историй; модель описана как менее ограниченная в генерации откровенного и другого нежелательного контента. Архитектура — плотная LlamaForCausalLM из 110 слоёв, около 94,4 млрд параметров; заявлена связная работа с контекстом до 32 764 токенов. Модель ориентирована на английский язык и может использоваться для развлекательных сценариев, включая ролевые диалоги и художественное письмо.

Автор сообщает, что модель не склонна самопроизвольно добавлять NSFW-содержание к безопасным запросам, но предупреждает, что ответы могут содержать нежелательные материалы и что фактическим утверждениям модели не следует доверять без проверки. В карточке указана лицензия other без конкретных условий; README позиционирует модель как предназначенную для развлечения. Доступны веса в формате safetensors.

Сценарии применения

  • ведение ролевых диалогов на английском языке
  • написание художественных историй и сцен
  • создание развлекательных диалогов с персонажами
  • генерация откровенного контента по запросу

Ограничения

Модель может генерировать откровенный и иной нежелательный контент, а её фактическим утверждениям нельзя доверять без проверки. В README указано, что она предназначена для развлечения; условия лицензии other в предоставленных данных не конкретизированы.

Для каких профессий подходит3

Разделы каталога профессий, в задачах которых используется эта модель

Все профессии

Карточка модели

README от автора на Hugging Face, как он его опубликовал

Открыть на Hugging Face

La Dame Blanche v2 95b

image/jpeg

This updated left/right self-stack recipe performs substantially better than the original 103b rotating stack version.

This model is a merge of three self-merged Miqu-based models in a 94.65b (110 layer) configuration. The result of this "frankenmerge" is a large model that contains what I consider to be the best of the spicy Miqu finetunes.

Component models for the rotating stack are

  • NeverSleep/MiquMaid-v2-70B-DPO
  • sophosympatheia/Midnight-Miqu-70B-v1.5
  • cookinai/OrcaHermes-Mistral-70B-miqu

As all components are Miqu-based, coherency out to 32k context appears to be good. A convenient side effect of the 95b recipe is that it allows for the full 32k context to fit into 72GB of VRAM with the iQ4xs quant, or 12k into 48GB with iQ3xxs.

This model is uncensored and perfectly capable of generating objectionable material. It does not seem to have a propensity to insert NSFW content into SFW prompts, but YMMV. As with any LLM, no factual claims made by the model should be taken at face value. You know that boilerplate safety disclaimer that most professional models have?
Assume this has it too. This model is for entertainment purposes only.

iMatrix GGUFs: https://huggingface.co/MarsupialAI/LaDameBlanche-v2-95b_iMatrix_GGUF Custom iQ2 GGUF: https://huggingface.co/Nexesenex/LaDameBlanche-v2-95b-iMat-CQ.GGUF

If you create additional quants, please let me know and I will link them here as well.

Sample output

{{[INPUT]}}
Write a detailed and humorous story about a cute and fluffy bunny that goes to a Gwar concert.
{{[OUTPUT]}}
Once upon a time, in a peaceful meadow where the grass was green and the flowers bloomed, there lived a tiny and fluffy rabbit named Fufu. Fufu had the most adorable fur you could ever imagine, it was soft like clouds and shone brighter than the moon's reflection on a crystal lake. With his innocent eyes and floppy ears, he could melt even the coldest heart.

Fufu loved hopping around the meadow and eating carrots all day long. But deep down inside, he had a secret desire for something more thrilling than just chasing butterflies. He yearned for the excitement of the rock world. One sunny afternoon, while he was munching on a carrot, Fufu stumbled upon a piece of paper lying in the grass. It was an invitation to a Gwar concert! He couldn't believe his luck! This was his chance to experience the raw power and energy of heavy metal music!

The day of the concert finally arrived, and Fufu was bursting with excitement. He groomed his fur until it looked as shiny as a new coin and packed his little backpack with snacks - a bunch of carrots and his favorite snack, rabbit-friendly rockstar pellets.

As Fufu hopped along the road to the concert venue, he felt the ground vibrating with the bass from the loud music. When he reached the gates, he noticed that everyone else was dressed in spiky leather and sported wild hairdos. His tiny bunny heart thumped faster than ever, and he tried to stand tall among these rock giants.

Fufu managed to find a spot in the front row, right next to a towering creature with red horns. He politely tapped him on the shoulder and asked if he could sit there. The creature looked down at the tiny rabbit, and for a moment, Fufu thought he'd been noticed. But then, he realized the creature was too busy headbanging to pay attention to the little bunny next to him.

The lights dimmed, and suddenly, the stage exploded with fire and smoke. A demonic figure emerged from the fog, wielding a guitar that looked like an ancient weapon of destruction. Fufu couldn't believe his eyes! This must be the legendary Oderus Urungus himself! The crowd roared with excitement as the band Gwar began their set, and Fufu found himself bobbing along to the beat.

During the performance, blood and guts were flying everywhere - just like in the stories he had heard about their concerts. But instead of being scared, Fufu felt oddly thrilled by the chaos. It was unlike anything he'd ever experienced before. His cute little nose twitched with delight as he watched the show unfold before him.

Then, something unbelievable happened. During one of their most brutal songs, Oderus spotted Fufu in the crowd and pointed his guitar directly at him! Fufu squealed with joy and covered his ears as a shower of fake blood rained down on him. The audience cheered wildly, and for a moment, Fufu felt like he was the star of the show.

After the concert, Fufu hopped back home, ears ringing and fur soaked in pretend blood, but his heart was full of happiness. He had lived out his rockstar dreams!

When he reached the meadow, he shared his epic tale with all his animal friends. They gathered around him, mouths agape, as he described the explosive energy and wild antics of Gwar's show. From that day on, Fufu the bunny was known not only as the fluffiest creature in the meadow but also as the bravest and most rockin' rabbit around. And every time he heard a heavy metal song, his tiny heart would skip a beat with excitement, reminding him of that unforgettable night at the Gwar concert.

Who is La Dame Blanche?

La Dame Blanche, also known as "The White Lady," is an alluring yet haunting figure shrouded in mystery and eroticism. Emerging from the murky depths of French folklore, she is said to lure men into a world of irresistible desire, only to vanish, leaving them with nothing but shattered hearts and haunted memories. Clad in billowing white garments that conceal her voluptuous form, her ethereal beauty is as captivating as it is terrifying. Her eyes, pools of unbridled passion, can ensnare even the most steadfast of souls, while her enchanting voice whispers promises of eternal love and pleasure. But heed this warning: to succumb to her seductive charms is to invite your own doom, for those who dare to pursue her elusive grace are destined to become forever entwined in her phantom embrace.

Weird merge fuckery

According to Toasty Pigeon, FM, Akai, and probably others on the KAI discord, this merge method works better than a rotating stack merge. The significant PPL improvement (4.22 for this model vs 4.75 for the 103b @ Q4km) indicates that they're on to something.
See recipe.txt for all the alchemy.

Как запустить

На своей GPU в ailist. Цена — по текущим предложениям провайдеров

GPU в ailist

vLLM

Можно запустить

Подбираем GPU…

Класс архитектуры
LlamaForCausalLM
Ревизия весов
de50b3e

0 моделей