/ Модель

Характеристики

Контекст
4 096 токенов
Параметры
10,6 млрд
Размер весов
42,9 ГБ
Лицензия
Apache 2.0
Архитектура
llama · dense
Базовая модель
SOLAR-10.7B-v1.0
Библиотека
transformers
Опубликована
5 фев 2024

corningQA-solar-10.7b-v1.0

Генерация текстаТекст → текст3 профессии

Доменная языковая модель на базе SOLAR-10.7B для многоходовых диалогов и ответов на вопросы по химии.

16скачиваний за 30 дней0лайковвеса обновлены7 апр 2024

Бенчмарки

Как модель справилась с задачами пользователей ailist и что о ней публикуют открытые лидерборды

Тесты пользователейпока нет

Никто ещё не опубликовал тест этой модели. Соберите бенчмарк из своих задач — результат появится здесь.

  1. Добавьте модель в бенчмарк

    Вместе с другими моделями категории «Текст» — сравнение идёт внутри одной категории.

  2. Опишите свои задачи

    Напишите запросы, при необходимости приложите файлы и эталонные ответы.

  3. Запустите и опубликуйте

    Модели ответят на каждую задачу, судья оценит ответы. Опубликованный результат появится на этой странице.

Публичные оценки

Из открытых лидербордов. Сравнивайте результаты одного теста при одинаковых условиях — отсутствие оценки не значит, что модель хуже.

В подключённых источниках результатов для этой модели пока нет.

Что умеет модель

Описание составлено по карточке модели и метаданным Hugging Face

CorningQA-solar-10.7b-v1.0 — доменно-специализированная языковая модель для многоходовых диалогов в химической тематике. Модель создана на базе SOLAR-10.7B-v1.0 и дообучена на наборе myngsoooo/CorningAI-DocQA.

Это плотная авторегрессионная модель архитектуры Llama с 10,6 млрд параметров. Она принимает текст и генерирует текст, поддерживает английский язык и имеет контекстное окно 4096 токенов. Для запуска предусмотрена библиотека Transformers; веса представлены в формате PyTorch.

Модель подходит для диалоговых вопросов и ответов по химическим темам, однако карточка не приводит оценок качества или подробных границ охвата. Лицензия — Apache-2.0.

Сценарии применения

  • многоходовые диалоги по химической тематике
  • ответы на вопросы по химическим документам
  • поиск справочной информации о химии в формате диалога

Ограничения

Карточка не содержит количественных оценок качества и подробных сведений о пределах охвата химических тем.

Для каких профессий подходит3

Разделы каталога профессий, в задачах которых используется эта модель

Все профессии

Карточка модели

README от автора на Hugging Face, как он его опубликовал

Открыть на Hugging Face

Introduction

This is a corning domain-specific model that has been trained to support multi-turn conversations in chemistry-related domains.

Loading the Model

Use the following Python code to load the model:

import torch
from transformers import AutoModelForCausalLM, AutoTokenizer

tokenizer = AutoTokenizer.from_pretrained("nayohan/corningQA-solar-10.7b-v1.0")
model = AutoModelForCausalLM.from_pretrained(
    "nayohan/corningQA-solar-10.7b-v1.0",
    device_map="auto",
    torch_dtype=torch.float16,
)

Generating Text

To generate text, use the following Python code:

# SYSTEM PROMPT
context="A New CCn Inverter Circuit For AMLCD Panels Results In Significantly Higher Efficiency And Brightness Mehmet K. Nalbant Linfinity Microelectronics 11861 Western Ave., Garden Grove, CA 92641 Tel: (714) 898-8121 Fax: (714) 893-2570 Abstract - The paper will discuss a new CCFL inverter that is based on a new control technique named the Current Synchronous Zero Voltage Switching (CS-ZVS) topology. This topology enables the design of very eficient dimmable CCFL inverter"
diaogues= "Speaker 1: What is the name of the new control technique used in the CCFL inverter?\nSpeaker 2: The new control technique is called Current Synchronous Zero Voltage Switching (CS-ZVS) topology.\nSpeaker 1: Can you tell me more about the CS-ZVS topology?\nSpeaker 2: Sure! The CS-ZVS topology is a new control technique that allows for the design of highly efficient and dimmable CCFL inverters.\nSpeaker 1: That sounds impressive. How does it achieve higher efficiency and brightness?\nSpeaker 2: Well, the CS-ZVS topology synchronizes the switching of the inverter with the current flow, resulting in lower losses and improved performance.\nSpeaker 1: I see. So, is this new CCFL inverter already available in the market?\nSpeaker 2: Yes, it is. It was developed by Linfinity Microelectronics and is currently being used in AMLCD panels to improve their efficiency and brightness.\nSpeaker 1: That's amazing. I'm sure this new inverter will be very popular in the market.\nSpeaker 2: ###"

text = f"""
You will be shown dialogues between Speaker 1 and Speaker 2. Please read and understand given Dialogue Session,
then complete the task under the guidance of Task Introduction.\n
Context: {context}
Dialogue Session: {diaogues}
Task Introduction: After reading the Dialogue Session, please create an appropriate response in the parts marked ###.
Task Result:
"""
inputs = tokenizer(text, return_tensors="pt").to('cuda')

outputs = model.generate(**inputs, max_new_tokens=64)
print(tokenizer.decode(outputs[0], skip_special_tokens=True))

# USER INPUT:
{context}: A New CCn Inverter Circuit For AMLCD Panels Results In Significantly Higher Efficiency And Brightness Mehmet K. Nalbant Linfinity Microelectronics 11861 Western Ave., Garden Grove, CA 92641 Tel: (714) 898-8121 Fax: (714) 893-2570 Abstract - The paper will discuss a new CCFL inverter that is based on a new control technique named the Current Synchronous Zero Voltage Switching (CS-ZVS) topology. This topology enables the design of very eficient dimmable CCFL inverter
{diaogues}: Speaker 1: What is the name of the new control technique used in the CCFL inverter?\nSpeaker 2: The new control technique is called Current Synchronous Zero Voltage Switching (CS-ZVS) topology.\nSpeaker 1: Can you tell me more about the CS-ZVS topology?\nSpeaker 2: Sure! The CS-ZVS topology is a new control technique that allows for the design of highly efficient and dimmable CCFL inverters.\nSpeaker 1: That sounds impressive. How does it achieve higher efficiency and brightness?\nSpeaker 2: Well, the CS-ZVS topology synchronizes the switching of the inverter with the current flow, resulting in lower losses and improved performance.\nSpeaker 1: I see. So, is this new CCFL inverter already available in the market?\nSpeaker 2: Yes, it is. It was developed by Linfinity Microelectronics and is currently being used in AMLCD panels to improve their efficiency and brightness.\nSpeaker 1: That's amazing. I'm sure this new inverter will be very popular in the market.\nSpeaker 2: ###

# OUTPUT:
nayohan/corningQA-llama2-13b-chat: Yes, we are confident that it will revolutionize the CCFL inverter market.

Full example

Context: A New CCn Inverter Circuit For AMLCD Panels Results In Significantly Higher Efficiency And Brightness Mehmet K. Nalbant Linfinity Microelectronics 11861 Western Ave., Garden Grove, CA 92641 Tel: (714) 898-8121 Fax: (714) 893-2570 Abstract - The paper will discuss a new CCFL inverter that is based on a new control technique named the Current Synchronous Zero Voltage Switching (CS-ZVS) topology. This topology enables the design of very eficient dimmable CCFL inverter
Dialogue Session: Speaker 1: What is the name of the new control technique used in the CCFL inverter?
Speaker 2: The new control technique is called Current Synchronous Zero Voltage Switching (CS-ZVS) topology.
Speaker 1: Can you tell me more about the CS-ZVS topology?
Speaker 2: Sure! The CS-ZVS topology is a new control technique that allows for the design of highly efficient and dimmable CCFL inverters.
Speaker 1: That sounds impressive. How does it achieve higher efficiency and brightness?
Speaker 2: Well, the CS-ZVS topology synchronizes the switching of the inverter with the current flow, resulting in lower losses and improved performance.
Speaker 1: I see. So, is this new CCFL inverter already available in the market?
Speaker 2: Yes, it is. It was developed by Linfinity Microelectronics and is currently being used in AMLCD panels to improve their efficiency and brightness.
Speaker 1: That's amazing. I'm sure this new inverter will be very popular in the market.
Speaker 2: ###
Task Introduction: After reading the Dialogue Session, please create an appropriate response in the parts marked ###.
Task Result:
Yes, we are confident that it will revolutionize the CCFL inverter market.

License

@misc{kim2023solar,
      title={SOLAR 10.7B: Scaling Large Language Models with Simple yet Effective Depth Up-Scaling}, 
      author={Dahyun Kim and Chanjun Park and Sanghoon Kim and Wonsung Lee and Wonho Song and Yunsu Kim and Hyeonwoo Kim and Yungi Kim and Hyeonju Lee and Jihoo Kim and Changbae Ahn and Seonghoon Yang and Sukyung Lee and Hyunbyung Park and Gyoungjin Gim and Mikyoung Cha and Hwalsuk Lee and Sunghun Kim},
      year={2023},
      eprint={2312.15166},
      archivePrefix={arXiv},
      primaryClass={cs.CL}
}

Our trainig code can be found here: Github: https://github.com/nayohan/2023-Corning-AI-Challenge

Как запустить

На своей GPU в ailist. Цена — по текущим предложениям провайдеров

GPU в ailist

Универсальный рантайм · transformers

Можно запустить

Подбираем GPU…

Класс архитектуры
LlamaForCausalLM
Ревизия весов
dff1bb0

0 моделей