/ Модель

Характеристики

Лицензия
Своя лицензия
Архитектура
segformer · dense
Базовая модель
mit-b0
Библиотека
transformers
Опубликована
16 дек 2024

segformer-b0-finetuned-Eduardo-food103-GOOGLE100

Сегментация изображенийИзображение → mask3 профессии

SegFormer B0, дообученная для выделения пикселей продуктов и блюд на изображениях по категориям FoodSeg103.

90скачиваний за 30 дней0лайковвеса обновлены18 дек 2024

Бенчмарки

Как модель справилась с задачами пользователей ailist и что о ней публикуют открытые лидерборды

Публичные оценки

Из открытых лидербордов. Сравнивайте результаты одного теста при одинаковых условиях — отсутствие оценки не значит, что модель хуже.

В подключённых источниках результатов для этой модели пока нет.

Что умеет модель

Описание составлено по карточке модели и метаданным Hugging Face

Это дообученная модель SegFormer B0, разработанная автором репозитория на базе nvidia/mit-b0 и обученная на датасете FoodSeg103. Она предназначена для семантической сегментации изображений еды: модель выделяет пиксели, относящиеся к фону и категориям продуктов и блюд, например мясу, овощам, фруктам и гарнирам.

Модель принимает изображения и выдаёт карту сегментации. В карточке приведены результаты оценки: mean IoU 0,0515 и общая точность 0,2045; эти показатели указывают на низкое качество сегментации на указанной оценочной выборке. Для надёжного применения в реальных сценариях потребуется отдельная проверка и, вероятно, дообучение. Модель распространяется в формате safetensors; лицензия указана как other, поэтому условия использования следует сверить с карточкой репозитория.

Сценарии применения

  • сегментация ингредиентов на фотографии блюда
  • выделение мяса, овощей и гарниров на изображении еды
  • создание масок объектов для анализа фотографий продуктов

Ограничения

На оценочной выборке модель показала низкие метрики: mean IoU 0,0515 и общую точность 0,2045; результаты по многим классам отсутствуют или равны нулю. Лицензия обозначена как other, поэтому перед использованием нужно проверить её условия в карточке модели.

Для каких профессий подходит3

Разделы каталога профессий, в задачах которых используется эта модель

Все профессии

Карточка модели

README от автора на Hugging Face, как он его опубликовал

Открыть на Hugging Face

segformer-b0-finetuned-Eduardo-food103-GOOGLE100

This model is a fine-tuned version of nvidia/mit-b0 on the EduardoPacheco/FoodSeg103 dataset. It achieves the following results on the evaluation set:

  • Loss: 2.0865
  • Mean Iou: 0.0515
  • Mean Accuracy: 0.1257
  • Overall Accuracy: 0.2045
  • Accuracy Background: nan
  • Accuracy Candy: nan
  • Accuracy Egg tart: nan
  • Accuracy French fries: 0.0
  • Accuracy Chocolate: nan
  • Accuracy Biscuit: nan
  • Accuracy Popcorn: nan
  • Accuracy Pudding: nan
  • Accuracy Ice cream: 0.0
  • Accuracy Cheese butter: 0.0
  • Accuracy Cake: 0.0
  • Accuracy Wine: 0.0
  • Accuracy Milkshake: nan
  • Accuracy Coffee: nan
  • Accuracy Juice: 0.0
  • Accuracy Milk: nan
  • Accuracy Tea: nan
  • Accuracy Almond: nan
  • Accuracy Red beans: nan
  • Accuracy Cashew: nan
  • Accuracy Dried cranberries: nan
  • Accuracy Soy: nan
  • Accuracy Walnut: nan
  • Accuracy Peanut: nan
  • Accuracy Egg: nan
  • Accuracy Apple: nan
  • Accuracy Date: nan
  • Accuracy Apricot: nan
  • Accuracy Avocado: nan
  • Accuracy Banana: nan
  • Accuracy Strawberry: nan
  • Accuracy Cherry: nan
  • Accuracy Blueberry: nan
  • Accuracy Raspberry: nan
  • Accuracy Mango: nan
  • Accuracy Olives: nan
  • Accuracy Peach: 0.0
  • Accuracy Lemon: nan
  • Accuracy Pear: nan
  • Accuracy Fig: nan
  • Accuracy Pineapple: nan
  • Accuracy Grape: nan
  • Accuracy Kiwi: nan
  • Accuracy Melon: nan
  • Accuracy Orange: 0.0
  • Accuracy Watermelon: nan
  • Accuracy Steak: 0.8548
  • Accuracy Pork: 0.5362
  • Accuracy Chicken duck: 0.3458
  • Accuracy Sausage: 0.0
  • Accuracy Fried meat: nan
  • Accuracy Lamb: 0.0
  • Accuracy Sauce: 0.0
  • Accuracy Crab: nan
  • Accuracy Fish: nan
  • Accuracy Shellfish: 0.0
  • Accuracy Shrimp: 0.0
  • Accuracy Soup: 0.0
  • Accuracy Bread: 0.0157
  • Accuracy Corn: 0.0
  • Accuracy Hamburg: nan
  • Accuracy Pizza: nan
  • Accuracy hanamaki baozi: 0.0
  • Accuracy Wonton dumplings: nan
  • Accuracy Pasta: nan
  • Accuracy Noodles: 0.2191
  • Accuracy Rice: 0.3396
  • Accuracy Pie: 0.0
  • Accuracy Tofu: 0.0
  • Accuracy Eggplant: nan
  • Accuracy Potato: 0.6707
  • Accuracy Garlic: nan
  • Accuracy Cauliflower: 0.0
  • Accuracy Tomato: 0.0295
  • Accuracy Kelp: nan
  • Accuracy Seaweed: nan
  • Accuracy Spring onion: 0.0
  • Accuracy Rape: 0.0
  • Accuracy Ginger: nan
  • Accuracy Okra: 0.0
  • Accuracy Lettuce: 0.0014
  • Accuracy Pumpkin: nan
  • Accuracy Cucumber: 0.2728
  • Accuracy White radish: 0.0
  • Accuracy Carrot: 0.9345
  • Accuracy Asparagus: nan
  • Accuracy Bamboo shoots: nan
  • Accuracy Broccoli: 0.7618
  • Accuracy Celery stick: 0.0400
  • Accuracy Cilantro mint: 0.0
  • Accuracy Snow peas: nan
  • Accuracy cabbage: nan
  • Accuracy Bean sprouts: nan
  • Accuracy Onion: 0.0075
  • Accuracy Pepper: nan
  • Accuracy Green beans: nan
  • Accuracy French beans: nan
  • Accuracy King oyster mushroom: nan
  • Accuracy Shiitake: nan
  • Accuracy Enoki mushroom: nan
  • Accuracy Oyster mushroom: nan
  • Accuracy White button mushroom: 0.0
  • Accuracy Salad: nan
  • Accuracy Other ingredients: 0.0
  • Iou Background: 0.0
  • Iou Candy: nan
  • Iou Egg tart: nan
  • Iou French fries: 0.0
  • Iou Chocolate: nan
  • Iou Biscuit: 0.0
  • Iou Popcorn: nan
  • Iou Pudding: nan
  • Iou Ice cream: 0.0
  • Iou Cheese butter: 0.0
  • Iou Cake: 0.0
  • Iou Wine: 0.0
  • Iou Milkshake: nan
  • Iou Coffee: nan
  • Iou Juice: 0.0
  • Iou Milk: nan
  • Iou Tea: nan
  • Iou Almond: nan
  • Iou Red beans: nan
  • Iou Cashew: nan
  • Iou Dried cranberries: nan
  • Iou Soy: nan
  • Iou Walnut: nan
  • Iou Peanut: nan
  • Iou Egg: nan
  • Iou Apple: nan
  • Iou Date: nan
  • Iou Apricot: nan
  • Iou Avocado: nan
  • Iou Banana: nan
  • Iou Strawberry: nan
  • Iou Cherry: nan
  • Iou Blueberry: nan
  • Iou Raspberry: nan
  • Iou Mango: nan
  • Iou Olives: nan
  • Iou Peach: 0.0
  • Iou Lemon: nan
  • Iou Pear: nan
  • Iou Fig: nan
  • Iou Pineapple: nan
  • Iou Grape: nan
  • Iou Kiwi: nan
  • Iou Melon: nan
  • Iou Orange: 0.0
  • Iou Watermelon: nan
  • Iou Steak: 0.1109
  • Iou Pork: 0.2326
  • Iou Chicken duck: 0.1176
  • Iou Sausage: 0.0
  • Iou Fried meat: nan
  • Iou Lamb: 0.0
  • Iou Sauce: 0.0
  • Iou Crab: nan
  • Iou Fish: nan
  • Iou Shellfish: 0.0
  • Iou Shrimp: 0.0
  • Iou Soup: 0.0
  • Iou Bread: 0.0065
  • Iou Corn: 0.0
  • Iou Hamburg: nan
  • Iou Pizza: nan
  • Iou hanamaki baozi: 0.0
  • Iou Wonton dumplings: nan
  • Iou Pasta: nan
  • Iou Noodles: 0.1944
  • Iou Rice: 0.2630
  • Iou Pie: 0.0
  • Iou Tofu: 0.0
  • Iou Eggplant: nan
  • Iou Potato: 0.2078
  • Iou Garlic: nan
  • Iou Cauliflower: 0.0
  • Iou Tomato: 0.0283
  • Iou Kelp: nan
  • Iou Seaweed: nan
  • Iou Spring onion: 0.0
  • Iou Rape: 0.0
  • Iou Ginger: nan
  • Iou Okra: 0.0
  • Iou Lettuce: 0.0010
  • Iou Pumpkin: nan
  • Iou Cucumber: 0.1036
  • Iou White radish: 0.0
  • Iou Carrot: 0.4668
  • Iou Asparagus: nan
  • Iou Bamboo shoots: nan
  • Iou Broccoli: 0.3830
  • Iou Celery stick: 0.0400
  • Iou Cilantro mint: 0.0
  • Iou Snow peas: nan
  • Iou cabbage: nan
  • Iou Bean sprouts: nan
  • Iou Onion: 0.0073
  • Iou Pepper: nan
  • Iou Green beans: nan
  • Iou French beans: nan
  • Iou King oyster mushroom: nan
  • Iou Shiitake: nan
  • Iou Enoki mushroom: nan
  • Iou Oyster mushroom: nan
  • Iou White button mushroom: 0.0
  • Iou Salad: nan
  • Iou Other ingredients: 0.0

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

  • learning_rate: 0.0001
  • train_batch_size: 12
  • eval_batch_size: 12
  • seed: 42
  • optimizer: Use adamw_torch with betas=(0.9,0.999) and epsilon=1e-08 and optimizer_args=No additional optimizer arguments
  • lr_scheduler_type: linear
  • num_epochs: 50

Training results

Training LossEpochStepValidation LossMean IouMean AccuracyOverall AccuracyAccuracy BackgroundAccuracy CandyAccuracy Egg tartAccuracy French friesAccuracy ChocolateAccuracy BiscuitAccuracy PopcornAccuracy PuddingAccuracy Ice creamAccuracy Cheese butterAccuracy CakeAccuracy WineAccuracy MilkshakeAccuracy CoffeeAccuracy JuiceAccuracy MilkAccuracy TeaAccuracy AlmondAccuracy Red beansAccuracy CashewAccuracy Dried cranberriesAccuracy SoyAccuracy WalnutAccuracy PeanutAccuracy EggAccuracy AppleAccuracy DateAccuracy ApricotAccuracy AvocadoAccuracy BananaAccuracy StrawberryAccuracy CherryAccuracy BlueberryAccuracy RaspberryAccuracy MangoAccuracy OlivesAccuracy PeachAccuracy LemonAccuracy PearAccuracy FigAccuracy PineappleAccuracy GrapeAccuracy KiwiAccuracy MelonAccuracy OrangeAccuracy WatermelonAccuracy SteakAccuracy PorkAccuracy Chicken duckAccuracy SausageAccuracy Fried meatAccuracy LambAccuracy SauceAccuracy CrabAccuracy FishAccuracy ShellfishAccuracy ShrimpAccuracy SoupAccuracy BreadAccuracy CornAccuracy HamburgAccuracy PizzaAccuracy hanamaki baoziAccuracy Wonton dumplingsAccuracy PastaAccuracy NoodlesAccuracy RiceAccuracy PieAccuracy TofuAccuracy EggplantAccuracy PotatoAccuracy GarlicAccuracy CauliflowerAccuracy TomatoAccuracy KelpAccuracy SeaweedAccuracy Spring onionAccuracy RapeAccuracy GingerAccuracy OkraAccuracy LettuceAccuracy PumpkinAccuracy CucumberAccuracy White radishAccuracy CarrotAccuracy AsparagusAccuracy Bamboo shootsAccuracy BroccoliAccuracy Celery stickAccuracy Cilantro mintAccuracy Snow peasAccuracy cabbageAccuracy Bean sproutsAccuracy OnionAccuracy PepperAccuracy Green beansAccuracy French beansAccuracy King oyster mushroomAccuracy ShiitakeAccuracy Enoki mushroomAccuracy Oyster mushroomAccuracy White button mushroomAccuracy SaladAccuracy Other ingredientsIou BackgroundIou CandyIou Egg tartIou French friesIou ChocolateIou BiscuitIou PopcornIou PuddingIou Ice creamIou Cheese butterIou CakeIou WineIou MilkshakeIou CoffeeIou JuiceIou MilkIou TeaIou AlmondIou Red beansIou CashewIou Dried cranberriesIou SoyIou WalnutIou PeanutIou EggIou AppleIou DateIou ApricotIou AvocadoIou BananaIou StrawberryIou CherryIou BlueberryIou RaspberryIou MangoIou OlivesIou PeachIou LemonIou PearIou FigIou PineappleIou GrapeIou KiwiIou MelonIou OrangeIou WatermelonIou SteakIou PorkIou Chicken duckIou SausageIou Fried meatIou LambIou SauceIou CrabIou FishIou ShellfishIou ShrimpIou SoupIou BreadIou CornIou HamburgIou PizzaIou hanamaki baoziIou Wonton dumplingsIou PastaIou NoodlesIou RiceIou PieIou TofuIou EggplantIou PotatoIou GarlicIou CauliflowerIou TomatoIou KelpIou SeaweedIou Spring onionIou RapeIou GingerIou OkraIou LettuceIou PumpkinIou CucumberIou White radishIou CarrotIou AsparagusIou Bamboo shootsIou BroccoliIou Celery stickIou Cilantro mintIou Snow peasIou cabbageIou Bean sproutsIou OnionIou PepperIou Green beansIou French beansIou King oyster mushroomIou ShiitakeIou Enoki mushroomIou Oyster mushroomIou White button mushroomIou SaladIou Other ingredients
2.766914.28571002.59820.04370.11310.1847nannannan0.0nannannannan0.00.00.00.0nannan0.0nannannannannannannannannannannannannannannannannannannannannan0.0nannannannannannannan0.0nan0.94700.07740.06060.0nan0.00.0nannan0.00.00.00.08430.0nannan0.0nannan0.00.68460.00.0nan0.5680nan0.00.0nannan0.00.0nan0.00.0nan0.34240.00.9617nannan0.78700.01120.0003nannannan0.0nannannannannannannan0.0nan0.00.0nannan0.0nan0.0nannan0.00.00.00.0nannan0.0nannannannannannannannannannannannannannannannannannannannannan0.0nannannannannannannan0.0nan0.07300.07470.04810.0nan0.00.0nannan0.00.00.00.03020.0nannan0.0nannan0.00.60740.00.0nan0.2870nan0.00.0nannan0.00.0nan0.00.0nan0.09550.00.3976nannan0.25270.01100.0003nannannan0.0nan0.0nannannannannan0.0nan0.0
1.893128.57142002.21740.04160.10850.1951nannannan0.0nannannannan0.00.00.00.0nannan0.0nannannannannannannannannannannannannannannannannannannannannan0.0nannannannannannannan0.0nan0.45170.57160.05210.0nan0.00.0nannan0.00.00.00.00200.0nannan0.0nannan0.10630.28450.00.0nan0.8817nan0.00.0162nannan0.00.0nan0.00.0074nan0.22460.00.9538nannan0.77940.00130.0037nannannan0.0026nannannannannannannan0.0nan0.00.0nannan0.0nan0.0nannan0.00.00.00.0nannan0.0nannannannannannannannannannannannannannannannannannannannannan0.0nannannannannannannan0.0nan0.05890.21250.03570.0nan0.00.0nannan0.00.00.00.00090.0nannan0.0nannan0.10600.21940.00.0nan0.2077nan0.00.0159nannan0.00.0nan0.00.0059nan0.07370.00.4452nannan0.35710.00130.0036nannannan0.0025nannannannannannannan0.0nan0.0
1.547942.85713002.08650.05150.12570.2045nannannan0.0nannannannan0.00.00.00.0nannan0.0nannannannannannannannannannannannannannannannannannannannannan0.0nannannannannannannan0.0nan0.85480.53620.34580.0nan0.00.0nannan0.00.00.00.01570.0nannan0.0nannan0.21910.33960.00.0nan0.6707nan0.00.0295nannan0.00.0nan0.00.0014nan0.27280.00.9345nannan0.76180.04000.0nannannan0.0075nannannannannannannan0.0nan0.00.0nannan0.0nan0.0nannan0.00.00.00.0nannan0.0nannannannannannannannannannannannannannannannannannannannannan0.0nannannannannannannan0.0nan0.11090.23260.11760.0nan0.00.0nannan0.00.00.00.00650.0nannan0.0nannan0.19440.26300.00.0nan0.2078nan0.00.0283nannan0.00.0nan0.00.0010nan0.10360.00.4668nannan0.38300.04000.0nannannan0.0073nannannannannannannan0.0nan0.0

Framework versions

  • Transformers 4.46.3
  • Pytorch 2.5.1+cu121
  • Datasets 3.2.0
  • Tokenizers 0.20.3

Как запустить

На своей GPU в ailist. Цена — по текущим предложениям провайдеров

GPU в ailist

Универсальный рантайм · transformers · image-segmentation

Можно запустить

Подбираем GPU…

Класс архитектуры
SegformerForSemanticSegmentation
Ревизия весов
ed3ce53

0 моделей