/ Модель

Характеристики

Лицензия
Своя лицензия
Базовая модель
OlmoEarth-v1_2-Base
Библиотека
pytorch
Опубликована
31 авг 2026

olmoearth-v1.2-energy-multitask-v4

Сегментация изображенийИзображение → mask3 профессии

Исследовательская модель на базе OlmoEarth для сегментации и многозадачного анализа энергетической инфраструктуры, возобновляемых объектов и центров обработки данных на снимках Sentinel-2.

14скачиваний за 30 дней0лайковвеса обновлены31 авг 2026

Бенчмарки

Как модель справилась с задачами пользователей ailist и что о ней публикуют открытые лидерборды

Публичные оценки

Из открытых лидербордов. Сравнивайте результаты одного теста при одинаковых условиях — отсутствие оценки не значит, что модель хуже.

В подключённых источниках результатов для этой модели пока нет.

Что умеет модель

Описание составлено по карточке модели и метаданным Hugging Face

OlmoEarth v1.2 Energy Multi-Task V4 — исследовательская многозадачная модель для плотного анализа спутниковых снимков Sentinel-2 L2A, разработанная на основе allenai/OlmoEarth-v1_2-Base и дообученная для энергетических объектов в США. Общий энкодер OlmoEarth v1.2 формирует признаки, а отдельные декодеры предсказывают наличие энергетической инфраструктуры, тип топлива электростанций, маски площадок-кандидатов для солнечных и ветровых установок, показатели возобновляемой генерации, вероятности источников энергии центров обработки данных и вспомогательный тип их геометрии.

Модель предназначена для исследовательского картирования объектов и анализа территорий по спутниковому контексту. Для подачи требуются гармонизированные DN-значения Sentinel-2 L2A и время съёмки; модель применяет нормализацию OlmoEarth самостоятельно. Выходы по источникам энергии ЦОД — некалиброванные вероятности, а не измеренные доли потребления или закупки электроэнергии. Тип топлива следует интерпретировать только после подтверждённого обнаружения электростанции.

В версии V4 заморожены энкодер и декодеры возобновляемой энергетики и ЦОД, а дообучена силовая ветвь; географический охват обучения ориентирован на США. Калибровка вероятностей и независимая внешняя географическая проверка не заявлены, поэтому качество за пределами США не подтверждено. Модель основана на OlmoEarth Artifact License и подчиняется условиям исходной модели Ai2 Responsible Use Guidelines; для датасетов могут действовать отдельные лицензии и требования атрибуции.

Сценарии применения

  • картирование электростанций и оценка наличия энергетической инфраструктуры
  • классификация топлива обнаруженных электростанций
  • поиск площадок-кандидатов для солнечных и ветровых установок
  • оценка показателей возобновляемой генерации по спутниковому контексту
  • анализ вероятных источников энергоснабжения в известных зонах ЦОД

Ограничения

Модель обучалась на данных США, и её качество в других регионах не подтверждено; вероятности по ЦОД и топливу не откалиброваны, а фоновые пиксели вне известных геометрий ЦОД не имеют заданной интерпретации. Спутниковый контекст не устанавливает фактические закупки электроэнергии или потребление топлива; важные выводы требуют проверки по авторитетным данным объектов и коммунальных служб.

Для каких профессий подходит3

Разделы каталога профессий, в задачах которых используется эта модель

Все профессии

Карточка модели

README от автора на Hugging Face, как он его опубликовал

Открыть на Hugging Face

OlmoEarth v1.2 Energy Multi-Task V4

A United States-focused, multi-task dense prediction model fine-tuned from allenai/OlmoEarth-v1_2-Base. One Sentinel-2 L2A encoder pass produces:

  • power-infrastructure presence logits;
  • broad power-plant fuel logits;
  • five solar/wind candidate-area masks;
  • renewable capacity factor, LCOE, capacity density, and generation density outputs;
  • eight data-center energy-source likelihood channels;
  • an auxiliary data-center geometry-type output.

Try the map application: https://sarkarghya--olmoearth-energy-grid-demo-web.modal.run

Important interpretation

This is an exploratory research checkpoint, not an operational energy audit.

  • Data-center channels are raw, uncalibrated model likelihoods from Earth-observation context. They are not measured procurement, generation, or electricity-consumption percentages.
  • Data-center channels were supervised inside known data-center geometry. Aggregate them only inside a user-provided/known data-center ROI; arbitrary background pixels are unconstrained.
  • dc_geometry_type has no background class and is not a data-center detector.
  • Power fuel should be reported only after a power-presence object passes a validated detection threshold. Do not report a grid-wide fuel average.
  • Frozen holdout calibration and task-specific threshold selection have not yet been completed.
  • Training data and fine-tuning are U.S.-focused; performance elsewhere is unverified.

Checkpoint

ItemValue
Selected runolmoearth-v12-power-fuel-h100x8-v4b-20260831
Power-tune step200
Selected best.pt SHA-2568703e2b63f749cefad3be11b2b858612ebc1b4d02c7baf9af85367c0dfd99d5e
Parent checkpointolmoearth-v1.2-energy-multitask-v3
Base revision581aa9baaa7aed4348c0903617eb92ee9f89e2ec
Patch size4
Input grid128 × 128 pixels at 10 m

V4 is an evidence-driven power specialization of V3. Error analysis showed zero sample-level false positives across the named hard-negative strata at low thresholds, while most missed positives were wind facilities. Training therefore froze the encoder, renewable decoder, and data-center decoder; changed only the power decoder/presence/fuel tensors; used per-positive-sample Dice; balanced positive/negative sampling; increased wind-positive exposure; and then refit only the fuel head with natural positive sampling.

Tensor-level publication audit confirmed that the encoder and every renewable/data-center parameter are bit-identical to V3. Only 18 power tensors changed.

Site-grouped power comparison

The historical seed-17 validation sites, which were excluded from gradient updates, were deterministically divided into an analysis half and a frozen comparison half. Both halves had influenced historical V3 checkpoint selection through aggregate validation loss, so these are stronger comparison metrics but not a pristine external test.

Partition / metricV3V4
Analysis sample F1, best threshold0.94091.0000
Analysis pixel AP0.67970.6878
Analysis fuel sample accuracy0.71570.6853
Frozen comparison sample F10.95471.0000
Frozen comparison pixel AP0.60650.6679
Frozen comparison fuel sample accuracy0.71100.7225
Frozen false positives at threshold 0.50 / 9 pixels0 / 3830 / 383
Frozen false negatives at threshold 0.50 / 9 pixels17 / 1730 / 173

The selected V4 operating point is presence probability 0.50 with a minimum connected component of 9 pixels (900 m²). It was selected on the analysis partition and confirmed on the frozen comparison partition. Fuel confidence remains provisional and uncalibrated. No external geographic holdout or probability calibration claim is made. Full machine-readable reports are included as power_error_analysis_v3.json and power_error_analysis_v4.json.

Installation

Python 3.11 and a CUDA GPU are recommended.

python -m venv .venv
source .venv/bin/activate
pip install -r https://huggingface.co/sarkarghya/olmoearth-v1.2-energy-multitask-v4/raw/main/requirements.txt

The fine-tuned weights are stored as model.safetensors. Loading also downloads the exact pinned OlmoEarth base snapshot because its config is required to instantiate the architecture; the fine-tuned state then replaces all model parameters.

Input contract

Provide harmonized Sentinel-2 L2A DN values:

dtype: uint16
shape per sample: [12 bands, 1 time, 128 height, 128 width]
resolution: 10 m
band order: B02, B03, B04, B08, B05, B06, B07, B8A, B11, B12, B01, B09

Supply the real acquisition timestamp. The model applies OlmoEarth normalization internally. Do not divide harmonized DN by 10,000 before calling the model.

For Sentinel processing baselines with BOA_ADD_OFFSET, harmonize each source band from product metadata:

reflectance = (source_DN + BOA_ADD_OFFSET) / BOA_QUANTIFICATION_VALUE
harmonized_DN = round(clip(reflectance, 0, 6.5535) * 10000)

Resample 20 m and 60 m bands onto the exact 10 m grid. Use nearest-neighbor for SCL and bilinear for reflectance. Pixels with SCL classes 0, 1, 3, 8, 9, 10, 11 should be treated as invalid for aggregation.

Python loading example

import sys
from huggingface_hub import snapshot_download

repo_id = "sarkarghya/olmoearth-v1.2-energy-multitask-v4"
repo_dir = snapshot_download(repo_id)
sys.path.insert(0, repo_dir)

import numpy as np
import torch
from modeling_energy_multitask import load_pretrained

model = load_pretrained(repo_id, device="cuda")
chip = np.load("sentinel2_l2a.npy", allow_pickle=False)  # uint16 [12, 1, 128, 128]
batch = {
    "sentinel2_l2a": torch.from_numpy(chip[None]).cuda(),
    "acquired_at_utc": ["2026-08-29T18:25:03Z"],
}

# The OlmoEarth wrapper configures its internal autocast dtype.
with torch.inference_mode():
    logits = model.predict_all(batch)

power_probability = torch.sigmoid(logits["power_presence"])
power_fuel_probability = torch.softmax(logits["power_fuel"], dim=1)
renewable_probability = torch.sigmoid(logits["renewable_masks"])
datacenter_source_likelihood = torch.sigmoid(logits["dc_energy"])

predict_all() runs the encoder once and returns raw dense heads:

OutputShapeActivation/meaning
power_presence[B,1,128,128]sigmoid
power_fuel[B,8,128,128]softmax over class dimension
renewable_masks[B,5,128,128]independent sigmoids
renewable_regression[B,4,128,128]robust-scaled regression
dc_energy[B,8,128,128]independent sigmoids; ROI-only aggregation
dc_geometry_type[B,3,128,128]positive-geometry auxiliary classes

A command-line example is included:

python example_inference.py sentinel2_l2a.npy \
  --timestamp 2026-08-29T18:25:03Z \
  --roi-mask known_datacenter_roi.npy

If no ROI mask is supplied, the example deliberately does not produce a data-center source aggregate.

Output orders

power_fuel = ["background", "solar", "wind", "gas", "coal", "hydro", "nuclear", "other"]
renewable_masks = ["solar_base", "solar_constrained", "wind_base", "wind_constrained", "offshore_wind_base"]
renewable_regression = ["capacity_factor", "lcoe", "capacity_density", "generation_density"]
datacenter_sources = ["solar", "wind", "hydro", "gas", "coal", "nuclear", "grid", "other"]
datacenter_geometry = ["building", "campus", "point"]

Data-center source outputs are multi-label, so they must not automatically be normalized to sum to 100%. If a separate normalized display is desired, call it an “expected source-likelihood profile,” not an energy mix.

Renewable regression predictions use the median/IQR values in checkpoint_metadata.json. Reverse the robust scaling with value = prediction * iqr + median; then apply expm1 to capacity-density and generation-density channels. Clamp capacity factor to [0,1] and LCOE to an application-appropriate non-negative range.

Training data

DatasetPinned revisionAccepted samples
power-plant-olmoearth-segmentation1f992f24151342392044fe5b46eb865ab42586a912,453
im3-datacenter-olmoearth-segmentationeaf7739276126b6e9e5eb6e190d8c8cd93e69dcc1,417
wind-and-solar-candidate-olmoearth-segmentation3f3bbb8358203bfae1a0ce46443c4bc2bc4abb6612,649

The power release already includes purpose-built hard-negative windows. Future negative work should be driven by false-positive error analysis across its existing negative strata, not by blindly adding more negatives.

The published datasets have split="all"; training used a deterministic ephemeral site-grouped validation split. This is why a new frozen site-grouped holdout remains necessary before stronger generalization claims.

Architecture and training summary

  • Shared pinned OlmoEarth v1.2 Base encoder.
  • Independent power, renewable, and data-center upsampling decoders.
  • Power: focal BCE + soft Dice for presence; class-weighted fuel cross entropy inside valid plant pixels.
  • Renewables: independent focal BCE + Dice masks and robust-scaled Huber regression.
  • Data centers: per-site/channel weighted multi-label BCE inside known geometry; geometry-type auxiliary cross entropy.
  • V2 introduced equal per-site data-center weighting, lower DC learning rate, dropout, reduced DC sampling, and broader validation.
  • V3 continued V2 at low learning rate; step 100 was selected as the multi-task parent.
  • V4 used 8×H100 power-only continuation with the shared encoder and non-power heads frozen, followed by fuel-head-only recovery; power-tune step 200 was selected.

Limitations and responsible use

Satellite context cannot establish contractual electricity procurement or real-time fuel consumption. Predictions may be wrong because of cloud, season, construction date, geographic shift, label uncertainty, spatial resolution, or visually similar industrial sites. Do not use this model alone for regulatory, financial, safety, siting, grid-reliability, or environmental-compliance decisions. Confirm important conclusions with authoritative facility and utility records.

The source model is licensed under the OlmoEarth Artifact License and is intended for use according to Ai2's Responsible Use Guidelines. This derivative includes the source weights and remains subject to those terms; review the base model repository before use. Dataset licenses and attribution requirements remain independently applicable.

Как запустить

На своей GPU в ailist. Цена — по текущим предложениям провайдеров

GPU в ailist

Универсальный рантайм · pytorch · image-segmentation

Нельзя запустить

Архитектура EnergyMultiTaskModel неизвестна transformers в образе рантайма.

Класс архитектуры
EnergyMultiTaskModel
Ревизия весов
ed09179

0 моделей