/ Модель

Характеристики

Лицензия
Своя лицензия
Библиотека
pytorch
Опубликована
30 сен 2026

fpidt-ro-desalination

Регрессия по таблицам

Набор федеративно обученных физически информированных регрессионных моделей для прогноза потока воды и энергозатрат пилотных систем обратного осмоса.

0скачиваний за 30 дней0лайковвеса обновлены30 сен 2026

Бенчмарки

Как модель справилась с задачами пользователей ailist и что о ней публикуют открытые лидерборды

Публичные оценки

Из открытых лидербордов. Сравнивайте результаты одного теста при одинаковых условиях — отсутствие оценки не значит, что модель хуже.

В подключённых источниках результатов для этой модели пока нет.

Что умеет модель

Описание составлено по карточке модели и метаданным Hugging Face

FPIDT — набор регрессионных моделей цифровых двойников для обратного осмоса, опубликованный авторами исследования Emad Eldin, Baroud, Atitallah и AL-Ghamdi. Модели оценивают поток пермеата и, для шести клиентов установки NAWI/ORNL, удельное энергопотребление по рабочим параметрам установки. В README описаны федеративное обучение на данных девяти пилотных клиентов и физически информированная функция потерь, основанная на законе растворения–диффузии; для известных установок предусмотрена персонализация локальной донастройкой общей модели.

Входы включают давление подачи, солёность и температуру, а также другие рабочие переменные; наблюдения агрегированы в окна по 10 секунд. Данные охватывают пилотную установку обратного осмоса с солоноватой водой и установку с морской водой. Для новой установки авторы рекомендуют глобальную физически информированную модель, а для знакомых — персонализированные модели. Репозиторий содержит веса Safetensors для задачи табличной регрессии и использует PyTorch.

Модели предназначены для прогнозирования производительности и сценарного анализа цифрового двойника, но не проверены для управления промышленными установками. Они обучены только на двух пилотных стендах, могут ошибаться при экстраполяции за пределы обучающих условий, не моделируют загрязнение мембран, а прогноз энергопотребления доступен только для клиентов NAWI. Лицензия указана как `other` и, согласно README, ещё должна быть установлена авторами; условия доступа к исходным данным регулируются репозиториями NAWI DAMS и MHKDR.

Сценарии применения

  • прогнозирование потока пермеата по рабочим параметрам установки обратного осмоса
  • оценка удельного энергопотребления установок NAWI
  • сценарный анализ цифрового двойника опреснительной установки
  • адаптация общей модели к данным конкретной пилотной установки
  • оценка работы новой установки по глобальной физически информированной модели

Ограничения

Модели обучены на двух пилотных установках и не валидированы для управления полноразмерными промышленными системами; прогнозы за пределами обученного диапазона ненадёжны, а загрязнение мембран не моделируется. Прогноз энергопотребления предусмотрен только для шести клиентов NAWI; федеративное обучение не включало защищённую агрегацию или дифференциальную приватность.

Карточка модели

README от автора на Hugging Face, как он его опубликовал

Открыть на Hugging Face

FPIDT: federated physics-informed digital twins for reverse-osmosis desalination

Models from the paper Federated Physics-Informed Digital Twins for Privacy-Preserving Performance Prediction of Reverse Osmosis Desalination (Emad Eldin, Baroud, Atitallah, AL-Ghamdi). They predict water flux and specific energy consumption (SEC) of RO membranes from four operating variables, and were trained with federated learning across nine real pilot-plant clients, so no client's raw data left that client. All training data are public experimental records from two U.S. national-laboratory RO pilots; nothing is simulated.

Headline result. With a client's full history, a network trained on that client alone is the most accurate. Personalisation brings federated models close to it and well ahead of one centralized model for all plants. The physics loss improves the shared model, keeps its responses physically correct, and helps where local data are missing (a plant left out of training, or one with only minutes of history). Use the per-client models for known plants and global_pi_fedavg for a new one.

System overview

1. The problem

RO plants log pressure, flow, conductivity and power continuously. A model that predicts how much water a membrane will produce, and at what energy cost, supports operation and what-if analysis (a digital twin). Training it on one plant limits it to that plant's operating range; pooling data across plants is often impossible because operators cannot share raw records. Federated learning trains one model across sites while raw data stay local, but plants differ in membrane, salinity and control strategy (the data are non-IID). The proposal tested here adds two remedies: a physics-informed loss that holds every client to the solution–diffusion law of RO, and personalisation (local fine-tuning of the shared model).

2. Data

SourceProcessWaterClientsAccess
NAWI/ORNL CCRO pilot (Villez et al.)closed-circuit (semi-batch) RO; concentrate recirculated during filtration, drained each cycleNaCl, brackishsix 2021 campaigns (N1–N6)DOI 10.7481/1963162
NREL wave-desalination pilotonce-through RO under dynamic feed pressureseawater rangethree regimes (W2–W4)MHKDR submission 649

From 944 raw files (6,172,941 logged rows at 2–4 Hz), filtration-phase rows with feed pressure above 3.5 bar and flux above 0.5 LMH were kept and averaged into 10-second windows (216,909 windows). Each client is split in time: first 70% train, next 10% validation, last 20% test, with 5-minute gaps between blocks, so every test is a prediction of later operation.

ClientSourceRegimeFiles10-s windowsTrain / val / test (flux)Solution–diffusion fit A (LMH/bar), k (bar per mS/cm)
N1_conventionalNAWI/ORNL CCROconventional feedback control1921644 / 62 / 1552.09, 0.52
N2_openloop_junNAWI/ORNL CCROopen-loop pump perturbations (June 2021)343,4992,449 / 320 / 6701.50, 0.45
N3_escNAWI/ORNL CCROextremum-seeking control58485,26659,686 / 8,496 / 17,0242.13, 0.55
N4_openloop_augNAWI/ORNL CCROopen-loop perturbations and set-point steps (Aug. 2021)3819,20713,444 / 1,891 / 3,8121.62, 0.47
N5_mpcNAWI/ORNL CCROmodel predictive control9840,22228,155 / 3,992 / 8,0151.39, 0.48
N6_bayesoptNAWI/ORNL CCROBayesian optimisation15961,93843,356 / 6,164 / 12,3581.34, 0.45
W1_steadyNREL ROsteady-state pressure (excluded: one 5-minute run)131excluded—
W2_rampNREL ROtrapezoidal pressure ramps44,2472,972 / 395 / 8200.98, 0.51
W3_sineNREL ROsinusoidal pressure23699489 / 40 / 1100.79, 0.40
W4_wecsimNREL ROwave-energy-simulator pressure traces2910637 / 60 / 1530.95, 0.47

3. Features and targets

FeatureUnitMeaningUsed by
P_barbarfeed pressureflux and energy
C_bulkmS/cmbulk salinity on the concentrate side (NAWI: recirculation-loop conductivity; NREL: mean of feed and reject conductivity)flux and energy
T_CdegCfeed temperatureflux and energy
Q_crossL/mincrossflow (NAWI: recirculation flow; NREL: feed flow)flux and energy
J_LMHL m^-2 h^-1water flux (input of the energy model only)energy only
TargetUnitClientsDefinition
J_LMH (flux model)L m⁻² h⁻¹all ninewater flux as logged by each rig (permeate flow per membrane area, so the two pilots are comparable)
SEC (energy model)kWh/m³six NAWItotal pump power / permeate flow (logged directly in campaigns 3–6, same formula from logged pump powers in 1–2); NREL measures no power

Leakage guard. Never used as inputs: permeate flow (flux × area), NAWI's make-up feed flow (equal to permeate flow during closed-circuit filtration), cumulative permeate volume, and — for the energy model — the pump powers that define SEC.

4. Exploratory analysis

The clients are strongly non-IID. NAWI clients run at a median of 17.6 bar on brackish loops of 12.1 mS/cm; NREL clients at 54.6 bar on seawater of 56.8 mS/cm.

Per-client distributions

Control strategy shapes the data. In the extremum-seeking, predictive-control and Bayesian-optimisation campaigns the controller holds flux at a set point while pressure rises with the loop's salinity; in the open-loop campaigns and at NREL, flux follows the applied pressure.

Dynamics

The physics holds on both pilots. Each client's solution–diffusion fit J = A (P − kC) gives a water permeability A of 1.34–2.13 LMH/bar on the brackish NAWI membrane and 0.79–0.98 LMH/bar on the seawater NREL membrane, and an osmotic coefficient k of 0.40–0.55 bar per mS/cm on every client — physically plausible for NaCl.

Physics

Energy. SEC falls with flux on every NAWI client, as fixed pump overheads are spread over more water.

Energy

5. Models in this repository

TaskFilePaper methodPer client?Seed-0 test RMSE (mean over clients)
fluxflux/local_nn.safetensorsM3yes (stacked)0.449 LMH
fluxflux/global_fedavg.safetensorsM5no3.309 LMH
fluxflux/personalised_fedavg.safetensorsM8yes (stacked)0.601 LMH
fluxflux/global_pi_fedavg.safetensorsM7no1.686 LMH
fluxflux/personalised_fpidt.safetensorsM9yes (stacked)0.719 LMH
energyenergy/local_nn.safetensorsM3yes (stacked)0.313 kWh/m³
energyenergy/global_fedavg.safetensorsM5no1.170 kWh/m³
energyenergy/personalised_fedavg.safetensorsM8yes (stacked)0.419 kWh/m³
energyenergy/global_pi_fedavg.safetensorsM7no1.179 kWh/m³
energyenergy/personalised_fpidt.safetensorsM9yes (stacked)0.413 kWh/m³

All models share one architecture: an MLP [4, 64, 64, 1] with SiLU activations (4,545 parameters for flux, 4,609 for energy). Per-client files stack one model per client in the order of config.json → clients. Each exported model was retrained with seed 0 and re-scored: every per-client test RMSE matches the paper's seed-0 run exactly (reproduction_check in config.json).

Which to use. For a plant that is one of the clients, personalised_fpidt or local_nn (the most accurate; see results). For a new plant with no data, global_pi_fedavg (the physics-informed shared model, best of the privacy-preserving options on unseen clients for flux).

6. Training

  • Federated averaging: 60 rounds; each round every client starts from the global model and takes 100 Adam steps (batch 256) on its own data; the server averages parameters weighted by training size; the round with the lowest mean per-client validation RMSE is kept.
  • Physics loss (PI variants, weight λ): squared deviation from the client's own solution–diffusion fit, plus hinge penalties when +0.5 bar lowers the predicted flux or +0.5 mS/cm raises it. For energy: deviation from a local grey-box fit SEC = aP + bQ/J + c plus a hinge on predictions below the hydraulic bound SEC ≥ P/36 (P in bar). Each client's physics parameters stay local.
  • Personalisation: fine-tune the global model on the client's own data for up to 300 steps (lr 5e-4), keeping the state with the lowest validation error on that client.
  • Standardisation: global means and standard deviations from per-client sums (stored in config.json).
  • Hyper-parameters, chosen on validation blocks only (grids widened until the optimum was interior): flux λ = 1, FedProx μ = 1, fine-tuning λ = 0; energy λ = 0.1, μ = 1, fine-tuning λ = 0.01.
  • Each message carries 4,545 parameters (~17.8 kB); a nine-client round moves 0.31 MB in both directions.

7. Results (paper; 5 seeds, test blocks)

Statistics treat clients as the independent units: per-client RMSE is averaged over seeds, and two methods are compared with an exact sign-flip permutation test over clients, Holm-adjusted. With nine flux clients the smallest attainable p is 0.004; with six energy clients it is 0.031.

Water flux (9 clients)

MethodRMSE (LMH)MAEBeats own local NNWorst clientPhysics violationsp vs FPIDT (Holm)
Client mean (null)5.4024.7652/915.3800.0%0.11
Physics only (local fit)1.8641.6380/94.4770.0%0.04
Local linear regression0.6810.4802/92.29122.2%1.00
Local NN0.4430.320—1.6719.9%0.11
Centralized NN (pools raw data)1.3651.0810/92.6401.1%0.04
FedAvg3.6313.1960/96.8780.0%0.05
FedProx2.3952.0540/93.5580.0%0.05
PI-FedAvg (physics loss)1.9961.5730/93.3080.0%0.05
FedAvg + personalisation0.6380.4441/92.0542.3%1.00
FPIDT (PI-FedAvg + personalisation)0.7030.4952/91.9304.3%—

Specific energy (6 NAWI clients)

MethodRMSE (kWh/m³)MAEBeats own local NNWorst clientPhysics violationsp vs FPIDT (Holm)
Client mean (null)2.1271.7470/65.0470.0%0.28
Physics only (local fit)0.8710.6633/64.2170.0%1.00
Local linear regression0.6770.5151/62.1040.0%0.47
Local NN0.3280.240—0.9590.0%0.75
Centralized NN (pools raw data)0.7370.5700/61.2050.0%0.47
FedAvg1.1480.9410/62.0310.0%0.28
FedProx0.9740.7300/62.2620.0%0.28
PI-FedAvg (physics loss)1.1600.9520/62.0570.0%0.28
FedAvg + personalisation0.4310.3352/61.3800.0%1.00
FPIDT (PI-FedAvg + personalisation)0.4300.3332/61.3730.0%—

"Physics violations": share of test points where +0.5 bar lowers, or +0.5 mS/cm raises, the predicted flux (for energy: predictions below P/36).

Per-client RMSE

What each ingredient does (2×2 design)

Flux

ComparisonMean RMSE changeClients improvedp (Holm)
Physics loss, global model (PI-FedAvg − FedAvg)-1.6357/90.12
Physics loss, after personalisation (FPIDT − FedAvg+pers.)+0.0655/90.54
Personalisation, no physics (FedAvg+pers. − FedAvg)-2.9938/90.05
Personalisation, with physics (FPIDT − PI-FedAvg)-1.2938/90.05
FedProx − FedAvg-1.2366/90.18
FedAvg+pers. − local NN+0.1941/90.05
FPIDT − local NN+0.2602/90.11
FPIDT − centralized NN-0.6629/90.03

Energy

ComparisonMean RMSE changeClients improvedp (Holm)
Physics loss, global model (PI-FedAvg − FedAvg)+0.0111/61.00
Physics loss, after personalisation (FPIDT − FedAvg+pers.)-0.0013/61.00
Personalisation, no physics (FedAvg+pers. − FedAvg)-0.7176/60.25
Personalisation, with physics (FPIDT − PI-FedAvg)-0.7306/60.25
FedProx − FedAvg-0.1744/61.00
FedAvg+pers. − local NN+0.1032/61.00
FPIDT − local NN+0.1022/61.00
FPIDT − centralized NN-0.3075/60.56

A plant that contributed no data (leave one client out; 2 seeds, 40 rounds)

Flux (LMH)

Centralized NNFedAvgFedProxPI-FedAvgClient's own local NN (for scale)
1.954.492.452.370.44

PI-FedAvg − FedAvg: -2.12 (sign-flip p = 0.04).

Energy (kWh/m³)

Centralized NNFedAvgFedProxPI-FedAvgClient's own local NN (for scale)
1.441.611.351.620.33

PI-FedAvg − FedAvg: +0.01 (sign-flip p = 0.19).

Plants with little history (flux; 3 seeds)

Every client keeps only its most recent training windows; validation and test blocks are unchanged.

Method30 windows (5 min)100 windows (17 min)300 windows (50 min)all data
Local NN2.871.350.770.44
FedAvg4.693.242.603.63
PI-FedAvg2.822.392.072.00
FedAvg + pers.2.341.751.140.64
FPIDT1.881.531.190.70

With 5 minutes of history FPIDT has the lowest mean error, but beats the local model on only 5/9 clients (Holm p = 1.00): it helps clients whose short history does not cover their later operating range and hurts set-point campaigns whose flux is fixed by the controller.

Scarcity

Convergence

8. How to use

from huggingface_hub import snapshot_download
import sys
path = snapshot_download("FatimahEmadEldin/fpidt-ro-desalination", token=True)
sys.path.insert(0, path)
from fpidt_model import load

# personalised model for a known client: inputs P_bar, C_bulk, T_C, Q_cross (raw units)
m = load("flux", "personalised_fpidt", client="N4_openloop_aug")
print(m.predict([[18.2, 17.1, 22.6, 49.9]]))          # water flux, LMH

# shared physics-informed model for a new plant
g = load("flux", "global_pi_fedavg")
print(g.predict([[50.0, 57.0, 20.0, 20.4]]))

# energy: inputs P_bar, C_bulk, T_C, Q_cross, J_LMH
e = load("energy", "personalised_fpidt", client="N5_mpc")
print(e.predict([[22.9, 16.3, 21.7, 45.3, 24.6]]))    # SEC, kWh/m^3

Requires torch, safetensors, numpy. config.json in each task folder lists feature order, units, standardisation, clients, physics fits, training settings and per-client test RMSE for every model.

9. Limitations and intended use

  • Research models, trained on two pilot rigs (six campaigns on one brackish rig, three regimes on one seawater rig), not on full-scale plants; they are not validated for operational control.
  • Inputs outside the training range (pressure, salinity, crossflow) are extrapolation; the global physics-informed model degrades more gracefully than the local ones, but none is guaranteed.
  • On set-point campaigns (N3, N5, N6) flux is held by the controller, so flux predictions there mostly reproduce the set point; locally trained models can learn the controller's confounded sign.
  • Energy exists only for the six NAWI clients; NREL clients have flux models only.
  • Privacy is architectural (raw data stay local); no secure aggregation or differential privacy was used, and model parameters can leak information about training data.
  • Membrane fouling is not modelled: the public data carry no fouling labels.
  • License: other — to be set by the authors. Training data are subject to the terms of the NAWI DAMS and MHKDR repositories.

10. Citation

Paper: F. Emad Eldin, B. Baroud, N. Atitallah, A. S. AL-Malaise AL-Ghamdi, Federated Physics-Informed Digital Twins for Privacy-Preserving Performance Prediction of Reverse Osmosis Desalination (2026).

Data: K. Villez et al., NAWI Seedling Project: Foundational Control Methods for Water Treatment Systems — Online Actuator and Sensor Data, NAWI Water DAMS / ORNL, doi:10.7481/1963162. National Renewable Energy Laboratory, Experimental Wave Desalination Data with Variable Feed and Pressure Input, MHKDR submission 649 (2025); see also K. A. Sitterley, Z. Binger, D. S. Jenne, Membranes 15(8), 243 (2025), doi:10.3390/membranes15080243.

Как запустить

На своей GPU в ailist. Цена — по текущим предложениям провайдеров

GPU в ailist

Универсальный рантайм · pytorch

Нельзя запустить

Табличные модели пока не поддерживаются.

Ревизия весов
cc3c1ed

0 моделей