LFM2.5-VL-450M Pre-Disaster Detection
This is a fine-tuned version of LiquidAI/LFM2.5-VL-450M on the TurkishCodeMan/Sentinel2-Turkey-VLM dataset.
Model Details
- Base Model: LiquidAI/LFM2.5-VL-450M
- Dataset: TurkishCodeMan/Sentinel2-Turkey-VLM
- Task: Vision-Language Pre-Disaster Feature Extraction from Sentinel-2 RGB and CIR imagery.
Training Strategy
- Fine-Tuning Method: Full Fine-Tuning (Full FT)
- Epochs: 5
- Learning Rate: 2e-5 (Cosine Scheduler)
- Batch Size: 2 (Gradient Accumulation: 4)
- Loss Masking: Assistant loss masking enabled (prompt and padding tokens masked with -100).
- Hardware: 1x GPU (bfloat16)
The model was trained to output precisely formatted JSON matching 5 core disaster risk features (Risk Level, Dry Vegetation, Steep Terrain, Water Body, Image Quality). It achieved 84% exact-match overall accuracy on the test set with 100% valid JSON formatting.
Usage
import torch
from PIL import Image
from transformers import AutoProcessor, AutoModelForImageTextToText
model_id = "TurkishCodeMan/LFM2.5-VL-450M-Pre-Disaster-Detection"
processor = AutoProcessor.from_pretrained(model_id)
model = AutoModelForImageTextToText.from_pretrained(model_id, device_map="auto", dtype="bfloat16")
# Load your RGB and CIR images, then merge them horizontally
# merged_image = merge_images(rgb, cir)
SYSTEM_PROMPT = """Extract the following from the image:
risk_level: The fire risk level of the forest based on the right side CIR image, select from Low, Medium, or High
dry_vegetation_present: Is dry vegetation present (which appears as greyish/brownish/non-red in the right side CIR image)?, select from true, or false
steep_terrain: Is the terrain steep based on the images?, select from true, or false
water_body_present: Is there a water body (lake, river) present in the left RGB image?, select from true, or false
image_quality_limited: Is the image quality limited or very cloudy?, select from true, or false
Respond with only a JSON object. Do not include any text outside the JSON."""
conversation = [
{"role": "system", "content": [{"type": "text", "text": SYSTEM_PROMPT}]},
{"role": "user", "content": [{"type": "image", "image": merged_image}]}
]
inputs = processor.apply_chat_template(conversation, return_tensors="pt", return_dict=True, tokenize=True, add_generation_prompt=True)
inputs = {k: v.to(model.device) for k, v in inputs.items()}
with torch.no_grad():
output_ids = model.generate(**inputs, max_new_tokens=150, temperature=0.1)
generated_ids = output_ids[0][inputs["input_ids"].shape[1]:]
generated_text = processor.decode(generated_ids, skip_special_tokens=True).strip()
print(generated_text)