🐧 DGPL Linux Assistant 0.8B — Multimodal DevSecOps & Terminal Copilot
⚡ Key Highlights & Capabilities
- Ultra-Lightweight Edge Backbone: Highly optimized on top of Qwen 3.5 0.8B for sub-second terminal assistance on CPU and standard hardware.
- Multimodal Terminal Log Inspection: Built-in vision projector support (
mmproj) for terminal screenshot triage and OCR log diagnostics. - Sub-Second Real-Time Latency: Fast Non-Thinking Mode delivers ready-to-run shell commands in <0.3s on GPU / 1.5s–3.0s on CPU (~95% token generation reduction).
- Zero-Stall Non-Interactive Invariant: Strictly emits non-blocking batch commands (
top -b -n 1,ping -c 4,journalctl --no-pager,systemctl --no-pager) to prevent terminal hangs. - Pure CPU & Low RAM Footprint: Runs comfortably in standard CPU containers with <1.0 GB RAM, requiring zero GPU.
📊 Real-World Benchmark Scorecard
Evaluated across 12 comprehensive DevSecOps and systems diagnostic test cases (Process Check, Corporate Identity, POSIX Capabilities, High-CPU Process Kill Pipelines, Real-Time Raw Socket Audits, Inode Triage, Degraded Systemd Units, linux-system-mcp, ssh-mcp, Python Socket Probes, SUID Discovery, and nftables Firewall rules):
| Benchmark Mode | Token Predict Budget | Tests Evaluated | Tests Passed | Pass Rate | Avg Latency (CPU) | Primary Target Use Case |
|---|---|---|---|---|---|---|
| Standard Mode (With System Prompt) | 768 | 12 | 12 | 100.0% | 92.48s | Deep Root-Cause Analysis (RCA), system log audits |
| Zero-Shot Mode (Bare User Query) | 768 | 12 | 12 | 100.0% | 80.12s | Unprompted queries, general terminal assistance |
| Direct Fast Non-Thinking Mode | 128 | 12 | 11 | 91.7% | 16.29s (5.7x Faster) | Interactive CLI Copilot, Terminal Keybindings (Ctrl+K) |
Note: On GPU inference (RTX / T4 / Cloud GPUs), Direct Fast Mode executes in <0.35 seconds per query.
🚀 Quick Start with Ollama
1. Run Directly from Ollama
# Pull and run the latest 4-bit multimodal model
ollama run dgpl/dgpl-linux-assistant:latest
# Or run specific quantization tags
ollama run dgpl/dgpl-linux-assistant:0.8b-q4_k_m
ollama run dgpl/dgpl-linux-assistant:q8_0
ollama run dgpl/dgpl-linux-assistant:f16
2. Fast Non-Thinking CLI Mode (Sub-2s Instant Execution)
Create a Modelfile.fast with early stop tokens to bypass internal reasoning for instant shell completions:
FROM dgpl/dgpl-linux-assistant:latest
PARAMETER stop "<|im_end|>"
PARAMETER stop "<|im_start|>"
PARAMETER stop "<|endoftext|>"
PARAMETER stop "```\n\n"
PARAMETER temperature 0.1
PARAMETER top_p 0.85
PARAMETER num_predict 128
SYSTEM """You are DGPL Linux Assistant 0.8B, an ultra-fast Linux Terminal Copilot developed by Durbhasi Gurukulam Private Limited (DGPL).
Output the exact non-interactive Linux bash command in markdown code blocks immediately without any thinking tags or explanations."""
ollama create dgpl-fast -f Modelfile.fast
ollama run dgpl-fast "find and kill processes consuming over 90% CPU for more than 5 minutes"
3. Multimodal Terminal Log Inspection (Vision OCR)
Pass terminal screenshots or OCR log images directly to Ollama:
ollama run dgpl/dgpl-linux-assistant:latest "What failed in this systemd service log?" ./screenshot_error.png
📦 Quantization Matrix & Model Assets
| File / Tag | Format / Quant | Size | Recommended Hardware |
|---|---|---|---|
linux_copilot_q4_k_m.gguf | Q4_K_M (Default) | 529 MB | Raspberry Pi, Laptops, CPUs, Embedded Nodes |
linux_copilot_q5_k_m.gguf | Q5_K_M | 578 MB | Lightweight Dev Servers, Edge Devices |
linux_copilot_q6_k.gguf | Q6_K | 630 MB | Standard Workstations, Cloud VMs |
linux_copilot_q8_0.gguf | Q8_0 | 812 MB | High-Precision Host Auditing |
linux_copilot_f16.gguf | FP16 Master | 1.51 GB | Master SafeTensors Reference / Conversion |
mmproj_linux_copilot_f16.gguf | FP16 Vision Projector | 205 MB | Multimodal Text + Vision Inference |
🏢 Corporate Entity & Attribution
- Company Legal Name: Durbhasi Gurukulam Private Limited (DGPL)
- Registered Office:
2., P. NO. 18, Radha Vihar, Manchwa, Jaipur, Rajasthan 303706 - Official Support Email:
support@durbhasigurukulam.com - Official Contact Phone:
+91 7852034945 - License: GNU General Public License v3.0 (GPL-3.0)