grafana

Live homelab metrics — system health and LLM inference.

Ronak Haresh Chhatbar
Ronak Haresh Chhatbar Graduate Researcher · SUNY Buffalo · AI & Computer Vision
About me ↗
Range: Open ↗

📊 Homelab — At a Glance ● LIVE

CPU Usage
RAM Used %
Disk /
CPU Temp °C
GPU 0 Util %
GPU 1 Util %
CPU Usage % (user / system / iowait)
Memory — used / cached / free

🤖 LLM Inference — SGLang (CT-102) ● LIVE

Gen Throughput
Running Requests
Queue Depth
KV Cache Used
Cache Hit Rate
GPU Util % (avg)
Throughput over time
Running vs Queued
KV Cache & Hit Rate
GPU Utilization — both GPUs
GPU Memory Used (MB)
E2E Latency (p50/p95/p99)
Open full dashboard ↗