Metrics

Every chart on the Operator UI Metrics page.

The Metrics screen shows trends over time for one engine. Pick an engine with the filter in the page header and a time range with the range selector. Charts are grouped into four tabs.

Every chart reads a signal from the platform Metrics reference; this page maps each chart on the screen to the metric behind it. It needs your Prometheus connected (see Configuration), and the GPU charts need the DCGM exporter.

Serving

GPU and host load, and how much of each request the cache serves.

Chart	What it shows	Metric
GPU Utilization	Per-node GPU busy %, from the DCGM exporter	DCGM_FI_DEV_GPU_UTIL
Host CPU Utilization	Per-node CPU busy %	node_cpu_utilisation (rate)
Cache Hit Rate	Share of requested tokens served from cache instead of recomputed	lmcache_mp_lookup_hit_tokens_total / lmcache_mp_lookup_requested_tokens_total

Cache Capacity

How full each tier is, and how fast entries turn over.

Chart	What it shows	Metric
L1 Fill Per Node	Host-DRAM (L1) fill per node	lmcache_mp_l1_usage_ratio (bytes: lmcache_mp_l1_memory_usage_bytes)
GPU HBM Fill	GPU memory used vs total, per node	DCGM_FI_DEV_FB_USED / (DCGM_FI_DEV_FB_USED + DCGM_FI_DEV_FB_FREE)
L1 Eviction Rate	Chunks evicted from L1 under pressure	lmcache_mp_l1_evicted_chunks_total
L2 Backend Fill / Stored	External-storage (L2) bytes held, or objects stored	lmcache_mp_l2_usage_bytes, lmcache_mp_l2_store_submitted_objects_chunks_total

Cache Activity

Reads vs writes, and traffic between tiers.

Chart	What it shows	Metric
L1 Activity — Read vs Write	L1 reads (reuse) vs writes (ingest)	lmcache_mp_l1_read_chunks_total / lmcache_mp_l1_write_chunks_total
L2 Activity — Store vs Load	L2 store vs load requests	lmcache_mp_l2_store_completed_requests_total / lmcache_mp_l2_load_completed_requests_total
L0↔L1 Throughput — Store vs Load	GPU↔DRAM transfer rate (GB/s)	lmcache_mp_l0_l1_store_throughput_GB_per_second / lmcache_mp_l0_l1_load_throughput_GB_per_second
L2 Throughput — Store vs Load	External-storage transfer rate (GB/s)	lmcache_mp_l2_store_throughput_GB_per_second / lmcache_mp_l2_load_throughput_GB_per_second
Retrieved Chunk Volume	Chunks loaded back into service	lmcache_mp_num_chunks_loaded_total
Prefetch Failure Rate	Prefetches that failed (miss or L1 pressure)	lmcache_mp_l2_prefetch_failure_chunks_total

Quotas

Per-workload cache budget and usage — which workloads (keyed by tenant cache_salt) are within or over their configured budget.

Related

• Monitoring Your Fleet
• Thresholds & Notifications
• Metrics reference