> ## Documentation Index
> Fetch the complete documentation index at: https://docs.tensormesh.ai/llms.txt
> Use this file to discover all available pages before exploring further.

# Metrics

> Every chart on the Operator UI Metrics page.

The **Metrics** screen shows trends over time for one engine. Pick an engine with the filter
in the page header and a time range with the range selector. Charts are grouped into four tabs.

Every chart reads a signal from the platform [Metrics reference](/observability/metrics); this page
maps each chart on the screen to the metric behind it. It needs your Prometheus connected (see
[Configuration](/ui/configuration)), and the GPU charts need the DCGM exporter.

## Serving

GPU and host load, and how much of each request the cache serves.

| Chart                | What it shows                                                     | Metric                                                                            |
| -------------------- | ----------------------------------------------------------------- | --------------------------------------------------------------------------------- |
| GPU Utilization      | Per-node GPU busy %, from the DCGM exporter                       | `DCGM_FI_DEV_GPU_UTIL`                                                            |
| Host CPU Utilization | Per-node CPU busy %                                               | `node_cpu_utilisation` (rate)                                                     |
| Cache Hit Rate       | Share of requested tokens served from cache instead of recomputed | `lmcache_mp_lookup_hit_tokens_total` / `lmcache_mp_lookup_requested_tokens_total` |

## Cache Capacity

How full each tier is, and how fast entries turn over.

| Chart                    | What it shows                                       | Metric                                                                            |
| ------------------------ | --------------------------------------------------- | --------------------------------------------------------------------------------- |
| L1 Fill Per Node         | Host-DRAM (L1) fill per node                        | `lmcache_mp_l1_usage_ratio` (bytes: `lmcache_mp_l1_memory_usage_bytes`)           |
| GPU HBM Fill             | GPU memory used vs total, per node                  | `DCGM_FI_DEV_FB_USED` / (`DCGM_FI_DEV_FB_USED` + `DCGM_FI_DEV_FB_FREE`)           |
| L1 Eviction Rate         | Chunks evicted from L1 under pressure               | `lmcache_mp_l1_evicted_chunks_total`                                              |
| L2 Backend Fill / Stored | External-storage (L2) bytes held, or objects stored | `lmcache_mp_l2_usage_bytes`, `lmcache_mp_l2_store_submitted_objects_chunks_total` |

## Cache Activity

Reads vs writes, and traffic between tiers.

| Chart                            | What it shows                                | Metric                                                                                               |
| -------------------------------- | -------------------------------------------- | ---------------------------------------------------------------------------------------------------- |
| L1 Activity — Read vs Write      | L1 reads (reuse) vs writes (ingest)          | `lmcache_mp_l1_read_chunks_total` / `lmcache_mp_l1_write_chunks_total`                               |
| L2 Activity — Store vs Load      | L2 store vs load requests                    | `lmcache_mp_l2_store_completed_requests_total` / `lmcache_mp_l2_load_completed_requests_total`       |
| L0↔L1 Throughput — Store vs Load | GPU↔DRAM transfer rate (GB/s)                | `lmcache_mp_l0_l1_store_throughput_GB_per_second` / `lmcache_mp_l0_l1_load_throughput_GB_per_second` |
| L2 Throughput — Store vs Load    | External-storage transfer rate (GB/s)        | `lmcache_mp_l2_store_throughput_GB_per_second` / `lmcache_mp_l2_load_throughput_GB_per_second`       |
| Retrieved Chunk Volume           | Chunks loaded back into service              | `lmcache_mp_num_chunks_loaded_total`                                                                 |
| Prefetch Failure Rate            | Prefetches that failed (miss or L1 pressure) | `lmcache_mp_l2_prefetch_failure_chunks_total`                                                        |

## Quotas

Per-workload cache budget and usage — which workloads (keyed by tenant `cache_salt`) are within or
over their configured budget.

## Related

* [Monitoring Your Fleet](/ui/monitoring-your-fleet)
* [Thresholds & Notifications](/ui/thresholds-and-notifications)
* [Metrics reference](/observability/metrics)
