Edge Discovery

loading…
Agents (Healthy / Total)
–
Tunnels (Connected / Agents)
–
Models (unique)
–
Queue Depth (sum)
–
CPU (avg %)
–
Memory (avg MB)
–
GPUs (total)
–
VRAM (used/total)
–
Req/s (60s window)
–
vLLM Instances
–
vLLM Tokens
–
vLLM Cache Hit
–
vLLM KV Cache
–
Prompt tok/s (sum)
–
Generation tok/s (sum)
–
Cache hit tok/s (sum)
–

Inference Pools (/inference/{pool} — tunnel-served) [+ new pool]

PoolModelsMembersConfig RequestsFailovers

Live Request Feed [pause] [clear]

Models

ModelAgentsCapabilities

vLLM Instance Metrics [hide]

InstanceAgentRunWait Prompt TokensGen Tokens Tok/s InTok/s OutCache tok/s Cache HitKV CacheGPU Cache Avg TTFTAvg ITL Req (S/L/A) TTFT p50TTFT p95TTFT p99