How to check GPU usage and memory

I can monitor the CPU usage and CPU memory under Grafana. For example,

  1. CPU usage: Grafana
  2. CPU memory: Grafana

So how can I check GPU usage and GPU memory in a similar way?


There’s no grafana dashboard that shows GPU utilization. The only option is to log in to the compute node of interest and run nvidia-smi.

Thanks for your help, I get it.