How to check GPU usage and memory

Software and Programming GPU
1

I can monitor the CPU usage and CPU memory under Grafana. For example,

  1. CPU usage: Grafana
  2. CPU memory: Grafana

So how can I check GPU usage and GPU memory in a similar way?

2

Hi,

There’s no grafana dashboard that shows GPU utilization. The only option is to log in to the compute node of interest and run nvidia-smi.

3

Thanks for your help, I get it.