Get GPU Processor Usage Programmatically

Question

Is there is anyway to get the GPU processor usage using CUDA. I want to get the processor usage of each GPU connected in a cluster and to assign the job to the GPU having least processor usage.

Operating system i am using is Windows 7 64bit. All the connected GPUs have fermi architecture

Please help.

Answer 1

NVIDIA Management Library is a C-based API for monitoring and managing various states of the NVIDIA GPU devices. It provides a direct access to the queries and commands exposed via the cmdline tool nvidia-smi.

https://developer.nvidia.com/nvidia-management-library-nvml