Unmonitored GPU activity

[timgianitsos]

I created a pod to access an MI300X.

I'm using nvtop to monitor GPU utilization. I keep seeing unexpected GPU activity even when there are no processes visible from within my kubernetes-pod.

Do I not have exclusive access to the MI300X that my pod has claimed?

There would normally be processes listed under the green bar if they were utilizing the GPU, but notice how there are none.