Python GPU Resource Utilization

Question

I have a Python script running inference on some deep learning models.

Is there any way I can find out the GPU resource utilization levels? For instance, utilization of shaders, float16 multipliers, etc.

I can't seem to find much documentation online regarding those GPU resources.

Thank you!

KimKulling · Accepted Answer · 2019-12-23 19:53:51Z

1

You can try to run your pyxthon-application in a GPU-Profiler like Renderdoc. It will analyse you your run. You will be able to get information about th eused resources, used buffers, output on the different renderstates etc.

Just check Renderdoc-website to learn more about it.

answered Dec 23, 2019 at 19:53

KimKulling

2,8531 gold badge17 silver badges33 bronze badges

Sign up to request clarification or add additional context in comments.

Comments

quasiben · Accepted Answer · 2020-01-08 18:17:28Z

0

Yes, you can do this with pynvml and if you are using jupyterlab you could use nvdashboard. A recent medium post details the usage of these libraries: https://medium.com/rapids-ai/gpu-dashboards-in-jupyter-lab-757b17aae1d5

answered Jan 8, 2020 at 18:17

quasiben

1,4641 gold badge11 silver badges20 bronze badges

Collectives™ on Stack Overflow

Python GPU Resource Utilization

2 Answers 2

Comments

Comments

Your Answer

Hot Network Questions

Collectives™ on Stack Overflow

2 Answers 2

Comments

Comments

Your Answer

Sign up or log in

Post as a guest

Related