New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Multi -graphics card utilization problem #829

Open

FlypigW opened this issue Dec 9, 2024 · 0 comments

FlypigW commented Dec 9, 2024

When I run my computing program through Docker, only one graphics card's video memory is completely occupied, and other graphics cards do not work. How should I use all my graphics cards?
Mon Dec 9 10:36:11 2024
+-----------------------------------------------------------------------------------------+
| NVIDIA-SMI 560.28.03 Driver Version: 560.28.03 CUDA Version: 12.6 |
|-----------------------------------------+------------------------+----------------------+
| GPU Name Persistence-M | Bus-Id Disp.A | Volatile Uncorr. ECC |
| Fan Temp Perf Pwr:Usage/Cap | Memory-Usage | GPU-Util Compute M. |
| | | MIG M. |
|=========================================+========================+======================|
| 0 NVIDIA A10 Off | 00000000:34:00.0 Off | 0 |
| 0% 35C P0 55W / 150W | 21731MiB / 23028MiB | 0% Default |
| | | N/A |
+-----------------------------------------+------------------------+----------------------+
| 1 NVIDIA A10 Off | 00000000:36:00.0 Off | 0 |
| 0% 36C P0 56W / 150W | 237MiB / 23028MiB | 0% Default |
| | | N/A |
+-----------------------------------------+------------------------+----------------------+
| 2 NVIDIA A10 Off | 00000000:9B:00.0 Off | 0 |
| 0% 37C P0 58W / 150W | 237MiB / 23028MiB | 0% Default |
| | | N/A |
+-----------------------------------------+------------------------+----------------------+
| 3 NVIDIA A10 Off | 00000000:9D:00.0 Off | 0 |
| 0% 36C P0 56W / 150W | 237MiB / 23028MiB | 0% Default |
| | | N/A |
+-----------------------------------------+------------------------+----------------------+

+-----------------------------------------------------------------------------------------+
| Processes: |
| GPU GI CI PID Type Process name GPU Memory |
| ID ID Usage |
|=========================================================================================|
| 0 N/A N/A 3006916 C python 21722MiB |
| 1 N/A N/A 3006916 C python 228MiB |
| 2 N/A N/A 3006916 C python 228MiB |
| 3 N/A N/A 3006916 C python 228MiB |
+-----------------------------------------------------------------------------------------+

cuda：12.6
cli-version: 1.13.5
lib-version: 1.13.5
build compiler: x86_64-linux-gnu-gcc-7 7.5.0
and I have done this before. #381 (comment)

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment