TensorRT 10.7 when generating engine on GPU 5090 laptop

[chky1997]

Description

Hi, I'm trying to use tensorrt 10.7 to generate engine on Nvidia 5090 laptop. The process failed and I'm not sure if 50XX series are currently not supported. Thank you.

Environment

TensorRT Version: 10.7

NVIDIA GPU: 5090 Laptop

NVIDIA Driver Version: 546.1

CUDA Version: 12.6

[chky1997]

[chky1997]

[johnnynunez]

Maybe you have to use last cuda or incoming cuda 12.7

[chky1997]

--update
I have tried latest cuda 12.6 and the error remains the same. I think tensorrt is not compatible with 50 series not cuda.

[lix19937]

From https://docs.nvidia.com/deeplearning/tensorrt/support-matrix/index.html#compute-capability-platform and https://docs.nvidia.com/deeplearning/tensorrt-cloud/latest/support-compatibility.html, rtx5090 as GeForce gpu as Blackwell arch, current trt version not support it. I think will support soon.

[johnnynunez]

[chky1997]

So will next TensorRT version support 50XX Series (blackwell,12.0)? Will it be released this month?

[lix19937]

@johnnynunez At current time 2025-01-14,
https://docs.nvidia.com/cuda/cuda-toolkit-release-notes/index.html
https://developer.nvidia.com/cuda-toolkit-archive

the latest cuda version is 12.6.

[lix19937]

So will next TensorRT version support 50XX Series (blackwell,12.0)? Will it be released this month?

@kevinch-nv FYI, make sure ?

[johnnynunez]

@lix19937 new cuda 12.7 and drivers are coming for enable binares for build with all libraries

[lix19937]

I think it will not released this month.