Skip to content

Issues: NVIDIA/TensorRT

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

425 Open 3,432 Closed
425 Open 3,432 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Assignee
Filter by who’s assigned
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Issues list

trt.IStreamReader (as implemented e.g. in polygraphy) requires higher peak CPU memory and more time than naive python implementation.
#4327 opened Jan 16, 2025 by michaelfeil
2
Polygraphy unable to switch context to driver api instead of default context from run time api
#4326 opened Jan 15, 2025 by yshvrdhn
The CUDA graph capture on the stream has failed
#4325 opened Jan 15, 2025 by zsh4614
1
TensorRT 8.6.2 MatrixMultiply Operator Quantization
#4322 opened Jan 15, 2025 by dingliangxiansheng
4
failure of TensorRT 10.5 trying to run python samples
#4321 opened Jan 14, 2025 by davave1693
3
Build engine failure of TensorRT 10.7 when running quantization model on GPU NVIDIA GeForce RTX 3090
#4320 opened Jan 14, 2025 by DuanHongxuan
3
Perfomence: QAT and PTQ choose different Kernel
#4319 opened Jan 14, 2025 by AnnaTrainingG
1
TensorRT 10.7 when generating engine on GPU 5090 laptop
#4317 opened Jan 10, 2025 by chky1997
10
flux can only generate 256x256---1344x1344 for tensorrt?diffuer can generate 2048x2048!
#4315 opened Jan 7, 2025 by bleedingfight
[doc] groupNormalizationPlugin loss readme.md
#4314 opened Jan 7, 2025 by lix19937
GroupNormalization scale and bias issue
#4313 opened Jan 4, 2025 by hrishi121
[Bug]After converting sensevoice's onnx to trt via trtexec, an error is reported triaged Issue has been triaged by maintainers
#4307 opened Dec 31, 2024 by wjj19950828
@asfiyab-nvidia
5
Logger sends messages to stdout rather than stderr Documentation Lack of clarity in documentation triaged Issue has been triaged by maintainers
#4306 opened Dec 30, 2024 by HolyWu
@pranavm-nvidia
3
Different output on python and C++ Accuracy Output mismatch between TensorRT and other frameworks triaged Issue has been triaged by maintainers
#4305 opened Dec 30, 2024 by app-houqiangli
2
I used pytorch-quantization to perform PTQ int8 quantization on ResNet50 and exported it to onnx, followed by exporting it to engine. trt. When reasoning, I found that the speed did not increase, but instead slowed down. What went wrong.
#4304 opened Dec 30, 2024 by jishenghuang
4
Does the plug-in code implemented in cubin such as FlashAttention support the orin platform?
#4301 opened Dec 26, 2024 by lzymmm123
2
Compatible Tensorrt version for Jetpack 5.1.2 and CUDA 12.2
#4300 opened Dec 24, 2024 by mfatih7
3
Onnx does not support block-wise quantization when quantizing a pt model by modelopt. How do I transform pt model to tensorrt?
#4298 opened Dec 23, 2024 by lqq-feel
1
Inserting QDQ has severely impacted the performance of the unquantized Myelin part.
#4297 opened Dec 23, 2024 by zsh4614
3
Building engine failed of TensorRT 8.6.13 when running on GPU H20 Engine Build Issues with engine build triaged Issue has been triaged by maintainers
#4295 opened Dec 23, 2024 by XuDeshengCat
4
AttributeError: 'tensorrt_bindings.tensorrt.ICudaEngine' object has no attribute 'max_batch_size'
#4293 opened Dec 20, 2024 by kratos231245
1
[Question] What is the recommended API for deprecated SetDynamicRange?
#4292 opened Dec 19, 2024 by Benjamin-Tan
1
Internal Error (Could not find any implementation for node {...Tensordot/Reshape}) failure of TensorRT 8.6 when running generate INT8 engine on GPU RTX3080 Engine Build Issues with engine build quantization Issues related to Quantization triaged Issue has been triaged by maintainers
#4291 opened Dec 19, 2024 by yjiangling
@yuanyao-nv
15
Engine cache and model security ONNX Issues relating to ONNX usage and import triaged Issue has been triaged by maintainers
#4290 opened Dec 19, 2024 by MickaMickaMicka
@yuanyao-nv
2
Long Inference Time on First Run After Changing Input Shape in Dynamic Shape TensorRT Engine Demo: Diffusion Issues regarding demoDiffusion triaged Issue has been triaged by maintainers
#4289 opened Dec 19, 2024 by renne444
@asfiyab-nvidia
4
ProTip! Find all open issues with in progress development work with linked:pr.