TensorRT-LLM Release 0.18.1

[kaiyux]

Key Features and Enhancements

• The 0.18.x series of releases builds upon the 0.17.0 release, focusing exclusively on dependency updates without incorporating features from the previous 0.18.0.dev pre-releases. These features will be included in future stable releases.

Infrastructure Changes

• The dependent transformers package version is updated to 4.48.3.

---

This discussion was created from the release TensorRT-LLM Release 0.18.1.

[michaelfeil]

Is the wheel coming with Blackwell support. Does the tag of this release come with Blackwell support when build with sm100 support?

[chzblych]

Is the wheel coming with Blackwell support. Does the tag of this release come with Blackwell support when build with sm100 support?

It is the same as the previous 0.17.0 release.

NOTE: pip installation is not supported for TRT-LLM 0.17 on Blackwell platforms only. Instead, it is recommended that the user build from source using NVIDIA NGC 25.01 PyTorch container.

The pre-built wheels on NVIDIA PYPI will support Blackwell / SM100 when the upstream PyTorch supports Blackwell in its stable release.

[michaelfeil]

Thanks so much for the reply. Looking forward to the first release with Blackwell support in the python wheels, now that torch=2.7 is released.

[chzblych]

This week's release wheels from the main branch - https://github.com/NVIDIA/TensorRT-LLM/releases/tag/v0.20.0rc3 - support Blackwell.

Please refer to https://nvidia.github.io/TensorRT-LLM/0.20.0rc3/installation/linux.html.