Auto merge of #125406 - tbu-:pr_rm_path_with_extension, r=Nadrieril

Directly add extension instead of using `Path::with_extension`

`Path::with_extension` has a nice footgun when the original path doesn't contain an extension: Anything after the last dot gets removed.

Author: bors