liguodongiot--llm-action/llm-inference/tensorrt

镜像：

• https://catalog.ngc.nvidia.com/orgs/nvidia/containers/pytorch

python tar包安装：

• https://docs.nvidia.com/deeplearning/tensorrt/quick-start-guide/index.html#installing-pip

• https://docs.nvidia.com/deeplearning/tensorrt/install-guide/index.html#installing-tar

• TensorRT: https://github.com/NVIDIA/TensorRT

• Torch-TensorRT: https://github.com/pytorch/TensorRT