配置环境
- MMAction2 1.2.0 配置MMAction2环境
- CUDA 11.8 安装CUDA,cuDNN,NCCL
- cuDNN 8.4.1 安装CUDA,cuDNN,NCCL
- TensorRT GA 8.6 配置TensorRT环境
- MMDeploy
pip install mmdeploy
- pytorch 2.0.1, torchvision 0.15.2
conda install -y pytorch==2.0.1 torchvision==0.15.2 pytorch-cuda=11.8 -c pytorch -c nvidia
- numpy 1.26.3
- pycuda 配置TensorRT环境(只需要推理的时候使用,仅仅转换的话不需要)
执行一个MMAction2的Demo
执行 demo/demo.py
,并使用 tsm
配置文件。
bash
python demo/demo.py "configs/recognition/tsm/tsm_imagenet-pretrained-r50_8xb16-1x1x16-50e_kinetics400-rgb.py" "../mmaction2 Ckpt/tsm_imagenet-pretrained-r50_8xb16-1x1x16-50e_kinetics400-rgb_20220831-042b1748.pth" "demo/demo.mp4" "tools/data/kinetics/label_map_k400.txt"
将Demo转为TensorRT
Clone the mmdeploy repo: git clone -b main https://github.com/open-mmlab/mmdeploy.git
假设当前路径是:
其中 Ckpt
存放了 .pth
文件,将要生成的 .onnx
和 .engine
也会放在 Ckpt
中。.engine
就是转换好的 TensorRT 文件。
执行下面的指令完成TensorRT转换:
bash
cd mmdeploy
python tools/deploy.py "configs/mmaction/video-recognition/video-recognition_2d_tensorrt_static-224x224.py" "../mmaction2/configs/recognition/tsm/tsm_imagenet-pretrained-r50_8xb16-1x1x16-50e_kinetics400-rgb.py" "../Ckpt/tsm_imagenet-pretrained-r50_8xb16-1x1x16-50e_kinetics400-rgb_20220831-042b1748.pth" "tests/data/arm_wrestling.mp4" --work-dir "../Ckpt/tsm_trt" --device cuda:0 --show --dump-info
会遇到报错:
Error Code 4: Internal Error (input: kMIN dimensions in profile 0 are [1,250,3,224,224] but input has static dimensions [1,160,3,224,224].)
Because the shape in mmdeploy/configs/mmaction/video-recognition/video-recognition_2d_tensorrt_static-224x224.py
is default as [1, 250, 3, 224, 224]
, while the shape of tests/data/arm_wrestling.mp4
is [1, 160, 3, 224, 224]
. The shapes should be the same.
修改 [1, 250, 3, 224, 224]
为 [1, 160, 3, 224, 224]
后即可。