Hot 3D 人体姿态估计 HPE Demo复现过程

视频讲解

Hot 3D 人体姿态估计 HPE Demo复现过程

使用conda进行环境准备

复制代码
conda create -n hot python=3.9
conda activate hot
pip3 install -r requirements.txt -i https://mirrors.tuna.tsinghua.edu.cn/pypi/web/simple

下载human3.6M dataset

https://drive.google.com/file/d/1FMgAf_I04GlweHMfgUKzB0CMwglxuwPe/view

解压后把npz放进./data文件夹下

下载pretrained-model

https://drive.google.com/drive/folders/1Mr00vyPXMnAX2lA4r1r2L3nR1bR4wvoN

下载YOLOv3 and HRNet pretrained models

https://drive.google.com/drive/folders/1_ENAMOsPM7FXmdYRbkwbFHgzQq_B_NQA

放到./demo/lib/checkpoint

三个地方的文件下载完成后,如下图的目录

跑一下demo

复制代码
python demo/vis.py --video sample_video.mp4

报错

复制代码
- 标题:Hourglass Tokenizer for Efficient Transformer-Based 3D Human Pose Estimation
- 论文地址:https://arxiv.org/abs/2311.12028
- 代码地址:https://github.com/NationalGAILab/HoT
使用conda进行环境准备
conda create -n hot python=3.9
conda activate hot
pip3 install -r requirements.txt -i https://mirrors.tuna.tsinghua.edu.cn/pypi/web/simple
下载human3.6M dataset  
https://drive.google.com/file/d/1FMgAf_I04GlweHMfgUKzB0CMwglxuwPe/view
解压后把npz放进./data文件夹下

下载pretrained-model
https://drive.google.com/drive/folders/1Mr00vyPXMnAX2lA4r1r2L3nR1bR4wvoN


下载YOLOv3 and HRNet pretrained models
https://drive.google.com/drive/folders/1_ENAMOsPM7FXmdYRbkwbFHgzQq_B_NQA
./demo/lib/checkpoint

三个地方的文件下载完成后,如下图的目录


跑一下demo
python demo/vis.py --video sample_video.mp4
报错
python demo/vis.py --video sample_video.mp4
A module that was compiled using NumPy 1.x cannot be run in
NumPy 2.0.2 as it may crash. To support both 1.x and 2.x
versions of NumPy, modules must be compiled with NumPy 2.0.
Some module may need to rebuild instead e.g. with 'pybind11>=2.12'.
If you are a user of the module, the easiest solution will be to
downgrade to 'numpy<2' or try to upgrade the affected module.
We expect that some modules will need time to support NumPy 2.
Traceback (most recent call last):  File "/home/dar/model/HoT/demo/vis.py", line 15, in <module>
import matplotlib
File "/home/dar/miniconda3/envs/hot/lib/python3.9/site-packages/matplotlib/__init__.py", line 131, in <module>
from . import _api, _version, cbook, _docstring, rcsetup
File "/home/dar/miniconda3/envs/hot/lib/python3.9/site-packages/matplotlib/rcsetup.py", line 27, in <module>
from matplotlib.colors import Colormap, is_color_like
File "/home/dar/miniconda3/envs/hot/lib/python3.9/site-packages/matplotlib/colors.py", line 56, in <module>
from matplotlib import _api, _cm, cbook, scale
File "/home/dar/miniconda3/envs/hot/lib/python3.9/site-packages/matplotlib/scale.py", line 22, in <module>
from matplotlib.ticker import (
File "/home/dar/miniconda3/envs/hot/lib/python3.9/site-packages/matplotlib/ticker.py", line 138, in <module>
from matplotlib import transforms as mtransforms
File "/home/dar/miniconda3/envs/hot/lib/python3.9/site-packages/matplotlib/transforms.py", line 49, in <module>
from matplotlib._path import (
AttributeError: _ARRAY_API not found
Traceback (most recent call last):
File "/home/dar/model/HoT/demo/vis.py", line 15, in <module>
import matplotlib
File "/home/dar/miniconda3/envs/hot/lib/python3.9/site-packages/matplotlib/__init__.py", line 131, in <module>
from . import _api, _version, cbook, _docstring, rcsetup
File "/home/dar/miniconda3/envs/hot/lib/python3.9/site-packages/matplotlib/rcsetup.py", line 27, in <module>
from matplotlib.colors import Colormap, is_color_like
File "/home/dar/miniconda3/envs/hot/lib/python3.9/site-packages/matplotlib/colors.py", line 56, in <module>
from matplotlib import _api, _cm, cbook, scale
File "/home/dar/miniconda3/envs/hot/lib/python3.9/site-packages/matplotlib/scale.py", line 22, in <module>
from matplotlib.ticker import (
File "/home/dar/miniconda3/envs/hot/lib/python3.9/site-packages/matplotlib/ticker.py", line 138, in <module>
from matplotlib import transforms as mtransforms
File "/home/dar/miniconda3/envs/hot/lib/python3.9/site-packages/matplotlib/transforms.py", line 49, in <module>
from matplotlib._path import (
ImportError: numpy.core.multiarray failed to import

使用 conda update matplotlib 解决

再运行一次,生成的视频,3d pose 2d pose都在output目录下

相关推荐
MaisieKim_2 分钟前
如何量化创新项目的成功标准
人工智能
Francek Chen21 分钟前
【深度学习优化算法】02:凸性
人工智能·pytorch·深度学习·优化算法·凸函数
Eastmount33 分钟前
[论文阅读] (38)基于大模型的威胁情报分析与知识图谱构建论文总结(读书笔记)
论文阅读·人工智能·大模型·知识图谱·威胁情报
智源研究院官方账号37 分钟前
更强劲,更高效:智源研究院开源轻量级超长视频理解模型Video-XL-2
人工智能·开源
要努力啊啊啊1 小时前
GQA(Grouped Query Attention):分组注意力机制的原理与实践《一》
论文阅读·人工智能·深度学习·语言模型·自然语言处理
m0_748245171 小时前
KrillinAI:视频跨语言传播的一站式AI解决方案
人工智能·音视频
说私域1 小时前
定制开发开源AI智能名片S2B2C商城小程序在无界零售中的应用与行业智能升级示范研究
人工智能·小程序·开源·零售
蹦蹦跳跳真可爱5891 小时前
计算机视觉处理----OpenCV(从摄像头采集视频、视频处理与视频录制)
人工智能·python·opencv·计算机视觉·音视频
Icoolkj2 小时前
微软推出 Bing Video Creator,免费助力用户轻松创作 AI 视频
人工智能·microsoft·音视频
s153352 小时前
9.RV1126-OPENCV 视频的膨胀和腐蚀
人工智能·opencv·计算机视觉