Hot 3D 人体姿态估计 HPE Demo复现过程

视频讲解

Hot 3D 人体姿态估计 HPE Demo复现过程

使用conda进行环境准备

复制代码
conda create -n hot python=3.9
conda activate hot
pip3 install -r requirements.txt -i https://mirrors.tuna.tsinghua.edu.cn/pypi/web/simple

下载human3.6M dataset

https://drive.google.com/file/d/1FMgAf_I04GlweHMfgUKzB0CMwglxuwPe/view

解压后把npz放进./data文件夹下

下载pretrained-model

https://drive.google.com/drive/folders/1Mr00vyPXMnAX2lA4r1r2L3nR1bR4wvoN

下载YOLOv3 and HRNet pretrained models

https://drive.google.com/drive/folders/1_ENAMOsPM7FXmdYRbkwbFHgzQq_B_NQA

放到./demo/lib/checkpoint

三个地方的文件下载完成后,如下图的目录

跑一下demo

复制代码
python demo/vis.py --video sample_video.mp4

报错

复制代码
- 标题:Hourglass Tokenizer for Efficient Transformer-Based 3D Human Pose Estimation
- 论文地址:https://arxiv.org/abs/2311.12028
- 代码地址:https://github.com/NationalGAILab/HoT
使用conda进行环境准备
conda create -n hot python=3.9
conda activate hot
pip3 install -r requirements.txt -i https://mirrors.tuna.tsinghua.edu.cn/pypi/web/simple
下载human3.6M dataset  
https://drive.google.com/file/d/1FMgAf_I04GlweHMfgUKzB0CMwglxuwPe/view
解压后把npz放进./data文件夹下

下载pretrained-model
https://drive.google.com/drive/folders/1Mr00vyPXMnAX2lA4r1r2L3nR1bR4wvoN


下载YOLOv3 and HRNet pretrained models
https://drive.google.com/drive/folders/1_ENAMOsPM7FXmdYRbkwbFHgzQq_B_NQA
./demo/lib/checkpoint

三个地方的文件下载完成后,如下图的目录


跑一下demo
python demo/vis.py --video sample_video.mp4
报错
python demo/vis.py --video sample_video.mp4
A module that was compiled using NumPy 1.x cannot be run in
NumPy 2.0.2 as it may crash. To support both 1.x and 2.x
versions of NumPy, modules must be compiled with NumPy 2.0.
Some module may need to rebuild instead e.g. with 'pybind11>=2.12'.
If you are a user of the module, the easiest solution will be to
downgrade to 'numpy<2' or try to upgrade the affected module.
We expect that some modules will need time to support NumPy 2.
Traceback (most recent call last):  File "/home/dar/model/HoT/demo/vis.py", line 15, in <module>
import matplotlib
File "/home/dar/miniconda3/envs/hot/lib/python3.9/site-packages/matplotlib/__init__.py", line 131, in <module>
from . import _api, _version, cbook, _docstring, rcsetup
File "/home/dar/miniconda3/envs/hot/lib/python3.9/site-packages/matplotlib/rcsetup.py", line 27, in <module>
from matplotlib.colors import Colormap, is_color_like
File "/home/dar/miniconda3/envs/hot/lib/python3.9/site-packages/matplotlib/colors.py", line 56, in <module>
from matplotlib import _api, _cm, cbook, scale
File "/home/dar/miniconda3/envs/hot/lib/python3.9/site-packages/matplotlib/scale.py", line 22, in <module>
from matplotlib.ticker import (
File "/home/dar/miniconda3/envs/hot/lib/python3.9/site-packages/matplotlib/ticker.py", line 138, in <module>
from matplotlib import transforms as mtransforms
File "/home/dar/miniconda3/envs/hot/lib/python3.9/site-packages/matplotlib/transforms.py", line 49, in <module>
from matplotlib._path import (
AttributeError: _ARRAY_API not found
Traceback (most recent call last):
File "/home/dar/model/HoT/demo/vis.py", line 15, in <module>
import matplotlib
File "/home/dar/miniconda3/envs/hot/lib/python3.9/site-packages/matplotlib/__init__.py", line 131, in <module>
from . import _api, _version, cbook, _docstring, rcsetup
File "/home/dar/miniconda3/envs/hot/lib/python3.9/site-packages/matplotlib/rcsetup.py", line 27, in <module>
from matplotlib.colors import Colormap, is_color_like
File "/home/dar/miniconda3/envs/hot/lib/python3.9/site-packages/matplotlib/colors.py", line 56, in <module>
from matplotlib import _api, _cm, cbook, scale
File "/home/dar/miniconda3/envs/hot/lib/python3.9/site-packages/matplotlib/scale.py", line 22, in <module>
from matplotlib.ticker import (
File "/home/dar/miniconda3/envs/hot/lib/python3.9/site-packages/matplotlib/ticker.py", line 138, in <module>
from matplotlib import transforms as mtransforms
File "/home/dar/miniconda3/envs/hot/lib/python3.9/site-packages/matplotlib/transforms.py", line 49, in <module>
from matplotlib._path import (
ImportError: numpy.core.multiarray failed to import

使用 conda update matplotlib 解决

再运行一次,生成的视频,3d pose 2d pose都在output目录下

相关推荐
amhjdx2 小时前
星巽短剧以科技赋能影视创新,构建全球短剧新生态!
人工智能·科技
听风南巷2 小时前
机器人全身控制WBC理论及零空间原理解析(数学原理解析版)
人工智能·数学建模·机器人
美林数据Tempodata3 小时前
“双新”指引,AI驱动:工业数智应用生产性实践创新
大数据·人工智能·物联网·实践中心建设·金基地建设
电科_银尘3 小时前
【大语言模型】-- 私有化部署
人工智能·语言模型·自然语言处理
翔云 OCR API4 小时前
人工智能驱动下的OCR API技术演进与实践应用
人工智能·ocr
南方者5 小时前
重磅升级!文心 ERNIE-5.0 新一代原生全模态大模型,这你都不认可它吗?!
人工智能·aigc
庄周迷蝴蝶5 小时前
旋转位置编码(Rotary Position Embedding,RoPE)
人工智能·机器学习
xier_ran5 小时前
深度学习:RMSprop 优化算法详解
人工智能·深度学习·算法
大千AI助手5 小时前
Prefix-Tuning:大语言模型的高效微调新范式
人工智能·神经网络·自然语言处理·llm·prefix-tuning·大千ai助手·前缀微调
雾江流5 小时前
RikkaHub 1.6.11 | 开源的本地大型语言模型聚合应用,支持多种AI服务提供商
人工智能·语言模型·自然语言处理·软件工程