Hot 3D 人体姿态估计 HPE Demo复现过程

视频讲解

Hot 3D 人体姿态估计 HPE Demo复现过程

使用conda进行环境准备

复制代码
conda create -n hot python=3.9
conda activate hot
pip3 install -r requirements.txt -i https://mirrors.tuna.tsinghua.edu.cn/pypi/web/simple

下载human3.6M dataset

https://drive.google.com/file/d/1FMgAf_I04GlweHMfgUKzB0CMwglxuwPe/view

解压后把npz放进./data文件夹下

下载pretrained-model

https://drive.google.com/drive/folders/1Mr00vyPXMnAX2lA4r1r2L3nR1bR4wvoN

下载YOLOv3 and HRNet pretrained models

https://drive.google.com/drive/folders/1_ENAMOsPM7FXmdYRbkwbFHgzQq_B_NQA

放到./demo/lib/checkpoint

三个地方的文件下载完成后,如下图的目录

跑一下demo

复制代码
python demo/vis.py --video sample_video.mp4

报错

复制代码
- 标题:Hourglass Tokenizer for Efficient Transformer-Based 3D Human Pose Estimation
- 论文地址:https://arxiv.org/abs/2311.12028
- 代码地址:https://github.com/NationalGAILab/HoT
使用conda进行环境准备
conda create -n hot python=3.9
conda activate hot
pip3 install -r requirements.txt -i https://mirrors.tuna.tsinghua.edu.cn/pypi/web/simple
下载human3.6M dataset  
https://drive.google.com/file/d/1FMgAf_I04GlweHMfgUKzB0CMwglxuwPe/view
解压后把npz放进./data文件夹下

下载pretrained-model
https://drive.google.com/drive/folders/1Mr00vyPXMnAX2lA4r1r2L3nR1bR4wvoN


下载YOLOv3 and HRNet pretrained models
https://drive.google.com/drive/folders/1_ENAMOsPM7FXmdYRbkwbFHgzQq_B_NQA
./demo/lib/checkpoint

三个地方的文件下载完成后,如下图的目录


跑一下demo
python demo/vis.py --video sample_video.mp4
报错
python demo/vis.py --video sample_video.mp4
A module that was compiled using NumPy 1.x cannot be run in
NumPy 2.0.2 as it may crash. To support both 1.x and 2.x
versions of NumPy, modules must be compiled with NumPy 2.0.
Some module may need to rebuild instead e.g. with 'pybind11>=2.12'.
If you are a user of the module, the easiest solution will be to
downgrade to 'numpy<2' or try to upgrade the affected module.
We expect that some modules will need time to support NumPy 2.
Traceback (most recent call last):  File "/home/dar/model/HoT/demo/vis.py", line 15, in <module>
import matplotlib
File "/home/dar/miniconda3/envs/hot/lib/python3.9/site-packages/matplotlib/__init__.py", line 131, in <module>
from . import _api, _version, cbook, _docstring, rcsetup
File "/home/dar/miniconda3/envs/hot/lib/python3.9/site-packages/matplotlib/rcsetup.py", line 27, in <module>
from matplotlib.colors import Colormap, is_color_like
File "/home/dar/miniconda3/envs/hot/lib/python3.9/site-packages/matplotlib/colors.py", line 56, in <module>
from matplotlib import _api, _cm, cbook, scale
File "/home/dar/miniconda3/envs/hot/lib/python3.9/site-packages/matplotlib/scale.py", line 22, in <module>
from matplotlib.ticker import (
File "/home/dar/miniconda3/envs/hot/lib/python3.9/site-packages/matplotlib/ticker.py", line 138, in <module>
from matplotlib import transforms as mtransforms
File "/home/dar/miniconda3/envs/hot/lib/python3.9/site-packages/matplotlib/transforms.py", line 49, in <module>
from matplotlib._path import (
AttributeError: _ARRAY_API not found
Traceback (most recent call last):
File "/home/dar/model/HoT/demo/vis.py", line 15, in <module>
import matplotlib
File "/home/dar/miniconda3/envs/hot/lib/python3.9/site-packages/matplotlib/__init__.py", line 131, in <module>
from . import _api, _version, cbook, _docstring, rcsetup
File "/home/dar/miniconda3/envs/hot/lib/python3.9/site-packages/matplotlib/rcsetup.py", line 27, in <module>
from matplotlib.colors import Colormap, is_color_like
File "/home/dar/miniconda3/envs/hot/lib/python3.9/site-packages/matplotlib/colors.py", line 56, in <module>
from matplotlib import _api, _cm, cbook, scale
File "/home/dar/miniconda3/envs/hot/lib/python3.9/site-packages/matplotlib/scale.py", line 22, in <module>
from matplotlib.ticker import (
File "/home/dar/miniconda3/envs/hot/lib/python3.9/site-packages/matplotlib/ticker.py", line 138, in <module>
from matplotlib import transforms as mtransforms
File "/home/dar/miniconda3/envs/hot/lib/python3.9/site-packages/matplotlib/transforms.py", line 49, in <module>
from matplotlib._path import (
ImportError: numpy.core.multiarray failed to import

使用 conda update matplotlib 解决

再运行一次,生成的视频,3d pose 2d pose都在output目录下

相关推荐
catchadmin43 分钟前
PHP 快速集成 ChatGPT 用 AI 让你的应用更聪明
人工智能·后端·chatgpt·php
YAY_tyy1 小时前
Three.js 开发实战教程(五):外部 3D 模型加载与优化实战
前端·javascript·3d·three.js
杀生丸学AI1 小时前
【无标题】SceneSplat:基于视觉-语言预训练的3DGS场景理解
3d·aigc·slam·语义分割·三维重建·视觉大模型·空间智能
Zuckjet_4 小时前
开启 3D 之旅 - 你的第一个 WebGL 三角形
前端·javascript·3d·webgl
2401_863801464 小时前
探索 12 种 3D 文件格式:综合指南
前端·3d
编程武士4 小时前
从50ms到30ms:YOLOv10部署中图像预处理的性能优化实践
人工智能·python·yolo·性能优化
max5006005 小时前
基于Meta Llama的二语习得学习者行为预测计算模型
人工智能·算法·机器学习·分类·数据挖掘·llama
月疯6 小时前
OPENCV摄像头读取视频
人工智能·opencv·音视频
极客天成ScaleFlash6 小时前
极客天成让统一存储从云原生‘进化’到 AI 原生: 不是版本升级,而是基因重组
人工智能·云原生
王哥儿聊AI6 小时前
Lynx:新一代个性化视频生成模型,单图即可生成视频,重新定义身份一致性与视觉质量
人工智能·算法·安全·机器学习·音视频·软件工程