bevfusion 学习笔记

目录

[tensorrt ros部署:](#tensorrt ros部署:)

[也依赖ros2 c++](#也依赖ros2 c++)

ros2安装指导:

相机标定工具源码:

官方github,部分模型开源


tensorrt ros部署:

https://github.com/linClubs/BEVFusion-ROS-TensorRT

也依赖ros2 c++

GitHub - newintelligence4/BEVfusion_preprocess: Multiple Lidar preprocessor for BEVfusion

ros2安装指导:

ROS2学习笔记(一)------Win11安装及使用 - 知乎

安装手册:

Windows (binary) --- ROS 2 Documentation: Humble documentation

下载地址:Releases · ros2/ros2 · GitHub

相机标定工具源码:

GitHub - linClubs/Calibration-Is-All-You-Need: calibration is you need including camera、imu、camera2camera、 camera2lidar、imu2camera、imu2lidar.

官方github,部分模型开源

https://github.com/ADLab-AutoDrive/BEVFusion

没有开源centerpoint版,

Main Results

nuScenes detection test

Model Head 3DBackbone 2DBackbone mAP NDS Link
BEVFusion TransFusion-L VoxelNet Dual-Swin-T 69.2 71.8 Detection
BEVFusion* TransFusion-L VoxelNet Dual-Swin-T 71.3 73.3 Leadboard

nuScenes detection validation

Model Head 3DBackbone 2DBackbone mAP NDS Model
BEVFusion PointPillars - Dual-Swin-T 22.9 31.1 Model
BEVFusion PointPillars PointPillars - 35.1 49.8 Model
BEVFusion PointPillars PointPillars Dual-Swin-T 53.5 60.4 Model
BEVFusion CenterPoint - Dual-Swin-T 27.1 32.1 -
BEVFusion CenterPoint VoxelNet - 57.1 65.4 -
BEVFusion CenterPoint VoxelNet Dual-Swin-T 64.2 68.0 -
BEVFusion TransFusion-L - Dual-Swin-T 22.7 26.1 -
BEVFusion TransFusion-L VoxelNet - 64.9 69.9 -
BEVFusion TransFusion-L VoxelNet Dual-Swin-T 67.9 71.0 -
BEVFusion* TransFusion-L VoxelNet Dual-Swin-T 69.6 72.1 Model

GitHub - mit-han-lab/bevfusion: ICRA'23 BEVFusion: Multi-Task Multi-Sensor Fusion with Unified Bird's-Eye View Representation

3D Object Detection (on nuScenes validation)

Model Modality mAP NDS Checkpoint
BEVFusion C+L 68.52 71.38 Link
Camera-Only Baseline C 35.56 41.21 Link
LiDAR-Only Baseline L 64.68 69.28 Link

Note : The camera-only object detection baseline is a variant of BEVDet-Tiny with a much heavier view transformer and other differences in hyperparameters. Thanks to our efficient BEV pooling operator, this model runs fast and has higher mAP than BEVDet-Tiny under the same input resolution. Please refer to BEVDet repo for the original BEVDet-Tiny implementation. The LiDAR-only baseline is TransFusion-L.

BEV Map Segmentation (on nuScenes validation)

Model Modality mIoU Checkpoint
BEVFusion C+L 62.95 Link
Camera-Only Baseline C 57.09 Link
LiDAR-Only Baseline L 48.56 Link
相关推荐
MartinYeung56 小时前
[论文学习]自主性如何重塑个性化对LLM智能体隐私关切与信任的影响
人工智能·学习
FellAveal7 小时前
【Go语言入门学习笔记】Part18.工作池与WaitGroup(也即协程池)
笔记·学习·golang
xqqxqxxq7 小时前
Java Socket 多人聊天室(私聊+群聊)技术笔记(V4版本)
java·网络·笔记
菜鸟‍7 小时前
【论文学习】MICCAI 2024 || SGSeg:通过自引导机制实现胸部X光片语言引导分割的无文本推理
人工智能·深度学习·学习
龙仔7257 小时前
人大金仓OS_Core数据库自动备份实施笔记(银河麒麟Linux)
linux·数据库·笔记·备份·人大金仓
lazy H7 小时前
Git clone 怎么用?克隆项目及常见问题完整教程
大数据·git·后端·学习·搜索引擎·github
菜鸟‍7 小时前
【论文学习】arxiv 2024 || RoSIS:基于鲁棒框架重新审视文本提示式手术器械分割
人工智能·学习·计算机视觉
笨鸟先飞的橘猫9 小时前
只会脚本语言的游戏后端自我提升之路——c++学习(开篇)
学习·游戏
Z5998178419 小时前
c#软件开发学习笔记--Modbus-RTU通讯
笔记·学习·c#
绿浪198410 小时前
async/await 深入学习
学习