bevfusion 学习笔记

目录

[tensorrt ros部署:](#tensorrt ros部署:)

[也依赖ros2 c++](#也依赖ros2 c++)

ros2安装指导:

相机标定工具源码:

官方github,部分模型开源


tensorrt ros部署:

https://github.com/linClubs/BEVFusion-ROS-TensorRT

也依赖ros2 c++

GitHub - newintelligence4/BEVfusion_preprocess: Multiple Lidar preprocessor for BEVfusion

ros2安装指导:

ROS2学习笔记(一)------Win11安装及使用 - 知乎

安装手册:

Windows (binary) --- ROS 2 Documentation: Humble documentation

下载地址:Releases · ros2/ros2 · GitHub

相机标定工具源码:

GitHub - linClubs/Calibration-Is-All-You-Need: calibration is you need including camera、imu、camera2camera、 camera2lidar、imu2camera、imu2lidar.

官方github,部分模型开源

https://github.com/ADLab-AutoDrive/BEVFusion

没有开源centerpoint版,

Main Results

nuScenes detection test

Model Head 3DBackbone 2DBackbone mAP NDS Link
BEVFusion TransFusion-L VoxelNet Dual-Swin-T 69.2 71.8 Detection
BEVFusion* TransFusion-L VoxelNet Dual-Swin-T 71.3 73.3 Leadboard

nuScenes detection validation

Model Head 3DBackbone 2DBackbone mAP NDS Model
BEVFusion PointPillars - Dual-Swin-T 22.9 31.1 Model
BEVFusion PointPillars PointPillars - 35.1 49.8 Model
BEVFusion PointPillars PointPillars Dual-Swin-T 53.5 60.4 Model
BEVFusion CenterPoint - Dual-Swin-T 27.1 32.1 -
BEVFusion CenterPoint VoxelNet - 57.1 65.4 -
BEVFusion CenterPoint VoxelNet Dual-Swin-T 64.2 68.0 -
BEVFusion TransFusion-L - Dual-Swin-T 22.7 26.1 -
BEVFusion TransFusion-L VoxelNet - 64.9 69.9 -
BEVFusion TransFusion-L VoxelNet Dual-Swin-T 67.9 71.0 -
BEVFusion* TransFusion-L VoxelNet Dual-Swin-T 69.6 72.1 Model

GitHub - mit-han-lab/bevfusion: ICRA'23 BEVFusion: Multi-Task Multi-Sensor Fusion with Unified Bird's-Eye View Representation

3D Object Detection (on nuScenes validation)

Model Modality mAP NDS Checkpoint
BEVFusion C+L 68.52 71.38 Link
Camera-Only Baseline C 35.56 41.21 Link
LiDAR-Only Baseline L 64.68 69.28 Link

Note : The camera-only object detection baseline is a variant of BEVDet-Tiny with a much heavier view transformer and other differences in hyperparameters. Thanks to our efficient BEV pooling operator, this model runs fast and has higher mAP than BEVDet-Tiny under the same input resolution. Please refer to BEVDet repo for the original BEVDet-Tiny implementation. The LiDAR-only baseline is TransFusion-L.

BEV Map Segmentation (on nuScenes validation)

Model Modality mIoU Checkpoint
BEVFusion C+L 62.95 Link
Camera-Only Baseline C 57.09 Link
LiDAR-Only Baseline L 48.56 Link
相关推荐
鬓戈13 分钟前
Rust 语言与 AI 应用生态调研及学习路径
人工智能·学习·rust
传奇开心果编程20 分钟前
【SwiftUI娓娓道来】第3课:让界面活起来——交互与动画指南
学习·macos·ui·ios·swiftui·swift
xian_wwq37 分钟前
【学习笔记】等保合规安全基线核查实战
笔记·学习
传奇开心果编程1 小时前
【Jetpack Compose进阶学与练】第14课:系列收尾复习总结;Compose项目常见坑点汇总;学习路线与后续学习方向
android·学习·ui·kotlin·android jetpack
yangmu32031 小时前
发动机是怎么把油变成动力的:四冲程内燃机原理拆解
学习
m4Rk_2 小时前
【论文阅读】Agent 记忆机制(81):EMR——用情景记忆避免 Agent 在多步推理中反复绕圈
论文阅读·人工智能·学习·开源·github
海海不掉头发2 小时前
阶段五_实验34-38_学习总结
深度学习·神经网络·学习·机器学习
M78佐菲2 小时前
ARM学习笔记(11)
linux·arm开发·笔记·嵌入式硬件·学习
M78佐菲2 小时前
ARM学习笔记(10)
linux·arm开发·笔记·嵌入式硬件·学习
dadaobusi2 小时前
学习:PCIe原子操作
学习