当前位置:网站首页>realsense d455 semantic_slam实现语义八叉树建图
realsense d455 semantic_slam实现语义八叉树建图
2022-06-25 06:39:00 【蓝羽飞鸟】
orb_slam2 + 语义分割 + 八叉树地图,
github地址:https://github.com/floatlazer/semantic_slam
环境配置参考链接
现在说说要用d455来实现实时建图,需要修改哪些地方。
首先要安装intel realsense的sdk,
到realsense-viewer可成功显示界面即成功
然后安装realsense的ros wrapper, 让d455可通过ros发送topic
安装方法
这一步需要同时安装ddynamic_reconfigure包,从github上下载下来,
和realsen_ros同放在catkin_ws/src下make即可
直到roslaunch realsense_camera rs_rgbd.launch能启动
关于深度图用哪个topic的问题:
深度图有的地方说要用/camera/depth/image_rect_raw
也有的说用/camera/aligned_depth_to_color/image_raw
(具体相机发布了哪些topic可以用rostopic list命令确认)
注意用roslaunch realsense_camera rs_camera.launch启动相机是没有/camera/aligned_depth_to_color/image_raw的
在rviz里观察了一下/camera/depth/image_rect_raw 和 /camera/aligned_depth_to_color/image_raw两个图片,
发现/camera/aligned_depth_to_color/image_raw的深度图是和rgb图像对齐的,
也就是说/camera/depth/image_rect_raw 这个深度图照的范围可能会比rgb图像更广,叠在一起的话可能都不会重叠。
所以我选了/camera/aligned_depth_to_color/image_raw,
当然不同的相机可能会不一样。
确定了rgb图像/camera/color/image_raw和深度图/camera/aligned_depth_to_color/image_raw之后,
要修改orb_slam2下的ros_rgbd.cc, 修改topic名称。
然后要修改semantic_slam/semantic_slam/params下的semantic_cloud.yaml,修改topic
同时需要修改语义网络的path,即model_path,到pth文件的地方
修改相机内参:
相机标定有几种方法,可以用ros包,realsense自带的命令,也可以拍几张图片用matlab标定,
标定好之后,修改semantic_slam/semantic_slam/params下的semantic_cloud.yaml和xtion.yaml,
xtion.yaml文件是启动orb_slam2的配置文件。
这个时候语义分割图片已经能显示出来了,但是显示不了八叉图地图!
问题出在哪呢,
可以看到问题出在semantic_cloud.py,里面直接用了深度图,而没有用DepthMapFactor进行scale,
而我们可以看到在orb_slam2中深度图是经过了scale的
imDepth.convertTo(imDepth,CV_32F,mDepthMapFactor);
我们需要做同样的事情,在semantic_cloud.yaml中定义DepthMapFactor,然后把semantic_cloud.py中的深度图进行scale。
然后就能建图啦:
边栏推荐
- 【UVM入門 ===> Episode_9 】~ 寄存器模型、寄存器模型的集成、寄存器模型的常規方法、寄存器模型的應用場景
- [batch dos-cmd command - summary and summary] - application startup and call, service and process operation commands (start, call, and)
- Tempest HDMI leak receive 1
- Debian introduction
- 稳压二极管的原理,它有什么作用?
- Harmony美食菜单界面
- 韩信大招:一致性哈希
- 【批处理DOS-CMD命令-汇总和小结】-上网和网络通信相关命令(ping、telnet、nslookup、arp、tracert、ipconfig)
- Authentique Photoshop 2022 expérience d'achat partage
- 【pytest】修改allure报告中的logo及参数化
猜你喜欢
![[Yu Yue education] engineering testing technology reference of Wenhua University](/img/69/50a8786ea062a541df9e07c1e16db5.jpg)
[Yu Yue education] engineering testing technology reference of Wenhua University

稳压二极管的原理,它有什么作用?

高数基础_函数的奇偶性

我的处女作杀青啦!
![[Batch dos - cmd Command - Summary and Summary] - External Command - cmd Download Command, wget Command](/img/00/5a5b081b78ad6a6c1c3a3c847dd315.png)
[Batch dos - cmd Command - Summary and Summary] - External Command - cmd Download Command, wget Command

Harmony美食菜单界面

Advanced mathematics foundation_ Parity of functions

Research on 3D model retrieval method based on two channel attention residual network - Zhou Jie - paper notes

Sichuan Tuwei ca-if1051 can transceiver has passed aec-q100 grade 1 certification

Evolution of Alibaba e-commerce architecture
随机推荐
How is the network connected?
CGLIB动态代理
Tempest HDMI leak receive 2
College entrance examination voluntary filling, why is the major the last consideration?
高考志愿填报,为啥专业最后考虑?
JMeter introduction practice ----- use of global variables and local variables
Domestic MCU perfectly replaces STM chip model of Italy France
14 BS object Node name Name attrs string get node name attribute content
Design a MySQL table for message queue to store message data
正版photoshop2022购买体验经历分享
LabVIEW generate application (exe) and installer
几款不错的天气插件
线程状态变化涉及哪些常用 API
How do I create a guid in excel- How to create a GUID in Excel?
lotus v1.16.0-rc3 calibnet
[Batch dos - cmd Command - Summary and Summary] - cmd extension Command, extension Function (CMD / E: on, CMD / E: off)
How comfortable it is to use Taijiquan to talk about distributed theory!
【批處理DOS-CMD命令-匯總和小結】-外部命令-cmd下載命令、抓包命令(wget)
Unity3D邪门实现之GUI下拉菜单Dropdown设计无重复项
Chuantu microelectronics breaks through the high-end isolator analog chip market with ca-is3062w