Selection and Compression of Local Binary Features for Remote Visual SLAM

IEEE International Conference on Robotics and Automation (ICRA)
Brisbane, Australia, Mai 2018

Abstract:

In the field of autonomous robotics, Simultaneous Localization and Mapping (SLAM) is still a challenging problem. With cheap visual sensors attracting more and more attention, various solutions to the SLAM problem using visual cues have been proposed. However, current visual SLAM systems are still computationally demanding, especially on embedded devices. In addition, collaborative SLAM approaches emerge using visual information acquired from multiple robots simultaneously to build a joint map.

Scenario
Heterogeneous robot team

In order to address both challenges, we present an approach for remote visual SLAM where local binary features are extracted at the robot, compressed and sent over a network to a centralized powerful processing node running the visual SLAM algorithm.

Architecture
Proposed system architecture

To this end, we propose a new feature coding scheme including a feature selection stage which ensures that only relevant information is transmitted. We demonstrate the effectiveness of our approach on well-known datasets. With the proposed approach, it is possible to build an accurate map while limiting the data rate to 75 kbits/frame.

Overview
Proposed binary feature coding framework

Supplementary Material:

We have tested our code using as encoding hardware a Core i5-6400HQ:

75 kbit/s (r=1) 0.5K feat (r=1) 1K feat (r=1) 75 kbit/s (r=4) 0.5K feat (r=4) 1K feat (r=4)
ORB
12.1 ms
Encoding Time 9.9 ms 9.6 ms 16.5 ms 15.0 ms 15.1 ms 23.4 ms

We have tested our code using as decoding hardware a Core i7-3770:

75 kbit/s (r=1) 0.5K feat (r=1) 1K feat (r=1) 75 kbit/s (r=4) 0.5K feat (r=4) 1K feat (r=4)
Decoding Time 12.8 ms 12.6 ms 24.5 ms 14.1 ms 12.0 ms 23.5 ms
Tracking Time 12.8 ms 12.4 ms 19.2 ms 13.5 ms 12.1 ms 19.9 ms

Please note that these results are obtained from single runs independent from the results presented in the paper. Timings and also the RMSE trajectory error are dependent on many factors. Please note that 75 kbit/s almost provide 500 features/frame for 1 reference frame and about 600 features/frame for 4 reference frames.

Citation:

If you refer to our map compression approach in an academic work, please cite:

    @INPROCEEDINGS{VanOpdenbosch2018
    author = {{Dominik Van Opdenbosch AND Martin Oelsch AND Adrian Garcea AND Tamay Aymut AND Eckehard Steinbach}},
    title = {{Selection and Compression of Local Binary Features for Remote Visual SLAM}},
    booktitle = {{IEEE International Conference on Robotics and Automation (ICRA)}},
    month = {May},
    year = {2018},
    address = {{Brisbane, Australia}}
    }

Source Code:

Our modified ORB-SLAM2 version can be found here.
The binary feature compression pipeline can be found here.
We plan to release an updated version in late 2018.

Update 05.11.2018: A newer version is available here.

Please contact us via dominik (dot) van-opdenbosch [at] tum (dot) de using “ICRA2018” as subject.

Return to main page.