Computational stereo performance has progressed such that several commercial or open source implementations are available which operate at frame rate, but suffer from well known correspondence errors. We show that introducing a global segmentation step after commodity stereo can increase robustness and leverage existing stereo software. The global segmentation step is based on a graph structure appropriate for collision detection, human vision inspired foveation, perceptual organization and graph partitioning using the minimum s-t graph cut. This system has been prototyped using the Sarnoff Acadia I vision processor to enable processing of 640×480 resolution imagery at 5-10Hz operation on embedded avionics. We describe system theory, demonstrate segmentation results on scenes of increasing complexity, and show flight experiment results on Georgia Tech’s GT-Max autonomous helicopter against real collision obstacles.
- J. Byrne, M. Cosgrove, and R. Mehra, “Stereo Based Obstacle Detection for an Unmanned Air Vehicle”, Proceedings of the 2006 IEEE International Conference on Robotics and Automation (ICRA), May 15-19, 2006, pp. 2830 – 2835; [pdf]